In the rapidly evolving world of engineering research, understanding the impact of your publications is essential. Traditional metrics like citation counts and journal impact factors provide some insight, but they often fail to capture the full scope of a publication's influence. Altmetrics, or alternative metrics, offer a more comprehensive view by tracking online attention and engagement. This expanded guide explores the definition of altmetrics, their application in engineering, measurement techniques, best practices, limitations, and future directions.

What Are Altmetrics?

Altmetrics are non-traditional metrics that measure the attention a research publication receives across various online platforms. This includes mentions on social media, coverage in news outlets, discussions in blogs, downloads, and bookmarks in reference managers. Unlike traditional citation counts, which can take years to accumulate, altmetrics provide real-time data, giving researchers immediate feedback on their work's reach and influence.

The term "altmetrics" was coined in 2010 as a shorthand for "alternative metrics," but it has evolved to mean "article-level metrics" that complement traditional indicators. The Altmetric.com platform, for example, aggregates mentions from sources like Twitter, Facebook, Wikipedia, news outlets, policy documents, and more. Other platforms include PlumX (now part of Elsevier) and ImpactStory. These tools assign scores based on the number and type of mentions, weighted by source credibility (e.g., a news article counts more than a tweet).

Types of Altmetrics

Altmetrics can be categorized into several types:

  • Social media mentions: Shares, likes, comments on platforms like Twitter, LinkedIn, Facebook, and Reddit.
  • News and blog coverage: Mentions in mainstream journalism or specialized blogs.
  • Policy documents: Citations in government reports or NGO publications.
  • Reference manager usage: Saves, bookmarks in tools like Mendeley, Zotero, CiteULike.
  • Downloads and views: Full-text downloads or abstract views on publisher sites or repositories.
  • Peer reviews and recommendations: Mentions on platforms like PubPeer, F1000Prime, or Review Commons.

Why Use Altmetrics in Engineering Research?

Engineering research often impacts industry, policy, and society in ways that traditional metrics cannot capture. A paper on a novel composite material might be cited by other academics, but its real-world impact may be reflected in patent filings, adoption in construction standards, or media coverage highlighting a breakthrough. Altmetrics help capture the dissemination of research beyond academia, highlighting practical applications, public engagement, and societal relevance.

For example, a study on earthquake-resistant building designs could see high altmetrics activity if it is picked up by news outlets after a major seismic event. Similarly, an open-source software tool developed by engineers might get thousands of downloads and GitHub stars, indicating immediate practical use. Traditional citation counts would only show this influence years later, if at all. Altmetrics thus provide a more timely and diverse view of impact.

Differences from Traditional Metrics

Traditional metrics like the Journal Impact Factor (JIF) and citation counts are slow, biased toward certain fields, and can be manipulated. Altmetrics offer several advantages:

  • Speed: Online attention can be measured days after publication, while citations may take years.
  • Diversity: Altmetrics capture attention from non-academic audiences, including policymakers, industry, and the general public.
  • Granularity: Metrics are available at the article level, not just the journal level, allowing for finer assessment.
  • Openness: Many altmetric providers use open APIs and transparent algorithms, though proprietary systems also exist.

However, altmetrics are not a replacement for traditional metrics but rather a complementary layer. The most robust impact assessment combines both.

How to Measure Impact Using Altmetrics

Measuring impact with altmetrics involves a systematic approach. Here is a step-by-step guide tailored for engineering researchers.

Step 1: Identify Altmetric Sources and Tools

Choose one or more altmetric aggregators that suit your needs. Popular tools include:

  • Altmetric.com: Provides a composite "Altmetric Attention Score" and a donut visualization. It tracks a wide range of sources, including news, blogs, Twitter, policy docs, and Wikipedia.
  • PlumX: Integrated into Scopus, PlumX breaks down metrics into categories: usage, captures, mentions, social media, and citations. It is particularly strong for downloads and bookmarks.
  • ImpactStory: An open-source tool that profiles individual researchers and their publications, showing altmetrics across many sources.
  • Google Scholar and Dimensions: While not primarily altmetric tools, they provide citation counts and sometimes mention counts.

Step 2: Monitor Online Mentions

Once you have selected a tool, track mentions of your publications by entering their DOI or URL. For a holistic view, monitor across multiple platforms. For example, a paper might have high Twitter activity but low news coverage; both are informative. Use alerts provided by tools like Altmetric.com to receive notifications when your paper is mentioned.

Step 3: Analyze Engagement Metrics

Look beyond raw counts. Analyze the context of mentions: Are they positive, critical, or neutral? Are they from authoritative sources (e.g., news outlets) or general public? For engineering research, pay special attention to:

  • Policy citations: Indicates influence on regulations or standards.
  • Patent references: A strong signal of industrial impact sometimes captured by altmetric tools (e.g., via Lens.org).
  • Downloads and usage: From repositories like GitHub, Figshare, or institutional repositories.
  • Educational use: Mentions in syllabi or teaching materials.

Step 4: Compare Across Platforms

Different platforms may show different patterns. For instance, a paper on a popular technology like blockchain in engineering might trend on Twitter more than on Mendeley, while a paper on nanomaterials might get more news coverage. Comparing across platforms helps identify which dissemination channels are most effective for your research. Use this insight to tailor your outreach: if your work gets high Twitter engagement, invest in social media; if news outlets pick it up, write press releases.

Step 5: Interpret and Report

Altmetrics should be contextualized. A high score does not automatically mean high-quality research; it could reflect controversy or a viral but flawed study. Cross-reference with citation counts and peer review. When reporting altmetrics in grants or CVs, explain what they indicate—e.g., "Our paper on renewable energy storage was mentioned in seven news outlets and one policy document, suggesting influence beyond academia."

Best Practices for Using Altmetrics

To effectively utilize altmetrics, consider the following best practices:

Integrate with Traditional Metrics

Use altmetrics alongside citation counts for a comprehensive impact assessment. For example, a paper with both high citations and high altmetrics likely has strong academic and societal impact. Conversely, a paper with low citations but high altmetrics may have immediate practical relevance (e.g., a software tool) that will later accumulate citations. Combining both gives a fuller picture.

Engage with Your Audience

Share your research on social media and respond to discussions to increase visibility. Write blog posts summarizing findings, create infographics, or record short videos. Engaging with journalists can lead to news coverage. For engineering research, consider platforms like LinkedIn for industry stakeholders, Twitter for academic and policy communities, and GitHub for software projects.

Set Clear Goals

Define what impact means for your research. Are you aiming to influence policy? Raise public awareness? Facilitate technology transfer? Align your altmetric tracking with these goals. For instance, if your goal is policy impact, monitor mentions in government documents and news; if it is industrial adoption, track downloads and patent references.

Regularly Review Data

Altmetrics are dynamic. Monitor your publications over time to identify spikes (e.g., after a media mention) and long-term trends. Use dashboards provided by tools like PlumX or Altmetric.com to track changes. Regular review helps you understand which dissemination strategies work and adjust accordingly.

Use Altmetrics for Strategic Planning

Beyond assessment, altmetrics can inform your research strategy. Identify which topics attract public or industrial attention, and consider incorporating those into future projects. For collaborative research, altmetrics can highlight partners whose work gains high online engagement.

Limitations and Challenges of Altmetrics

Altmetrics are not without flaws. Understanding their limitations is crucial for responsible use.

Gaming and Manipulation

Altmetrics can be artificially inflated through coordinated social media campaigns, bot activity, or self-promotion. Some platforms attempt to filter spam, but it is not foolproof. Researchers should be wary of very high scores from low-quality sources. Critical evaluation of mention context is essential.

Quality vs. Quantity

A high number of mentions does not necessarily indicate positive impact. A paper might be widely shared for being controversial or flawed. Altmetrics measure attention, not quality. Therefore, they should be combined with peer review and citation analysis.

Coverage Bias

Altmetrics favor certain disciplines and publication types. Engineering research may be underrepresented in social media compared to, say, health or climate science. Additionally, non-English publications may receive less attention. Normalization by field is challenging.

Platform Dependency

Each altmetric provider uses different sources and weighting algorithms. Scores are not directly comparable across tools. Decide on a consistent tool for your research group and report which tool you used.

Privacy and Ethical Concerns

Tracking mentions may raise privacy issues, especially for individual researchers or patients in medical studies (less relevant for engineering, but still consider institutional policies). Ensure you comply with data protection regulations.

Case Studies: Altmetrics in Engineering Research

To illustrate practical use, consider two hypothetical examples.

Example 1: Structural Engineering Paper

A research group publishes a paper on a new method for retrofitting bridges against earthquakes. Within a month, the paper receives:

  • 5 news articles (including one from a major engineering magazine).
  • 300 tweets from engineers and disaster management agencies.
  • 50 saves on Mendeley.
  • 1 citation in a policy document from a national infrastructure agency.

The altmetric score is moderate (around 30) but the policy citation is a strong indicator of real-world influence. The researchers use this data in a grant application for further studies, highlighting the immediate relevance to national safety.

Example 2: Software Tool in Civil Engineering

A team releases an open-source MATLAB toolkit for analyzing traffic flow data. Altmetric tracking shows:

  • 2,000 downloads from GitHub and Figshare.
  • 200 mentions on Twitter from practitioners.
  • 10 blog posts reviewing the tool.

Traditional citation count is low because the tool is not an academic paper per se. However, the altmetrics demonstrate broad adoption in industry. The team uses these numbers to justify continued development and to secure funding for a journal article describing the tool, which later gets citations.

Future Directions

Altmetrics are evolving. Emerging trends include:

  • Integration with open science: Preprints and data sharing platforms are increasingly tracked.
  • AI-driven analysis: Natural language processing to analyze the sentiment and context of mentions.
  • Standardization: Groups like NISO (National Information Standards Organization) are working on standards (e.g., NISO Altmetrics Initiative).
  • Institutional adoption: Universities and funding agencies are incorporating altmetrics into tenure and grant evaluations.

For engineering researchers, staying informed about these developments ensures that impact is measured in a way that reflects the true breadth of contributions—from laboratory to society.

Conclusion

Altmetrics provide a valuable, real-time view of the impact of engineering research publications. By leveraging these metrics, researchers can better understand how their work influences industry, policy, and society. Incorporating altmetrics into your research assessment toolkit can enhance your ability to demonstrate the broader significance of your work and improve dissemination strategies. However, they should be used thoughtfully, in conjunction with traditional metrics, and with an awareness of their limitations. For engineers whose work often has tangible applications, altmetrics are not just a trend but a practical tool for measuring and amplifying impact.