Researchers have gradually become concerned about the appropriateness of journal-level metrics for research assessment. After meeting in Dec. 2012, a group of journal publishers and editors have released the San Francisco Declaration on Research Assessment (DORA) to highlight the need to improve how research impact is evaluated. In sum, they point out:
They have put forward a list of recommendations for researchers, institutions, funding agencies, publishers, and organizations that supply metrics. Thousands of individuals in different academic communities around the world have signed DORA. Successful researchers have also shared their thoughts about why Journal Impact Factors do not deserve so much weight and attention. Similarly, Randy Schekman, the wininer of the 2013 Nobel prize for medicine, has articulated his concerns over unwarranted significance of publishing in prestigious "luxury journals."
The Public Library of Science summarizes how article-level metrics (ALMs) are valuable to different stakeholders in the scholarly communication lifecycle:
These are some of the discussions about the shortcomings of journal-level metrics:
Researchers increasingly recognize the significance of assessing research at the article level with both traditional and novel data points. The SPARC Primer on article-level metrics (ALMs) notes that ALMs:
However, just like other metrics, ALMs can be gamed and cannot evaluate the quality and intent of the comments on an article.
This video provides an overview of ALMs: