US Department of Energy Office of Scientific and Technical Information OSTI ICSTI Technical Activities Coordinating TACC Meeting October 2013 Traditional Bibliometrics and Alternative Metrics in Research Program Assessment ID: 294329
Download Presentation The PPT/PDF document "Lorrie Johnson" is the property of its rightful owner. Permission is granted to download and print the materials on this web site for personal, non-commercial use only, and to display it on your personal computer provided you do not modify the materials and that you retain all copyright notices contained in the materials. By downloading content from our website, you accept the terms of this agreement.
Slide1
Lorrie JohnsonU.S. Department of EnergyOffice of Scientific and Technical Information (OSTI)ICSTI Technical Activities Coordinating (TACC) MeetingOctober 2013
Traditional Bibliometrics and Alternative Metrics in Research Program AssessmentSlide2
Scientific and Technical Publication Metrics
Scientific and technical publications, such as journal articles, are the primary products of scientific research, and the means by which new knowledge is created and
transferred.
Publication
metrics can provide useful insight into research productivity, and into the impact and influence of research within particular fields of
science.Slide3Slide4Slide5Slide6
Analysis of Joint Genome Institute PublicationsSlide7
Aggregate JGI Citation Data(from Web of Science)
JGI publications were cited 51,590 times (through April 2013)
Average citations per article = 56
H Index = 113 (113 articles have been cited more than 113 times)
Average citations per year = 4,299
Citations for JGI publications are continuing to grow over time.Slide8
Top Journals for JGI PublicationsComparison of Citation Rates for JGI Articles versus Other Articles in Journal
Journal Titles
# Articles
% of Total (908)
5 Year Impact Factor
Total Number of Citations for JGI Publications
Average Number of Citations per JGI Publication
Average
Number
of Citations for All Articles Published in Journal 2002-2012
STANDARDS IN GENOMIC SCIENCES
168
19%
1.6215963.53.2JOURNAL OF BACTERIOLOGY728%3.924122217.020.2PLOS ONE425%4.53773717.55.9PROCEEDINGS OF THE NATIONAL ACADEMY OF SCIENCES OF THE UNITED STATES OF AMERICA415%10.472307775.048.6APPLIED AND ENVIRONMENTAL MICROBIOLOGY394%4.453244362.624.3NATURE364%36.23512669351.961.7SCIENCE364%32.4529011250.358.4GENOME RESEARCH293%12.486245484.659.5BMC GENOMICS283%4.32856520.212.8NUCLEIC ACIDS RESEARCH263%7.417214282.434.9ENVIRONMENTAL MICROBIOLOGY202%6.15153026.524.8ISME JOURNAL162%7.85033420.917.4MOLECULAR BIOLOGY AND EVOLUTION162%9.85786554.137.5NATURE BIOTECHNOLOGY162%28.1611865116.640.0Slide9
Citation Rates for 2008 JGI Articles in Nature Compared to Average Citation RateSlide10
Citation Rates for 2009 JGI Articles in Science Compared to Average Citation RateSlide11
Paper was published in 2006; citations peak in 2009-2011.Indicators of Impact and Influence within Research Field
Primary citations = 1,218
Secondary citations = 24,058
Research Areas of Citing Articles = 40
Unique Authors of Citing Articles = 5,149
Distinct Institutions Represented in Citing Articles = 1,112
Analysis of Individual Publication:
The
genome of black cottonwood,
Populus
trichocarpa
… Slide12
Top 10 Journals Citing this ArticleTop 10 Research Areas of Articles Citing this Article
Journal Title
# Publications
BMC GENOMICS
72
NEW PHYTOLOGIST
60
PLANT PHYSIOLOGY
50
BMC PLANT BIOLOGY
48
PLOS ONE
35
PLANT JOURNAL33TREE GENETICS GENOMES29PLANT CELL28BMC EVOLUTIONARY BIOLOGY23JOURNAL OF EXPERIMENTAL BOTANY21Research Areas# PublicationsPLANT SCIENCES542GENETICS HEREDITY303BIOCHEMISTRY MOLECULAR BIOLOGY265BIOTECHNOLOGY APPLIED MICROBIOLOGY173FORESTRY81EVOLUTIONARY BIOLOGY73AGRICULTURE72CELL BIOLOGY62SCIENCE TECHNOLOGY OTHER TOPICS61ENVIRONMENTAL SCIENCES ECOLOGY48Analysis of Individual Publication:The genome of black cottonwood, Populus trichocarpa… Slide13
Article Metrics provided by PLOS One:Other Alternative Metrics Measurements:
Total article views = 23,384
Total PDF downloads = 4,403
4 Tweets
4 Facebook posts
15 bookmarks on
CiteULike
20 cites on
CrossRef
Mendeley
readers =
212 (89%
in the Biological Sciences;
25% of readers from the U.S.)Cited by 17 articles in PubMed Central46 citations in Google ScholarAltmetric score = 21Alternative Metrics for JGI Article in PLOS One:“Direct Comparisons of Illumina vs. Roche 454 Sequencing Technologies on the Same Microbial Community DNA Sample” Slide14
NISO Alternative Assessment Metrics (Altmetrics) Project
Sloan Foundation grant to undertake two-phase initiative to explore, identify, and advance standards and/or best practices for new assessment metrics, including:
Usage-based metrics
Social media references
Network behavioral analysis
Will also explore potential assessment criteria for non-traditional research outputs, such as data sets, visualizations, software, and other applications.Slide15
NISO Alternative Assessment Metrics (Altmetrics) Project
First phase – in person and virtual meetings to solicit input and collaboration from community.
ICSTI members are encouraged to participate:
Washington, DC – December 11, 2013
Philadelphia, PA – January 23-24, 2014Slide16
NISO Alternative Assessment Metrics (Altmetrics) Project
Outcome from Phase 1 – white paper describing outcomes, recommendations, and action items identified during the meetings.
Phase 2 and Final Outcome – Published standards or recommended practices regarding alt metrics.
For more information, see NISO project website:
http://
www.niso.org/topics/tl/altmetrics_initiative/
Or contact Todd Carpenter:
tcarpenter@niso.org