/
Post-publication evaluation through tags Post-publication evaluation through tags

Post-publication evaluation through tags - PowerPoint Presentation

mediumgeneral
mediumgeneral . @mediumgeneral
Follow
342 views
Uploaded On 2020-08-06

Post-publication evaluation through tags - PPT Presentation

Bodo Stern Chief Development and Strategy Officer HHMI February 8 2018 2 2018 Howard Hughes Medical Institute The problem We need better indicators of scientific quality and impact Technical ID: 800663

tags indicators 2018 quality indicators tags quality 2018 scientists institute medical hughes howard papers evaluate based technical score articles

Share:

Link:

Embed:

Download Presentation from below link

Download The PPT/PDF document "Post-publication evaluation through tags" is the property of its rightful owner. Permission is granted to download and print the materials on this web site for personal, non-commercial use only, and to display it on your personal computer provided you do not modify the materials and that you retain all copyright notices contained in the materials. By downloading content from our website, you accept the terms of this agreement.


Presentation Transcript

Slide1

Post-publication evaluation through tags

Bodo Stern

Chief Development and Strategy Officer

HHMI

February 8, 2018

Slide2

2

©2018 Howard Hughes Medical Institute

The problem: We need better indicators of scientific quality and impact

Technical

Quality

Journal-based indicators dominate today. They are simply not good enough because they evaluate scientists based on

where they publish, not what they publish.

We need article-specific indicators that better reflect individual contributions. We refer to these indicators as ‘tags’ or ‘badges’.

Slide3

3

©2018 Howard Hughes Medical Institute

Why do we need quality indicators?

Select scholarly papers:

Indicators assist scientists in selecting relevant papers outside their field of expertise.

Evaluate scholarly applications:

Indicators assist scientists during the triage stage for funding or hiring decisions.

Experts may not need indicators of quality and impact to evaluate articles or scientists in their own field. But we all rely on them to:

Slide4

4

©2018 Howard Hughes Medical Institute

post-publication tags

Tags

are shorthand measures (‘proxies’) for a particular quality feature of published articles.

Critical features of tagsattached to article or easily discoverableEasily generated, easily consumedcan change over time

Citations

Technical

Quality

Example tags

technical quality score

Reproducibility score

Citation score

Slide5

5

©2018 Howard Hughes Medical Institute

Feedback

Do you think tags would be a good and feasible alternative to journal-based indicators? Or can you think of better approaches that allow scientists to quickly

identify a

desired value of articles?

Technological hurdles: How can tags be created?

how can tags be ‘attached’ to papers?

How can tags change over time?