Altmetrics與機構典藏
臺大圖書資訊學系
副教授 唐牧群
muhchyun.tang@gmail.com
2014臺灣學術機構典藏(TAIR)研討會
1
Altmetrics
• “"...is the creation and study of new metrics based on the
Social Web for analyzing, and informing scholarship."” Coined
by Jason Priem in 2010
• “ the study and use of non-traditional scholarly impact
measures that are based on activity in web-based
environments.” POLS
2014臺灣學術機構典藏(TAIR)研討會
2
The thrusts behind altmetrics:
evaluation
• Reflect the concern over “journalization of
science”
– Outputs
• The rise of social media as a place to generate
scholarly impacts
– Impacts
2014臺灣學術機構典藏(TAIR)研討會
3
Changing definition of scholarly
outputs
• The new NSF policy states: “Acceptable products
must be citable and accessible including but not
limited to publications, data sets, software, patents,
and copyrights. “
• “Altmetrics give a fuller picture of how research
products have influenced conversation, thought and
behaviour.” Heather Piwowar
2014臺灣學術機構典藏(TAIR)研討會
4
Alternative research outputs
• Research database
• Scientific software
• Poster and presentation at conferences, in particular
in the medical sciences
• Electronic theses and dissertations
• Performances in film, theater, and music
• Lectures, online classes and other teaching activities
2014臺灣學術機構典藏(TAIR)研討會
5
More inclusive evidences of impact
2014臺灣學術機構典藏(TAIR)研討會
6
Chen, K. H., Tang, M. C., Wang, C. M., & Hsiang, J. (2014). Exploring alternative
metrics of scholarly performance in the social sciences and humanities in
Taiwan. Scientometrics, 1-16.
Table 1
Descriptive statistics of the metrics and overall scholarly performance variables
Mean
25.68
SD
71.59
5.75
14.04
2
93
0
56.84
98.17
19
488
0
# of circulation
417.18
741.39
86
3750
0
# of citations in TH&D
740.44
998.86
407
4420
0
# of Th&D supervised
31.56
53.59
13
336
0
1.72
3.59
0
18
0
Webometrics Visibility
13.75
56.49
1
422
0
Webometrics Size
77.05
325.28
4
2356
0
Webometrics Rich Files
30.67
111.68
0
739
0
Webometrics Scholar
1.25
6.21
0
40
0
# of citations in THCI
25.16
70.92
3
497
0
121.88
189.50
61
1093
1
# of citations in Scopus
68.54
138.56
1
714
0
# of citations in WOS
26.16
68.01
2
460
0
# of books authored
8.68
17.82
2
98
0
# of journal articles
70.96
88.76
43
490
5
# of conference articles
46.82
41.37
37
188
0
20
0
30
0
# of articles in the press
# of non-academic articles
# of syllabi citations
Wikipedia presence
# of citations in ACI
award received index
# of grants received
Median Maximum Minimum
1
426
0
5.78
6.08
3
2014臺灣學術機構典藏(TAIR)研討會
11.11
7.48
10
7
Table 2
Correlations among conventional and new output measures
magazine articles
theses and dissertation
journal articles
conference articles
authored
authored
books authored
authored
articles in the press
magazine articles authored
.313* (0.059-0.526)
advised
.431** (0.197-0.624)
.326* (0.038-0.548)
.431** (0.161-0.636)
.321* (0.043-0.533)
.392** (0.108-0.611)
.421** (0.147-0.652)
.639** (0.420-0.791)
.299* (0.022-0.532)
.346** (0.098-0.558)
.566** (0.345-0.731)
.263* (-0.007-0.505)
.565** (0.324-0.765)
.664** (0.501-0.773)
theses and dissertation advised
books authored
.491** (0.258-0.670)
journal articles authored
*. Correlation is significant at the 0.05 level (2-tailed).
**. Correlation is significant at the 0.01 level (2-tailed).
2014臺灣學術機構典藏(TAIR)研討會
8
Table 3
Correlations among conventional and new impact metrics
citations in theses and
citation received in
citation received in
wiki presence
dissertations
citations received in syllabi
cited in Web of
cited in Scopus
THCI database
ACI database
Science
.664** (0.481-0.788) .412** (0.178-0.605) .544** (0.352-0.694) .699** (0.533-0.812)
.024 (-0.244-0.262)
.044 (-0.223-0.299)
.408** (0.157-0.591) .440** (0.222-0.621) .899** (0.818-0.950)
.302* (0.049-0.535)
.227 (-0.056-0.473)
citations in theses/dissertation
.469** (0.227-0.658) .414** (0.180-0.592)
wiki presence
-.027 (0.227-0.658) -.129 (-0.382-0.145)
1.000 .521** (0.325-0.689) -.114 (-0.374-0.131) -.157 (-0.414-0.093)
citation received in THCI database
Table
citation3received in ACI database
Correlations among conventional and new impact metrics
.255 (-0.023-0.509)
.874** (0.775-0.942)
citations in Scopus
*. Correlation is significant at the 0.05
levelin(2-tailed).
citations
theses and
**. Correlation is significant at the 0.01 level (2-tailed).
dissertations
citations received in syllabi
citations in theses/dissertation
wiki presence
citation received in THCI database
citation received in
citation received in
wiki presence
cited in Web of
cited in Scopus
THCI database
ACI database
Science
.664** (0.481-0.788) .412** (0.178-0.605) .544** (0.352-0.694) .699** (0.533-0.812)
.024 (-0.244-0.262)
.044 (-0.223-0.299)
.408** (0.157-0.591) .440** (0.222-0.621) .899** (0.818-0.950)
.302* (0.049-0.535)
.227 (-0.056-0.473)
.469** (0.227-0.658) .414** (0.180-0.592)
-.027 (0.227-0.658) -.129 (-0.382-0.145)
1.000 .521** (0.325-0.689) -.114 (-0.374-0.131) -.157 (-0.414-0.093)
citation received in ACI database
citations in Scopus
.200 (-0.098-0.456)
.255 (-0.023-0.509)
2014臺灣學術機構典藏(TAIR)研討會
.200 (-0.098-0.456)
9
.874** (0.775-0.942)
Table 4
Correlations among the metrics and scholarly performance variables
# of
Awards received index
Humanities
Social
Sciences
grants received
Humanities
Social Sciences
-.050
.568**
-.366
.282
.796**
.419**
.819**
.304*
# of syllabi citations
.630**
.506**
.877**
.210
# of library circulation
.840**
.560**
.823**
.164
# of citations in Th&D
.778**
.722**
.681**
.524**
# of Th&D supervised
.515**
.624**
.695**
.622**
-.011
.426**
.276
.108
.674
**
.523
**
.729
**
.224
# of citations in ACI
.688
**
.692
**
.759
**
.484**
# of citations in Scopus
.354**
.224
.194
.381**
.147
.199
-.237
.297
# of books authored
.616**
.422**
.660**
.213
# of journal articles
.689**
.660**
.702**
.570**
# of conference articles
.476**
.334*
.543**
.275
# of article in the press
# of non-academic
articles
Wikipedia presence
# of citations in THCI
# of citations in WoS
*. Correlation is significant at the 0.05 level (2-tailed).
**. Correlation is significant at the 0.01 level (2-tailed).
2014臺灣學術機構典藏(TAIR)研討會
10
Table 5
Rotated Component Matrix
Component
# of citations in ACI
# of syllabi citations
# of citations in TH&D
# of circulation
# of journal articles
# of books
# of advisees
# of conference articles
Webometrics_Visibility
Webometrics_Rich Files
Webometrics_Size
Webometrics_Scholar
# of citations in Scopus
# of citations in WoS
Wikipedia_presence
# of non-academic articles
# of articles in the press
Percentage of variance explained
1
.883
.735
.868
.759
.822
.685
.550
.702
.113
-.047
-.088
.202
.063
.006
.258
.537
.283
36.690
2
-.107
.213
-.112
.013
.041
.307
.073
.094
.852
.911
.885
.669
-.018
.035
-.167
.136
.042
17.333
2014臺灣學術機構典藏(TAIR)研討會
3
.220
.056
.207
-.099
.262
-.209
.488
-.313
-.029
.185
-.004
-.095
.937
.931
-.096
-.023
.143
13.540
4
.166
.355
.114
.390
.280
.284
.225
-.030
.023
-.002
.088
-.132
-.046
.009
.795
.545
.754
6.172
11
Table 6
Dependent variable: the “awards received” index
All cases
(N=57)
Humanities
(N=13)
Social Sciences
(N=44)
Variable entered
β
Domestic scholarly influences
.561
Social influences
.380
International impact
.243
Domestic scholarly influences
.715
Domestic scholarly influences
.459
Social influences
.423
International impact
.323
2014臺灣學術機構典藏(TAIR)研討會
Adjusted R2
.492
.466
.508
12
Table 7
Dependent variable: # of grants received
All cases
(N = 57)
Humanities
(N = 13)
Social Sciences
(N = 44)
Variable entered
β
Domestic scholarly influences
.494
Adjusted R2
0.421
International impact
.444
Domestic scholarly influences
.715
International impact
.467
0.526
0.398
Domestic scholarly influences
.440
2014臺灣學術機構典藏(TAIR)研討會
13
The thrusts behind altmetrics:
discovery
– ‘…We rely on filters to make sense of the scholarly
literature, but the narrow, traditional filters are being
swamped… …the growth of new, online scholarly tools
allows us to make new filters: these altmetrics reflect the
broad, rapid impact of scholarship in this burgeoning
ecosystem. We call for more tools and research based on
altmetrics.’
• Link to the altmetrics vs. traditional data for an Ebola article in
Nature
2014臺灣學術機構典藏(TAIR)研討會
14
2014臺灣學術機構典藏(TAIR)研討會
15
Researchers’ view
2014臺灣學術機構典藏(TAIR)研討會
16
Current altmetrics efforts
• Altmetric / with Scopus
• Plum Analytics /now with EBSCO
– Launched in2011 by former librarians Mike Buschmen and Andrea
Michalek
• Impact Story
• Reader Meter
• ALM
2014臺灣學術機構典藏(TAIR)研討會
17
Altmetric.com data sources
1) Policy documents
We track a wide range of public policy documents for mentions, and are adding
more every month.
2) Mainstream media
You can check out the news sources page on the Altmetric website for the latest list
of news sources that we track.
3) Social media data
•
•
•
•
•
Twitter ‧Facebook (public posts only) ‧ Google+ ‧Pinterest ‧Reddit
Sina Weibo ‧PubPeer and Publons ‧LinkedIn groups
Blogs (this is a manually curated list - currently this contains over 8,000 blogs)
Sites running Stack Exchange (Q&A) ‧Reviews on F1000 ‧YouTube
... & many smaller sources
4) Online reference manager and publisher download count data
•
•
Mendeley
CiteULike
http://support.altmetric.com/knowledgebase/articles/83335-which-data-sources-does-altmetric-track
18
Altmetric.com
• Altmetric example
Source weight
News
8
Blogs
5
Q&A forums
2.5
Twitter
1
Google+
1
Facebook
0.25
http://support.altmetric.com/knowledgebase/articles/83337-how-is-the-altmetric-score-calculated19
Plum analytics
• Metrics
– Usage - Downloads, views, book holdings,
ILL, document delivery
– Captures - Favorites, bookmarks, saves,
readers, groups, watchers
– Mentions - blog posts, news stories,
Wikipedia articles, comments, reviews
– Social media - Tweets, +1's, likes, shares,
ratings
– Citations - PubMed, Scopus, patents
2014臺灣學術機構典藏(TAIR)研討會
20
Source: (Lin & Fenner, 2013).
2014臺灣學術機構典藏(TAIR)研討會
21
Impact Story
Source: (Lin & Fenner, 2013).
2014臺灣學術機構典藏(TAIR)研討會
22
Traditional repository metrics
• Download counts
• Page views
• Google analytics
– Geographic access, referral links, search terms
• Some citation metrics
2014臺灣學術機構典藏(TAIR)研討會
23
Example of using almetrics in IR
An example article from University of Massachusetts Medical School
2014臺灣學術機構典藏(TAIR)研討會
24
Value of Altmetrics for IRs
• Demonstrate impact of open access, recruit new
content
• Showcase social importance of content
• Add more context and meaning to download counts
• Provide authors with more comprehensive
understanding of their readership and lead to new
collaborators
2014臺灣學術機構典藏(TAIR)研討會
25
Existing barriers
• Limited DOI implementation
• Author disambiguation
2014臺灣學術機構典藏(TAIR)研討會
26
Useful references
•
•
•
•
•
•
Bernal, I. (2013). Open Access and the Changing Landscape of Research Impact Indicators:
New Roles for Repositories. Publications, 1(2), 56-77.
Lin, Jennifer and Martin Fenner (2013). Altmetrics in evolution: defining and redefining the
ontology of article-level metrics. Information Standards Quarterly, Summer, 25(2): 20-26.
Konkiel, S., & Scherer, D. (2013). New opportunities for repositories in the age of
altmetrics. Bulletin of the American Society for Information Science and Technology, 39(4),
22-26.
Mounce, R. (2013). Open access and altmetrics: Distinct but complementary. Bulletin of the
American Society for In formation Science and Technology, 39(4), 14-17.
Palmer, Lisa A. (2013), "Altmetrics and Institutional Repositories: A Health Sciences Library
Experiment". University of Massachusetts Medical School. Library Publications and
Presentations. Paper 142. http://escholarship.umassmed.edu/lib_articles/142
Roemer, R. C., & Borchardt, R. (2013). Institutional Altmetrics and Academic Libraries.
Information Standards Quarterly, 25(2), 14.
2014臺灣學術機構典藏(TAIR)研討會
27