Last edited 2013-06-27
Bibliometrics and Publishing
Peter Sjögårde & Staffan Karlsson, Bibliometric analysts
KTH Royal Institute of Technology, ECE School of Education and
Communication in Engineering Sciences (ECE), Unit for Publication
Infrastructure
What is bibliometrics and why bother about
it?
Is someone reading and building on your results?
Statistics on publications and citations
Measuring Impact on research society
Used for evaluation of research
• Publication level
• Individual level
• Organizational level
Use of bibliometrics
University rankings
Research assessment at
KTH
Recruitment of
researchers
Funding allocation
(part of future peer assessment?)
Research funders
Bibliometric indicators
Field normalized citation rate
H-index
Journal Impact Factor
Photo - http://www.flickr.com/photos/tysonneil/179407461/
Field normalized citation rate
For a publication:
𝑁𝑢𝑚𝑏𝑒𝑟 𝑜𝑓 𝑐𝑖𝑡𝑎𝑡𝑖𝑜𝑛𝑠
𝑎𝑣𝑒𝑟𝑎𝑔𝑒 𝑛𝑢𝑚𝑏𝑒𝑟 𝑜𝑓 𝑐𝑖𝑡𝑎𝑡𝑖𝑜𝑛𝑠 𝑓𝑜𝑟 𝑠𝑖𝑚𝑖𝑙𝑎𝑟 𝑝𝑢𝑏𝑙𝑖𝑐𝑎𝑡𝑖𝑜𝑛𝑠
Same research field
same year
same document type
Average = 1
Field normalized citation rate
Used at different levels
• Rankings (university level)
• Funding allocation (university level)
• Assessment (research groups)
RAE2012 - Time series of average
field normalized citation rate for KTH
Field normalised citation rate
(full counts, 3 year sliding averages, KI)
2.00
1.80
1.60
1.40
1.20
1.00
0.80
0.60
0.40
0.20
0.00
2004
2005
2006
2007
Year
2008
2009
2010
H-index
H-index
Used at individual level
• Recruitment
• Research funding
Definition:
”A scientist has index h if h of his/her Np papers have
at least h citations each, and the other (Np − h) papers
have no more than h citations each.”
H-index
Bibliometrics at KTH
• Research Assessment Exercise (research groups, UoA)
• Yearly indicator report (KTH Schools)
• Funding allocation
Funding allocation
Field normalized citation rate
Relative to size of school budget (size of school)
Currently, re-allocation of 20 MSEK of KTH research funds
Research Assessment Exercise
Researcher based
Wide range of indicators
• Publishing
– Number of publications
– Coverage in Web of Science
– Field normalized citation rate of the journals, in average.
• Impact
– Citations
– Field normalized citation rate
– Share of 10% most cited publications in the research field.
• Collaboration
– Share of internationally co-authored publications
Yearly indicator report
•
•
•
•
•
Number of peer reviewed articles
Number of peer reviewed conference papers
Field normalized citation rate
Top 10% publications
Number and Share of level 2 publications in the
Norwegian system
• Number of publications co-published with industry
• Share of publications internationally co-published
Databases used for bibliometrics
Web of Science is the most important database for bibliometric analyses
Scopus is the second most important, (and more or less the only
alternative)
Google Scholar
Good search tool
Cover all types of publications (including patents)
Not used for ”serious” bibliometrics
• Poorly defined contents
• Normalizations not possible
Primitive user interface
Third-party user interface: Publish or perish
(http://www.harzing.com/pop.htm)
Google Scholar
Choice of journal
Journal Prestige
Audience
Outreach
Language
Impact
In Web of Science?
Peer review process
In Scopus?
Relevance to subject
Google/Google Scholar
Open Access
Format
Journal Impact
Much discussed and critized
eg http://www.sciencemag.org/content/340/6134/787.full
and http://am.ascb.org/dora/
Science 17 May 2013
JIF is a poor proxy for the number of citations to expect.
Overrated as an indicator of where to publish to maximize
citations
Could be useful as a proxy for the ”brand value” of a paper for indivduals and universities
Journal Impact Factor (JIF)
How is it calculated?
JIF = Citations 2012 / Citable Items 2010-2011
Citations from 2012
Issues from 2010-2011
Thomson Reuters description http://thomsonreuters.com/products_services/science/free/essays/impact_factor/
To access Journal Citation Reports
Through the KTH-library site select
>Search Tools > Databases > Web of Knowledge
> Add Resources > Journal Citation Reports
https://www.kth.se/kthb
Journal Impact Factor (JIF)
a measure of the speed at which
content in a particular journal is
picked up and referred to
Eigenfactor Score = the percentage of the total weighted citations that journal i
receives. It is adjusted for differences in citation patterns among disciplines.
Article Influence Score = a measure of the per-article citation influence of the
journal
Alternatives to the WoS JIF
Eigenfactor.org
• eigenfactor.org or through Web of Knowledge
• Based on WoS (ca 8 300 journals)
• Field normalized (using a PageRank algorithm)
• Citations from high impact journals are valued higher
• Are not influenced by journal self-citation.
SCImago journal rank
• scimagojr.com/journalrank.php or through Scopus
• Based on Scopus data (ca 20 000 journals)
• Field normalized (using a PageRank algorithm)
SNIP (source normalized impact)
• through Scopus
• Based on Scopus (probably also WoS in the future)
• “Source normalized”  more fair evaluation of applied fields
To access Scopus
Through the KTH-library site
>Search Tools > Databases > Scopus
> Analytics
https://www.kth.se/kthb
Improving your visibility using uniqe author identifiers
Open Researcher and Contributor ID
http://orcid.org/
ORCID can import publication data from
Scopus Author ID
ResearcherID (Web of Science)
CrossRef
Personal ORCID site
eg http://orcid.org/0000-0002-5739-5213
DiVA – KTH publication database
Budget citation indicator and school indicators
KTH RAE 2012
Dynamic listings for
• CV
• Profile pages
• web pages
DiVA
The researchers at KTH should register all new
publications not registered by Web of Science or Scopus
When register:
• Check for duplicates
• KTH-ID (u1l3g15d)
• Organization
• WoS-ID
DiVA
•
Check for duplicates
DiVA
•
KTH-ID (u1l3g15d)
DiVA
•
Organization
DiVA
•
Web of Science ID
DiVA
Strategic research areas
Open Access
Green – Parallel publishing
Gold – Publishing in Open Access journals
Open Access
Mandated by
•
•
•
•
•
•
VR
Riksbankens jubileumsfond
Formas
Knut och Alice Wallenbergs stiftelse
Seventh Framework Programme (FP7)
European Research Council (ERC)
More impact/citations with Open Access?
Some studies show that OA articles get more downloads and more
citations - Other show no advantage - debate is still going on
• More possible citers
• Easier access
• Easier indexing for web crawlers
• Better visibility outside the research community
No contradiction between OA and high impact factor journals
• If choosing to publish in OA journals the same recommendations apply
– Check outreach and impact
– Check the peer review process
– Relevance
– …
Citations and collaboration
Correlation between citation rates and number of
authors in RAE2012
2.00
16
1.80
14
12
1.40
10
1.20
1.00
8
0.80
6
0.60
4
0.40
2
0.20
0.00
0
1
2
3
4
5
6
7
Number of authors
8
9
10
Citations
Field normalized citation rate
1.60
Field normalized
citation rate (WoS)
Average number of
citations (WoS)
Citations and collaboration
Correlation between citation rate and number
of authors in RAE2012
Field noralized citation rate
140
120
100
80
60
40
20
0
0
20
40
60
Authors
Publications with less than 100 authors included
80
100
120
Social media
Why?
• Find publications
• Share publications
• Make research visual
• Collaborate
Correlation between social media impact
and bibliometrics?
Differences between research fields
Altmetrics
KTH’s policy for scientific publishing
Aim: To make KTH's scientific publishing more visible
for the international scientific community and the general public
Publish in international high-impact journals
Make articles freely available by publishing in Open Access
journals or do parallel publishing
Write popular science to increase KTH visibility and impact
on society
Register publications in the KTH publication database DiVA
http://www.kth.se/en/kthb/publicering/vagledning/policydokument-1.182530
Affiliation
KTH Royal Institute of Technology
Summary of KTH’s Publishing guide
Check the outreach of your publishing channel.
Check the impact of your journal.
Publish in English.
Plan your research and publishing for cooperation.
Use a unique and consistent author name.
Write your organizational affiliation in a way that is easy to identify by an international audience.
Register your publication in the KTH publication database DiVA.
Publish your article Open Access if possible.
Contact the Department of Publication Infrastructure at the ECE School for support and more
information.
Ulf Kronman, 2011, Guide to Scientific Publication Management for Researchers at the KTH Royal Institute of
Technology, URL: http://kth.diva-portal.org/smash/record.jsf ?pid=diva2:450945
Further information
www.kth.se/kthb > Publishing
Comments/questions to:
Peter Sjögårde, Bibliometric Analyst
Staffan Karlsson, Bibliometric Analyst
pi@ece.kth.se
KTH Royal Institute of Technology
School of Education and Communication in Engineering Sciences (ECE)
Unit for Publication Infrastructure