MEASURE YOUR RESEARCH
PERFORMANCE WITH INCITES
Guillaume Rivalle
Guillaume.rivalle@thomsonreuters.com
APRIL 2014
HOW DO CUSTOMERS USE INCITES?
• Annual reports, Board of trustees reports Universities and other research
• Strategic plans/performance dashboards
producing institutions
• Strategic publishing/funding
• Competitive analysis
Research funding organizations
• PR, research magazines
• Recruitment, expert finding
• Collaboration analysis
Publishers
• Departmental research strategy
• Building an institutional repository
• Build faculty expertise database
Corporate sector
INTEGRATE CITATION METRICS INTO
YOUR WORKFLOW
INSTITUTIONAL
REPOSITORIES
RESEARCH
MANAGEMENT SYSTEMS
Support data capture, public
profiles, etc.
Feed internal or approved 3rd
party systems
InCites
INTERNAL REPORTING
EXTERNAL REPORTING
Share among stakeholders
at your institution
Support strategic, funding
and marketing activities
2
THE CHALLENGES OF USING CITATION METRICS
• Work with « clean », unified and consistent data
• Generate relevant and normalised indicators
• Work and visualize several indicators (multiple angles)
simultaneously
• Quickly and regularly produce standardised and reliable reports
• Identify weaknesses and demonstrate strengths of research
activities
• Analyse collaborations and identify the most fruitful and efficient
ones
• Being able to run fair comparisons between entities (people,
departments, universities, countries, etc.)
3
WEB OF SCIENCE- A TRULY UNIQUE CITATION
RESOURCE
• Selectivity and control of content: consistent, transparent standards
• Content: 12500 journals,12000 annual conferences 50000 books
and 800 million Cited References
• Multidisciplinary: 251 subject categories
• Consistent and reliable data:
- Cover-to-cover indexing
- Cited references for all years of coverage
- Indexing of all author names and addresses
• Funding acknowledgments: link funding source to outputs
4
INDEXING
DIFFERENT LEVELS OF METADATA CAPTURE
MEDLINE/PUBMED
recordCore Collection record
Web of Science
5
All Authors
All Affiliations
All Funding sources
Without consistency, no
meaningful data analysis is
possible
JOURNAL SELECTION PROCESS FOR
WEB OF SCIENCE Core Collection
Four Points of Evaluation
Journal
Publishing
Standards
Editorial
Content
International
Diversity
Citation
Analysis
Core coverage in Web of Science is not static !
For decades, Thomson Reuters has carefully evaluated
journals for potential inclusion in the database
SELECTIVE……YET COMPREHENSIVE
100 %
of the top 100 universities
have Web of Science
GOLD STANDARD
used by 7,000+ institutions in 100+
countries
Web of Science data provide the foundation for
research analytics solutions
Thomson
Reuters data
sources and
expertise
• Address unification (5000 unified
institutions by 2015)
• Author-Affiliation linking
• Normalization & baselines
• Default 10 years world dataset
InCites
Researchers
Profiles
Client
Expertise and
Information
• Researchers
• Departments, research
units, institutes
• Repository
RIV
InCites
Reports
InCites provides REAL Metrics
Citation rates vary among fields and scientific communities.
What is good or average in mathematics is very different from
what is good or average in biochemistry.
23.3 cites/paper
H-index: 13
14.5 cites/paper
H-index: 7
9.8 cites/paper
H-index: 7
4.2 cites/paper
H-index: 3
How “good” is this? What is the context?
Additional metrics are needed to
understand research performance.
10
Should this article be one of the most
impactful publication of this author?
Is this a high number of citations?
The JIF is informative because it gives me
the average influence of a journal, NOT of
a researcher/institution/country/…
11
Should this article be one of the most
impactful publication of this author?
Is this a high number of citations?
According to Essential Science Indicators, this
article is within the 1% of the most cited 2011
articles in Chemistry
12
A new Essential Science Indicators
For each publication, InCites will take into
account different data points for creation of
truly Contextualized impact.
According to InCites, this article has an impact
that is 126 times above the expected impact in
this category, and 58 times above the expected
impact for this journal
14
EXAMPLES
Run Direct comparisons between the world’s
institutions, countries, journals, researchers,
EXAMPLES
Run Direct comparisons between the world’s
institutions, countries, journals, researchers,
EXAMPLES
Quickly analyze the effects of a collaboration
EXAMPLES
Drill into one institution publication activities
Use the “Analytics” tab to access your existing
reports, do new analyses and generate new ‘tiles’
The “Explore” features allow you to do comprehensive
analyses of various different entities
“System Reports” allow you to access
various pre-configured reports
“Scenario Planner” is designed
to help you test the impact of
various scenarios.
For example the potential of a
proposed merger or the impact
of hiring a particular individual
The ‘Explore Organizations’ page lets you run
complex analyses, browse institutions and
benchmark your performance to peers,
Filter results using a variety of attributes
Also limit your search to
certain research areas,
document types, specific
journals or to articles in
Open Access journals
Change the type
of visualization
Each report (tile) can be based on any group of
publications, e.g a researcher, a department, an
institute, a journal, a topic, a country, etc.
Each tile can be drilled through for analysis at
individual article level
Reports can be shared and sent to other users
By saving and building up a
collection of your own tiles you can
create your own ‘Dashboard’.
Easy to access, interpret and share,
yet built on robust and careful
analysis
A new Journal Citation Report with
more powerful and flexible analysis
capabilities
Navigate between journal
or category ranks
Click a specific category in
the Node & Link Network or
the # of journals to view the
journals for that category
Instantly search any journal title
Easily navigate to previous editions of the JCR
to view trends. All customers have access to
the full archive back to 1997
All customers have access to both
Science and Social Sciences
editions of the JCR at the same time.
For the first time it is possible to group journals
by the Essential Science Indicators subject
classification schema of 22 disciplines
Limit your analysis to only
those journals in certain
quartiles of their subject area
Or limit to a specific range
of Impact Factors
MEASURE YOUR RESEARCH
PERFORMANCE WITH INCITES
Guillaume Rivalle
Guillaume.rivalle@thomsonreuters.com
APRIL 2014