WEB OF KNOWLEDGE UPDATE TRAINING
MIMAS 2010
Email:rachel.mangan@thomsonreuters.com
More information: www.isiwebofknowledge.com
CONTENT
New Features of Web of Knowledge 4.0
•
Enhancements to ResearcherID
•
New Features in Endnote Web
•
Refine results by Funding Agency in Web of Science
Biosis Citation Index in Web of Knowledge 5.0
•
Introduction to Biosis Citation Index
•
Examination of a BIOSIS Full Record
•
Examination of Cited References and Cited Reference Navigation
•
Cited Reference Search
Web of Science in Web of Knowledge 5
•
Web of Science searching enhancements
•
Display Enhancements
•
Analyse Enhancements
•
Citation Enhancements
•
All Data Base Searching in WOK 5
•
Record Management Enhancements
Introduction to using Bibliometrics for Research Evaluation
•
Definition of Bibliometrics and introduction to Research Evaluation
•
Bibliometrics available in Web of Science and JCR (h index, Average Citation per paper, Total Papers, Total
Citations, Citing Articles, indirect citations and Impact Factor etc)
•
Relative Metrics in Incites (Journal Expected Citation Rates, Category Expected Citation Rates, Percentile, etc.)
2
NEW FEATURES OF WEB OF KNOWLEDGE
4.0
3
EXAMPLE RESEARCHER ID
Visibly explore
who this author
collaborates with
RESEARCHER ID
•
A secure Web platform creates a system-generated unique
identifier for each registrant
•
•
•
As a free online community anyone can access and use
Privacy options are controlled by the user
Robust web services allow integration with institutional
systems to access, create, and use profile and publication data
•
Integration with the Web of Knowledge, Endnote Web,
EndNote, and other systems help build publication lists
•
Interacts with the Web of Science to provide current
bibliographic data and citation counts
5
RESEARCHER ID ENHANCEMENTS
• Re-design of home page
• Include up to 10 Past Institutions in your RID profile
• Include ‘past institution’ in institution search
• Endnote Web users also registered in RID have 3
Publication Lists. Non Endnote Web users view
only ‘My Publications’.
• Import Publications stored in your Endnote Web
Library to your RID publication lists
• Rename Publications Lists 1 & 2 from your
Endnote Web Library
6
SEARCH ‘PAST INSTITUTION’ IN RID
SEARCH
RID profiles can
include up to 10
Past Institutions. To
search this field
select also search
“past institutions”.
7
INCLUDE UP TO 10 PAST INSTITUTIONS IN
YOUR RID PROFILE
Selecting the ‘My
Affiliations’ tab add up to
10 Past Institutions to your
RID profile. You can
include Role, Start and
End date
8
ENDNOTE WEB USERS- ACCESS TO 3
PUBLICATION LISTS (1 & 2)
Endnote Web users will have access
to an additional 2 Publication Lists. All
RID users by default will view ‘My
Publications’
9
IMPORT PUBLICATIONS FROM YOUR
ENDNOTE WEB LIBRARY
10
ADD PUBLICATIONS STORED IN YOUR ENDNOTE
WEB LIBRARY TO YOUR RID PUBLICATION LISTS
11
ADD PUBLICATIONS FROM AN ONLINE
SEARCH/ IMPORT REFERENCES TO YOUR
RID PUBLICATION LIST
12
RENAME PUBLICATION LISTS 1 & 2 FROM
YOUR ENDNOTE WEB LIBRARY
13
WEB OF SCIENCE- SEARCH FOR FUNDING
AGENCIES OR GRANT NUMBERS
14
REFINE RESULTS BY FUNDING AGENCIES
15
ENDNOTE WEB ENHANCEMENTS
16
IMPROVED EDIT REFERENCE TOOLS
Improved formatting for records with
certain extended characters
17
INCLUDE REFERENCES FROM SHARED
GROUPS IN CWYW
To include Shared Folders in
CWYW select the folder from
the ‘Others Groups’ list
18
CAPTURE AUDIO/VISUAL REFERENCES
TO ADD TO YOUR ENDNOTE WEB
LIBRARY
Use the Capture function in
Internet Explorer to import an
audio/visual reference to you
Endnote Web library
19
AUDIO VISUAL REFERENCE IN ENWVIDEO EMBEDDED IN REFERENCE
Reference details will
automatically be populated
20
BIOSIS CITATION INDEX
21
BCI INTRODUCTION
• Combines the broadest coverage available for life science
research with the power of cited reference searching
• Full source file - 1926 to present
• Content from BIOSIS Previews
–
Biological Abstracts/Reports, Reviews and Meetings
–
Includes approximately 5,000 journals and over 165,000 items from more than
1,500 meetings
–
Unified indexing structure for relevant subject retrieval
• General and Cited Reference Searching
–
Fully indexed cited references from BIOSIS sources from 2006 forward
–
Items published prior to 2006 and which overlap with Web of Science will also
contain cited reference data
22
BIOSIS CITATION INDEX SUBJECT
COVERAGE
• Coverage includes traditional areas of biology such as:
– Botany
– Zoology
– Microbiology
• And, related fields such as:
– Biomedical
– Agriculture
– Pharmacology
– Ecology
• And, interdisciplinary fields such as:
– Medicine
– Biochemistry
– Biophysics
– Bioengineering
– Biotechnology
23
BIOSIS FULL RECORD
Times Cited:
Citations from other
BIOSIS records
Cited by:
Citations
from All
Databases
(WOS, CSI,
BCI)
BIOSIS
specialist
indexing
24
BIOSIS REFERENCES
References are hyperlinked to their
source article in other WOK databases.
If your subscription allows you to view
those items you will see the hyperlinks.
If not, they will display as plain text.
View articles that cite a Reference by
clicking on the Times Cited count for
that item. Citations from ‘All Databases’
Order the References by these options.
25
BIOSIS CITING ARTICLES
Total unique Citations from
Citation Databases. A single
citing item may be found in
more than one database
This Score card details the number of
citations to this article from each Web of
Knowledge citation resource. These
counts are complete, regardless of your
subscription, so you are seeing the full
picture of the citations to this item. You
will only be able to follow links to items
for which you have a subscription
26
BIOSIS CITED REFERENCE SEARCH
Select your Cited Reference
Search elements from the
drop down menu
27
BIOSIS CITED REFERENCE SEARCH
SUMMARY TABLE
References display that
correspond to your query.
Click on ‘Show expanded
title’ to view the title of the
reference.
First author of reference
displays (even though you
may have searched a
secondary author)
Cited Work contains your
query some where in the
title, not just at the
beginning (WOS)
Restrict the results by the
options available
28
WEB OF SCIENCE IN WEB OF
KNOWLEDGE 5.0
29
SEARCHING ENHANCEMENTS
30
ADJUST DISPLAY ORDER OF RESULTS
FROM GENERAL SEARCH PAGE
Now you order the results by
journal cover date.
31
ELIMINATION OF STOPWORDS
32
ADJUST SEARCH- SWITCH ON/OFF
LEMMATIZATION
Lemmatization switched ‘on’
will include alternatives of
your word in your search.
run, runs, ran and running
are forms of the same
lexeme, with run as the
lemma
33
ADJUST SEARCH- SWITCH ON/OFF
LEMMATIZATION
34
FULL RESULT COUNTS
NO MAXIMUM ON ‘ANALYZE RESULTS’
35
ADDITIONAL SORTING OPTIONS ON
RESULTS SUMMARY PAGE
36
LEFT HAND TRUNCATION
37
DISPLAY ENHANCEMENTS
38
PREVIEW ABSTRACT ON SUMMARY PAGE
39
CITED REFERENCE ENHANCEMENTS
40
ADDITIONAL CITED REFERENCE SEARCH
FIELDS- CITED REFERENCE SEARCHING IN ALL
CITATION SOURCES (WOS, BCI, CSI)
New cited reference search
parameters facilitate a more
accurate search
41
ALL DATA BASE SEARCHING IN WOK 5
42
REFINE ALL DATA BASE SEARCH BY DATA
BASE
43
EACH DATABASE HAS OWN CITATION
COUNT
44
CITATION REPORT AVAILBLE FOR EACH
DATA BASE (WOS ,BCI & CCI) AND ALL
DATA BASE SEARCH
45
RUN CITATION REPORT FROM MARKED
LIST
46
WOK 5 RECORD MANAGEMENT
ENHANCEMENTS
47
ALL DATA BASE MARKED LISTACCUMULATE ALL MARKED ITEMS IN
PRODUCT SPECIFIC LISTS
Mark up to 5,000 records
at a time.
Export and print limited to
500
For product specific export
fields view the marked
items in product specific
list
48
ANALYSE OR RUN CITATION REPORT
FROM PRODUCT MARKED LIST
49
KEY FEATURES FOR FUTURE RELEASES
• ResearcherID search
• RSS Feeds
• Link to ResearcherID record
from author full record
• Links to full text, open URL from
cited references
• Direct RefWorks export from
WoK
• Sorting cited references
• Spellcheck ‘Did you mean..?’
• Search highlighting
• Numbers in refine panel for All
DB results
• Search aids
• Abstract export for All DB results
• Author Finder
• BibTeX output from WoS
• Analyze feature in All DB results
• Alerting
50
INTRODUCTION TO USING BIBLIOMETRICS FOR
RESEARCH EVALUATION
51
CONTENT
• Why evaluate research performance?
• How can research be evaluated?
• Who at an institution engages in research
evaluation?
• What types of data are used in bibliometrics?
• What does bibliometrics measure?
52
WHY EVALUATE RESEARCH
PERFORMANCE
• Science research is now such a large enterprise and the substance of
scientific research is complex and specialized
• Personal knowledge and experience are no longer sufficient tools for
understanding trends or for making decisions
• The need to be selective and to highlight significant or promising areas of
research, and to manage better investments in science is increasing.
• Funding from government, industry, education and philanthropy have not
grown as fast as science
• Universities, government offices and labs, and boardrooms face pressing
questions about what should be supported and what should not, or
which research projects and researchers should receive more support than
others.
• A library faced with collection decisions, a foundation making funding
choices, or a government office weighing national research needs must rely
on expert analysis of scientific research performance.
53
WHY EVALUATE RESEARCH
PERFORMANCE
• Increasingly, universities everywhere must demonstrate their
special capabilities to a variety of constituencies
• Universities that seek research funding from government agencies
and foundations must provide evidence of their
accomplishments and capacities
• In many countries, universities, whether public or private, must
account for their performance as part of national or professional
accountability protocols
• Every university must have a clear, evidence-based understanding
of the institution’s performance towards its goals and mission
• This understanding is achieved and maintained through ongoing
evaluation of all of the institution’s functions: A university must
evaluate its Research performance
• Data on research performance helps to inform strategic decisions
about what areas of research to support or build
54
-With solid, objective information about
production and impact, the university has a
strong basis for setting goals, charting
progress, making budgetary and hiring
decisions, investing in facilities, and
working with external agencies
55
HOW CAN RESEARCH BE EVALUATED?
56
WHAT IS BIBLIOMETRICS?
Bibliometrics:
“the statistical analysis of bibliographic data, mainly in scientific and
technical literatures. It measures the amount of scientific activity in a
subject category, journal, country, topic or other area of interest.”
Dr. Henry Small, Chief Scientist, Thomson Reuters (Scientific)
“If you can measure that of which
you speak, and can express it by a
number, you know something of
your subject; but if you cannot
measure it, your knowledge is
meager and unsatisfactory”
- Lord Kelvin (William Thomson)
BIBLIOMETRICS
• Bibliometrics turns the main tool of science,
quantitative analysis, on itself.
• Essentially, bibliometrics is the application of
quantitative analysis and statistics to publications
such as journal articles and their accompanying
citation counts.
• Quantitative evaluation of publication and citation
data is now used in almost all nations around the
globe with a sizeable science enterprise
58
BIBLIOMETRICS AND PEER JUDGEMENT:
A TWO-PRONGED APPROACH
• Global in perspective
• Offers “top-down” review that puts
the work in context
• Complements the local perspective
of peer review
• Provides data on all activity in an
area, summaries of these data,
and a comprehensive perspective
on activity and achievements
• Uses weighted quantitative
measures (papers per researcher
or citations per paper)
• For example, when we think of “the
best,” it is hard not to think
automatically of the biggest
producers, such as individuals,
labs, and universities; but those
locations might not be the source
of the most important work.
• Likewise, quantitative analysis
indicates current top performers,
thus balancing human perceptions
of reputation
• Removes characteristics, such as
the place of production, or past
reputation, that color human
perceptions of quality.
59
Bibliometrics are one piece of the
research performance puzzle.
They complement other types of
assessment.
Citation data
Funding data
Awards/Honors
Peer review
• Combination of multiple methodologies and data sources
• Examples of data sources / methodologies:
–
–
–
–
–
# of and value of Grants awarded
# of awards (e.g. Nobel Prizes)
Peer evaluation
Publication counts
Citation counts/citation metrics
• Combination of factors
– None of these measure works perfectly on its own, there are always
anomalies and human judgment is required to interpret the results
60
WHO IS ALREADY USING BIBLIOMETRICS?
Today, bibliometrics programs with large teams of analysts are firmly established in many
nations, and these groups issue bibliometric reports, often called science indicators
studies, at regular intervals using ThomsonReuters data
 US National Science Foundation -Science & Engineering Indicators
 European Commission:
 European Union Science & Technology Indicators
 Japan’s National Institute for Informatics (NII)
 Ministry of Economy, Trade and Industry
 National Institute for Science and Technology Policy
 US National Research Council -- Doctoral Program Ranking
 Also used by government entities in France, Australia, Italy, Japan,
UK, Portugal, Norway, Spain, Belgium, South Korea, Canada, and
more, to shape higher education policy.
WHO AT AN INSTITUTION ENGAGES EN
RESEARCH EVALUATION?
62
Different stakeholders in research evaluation
External Entities
Government agencies/funding organizations
/accreditors/ state government
Institutional Management
Management, including
committees, provost, vice
provosts
Institutional Depts/Divisions
Deans; Department Heads
Institutional assessment,
academic affairs
Individuals
Faculty,
staff
Library
WHAT TYPES OF DATA ARE USED IN
BIBLIOMETRICS?
• Web of Science- main source of bibliometric data
• Over 50 years, Thomson Reuters has comprehensively collected
data across academic fields, from natural sciences to social
sciences and humanities.
• Highly reliable statistical analysis of the data is possible because of
Thomson Scientific’s consistent policy on indexing and storing data
• Covering core journals
• Covering all types of items
• Covering all authors and their organizations
• Covering all Cited References
64
WEB OF SCIENCE BIBLIOGRAPHIC DATA
65
WHAT DO BIBLIOMETRICS MEASURE?
66
PUBLICATIONS AND CITATIONS
• Number of scholarly journal publications-most basic research activity that
can be counted
• Citations are the references researchers append to their papers to show
explicitly earlier work on which they have depended to conduct their own
investigations.
• Tracking citations and understanding their trends in context is a key to
evaluating the impact and influence of research
67
MOTIVATIONS FOR CITING PREVIOUS
WORK
• Paying homage to pioneers.
• Criticizing previous work.
• Giving credit for related work
(homage to peers).
• Substantiating claims.
• Identifying methodology,
equipment, and the like.
• Providing background reading.
• Correcting one's own work.
• Correcting the work of others.
• Criticizing previous work.
• Substantiating claims.
• Alerting researchers to
forthcoming work.
• Alerting researchers to
forthcoming work.
• Providing leads to poorly
disseminated, poorly indexed,
or uncited work.
• Authenticating data and
classes of fact (such as
physical constants).
• Identifying original publications
in which an idea or concept
was discussed.
68
TYPES OF METRICS AVAILABLE FROM
WEB OF SCIENCE AND INCITES
69
Productivity
Total influence
Efficiency
Journal
Efficiency
Indirect
Influence
Relative Impact/
Benchmark
Total papers
Number of researchers
Characteristics of paper
Total citations
Number of researchers
H-index
Discipline and career history of
researcher
Average citation per paper
Percent Cited/Uncited
Characteristics of paper (discipline)
Impact Factor
5 Year Impact Factor
Immediacy Index
Journal discipline
Total Second Generation Citations
Measure long term impact of paper
Percent Cited/Uncited-Relative
What is normal for the field?
Journal Expected Citation per paper
Same article type/ publication year
Category Expected Citation per
paper
Same article type/publication
year/category
Percentile Indicators
% papers (from set) at top 1%
70
DIFFERENT MOTIVES
REQUIRE DIFFERENT METRICS
• 1. Productivity:
• a. Counts of papers
• Paper counts, which measure productivity, are the most basic
bibliometric measure and provide the raw data for all citation
analysis.
• Ranking institutions in terms of paper counts helps to compare the
productivity and volume of research output among various
institutions.
• The number of researchers at an institution should be taken into
account when comparing publication counts across institutions.
• Characteristics of the papers, such as document type, publication
year, and categorization method, should also be considered.
71
DIFFERENT MOTIVES
REQUIRE DIFFERENT METRICS
• 2. Total recognition/influence:
• a. Citation counts
• Citations measure impact and influence. Citations to papers are
summed over some time period to create an aggregate citation
count.
• Aggregate citation counts of institutions or researchers over the
same time period can be useful in comparing and ranking their
research impact.
• As with paper counts, the number of researchers at an institution will
affect the total number of citations accrued
72
DIFFERENT MOTIVES
REQUIRE DIFFERENT METRICS
• 3. Indirect recognition/influence
• a. Second generation citation counts
• The sum of the citation counts of all the papers citing a target paper.
This is a measure of the long term impact of a paper which is similar
in effect to the Google PageRank.
• Like first generation citation counts, second generation citation
counts need to be normalized by field.
73
DIFFERENT MOTIVES
REQUIRE DIFFERENT METRICS
• 4. Efficiency
• a. Average citations per paper
• Citations per paper (sometimes called “impact”) is computed by
dividing the sum of citations to some set of papers for a defined time
period by the number of papers (paper count).
• b. Percent cited/uncited papers- Absolute
• This metric refers to the percentage of cited or uncited papers in a
sample. A “cited” paper has received at least one citation. This
measure can reveal the amount of publications with no or very little
influence.
• C. Journal Impact Factor
74
DIFFERENT MOTIVES
REQUIRE DIFFERENT METRICS
• 5. Relative Impact/benchmarking
• a. Percent cited/uncited papers- Relative
• Percent cited/uncited papers can be considered relative to the field
of research, a country, institution, etc. This method provides further
context to percent cited/uncited. For example, the rates of citedness
vary across disciplines. Relativizing the measure enables you to
judge the influence of the papers in light of the norm in their field, or
the norm in their country or institution.
• b. Expected Citation Rate for Category (field)
• Field baselines are average citations per paper for papers in a field
(usually a journal set) defined for a specific time period. Since
different fields exhibit different average rates of citation, the mean for
the field should be used to gauge the relative impact of one or a
group of papers.
75
DIFFERENT MOTIVES
REQUIRE DIFFERENT METRICS
• c. Journal Expected citation rate
• Journal Expected Citation rate indicates how often a paper is
expected to be cited based on its year of publication, journal, and
article type. This represents the average citations per paper for the
cohort of papers having these same attributes.
• d. Percentile indicators:
• A paper percentile is determined by taking the year and journal
category of the paper, creating a citation frequency distribution for all
the papers in that year and category (finding the number of papers
cited N times, and arranging these in descending order), and
determining the percentage of papers at each level of citation. The
percentile then indicates how a paper has performed relative to
others in its field
76
CITATION FREQUENCY DISTRIBUTION
Percentile:
Take articles from same publication year/journal category
Order highest citation count to lowest
Record number of papers at each citation level
Determine percentage of papers at each level of citation
77
RELATIVE IMPACT
BENCHMARKING AGAINST BASELINES
Is this a highly cited paper?
RELATIVE IMPACT
AGAINST JOURNAL AVERAGE
Search
publications by:
- Journal
- Document type
- Year
RELATIVE IMPACT
AGAINST JOURNAL AVERAGE
Citation report shows an
average of 7.81 citations
per paper for that journal,
year and document type
RELATIVE IMPACT
AGAINST JOURNAL AVERAGE
So our paper was
cited 22/7.81 = 2.82
times the average
We call this journal
actual versus
expected cites (JXC)
INCITES
82
INCITES
Normalised relative
metrics available in
Incites
83
WEB OF KNOWLEDGE UPDATE TRAINING
THANK YOU!
rachel.mangan@thomsonreuters.com