Academic Analytics:
Obtaining Benchmarks
for
Faculty Productivity
Carol Livingstone
Division of Management Information
www.dmi.illinois.edu
livngstn@illinois.edu
333-3551
The Problem: How to Evaluate
Scholarly Productivity
Very
G
few good measures
& C – dollars/numbers
College/dept
collections of publication
and awards data
Anecdotal
evidence from faculty search
and outside offer processes
The Problem: How to Evaluate
Scholarly Productivity
No
easy benchmarks/peer comparisons
No campus-wide database for vita info publications and awards

Overview of Academic Analytics
AA
has compiled a massive database of
journal articles, books, chapters, grants,
honors, awards, etc.
The
scholarly output is matched by name
with faculty and researchers at schools
nationwide
The
database can be used to quantify
scholarly output at any university – by
discipline – and compare it to peers
AA Database contents - Measures
Books
Honorific
Journal
Articles
Citations
Grants
awards
Database Scope
9,874
PhD programs
385
institutions, 170,000+ faculty
172
disciplines in 11 broad fields
22
AAU institutions actively
participate, 30 others considering
Book Variables
56,000 authored & edited books (Baker
& Taylor, Library of Congress, British
Library)
Books
per faculty member
#
Faculty who published a book
%
of faculty with a book
Total
number of books
Journal Article Variables
1 million+ articles (journals, and
conference proceedings)
Articles
per author
Articles
per faculty member
#
Faculty with an article
%
of Faculty with an article
Total
number of articles
Citations
10 million + Citations (Scopus & Proquest)
Citations
per author
Citations
per article
Citations
per faculty member
#
Faculty with a citation
%
of Faculty with a citation
Total
number of citations
Honorific Awards
395 awarding bodies, 2700+ award types
Awards
per faculty member
#
Faculty with an award
%
of Faculty with an award
Total
number of awards
Grants Variables
95,000+ federal research grants
Dollars
Grant
per Grant
dollars per faculty member
#
of Faculty with a grant
%
of Faculty with a grant
Total
Total
Grant dollars
number of grants
Academic Analytics AAU Clients
Cornell
Duke
Emory
Iowa State
Johns Hopkins
MIT
Ohio State
SUNY - Stony Brook
Texas A & M
Chicago
Colorado
Kansas
Missouri - Columbia
Missouri - Kansas City
North Carolina
Pittsburgh
USC
Wisconsin - Madison
Vanderbilt
Wash U - St. Louis
Where we are
Summer,
Fall,
30
2011 – 3 yr contract signed
2011 - Steering team commissioned
users have been authorized
Fall,
2009 faculty data available through
web dashboard
Fall,
2010 faculty lists are being
processed
Annual Process –Faculty Lists
DMI
AA
Colleges
Depts
Academic Analytics Output
Summary data by department or broad
disciplinary area (not by faculty member)


Comparisons to selected peers

Access to entire scrubbed database
Analytical
interface
tools through a dashboard
Sample Output – Productivity Radar
Sample Output – Program Gauge
Sample Output – Quintile Analysis
Steering Committee Goals
Refine
faculty selection process/criteria
Oversee
rollout to college/dept staff
Evaluate
tool
Demo
Questions??