DIY Tools for Grad
Program Assessment
An Approach and Some Examples
Rick Dale
CIS Grad Chair
cogsci.ucmerced.edu / cognaction.org/rick
program
^
Graduate Assessment
program
^
Graduate Assessment
program
^
Graduate Assessment
program
^
Graduate Assessment
program
^
Graduate Assessment
program
^
Graduate Assessment
training in
scientific
research
Annual Meeting of the !
Cognitive Science Society!
(“CogSci”)!
!
premiere
interdisciplinary
cognitive science
conference
!
almost 1,000 presentations
1,500 attendees
hundreds of schools
!
CogSci Abstracts
CogSci Abstracts
…
CogSci Abstracts
…
similarity score
Approach: compare similarities of
4 advanced PhD students
10000
0
Density
Approach: compare similarities of
Distribution
of topical similarity at CogSci 2013
4 advanced
PhD students
−0.5
0.0
0.5
1.0
Similarity score between a pair of abstracts (cosine)
10000
0
Density
Approach: compare similarities of
Distribution
of topical similarity at CogSci 2013
4 advanced
PhD students
−0.5
0.0
0.5
1.0
Similarity score between a pair of abstracts (cosine)
10000
average
of least
similar
abstracts
0
Density
Approach: compare similarities of
Distribution
of topical similarity at CogSci 2013
4 advanced
PhD students
−0.5
0.0
0.5
1.0
Similarity score between a pair of abstracts (cosine)
10000
average
of least
similar
abstracts
average
of most
similar
abstracts
0
Density
Approach: compare similarities of
Distribution
of topical similarity at CogSci 2013
4 advanced
PhD students
−0.5
0.0
0.5
1.0
Similarity score between a pair of abstracts (cosine)
10000
similarity across
the 4 advanced
PhD students
average
of least
similar
abstracts
average
of most
similar
abstracts
0
Density
Approach: compare similarities of
Distribution
of topical similarity
4 advanced
PhD students
averageat CogSci 2013
−0.5
0.0
0.5
1.0
Similarity score between a pair of abstracts (cosine)
4
7
~300
institutions
2012
e
~300 institutions
2
0
CogSci 2013
Accepted Proceedings Paper
32% rejection rate
20
18
16
14
12
10
8
#5
University0of0California,0San0Diego
Stanford0University
Indiana0University
Carnegie0Mellon0University
University*of*California,*Merced
University0of0California,0Berkeley
Max0Planck0InsAtute0for0Human0Development
University0of0New0South0Wales
Tilburg0University
6
~350 institutions
4
~350 institutions
2
0
Presentations
Rank
4
7
~300
institutions
2012
e
~300 institutions
2
0
CogSci 2013
Accepted Proceedings Paper
32% rejection rate
20
18
16
14
12
10
8
#5
University0of0California,0San0Diego
Stanford0University
Indiana0University
Carnegie0Mellon0University
University*of*California,*Merced
University0of0California,0Berkeley
Max0Planck0InsAtute0for0Human0Development
University0of0New0South0Wales
Tilburg0University
6
~350 institutions
4
~350 institutions
2
0
Presentations
Rank
s at the conference. This year, no matter how you count it, Merced is in the
side by side with Indiana, Stanford, and UC Berkeley. CogSci is held in the
n involves over 300 institutions on approaching 1,000 presentations.
2
7
~300
institutions
CogSci 2014
Accepted Proceedings Paper
28% rejection rate
22
20
18
16
14
12
10
#3
University0of0California,0San0Diego
MIT
University*of*California,*Merced
Stanford0University
Tilburg0University
Carnegie0Mellon0University
Northwestern0University
University0of0California,0Berkeley
Indiana0University
8
6
4
2
0
~300 institutions
s at the conference. This year, no matter how you count it, Merced is in the
side by side with Indiana, Stanford, and UC Berkeley. CogSci is held in the
n involves over 300 institutions on approaching 1,000 presentations.
2
7
~300
institutions
CogSci 2014
Accepted Proceedings Paper
28% rejection rate
22
20
18
16
14
12
10
#3
University0of0California,0San0Diego
MIT
University*of*California,*Merced
Stanford0University
Tilburg0University
Carnegie0Mellon0University
Northwestern0University
University0of0California,0Berkeley
Indiana0University
8
6
4
2
0
~300 institutions
training in
scientific
research
cognitive & information sciences graduate student productivity and contributions in the 2012-2013 academic year
Chicago
Lisbon
Berlin
Galway
Edmonton
Santa Barbara
Washington, DC
Newcastle
Minneapolis
Potsdam
10 cities, 6 countries
59 unique
conference
presentations
40 unique writing
endeavors
5 chapters
language development: evolution, change, acquisition
nonlinear methods for psychological science
lsa summer institute universality and variability
joint action workshop
spatial cognition summer institute
dynamic field theory
structural equation modeling
exploratory data mining
8 unique
workshop
experiences
extensive
service
including
12 accepted or in-press journal articles
13 submitted journal articles
13 proceedings
3 in-prep papers
!
ad hoc journal manuscript reviewing
providing extensive undergrad research experiences
university representation and coordination
workshop presentations to summer research
programs, e.g., McNair Scholars Program
cogsci.ucmerced.edu based on data from 19 students
program
^
Graduate Assessment
Thanks
UC Merced Branding
UNIVERSITY SEAL
This seal is used under the authority of the Regents of the University of California. The s
The official seal of the
may not be altered. Use of the seal in communication and marketing materials must be
University of California is:
approved by University Communications. Please contact University Communications at
559-241-7411 for camera-ready or electronic versions of the seal.
c gsCI
OFFICIAL UC MERCED LOGO
FOR PRINTED PUBLICATIONS
www.ucmerced.edu
RECOMMENDED FORMAT FOR
THE OFFICIAL LOGO WITH NAMES
OF SCHOOLS AND DEPARTMENTS*
SCHOOL OF NATURAL SCIENCES
Environmental Sciences
SCHOOL OF NATURAL SCIENCES
Environmental Sciences
STUDENT AFFAIRS
Admissions Office
*NOTE:
Logos for schools and departments
are available from University
Communications at 559-241-7411.
STUDENT AFFAIRS
Admissions Office
SCHOOL OF SOCIAL SCIENCES
HUMANITIES AND ARTS
Anthropology
SCHOOL OF SOCIAL SCIENCES
HUMANITIES AND ARTS
Anthropology
SCHOOL OF ENGINEERING
Bioengineering
SCHOOL OF ENGINEERING
Bioengineering
UC MERCED
Thanks to UCM Assessment
|
GRAPHIC STANDARDS
|
Spring