DIY Tools for Grad Program Assessment An Approach and Some Examples Rick Dale CIS Grad Chair cogsci.ucmerced.edu / cognaction.org/rick program ^ Graduate Assessment program ^ Graduate Assessment program ^ Graduate Assessment program ^ Graduate Assessment program ^ Graduate Assessment program ^ Graduate Assessment training in scientific research Annual Meeting of the ! Cognitive Science Society! (“CogSci”)! ! premiere interdisciplinary cognitive science conference ! almost 1,000 presentations 1,500 attendees hundreds of schools ! CogSci Abstracts CogSci Abstracts … CogSci Abstracts … similarity score Approach: compare similarities of 4 advanced PhD students 10000 0 Density Approach: compare similarities of Distribution of topical similarity at CogSci 2013 4 advanced PhD students −0.5 0.0 0.5 1.0 Similarity score between a pair of abstracts (cosine) 10000 0 Density Approach: compare similarities of Distribution of topical similarity at CogSci 2013 4 advanced PhD students −0.5 0.0 0.5 1.0 Similarity score between a pair of abstracts (cosine) 10000 average of least similar abstracts 0 Density Approach: compare similarities of Distribution of topical similarity at CogSci 2013 4 advanced PhD students −0.5 0.0 0.5 1.0 Similarity score between a pair of abstracts (cosine) 10000 average of least similar abstracts average of most similar abstracts 0 Density Approach: compare similarities of Distribution of topical similarity at CogSci 2013 4 advanced PhD students −0.5 0.0 0.5 1.0 Similarity score between a pair of abstracts (cosine) 10000 similarity across the 4 advanced PhD students average of least similar abstracts average of most similar abstracts 0 Density Approach: compare similarities of Distribution of topical similarity 4 advanced PhD students averageat CogSci 2013 −0.5 0.0 0.5 1.0 Similarity score between a pair of abstracts (cosine) 4 7 ~300 institutions 2012 e ~300 institutions 2 0 CogSci 2013 Accepted Proceedings Paper 32% rejection rate 20 18 16 14 12 10 8 #5 University0of0California,0San0Diego Stanford0University Indiana0University Carnegie0Mellon0University University*of*California,*Merced University0of0California,0Berkeley Max0Planck0InsAtute0for0Human0Development University0of0New0South0Wales Tilburg0University 6 ~350 institutions 4 ~350 institutions 2 0 Presentations Rank 4 7 ~300 institutions 2012 e ~300 institutions 2 0 CogSci 2013 Accepted Proceedings Paper 32% rejection rate 20 18 16 14 12 10 8 #5 University0of0California,0San0Diego Stanford0University Indiana0University Carnegie0Mellon0University University*of*California,*Merced University0of0California,0Berkeley Max0Planck0InsAtute0for0Human0Development University0of0New0South0Wales Tilburg0University 6 ~350 institutions 4 ~350 institutions 2 0 Presentations Rank s at the conference. This year, no matter how you count it, Merced is in the side by side with Indiana, Stanford, and UC Berkeley. CogSci is held in the n involves over 300 institutions on approaching 1,000 presentations. 2 7 ~300 institutions CogSci 2014 Accepted Proceedings Paper 28% rejection rate 22 20 18 16 14 12 10 #3 University0of0California,0San0Diego MIT University*of*California,*Merced Stanford0University Tilburg0University Carnegie0Mellon0University Northwestern0University University0of0California,0Berkeley Indiana0University 8 6 4 2 0 ~300 institutions s at the conference. This year, no matter how you count it, Merced is in the side by side with Indiana, Stanford, and UC Berkeley. CogSci is held in the n involves over 300 institutions on approaching 1,000 presentations. 2 7 ~300 institutions CogSci 2014 Accepted Proceedings Paper 28% rejection rate 22 20 18 16 14 12 10 #3 University0of0California,0San0Diego MIT University*of*California,*Merced Stanford0University Tilburg0University Carnegie0Mellon0University Northwestern0University University0of0California,0Berkeley Indiana0University 8 6 4 2 0 ~300 institutions training in scientific research cognitive & information sciences graduate student productivity and contributions in the 2012-2013 academic year Chicago Lisbon Berlin Galway Edmonton Santa Barbara Washington, DC Newcastle Minneapolis Potsdam 10 cities, 6 countries 59 unique conference presentations 40 unique writing endeavors 5 chapters language development: evolution, change, acquisition nonlinear methods for psychological science lsa summer institute universality and variability joint action workshop spatial cognition summer institute dynamic field theory structural equation modeling exploratory data mining 8 unique workshop experiences extensive service including 12 accepted or in-press journal articles 13 submitted journal articles 13 proceedings 3 in-prep papers ! ad hoc journal manuscript reviewing providing extensive undergrad research experiences university representation and coordination workshop presentations to summer research programs, e.g., McNair Scholars Program cogsci.ucmerced.edu based on data from 19 students program ^ Graduate Assessment Thanks UC Merced Branding UNIVERSITY SEAL This seal is used under the authority of the Regents of the University of California. The s The official seal of the may not be altered. Use of the seal in communication and marketing materials must be University of California is: approved by University Communications. Please contact University Communications at 559-241-7411 for camera-ready or electronic versions of the seal. c gsCI OFFICIAL UC MERCED LOGO FOR PRINTED PUBLICATIONS www.ucmerced.edu RECOMMENDED FORMAT FOR THE OFFICIAL LOGO WITH NAMES OF SCHOOLS AND DEPARTMENTS* SCHOOL OF NATURAL SCIENCES Environmental Sciences SCHOOL OF NATURAL SCIENCES Environmental Sciences STUDENT AFFAIRS Admissions Office *NOTE: Logos for schools and departments are available from University Communications at 559-241-7411. STUDENT AFFAIRS Admissions Office SCHOOL OF SOCIAL SCIENCES HUMANITIES AND ARTS Anthropology SCHOOL OF SOCIAL SCIENCES HUMANITIES AND ARTS Anthropology SCHOOL OF ENGINEERING Bioengineering SCHOOL OF ENGINEERING Bioengineering UC MERCED Thanks to UCM Assessment | GRAPHIC STANDARDS | Spring