GMCTE Repository of Validated Course, Program, and Institutional Surveys

advertisement
GMCTE Repository of Validated Course, Program, and Institutional Surveys
The Gwenna Moss Centre for Teaching Effectiveness has developed a repository of
surveys that have been developed in higher education, focused on the student
experience and measuring the impact of programs on learning at both the
undergraduate and graduate levels. These tools have all undergone validity and
reliability testing and the researchers who developed them have published on each of
them over the past two decades.
These only represent a small fraction of the tools that have been developed and are
present in the higher education literature. Each of these thirteen are freely available to
use, but may require a notification to the authors (please see the notes below). For
more information about using these instruments as part of your evaluation at the
course, program, department, or college level, please contact the Gwenna Moss Centre
at gmcte@usask.ca.
1. Revised Study Process Questionnaire (R-SPQ)1 – The R-SPQ gives a measure of a
student’s use of deep and surface approaches to learning as part of their
approach to studying and engaging with course material/activities.
2. Reflection Questionnaire1 – This questionnaire measures the level of a student’s
critical reflective thinking. It contains four scales corresponding to four levels of
reflective thinking: habitual action/non-reflection, understanding, reflection, and
critical reflection.
3. Student Engagement Questionnaire (SEQ)1 – SEQ is a program-level instrument
designed to measure the level of student engagement. The questionnaire
contains scales for eight generic graduate attributes and nine scales which
together measure a broadly-based teaching and learning environment.
1.
2.
3.
4.
5.
6.
7.
Critical thinking
Creative thinking
Self-managed learning
Adaptability
Problem solving
Communication skills
Interpersonal skills and
group work
8. Computer literacy
9. Active learning
10.
11.
12.
13.
14.
15.
16.
17.
Teaching for understanding
Feedback to assist learning
Assessment
Relationship between
teachers and students
Workload
Relationships with other
students
Cooperative learning
Coherence of curriculum
Results from the SEQ can be used as the principal diagnostic measure in a system
for program quality improvement. Results from the SEQ can be used to diagnose
programs that need attention and to demonstrate that there have been
improvements, through longitudinal data, at the institutional level, which
showed increases in scored on relevant scales
4. Course-Based Graduate Student Experience Questionnaire – *adapted from the
University of Sydney Taught Post-graduate Experience Questionnaire (TPEQ).
Designed to be administered specifically to graduate students in course-based
programs, the Course-Based Graduate Student Experience Questionnaire is
based on a model that contains three domains: curriculum and content, teaching
and learning environment, and learning outcomes.
1. Curriculum and content
i. Knowledge
ii. Skill development
iii. Curriculum
2. Teaching and learning
environment
i. Assessment
ii. Active learning
iii. Relevance
iv. Teacher-student
relationships
v. Feedback
vi. Teaching for
understanding
vii. Organization
3. Learning outcomes
i. Career-related
ii. Interest
iii. Critical intellectual
inquiry
iv. Lifelong learning
v. Tackling novel
situations and illdefined problems
vi. Communication
vii. Collaboration
viii. Overall satisfaction
5. Blended Learning Environment Questionnaire – This questionnaire measures
student perceptions of their blended learning environment. It includes items
related to teaching online, online resource design, workload, and interactivity.
The Blended Learning Environment Questionnaire can also be adapted for
program level assessment using the E-learning Scale 2.
6. Student Program Experience Questionnaire (SPEQ) 3 – SPEQ is adapted from the
University of Sydney Student Course Experience Questionnaire (SCEQ).
The survey gathers data on students' perceptions of the quality of teaching and
student learning during their degree program as well as their perceptions of the
administration and student support services. The SPEQ data can provide faculties
with a useful resource to inform strategic teaching and curriculum developments.
7. Classroom Survey of Student Engagement (CLASSE) - CLASSE is a classroom-level
adaptation of the National Survey of Student Engagement (NSSE).
CLASSE asks students how frequently they engage in various educational
practices within a specific course. The questionnaire also includes measures of
student engagement, cognitive demands, and class atmosphere that align to the
sub-scales used on the NSSE survey – Level of Academic Challenge, Active and
Collaborative Learning, Student-Faculty Interaction, Enriching Educational
Experience, and Supportive Campus Environment. Please note, in order to use
CLASSE, a note must be sent to the authors of the instrument in advance, but it
is made available free of charge.
8. The Canadian Graduate Survey – Undergraduate (CGS-U) 4 – Designed to survey
undergraduate students who have completed (ie. graduated) from their program,
the CGS is adapted from the University of Sydney versions of the governmentmandated Australian Graduate Survey (AGS), comprising a Graduate
Destinations Survey and Program Experience Questionnaire.
The Canadian Graduate Survey is comprised of two components:
•
•
Graduate Destinations Survey (GDS) - collects information about the activities of
graduates after the completion of their degrees regarding their career and/or
further study choices.
Program Experience Questionnaire (PEQ) - gathers data about graduates’
perceptions of their higher education experience.
9. The Canadian Graduate Survey – Graduate Student (CGS-GS)5 – The CGS-GS are
adapted from the University of Sydney versions of the government-mandated
Australian Graduate Survey (AGS) and Postgraduate Research Experience
Questionnaire (PREQ).
The survey gathers data on research-based (PhD and thesis-based Masters)
graduate students' perceptions of the quality and frequency of supervision,
intellectual and social climate, infrastructure, approaches to research, quality of
thesis examination, and generic skills development in their research-based
graduate degree.
The purpose of the CGS-GS is to provide the University community with a basis
for strategic, faculty level academic development and curriculum review to
further enhance the quality of research-based graduate degrees. The GSREQ also
provides data for benchmarking between similar programs in different
universities.
10. Undergraduate Research Participation Survey (URPS) – The URPS is adapted from
the MIT Undergraduate Research Opportunity Program (UROP) Survey.
The Undergraduate Research Participation Survey is a measure of undergraduate
student participation in research. Questionnaire items pertain to student
perceptions of undergraduate research participation, motivation, barriers,
supervision, compensation, and outcomes/benefits.
11. CIRP First Year Survey 6 – The CIRP is adapted from the Cooperative Institutional
Research Program (CIRP) Freshman Survey, a national longitudinal study of the
American higher education system.
The CIRP First Year Survey is designed for administration to incoming first-year
students prior to beginning classes. The instrument collects extensive
information that allows for a snapshot of what incoming students are like before
they experience college. Key sections of the survey examine:
•
•
•
•
Established behaviors in high
school;
Academic preparedness;
Admissions decisions;
Expectations of college;
•
•
•
•
Interactions with peers and faculty;
Student values and goals and
Student demographic characteristics;
and
Concerns about financing college.
12. Enrolled Student Survey (ESS) – The ESS is adapted from the Consortium on
Financing Higher Education (COFHE) Enrolled Student Survey (ESS).
The Enrolled Student Survey asks students about time spent doing various
activities in and out of the classroom (including work, extracurricular activities,
etc.). In addition, the ESS explores student perceptions of their university
experience including how their skills and abilities have changed since enrolling at
the University of Saskatchewan. Student satisfaction and wellbeing, as well as,
sources of advice about academic, career, and personal choices are also explored.
13. Student Motivation and Attitudes to Academic Research (SMAAR) 7 – The SMAAR
questionnaire measures student motivation as it relates to attitudes about
academic research as a component of the learning environment. Questionnaire
items pertain to students’ career aspirations, their attitudes toward studying,
perception of their program/department, and their understanding/attitude
toward research. Please note, in order to use this survey, a note must be sent to
the authors of the instrument in advance, but it is made available free of charge.
1
Additional information regarding analysis and interpretation of questionnaire results can be found in:
Kember, D. & Ginns, P. (2012). Evaluating Teaching and Learning: A practical handbook for colleges,
universities and the scholarship of teaching. Routledge: London and New York.
2 Additional information on the E-learning Scale can be found in Kember, D. and Ginns, P. (2012, p. 38).
3 More information regarding the SCEQ can be found at http://www.itl.usyd.edu.au/sceq/
4 More information regarding the AGS and CEQ can be found at http://www.itl.usyd.edu.au/ceq/
5 More information regarding the PREQ can be found at http://www.itl.usyd.edu.au/preq/
6 More information regarding the CIRP First Year Survey can be found at
http://www.heri.ucla.edu/cirpoverview.php
7 Additional information regarding the Student Motivation and Attitudes to Academic Research
Questionnaire Item can be found in: Breen, R. & Lindsay, R. (1999). Academic research and student
motivation. Studies in Higher Education, 24:1, 75-93. Notification must be provided to the authors for use.
Download