QLP TA Training Workshop
FALL 2015
AGENDA (Morning)
9:00 – 9:10
9:10 – 9:20
9:20 – 9:30
Introduction to QLP
Student Learning Outcomes (SLOs)
Data Collection Overview & Parscore
Tutorial
9:30 – 9:40 Data Entry and Submission
(QLCDS-upper division only)
9:40 – 9:50 Tips for TA/Graders and Resources
9:50 – 10:00 Tips for Grading Writing
Team
Kim Massaro
Kimberly Ward
Kim Massaro
Kimberly Ward
Gail Pizzola
AGENDA (Afternoon)
1:00 – 1:10 Introduction to QLP
1:10 – 1:20 Student Learning Outcomes (SLOs)
1:20 – 1:30 Data Collection Overview & Parscore
Tutorial
1:30 – 1:40 Data Entry and Submission
(QLCDS-upper division only)
1:40 – 1:50 Tips for TA/Graders and Resources
1:50 – 2:00 Tips for Grading Writing
Team
Kim Massaro
Kimberly Ward
Kim Massaro
Kimberly Ward
Gail Pizzola
What is the QLP?
 The Quantitative Literacy Program is part of UTSA’s
Quality Enhancement Plan to address the critical need
for quantitative skills in students by enhancing core
curriculum of select courses.
 The goal is to teach
students to think critically
when solving problems
that involve observing and
interpreting data.
Quantitative Literacy Program (QLP) Program Goals
 Develop quantitative skills in
undergraduate students
 Implement effective teaching pedagogies
and assessments to support the
development of an exemplary quantitative
scholarship program at the undergraduate
level
 Provide the organizational framework and
resources for an institutional
transformation to graduate a quantitatively
informed citizenry
Q-Course
Current
Course
QLP
Data
+ Q. Methods
+ Redesign
Q-Course
• Learn Quantitative Skills
• Think critically
• Interpret and use data
that naturally exist in
the subject area
• Make informed
decisions
• Makes the course more
engaging
How are Q-courses different from regular courses?
In regular (non-Q) courses, information and data are
presented to students in a lecture format and discussed.
In a Q-course, students generate and analyze real-world
data sets appropriate for the subject.
Example: Physical Anthropology
students visited the San
Antonio Zoo to collect data on
primate activities and created
charts and graphs for study
Why is it important? Get More Out of Courses
QLP courses help students
1. Acquire basic quantitative literacy and numeracy skills
2. Effectively communicate the results of their quantitative
analysis
3. Acquire discipline-specific advanced quantitative skills
By incorporating data analysis into existing classes, students will
see how informed decisions can be made in the context of
their discipline.
These skills are useful in everyday life.
QLP Growth
Year One
(2011-12)
20 faculty
10 Q-Courses
113 Sections
Year Four
(2014-15)
100 faculty
27 Q-Courses
556 Sections
6,845 enrollments
26,599 enrollments
2015-16 Q-course List
ANT 2033
ANT 2043
ARC 4183
ARC 4283
BIO 1233
BIO 1404
COM 3073
CRJ 3013
ECO 2003
ECO 2013
ECO 2023
ENG 2413
ES 2013
27 Q-courses
19 core, 8 upper division
HIS 2123
HIS 2133
KIN 3323
MAT 1043
MDS 4983
PHI 1043
POL 1013
POL 1113
SOC 1013
SOC 3323
SPE 3603
STA 1053
WRC 1013
WRC 1023
QLP Student Learning Outcomes
LEARNING TO
EVALUATE
EXPLORE
Students will demonstrate the ability to explore
data to define problems and identify solutions in
a variety of real-world contexts.
VISUALIZE
Students will demonstrate the ability to visualize data
through converting information into different graphical
and tabular forms.
ANALYZE
Students will demonstrate the ability to analyze
data using different quantitative methods and
draw appropriate conclusions.
TRANSLATE
Students will demonstrate the ability to translate
quantitative language into verbal assumptions
and vice versa.
EXPRESS
Students will demonstrate the ability to express
quantitative evidence effectively in oral or written
communication.
Taxonomies
Data Collection Overview
PRE-TEST
ASSIGNMENT(S)
POST-TEST
Different Courses—Different Processes
 Depending on the course, the data collected will differ.
Core Courses (1000 or 2000 level)
Upper-Division (3000 or 4000 level)
Pre/post-test including one short
written question (SLO: Express)
Pre/post-test including one short
written question (SLO: Express).
Q-Assignment data not
collected/submitted to the QLP
One common Q-assignment that covers
four or more SLOs, including Translate
and Express
 Core courses still give and grade Q-assignments, but no
longer need to upload data to QLCDS website
How to grade Parscore
PRE/POST-TEST
Parscore Process
1.
Faculty register for Parscore for their Q-course sections at the
beginning of every new semester.
2.
The students fill out the Parscore forms for pre/post-test.
3.
The faculty/grader grades the Express piece for student.
4.
The grader puts the Express score on student’s Parscore form
5.
Faculty/Grader create a Parscore “key” and drop off forms to
Parscore office, indicating it is a Q-course and give permission
for Testing Services to send student results to the QLP.
Parscore Types
 Parscore Form #F-14507-PAR-L (small one)
 ParScore Form #F-1712-ERI (large one)
Or
How to Grade Express Piece (large form)
 Write the score that the
student received in the far
right column of the SUBJ
SCORE box.
 Bubble in the score that the
student received for the
Express piece in the same
column.
5
How to Grade Express Piece (small form)
 Write the score that the
student received in the far
right column of the EXAM #
box.
 Bubble in the score that the
student received for the
Express piece in the same
column.
How to create a ParScore Key
 Bubble in the correct answers into the multiple choice questions
 Write and bubble in the maximum number of points student could receive on the
Express question in Express box
 Write Instructor’s Name, Course ID, Section #, “Pre-test” (or “Post-test”), and “KEY.”
Or
5
08/28/2015
George Washington
HIS 1013.002 Pre-test KEY
MWF 8-8:50
George Washington
HIS 1013.002 Pre-test KEY
08/28/2015
MWF 8-8:50
5
COLLECTING
ASSESSMENT DATA
BEST PRACTICES
TA/Grader Resources
Resources Available:
 Your faculty should be your first
resource for questions related
to the Q-course.



Blackboard Learn Gradebook permissions
Parscore
Rubrics/grading materials
 You and the faculty member can
contact the QLP Team (qlp@utsa.edu) for questions related to

QLCDS Data entry/submission
 For those using Blackboard Learn, there are helpful tutorials
available online for use
(https://learn.utsa.edu/resources_instructors.html)
TIPS FOR GRADING
WRITING
Any Questions?