CATs - Youngstown State University

advertisement
Using Classroom Assessment
Techniques to Enhance Active
Learning
Marsha Huber, Ph.D., CPA
Youngstown State University
Brown Bag
Sept. 19, 2013
Who am I?
► Marsha
Huber
 Associate Professor of Accounting
 Teaching - 26 years
 Discovered CATs in 2006
How I got involved
►
Attended 2-day accreditation assessment seminar in 2005
►
An interterm campus seminar on “significant learning” with
Dee Fink in December, 2005
►
Center for Teaching and Learning sponsored a seminar at
Otterbein University on “CATs and student learning – is it
working?” in 2006.
►
Dissatisfied with what I was seeing
and experiencing as a professor in the
classroom.
The Journey
Take you on a journey that will help you use
CATs to improve student learning:
1)
2)
3)
4)
5)
Introduce you to Classroom Assessment Techniques (CATs)
Find out what you’ve been using
Help you design CATs to gain understanding of your students’
thinking and learning (or lack thereof).
Learn how to “close the loop” by providing timely feedback to
students.
Provide you with examples of practical CATs that can be used
to revise courses as well as creating a new CAT with a
feedback loop.
Angelo & Cross
What is a CAT?
Classroom Assessment Technique
What is a CAT?
Coined as CATs by Angelo & Cross in 1993
“An ongoing process aimed at
understanding and improving
student learning”
Classroom Assessment Techniques
(CATs)
CATs are “feedback devices,” instruments that
faculty can use to find out how much, how
well, and even how students are learning
what they are trying to teach.
(Angelo & Cross, p. 25)
How: Be SMART
Systematic –
ongoing throughout the term
Measureable –
Appropriate –
Relevant –
Timely –
assessing a learning goal
congruent to that learning goal
meaningful to the instructor and student
implemented at right times w/ feedback
Pointer #1: Shift in Emphasis
► The
shift in education is from a “teaching”
paradigm to a “learning” paradigm.
► We
are to assess student learning –
document it, explain problems, and improve
performance.
Pointer #2: Shift in Responsibility
► Active
learning – responsibility for learning
is shifted to the learners.
► Learners
need to be engaged in their
learning which involves motivation and
attitudes.
Pointer #3: Shift in Activities
► Students
- from observing and listening to
doing and saying.
► Faculty
► Means
- requires planning & involvement.
students receive complete, timely,
and appropriate feedback.
What are some CATS you have
used?
Types of CATs
► Tell
me about me
► Tell me about you
Teachercentered
Studentcentered
Relational CATs
► Open
► Help
► Help
doors of communication
me become a better teacher
students become the authors of their
learning
The CAT Feedback Loop
Faculty Responsibility:
Improving Teaching
Student Responsibility:
Improving Learning
Shared Responsibility
The CAT Feedback Loop
When?
SMART
► Systematic – throughout the term
 Beginning
 During
 At the End
First Day of Class - CAT #1
► Assessing
Prior Knowledge CAT #1 – helps you
understand your student population
► What
► Who
year are they?
are their majors?
► What
prior classes did they have?
► What
do they know about accounting so far?
► How
are they feeling about the class?
CAT #1: Assessing Student Prior Knowledge
1. Have you had accounting in high school?
Yes
No
2. Have you had a college accounting level
course? (Dropped it or are retaking it)
3. Have you (or do you) work in an
accounting-related field? If yes, please
describe:
4. Have you ever heard of financial
statements before this first class?
Yes
No
Yes
No
Never heard of this Have heard of it, Have some idea of Have a clear idea
but do not know what it means, but of what this
what it means
am no too clear means and can
explain it
5. Have you ever heard of the Sarbanes
Oxley Act?
6. Have you ever heard of debits and credits?
7. Have you ever heard of financial ratios?
8. Have you ever heard of journal entries?
9. Have you ever heard of internal controls?
10. Have you ever heard of the auditors
report?
11. What is your motivation level to take
I am not motivated I have minimal
this class at this time?
at all and wish it
interest in this
was not a
class
requirement
Write your feelings about taking this class this term:
What are your feelings now after the first day of class:
I am moderately
interested
I am very
motivated and
can’t wait to get
started
Results for CAT #1
For an introductory accounting class:
►
Accounting in high school – few had it in high (change from classes 10
►
Prior college class – 10% are retaking it
►
Work in an accounting-related field – a few
►
Prior knowledge of certain accounting topics – most have very little, but
►
Motivation level – moderate to high
►
Feelings that first day – anxiety, fear, want to get a good grade, excited
►
Used later as a pre-test, post-test
years ago)
there are always a few that have a pretty good knowledge
Your first CAT
Group Activity 1: develop a new “prior
knowledge” CAT for the first day of class
Key:
 Must be easy and fast
 Set the tone
 Fast feedback
Ideas for CATS
from YSU Group
What are you career
goals?
Where do you
see yourself in
5 years?
Bloom evaluation
from beginning
and end
What is going to put
a smile on your face
besides earning a
good grade or the
class being over?
Pre-tests for
assessment
purposes
Rate your interest
in the various
concepts in the
class
What would you
change about the
syllabus? “+ and –”
What is your
learning style
preferences?
Delivery?
Presentation?
Write definitions
and roles of the
discipline (pre
and post)
CAT
► Timekeeper
(beginning of term)
(#2)
 Setting expectations
 Communicating correlations
CAT #2: Timekeeper
Week 1
Sun
Total
Mon
Tues
Wed
Thurs
Fri
Sat
Studying/Reading
Homework
Studying for Tests
Midterm thoughts: How well do you think you used your time during the
first half of the term? What things will you change for the second half of
the term?
Final thoughts: Were you able to make the changes you wanted to
during the term? How might you improve your time management for
future accounting classes? What suggestions would you make to future
students about time management in future terms?
CAT
► Daily/Weekly
(During the term)
CAT
 Muddiest/clearest point paper
 Clickers – immediate feedback
 Walking around the classroom
► Friend
CAT (#3)
 Write evaluation of student explanation of
financial statements
CAT
► Team
(During the term)
CAT (#4)
►Formative
review of preparation, problems, and
participation
► Student
►Let
Assessment of “best models”
them assess themselves
Midterm and End of Term
► Mid-term
Intervention
 The Director of our Center for Teaching and
Learning holds a focus group discussion with
my students
► Reflection
Paper at midterm and end
 Reflection Papers (#5)
►Ranking
learning experiences
►Are they getting it?
►Are they making the connections?
CAT
(At the end)
Day Traditional Class
Consensus Exercises (first day of class)
Interview with business person and in-class model development
Clicker use
Working in groups
Reading the text
Doing Homework problems in the book
Lectures
Friend questionnaire exercise
Practice exam
Midterm examination
3.58
3.50
4.42
4.38
3.54
4.71
3.79
3.29
4.63
4.33
Evening Non-Traditional Class
Consensus Exercises (first day of class)
Interview with business person and in-class model development
Clicker use
Working in groups
Reading the text
Doing Homework problems in the book
Lectures
Friend questionnaire exercise
Practice exam
Midterm examination
3.11
3.33
3.11
3.67
4.00
4.67
4.56
3.33
4.72
4.67
Which learning experience helped you IMPROVE the following
personal competencies the most?
Doing
Homework
Ethical behavior
Effective problemsolving
Decision-making
skills
To effectively lead
To work
productively with
others
Project
management
Written
communication
skills
Interview
Project
x
Solving Case
Studies
Developing
Pamphlets
Studying
for Tests
Setting up
Panels
Reflection
Papers
Value Added CAT
(#6)
Value Added CAT
Group Activity #2
What CAT can you add to your classes?
Don’t be a Scaredy CAT
Asking what you always wanted to
know, but were afraid to hear!
The “Ask” CAT
The “Ask CAT”
► Why
did you fail the exam?
► Responses:
The “Ask” CAT
► What
surprised you about the on-line
quizzes?
► Responses:
The “Ask” CAT
► Did
you feel your grade reflected your
work?
► Responses:
Group Activity #3
► Create
a new “Ask” CAT – discuss what
questions you would like answers for:
Reflection
► What
concepts or ideas will you remember
the most after you leave this session?
► Reflect
upon the most interesting thing you
learned today.
► What
will you be changing as a result of this
workshop?
Concluding Remarks
► For
best results, assessment is an integral
part of learning.
► The
purpose is to minimize disconnects
and frustration as we improve student
learning.
► My
experience is that it works!
Assessment brings new life to each class.
Download