Some Questions to Think About When Designing an Assessment

advertisement
Some Questions to Think About When Designing an Assessment
1. What is your question?
2. What type of outcome do you want to measure?
o Cognitive  Student can self-report knowledge (ok) or they can demonstrate it (better).
o Affective  Attitudes can be demonstrated, but often it is more practical to ask students
about their attitudes.
2. What type of data do you want to collect?
o Psychological  It is often easier to ask about someone’s personal traits than it is to
observe them.
o Behavioral  Student can self-report behavior (ok) or they can demonstrate it (better).
3. What is your time frame?
o Short-term: Allows for a variety of assessments during/immediately following programs.
o Long-term: Can be difficult to track students and retain their commitment.
4. What type of measure do you want/need? Direct is most desirable, but practically speaking a mix of
types is good.
o Direct measures require you to evaluate the products of students’ work.
o Indirect measures are based on students’ perceptions and/or often draw a connection
between some activity and a desired outcome.
o Norm-, criterion- or self-referenced
5. Additional considerations
o Are you assessing behaviors or attitudes that are sensitive, controversial, or personal? If so,
the anonymity/confidentiality of a survey can be a significant benefit. Beware of “socially
desirable” responses.
o What type of assessment is likely to be most effective with your target population?
o How many students are involved?
o What are your assessment skills and where can you find help? Talk to a friendly skeptic.
o What are your resources (human, financial, etc.)?
o What is your time frame for the assessment and producing results?
o What evidence, if any, do you have already? What will compliment it?
o What is convincing evidence from your audience’s perspective?
Assessment question:
Type of outcome:
Type of data:
Time frame:
Type of measure:
Additional considerations:
What type of evidence do you have already (if any?)
Who is the audience for your assessment?
Possible assessment tools:
Download