This work is licensed under the Creative Commons Attribution-NonCommercial 4.0 International License. To view a copy of this license, visit http://creativecommons.org/licenses/by-nc/4.0/. BACKWARD DESIGN AND ASSESSMENT Course Design Intensive ~ Dr. Catherine D. Rawn June 2014 Learning Objective By the end of this morning, you will be able to plan one forward-looking and one backward-looking assessment for your course that is integrated with a learning objective or course goal. What makes a learning assessment good (or bad)? Backwards Design Once you have identified the learning goals you hope to achieve, jump to how you want to measure them. What does successful student performance look like? Fink (2004) Components of Integrated Course Design Learning Goals Teaching and Learning Activities Feedback and Assessment Situational Factors (Context) Fink (2004) Assessments: Think Big! Forward-Looking Backward-Looking Assessment Assessment Life beyond your course Within boundary of your course Replicate future Did students understand relevant context material? Meaningful now Quantitative Research Methods Forward-Looking Assessment Backward-Looking Assessment In a group design a study, gather data, write report. (Term assignment) Find and read a journal article. Summarize the take-home message of the article, as if explaining to a friend. (Brief assignment) Find and read a journal article. Identify the independent and dependent variables, and how they were operationally defined. (Brief assignment) Imagine you want to measure anxiety List and define the general three in a study. Generate three different ways to operationally define a ways you could measure it. (Exam) dependent variable. (Exam) 80-90 2nd year Arts Psychology Majors Required for majors, Prerequisite for statistics For many, the only course on methods they get Applied Social Psychology Forward-Looking Assessment Backward-Looking Assessment Identify a learning challenge you face. Find and compare popular versus research-based advice for dealing with this challenge. (Part of term assignment) Imagine you have been selected to present to the incoming first year class about the role of beliefs in academic performance. What kind of belief do you recommend they develop? Why? (Exam) … In your answer, thoroughly explain to them the differences between entity and incremental theories of intelligence. (Exam) Drawing on your understanding of how memory works, explain why active learning is more effective than passive learning. (Exam) 100-180 students from all over campus (mostly Arts) Not a prerequisite for anything; has no prereqs Formally called “Special Topics” Teaching of Psychology Forward-Looking Assessment Backward-Looking Assessment Deliver two lessons to your peers Give and receive peer feedback Write a teaching statement Revise your teaching statement Develop a syllabus you could use Self-assessment: What have you learned? Self-assessment: What have you learned? 4-8 Graduate Students in Psychology Varied levels of classroom experience Fulfills no requirements Identify one of each Forward-Looking Assessment Backward-Looking Assessment How would you know if these are “good” assessments? Criteria to Consider Validity Accurate appraisal of learning, given learning goals? Reliability Measured consistently? Rubrics, clear criteria, standards Transparency Feedback Communicated to students? Formative and summative? Workload Reasonable, given role of this course, students’ load? Components of Integrated Course Design Learning Goals Teaching and Learning Activities Feedback and Assessment Situational Factors (Context) Fink (2004) Three Column Course Planning for Integrated Course Design Components of Integrated Course Design Learning Goals Teaching and Learning Activities Feedback and Assessment Situational Factors (Context) Fink (2004) Components of Integrated Course Design: 3 Column Version Goal Assessment Learning Activity By the end of this course, what should students be able to do? What does successful performance look like? How will you measure performance? What will you do to help the students learn so they can succeed? Dis-integration Example Memorize content. Think critically about content. Lecture Exam? Situational Factors (Context) Fink (2004) Dis-integration Example Memorize content. Think critically about content. Lecture Exam Memorize only Situational Factors (Context) Fink (2004) Dis-integration Example Memorize content. Think critically about content. Lecture X Exam Memorize & Think Critically Situational Factors (Context) Fink (2004) Components of Integrated Course Design Learning Goals Teaching and Learning Activities Feedback and Assessment Situational Factors (Context) Fink (2004) Apply your Knowledge of Integrated Course Design Task In pairs, generate 1 forward-looking and one backward-looking assessment idea to measure one of the learning objectives (your choice). Be as specific as you can. Both people need a copy. Ok to specify assumptions about the course, refine LO Learning Objective Explain four implications of cultural sensitivity in the business world. Develop your team leadership skills. Identify requirements of academic writing. Apply your Knowledge of Integrated Course Design Task Switch pairs, present your assessment ideas. Offer feedback Does each assessment align with LO? How could the LO or assessment altered to enhance integration? Learning Objective Explain four implications of cultural sensitivity in the business world. Develop your team leadership skills. Identify requirements of academic writing. Options for Working on Your Course Start the 3 column worksheet. Handout of examples Consider your existing course goals and generate potential forward-looking and backward-looking assessments for your course. Continue working on your DACUM (course goals, learning objectives) Integrated Course Design Build Strong Primary Components Assemble Components into Coherent Whole Finish Important Remaining Tasks Initial Design Phase Intermediate Design Phase Final Design Phase 6. Structure for course 7. Instructional strategy 8. Overall schema of learning activities 9. Grading system 10.Possible problems 11.Syllabus 12.Course and teaching evaluation plan 1. Situational factors 2. Learning goals 3. Feedback and assessment procedures 4. Teaching/learning activities 5. Ensure integration Fink (2004) Integrated Course Design: Monday Build Strong Primary Components Assemble Components into Coherent Whole Finish Important Remaining Tasks Initial Design Phase Intermediate Design Phase Final Design Phase 6. Structure for course 7. Instructional strategy 8. Overall schema of learning activities 9. Grading system 10.Possible problems 11.Syllabus 12.Course and teaching evaluation plan 1. Situational factors 2. Learning goals 3. Feedback and assessment procedures 4. Teaching/learning activities 5. Ensure integration Fink (2004) Integrated Course Design: Today Build Strong Primary Components Assemble Components into Coherent Whole Finish Important Remaining Tasks Initial Design Phase Intermediate Design Phase Final Design Phase 6. Structure for course 7. Instructional strategy 8. Overall schema of learning activities 9. Grading system 10.Possible problems 11.Syllabus 12.Course and teaching evaluation plan 1. Situational factors 2. Learning goals 3. Feedback and assessment procedures 4. Teaching/learning activities 5. Ensure integration Fink (2004) Integrated Course Design: Friday Build Strong Primary Components Assemble Components into Coherent Whole Finish Important Remaining Tasks Initial Design Phase Intermediate Design Phase Final Design Phase 1. Situational factors 2. Learning goals 3. Feedback and assessment procedures 4. Teaching/learning activities 5. Ensure integration 6. Structure for course 7. Instructional strategy 8. Overall schema of learning activities 9. Grading system 10.Possible problems 11.Syllabus 12.Course and teaching evaluation plan Fink (2004)