Majmaah University College of Engineering Electrical Engineering Department KPIs: Definition and Real Examples Dr. Abdel-Rahman Al-Qawasmi Majmaah, 6\4\2015 Learning Outcomes Learning Outcomes Analysis of Assessment results Analysis of Assessment results results of analysis Results of analysis: Learning outcomes: • Learning Outcomes (Los) describe what learners are supposed to know, understand, or are able to do at the end of the Program or course. What to Learn? Learner acheivements Learning Outcome Focus on Performance Why we need LOs? • To inform students of what is expected from them . • To guide the teacher in his approach on the delivery of content and assessment that focuses on what the student will be able to do as a result of the learning. • To fulfill the requirements of one or more Program outcomes. What is KPI? • A Key Performance Indicator (KPI) is a measurable value that demonstrates how effectively an instructor achieves learning Outcomes. The program evaluator uses KPIs to evaluate their success in reaching Goals and Objectives. Learning Outcome Teaching Strategy Assessment Planning for Improvement Rubrics KPI What is KPI? • To analyze the assessment of students achievement for LO, we use a KPI, a rubric or exam scores to measure and assess student’s performance. KEY: Performance: Indicator: Rubrics: • "Rubrics" are a way of explicitly stating the expectations for student performance. They may lead to a grade or be part of the grading process but they are more specific, detailed, and disaggregated than a grade. Types of Rubrics Holistic: Raters make judgments by forming an overall impression of a performance Analytic : scales tend to focus on important dimensions of student performance related to performance criteria. Why we need to use a Rubric? • To have specific, detailed, and disaggregated than a grade. • Rubrics provide the characteristics for each level of performance on which student performance should be judged • The rubric provides those who have been assessed with clear information about how well they performed and a clear indication of what they need to accomplish in the future to better their performance. LO KPIs Rubrics Demonstrates solutions implementing simple applications of one formula or equation with close analogies to class/lecture problems Demonstrates solution with integration of diverse concepts or derivation of useful relationships involving ideas covered in course concepts; however, no alternative solutions are generated Solutions creativity alternatives Demonstrates creative synthesis of solution and creates new alternatives by combining knowledge and information Does not see the connection between theory and practical problem solving Practical concepts problem solving using theoretical Connects theoretical concepts to practical problem-solving when prompted Can relate theoretical concepts to practical problem solving Is unable to predict or defend problem outcomes Predict and defend problem outcomes Occasionally predicts and defends problem outcomes Can predict and defend problem outcomes Uses no resources to solve problems The uses of appropriate resources needed to solve (b3) problems An ability to identify, formulate, and solve The integration of new information with previous engineering knowledge problems. Uses limited resources to solve problems Uses appropriate resources to locate information needed to solve problems Has no concept of how previous knowledge and new information relate Must be assisted in integrating previous knowledge and new information Takes new information and effectively integrates it with previous knowledge Does not realize when major components of the problem are missing The understanding of how various pieces of the Is missing some of the pieces of the whole problem problem relate to each other and the whole Demonstrates understanding of how various pieces of the problem relate to each other and the whole Strategies for solving problems Has no coherent strategies for problem solving Has some strategies for problem-solving, but does not apply them consistently Formulates strategies for solving problems The answer is incorrect and not checked for its reasonableness Correction of the answer Solutions: Other Ways The answer is nearly correct, but properly labeled (within reasonable and logical range of the correct answer-it's in the "ballpark") The answer is correct and properly labeled No attempt at checking the obviously incorrect solution--no commentary The solution is correct, but not checked in other ways The solution is correct and checked in other ways when it can be; the interpretation is appropriate and makes sense