Central Washington University Assessment of Student Learning Outcome Report – EMS Paramedic Program Academic Year of Report: 2011-2012 College of Education and Professional Studies Department of Nutrition, Exercise, and Health Sciences EMS Paramedicine Program 1. What student learning outcomes were assessed this year and why? The EMS Paramedicine Program assessed the first Learning Outcome this year as it represents the most determinate measure of program success of all the other outcomes. That Student Learning Outcome is: “Students and Program graduates will demonstrate knowledge of programmatic and coursespecific goals, as well as professional benchmarks in preparatory, assessment, and medical therapeutics in prehospital paramedicine.” The motivation for this goal selection this year is based upon each of the following: 1. These goals were constructed from national standard curriculum guidelines as well as accreditation-specific program goals. Great emphasis is placed on these goals as they are critical in assessing Program effectiveness and will continue to be assessed each year to trend progress and success. Placing such emphasis on notably aggressive goals is essential to the continued programmatic distinction this EMS Paramedicine Program has as well as continued efforts toward national recognition. 2. It is important to note that these goals are also related to the Department/Program goals of “Students will demonstrate the knowledge, skills, and attitudes to be successful in their field as practitioners as well as leaders” and “The EMS Paramedic Program will continue to be recognized in the region for its outstanding program attainment and accomplished graduates, as well as for its comprehensive programmatic content and innovative educational methodologies.” 3. In addition, College Goals 1 and 5 are also related: “Provide for an outstanding academic and professional growth experience for students at all CWU location” and “Provide professional, high-quality, staffing, facilities, technologies, and appropriate resources to ensure the highest level of academic and professional development.” 1 Central Washington University Assessment of Student Learning Outcome Report – EMS Paramedic Program 4. And finally, University Goals I, IV, and V are also related: “Maintain and strengthen an outstanding academic and student life on the Ellensburg campus.” and “Build mutually beneficial partnerships with the public sector, industry, professional groups, institutions, and the communities surrounding our campuses.” and “Achieve regional and national prominence for the university.” 2. How were the student learning outcomes assessed, who were assessed, and when? This Student Learning Outcome was assessed through several traditional methods. The methods employed in the assessment of this Student Learning Outcome included: 1. The use of standard cognitive performance assessment. In all courses of the EMS Paramedicine Major, students were evaluated on their cognitive abilities through traditional psychometric testing practices. Periodic, mid-term, and end-of-course final exams were administered in a controlled manner. These exams varied in format (multiple choice, short answer, completion, and essay) to assess effectively the scope and breadth of knowledge within the paramedicine discipline. In addition, cognitive assessment was also conducted in student group performance, team dynamics (an integral component in paramedicine practice that is closely linked to psychomotor skill performance), and in formal student presentations. 2. The use of specialized and discipline-specific psychomotor skill assessment. The principal means by which psychomotor skill performance assessment is conducted is through a comparative analysis of student performance to established skill standards as determined by the National Standard EMS Curricula Guidelines, the National Registry Skill Performance Guidelines skill sheets, and Program-developed skill performance assessment instruments. In addition, students are evaluated on their field performances through clinical preceptor evaluation and established evaluative guidelines, as well as a qualitative assessment of knowledge in a problem-based learning environment. 3. What was learned? In measuring this Student Learning Outcome and comparing it to previous year’s performances, the following summary is revealed: 2 Central Washington University Assessment of Student Learning Outcome Report – EMS Paramedic Program Course EMS 335 EMS 335LAB EMS 336 EMS 336LAB EMS 337 EMS 337LAB EMS 440 EMS 441 EMS 443 EMS 444 EMS 451 EMS 459 EMS 493 Met standard 2010-2011 93.55% 100% 100% 100% 100% 100% 100% 100% 91.66% 100% 93.55% 100% 82.14% Met standard 2011-2012 95.65% 100% 90.91% 100% 100% 100% 82.14% 95.83% 93.75% 81.82% 95.46% 100% 88.24% Percent Change 2.25% 0% (9.09%) 0% 0% 0% (17.86%) (4.17%) 2.28% (18.18%) 2.04% 0% 7.42% From this data, it can be determined that programmatic and course goals are being met within a reasonable range of the benchmark. Given the academic rigor of the Program and the student performance during previous National Registry performance examinations, the data suggest that the Program continues to perform above the national standard. Even if the CWU EMS Paramedicine Program had academic goals identical to other national programs, the performances illustrated above still demonstrate achievement. Taking into consideration the lofty performance standards and academic rigor of the EMS Paramedicine Program at CWU, the results are even more promising. These results also draw the attention to the potential of the student candidates for each academic year cohort in the Program. In effect, the question becomes, “Do the student candidates for each academic year possess the potential to meet the academic rigor of the Program?” This question has been the investigational focus of the Program for the past few years given the fact that most candidates are recruited from the local region. To assure student successes in the future, IF the Program continues to expect the same academic rigor that currently exists, recruitment must occur nationwide. 3 Central Washington University Assessment of Student Learning Outcome Report – EMS Paramedic Program This information is useful to assess the adequacy in the level of cognitive content of the various courses and the difficulty of the academic challenge offered the students. It is also helpful in assessing pedagogic effectiveness. The Program will continue to monitor these parameters and strive to achieve higher performances among the Paramedic Program cohorts in the future. 4. What will the Program do as a result of that information? The information derived is informative and important. Several options exist for a continued course of action: 1. If the University leadership and the Program faculty continue to seek national program recognition in EMS and aspire for discipline excellence, then the academic rigor and performance standards that the Program currently espouses should be maintained. However, to achieve desirable academic performance and Student Learning Outcomes, the candidate selection of the prospective students must include a national source. Expansion of candidate sources to a national level is essential to future Program successes. To achieve this, a national marketing plan must be adopted and an application process conducive to out-of-state students is essential. 2. In addition, the Program will continue to promote success and endeavor to achieve improvements in student learning outcomes in this area. Specifically, the Program will seek additional means of information delivery, methods of instruction, and evaluative measures to assure maximal student comprehension and mastery of cognitive, psychomotor, and behavioral objectives. 3. New and innovative instructional methods have been, and will continue to be, employed in the classroom. This will continue to include, but not be limited to, focus group discussions, supplemental information via Blackboard platform, independent case investigation by students, problem-based learning curricula in select core development courses, multimedia platforms, and other sound pedagogical approaches. 4 Central Washington University Assessment of Student Learning Outcome Report – EMS Paramedic Program 4. Psychomotor skill development have been substantively enhanced with additional core and supplemental objectives (e.g., advanced physical examination procedures, ophthalmoscopy, otoscopy, 12-lead electrocardiography, etc.), as well as additional instructional resources to maintain intensity of instruction for these critical skills. Practical lab sessions are currently designed to allow compliance with national standard guidelines to assure adequate instructional guidance of students due to the complexity and criticality of these skills. This standard is critical to our profession and, in particular, to our educational practices. We will continue to regard this practice as unalterable within our Program for continued success. 5. Behavioral objective achievement has been effectively assessed and those successes assured with a newly implemented evaluative instrument adopted from the most recent national standard curricula guidelines. This assessment tool will continue to be applied periodically each quarter with summary results shared with the students throughout the academic year. This parameter of education (affective domain) will continue to be given equal relevance in student completion of Program goals and requirements. 6. Additionally, student field assessment and performance documentation will continue to receive 100% review by the Program’s faculty and staff, as means and facilities permit. Despite the arduous nature and the significant demand it places on our faculty, we will continue this practice as it results in programmatic standards that far exceed current accreditation and industry benchmarks as an element of student and program assessment. 5. What did the Program do in response to the feedback from last year’s assessment report? The feedback from last year’s assessment report has helped the EMS Paramedicine Program immeasurably in developing further the assessment of the Program’s learning goals. Input was invaluable and, coupled with the data collected, the Program is able to enhance assessment goals, practices, and improve outcomes universally. It is the Program’s plan to achieve near 100% accomplishment in goal-oriented outcomes in the years to come. 5 Central Washington University Assessment of Student Learning Outcome Report – EMS Paramedic Program 6. Questions or suggestions concerning the Assessment of Student Learning at Central Washington University: This year’s questions and suggestions remain the same as previous. 6