Central Washington University
Assessment of Student Learning Report – EMS Paramedic Program
Academic Year of Report: 2008-2009
College of Education and Professional Studies
Department of Nutrition, Exercise, and Health Sciences - EMS Paramedic Program
1. What student learning outcomes were assessed this year and why?
The EMS Paramedic Program assessed five programmatic outcomes this year:
1. Students will demonstrate knowledge of programmatic and course-specific goals, as
well as professional benchmarks in preparatory, assessment, and medical therapeutics
in prehospital paramedicine. This goal is critical in assessing Program effectiveness
and will be assessed each year to trend progress and success. This goal was related to
the Department/Program goals of “Students will demonstrate the knowledge, skills,
and attitudes to be successful in their field as practitioners as well as leaders” and “The
EMS Paramedic Program will continue to be recognized in the region for its
outstanding program attainment and accomplished graduates, as well as for its
comprehensive programmatic content and innovative educational methodologies.”
Additionally, College Goals 1 and 5 are related: “Provide for an outstanding academic
and professional growth experience for students at all CWU location” and “Provide
professional, high-quality, staffing, facilities, technologies, and appropriate resources
to ensure the highest level of academic and professional development.” and University
Goals I, IV, and V are also related: “Maintain and strengthen an outstanding academic
and student life on the Ellensburg campus.” and “Build mutually beneficial
partnerships with the public sector, industry, professional groups, institutions, and the
communities surrounding our campuses.” and “Achieve regional and national
prominence for the university.”
2. Students will demonstrate the ability to use critical and creative thinking to
interpret and solve problems, as well as integrate information and prioritize
interventions. As a measure of disciplinary excellence, this goal is critical in setting the
CWU EMS Paramedic Program apart from other similar programs nationwide. As such,
this goal should be regularly assessed. This goal was related to the Department/
Program goals of “Students will demonstrate the knowledge, skills, and attitudes to be
successful in their field as practitioners as well as leaders” and “The EMS Paramedic
Program will continue to be recognized in the region for its outstanding program
attainment and accomplished graduates, as well as for its comprehensive
programmatic content and innovative educational methodologies.” Additionally,
College Goals 1 and 5 are related: “Provide for an outstanding academic and
1
Central Washington University
Assessment of Student Learning Report – EMS Paramedic Program
professional growth experience for students at all CWU location” and “Provide
professional, high-quality, staffing, facilities, technologies, and appropriate resources
to ensure the highest level of academic and professional development.” and University
Goals I and IV are also related: “Maintain and strengthen an outstanding academic and
student life on the Ellensburg campus.” and “Build mutually beneficial partnerships
with the public sector, industry, professional groups, institutions, and the communities
surrounding our campuses.”
3. Program graduates will have knowledge of research methodologies and principles
in EMS research. One areas of weakness within the Program is contribution toward
research within its discipline. To gauge progress in this area, this goal should be
periodically assessed. This goal was related to the Department/Program goals of
“Students will demonstrate the knowledge, skills, and attitudes to be successful in
their field as practitioners as well as leaders” and “The EMS Paramedic Program will
continue to be recognized in the region for its outstanding program attainment and
accomplished graduates, as well as for its comprehensive programmatic content and
innovative educational methodologies.” Additionally, College Goals 1 and 5 are
related: “Provide for an outstanding academic and professional growth experience for
students at all CWU location” and “Provide professional, high-quality, staffing,
facilities, technologies, and appropriate resources to ensure the highest level of
academic and professional development.” and University Goals I and IV are also
related: “Maintain and strengthen an outstanding academic and student life on the
Ellensburg campus.” and “Build mutually beneficial partnerships with the public sector,
industry, professional groups, institutions, and the communities surrounding our
campuses.”
4. Program graduates can effectively demonstrate cognitive and skill competency on
the use of contemporary diagnostic and therapeutic EMS-related equipment,
computers, and other technology for EMS purposes. Another measure of disciplinary
excellence, this goal should be measured frequently to determine compliance and to
set the CWU Program apart from the others. This goal was related to the
Department/Program goals of “Students will demonstrate the knowledge, skills, and
attitudes to be successful in their field as practitioners as well as leaders” and “The
EMS Paramedic Program will continue to be recognized in the region for its
outstanding program attainment and accomplished graduates, as well as for its
comprehensive programmatic content and innovative educational methodologies.”
Additionally, College Goals 1 and 5 are related: “Provide for an outstanding academic
and professional growth experience for students at all CWU location” and “Provide
professional, high-quality, staffing, facilities, technologies, and appropriate resources
2
Central Washington University
Assessment of Student Learning Report – EMS Paramedic Program
to ensure the highest level of academic and professional development.” and University
Goals I and V are also related: “Maintain and strengthen an outstanding academic and
student life on the Ellensburg campus.” and “Achieve regional and national
prominence for the university.”
5. Program graduates will communicate effectively in a variety of formats. This goal
was chosen to assess the effectiveness of the newly introduced educational methods
that emphasize student communication. This goal was related to the
Department/Program goals of “Students will demonstrate the knowledge, skills, and
attitudes to be successful in their field as practitioners as well as leaders” and “The
EMS Paramedic Program will continue to be recognized in the region for its
outstanding program attainment and accomplished graduates, as well as for its
comprehensive programmatic content and innovative educational methodologies.”
Additionally, College Goals 1 and 5 are related: “Provide for an outstanding academic
and professional growth experience for students at all CWU location” and “Provide
professional, high-quality, staffing, facilities, technologies, and appropriate resources
to ensure the highest level of academic and professional development.” and University
Goals I and V are also related: “Maintain and strengthen an outstanding academic and
student life on the Ellensburg campus.” and “Achieve regional and national
prominence for the university.”
2. How were the student learning outcomes assessed, who were assessed, and when?
1. The Program Goal, “Students will demonstrate knowledge of programmatic and
course-specific goals, as well as professional benchmarks in preparatory, assessment,
and medical therapeutics in prehospital paramedicine.” was assessed through several
traditional methods. In all courses of the Major, students were evaluated on their
cognitive abilities through traditional psychometric testing approaches. Periodic, midterm, and end-of-course final exams were administered. These exams varied in format
(multiple choice, short answer, completion, and essay) to assess effectively, scope and
breadth of knowledge. Additional assessments were conducted in group discussions,
presentation evaluations using an established rubric, skill performances in practica
using the National Standard Curricula Guidelines and National Registry Skill
Performance Guidelines skill sheets, field performances through clinical preceptor
evaluation and established evaluative guidelines, and qualitative assessment of
knowledge in a problem-based learning environment.
3
Central Washington University
Assessment of Student Learning Report – EMS Paramedic Program
All students in the courses are assessed in the same manner, simultaneously, with
identical outcome measures.
2. The Program Goal, “Students will demonstrate the ability to use critical and creative
thinking to interpret and solve problems, as well as integrate information and prioritize
interventions” was assessed in the lab sessions of EMS 335LAB, EMS 336LAB, and EMS
337LAB. During these lab sessions, students are expected to perform specific skills and
to integrate cognitive knowledge into the diagnostic assessment and management of
simulated patient cases and scenarios. These instances demand considerable
correlation of information, effective problem-solving skills, decisive decision-making,
and substantial leadership abilities. To establish this standard, students undergo
continual remediation throughout their educational development in the EMS
Paramedicine Major. Compliance to the Goal and successful achievement is measured
by correlation to established disciplinary standards and benchmarks, as well as
universally recognized algorithmic-directed performances. The instructors assess
student compliance and achieve to these standards continuously, providing feedback
and instructional advisements throughout. These assessments occur in all lab sessions
of the designated courses.
All students in the courses are assessed in the same manner, simultaneously, with
identical outcome measures.
3. The Program Goal, “Program graduates will have knowledge of research
methodologies and principles in EMS research” is simply assessed by the students’
recapitulation of research principles in traditional cognitive evaluations,
demonstration of research knowledge through journal club article assessment
presentations, and through group discussions on relevant published research.
Students are encouraged to participate in research as principal investigators as well as
co-investigators. These assessments are largely conducted periodically in courses EMS
336 and EMS 337, particularly at Quarter’s end.
All students in the courses are assessed in the same manner, simultaneously, with
identical outcome measures.
4. The Program Goal, “Program graduates can effectively demonstrate cognitive and
skill competency on the use of contemporary diagnostic and therapeutic EMS-related
equipment, computers, and other technology for EMS purposes” is assessed by
instructor-observation of students applying the devices and principles during lab
practica. In all lab sessions associated with courses in the Major, students are
expected to master operational skills of all EMS-related equipment. This process is
4
Central Washington University
Assessment of Student Learning Report – EMS Paramedic Program
facilitated by instructor demonstration, followed by student application, and repeated
rehearsals throughout the academic year. As the lab sessions progress throughout the
academic year, the skills acquired in previous lab sessions are compounded by new
skills and the earlier skills are, thus, reinforced repeatedly. These assessments occur
throughout all lab sessions in all practical courses.
All students in the courses are assessed in the same manner, simultaneously, with
identical outcome measures.
5. The Program Goal, “Program graduates will communicate effectively in a variety of
formats” is assessed through verbal expression, written expression, and integrated
communication methods. All students in the Major must attain competency in
communicating EMS-related diagnostic and therapeutic information via the written
format on all simulated patient cases, as well as a standardized verbal format through
radio reporting and person-to-person patient reporting. These skills are progressively
developed throughout the academic year, culminating in the students’ mastery of
effective communication as judged by the instructor, based upon established
benchmarks and guidelines of the National Standard Curricula Guidelines and National
Registry of EMTs Guidelines. These assessments are conducted throughout the
academic year in all lab sessions in a progressively comprehensive manner.
All students in the courses are assessed in the same manner, simultaneously, with
identical outcome measures.
3. What was learned?
1. For the Goal, ““Students will demonstrate knowledge of programmatic and coursespecific goals, as well as professional benchmarks in preparatory, assessment, and
medical therapeutics in prehospital paramedicine,” the following performance
outcomes were recorded for 2008-2009 academic year by course (cut score of 75%):
Course
EMS 335
EMS 335LAB
EMS 336
EMS 336LAB
EMS 337
EMS 337LAB
5
Percent failing to
meet standard
0%
0%
0%
0%
0%
0%
Percent met
standard
100%
100%
100%
100%
100%
100%
Student Performance
Average
86.3%
Successful1
79.3%
Successful1
Unknown2
Unknown2
Central Washington University
Assessment of Student Learning Report – EMS Paramedic Program
EMS 440
0%
100%
EMS 441
0%
100%
EMS 443
6.9%
94.1%
EMS 444
0%
100%
EMS 451
0%
100%
EMS 459
0%
100%
EMS 493
13.3%
86.7%
1 Course outcomes are graded as successful/unsuccessful
2 Courses are not yet completed and outcomes are undetermined
86.9%
91.6%
86.1%
87.7%
78.7%
Unknown2
Successful1
2. For the Goal, “Students will demonstrate the ability to use critical and creative
thinking to interpret and solve problems, as well as integrate information and prioritize
interventions,” the following performance outcomes were recorded for academic year
2008-2009 by course (successful/unsuccessful criteria):
Course
Percent failing to
Percent met
Student Performance
meet standard
standard
Average
EMS 335LAB
0%
100%
Successful1
EMS 336LAB
0%
100%
Successful1
EMS 337LAB
0%
100%
Unknown2
1 Course outcomes are graded as successful/unsuccessful
2 Courses are not yet completed and outcomes are undetermined
3. For the Goal, “Program graduates will have knowledge of research methodologies
and principles in EMS research,” the students’ performance in this outcome for
academic year 2008-2009 are embedded in the cognitive outcomes of the courses in
the Major (EMS 335, EMS 336, and EMS 337), as well as in the critical assessment of
student’s research analysis presentation. The results from the research analysis
presentation are provided below as a proxy for this outcome:
Parameter
Percent failing to
meet standard
0%
Percent met
standard
100%
Student Performance
Average
83.2%1
Research
Analysis
Presentation
1 Outcome measure is incomplete as data from EMS 337 have not yet been collected.
4. For the Goal, “Program graduates can effectively demonstrate cognitive and skill
competency on the use of contemporary diagnostic and therapeutic EMS-related
equipment, computers, and other technology for EMS purposes,” the students are
6
Central Washington University
Assessment of Student Learning Report – EMS Paramedic Program
assured skill competency through instructional methods in the practical lab sessions;
thereby, reflecting achievement through course completion success. The practical
courses relevant to this Goal are EMS 335Lab, EMS 336Lab, and EMS 337Lab. The
results are as follows:
Course
Percent failing to
Percent met
Student Performance
meet standard
standard
Average
EMS 335LAB
0%
100%
Successful1
EMS 336LAB
0%
100%
Successful1
EMS 337LAB
0%
100%
Unknown2
1 Course outcomes are graded as successful/unsuccessful
2 Courses are not yet completed and outcomes are undetermined
5. For the Goal, “Program graduates will communicate effectively in a variety of
formats,” the students are assured communication skill competency through patient
reporting in the practical lab sessions; thereby, reflecting achievement through course
completion success. The practical courses relevant to this Goal are EMS 335Lab, EMS
336Lab, and EMS 337Lab. The results are as follows:
Course
Percent failing to
Percent met
Student Performance
meet standard
standard
Average
EMS 335LAB
0%
100%
Successful1
EMS 336LAB
0%
100%
Successful1
EMS 337LAB
0%
100%
Unknown2
1 Course outcomes are graded as successful/unsuccessful
2 Courses are not yet completed and outcomes are undetermined
4. What will the Program do as a result of that information?
1. For the Goal, ““Students will demonstrate knowledge of programmatic and coursespecific goals, as well as professional benchmarks in preparatory, assessment, and
medical therapeutics in prehospital paramedicine,” the Program will continue to
promote success and endeavor to achieve improvements in student learning outcomes
in this area. Specifically, the Program will seek additional means of information
delivery, methods of instruction, and evaluative measures to assure maximal student
comprehension and mastery of cognitive, psychomotor, and behavioral objectives.
New and innovative instructional methods will be employed in the classroom. This will
include, but not be limited to, focus group discussions, supplemental information via
7
Central Washington University
Assessment of Student Learning Report – EMS Paramedic Program
Blackboard platform, independent case investigation by students, problem-based
learning curricula in select core development courses, implementation of studentresponse systems integrated into the lecture presentations (PowerPoint), and other
sound pedagogical approaches.
Psychomotor skill development will be enhanced with additional core and
supplemental objectives (e.g., advanced physical examination procedures,
ophthalmoscopy, otoscopy, portable sonography, etc.), as well as additional
instructional resources to maintain intensity of instruction for these critical skills.
Practical lab sessions are currently designed to allow compliance with national
standard guidelines to assure adequate instructional guidance of students due to the
complexity and criticality of these skills.
Behavioral objective achievement will be more effectively assessed and successes
assured with a newly implemented evaluative instrument adopted from the most
recent national standard curricula guidelines. This assessment tool will be applied
periodically each quarter with summary results shared with the students throughout
the academic year. This parameter of education (affective domain) will be given
substantive (in fact, equal) relevance in student completion of Program goals and
requirements.
Additionally, student field assessment and performance documentation will continue
to receive 100% review by the Program’s faculty and staff, as means and facilities
permit. This Programmatic standard exceeds current accreditation and industry
benchmarks as an element of student and program assessment.
2. For the Goal, “Students will demonstrate the ability to use critical and creative
thinking to interpret and solve problems, as well as integrate information and prioritize
interventions,” the Program has achieved remarkable success in this aspect of
paramedical education. It may very well be the single-most attribute of our graduates
that set them apart from graduates of other programs and that motivates so many
regional employers to seek-out our graduates for employment. The intent is to
maintain our successes with this standard and to seek new and innovative means of
developing our successes and promote even greater achievements in critical thinking,
problem-solving, and integrated delivery of care.
4. For the Goal, “Program graduates can effectively demonstrate cognitive and skill
competency on the use of contemporary diagnostic and therapeutic EMS-related
8
Central Washington University
Assessment of Student Learning Report – EMS Paramedic Program
equipment, computers, and other technology for EMS purposes,” the Program has also
received considerable recognition and accolades from providers, employers and
clinical preceptors from the region on behalf of our students’ knowledge and
performances. The students’ familiarity with a diverse and complex array of medical
diagnostic and therapeutic equipment, coupled with their advanced comprehension of
discipline concepts, has established the growing recognition of our Program. We will
endeavor to maintain that level of recognition and seek new ways to promote
development in this area.
5. For the Goal, “Program graduates will communicate effectively in a variety of
formats,” the Program has again realized substantive successes. Program students
have been able to consistently demonstrate competency in this area to clinical
preceptors and potential employers during their field internships. This positive
association has been bolstered by our graduates’ performances early in their career
with local EMS agencies. A common aspect of deficiency in most graduates from other
EMS education programs, competency in communicative scenarios for the
transference of patient information, has been stellar in our Program graduates.
5. What did the Program do in response to the feedback from last year’s assessment report?
The EMS Paramedic Program did not have any previous yearly program assessment
reports to guide this year’s development and goal establishment. The only source of
information was the five-year assessment which was consistent with this year’s
findings and conclusions. Next year, the Program will have more meaningful data to
correlate with our successes and to assess trends and design future programmatic
improvements.
6. Questions or suggestions concerning the Assessment of Student Learning at Central
Washington University:
The EMS Paramedic Program has only a few questions/suggestions related to the
assessment of student learning process at CWU:
 As we progress through this process and become more familiar with our
outcomes and more informed of our weaknesses, it would be beneficial if we
could abbreviate the process of reporting our outcomes. That is not to say we
should abbreviate or minimize our efforts, but rather to condense the
reporting process.
 It would be interesting (not to mention beneficial) if we could correlate
standardized outcomes across the programs at CWU. Much like we compare
9
Central Washington University
Assessment of Student Learning Report – EMS Paramedic Program

10
Faculty FTE to Student FTE ratios, we could measure and compare student
learning outcomes with other programs to judge our standing university-wide.
These outcomes would need to be adjusted to measure a similar metric
throughout.
By the same token, any creative or unique assessment tools, educational
standards, learning goals, or interventions employed or considered by other
programs would benefit all if they were shared within the university
community. For example, I would be very interested to learn what other
programs utilize the student response systems or provide instruction using the
problem-based learning model.