2005-2006
Phillips Community College of the University of Arkansas
For
EMT Certificate of Proficiency
Curriculum
Assessment of Student Learning
PROGRAM EVALUATION PLAN
Operational Definitions:

Program design is the prescribed course of study.

College Core Competency: Technology Utilization includes, but is not limited to, the following core components on the EMT-Basic Written Exam: Airway and Breathing, Trauma, OB/Peds, Cardiology,
Medical, EMS Operations
Expected Levels of Achievement:
1. The total number of required program credit hours will not exceed 10.
2. The ratio of credit hours to clock hours in the theory component of EMT 1010 will be 1:1.
3. The ratio of credit hours to clock hours in the clinical component of EMT 1010 will be 1:3.
4. The class will achieve an average score at or above the 70th percentile on the “Airway and Breathing” component of the EMT-Basic written exam.
5. The class will achieve an average score at or above the 70th percentile on the “Trauma” component of the EMT-Basic written exam.
6. The class will achieve an average score at or above the 70th percentile on the “OB/Peds” component of the EMT-Basic written exam.
7. The class will achieve an average score at or above the 70th percentile on the “Cardiology” component of the EMT-Basic written exam.
8. The class will achieve an average score at or above the 70th percentile on the “Medical” component of the EMT-Basic written exam.
9. The class will achieve an average score at or above the 70th percentile on the “EMS Operations” component of the EMT-Basic written exam.
PROCESS
Component
Program
Design
Where
Documentation
Is Found
Course Catalog
Prospective EMT
Student
Brochure
IMPLEMENTATION
Person/
Committee
Responsible
Time/
Frequency of
Assessment
Assessment Method
DAH
Every 3 years
or with change
Next Review:
January 2006
Review Total Program
Credit Hours and credit
to clock hour ratios for
theory and clinical.
Report of Data Collection & Analysis
Actual Level of Achievement
January 2006
Total number of required program credit
hours is 10.
Actions
For Program Development, Maintenance, or Revision
Level of achievement met.
PCCUA Website:
Allied
Health/EMT
Credit to
Clock Hour
Ratio
Level of achievement met.
Theory
124 hrs./15 weeks= 8 hrs and 15 minutes
(1:1 ratio) Award 8 credits for lecture.
Clinical
80 hrs./3 (3:1 ratio)=26.7
26.7/15 weeks+1.8 or 2 credits
Total credits for theory and clinical=10
1
Level of achievement met.
College Core
Competency:
Technology
Utilization
Airway and
Breathing
Trauma
OB/Peds
Cardiology
At the
beginning of
each semester
At the
beginning of
each semester
At the
beginning of
each semester
At the
beginning of
each semester
Analysis of scores on
the “Airway and
Breathing” component
of the EMT-Basic
written exam.
Analysis of scores on
the “Trauma”
component of the
EMT-Basic written
exam.
Analysis of scores on
the “OB/Peds”
component of the
EMT-Basic written
exam.
Analysis of scores on
the “Cardiology”
component of the
EMT-Basic written
exam.
September 2005
The class achieved an average percentile
score of 71 on the “Airway and Breathing”
component of the EMT-Basic written exam.
January 2006
The class achieved an average percentile
score of 69 on the “Airway and Breathing”
component of the EMT-Basic written exam.
September 2005
The class achieved an average percentile
score of 71 on the “Trauma” component of
the EMT-Basic written exam.
January 2006
The class achieved an average percentile
score of 76 on the “Trauma” component of
the EMT-Basic written exam.
September 2005
The class achieved an average percentile
score of 61 on the “OB/Peds” component of
the EMT-Basic written exam.
January 2006
The class achieved an average percentile
score of 81 on the “OB/Peds” component of
the EMT-Basic written exam.
September 2005
The class achieved an average percentile
score of 62 on the “Cardiology” component
of the EMT-Basic written exam.
January 2006
The class achieved an average percentile
score of 78 on the “Cardiology” component
of the EMT-Basic written exam.
2
Level of achievement met.
Level of achievement not met.
Program Maintenance SP 2006
Emphasize this content more in theory and clinical settings.
Level of achievement met.
Level of achievement met.
Program Maintenance SP 2006
Emphasize this content more in theory and clinical settings.
Level of achievement not met.
Program Maintenance F 2005
Text change has been made. Emphasize this content more
in theory and clinical settings.
Level of achievement met.
Level of achievement not met.
Program Maintenance F 2005
Text change has been made. Emphasize this content more
in theory and clinical settings.
Level of achievement met.
Medical
EMS
Operations
At the
beginning of
each semester
At the
beginning of
each semester
September
Analysis of scores on
the “Medical”
component of the
EMT-Basic written
exam.
Analysis of scores on
the “EMS Operation”
component of the
EMT-Basic written
exam.
September 2005
The class achieved an average percentile
score of 65 on the “Medical”
component of the EMT-Basic written exam.
Level of achievement not met.
Program Maintenance F 2005
Text change has been made. Emphasize this content more
in theory and clinical settings.
January 2006
The class achieved an average percentile
score of 69 on the “Medical”
component of the EMT-Basic written exam.
Level of achievement not met.
Program Maintenance SP 2006
Emphasize this content more in theory and clinical settings.
September 2005
The class achieved an average percentile
score of 74 on the “EMS Operations”
component of the EMT-Basic written exam.
Level of achievement met.
January 2006
The class achieved an average percentile
score of 75 on the “EMS Operations”
component of the EMT-Basic written exam.
3
Level of achievement met.
2005-2006
Phillips Community College of the University of Arkansas
Systematic Plan for Evaluation
Program Effectiveness
PROGRAM EVALUATION PLAN
Operational Definitions:

Graduation Rates – The percentage of newly admitted students enrolled in EMT 1010 on the 11th day headcount will complete the course.

Performance on National Registry – The percentage of graduates passing the National Registry on the first write.

Rates of Employment – The percentage of graduates seeking employment who attain employment in a position requiring EMT preparation.

Graduate Satisfaction – The degree to which graduates profess overall satisfaction with the EMT course in preparation for practice.

Employer Satisfaction – The degree to which employers of PCCUA EMT graduates profess overall satisfaction with graduates’ preparation for EMT practice.
Expected Levels of Achievement:
1. Graduation Rates – Forty percent (40%) of newly admitted students enrolled in EMT 1010 on the 11th day headcount will successfully complete the course.
2. Rates of Employment - Ninety percent (90%) of graduates seeking employment will be employed in a position that requires EMT preparation within 3 months of graduation.
3. Performance on National Registry - Eighty-five percent (85%) of graduates will pass the National Registry on the first write.
4. Graduate Satisfaction - Eighty-five percent (85%) of graduates returning the Graduate Survey within 3 months of completing the course will express overall satisfaction with preparation provided by
the program.
5. Employer Satisfaction with Graduates - Eighty-five percent (85%) of employers returning the employer survey within 3 months of graduation will report overall satisfaction with graduate performance.
PROCESS
Component
Program
Effectiveness
Graduation
Rates
Rates of
Employment
Where
Documentation
Is Found
Office of the
DAH
Person
Responsible
IMPLEMENTATION
Frequency of
Assessment
Assessment Method
Report of Data Collection & Analysis
Actual Level of Achievement
Actions
For Program Development, Maintenance, or Revision
DAH
At the
beginning of
each semester
At the
beginning of
each semester
Analysis of Tracking
Table for Each
Admission cohort.
Analysis of Exit
Interview data
September 2005
75% of students enrolled in EMT 1010 on the
11th day head count completed the course.
Level of achievement met.
January 2006
83% of students enrolled in EMT 1010 on the
11th day head count completed the course.
Level of achievement met.
September 2005
100% of graduates seeking employment are
employed in a position that requires EMT
preparation.
January 2006
100% of graduates seeking employment are
employed in a position that requires EMT
preparation.
4
Level of achievement met.
Level of achievement met.
Performance
on National
Registry
At the
beginning of
each semester
Analysis of National
Registry Performance
Report
September 2005
33% of graduates passed the National Registry
on the first write.
January 2006
60% of graduates passed the National Registry
on the first write.
Graduate
Program
Satisfaction
Annually in
April,
September, or
November
Analysis of Graduate
Surveys results
September and October 2005
50% of graduates (2/6) returning the
Graduate Survey within 3 months of
completing the course expressed overall
satisfaction with preparation provided by the
program.
April 2006
100% of graduates returning the Graduate
Survey within 3 months of completing the
course expressed overall satisfaction with
preparation provided by the program.
Employer
Satisfaction
Annually in
April,
September, or
November
Analysis of results of
Employer Satisfaction
Survey
September 2005
One hundred percent (100%) 2 out of 3 of
employers returned the employer survey
within 3 months of graduation and reported
overall satisfaction with graduate performance.
April 2006
One hundred percent (100%) or 2 out of 2
employers returned the employer survey
within 3 months of graduation. Fifty percent of
employers expressed overall satisfaction with
graduate performance. One employer reported
“somewhat satisfied” with overall graduate
performance even though survey answers for
7 of the 12 questions were marked satisfied.
The other employer was “Very Satisfied” with
graduate performance
5
Level of achievement not met.
Level of achievement not met.
Program Revision 2005-2006.
Beginning in the spring of 2006, students failing 2 or more
unit exams will fail the course.
September: Cannot assess if level of achievement was met
at this time because no student returned the survey by the
deadline. Students were not accessible by phone when
called to obtain survey information.
October: Two graduate surveys received in October.
Program Revision Fall 2005
Emphasize to students the importance of returning the
graduate survey after graduation.
Level of achievement met.
Level of achievement met.
Program Maintenance 2005-2006
Continue to monitor since data for one employer is unclear.
Level of achievement not met.
Development Spring 2006
Two employers responded. This is the first time DeWitt
Hospital marked “Somewhat Satisfied” for graduate
performance when 7 of 12 survey responses by this same
hospital were marked satisfied or very satisfied with overall
graduate performance. In light of the discrepancies
between survey responses from DeWitt Hospital and EASI,
no action will be taken at this time other than to continue
to monitor employer satisfaction with graduate
performance.