West Virginia University Hospitals
Radiation Therapy Education Program
Outcome Assessment Plan
2011 - 2012 Academic Year
Lindsay, Terence, Jona, Melissa
Goal #1: Students will demonstrate entry-level clinical competence in radiation therapy.
Student Learning Outcome
1.1 Students will
demonstrate appropriate
immobilization and
positioning when preparing
patients for treatment and
simulation.
Data Tool /Mechanism
1.1a Clinical Eval, Domain
B: Administer/Monitor of
Rad Therapy; item 2 "Pt
positioning/immobilization"
Benchmark
Mean ≥ 3.5 (4 point scale)
1.1b Clinical Competency
Exam Section IIB,
"Psychomotor Domain"
Mean ≥ 95% (100 pt scale)
Semi-Annually (
Semester I & II)
Minimum 3
exams/student/sem:
random sample
Program Director
2012 Sem I = 99.5
2011 Sem I = 99.3
Sem II = 99.5
Sem II = 99.9
1.2 Students will correctly
operate equipment and
accessories to deliver
prescribed therapeutic
doses.
1.2a Clinical Eval, Domain
B: Administer/Monitor of
Rad Therapy; item 1
"Equipment operation"
Mean ≥ 3.5 (4 point scale)
Semi-Annually (
Semester I & II)
Clinical
Supervisors
2012 Sem I = 3.85
2011 Sem I = 3.77
Sem II = 4.0
Sem II = 4.0
1.2b. Program Director
Evaluation of Student; item
4"Equipment operation"
Mean ≥ 3.5 (4 point scale)
Quarterly
Program Director
2012 Sem I = 3.50
2011 Sem I = 3.50
Sem II = 4.0
Sem II = 4.0
1.3a Comprehensive
Competency Exam
Mean ≥ 95% (100 pt. scale)
Semi-annually; each
semester, min. of 2
exams/student/
semester
Program Director
2012 Sem I = 99.5
2011 Sem I = 99.8
Sem II = 99.88
Sem II = 100
1.3b. Program Director
Evaluation of Student; item
20"Overall Progress"
Mean ≥ 3.5 (4 point scale)
Quarterly
Program Director
2012 Sem I = 3.63 Sem II = 3.88
2011 Sem I = 4.0 Sem II = 4.0
1.3 Students will
demonstrate adequate
clinical skills to perform as
an entry level therapist.
Analysis & Action Plan
Student Learning Objective 1.1
Data Tool 1.1a
Clinical Evaluation
Data Tool 1.1b
Clinical competency exam
Student Learning Objective 1.2
Data Tool 1.2a
Clinical Evaluation
Data Tool 1.2b
Program Director Evaluation
Student Learning Objective 1.3
Data Tool 1.3a
Comprehensive competency
Data Tool 1.3b
Program Director Evaluation
met, no action taken
met, no action taken
met, no action taken
Frequency/Time Frame Responsibility
Semi-Annually
Clinical
(semester I & II)
Supervisors
Outcome Results
2012 Sem I = 3.8 Sem II = 4.0
2011 Sem I = 3.68 Sem II = 3.95
West Virginia University Hospitals
Radiation Therapy Education Program
Outcome Assessment Plan
2011 - 2012 Academic Year
Lindsay, Terence, Jona, Melissa
Goal #2 : Students will practice effective communications skills.
Student Learning Outcome
2.1 Students will
demonstrate effective
verbal communication
skills.
2.2 Students will
demonstrate appropriate
written communication
skills
Data Tool /Mechanism
1.1a Clinical Eval, Domain
C: Caregiving ; section C
score
Benchmark
Frequency/Time Frame Responsibility
Mean Score Section "C" ≥ 3.5 Semiannually Sem I & Clinical Supervisor
(4 point scale)
II (Mid-term & Final)
Outcome Results
2012 Sem I=3.95
2011 Sem I=3.98
2.1b. Clinical competency
exam, Section II C:
Interpersonal Domain
Mean score Section II C ≥
95% (100 pt. scale)
Semiannually Sem I &
II min. of 3
exams/student/sem;
random sample
Program Director
2012 Sem I=99.7%
2011 Sem I=99.8%
2.1c. Employer Survey,
Communication Skills
Section (Q-7)
Mean employer response >
3.5 (5 point scale)
Annually
(July)
Program Director
2011 = Data not yet available
2012 = Data not yet available
2.2a RADTT 323 & RADTT
343 - Technical writing
research project evaluation
Research Paper eval. formmean score ≥ 86 points (100
pt scale);Physics Project eval.
form- mean score ≥ 86 points
(100 pt scale)
Mean score > 95% (100 pt
scale) Section I "Completion
of Pt. information"
Semiannually Sem I &
II (Nov., May)
Course Instructor
2012 Sem I=96.8%
2011 Sem I=96.3%
Semiannually Sem I &
II min. of 2
exams/student/sem;
random sample
Program Director
2012 Sem I=100.0%
Sem II=100%
2011 Sem I=98.8%
Sem II=100%
2.3a Clinical Eval, Domain
C: Caregiving ; item 3 "pt &
family interaction"
Mean ≥ 3.5 (4 point scale)
Annually - March
Course Instructor
2012 Sem I=3.96
2011 Sem I=3.98
2.2b Program Director
evaluation of student; item 3
"Pt & family interaction",
item 13 "attitude toward
collegues"
Mean Score items 3 & 13 ≥
3.5 (4 point scale)
Quarterly
Program Director
2012 Sem I=3.88 Sem II=3.75
2011 Sem I=4.0 Sem II=4.0
2.2b Comprehensive
Competency Exam Section I
2.3 Students will
communicate and interact
appropriately with
patients/family members
and colleagues.
Analysis & Action Plan
Student Learning Objective 2.1
Data Tool 2.1a
Clinical Evaluation
Data Tool 2.1b
Clinical competency exam
Data Tool 2.1c
Employer Survey
Student Learning Objective 2.2
Status
met, no action taken
met, no action taken
Sem II=4.0
Sem II=4.0
Sem II=99.6%
Sem II=100%
Sem II=99%
Sem II=95%
Sem II=4.0
Sem II=4.0
Data Tool 2.2a
research evaluation
Data Tool 2.2b
Comprehensive Competency Exam
Student Learning Objective 2.3
Data Tool 2.3a
Clinical Eval
Data Tool 2.3b
Program Director evaluation
met, no action taken
West Virginia University Hospitals
Radiation Therapy Education Program
Outcome Assessment Plan
2011 - 2012 Academic Year
Lindsay, Terence, Jona, Melissa
Goal #3 : Students will employ critical thinking / problem solving skills.
Student Learning Outcome
3.1 Students will assess
patient needs and adapt
radiation therapy
procedures as required.
3.2 -Students will
demonstrate the application
of didactic knowledge in
the clinical setting.
Data Tool /Mechanism
3.1a Clinical Eval, Domain
C: Caregiving ; item 1 "pt.
assessment"
Benchmark
Mean Score item 1 ≥ 3.5
point scale)
3.1b Program Director
evaluation of student; item 18
"handles stressful situations",
item 19 "management of
rapidly changing situations"
Mean Score items 18-19 ≥ 3.5
(4 point scale)
Quarterly
3.1c Employer Survey Q-5
"Analytical/Critical thinking
skills"
Mean employer response >
3.5 (5 point scale)
Annually (July)
Program Director
2012 = Data not yet available
2011 = Data not yet available
3.1b Program Director
evaluation of student; item 5
"application of didactic
knowledge"
Mean Score item 5 ≥ 3.5
point scale)
Quarterly
Program Director
2012 Sem I=3.88 Sem II=4.0
2011 Sem I=4.0 Sem II=4.0
3.2a Comprehensive
Competency Exam section
IIA: Cognitive Domain
Mean score > 95% (100 pt
scale) Section IIA: Cognitive
Domain
Semiannually Sem I &
II min. of 2
exams/student/sem;
random sample
Program Director
2012 Sem I=100%
2011 Sem I=100%
Analysis & Action Plan
Status
Student Learning Objective 3.1
Data Tool 3.1a
Clinical Eval
Data Tool 3.1b
Program Director evaluation
Data Tool 3.1c
Employer Survey
Student Learning Objective 3.2
Data Tool 3.2a
Program Director evaluation
Data Tool 3.2b
Comprehensive Competency Exam
met, no action taken
met, no action taken
(4
(4
Frequency/Time Frame Responsibility
Semiannually Sem I & Clinical Supervisor
II (Mid-term & Final)
Program Director
Outcome Results
2012 Sem I=3.95
2011 Sem I=3.98
Sem II=4.0
Sem II=4.0
2012 Sem I=3.94 Sem II=3.94
2011 Sem I=4.0
Sem II=4.0
Sem II=100%
Sem II=100%
West Virginia University Hospitals
Radiation Therapy Education Program
Outcome Assessment Plan
2011 - 2012 Academic Year
Lindsay, Terence, Jona, Melissa
Goal #4 : Students will exibit professional behavior.
Student Learning Outcome
4.1 Students will
demonstrate commitment
and responsibility to the
radiation therapy
profession.
4.2 Students will
demonstrate positive
attitutes.
4.3 Students will exhibit
ethical behavior and
judgement.
Data Tool /Mechanism
4.1a Program Director
evaluation of student; item 10
"attendance"
Benchmark
Mean > 3.5 ( 4 point scale)
Frequency/Time Frame Responsibility
Quarterly
Program Director
4.1b Employer Surveys,
"Attendance and Punctuality"
section Q-8
Mean employer response =>
3.5 ( 5 point scale)
Annually
Program Director
2012 = Data not yet available
2011 = Data not yet available
4.2a Program Director
evaluation of student; item 13
"attitude"
Mean > 3.5 ( 4 point scale)
Quarterly
Program Director
2012 Sem I= 3.75 Sem II= 3.75
2011 Sem I= 4.0 Sem II= 4.0
4.2b Clinical Eval, Domain
A: Organization & work role ;
item 3 "student attitude
toward colleagues"
Mean > 3.5 ( 4 point scale)
Semiannually Sem I &
II (Mid-term & Final)
Clinical Supervisor
2012 Sem I= 3.88
2011 Sem I= 3.98
4.3a RADTT 316: Medical
Ethics Course, Exam 1,
Situational essay
Grading Mean Score ≥ 8
points (out of possible 10)
Annually (Semester IJuly)
Course Instructor
2012 = 10.0 pts
2011 = 10.0 pts
4.3b Clinical Eval, Domain
Mean > 3.5 ( 4 point scale)
Semiannually Sem I &
II (Mid-term & Final)
Clinical Supervisor
2012 Sem I= 3.89
2011 Sem I= 3.94
Program direcot
Analysis & Action Plan
Student Learning Objective 4.1
Data Tool 4.1a
Benchmark not met in 2nd semester.
Program Director evaluation
Data Tool 4.1b
Employer Surveys
Student Learning Objective 4.2
Data Tool 4.2a
Program Director evaluation
Data Tool 4.2b
Clinical Eval
Outcome Results
2012 Sem I= 3.75 Sem II= 3.38
2011 Sem I= 4.0 Sem II= 4.0
Sem II= 3.96
Sem II= 3.99
Sem II= 3.96
Sem II= 3.98
Student Learning Objective 4.3
Data Tool 4.3a
Exam 1, Situational essay
Data Tool 4.3b
Clinical Eval
West Virginia University Hospitals
Radiation Therapy Education Program
Outcome Assessment Plan
2011 - 2012 Academic Year
Lindsay, Terence, Jona, Melissa
Goal #5: Students will integrate professional growth and development practices.
Student Learning Outcome Data Tool /Mechanism
5.1 Students will evaluate
5.1a. Student self-evaluation
their clinical performance
to assess professional
development.
5.2 Students will
demonstrate dependability
in the clinical workplace.
5.3 Students will reflect
evidence of professional
growth.
Benchmark
Mean student response > 3.5
(4 point scale)
5.1b. Exit Survey summary
results, Q-1
Mean > 4.5 ( 4 point scale)
5.2a Clinical Eval, Domain
D: Professionalism ; item 1
"Arrives on time, returns form
class timely"
Mean > 3.5 ( 4 point scale)
5.2b Employer Surveys,
"Attendance and Punctuality"
section Q-8
Frequency/Time Frame Responsibility
Semiannually Sem I & Student/Program
II (Mid-term & Final)
Director
Sem II= 3.95
Sem II= 3.96
Student/Program
Director
2012 4.73
Semiannually Sem I &
II (Mid-term & Final)
Clinical Supervisor
2012 Sem I= 3.88 Sem II= 3.96
2011 Sem I= 4.0 Sem II= 4.0
Mean employer response =>
3.5 ( 5 point scale)
Annually
Program Director
2012 No data yet available
2011 No data yet available
5.3a Clinical Eval, Domain
A: Organization & Work role
; item 2 "Teamwork"
Mean > 3.5 ( 4 point scale)
Semiannually Sem I &
II (Mid-term & Final)
Clinical Supervisor
2012 Sem I= 3.88 Sem II= 4.0
2011 Sem I= 3.96 Sem II= 3.96
5.3b Employer Surveys,
"Promotability" section Q-9
Mean employer response =>
3.5 ( 5 point scale)
Annually
Program Director
2012 No data yet available
2011 No data yet available
Analysis & Action Plan
Student Learning Objective 5.1
Data Tool 5.1a
Student self-evaluation
Data Tool 5.1b
Exit Survey
Student Learning Objective 4.2
Data Tool 5.2a
Clinical Eval
Data Tool 5.2b
Employer Surveys
Student Learning Objective 4.3
Data Tool 5.3a
Clinical Eval
met, no action taken
met, no action taken
met, no action taken
Annually
Outcome Results
2012 Sem I= 3.69
2011 Sem I= 3.79
2012 4.9
Data Tool 5.3b
Employer Surveys
West Virginia University Hospitals
Radiologic Technology Education Programs
Outcome Assessment Plan
2011 - 2012 Academic Year
Program Effectiveness Measures
Outcome
P.E. #1 - Students will
complete the program.
Data Tool /Mechanism
Graduation data
Benchmark
Program completion rate ≥
90% over 5 year period
P.E.# 2 - Graduates will
pass the A.R.R.T.
certification exam in
Radiation Therapy
A.R.R.T Exam Data
1st time ARRT exam pass rate
≥ 90% over 5 year period
P.E. #3 - Graduates will
pass the A.R.R.T. exam in
Radiation therapy with
acceptable proficiency.
A.R.R.T Exam Data
P.E. #4 - Graduates will
identify that they received a
satisfactory education in
Radiation therapy.
Exit Surveys, Alumni surveys
P.E. #5 - Graduates will
obtain employment in
radiation therapy within 6
months post- graduation
Post-Exit Surveys, E-mail
responses, or Word of Mouth
P.E. #6 - Employers will
identify graduates as
satisfactory with respect to
entry-level skills.
Employer Surveys
Frequency/Time Frame Responsibility
Annually
Program Director
Annually
Program Director
Outcome Results
2012 = 100% (4 of 4 completed the program in June 2011)
2011 = 100% (4 of 4 completed the program in June 2011)
2010 = 100% (4 of 4 completed the program in June 2010)
2009 = 100% (4 of 4 completed the program in June 2009)
2008 = 100% (4 of 4 completed the program in June 2008)
2012 = 100%
2011 = 100%
2010= 100%
2009= 100%
2008= 100%
Program ARRT Exam Mean
Scaled Score will be ≥ to US
mean per exam year.
Annually
Mean overall Score Exit
survey Q4 "overall quality",
Alumni survey Q 17 "Overall
educational experience" ≥4.0
(5 point scale)
Annually
Employment within 6 months
of graduation ≥ 75%
Annually
Program Director
2012:WVUH= 85.3 U.S.= Data not available
2011:WVUH= 84.3 U.S.= 83.2
2010: WVUH= 88.8 U.S.= 82.0
2009: WVUH= 85.0 U.S.= 82.2
2008: WVUH= 87.3 U.S.= 82.3
Program Director
Program Director
2012 Q4 = 5.0
2011 Q4 = 5.0
Q-17 = Data not available
Q-17 = 5.0
2010 Q-4 = 5.0
2009 Q-4 = 4.50
2008 Q-4 = 4.75
Q-17 = 4.75
Q-17 = 5.0
Q-17 = 5.0
2012 = 50% to date
2011 = 100%
2010= 100%
2009= 100%
2008= 100%
Mean overall score Question
#10 "Overall Competence" ≥
4.0 (on a 5 point scale)
Annually
Program Director
Analysis & Action Plan
P.E. #1
met, no action taken
P.E. #2
met, no action taken
P.E. #3
met, no action taken
P.E. #4
met, electronic survey format (Survey Monkey) was implemented for the Alumni (2011) survey with a 100% return.
P.E. #5
met, no action taken
P.E. #6
electronic survey format (Survey Monkey)was implemented for 2012 to try to increase survey response
2012 = Data not yet available
2011 = Data not yet available
2010 = 4.66
2009 = 5.0
2008 = 4.25