Radiologic Technology Program, AAS

advertisement
Radiologic Technology Program, AAS
Educational Effectiveness
Assessment Plan
Version III
Adopted by
The Radiologic Faculty: June 2004
June 2008
Submitted to
The Dean of the Community and Technical College: June 2008
The Office of Academic Affairs: June 2008
533571652
Submitted 6-17-08
Page 1 of 18
Table of Contents
Mission Statement _______________________________________________________3
Program Introduction _____________________________________________________3
Assessment Process Introduction ____________________________________________3
Program Outcomes _______________________________________________________4
Table 1: Association of Assessment Measures to Program Outcomes ________________5
Assessment Measures _____________________________________________________6
Table 2: Program Outcomes and Assessment Measures and Administration __________6
Assessment Implementation & Analysis for Program Improvement _________________7
General Implementation Strategy ___________________________________________________7
Method of Data Analysis and Formulation of Recommendations for the Program _____________7
Modification to the Assessment Plan ________________________________________________8
Appendix A: ____________________________________________________________9
Measure Description _____________________________________________________________9
Factors that affect the data collection ________________________________________________9
How to interpret the data __________________________________________________________9
Example of tool _________________________________________________________________10
Appendix B:____________________________________________________________11
Measure Description ____________________________________________________________11
Factors that affect the data collection _______________________________________________11
How to interpret the data _________________________________________________________11
Example of tool ________________________________________________________________12
Appendix C: ____________________________________________________________13
Measure Description _____________________________________________________________13
Factors that affect the data collection ________________________________________________13
How to interpret the data __________________________________________________________13
Example of tool _________________________________________________________________14
Appendix D: ____________________________________________________________15
Measure Description _____________________________________________________________15
Factors that affect the data collection ________________________________________________15
How to interpret the data __________________________________________________________15
Example of tool _________________________________________________________________16-18
533571652
Submitted 6-17-08
Page 2 of 18
MISSION STATEMENT
It is the Mission of the Radiologic Technology program to prepare students for employment as career
entry Medical Radiographers. Students completing the program receive an Associate of Applied
Science degree and are eligible to apply for certification with the American Registry of Radiologic
Technologists (ARRT). The program of study incorporates didactic instruction, laboratory
demonstration, and clinical application in a manner that provides correlation of theory with practice.
The inclusion of general university requirements fulfills program goals of developing knowledgeable
and competent practitioners who will have opportunities for continued professional growth.
PROGRAM INTRODUCTION
The Radiologic Technology Program at the University of Alaska Anchorage is not accredited by any
outside accrediting agency. It does however parallel the curriculum set forth for Radiology Programs
by the American Registry of Radiologic Technologist (ARRT), the Joint Review Committee on
Education in Radiologic Technology (JRCERT), and the American Society of Radiologic
Technologists (ASRT).
ASSESSMENT PROCESS INTRODUCTION
The Radiologic Technology Program was established at UAA in 2001. The program was developed
based on programmatic accreditation standards developed by the Joint Review Committee on
Education in Radiologic Technology (JRCERT). This accrediting body, along with the American
Society of Radiologic Technologist (ASRT), establishes the curriculum for Radiologic Technology
Programs. These standards include requirements for the establishment of program objectives,
outcomes, assessment tools and the implementation of an assessment plan. Thus, when the program
was initially established objectives and outcomes were identified, appropriate assessment tools to
assess these objectives and outcomes were also identified, and an assessment plan was developed.
This document defines the expected student learning outcomes for the Radiologic Technology program
and outlines a plan for assessing the achievement of the stated outcomes.
The objectives and outcomes were established with input from the faculty, an advisory group, a review
of accreditation standards, and a review of requirements for successful passing of the professional
registry (ARRT) exam. The faculty approved the objectives and outcomes in 2001 and continues to
review and update the outcomes.
The program graduated its first graduates in May 2003, and a sixth class of graduates completed the
program in May 2008. The program began the implementation of its assessment plan in 2004.
533571652
Submitted 6-17-08
Page 3 of 18
PROGRAM OUTCOMES
At the completion of this program, students have the ability to:
1. Demonstrate the 56 competency requirements outlined and identified by the American Society
or Radiologic Technologists (ARRT).
2. Demonstrate knowledge in the general education areas, such as those required for the AAS
degree, identified by the American Society of Radiologic Technologists (ASRT).
3. Demonstrate the ability to perform radiographic procedures learned in RADT 131, 132, 133
course sequence and apply them in the clinical RADT 195A, 195B, 195C, 295A and 295B
sequence.
4. Display professional attitude and ethics within the clinical setting.
533571652
Submitted 6-17-08
Page 4 of 18
Demonstrate the 56 competency requirements outlined and
identified by the American Society of Radiologic Technologists
(ARRT).
Demonstrate knowledge in the general education areas, such
those required for the AAS degree, identified by the American
Society of Radiologic Technologists (ASRT)
Demonstrate the ability to perform radiographic procedures
learned in RADT 131, 132, 133 course sequence and apply
them in the clinical RADT 195A, 195B, 195C, 295A and 295B
sequence.
Display professional attitude and ethics within the clinical
setting.
Submitted 6-17-08
Clinical bisemester
evaluation
1
1
1
1
1
1
0
0
1
1
1
1
0
0
1
1
0 = Measure is not used to measure the associated outcome.
1 = Measure is used to measure the associated outcome.
533571652
Clinical
Competent
ecy Exam
Outcomes
Exit
Survey
ARRT
Registry
Exam
TABLE 1: ASSOCIATION OF ASSESSMENT MEASURES TO PROGRAM OUTCOMES
Page 5 of 18
ASSESSMENT MEASURES
TABLE 2: PROGRAM OUTCOMES ASSESSMENT MEASURES AND ADMINISTRATION
Measure
Description
Frequency/
Start Date
ARRT Examination
National registry examination
administered by the American Society for
Radiologic Technologists (ARRT)
Upon
completion of
the program
Student Exit Survey
Upon
completion of
the program
Exit Survey
Clinical
Competency
Bi-Semester
Evaluations
Evaluation tool used in the clinical setting
to assess the student’s performance of
examinations on actual patients.
Throughout
the semester
Evaluation tool used twice per semester
to assess the students performance in
clinical abilities to include ethics
Midterm and
final semester
schedule
533571652
Submitted 6-17-08
Collection
Method
Exam results,
percentage of
students who
passed
mailed to
program
Annually at
the end of
spring
semester
Collected
throughout
the semester
students are
in clinical.
Collected by
the Clinical
Coordinator
Page 6 of 18
Administered
by
American
Registry for
Radiologic
Technologists
(ARRT)
Radiologic
Technology
Faculty
Radiologic
Technology
Faculty and
Clinical
Educator
Radiologic
Technology
Faculty and
Clinical
Educator
ASSESSMENT IMPLEMENTATION & ANALYSIS FOR PROGRAM IMPROVEMENT
General Implementation Strategy
The Radiologic Technology Program presently utilizes the four assessment tools identified above.
Students typically complete the program in May of each year, and sit for the national registry exam in
May or June. A summary of the students’ scores and pass/no pass results are forwarded from the
ARRT board to the department at the end of summer. This data is reviewed by the faculty.
The graduate exit survey is distributed to students at the end of each spring semester. The surveys are
distributed by the department, collected and reviewed in August of each year.
Clinical Competencies are ongoing throughout those semesters that students are in clinical. The
competencies are assessed by both the clinical educator (those registered radiologic technologists
within the clinical facility assigned to the students) and program faculty as the student completes them.
Bi-Semester Evaluations are done at midterm and at the end of the semester. They are reviewed by the
student and evaluated by the clinical educator as well as program faculty.
At the end of each spring semester data that has been collected throughout the year can be analyzed
and changes to the program can be planned for the following academic year.
Method of Data Analysis and Formulation of Recommendations for Program Improvement
The faculty of the program are to meet at least once a year to review the data collected using the
assessment tools. This meeting should result in recommendations for program changes that are
designed to enhance performance relative to the program’s objectives and outcomes. The results of the
data collection, an interpretation of the results, and the recommended programmatic changes are to be
forwarded to the office of Academic Affairs (in the required format) by the end of June each year. A
plan for implementing the recommended changes, including advertising the changes to all the
program’s stakeholders, is also to be completed at this meeting.
The proposed programmatic changes may be any action or change in policy that the faculty deems as
being necessary to improve performance relative to programs objectives and outcomes.
Recommended changes should also consider workload (faculty, staff, and students), budgetary,
facilities, and other relevant constraints. A few examples of changes made by programs at UAA
include:
o changes in course content, scheduling, sequencing, prerequisites, delivery methods, etc.
o changes in faculty/staff assignments
o changes in advising methods and requirements
o addition and/or replacement of equipment
o changes to facilities
533571652
Submitted 6-17-08
Page 7 of 18
Modification of the Assessment Plan
The faculty, after reviewing the collected data and the processes used to collect it, may decide to alter
the assessment plan. Changes may be made to any component of the plan, including the objectives,
outcomes, assessment tools, or any other aspect of the plan. The changes are to be approved by the
faculty of the program. The modified assessment plan is to be forwarded to the dean/director’s office
and the Office of Academic Affairs.
It was determined in October of 2007 that the assessment tools need to measure more specific
outcomes. This resulted in 2 new tools being implemented, the Clinical Competency form and the
Semester Evaluation form. Data for these two forms will be available in the 2008 Assessment.
533571652
Submitted 6-17-08
Page 8 of 18
Appendix A: ARRT National Registry Exam
Measure Description:
Students who complete the UAA Radiologic Technology Program are eligible to sit for the National
Registry Exam for Radiologic Technologists. The results are mailed to the department on a yearly
basis each September.
Factors that affect the collected data:
No specific factors. Students may repeat the exam if not passed on the first attempt. Currently one
student did not pass the exam on the first attempt but was successful on the second attempt.
How to interpret the data:
The outcomes associated with this assessment tool are directly related to the outcomes established by
the American Society of Radiologic Technologists.
533571652
Submitted 6-17-08
Page 9 of 18
533571652
Submitted 6-17-08
Page 10 of 18
APPENDIX B: EXIT SURVEY
Measure Description:
During the final course of the Radiologic Technology Program, students are given an exit survey. This
survey asks students to assess their skill level in both academic areas, as well as clinical proficiency
skills. Specifically the outcomes which have been identified by faculty are included in the exit survey.
At this point in time, the students have had an opportunity to use their acquired knowledge and skills in
their final practicum course.
Factors that affect the collected data:
Students’ experiences vary somewhat depending upon the individual facilities in which they are
placed. Individual experiences may affect the data.
How to interpret the data:
The exit survey is used by the faculty to assess whether there are specific knowledge areas or skills for
which the students feel as though their preparation is lacking. Changes can be made to strengthen
certain content areas, and/or skills as needed.
533571652
Submitted 6-17-08
Page 11 of 18
University of Alaska Anchorage
Radiologic Technology
Graduation Exit Survey
1 – Poor or low opinion
2 – Below average
3 – Average or acceptable
4 – Above average
5 – Excellent, very high opinion
I.
Curriculum
1.
The program courses are organized appropriately
2.
The course content is appropriate for all courses
1


2


3


4


5


II.
Laboratory Course Components
1. Lab courses were properly integrated with lecture and clinical courses
2.
Examination accurately tested my understanding of the information
3.
The instructor presented the information in an appropriate manner
4.
The lab was available for practice
5.
Sufficient equipment was available for instruction and practice
6.
Scheduling of lab sessions was fair & equitable
7.
Overall quality of all laboratory courses



































Didactic Courses
1.
Information was provided in a logical manner
2.
Examinations occurred at appropriate intervals
3.
Examinations accurately tested my understanding of appropriate information
4.
The structure of the Clinical Courses provided a positive mechanism that facilitated my learning
5.
Overall quality of courses





























1







2







3







4







5











































III.
IV
Program Director
1.
Availability
2.
Teaching ability
3.
Administration of program
V.
Clinical Coordinator
1.
Availability
2.
Teaching Ability
3.
Management of clinical education
VI
Resources
1.
Laboratory facilities
2.
Classroom facilities
3.
Equipment

Quality

Selection

Quantity
VII
Overall Rating
1.
How would you rate this program overall?
2.
How well do you feel the program prepared you for the workforce?
3.
Would you recommend this program?
533571652
Submitted 6-17-08
Page 12 of 18
Appendix C: Clinical Competency Evaluation Instrument
Measure Description:
During the program the student must complete a total of 56 competencies. These competencies are
dictated by the American Registry of Radiologic Technologists (ARRT). This instrument asks clinical
educators to assess the skill level of the student’s clinical proficiency skills. The proficiency skills are
assessed to see if the student can demonstrate information learned in the classroom and apply it to the
clinical setting. These competencies are performed on actual patients during the RADT 195A, RADT
195B, RADT 195C, RADT 295A and RADT 295B courses.
Factors that affect the collected data:
Evaluation abilities of the clinical educator may vary depending upon the individual assessing and
facility. Individual experiences may affect the data. Patient condition may also affect the evaluation as
some patients are more complicated than others.
How to interpret the data:
The clinical competency is used by the faculty to assess whether there are specific knowledge areas or
skills for which the clinical educators feel as though students’ preparation is lacking. Changes can be
made to strengthen certain content areas, and/or skills as needed.
533571652
Submitted 6-17-08
Page 13 of 18
Clinical Competency Evaluation Form
Student name________________________________________________________________________
Clinical Site ___________________________________ Pt ID _________________________
Examination ________________________________________Date _____________________
Grading 1 = acceptable
0 = not acceptable
N/A = not applicable
All items with an asterisk (*) are required to successfully pass the competency.
PREPARATION
_____ 1. Room cleaned and stocked.
_____ 2. Equipment prepared.
_____ 3. Hands washed prior to positioning.
PATIENT CARE
_____4. Introduces self and greets patient.
_____5. Explains procedure to the patient and maintains patient privacy.
_____6. Obtains a patient history, confirms identity and pregnancy status.
_____7. Assists patient using proper body mechanics
____*8. Properly cleans equipment after exam completion.
TECHNICAL FACTORS
_____ 9. Correctly measures the patient.
_____*10. Selects appropriate technical factors and film size.
_____*11. Uses markers appropriately.
RADIATION PROTECTION
_____*12. Closes x-ray room door and vacates unnecessary personnel.
_____ 13. Uses gonadal shielding and collimation properly.
_____*14. Wears film badge in the proper location.
_____*15 Practices personal protection (shielding, distance, etc).
_____ 16. Prevents unnecessary repeats. (Qualified radiographer must be present and observe
student during all repeats)
POSITIONING
_____ 17. Uses immobilization devices or positioning aides as needed
_____*18. Aligns the CR, IR, and part. Uses appropriate SID.
_____*19. Correctly angles CR when required
_____ 20. Gives patient correct breathing instructions
First year students must satisfactorily complete 16 of 20 items. Second year students must satisfactorily
complete 18 of 20 items. Failure to satisfactorily complete items with an asterisk is an automatic failure.
SCORE ____________
Evaluator’s Name and
Signature_________________________________________________________________________________
Comments_________________________________________________________________________________
__________________________________________________________________________________________
__________________________________________________________________________________________
__________________________________________________________________________________________
533571652
Submitted 6-17-08
Page 14 of 18
Appendix D: Student Bi-Semester Survey
Measure Description:
Twice during each semester of clinical courses the students are provided a semester survey which has
been completed by the clinical educator.. These surveys are completed at midterm as well as the final
portion of the semester. This survey asks clinical educators to assess the student’s skill level in both
academic areas, as well as clinical proficiency skills. This instrument is used in the RADT 195A,
RADT 195B, RADT 195C, RADT 295A and RADT 295B courses. Students are counseled, and the
assessment is reviewed by the student, clinical coordinator (UAA faculty) and clinical educator. Any
of the above are encouraged to make comments.
Factors that affect the collected data:
Students’ experiences vary somewhat depending upon the individual facilities in which they are
placed. Experience of the student, as well as the clinical educator, may affect the responses to the
survey.
How to interpret the data:
The semester survey evaluation is used by the faculty to assess whether there are specific knowledge
areas or skills for which the clinical educators feel as though the students are lacking. Changes can be
made to strengthen certain content areas, and/or skills as needed during each semester. Data is
reviewed by the clinical coordinator for the program as well as program director.
533571652
Submitted 6-17-08
Page 15 of 18
UAA Radiology Program
Final Clinical Evaluation Survey
Student______________________________________________ Date__________________
Clinical Site _________________________________________________________________
Evaluator (s) ________________________________________________________________
Grading. Using the following scale please rate the student’s current level of performance
5= superior – near perfect
3= average
1 = unacceptable
4= above average
2 = below average (needs improvement)
ATTENDANCE
_____ 1. The student reports to clinic as scheduled. Student is prepared for clinical instruction.
_____ 2. The student notifies the Clinical Educator of any delays or absences.
PROFESSIONAL CONDUCT
_____ 1. The student follows appropriate dress codes, grooming standards, and personal hygiene per
program and clinical policy.
_____ 2. The student demonstrates appropriate actions toward patients, peers and other health care
professionals.
_____ 3. The student responds in a positive matter to constructive commentary.
COMMUNICATION
_____ 1. The student explains all procedures, gives clear direction, and ensures patient understanding.
_____ 2. The student listens carefully and follows directions.
_____ 3. The student exhibits positive verbal and non verbal communication with patient, physicians,
peers and other health care professionals.
INITIATIVE
_____ 1. The student seems genuinely interested in procedures and will seek to participate in all
levels and types of examinations.
_____ 2. The student performs duties without being asked. Student uses time in a productive manner.
JUDGEMENT/CRITICAL THINKING
533571652
Submitted 6-17-08
Page 16 of 18
_____ 1. The student displays confidence in skills while recognizing limitations.
_____ 2. The student identifies the steps necessary to complete a task and does so in a logical manner.
_____ 3. The student properly evaluates the patient and makes adjustments for correct positioning.
_____4. The student can accept constructive criticism and strives to improve.
_____5. The student can adapt protocols to meet various situations and requirements.`
OCCUPATIONAL SKILLS
_____ 1. The student knows the department protocols and performs the positions properly.
_____ 2. The student can correctly formulate technical factors and makes adjustments according to
current level of training.
_____ 3. The student can discriminate between diagnostic and non-diagnostic radiographs and
determine necessary changes.
_____ 4. The student implements proper radiation protection for themselves and the patient.
_____ 5. The student uses proper universal precautions.
_____ 6. The student can complete examinations in a timely manner with few repeats according to the
exam difficulty and level of training.
PATIENT CARE
_____ 1. The student exhibits professionalism, perceives patient needs, and creates a friendly,
empathetic, comfortable atmosphere with all patients
_____ 2. The student is able to perform exams on patients presented with various difficulties.
533571652
Submitted 6-17-08
Page 17 of 18
EVALUATOR COMMENTS
Goal success
__________________________________________________________________________________
__________________________________________________________________________________
__________________________________________________________________________________
__________________________________________________________________________________
______________________________________________________________
Areas of strength and expansion during semester.
__________________________________________________________________________________
__________________________________________________________________________________
__________________________________________________________________________________
__________________________________________________________________________________
__________________________________________________________________________________
__________________________________________________________________________________
__________________________________________________________________________________
__________________________________________________
Areas needing improvement and/or improved during semester.
______________________________________________________________________________
______________________________________________________________________________
______________________________________________________________________________
______________________________________________________________________________
______________________________________________________________________________
______________________________________________________________________________
______________________________________________________________________________
General Comments/Suggestions
______________________________________________________________________________
______________________________________________________________________________
______________________________________________________________________________
______________________________________________________________________________
______________________________________________________________________________
______________________________________________________________________________
______________________________________________________________________________
______________________________________________________________________________
Student’s Signature _____________________________________ Date _______________
Evaluators Signature ____________________________________ Date _______________
533571652
Submitted 6-17-08
Page 18 of 18
Download