Radiologic Technology Program, AAS Educational Effectiveness Assessment Plan Version III Adopted by The Radiologic Faculty: June 2004 June 2008 Submitted to The Dean of the Community and Technical College: June 2008 The Office of Academic Affairs: June 2008 533571652 Submitted 6-17-08 Page 1 of 18 Table of Contents Mission Statement _______________________________________________________3 Program Introduction _____________________________________________________3 Assessment Process Introduction ____________________________________________3 Program Outcomes _______________________________________________________4 Table 1: Association of Assessment Measures to Program Outcomes ________________5 Assessment Measures _____________________________________________________6 Table 2: Program Outcomes and Assessment Measures and Administration __________6 Assessment Implementation & Analysis for Program Improvement _________________7 General Implementation Strategy ___________________________________________________7 Method of Data Analysis and Formulation of Recommendations for the Program _____________7 Modification to the Assessment Plan ________________________________________________8 Appendix A: ____________________________________________________________9 Measure Description _____________________________________________________________9 Factors that affect the data collection ________________________________________________9 How to interpret the data __________________________________________________________9 Example of tool _________________________________________________________________10 Appendix B:____________________________________________________________11 Measure Description ____________________________________________________________11 Factors that affect the data collection _______________________________________________11 How to interpret the data _________________________________________________________11 Example of tool ________________________________________________________________12 Appendix C: ____________________________________________________________13 Measure Description _____________________________________________________________13 Factors that affect the data collection ________________________________________________13 How to interpret the data __________________________________________________________13 Example of tool _________________________________________________________________14 Appendix D: ____________________________________________________________15 Measure Description _____________________________________________________________15 Factors that affect the data collection ________________________________________________15 How to interpret the data __________________________________________________________15 Example of tool _________________________________________________________________16-18 533571652 Submitted 6-17-08 Page 2 of 18 MISSION STATEMENT It is the Mission of the Radiologic Technology program to prepare students for employment as career entry Medical Radiographers. Students completing the program receive an Associate of Applied Science degree and are eligible to apply for certification with the American Registry of Radiologic Technologists (ARRT). The program of study incorporates didactic instruction, laboratory demonstration, and clinical application in a manner that provides correlation of theory with practice. The inclusion of general university requirements fulfills program goals of developing knowledgeable and competent practitioners who will have opportunities for continued professional growth. PROGRAM INTRODUCTION The Radiologic Technology Program at the University of Alaska Anchorage is not accredited by any outside accrediting agency. It does however parallel the curriculum set forth for Radiology Programs by the American Registry of Radiologic Technologist (ARRT), the Joint Review Committee on Education in Radiologic Technology (JRCERT), and the American Society of Radiologic Technologists (ASRT). ASSESSMENT PROCESS INTRODUCTION The Radiologic Technology Program was established at UAA in 2001. The program was developed based on programmatic accreditation standards developed by the Joint Review Committee on Education in Radiologic Technology (JRCERT). This accrediting body, along with the American Society of Radiologic Technologist (ASRT), establishes the curriculum for Radiologic Technology Programs. These standards include requirements for the establishment of program objectives, outcomes, assessment tools and the implementation of an assessment plan. Thus, when the program was initially established objectives and outcomes were identified, appropriate assessment tools to assess these objectives and outcomes were also identified, and an assessment plan was developed. This document defines the expected student learning outcomes for the Radiologic Technology program and outlines a plan for assessing the achievement of the stated outcomes. The objectives and outcomes were established with input from the faculty, an advisory group, a review of accreditation standards, and a review of requirements for successful passing of the professional registry (ARRT) exam. The faculty approved the objectives and outcomes in 2001 and continues to review and update the outcomes. The program graduated its first graduates in May 2003, and a sixth class of graduates completed the program in May 2008. The program began the implementation of its assessment plan in 2004. 533571652 Submitted 6-17-08 Page 3 of 18 PROGRAM OUTCOMES At the completion of this program, students have the ability to: 1. Demonstrate the 56 competency requirements outlined and identified by the American Society or Radiologic Technologists (ARRT). 2. Demonstrate knowledge in the general education areas, such as those required for the AAS degree, identified by the American Society of Radiologic Technologists (ASRT). 3. Demonstrate the ability to perform radiographic procedures learned in RADT 131, 132, 133 course sequence and apply them in the clinical RADT 195A, 195B, 195C, 295A and 295B sequence. 4. Display professional attitude and ethics within the clinical setting. 533571652 Submitted 6-17-08 Page 4 of 18 Demonstrate the 56 competency requirements outlined and identified by the American Society of Radiologic Technologists (ARRT). Demonstrate knowledge in the general education areas, such those required for the AAS degree, identified by the American Society of Radiologic Technologists (ASRT) Demonstrate the ability to perform radiographic procedures learned in RADT 131, 132, 133 course sequence and apply them in the clinical RADT 195A, 195B, 195C, 295A and 295B sequence. Display professional attitude and ethics within the clinical setting. Submitted 6-17-08 Clinical bisemester evaluation 1 1 1 1 1 1 0 0 1 1 1 1 0 0 1 1 0 = Measure is not used to measure the associated outcome. 1 = Measure is used to measure the associated outcome. 533571652 Clinical Competent ecy Exam Outcomes Exit Survey ARRT Registry Exam TABLE 1: ASSOCIATION OF ASSESSMENT MEASURES TO PROGRAM OUTCOMES Page 5 of 18 ASSESSMENT MEASURES TABLE 2: PROGRAM OUTCOMES ASSESSMENT MEASURES AND ADMINISTRATION Measure Description Frequency/ Start Date ARRT Examination National registry examination administered by the American Society for Radiologic Technologists (ARRT) Upon completion of the program Student Exit Survey Upon completion of the program Exit Survey Clinical Competency Bi-Semester Evaluations Evaluation tool used in the clinical setting to assess the student’s performance of examinations on actual patients. Throughout the semester Evaluation tool used twice per semester to assess the students performance in clinical abilities to include ethics Midterm and final semester schedule 533571652 Submitted 6-17-08 Collection Method Exam results, percentage of students who passed mailed to program Annually at the end of spring semester Collected throughout the semester students are in clinical. Collected by the Clinical Coordinator Page 6 of 18 Administered by American Registry for Radiologic Technologists (ARRT) Radiologic Technology Faculty Radiologic Technology Faculty and Clinical Educator Radiologic Technology Faculty and Clinical Educator ASSESSMENT IMPLEMENTATION & ANALYSIS FOR PROGRAM IMPROVEMENT General Implementation Strategy The Radiologic Technology Program presently utilizes the four assessment tools identified above. Students typically complete the program in May of each year, and sit for the national registry exam in May or June. A summary of the students’ scores and pass/no pass results are forwarded from the ARRT board to the department at the end of summer. This data is reviewed by the faculty. The graduate exit survey is distributed to students at the end of each spring semester. The surveys are distributed by the department, collected and reviewed in August of each year. Clinical Competencies are ongoing throughout those semesters that students are in clinical. The competencies are assessed by both the clinical educator (those registered radiologic technologists within the clinical facility assigned to the students) and program faculty as the student completes them. Bi-Semester Evaluations are done at midterm and at the end of the semester. They are reviewed by the student and evaluated by the clinical educator as well as program faculty. At the end of each spring semester data that has been collected throughout the year can be analyzed and changes to the program can be planned for the following academic year. Method of Data Analysis and Formulation of Recommendations for Program Improvement The faculty of the program are to meet at least once a year to review the data collected using the assessment tools. This meeting should result in recommendations for program changes that are designed to enhance performance relative to the program’s objectives and outcomes. The results of the data collection, an interpretation of the results, and the recommended programmatic changes are to be forwarded to the office of Academic Affairs (in the required format) by the end of June each year. A plan for implementing the recommended changes, including advertising the changes to all the program’s stakeholders, is also to be completed at this meeting. The proposed programmatic changes may be any action or change in policy that the faculty deems as being necessary to improve performance relative to programs objectives and outcomes. Recommended changes should also consider workload (faculty, staff, and students), budgetary, facilities, and other relevant constraints. A few examples of changes made by programs at UAA include: o changes in course content, scheduling, sequencing, prerequisites, delivery methods, etc. o changes in faculty/staff assignments o changes in advising methods and requirements o addition and/or replacement of equipment o changes to facilities 533571652 Submitted 6-17-08 Page 7 of 18 Modification of the Assessment Plan The faculty, after reviewing the collected data and the processes used to collect it, may decide to alter the assessment plan. Changes may be made to any component of the plan, including the objectives, outcomes, assessment tools, or any other aspect of the plan. The changes are to be approved by the faculty of the program. The modified assessment plan is to be forwarded to the dean/director’s office and the Office of Academic Affairs. It was determined in October of 2007 that the assessment tools need to measure more specific outcomes. This resulted in 2 new tools being implemented, the Clinical Competency form and the Semester Evaluation form. Data for these two forms will be available in the 2008 Assessment. 533571652 Submitted 6-17-08 Page 8 of 18 Appendix A: ARRT National Registry Exam Measure Description: Students who complete the UAA Radiologic Technology Program are eligible to sit for the National Registry Exam for Radiologic Technologists. The results are mailed to the department on a yearly basis each September. Factors that affect the collected data: No specific factors. Students may repeat the exam if not passed on the first attempt. Currently one student did not pass the exam on the first attempt but was successful on the second attempt. How to interpret the data: The outcomes associated with this assessment tool are directly related to the outcomes established by the American Society of Radiologic Technologists. 533571652 Submitted 6-17-08 Page 9 of 18 533571652 Submitted 6-17-08 Page 10 of 18 APPENDIX B: EXIT SURVEY Measure Description: During the final course of the Radiologic Technology Program, students are given an exit survey. This survey asks students to assess their skill level in both academic areas, as well as clinical proficiency skills. Specifically the outcomes which have been identified by faculty are included in the exit survey. At this point in time, the students have had an opportunity to use their acquired knowledge and skills in their final practicum course. Factors that affect the collected data: Students’ experiences vary somewhat depending upon the individual facilities in which they are placed. Individual experiences may affect the data. How to interpret the data: The exit survey is used by the faculty to assess whether there are specific knowledge areas or skills for which the students feel as though their preparation is lacking. Changes can be made to strengthen certain content areas, and/or skills as needed. 533571652 Submitted 6-17-08 Page 11 of 18 University of Alaska Anchorage Radiologic Technology Graduation Exit Survey 1 – Poor or low opinion 2 – Below average 3 – Average or acceptable 4 – Above average 5 – Excellent, very high opinion I. Curriculum 1. The program courses are organized appropriately 2. The course content is appropriate for all courses 1 2 3 4 5 II. Laboratory Course Components 1. Lab courses were properly integrated with lecture and clinical courses 2. Examination accurately tested my understanding of the information 3. The instructor presented the information in an appropriate manner 4. The lab was available for practice 5. Sufficient equipment was available for instruction and practice 6. Scheduling of lab sessions was fair & equitable 7. Overall quality of all laboratory courses Didactic Courses 1. Information was provided in a logical manner 2. Examinations occurred at appropriate intervals 3. Examinations accurately tested my understanding of appropriate information 4. The structure of the Clinical Courses provided a positive mechanism that facilitated my learning 5. Overall quality of courses 1 2 3 4 5 III. IV Program Director 1. Availability 2. Teaching ability 3. Administration of program V. Clinical Coordinator 1. Availability 2. Teaching Ability 3. Management of clinical education VI Resources 1. Laboratory facilities 2. Classroom facilities 3. Equipment Quality Selection Quantity VII Overall Rating 1. How would you rate this program overall? 2. How well do you feel the program prepared you for the workforce? 3. Would you recommend this program? 533571652 Submitted 6-17-08 Page 12 of 18 Appendix C: Clinical Competency Evaluation Instrument Measure Description: During the program the student must complete a total of 56 competencies. These competencies are dictated by the American Registry of Radiologic Technologists (ARRT). This instrument asks clinical educators to assess the skill level of the student’s clinical proficiency skills. The proficiency skills are assessed to see if the student can demonstrate information learned in the classroom and apply it to the clinical setting. These competencies are performed on actual patients during the RADT 195A, RADT 195B, RADT 195C, RADT 295A and RADT 295B courses. Factors that affect the collected data: Evaluation abilities of the clinical educator may vary depending upon the individual assessing and facility. Individual experiences may affect the data. Patient condition may also affect the evaluation as some patients are more complicated than others. How to interpret the data: The clinical competency is used by the faculty to assess whether there are specific knowledge areas or skills for which the clinical educators feel as though students’ preparation is lacking. Changes can be made to strengthen certain content areas, and/or skills as needed. 533571652 Submitted 6-17-08 Page 13 of 18 Clinical Competency Evaluation Form Student name________________________________________________________________________ Clinical Site ___________________________________ Pt ID _________________________ Examination ________________________________________Date _____________________ Grading 1 = acceptable 0 = not acceptable N/A = not applicable All items with an asterisk (*) are required to successfully pass the competency. PREPARATION _____ 1. Room cleaned and stocked. _____ 2. Equipment prepared. _____ 3. Hands washed prior to positioning. PATIENT CARE _____4. Introduces self and greets patient. _____5. Explains procedure to the patient and maintains patient privacy. _____6. Obtains a patient history, confirms identity and pregnancy status. _____7. Assists patient using proper body mechanics ____*8. Properly cleans equipment after exam completion. TECHNICAL FACTORS _____ 9. Correctly measures the patient. _____*10. Selects appropriate technical factors and film size. _____*11. Uses markers appropriately. RADIATION PROTECTION _____*12. Closes x-ray room door and vacates unnecessary personnel. _____ 13. Uses gonadal shielding and collimation properly. _____*14. Wears film badge in the proper location. _____*15 Practices personal protection (shielding, distance, etc). _____ 16. Prevents unnecessary repeats. (Qualified radiographer must be present and observe student during all repeats) POSITIONING _____ 17. Uses immobilization devices or positioning aides as needed _____*18. Aligns the CR, IR, and part. Uses appropriate SID. _____*19. Correctly angles CR when required _____ 20. Gives patient correct breathing instructions First year students must satisfactorily complete 16 of 20 items. Second year students must satisfactorily complete 18 of 20 items. Failure to satisfactorily complete items with an asterisk is an automatic failure. SCORE ____________ Evaluator’s Name and Signature_________________________________________________________________________________ Comments_________________________________________________________________________________ __________________________________________________________________________________________ __________________________________________________________________________________________ __________________________________________________________________________________________ 533571652 Submitted 6-17-08 Page 14 of 18 Appendix D: Student Bi-Semester Survey Measure Description: Twice during each semester of clinical courses the students are provided a semester survey which has been completed by the clinical educator.. These surveys are completed at midterm as well as the final portion of the semester. This survey asks clinical educators to assess the student’s skill level in both academic areas, as well as clinical proficiency skills. This instrument is used in the RADT 195A, RADT 195B, RADT 195C, RADT 295A and RADT 295B courses. Students are counseled, and the assessment is reviewed by the student, clinical coordinator (UAA faculty) and clinical educator. Any of the above are encouraged to make comments. Factors that affect the collected data: Students’ experiences vary somewhat depending upon the individual facilities in which they are placed. Experience of the student, as well as the clinical educator, may affect the responses to the survey. How to interpret the data: The semester survey evaluation is used by the faculty to assess whether there are specific knowledge areas or skills for which the clinical educators feel as though the students are lacking. Changes can be made to strengthen certain content areas, and/or skills as needed during each semester. Data is reviewed by the clinical coordinator for the program as well as program director. 533571652 Submitted 6-17-08 Page 15 of 18 UAA Radiology Program Final Clinical Evaluation Survey Student______________________________________________ Date__________________ Clinical Site _________________________________________________________________ Evaluator (s) ________________________________________________________________ Grading. Using the following scale please rate the student’s current level of performance 5= superior – near perfect 3= average 1 = unacceptable 4= above average 2 = below average (needs improvement) ATTENDANCE _____ 1. The student reports to clinic as scheduled. Student is prepared for clinical instruction. _____ 2. The student notifies the Clinical Educator of any delays or absences. PROFESSIONAL CONDUCT _____ 1. The student follows appropriate dress codes, grooming standards, and personal hygiene per program and clinical policy. _____ 2. The student demonstrates appropriate actions toward patients, peers and other health care professionals. _____ 3. The student responds in a positive matter to constructive commentary. COMMUNICATION _____ 1. The student explains all procedures, gives clear direction, and ensures patient understanding. _____ 2. The student listens carefully and follows directions. _____ 3. The student exhibits positive verbal and non verbal communication with patient, physicians, peers and other health care professionals. INITIATIVE _____ 1. The student seems genuinely interested in procedures and will seek to participate in all levels and types of examinations. _____ 2. The student performs duties without being asked. Student uses time in a productive manner. JUDGEMENT/CRITICAL THINKING 533571652 Submitted 6-17-08 Page 16 of 18 _____ 1. The student displays confidence in skills while recognizing limitations. _____ 2. The student identifies the steps necessary to complete a task and does so in a logical manner. _____ 3. The student properly evaluates the patient and makes adjustments for correct positioning. _____4. The student can accept constructive criticism and strives to improve. _____5. The student can adapt protocols to meet various situations and requirements.` OCCUPATIONAL SKILLS _____ 1. The student knows the department protocols and performs the positions properly. _____ 2. The student can correctly formulate technical factors and makes adjustments according to current level of training. _____ 3. The student can discriminate between diagnostic and non-diagnostic radiographs and determine necessary changes. _____ 4. The student implements proper radiation protection for themselves and the patient. _____ 5. The student uses proper universal precautions. _____ 6. The student can complete examinations in a timely manner with few repeats according to the exam difficulty and level of training. PATIENT CARE _____ 1. The student exhibits professionalism, perceives patient needs, and creates a friendly, empathetic, comfortable atmosphere with all patients _____ 2. The student is able to perform exams on patients presented with various difficulties. 533571652 Submitted 6-17-08 Page 17 of 18 EVALUATOR COMMENTS Goal success __________________________________________________________________________________ __________________________________________________________________________________ __________________________________________________________________________________ __________________________________________________________________________________ ______________________________________________________________ Areas of strength and expansion during semester. __________________________________________________________________________________ __________________________________________________________________________________ __________________________________________________________________________________ __________________________________________________________________________________ __________________________________________________________________________________ __________________________________________________________________________________ __________________________________________________________________________________ __________________________________________________ Areas needing improvement and/or improved during semester. ______________________________________________________________________________ ______________________________________________________________________________ ______________________________________________________________________________ ______________________________________________________________________________ ______________________________________________________________________________ ______________________________________________________________________________ ______________________________________________________________________________ General Comments/Suggestions ______________________________________________________________________________ ______________________________________________________________________________ ______________________________________________________________________________ ______________________________________________________________________________ ______________________________________________________________________________ ______________________________________________________________________________ ______________________________________________________________________________ ______________________________________________________________________________ Student’s Signature _____________________________________ Date _______________ Evaluators Signature ____________________________________ Date _______________ 533571652 Submitted 6-17-08 Page 18 of 18