Outcomes Assessment Plan Radiologic Technology Program Austin Community College 2011-2013 Goal #1: Upon completion of the program, the graduate will satisfactorily demonstrate entry level Clinical Competency Skills. Desired Outcomes Measurement Tools Benchmarks Time Frame Person/Group Results/Action Plan Responsible 1.1 Students will 1.1 Successful Enrolled Students will Annually in the Fall Program Director 94% earned B’s demonstrate clinical completion of Clinical average at least a B Semester after 6% earned C’s competency. Education Plan (5 (85%) in their clinical graduation in August Benchmark not met. semesters) education courses. See attached Action Plan. 1.2 Level of Clinical 1.2 Employer Survey: Enrolled students will Every two years. Last Program No Data Yet for this Competency as Question #4: earn an average score Survey completed in Director/Faculty cycle. Survey in 2013 perceived by “evaluation of of 4.0 on a scale of 1 Spring 2013. for 2012 grads met Employers technical skills” – 5 points. benchmark. 1.3 Rating of 1.3 Employer Survey: Enrolled Students will Every two years. Last Program No Data Yet for this graduate’s education Question #5: earn an average score Survey completed in Director/Faculty cycle. Survey in 2013 as perceived by “Rating of graduate’s of 4.0 points on a Spring 2013. for 2012 grads met employers. education as it relates scale of 1 – 5 pts. benchmark. to the job? 1.4 Level of Clinical 1.4 Graduate Survey: Graduates will rate Every two years. Last Program No Data Yet for this Competency as Question 10:”How themselves with an Survey completed in Director/Faculty cycle. Survey in 2013 perceived by would you rate your average score of at Spring 2013. for 2012 grads met graduates. technical abilities in least 3.75 on a 1 – 5 benchmark. relation to other new point scale. radiographers”? 1.5 Demonstrate the 1.5. Rating of Enrolled students will Every Semester for Program Students averaged a positioning skills positioning skills on earn a correct rating Courses: RADR Director/Faculty correct rating on 6.9 necessary to achieve Clinical Competency on at least 6 of the 7 1360,1361,2460,2461, of the 7 positioning a diagnostic Evaluation Form: positioning criteria and 2362 criteria questions. radiograph. Questions: 8,9,10, questions. Benchmark met. 12,13,14,and 15 Outcomes Assessment Plan, 2011 - 2013 Goal #1 Continued: Upon Completion of the program, the graduate will satisfactorily demonstrate entry level clinical competency. Desired Outcomes Measurement Tools Benchmark Time Frame Person/Group Results/Action Plan Responsible 1.6 Demonstrate 1.6 Lab Practical Enrolled first year In July of every year. Program Faculty All First year competency in Lab Evaluation Form students will earn an students successfully Practical Testing for average score of 85% passed with at least First Year Students. or better on lab an 85%. Practical Competency Benchmark Met. testing. 1.7 Demonstrate 1.7 Lab Practical Enrolled 2nd Year In April of every year. Program Faculty All 2nd Year Students competency in Lab Evaluation Form Students will earn an successfully passed Practical Testing for average score of 85% with at least an 85%. 2nd Year Students on lab Practical Benchmark Met. Competency testing. Action Plan for unmet Benchmarks Outcome 1.1: Successful completion of clinical education plan courses with at least an 85% average by all students. Action Plan: In review of the scores earned in outcome 1.1, the students that averaged less than 85% did so because of poor scoring on image analysis and/or grade deductions because of excessive absences. The faculty will address these two issues with the following recommendations/actions: #1. Excessive Absences: It is noted that frequently, the students are absent from Clinic more than the program policy permits during any given semester. Program faculty will address issue by meeting with the students when they reach the allowed limit of absences with a verbal warning as per the progressive discipline policy, to ensure that they are aware that if they incur more absences, they will have a grade deduction. Students will be informed via the progressive discipline policy what can occur if they miss excessive absences. #2.Poor Performance on Image Analysis Evaluations: It is noted that very often the poor performing students claim that they do not know what to study for when preparing for Image analysis exams. Because this information is very clearly stated in the learning objectives for any particular semester, the faculty member(s) will address this issue by having the students sign off that they understand the objectives that apply for a particular image analysis session. A comparison will be made to determine the level of improvement. This will be initiated during the Summer Semester, 2014. Outcomes Assessment Plan 2013 Program Goal #2: The Radiography Students will demonstrate problem solving and critical thinking skills in the didactic and clinical components of the program. Desired Outcomes Measurement Tools Benchmark Time Frame Person/Group Results/Action Plan Responsible 2.1 Students will 1.2 RADR 1213-Prin 2.1a Students will Annually in January Faculty Member(s) 2.1a 100% of the demonstrate ability of Imaging I Final correctly answer at teaching course. students answered 3 to evaluate exposure Exam: Items least 3 of the five of the 5 questions parameters to adjust 68,69,71,82, & 89. final exam questions. correctly. Benchmark radiographic quality met. factors such as 2.1b RADR 1213-Prin 2.1b Students will density, contrast, of Rad Imaging I unit correctly answer 3 of 2.1b 100% of the detail, and distortion. 4 Lab Activity on the the 4 questions on students correctly effects of scattered this lab project. answered 4 of the 4 radiation. question in this benchmark. Benchmark met. Continue to monitor. 2.2 Students will 2.2 Clinical Students will achieve Every Clinical Faculty Member(s) 2.2 100% of the demonstrate the Competency at least an 80% on Semester for and clinical students earned at ability to perform Evaluation form: portable chest x-rays RADR coordinator. least an 80% or radiographic Trauma designation and cross table lateral 1360,1361,2460, better with trauma procedures in a hips. 2461, and 2362 radiography of the trauma setting. chest & cross table hip. 2.3 Students will 2.3 RADR 2205-Prin Students will achieve Annually, late spring Faculty Member(s) 2.3 RADR 2205 Lab demonstrate the of Rad Imaging 2 lab at least an 85% on a semester. Project. 100% of the ability to be project using portable simulated trauma students scored at innovative in x-ray machine and patient in the least an 85% on this performing difficult whole body phantom program lab with the lab activity. simulations in lab portable x-ray unit. Benchmark met. setting. Continue to monitor Analysis of Student Learning Outcomes for Goal #2 Goal #2: Problem solving and Critical Thinking Skills Outcome 2.1: Students will demonstrate ability to revise exposure factors to adjust technical factors. It should be noted that the students are started on screen film imaging systems early in the program to demonstrate the prime exposure factors and how they influence the radiography quality. There are two activities that the program uses for this process: The first is a film analysis project which introduces technical parameter changes and then the resulting image differences are shown. This is done for kVp, mA, Sec., and SID adjustments. In addition to the film analysis activity, the students are also provided questions that are based on the prime factors. This project does help when the students are introduced to digital radiography where the control of quality factors is a function of computer image adjustments when the exposure is within the required exposure index. Outcome 2.2 and Outcome 2.3: Students will demonstrate the ability to perform radiographic procedures in a trauma setting and demonstrate innovation to complete difficult portable procedures. To improve that the students are better prepared to perform these procedures on trauma patients, lab activities using the Program Portable Units will be developed to better help the students be prepared for these two procedures as well as others such as extremities, cranial work, and spine radiography. Students are assigned to “teams” of several students that initiate the lab project and work their way through the procedures which will include positioning, selection of image receptor (CR), and processing the image. Program faculty are present to supervise the activities. Outcomes Assessment Plan 2013 Goal #3: The Student will demonstrate and practice professional growth and development. Desired Outcomes Measurement Tools Benchmark Time Frame Person/Group responsible RADR 1309 Faculty 3.1 Students will document professional growth and development by demonstrating professionalism and ethical behavior. 3.1 RADR 1309-Intro to Radiography & Pt. Care. Unit I Assignment: “Professional and ethical behavior assignment” The students will score at least an 85% on this assignment. The scale is 0 – 100% Every Fall Semester. 3.2 Student delivers quality care regardless of the age, gender, or patient condition. 3.2 “Professionalism Section on Professional Skills Development Evaluation Form. Question #9 The students will at least earn a 4.0 on a scale of 1 – 5 points. 3.3 Students will demonstrate a courteous and respectful attitude toward patients, physicians, clinical personnel, and fellow students. 3.3 “Professionalism Section” on Professional Skills Development Form. Question #12 On a scale of 1-5, the students will earn at least 4.0 points. No. of evaluations Program Faculty performed per clinical course: RADR 1360 – 2 RADR 1361 – 1 RADR 2460 – 2 RADR 2461 – 2 RADR 2362 -1 No. of evaluations Program Faculty. Performed per course RADR 1360 – 2 RADR 1361 - 1 RADR 2460 - 2 RADR 2461 - 2 RADR 2362 – 1 Results/action plan RADR 1309 Unit I Assn. on professional and ethical behavior. Results: Students averaged 94.8%. Benchmark Met: Faculty will continue to monitor and vary assignments. Results: Students averaged 4.6 points on a scale of 0 – 5 points. Benchmark Met: Will continue to monitor. Results: Students averaged 4.6 points. Benchmark Met: Faculty will continue to monitor situation. Review recommended revisions. Goal #3: Continued: Student will demonstrate and practice professional growth and development. Desired Outcomes Measurement Tools Benchmark Time Frame 3.4. Student actively seeks and participates in learning experiences during clinical training. 3.4 “Independence and initiative assessment in Prof. Skills development form. Question 9 On a scale of 1 – 5, students will earn at least 4 point on the evaluation question. No. of evaluations conducted per semester: RADR 1360 – 2 RADR 1361 - 1 RADR 2460 – 2 RADR 2461 – 2 RADR 2362 - 1 Person/Group Responsible Program Faculty/Program Director. Results/Action Plan Results: Benchmark Met. Students averaged a score of 4.9. Faculty will continue to monitor. Analysis of Student Learning Outcomes and Plan of Action Goal #3: Demonstrating Professional Growth and Development. 3.1 Documenting professional growth and development by demonstrating professionalism and ethical behavior. The score for this cohort of students was almost 3 points less than the group of student in 2012. This is felt to be well within the limits of acceptability that faculty have established for this item. The learning activity in RADR 1309 appears to be working well in the initial development of this type of professionalism and ethical behavior. The faculty of the program , especially those that teach in RADR 1309 feel that the current exercise continues to provide an excellent learning tool. Because the benchmark was met, there is no additional information or action that needs to be taken at this time. 3.2 Student delivers quality care regardless of the age, gender, or patient condition. In recent years, our clinical agencies have encouraged the program to strengthen the part of the program that teaches quality patient care. Because it is very important to the facilities that patients feel that they received “world class patient care”, they want to ensure that the program is doing everything it can to ensure that this part of the program curriculum is emphasized. The program feels that this aspect of the program is excellent and promotes quality patient care. The students are evaluated constantly on this particular criteria and the faculty feel that they understand how important it is to ensure that the patients feel that they received quality patient care. The students are not only evaluated by the exercise in RADR 1309, but also with their clinical competency evaluations, lab procedures evaluations, professional skills development evaluations, and also during their lab practical competency evaluations. The program will continue to monitor and vary the exercises used to help train students. 3.3. Students will demonstrate a courteous and respectful attitude towards patients, clinical personnel, and fellow students This assessment is performed during every clinical course as indicated in the time frame column during the 5 semesters of clinical education. This is felt to be adequate because it provides a way to monitor a student’s progress as they go through the program. In the event that a student receives a low mark in this section, they are counseled to ensure that they need to make progress in the following evaluation. If faculty advising/counseling does not appear to be working, then the student can be referred to one of the two Health Sciences Counselors for assistance and guidance. At this writing, it appears that this is a strength of the program and no additional action is necessary to help the student be in compliance or successful with this requirement. 3.4 Student participation with Learning experiences. Because this is such vital criteria in the overall success of students, the program faculty emphasize how important this particular activity is. This helps demonstrate the commitment of the students towards having a successful experience in their clinical education as well as with their didactic courses. Employers are very interesting in hiring graduates that they felt went above and beyond the normal expectation of a student in the program. To emphasize the importance of the student demonstrating independence and initiative, the program has brought in employers from the clinical agencies to explain to the students how important this is to their success in the program as well as improving their success in finding a job in this tight market. They describe how important it is to not only have excellent technical skills, patient care, but also demonstrate how important the profession is to them. At this point program faculty feel that this desired outcome in the assessment plan is working well and no changes at the present time are indicated. The faculty will continue to monitor this important requirement. Outcomes Assessment Plan, 2013 Goal #4: Upon completion of the program, the graduate will demonstrate satisfactory communication skills Desired Outcomes Measurement Tools Benchmark Time Frame Responsible/Party 4.1 enrolled students 4.1 Professional Skills Enrolled Students will This evaluation is Program Faculty & will demonstrate Development average at least 3.75 performed twice Program Director satisfactory Evaluation. points on a scale of 1 every clinical communication skills Communication – 5 points. semester in RADR in clinical courses Section, questions 161360,1361, 2460, 21. 2461, & 2362. 4.2 Enrolled students 4.2 Evaluation form Enrolled student will This evaluation is Program Faculty & will demonstrate for Basic and communicate performed multiple Program Director satisfactory Advanced Procedures effectively with times during communication skills courses: RADR 1411 simulated patients at procedures courses of during lab simulation and 2431 Question least 90% of the time RADR 1411 and 2431. testing with #17. during evaluations. procedures. 4.3 Enrolled students 4.3 Research and Enrolled students will This evaluation is Program Faculty will demonstrate Presentation Project average 85% or performed every satisfactory oral in RADR 2233better on the Spring semester presentation skills. Advanced Med. combined research during RADR 2233. Imaging grade form. paper and oral presentation. 4.4 Graduates will Employer Survey: Survey results on The surveys are Program Faculty or demonstrate Section 4: communication skills completed every two Program Director satisfactory Communication as observed by years. Will issue communication skills Question. Employers will survey again at the average at least 4.0 end of 2014. on a scale of 1 – 5 pts. Results/action plan. Benchmark met: Students averaged 4.09 points. Will continue to monitor. Benchmark Met: For RADR 1411, avg score was 98% For RADR 2431, avg Score was 95.1%. Will continue to monitor. Benchmark Met: Students averaged 86.4% on this presentation. Will continue to monitor Data not available Yet for this cohort. It should be noted that the most recent results for the years 2010 – 2012 averaged 4.5 points. Assessment of Student Learning Outcomes & Plan of Action Goal #4: Upon Completion of the Program, the graduate will demonstrate satisfactory communication skills. 4.1 Enrolled students will demonstrate satisfactory communication skills in clinical courses. While the program students met the stated benchmark, it will be important to continue to emphasize that communication with the patient is a critical component during any procedures that are done. This skill will continue to be addressed and improved in RADR 1309-Intro to Radiography, RADR 1411 and RADR 2431-Advanced Procedures. It is in these courses where excellent communication skills are introduced, simulated, and graded. Because the students do not attend clinicals during the first semester, the faculty have the opportunity to inform the students just how critical good communications skills are. The Program also plans to invite clinical officials that are employers of our graduates to let them tell the students what exactly they expect from graduates that are employed at their institutions. 4.2 Enrolled students will demonstrate satisfactory communication skills during lab simulation testing with procedures. The student outcomes did meet the established benchmarks, however the program faculty will continue to monitor and improve the process for evaluating communication. It should be noted that it is expected and required of students to make sure that they give the patients the correct instructions such as directions on moving on to and on the x-ray table, describing the procedure to the patient, and clear instructions such as breathing technique. 4.3 Enrolled students will demonstrate satisfactory oral presentation skills. During the program, the students are required to do one major presentation in RADR 2233. It is required that the student also have images on film, poster, or other media to ensure that the message is clear. The students are required to stand in front of the class for this presentation and to ensure inter-rater reliability, there are at least two faculty members present during the presentations to evaluate the student’s skills. 4.4 Graduates will demonstrate satisfactory communication skills. Employers were surveyed in early Spring 2013 prior to the graduation of the class of 2013 and it should be noted that their assessment of the previous graduates communication skills were rated as follows; 44.4% of the raters felt the communication skills were very good. 44.4% of the employers felt the communication skills were good. 11 % of the employers felt the communication skills were average. The program faculty will continue to monitor and emphasize this important characteristic during clinical counseling sessions that faculty conduct with each student.