2013 Assessment - Austin Community College

advertisement
Outcomes Assessment Plan
Radiologic Technology Program
Austin Community College
2011-2013
Goal #1: Upon completion of the program, the graduate will satisfactorily demonstrate entry level Clinical Competency Skills.
Desired Outcomes
Measurement Tools
Benchmarks
Time Frame
Person/Group
Results/Action Plan
Responsible
1.1 Students will
1.1 Successful
Enrolled Students will Annually in the Fall
Program Director
94% earned B’s
demonstrate clinical
completion of Clinical average at least a B
Semester after
6% earned C’s
competency.
Education Plan (5
(85%) in their clinical graduation in August
Benchmark not met.
semesters)
education courses.
See attached Action
Plan.
1.2 Level of Clinical
1.2 Employer Survey: Enrolled students will Every two years. Last
Program
No Data Yet for this
Competency as
Question #4:
earn an average score Survey completed in
Director/Faculty
cycle. Survey in 2013
perceived by
“evaluation of
of 4.0 on a scale of 1
Spring 2013.
for 2012 grads met
Employers
technical skills”
– 5 points.
benchmark.
1.3 Rating of
1.3 Employer Survey: Enrolled Students will Every two years. Last
Program
No Data Yet for this
graduate’s education Question #5:
earn an average score Survey completed in
Director/Faculty
cycle. Survey in 2013
as perceived by
“Rating of graduate’s of 4.0 points on a
Spring 2013.
for 2012 grads met
employers.
education as it relates scale of 1 – 5 pts.
benchmark.
to the job?
1.4 Level of Clinical
1.4 Graduate Survey: Graduates will rate
Every two years. Last
Program
No Data Yet for this
Competency as
Question 10:”How
themselves with an
Survey completed in
Director/Faculty
cycle. Survey in 2013
perceived by
would you rate your
average score of at
Spring 2013.
for 2012 grads met
graduates.
technical abilities in
least 3.75 on a 1 – 5
benchmark.
relation to other new point scale.
radiographers”?
1.5 Demonstrate the
1.5. Rating of
Enrolled students will Every Semester for
Program
Students averaged a
positioning skills
positioning skills on
earn a correct rating
Courses: RADR
Director/Faculty
correct rating on 6.9
necessary to achieve
Clinical Competency
on at least 6 of the 7
1360,1361,2460,2461,
of the 7 positioning
a diagnostic
Evaluation Form:
positioning criteria
and 2362
criteria questions.
radiograph.
Questions: 8,9,10,
questions.
Benchmark met.
12,13,14,and 15
Outcomes Assessment Plan, 2011 - 2013
Goal #1 Continued: Upon Completion of the program, the graduate will satisfactorily demonstrate entry level clinical competency.
Desired Outcomes
Measurement Tools
Benchmark
Time Frame
Person/Group
Results/Action Plan
Responsible
1.6 Demonstrate
1.6 Lab Practical
Enrolled first year
In July of every year.
Program Faculty
All First year
competency in Lab
Evaluation Form
students will earn an
students successfully
Practical Testing for
average score of 85%
passed with at least
First Year Students.
or better on lab
an 85%.
Practical Competency
Benchmark Met.
testing.
1.7 Demonstrate
1.7 Lab Practical
Enrolled 2nd Year
In April of every year. Program Faculty
All 2nd Year Students
competency in Lab
Evaluation Form
Students will earn an
successfully passed
Practical Testing for
average score of 85%
with at least an 85%.
2nd Year Students
on lab Practical
Benchmark Met.
Competency testing.
Action Plan for unmet Benchmarks
Outcome 1.1: Successful completion of clinical education plan courses with at least an 85% average by all students.
Action Plan: In review of the scores earned in outcome 1.1, the students that averaged less than 85% did so because of poor scoring on image
analysis and/or grade deductions because of excessive absences. The faculty will address these two issues with the following
recommendations/actions:
#1. Excessive Absences: It is noted that frequently, the students are absent from Clinic more than the program policy permits during any given
semester. Program faculty will address issue by meeting with the students when they reach the allowed limit of absences with a verbal warning
as per the progressive discipline policy, to ensure that they are aware that if they incur more absences, they will have a grade deduction.
Students will be informed via the progressive discipline policy what can occur if they miss excessive absences.
#2.Poor Performance on Image Analysis Evaluations: It is noted that very often the poor performing students claim that they do not know what
to study for when preparing for Image analysis exams. Because this information is very clearly stated in the learning objectives for any particular
semester, the faculty member(s) will address this issue by having the students sign off that they understand the objectives that apply for a
particular image analysis session. A comparison will be made to determine the level of improvement. This will be initiated during the Summer
Semester, 2014.
Outcomes Assessment Plan 2013
Program Goal #2: The Radiography Students will demonstrate problem solving and critical thinking skills in the didactic and clinical
components of the program.
Desired Outcomes
Measurement Tools
Benchmark
Time Frame
Person/Group
Results/Action Plan
Responsible
2.1 Students will
1.2 RADR 1213-Prin
2.1a Students will
Annually in January
Faculty Member(s)
2.1a 100% of the
demonstrate ability
of Imaging I Final
correctly answer at
teaching course.
students answered 3
to evaluate exposure Exam: Items
least 3 of the five
of the 5 questions
parameters to adjust 68,69,71,82, & 89.
final exam questions.
correctly. Benchmark
radiographic quality
met.
factors such as
2.1b RADR 1213-Prin 2.1b Students will
density, contrast,
of Rad Imaging I unit
correctly answer 3 of
2.1b 100% of the
detail, and distortion. 4 Lab Activity on the
the 4 questions on
students correctly
effects of scattered
this lab project.
answered 4 of the 4
radiation.
question in this
benchmark.
Benchmark met.
Continue to monitor.
2.2 Students will
2.2 Clinical
Students will achieve Every Clinical
Faculty Member(s)
2.2 100% of the
demonstrate the
Competency
at least an 80% on
Semester for
and clinical
students earned at
ability to perform
Evaluation form:
portable chest x-rays RADR
coordinator.
least an 80% or
radiographic
Trauma designation
and cross table lateral 1360,1361,2460,
better with trauma
procedures in a
hips.
2461, and 2362
radiography of the
trauma setting.
chest & cross table
hip.
2.3 Students will
2.3 RADR 2205-Prin
Students will achieve Annually, late spring
Faculty Member(s)
2.3 RADR 2205 Lab
demonstrate the
of Rad Imaging 2 lab
at least an 85% on a
semester.
Project. 100% of the
ability to be
project using portable simulated trauma
students scored at
innovative in
x-ray machine and
patient in the
least an 85% on this
performing difficult
whole body phantom program lab with the
lab activity.
simulations in lab
portable x-ray unit.
Benchmark met.
setting.
Continue to monitor
Analysis of Student Learning Outcomes for Goal #2
Goal #2: Problem solving and Critical Thinking Skills
Outcome 2.1: Students will demonstrate ability to revise exposure factors to adjust technical factors. It should be noted that the students are
started on screen film imaging systems early in the program to demonstrate the prime exposure factors and how they influence the radiography
quality. There are two activities that the program uses for this process: The first is a film analysis project which introduces technical parameter
changes and then the resulting image differences are shown. This is done for kVp, mA, Sec., and SID adjustments. In addition to the film analysis
activity, the students are also provided questions that are based on the prime factors. This project does help when the students are introduced
to digital radiography where the control of quality factors is a function of computer image adjustments when the exposure is within the required
exposure index.
Outcome 2.2 and Outcome 2.3: Students will demonstrate the ability to perform radiographic procedures in a trauma setting and demonstrate
innovation to complete difficult portable procedures. To improve that the students are better prepared to perform these procedures on trauma
patients, lab activities using the Program Portable Units will be developed to better help the students be prepared for these two procedures as
well as others such as extremities, cranial work, and spine radiography. Students are assigned to “teams” of several students that initiate the lab
project and work their way through the procedures which will include positioning, selection of image receptor (CR), and processing the image.
Program faculty are present to supervise the activities.
Outcomes Assessment Plan 2013
Goal #3: The Student will demonstrate and practice professional growth and development.
Desired Outcomes
Measurement Tools
Benchmark
Time Frame
Person/Group
responsible
RADR 1309 Faculty
3.1 Students will
document
professional growth
and development by
demonstrating
professionalism and
ethical behavior.
3.1 RADR 1309-Intro
to Radiography & Pt.
Care. Unit I
Assignment:
“Professional and
ethical behavior
assignment”
The students will
score at least an 85%
on this assignment.
The scale is 0 – 100%
Every Fall Semester.
3.2 Student delivers
quality care
regardless of the age,
gender, or patient
condition.
3.2 “Professionalism
Section on
Professional Skills
Development
Evaluation Form.
Question #9
The students will at
least earn a 4.0 on a
scale of 1 – 5 points.
3.3 Students will
demonstrate a
courteous and
respectful attitude
toward patients,
physicians, clinical
personnel, and fellow
students.
3.3 “Professionalism
Section” on
Professional Skills
Development Form.
Question #12
On a scale of 1-5, the
students will earn at
least 4.0 points.
No. of evaluations
Program Faculty
performed per clinical
course:
RADR 1360 – 2
RADR 1361 – 1
RADR 2460 – 2
RADR 2461 – 2
RADR 2362 -1
No. of evaluations
Program Faculty.
Performed per course
RADR 1360 – 2
RADR 1361 - 1
RADR 2460 - 2
RADR 2461 - 2
RADR 2362 – 1
Results/action plan
RADR 1309 Unit I
Assn. on professional
and ethical behavior.
Results: Students
averaged 94.8%.
Benchmark Met:
Faculty will continue
to monitor and vary
assignments.
Results: Students
averaged 4.6 points
on a scale of 0 – 5
points. Benchmark
Met: Will continue to
monitor.
Results: Students
averaged 4.6 points.
Benchmark Met:
Faculty will continue
to monitor situation.
Review
recommended
revisions.
Goal #3: Continued: Student will demonstrate and practice professional growth and development.
Desired Outcomes
Measurement Tools
Benchmark
Time Frame
3.4. Student actively
seeks and
participates in
learning experiences
during clinical
training.
3.4 “Independence
and initiative
assessment in Prof.
Skills development
form. Question 9
On a scale of 1 – 5,
students will earn at
least 4 point on the
evaluation question.
No. of evaluations
conducted per
semester:
RADR 1360 – 2
RADR 1361 - 1
RADR 2460 – 2
RADR 2461 – 2
RADR 2362 - 1
Person/Group
Responsible
Program
Faculty/Program
Director.
Results/Action Plan
Results: Benchmark
Met. Students
averaged a score of
4.9. Faculty will
continue to monitor.
Analysis of Student Learning Outcomes and Plan of Action
Goal #3: Demonstrating Professional Growth and Development.
3.1 Documenting professional growth and development by demonstrating professionalism and ethical behavior.
The score for this cohort of students was almost 3 points less than the group of student in 2012. This is felt to be well within the limits of
acceptability that faculty have established for this item. The learning activity in RADR 1309 appears to be working well in the initial development
of this type of professionalism and ethical behavior. The faculty of the program , especially those that teach in RADR 1309 feel that the current
exercise continues to provide an excellent learning tool. Because the benchmark was met, there is no additional information or action that
needs to be taken at this time.
3.2 Student delivers quality care regardless of the age, gender, or patient condition.
In recent years, our clinical agencies have encouraged the program to strengthen the part of the program that teaches quality patient care.
Because it is very important to the facilities that patients feel that they received “world class patient care”, they want to ensure that the
program is doing everything it can to ensure that this part of the program curriculum is emphasized. The program feels that this aspect of the
program is excellent and promotes quality patient care. The students are evaluated constantly on this particular criteria and the faculty feel that
they understand how important it is to ensure that the patients feel that they received quality patient care. The students are not only evaluated
by the exercise in RADR 1309, but also with their clinical competency evaluations, lab procedures evaluations, professional skills development
evaluations, and also during their lab practical competency evaluations. The program will continue to monitor and vary the exercises used to
help train students.
3.3. Students will demonstrate a courteous and respectful attitude towards patients, clinical personnel, and fellow students
This assessment is performed during every clinical course as indicated in the time frame column during the 5 semesters of clinical education.
This is felt to be adequate because it provides a way to monitor a student’s progress as they go through the program. In the event that a student
receives a low mark in this section, they are counseled to ensure that they need to make progress in the following evaluation. If faculty
advising/counseling does not appear to be working, then the student can be referred to one of the two Health Sciences Counselors for
assistance and guidance. At this writing, it appears that this is a strength of the program and no additional action is necessary to help the student
be in compliance or successful with this requirement.
3.4 Student participation with Learning experiences.
Because this is such vital criteria in the overall success of students, the program faculty emphasize how important this particular activity is. This
helps demonstrate the commitment of the students towards having a successful experience in their clinical education as well as with their
didactic courses. Employers are very interesting in hiring graduates that they felt went above and beyond the normal expectation of a student in
the program. To emphasize the importance of the student demonstrating independence and initiative, the program has brought in employers
from the clinical agencies to explain to the students how important this is to their success in the program as well as improving their success in
finding a job in this tight market. They describe how important it is to not only have excellent technical skills, patient care, but also demonstrate
how important the profession is to them. At this point program faculty feel that this desired outcome in the assessment plan is working well and
no changes at the present time are indicated. The faculty will continue to monitor this important requirement.
Outcomes Assessment Plan, 2013
Goal #4: Upon completion of the program, the graduate will demonstrate satisfactory communication skills
Desired Outcomes
Measurement Tools
Benchmark
Time Frame
Responsible/Party
4.1 enrolled students 4.1 Professional Skills Enrolled Students will This evaluation is
Program Faculty &
will demonstrate
Development
average at least 3.75
performed twice
Program Director
satisfactory
Evaluation.
points on a scale of 1 every clinical
communication skills Communication
– 5 points.
semester in RADR
in clinical courses
Section, questions 161360,1361, 2460,
21.
2461, & 2362.
4.2 Enrolled students 4.2 Evaluation form
Enrolled student will
This evaluation is
Program Faculty &
will demonstrate
for Basic and
communicate
performed multiple
Program Director
satisfactory
Advanced Procedures effectively with
times during
communication skills courses: RADR 1411
simulated patients at procedures courses of
during lab simulation and 2431 Question
least 90% of the time RADR 1411 and 2431.
testing with
#17.
during evaluations.
procedures.
4.3 Enrolled students 4.3 Research and
Enrolled students will This evaluation is
Program Faculty
will demonstrate
Presentation Project
average 85% or
performed every
satisfactory oral
in RADR 2233better on the
Spring semester
presentation skills.
Advanced Med.
combined research
during RADR 2233.
Imaging grade form.
paper and oral
presentation.
4.4 Graduates will
Employer Survey:
Survey results on
The surveys are
Program Faculty or
demonstrate
Section 4:
communication skills completed every two Program Director
satisfactory
Communication
as observed by
years. Will issue
communication skills Question.
Employers will
survey again at the
average at least 4.0
end of 2014.
on a scale of 1 – 5 pts.
Results/action plan.
Benchmark met:
Students averaged
4.09 points. Will
continue to monitor.
Benchmark Met:
For RADR 1411, avg
score was 98%
For RADR 2431, avg
Score was 95.1%.
Will continue to
monitor.
Benchmark Met:
Students averaged
86.4% on this
presentation. Will
continue to monitor
Data not available
Yet for this cohort.
It should be noted
that the most recent
results for the years
2010 – 2012
averaged 4.5 points.
Assessment of Student Learning Outcomes & Plan of Action
Goal #4: Upon Completion of the Program, the graduate will demonstrate satisfactory communication skills.
4.1 Enrolled students will demonstrate satisfactory communication skills in clinical courses.
While the program students met the stated benchmark, it will be important to continue to emphasize that communication with the patient is a
critical component during any procedures that are done. This skill will continue to be addressed and improved in RADR 1309-Intro to
Radiography, RADR 1411 and RADR 2431-Advanced Procedures. It is in these courses where excellent communication skills are introduced,
simulated, and graded. Because the students do not attend clinicals during the first semester, the faculty have the opportunity to inform the
students just how critical good communications skills are. The Program also plans to invite clinical officials that are employers of our graduates
to let them tell the students what exactly they expect from graduates that are employed at their institutions.
4.2 Enrolled students will demonstrate satisfactory communication skills during lab simulation testing with procedures.
The student outcomes did meet the established benchmarks, however the program faculty will continue to monitor and improve the process for
evaluating communication. It should be noted that it is expected and required of students to make sure that they give the patients the correct
instructions such as directions on moving on to and on the x-ray table, describing the procedure to the patient, and clear instructions such as
breathing technique.
4.3 Enrolled students will demonstrate satisfactory oral presentation skills.
During the program, the students are required to do one major presentation in RADR 2233. It is required that the student also have images on
film, poster, or other media to ensure that the message is clear. The students are required to stand in front of the class for this presentation and
to ensure inter-rater reliability, there are at least two faculty members present during the presentations to evaluate the student’s skills.
4.4 Graduates will demonstrate satisfactory communication skills.
Employers were surveyed in early Spring 2013 prior to the graduation of the class of 2013 and it should be noted that their assessment of the
previous graduates communication skills were rated as follows;
44.4% of the raters felt the communication skills were very good.
44.4% of the employers felt the communication skills were good.
11 % of the employers felt the communication skills were average.
The program faculty will continue to monitor and emphasize this important characteristic during clinical counseling sessions that faculty conduct
with each student.
Download