Nursing 201 Course Assessment Report-Spring 2014 Submitted by: Assistant Professor, Nursing

advertisement
Nursing 201 Course Assessment Report-Spring 2014
Submitted by:
L. Jim Bentley, RN, MSED, ANP-C,
Assistant Professor, Nursing
Introduction
1. Nursing 201 is comprised of two sections in the spring PNET[31627]
and NU201X34(31645).
2. 50 students 20 from the first section and 30 from the second. The
course began with 56 students and experienced attrition occurring at
various points due to clinical weakness or following an exam.
It is the third course of four, in a clinical course sequence, which adds a
significant amount of clinical pathophysiologic complexity, multiple patient
clinical experiences, a writing intensive experience and an expectation of
development in all of the learning outcomes.
3. Course Student Learning Outcomes
1.
2.
3.
4.
5.
6.
7.
8.
Professional Behaviors
Communication
Assessment
Clinical Decision Making
Caring Interventions
Teaching & Learning
Collaboration
Managing Care
Each Clinical course evaluates students based on each of the student learning
outcomes and competencies based on them. These evaluations are currently carried
out using multiple-choice exams for the didactic material and clinical observation in
both real life experiential clinical situations and in designed laboratory simulation
scenarios in our virtual hospital laboratory.
The purpose of this assessment of our course is to evaluate whether or not students
leave our course with an enhanced ability to think critically and quantify it through
use of a rubric, for certain key Learning Outcomes and their equivalent General
Education Objective.
General Education Objective
Course Learning Outcomes
Use analytical reasoning to identify
issues or problems and evaluate
evidence in order to make
informed decisions.
Integrate critical thinking
strategies, nursing course and
general education course content,
and evidence-based best practice
information to plan, implement and
evaluate safe, effective, quality care
for adult and maternal/child
client(s) with complex medical
conditions across various
healthcare settings.
Competencies
a. Analyze information from various sources using the nursing process and critical thinking strategies to
formulate clinical judgments that result in safe, effective care for the adult and maternal/child clients.
b. Utilize critical thinking, evidence-based research and the nursing process to analyze physiological,
psychosocial, reproductive and/or developmental needs of the adult and maternal-child clients, in order
to achieve positive outcomes.
c. Integrate principles of client safety and quality improvements with adult and maternal/child clients
utilizing the National Patient Safety Goals and adhering to hospital policy/protocol. Utilize the same
safety principles to prevent injury to self and other healthcare providers.
Didactic Assessment Plan:
4. I have evaluated three high-stakes exams worth 60% of the total grade to determine the student’s
success in answering questions designed to assess critical thinking. One exam covered Obstetrics,
one covered Cardiovascular Health and one covered Diabetes and other Endocrine This will be
done by examining those questions designated as analytical or involving synthesis of data and
labeled as “clinical decision making” by the developer of the test question and labeled as such on
the exam blueprint. Rubric Attached!
5. All students took the exams using Scantron answer cards and their grades are assessed by a
computer program called Par-Score, which provides grade distribution data like median, mean,
range, KR20 and point bi-serials and the percentage of students who answer each question
correctly. The ELOA Benchmark of >70% total students’ answering each question correctly
was chosen since it’s near the passing grade of 74.
6. I found a total of 38 total questions classified as “Clinical Decision Making” in three exams,
and measured the number and percentage of those questions answered correctly by more than
70% of the students. The questions were then arranged in order of the lowest percentile success
rate (< 60%) to the highest percentile (> 80%-Satisfactory), using a four-grade scale rubric. The
rubric set a satisfactory ELOA benchmark of 70% (70-79%- Fair), or above of students answering
the clinical thinking questions correctly (Passing grade is 74%). Further I mark 70% as the ELOA
and satisfactory number of Questions with satisfactory group responses. The ELOA was not met
with all questions as a whole (60.5%) or in 2/3 exams. The cardiac exam demonstrated the
lowest scores as is typical. Potential causes could be; test questions are too hard, this is a
weak cohort, or material was not presented or learned well in this a Pilot “PNET Course”
 In addition each question is examined for it’s P-value and it’s spread across all the distractor
choices and if found to be statistically unreliable or not valid it was not counted in the assessment.
 Finally this assessment should be used to evaluate multiple similar sections of other student
cohorts to examine consistent trends before making any drastic changes in response to this
assessment. This particular cohort has been weak throughout its history with a significant
attrition in both NU-101 & NU-102.

If students are consistently weak in this area Instructors should re-evaluate the questions used or
provide students with more instruction or practice in the strategies to use to improve their
performance on these type of questions.
7. If necessary I can provide samples of, the Exam Blueprint – Key which identifies all the “Clinical
Decision Making” Questions, as well as the Exam Item Analysis Data Sheet.
8. The data will be collected throughout the Spring 14 semester.
Queensborough Community College
Nursing 201 Exam
Critical Thinking Assessment Tool
Course: NU-201
Term / Year: Spring 2014
This rubric will be used to measure the # correct student responses for each exam question labeled as a
“Clinical Decision Question”.
1. The ELOA Benchmark of >70% total students’ answering each question correctly was chosen since
it’s near the passing grade of 74.
2. The total number of questions answered correctly should again be greater than 70%
demonstrating successful management of these questions which demonstrate critical thinking.
Unsatisfactory
Less than
Satisfactory
Fair
Satisfactory
Exam 1 OB
< 60% score
n=0
61-69 % score
n=3
70-79% score
n=0
Exam 2 CV
< 60% score
n=4
61-69 % score
n=2
70-79% score
n=2
Exam 3
Endo/GU/Onc
< 60% score
n=3
61-69 % score
n=3
70-79% score
n=1
7
8
> 80%
score
n=8
> 80%
score
n=3
> 80%
score
n=9
20
Total Scores in
each category
3
23/38 = 60.5%
Goal 70% score in
Fair or Satisfactory
category not met
% Questions
Answered
Correct
73%
45%
62.5%
38 total clinical
decision
questions
Comments: The ELOA was not met with all questions as a whole (60.5%) or in 2/3 exams. The cardiac
exam demonstrated the lowest scores as is typical. Potential causes could be; test questions are too hard,
this is a weak cohort, or material was not presented or learned well in this a Pilot “PNET Course”. Prior to
accepting any cause other semesters should be compared. This particular cohort has been weak
throughout its history with a significant attrition in both NU-101 & NU-102.
Download