ATI Pulse: How to Flatline the Competition What is it? ATI Pulse is a

advertisement
ATI Pulse: How to Flatline the Competition
What is it?
ATI Pulse is a new reporting interface that is designed to follow a nursing student throughout the
duration of his or her academic career and provides individual students with a predicted probability of
passing the NCLEX-RN or -PN exam, associated risk categories, and highlight remediation needs.
In essence, there are two main things ATI Pulse claims to do:
1. Provides early prediction of possible NCLEX success. It does this by taking the student’s scores
on the TEAS and various content mastery exams, comparing those scores to class and national
averages, and generating a prediction score that adjusts over time as the student takes more
exams.
2. Provides a usage report of recommended ATI remediation tools, including tutorial modules,
questions answered, time on task, etc.
What are its weaknesses?

There is no peer-reviewed research to support any of ATI’s predictive claims related to this, or
any other ATI testing product. Unless the product can support the scrutiny of objective research,
these are purely marketing claims made by ATI supported by ATI’s internal product developers.
Only HESI has more than a decade’s worth of peer-reviewed research to support its claims of
developing valid and reliable exams that are predictive of NCLEX success. Refer to the 10th
Validity study that just published!










According to an ATI webinar, the Pulse score only “predicts” a student’s score on the ATI
Comprehensive Predictor Exam, not the actual NCLEX. Again, there is no peer-reviewed
research linking a student’s score on the ATI Comp Predictor and the actual NCLEX.
ATI includes the TEAS V entrance exam scores as part of the Pulse dashboard; however, by their
own admission, ATI does not have a model for predicting Comprehensive Predictor Exam
results based on TEAS V score.
The NCLEX exam is built around Client Needs categories, but ATI Pulse measures subject area
exams only (Fundamentals, Mental Health, Maternity, and so on). ATI does not share their
methodology for generating the predictor scores, which raises legitimate questions, such as –
how can a 75% score on a Mental Health exam be demonstrably linked to overall future NCLEX
test results?
ATI Pulse is only available to complete partnership accounts for free; for other customers who
are only using some exams it is an add-on feature. Additionally, schools that don’t use all of
ATI’s exams will get an incomplete picture. From their own website: “ATI Pulse model’s
accuracy is negatively impacted by greater amounts of missing data.”
ATI Pulse only provides a birds-eye view of the exam data (e.g., overall score on the
Fundamentals exam); it does not provide a meaningful breakdown of strengths and
weaknesses in subcategories. HESI reports provide a robust analysis at all levels to ensure that
educators and students are focused on the most important areas of learning – including specialty
and sub-specialty areas, Client Needs, Nursing Process, Concepts, QSEN competencies, NLN
competencies, and more.
ATI Pulse reports on first-time test results only – scores on re-tests are not incorporated,
making it impossible to tell if a student’s additional study efforts have any impact on their
eventual likelihood of passing the NCLEX.
The Pulse usage reports of remediation materials have no measurable link to improving
student outcomes. The recommended usage of ATI tutorials and practice questions are all preset by ATI, cannot be modified by schools, and only provide the broadest recommendations
possible. For example, if a student scored X% on a Fundamentals exam, that student is then
expected to spend 3 hours remediating on Fundamentals, but it does not provide any guidance
as to what specific content area to focus their study.
While the usage report measures student activity on material ATI deems necessary, there is no
good way to view if that material is actually helping as they do not assign a ‘predictor score’ to
versions other than the first. The truest way to see if remediation material is working is to
analyze scoring on the consequent versions of the exams after remediating.
Trending data &/or performance in ATI Pulse seems to be difficult as there is seemingly no
‘reporting tool’, rather just a gallery of test results. There doesn’t seem to be a way to compare
like exams (including sub-topics & nursing concepts) across time.
ATI uses outdated, third-party content as the source for their remediation, and they do not
have supporting products like EAQ or HESI Case Studies that provide more rigorous, realistic
practice for Nursing students preparing for the NCLEX. Additionally, there is no evidence that
time on task can predict or improve NCLEX pass rates.

ATI Pulse does have a ‘print’ function available. This allows faculty to save as a pdf or to print of
scoring results. However, Pdf’s are locked down and have not manipulation capabilities. There
is no mention of being able to export into excel. The ability to export allows our faculty to
adjust any scoring that may be specific of individual to their cohort / program. It also allows
faculty to sort data based upon concepts / scores / students to allow for easy evaluation.
Download