ATI Pulse: How to Flatline the Competition What is it? ATI Pulse is a new reporting interface that is designed to follow a nursing student throughout the duration of his or her academic career and provides individual students with a predicted probability of passing the NCLEX-RN or -PN exam, associated risk categories, and highlight remediation needs. In essence, there are two main things ATI Pulse claims to do: 1. Provides early prediction of possible NCLEX success. It does this by taking the student’s scores on the TEAS and various content mastery exams, comparing those scores to class and national averages, and generating a prediction score that adjusts over time as the student takes more exams. 2. Provides a usage report of recommended ATI remediation tools, including tutorial modules, questions answered, time on task, etc. What are its weaknesses? There is no peer-reviewed research to support any of ATI’s predictive claims related to this, or any other ATI testing product. Unless the product can support the scrutiny of objective research, these are purely marketing claims made by ATI supported by ATI’s internal product developers. Only HESI has more than a decade’s worth of peer-reviewed research to support its claims of developing valid and reliable exams that are predictive of NCLEX success. Refer to the 10th Validity study that just published! According to an ATI webinar, the Pulse score only “predicts” a student’s score on the ATI Comprehensive Predictor Exam, not the actual NCLEX. Again, there is no peer-reviewed research linking a student’s score on the ATI Comp Predictor and the actual NCLEX. ATI includes the TEAS V entrance exam scores as part of the Pulse dashboard; however, by their own admission, ATI does not have a model for predicting Comprehensive Predictor Exam results based on TEAS V score. The NCLEX exam is built around Client Needs categories, but ATI Pulse measures subject area exams only (Fundamentals, Mental Health, Maternity, and so on). ATI does not share their methodology for generating the predictor scores, which raises legitimate questions, such as – how can a 75% score on a Mental Health exam be demonstrably linked to overall future NCLEX test results? ATI Pulse is only available to complete partnership accounts for free; for other customers who are only using some exams it is an add-on feature. Additionally, schools that don’t use all of ATI’s exams will get an incomplete picture. From their own website: “ATI Pulse model’s accuracy is negatively impacted by greater amounts of missing data.” ATI Pulse only provides a birds-eye view of the exam data (e.g., overall score on the Fundamentals exam); it does not provide a meaningful breakdown of strengths and weaknesses in subcategories. HESI reports provide a robust analysis at all levels to ensure that educators and students are focused on the most important areas of learning – including specialty and sub-specialty areas, Client Needs, Nursing Process, Concepts, QSEN competencies, NLN competencies, and more. ATI Pulse reports on first-time test results only – scores on re-tests are not incorporated, making it impossible to tell if a student’s additional study efforts have any impact on their eventual likelihood of passing the NCLEX. The Pulse usage reports of remediation materials have no measurable link to improving student outcomes. The recommended usage of ATI tutorials and practice questions are all preset by ATI, cannot be modified by schools, and only provide the broadest recommendations possible. For example, if a student scored X% on a Fundamentals exam, that student is then expected to spend 3 hours remediating on Fundamentals, but it does not provide any guidance as to what specific content area to focus their study. While the usage report measures student activity on material ATI deems necessary, there is no good way to view if that material is actually helping as they do not assign a ‘predictor score’ to versions other than the first. The truest way to see if remediation material is working is to analyze scoring on the consequent versions of the exams after remediating. Trending data &/or performance in ATI Pulse seems to be difficult as there is seemingly no ‘reporting tool’, rather just a gallery of test results. There doesn’t seem to be a way to compare like exams (including sub-topics & nursing concepts) across time. ATI uses outdated, third-party content as the source for their remediation, and they do not have supporting products like EAQ or HESI Case Studies that provide more rigorous, realistic practice for Nursing students preparing for the NCLEX. Additionally, there is no evidence that time on task can predict or improve NCLEX pass rates. ATI Pulse does have a ‘print’ function available. This allows faculty to save as a pdf or to print of scoring results. However, Pdf’s are locked down and have not manipulation capabilities. There is no mention of being able to export into excel. The ability to export allows our faculty to adjust any scoring that may be specific of individual to their cohort / program. It also allows faculty to sort data based upon concepts / scores / students to allow for easy evaluation.