Becoming an expert consumer of Medical Statistics

advertisement
FPIN Journal Club
DIAGNOSTIC STUDY WORKSHEET
SPEAKER NOTES
Article: Pulse oximetry for newborns: Should it be routine?
Original Article Citation: Ewer AK, Middleton LJ, Furmston AT, Bhoyar A, Daniels JP,
Thangaratinam S, Deeks JJ, Khan KS; PulseOx Study Group. Pulse oximetry screening for
congenital heart defects in newborn infants (PulseOx): a test accuracy study. Lancet.
2011;378:785-794.
Author: Corey Lyon, MD – University of Colorado, Department of Family Medicine
1. What question did the study attempt to answer?
Patients – Newborn infants >34 weeks
Intervention – Pulse oximetry on right hand and either foot within 24 hours of delivery
Comparison – Composite of echocardiogram and follow up if pulse oximetry <95%
Outcome – critical or major heart defects.
Did the study address an appropriate and clearly focused question
Yes
No
----What is the accuracy of pulse oximetry for screening major congenital heart defects in
asymptomatic newborn babies----2. Determining Relevance:
a. Is the diagnostic test feasible and common to your practice?
Yes
No
--- This test is readily available in the hospital setting and would be very low cost--b. Is the proportion of patients with the target illness comparable
to the patient group seen by family physicians?
Yes
No
---- Definitely relevant, because FPs care for newborns.--c. Did the authors study a clinically meaningful
Yes
No
and/or a patient oriented outcome?
--- Yes, many FPs care for newborns in the hospital setting and early detection of
congenital heart disease could elicit a promp referral in the hospital setting.---
3. Determining Validity:
a. What test is being evaluated
Pulse oximetry with hypoxemia: described as a pulse ox <95% in either the baby's hand or
foot. The study stated that these parameters were chosen because in prior studies higher
thresholds were used and treatable disorders were missed.
b. What is the reference standard with which the test being evaluated is compared?
Echo and follow-up were used to identify immediate- and late-presenting congenital
heart defects.
If SaO2 <95% and abnormal clinical exam, the newborn underwent echo. If pulse ox
<95% and normal clinical exam, repeat pulse ox in 1-2 hours; if still <95%, the newborn
underwent echo. The echo and pulse ox were done within 72 hours of each other.
c. The test and reference standard are measured
independently (blind) of each other?
Yes
No
Unclear
--- Echo and follow-up were used to identify immediate- and late-presenting
congenital heart defects.--d. Did the patient sample include an appropriate
spectrum of patients to whom the diagnostic test will be
applied in clinical practice?
Yes
No
Unclear
---Newborn babies--e. Patients for testing are selected either as a consecutive
series or randomly, from a clearly defined study
Yes
No
Unclear
--- Asymptomatic NB infants >34 weeks were recruited prospectively and included NB infants
in whom congenital heart defects were suspected antenatally after ultrasound.--f. Results are reported for all patients that are entered
into the study
Yes
No
Unclear
4. What are the results?
---Of 20,055 newborns screened, 53 had major congenital heart disease (24 critical, 29
serious). The prevalence was 2.6 per 1000 live births.(53/20,055 = 0.0026 = 2.6 per 1000 live
births)--a. What is the estimated sensitivity of the test being evaluated? (state 95% CI)
Sensitivity = proportion of results in patients with the disease that are correctly identified by the
new test; In other words, a sensitive test has very few false negatives:
Sensitivity of pulse ox was 75% (95% confidence interval [CI], 53.29-90.23) for critical cases
and 49.06% (95% CI, 35.02-63.16) for all major congenital heart defects.
b. What is the estimated specificity of the test being evaluated (state 95% CI)
Specificity = proportion of results in patients without the disease that are correctly identified by
the new test; In other words, a specific test has very few false positives
The specificity of pulse ox for critical cases was 99.12% (95% CI, 98.98-99.24) for critical cases
and 99.16% (95% CI, 99.02-99.28) for all major congenital heart defects).
***Teaching point: Likelihood ratios:
These ratios tell you how much the odds of a disease increase when a test is positive (LR+) or
how much the odds of a disease decrease when a test is negative (LR-)
- Likelihood ratios are independent of prevalence
- Can be calculated from the sensitivity and specificity (formulas below)
- Positive Likelihood ratios – How likely is the disease present if a test is positive
o It should be > 1, the higher the better
o LR + > 10 is an ideal test
o LR+ < 2 is no change
- Negative Likelihood ratios – How likely is the disease not present with a negative
test
o It should be < 1, the lower the better
o LR- < 0.1 is an ideal test
o LR- > 0.5 is no change
c. What are the likelihood ratios for the test being evaluated?
LR+ = sens / (1-spec)
- LR+ > 10 indicates a large change in likelihood, < 2 indicates no change in likelihood
LR+ = 0.75/ (1-0.99) = 75 for critical cases
LR+ = 0.49/(1-0.99) = 49 for all major cardiac defects
LR− = (1-sens) / spec
- LR− < 0.1 indicates a large change in likelihood, > 0.5 indicates no change in likelihood
LR− = (1-0.75)/0.99 = 0.25 for critical cases
LR− = (1-0.49/0.99) = 0.51 for all major critical cases
----Pulse oximetry identifies cases of critical congenital heart disease; early detection is an
additional advantage
The authors estimate that in a population of 100,000 newborns, approx 120 would have
critical CHD and 90 of those 120 would be detected by pulse oximetry. 843 false positives –
You would need 10 echos to detect one patient with critical CHD--5. Applying the evidence
a. Will the results help me in caring for my patients
Yes
-- FPs care for newborns --b. If the findings are valid and relevant, will this change
your current practice?
Yes
c. Is the change in practice something that can be done in
a medical care setting of a family physician?
Yes
d. Can the results be implemented?
Yes
--- Pulse oximetry is inexpensive, and non-invasive
e. Are there any barriers to immediate implementation?
Yes
--- Echocardiography may not be readily available; early d/c may lead to earlier
screening, which may increase the number of false positives.
f. How was this study funded? The National Institute for Health Research Health
Technology Assessment program funded the study.
No
No
No
No
No
Download