بسم هللا الرحمن الرحيم Professor of Clinical Pathology (Clinical Chemistry) Faculty of Medicine, Mansoura University The Laboratory test begins with a physician deciding which test to order and ends with that physician evaluating the test result. A process of brain to brain transmission of medical in formation. Problems arise primarily from imperfect processes, not from imperfect people. The quality problems are primarily management problems because only management has the power to change work process. The total system for a health care organization involves the interaction of all of the following processes as well as many others: Physicians might view a health care organization as a provider of processes for: A. Patient examination. B. Patient testing. C. Patient diagnosis. D. patient treatment. Health care administrators might view the activities in terms of processes for : A. Admitting B. Patient services C. Discharging patients D. Billing for costs of service Laboratory directors might understand their responsibilities in terms of processes for: A. Acquisition of specimens B. Processing of specimens C. Analysis of samples D. Reporting of test results Laboratory analysts might view their work as processes for: A. Acquiring samples B. Analyzing samples C. Performing quality control D. Releasing patient test results Report Written order Specimen Measurement Specimen preparation Patient preparation Quality Assurance (Q.A) The five Q framework Defines how quality can be managed using the scientific method or the PDCA cycle Plan do check Act: • Quality planning • QLP Includes analytical process and the general policies, practices and procedures that define how all aspects of the work get done. • Q.C. • Statistical. • Non statistical: e.g.: Linearity checks , reagent and standard checks and procedure. • Q.A. quality assessment concerned with: Measures and monitors performance as: of laboratory Turaround Specimen identification Patient identification Test utility • Q.I. quality improvement: Provides a structural problem-solving process With better analytical quality a lab can eliminate repeat run requests for test (this work is waste). If quality are improved waste will be reduced which reduce cost and provide a competitive advantage. If quality means conformance to requirements, then quality costs must be cost of conformance and cost of non-conformance. To customer requirement PREVENTION (To prevent problem) For appraising performance For poor analytical performance For analytical quality Essential Elements for Q.A. I. II. III. IV. V. Commitment. Facilities and Resources. Technical Competence. Technical Procedures. Problem solving Mechanism. • Input from QC technologist or supervisors to initiate the mechanism. • In service training program. • Specialized trouble shooting skills. • Quality team responsible for problem solving (small groups). Essential elements for Q.A. Essential elements for Q.A. Essential elements for Q.A. Essential elements for Q.A. Technical procedures Technical procedures Methodology Technical procedures Standardization and calibration: Reference calibrator material (RCM) (primary calibrator): by definitive method (absolute physical quantity such as mass) e.g. isotope dilution mass spectroscopy. Test calibrator material (TCM) (secondary calibrator): by reference method and high quality staff. Structure of an accuracy-based measurement system showing relationships among reference methods and materials . Technical procedures Documentation of analytical protocols and procedures. Monitoring of critical equipment and materials. Technical procedures The Monitoring of analytical quality by the use of: Q.C. SD, bias and 6 sigma • Levey – Jennings chart • Westgard multirules • Cum Sum P.T. Q.C. Levey Jennings control chart: Analyze control 20 different days mean ± SD. Construct Control chart. Control limits set as the mean ± 3s. Concentration is plotted on the y-axis versus time (run number) on the x- axis. Introduce the control into each run & record the value. Control limit: ± 2 SD observation when (n) the is number one rejection problem (Pfr). ± 3 SD when n = 2 or more detection (Ped is low). of false error Concentrations Q.C. Levey Jennings chart M+3SD M+2SD M+1SD Mean M M-1SD M-2SD M-3SD 1 2 3 4 5 6 7 8 9 10 Q.C. Westgard Multirules Chart If the control is within mean ± 2SD in control: I2s one excced mean ± 2SD ( warning that initiate testing of other control rules). I3s one excced mean ± 3SD ( Random error ) 22s 2 consecutive control excced mean ± 2SD (systemic error) R4s 2 consecutive excced mean plus and minus 2SD) ( Random error) 41s 4 consecutive excced mean ± 1SD ( syst. errors ) 10x` consecutive deviation Less than 1SD on (system errors) one side Concentrations Q.C Westgard chart 13s (random) M+3SD 22s systemic 12s (warning ) 4s (Random) M+2SD 41s systemic M+1SD Mean M M-1SD M-2SD M-3SD 1 2 3 4 5 6 7 8 9 10 A word from Dr. Westgard Westgard Multirule Chart Pfr is kept low Ped is improved Q.C Westgard chart Introduce two control specimens into each analytical run : When both fall with 2s limits accept the analytical run and report the patient results. When one exceeds 2s limit hold the patients results and inspect the control data using l3s, R45, 22s and 10xWhen one of these rules is out of control, reject the analytical run & don’t report the analytical results . When all of these rules indicate that the run is in control , accept the analytical run and report the patient results Q.C Westgard chart R4s is applied only within a run –between Run interpritted as RE Rule may be applied "across" materials one observations can be on the low, concentration and the other on the high concentration as long as they are within the same run . Rules 22s, 41s and 10x rules can be applied across runs and materials. This effectively increases n and improve the Ped of the procedure Q.C. Systemic error: caused by variations in: Instruments Technique Reagents or other material Random error: Appear despite, Analytical method Tightly Controlled, Sample piptting Dissolving reagent Mixing sample and reagents Baths temp instability. Q.C. The overall objective of these rules is to obtain a high probability of error detection and a low frequency of false rejection of runs: If the rules are violated it must: QC performance characteristics Different QC procedures have different sensitivities or capabilities for detecting analytical errors. The best is that with lowest Pfr and highest Ped. QC Cumulative sum CUSUM chart Calculate difference between mean & the result (e.g. mean 100 , result 110 the diff = 10) -add this difference to the following each day. Interpret the chart data . Steep slope of the Cusum Line, suggest systemic errors and the run is out of control. QC CUSUM QC CUSUM The Same as before but the difference is calculated between the estimated control value and k1 or ku (mean ±SD): The cusum calculation do not start until a control value exceeds a certain threshold above (Ku) or below (K1) of the expected mean (X). QC CUSUM This difference summated for 2 weeks If the summation exceed the control Limit the method out of control changed to If the sign changed (+ - or the reverse the calculation stopped the method is in – control Calculations and Tabular Record for Decision Limit Cusum For Control Material. With X=100, S=5.0, kU = 105 , K1 =95,hu=13.5,h1=13,5). QC CUSUM Q.C using patients data (Its efficiency is relatively low) Clinical correlation: • Correlate clinical diagnosis with laboratory test results e.g. impossible test result such as normal serum bilirubin in a highly jaundiced patients. Correlation with other laboratory tests e.g. T4 and TSH, urea and creatinine. Q.C using patients data Inter laboratory duplicate: • Divide sample into 2 aliquots and do analysis. This is a simple Q.C. procedure used in absence of stable control material. Q.C using patients data Delta checks with previous test: • To detect certain errors identification or labelling. e.g. • Compare laboratory test results with value obtained on previous specimens from the same patients. Delta check limit based on 3-day interval in term % of change from the initial value e.g. Na+ 5%, CK 99%. Q.C using patients data Limit checks: • Patients test results should be reviewed to check that they are within the physiological ranges compatible with life. Low warning S. Albumin (g/dl) 1.5 S. Uric acid (mg/dl) 1.0 S. Sodium (mmol/L) 120.0 High warning 6.0 12.0 150 External Q.C. Analyze the same Lot of control material: N. ± 1-1.5. > 2 Indicate that the Lab is not in agreement with the test of other Laboratories in the program. Must correct any test method instrum. trouble shooting. External Q.C. SDI for the same instruments and techniques: = External Q.C. Comparison of Lab. Mean and group mean by t-test. If significant (<0.05), the Lab. Result is biased. Role of proficiency testing (PT) in Accreditation According to Clinical Laboratory Improvement Amendments (CLIA88) Study 5 samples 3 times per year so as to improve the capability of detecting "unacceptable“ performance. The lab. must produce correct results on 4 out of 5 specimens for each of the analytes in that category and have an overall score of at least 80% for 3 consecutive challenges. The criteria of PT failure is: Two of five incorrect results on two of three consecutive PT surveys If there are 2 incorrect results for any analyte , The Lab. is considered "on probation " Lab . Suspended Lab: If the lab .has 2 or more incorrect results for any analyte or has any score less than 80% on two of three consecutive surveys. Suspended Lab. must cease all analytes in that specialty category until it is reinstated . Target value (% or absolute value): The mean of all responses after removal of outliers (more than 3SD). Or the mean established by definitive or reference method (acceptable by the national committee of standard NCS). Comparative method may be used in absence of the former methods. Post Analytical Goals and Clinical Interpretation of Lab. Procedures The following questions must be asked for test results: Screening : Is an apparent disease present ? Pathoghysiology : What is the disease process ? Confirmation : How can Confidence in the tentative diagnosis be increased ? Prognosis : How Severe is the disease process ? Monitoring : Has a change occurred since the Last observation ? Is it significantly different from previous result ? The probability that the difference between two result is analytically significant (p< 0.05) is 2.8 times the analytical SD (SDA of repeated measurements of a single quality normal control serum). To decide whether an analytical change is clinically significant, it is necessary to consider the extent of natural biological variation (means of SDB for repeated measure ments made at weekly intervals in healthy subjects over 10 weeks). The effects of analytical and biological variation can be assessed by calculating the overall standard deviation of the test by: If the difference between two test results exceeds 2.8 times the SD of the test, it can be considered of potential clinical significant: Is it consistent with clinical findings ? LAB. TESTING PROCESSES AND THEIR POTENTIAL ERRORS LAB. TESTING PROCESSES AND THEIR POTENTIAL ERRORS Process Potential Errors •Inappropriate test Test ordering •Handwriting not legible •Wrong patient identification •Special requirements not specified •Cost or delayed order LAB. TESTING PROCESSES AND THEIR POTENTIAL ERRORS Process Potential Errors •Incorrect tube or container •Incorrect patient identification •Inadequate volume Specimen •Invalid specimen acquisition (e.g. hemolyzed or too dilute) •Collected at wrong time •Improper transport conditions LAB. TESTING PROCESSES AND THEIR POTENTIAL ERRORS Process Potential Errors •Instrument not •calibarted correctly Analytical •Specimen mix –up measurement •Incorrect volume of specimen •Interfering substance present •Instrument precision problem LAB. TESTING PROCESSES AND THEIR POTENTIAL ERRORS Process Potential Errors •Wrong patient identification •Report not posted in chart Test reporting •Report not legible •Report delayed •Transcription error LAB. TESTING PROCESSES AND THEIR POTENTIAL ERRORS Process Test interpretation Potential Errors •Interfering substances not recognized •Specificity of test not understood •Precision limitations not recognized •Analytical sensitivity not appropriate •Previous values not available for comparison Six Sigma Six Sigma Today’s competitive environment leaves no room for error This is why six sigma quality must be a a part of our culture. What is six sigma It is a process that helps us focus on developing and delivering near perfect products and services. Why sigma Six Sigma The word is a statistical term that measures how far a given process deviates from perfection. The central idea behind six sigma is that you can measure how many” Defects” you have in a process, you can systematically figure out how to eliminate them and get as close to “zero defects” as Possible. Six Sigma The principles of Six Sigma go back to Motorola’s approach to TQM in the early 1990s and the performance goal that “6 sigmas or 6 standard deviations of process variation should fit within the tolerance limits of the process”; hence, the name Six Sigma. Six Sigma Six Sigma Methods of sigmametric measurement Six Sigma Sigma = (Tea – bias)/cv Tea = tolerable error or allowable total error (determined by CLIA) Bias = inaccuracy Six Sigma A shift or bias of 1.5 sigma would hardly cause any defects in a six sigma process. The actual rates that are expected are as follows: • 3.4 DPM for a six-sigma process; • 233 DPM for a five-sigma process; • 6210 DPM for a four-sigma process; • 66,807 DPM for three-sigma; and • 308,537 DPM for a two-sigma process Six Sigma Six Sigma Six Sigma Six Sigma Six Sigma Methods with 6 sigma performance are considered “World class”. Methods with sigma performance less than 3 are not acceptable for production. Six Sigma Chemistry Test or Analyte CLIA Acceptable Performance Five-Sigma Precision Six-Sigma Precision Blood gas pCO2 5 mm Hg or 8% (greater) 1 mm Hg or 1.6% 0.8 mm Hg or 1.3% Blood gas pH 0.04 pH units 0.008 pH units 0.00067 pH units Calcium, total 1.0 mg/dL 0.2 mg/dL 0.17 mg/dL Chloride 5% 1.0% 0.83% Cholesterol, total 10% 2.0% 1.7% Cholesterol, HDL 30% 6.0% 5.0% Creatine kinase 30% 6.0% 5.0% Creatinine 0.3 mg/dl or 15% (greater) 0.06 mg/dL or 3.0% 0.05 mg/dL or 2.5% Six Sigma Chemistry Test or Analyte CLIA Acceptable Performance Five-Sigma Precision Six-Sigma Precision ALT 20% 4.0% 3.3% Albumin 10% 2.0% 1.7% Alkaline Phosphatase 30% 6.0% 5.0% Amylase 30% 6.0% 5.0% Bilirubin, total 0.4 mg/dL or 20% (greater) 0.08 mg/dL or 4% 0.067 mg/dL or 3.3% Six Sigma Glucose 6 mg/dL or 10% (greater) 1.2 mg/dL or 2.0% 1.0 mg/dL or 1.7% Iron, total 20% 4.0% 3.3% LDH 20% 4.0% 3.3% Magnesium 25% 5.0% 4.2% Potassium 0.5 mmol/L 0.1 mmol/L 0.08 mmol/L Sodium 4 mmol/L 0.8 mmol/L 0.67 mmol/L Total protein 10% 2.0% 1.7% Urea Nitrogen 2 mg/dL or 9% (greater) 0.4 mg/dL or 1.8% 0.33 mg/dL or 1.5% Uric acid 17% 3.4% 2.8% Toxicology Test or Analyte Alcohol, blood 25% 5.0% 4.2% Blood lead 10% or 4 mcg/dL (greater) 2.0% or 0.8 mcg/dL 1.7% or 0.67 mcg/dL Carbamazepine 25% 5.0% 4.2% Digoxin 20% or 0.2 ng/mL (greater) 4.0% or 0.04 ng/mL 3.3% or 0.033 ng/mL Ethosuximide 20% 4.0% 3.3% Gentamicin 20% 4.0% 3.3% Lithium 0.3 mmol/L or 20% (greater) 0.06 mmol/L or 4.0% 0.05 mmol/L or 3.3% Phenobarbital 20% 4.0% 3.3% Phenytoin 25% 5.0% 4.2% Primidone 25% 5.0% 4.2% Procainamide 25% 5.0% 4.2% Quinidine 25% 5.0% 4.2% Theophylline 25% 5.0% 4.2% Tobramycin 25% 5.0% 4.2% Valproic acid 25% 5.0% 4.2% Six Sigma Hematology Test or Analyte Erythrocyte count 6% 1.2% 1.0% Hematocrit 6% 1.2% 1.0% Hemoglobin 7% 1.4% 1.2% Leukocyte count 15% 3.0% 2.5% Platelet count 25% 5.0% 4.2% Fibrinogen 25% 5.0% 4.2% Partial thromboplastin time 15% 3.0% 2.5% Prothrombin time 15% 3.0% 2.5%