N 07 15 003 laboratory s performance assessment in

advertisement
Policy and requirements for proficiency testing, interlaboratory comparison/
laboratorys performance assessment in test
Issue date 21 September, 2009
Bureau of Laboratory Quality Standard (BLQS), DMSc
N 07 15 003
Revision 04
page 1 of 13 pages
1. Purpose This policy and requirements of the BLQS aim to use the activities of proficiency testing, interlaboratory
comparison and laboratorys performance assessment in test, as a tool for accreditation in medical, public health testing
laboratories and forensic science laboratory.
2. Scope Scope of this policy and requirements are as follows :
2.1 Participation in proficiency testing and interlaboratory comparison of medical, public health testing
laboratories and forensic science laboratory which apply for accreditation and has already been accredited.
2.2 The consideration for PT result and interlaboratory comparison comply with the ISO/IEC Guide 43-2:1997.
3. Reference
3.1 ISO/IEC 17025:2005, section 5.9
3.2 ISO/IEC 17011:2004, section 7.15 item 7.15.1, 7.15.2 123 7.15.3
3.3 ISO/IEC G.43-1. Proficiency testing by interlaboratory comparisons - Part 1: Development and operation
of proficiency testing schemes. 2rd Edition, 1997.
3.4 ISO/IEC G.43-2, Proficiency testing by interlaboratory comparison - Part 2: Selection and use of
proficiency testing schemes by laboratory accreditation bodies. 1st Edition, 1997 (section 6.5, 7.1)
3.5 ILAC G.13:2000. Guidelines for the requirements for the competence of providers proficiency testing
schemes.
3.6 ILAC G.22:2004 Use of Proficiency Testing as a Tool for Accreditation in Testing.
3.7 ILAC : P9:2005 ILAC Policy for Participation in National and International Proficiency Testing
Activities.
3.8 APLAC PT 006:2008 Proficiency Testing Frequency Benchmarks.
4. Terminology
Proficiency Testing (PT) is determination of laboratory testing performance by means of interlaboraory
comparison.
Interlaboratory comparison is organization, performance and evaluation of test on the same or similar test items
by two or more laboratories in accordance with pre-determined condition.
Laboratorys performance assessment in test is one of the tools used to evaluate the laboratorys performance.
5. Policy and Requirements
5.1. In case that the PT providers are available. The laboratories shall participate in test parameters of test methods for
each disciplines that they apply for accreditation. However, the laboratory shall have mechanism to ensure that the PT test item
shall distribute among the various analysts that trained and qualified for the relevant tests. The criteria requirements for selection
the PT providers for participation are as follows:
Policy and requirements for proficiency testing, interlaboratory comparison/
laboratorys performance assessment in test
Issue date 21 September, 2009
Bureau of Laboratory Quality Standard (BLQS), DMSc
5.1.1
5.1.2
N 07 15 003
Revision 04
page 2 of 13 pages
Shall be the recognition PT providers in the international, national or group of related expert.
Source of PT Providers can search by access the website : www.dmsc.moph.go.th and website of PT
provider schemes in medical and public health testing laboratories mentioned in Appendix 1
5.1.3 Laboratory shall establish plan for participation in PT schemes coves the scope of their accreditation as
mentioned in Appendix 2,3. In case that the laboratory participate with the other PT providers which does
not in the list of PT Providers as mentioned in Appendix 1, the laboratory shall inform officially to the
BLQS and submit the evidence to demonstrate the competency of the PT providers that participated. The
BLQS shall make a dicision for the competency of those PT Providers.
5.2 In case that the PT providers are not available. The laboratories should carried out the interlaboratory comparisons
by two or more laboratories (where applicable). Laboratories should establish the procedure for interlaboratory comparsison (as
mentioned in Appendix 3) , should be adequate described the preparation of sample or test item, the providing of test item,
demonstrate the accurate value for the test item, the statistical techniques applied to review or evaluate the results. The criteria
requirements for selection the laboratory for carried out the interlaboratory comparison are as follows :
5.2.1 Laboratory which is the same level of competency by means of accredited laboratories comply with ISO/IEC
17025: 2005 or ISO 15189 : 2007 in the test item requested for carried out the interlaboratory comparison in
the same technique / the same matrix.
5.2.2 Source of interlaboratory comparison can search by access the website www.dmsc.moph.go.th
5.3 In case that the PT providers and interlaboratory comparison are not available. Laboratory shall carried out the
possible performance assessment in test for the certain testing in lieu of PT or interlaboratoy comparison. Laboratories shall
establish the procedure for their performance assessment in test (as mentioned in Appendix 3), should be adequate described the
preparation or providing of sample or test item, demonstrate the accurate value of the analyte, statistical technique that used for
evaluating such as ISO 5725 or the appropriate statistics, plan and frequency for assessment among the trained analyst, record
and report.
5.4 Frequency in participation of proficiency testing schemes/interlaboratory comparison/laboratorys performance
assessment in test
5.4.1 Frequency in participation of proficiency testing schemes should depend on the rounds of the PT providers or
as appropriate. However laboratory shall ensure the evidence of their performance that shall demonstrate on
onsite surveillance and re : assessment.
5.4.2 Frequency in the interlaboratory comparison and the laboratorys performance assessment in test should be
carried out at least once a year or as mentioned in the plan of laboratories.
5.5 Reporting of proficiency testing/interlaboratory/comparison/laboratorys performance assessment in test. Laboratories
shall submit the report of those activities to the BLQS. If the results of proficiency testing is unsatisfy, laboratories shall carried
out as follows:
5.5.1 Determine the root cause, remedial corrective action and report to the BLQS.
Policy and requirements for proficiency testing, interlaboratory comparison/
laboratorys performance assessment in test
Issue date 21 September, 2009
Bureau of Laboratory Quality Standard (BLQS), DMSc
N 07 15 003
Revision 04
page 3 of 13 pages
5.5.2 BLQS shall inform the assessor to examine the corrective action of those results. The acceptance criteria for
the result of proficiency testing evaluate by the statistic Z-score according to the ISO/IEC G43-1 : 1997
Z ≤2
2< Z <3
Satisfactory
Questionable
Z ≥3
Unsatisfactory
5.5.3 The acceptance criteria for interlaboratory comparison/laboratorys performance assessment in test should
depend on the statistical used in the internal quality control of laboratory testing or other statistics that followed ISO 5725 for
example T-test, F-test or other appropriate statistics.
5.5.4 BLQS shall make a decision for the unsatisfactory performance in PT scheme according to the ISO/IEC
G.43-2 section 6.5, specified that the laboratory accreditation body should advise participating laboratories of
the possible outcomes of unsatisfactory performance in a proficiency testing scheme. These may range from
continuing accreditation subject to successful attention to corrective actions within agreed time-frames,
temporary suspension of accreditation for the relevant test (subject to corrective action), through to
withdrawal of accreditation for the relevant test.
5.5.5 The decision of BLQS for temporary suspension will depend on history of performance of the laboratory over
time and from the most recent on-site assessments. As mentioned in the ISO/IEC G.43-2: 1997 Section 7.1
accredited laboratories should be required to maintain their own records of performance in proficiency testing
and any subsequent corrective or preventive actions.
6. Supplement note:
6.1 Appendix 1
Website of PT providers schemes in medical and public health laboratoies
6.2 Appendix 2
Scope of accreditation
6.3 Appendix 3
Actions for accredited laboratories and accreditation bodies
Policy and requirements for proficiency testing, interlaboratory comparison/
laboratorys performance assessment in test
Issue date 21 September, 2009
Bureau of Laboratory Quality Standard (BLQS), DMSc
Appendix 1
Website: PT providers schemes (Public health laboratory comply with ISO/IEC 17025: 2005)
- Food analysis performance assessment scheme (FAPAS)
www.fapas.com
- Food examination performance assessment scheme (FEPAS)
www.fepas.com
- National Association of Testing Authority, Australia (NATA)
www.nata.asn.au
- American Society of Brewing Chemists, USA
www.asbcnet.org
- Bureau Interprofessional d'Etudes Analytiques
www.bipea.org
- Canadian Food Inspection Agency
www.inspection.gc.ca
- Canadian Association for Environmental Analytical Laboratories (CAEAL)
www.caeal.ca
- Institute for Interlaboratory Studies (IIS) Netherlands
www.iisnl.com
- Institute for Animal Health, (UK)
www.iah.ac.uk
- American Optometric Association
www.aoa.org
- Health Protection Agency Food EQA Schemes, UK
www.hpa.org.uk
- Laboratory Government Chemist (LGC) Standards Proficiency Testing, UK
www.lgc.co.uk
- National Measurement Institute (NMI) Australia
www.measurement.gov.au
- Quality management (QM), UK
www.qmuk.co.uk
- European Directorate for Quality Medicines & Health Care
www.edqm.eu
N 07 15 003
Revision 04
page 4 of 13 pages
Policy and requirements for proficiency testing, interlaboratory comparison/
laboratorys performance assessment in test
Issue date 21 September, 2009
Bureau of Laboratory Quality Standard (BLQS), DMSc
-
-
N 07 15 003
Revision 04
page 5 of 13 pages
IFM Quality service Pty, Ltd. (Australia)
www.ifmqs.com.au
American oil chemist society
www.aocs.org
American Society
www.asm.org
Bureau of Quality and Safety of Food Department of Medical Sciences, the Ministry of Public Health
http://www.dmsc.moph.go.th/webroot/BQSF/indexMain.htm
Institute of Nutrition, Mahidol University.
http://www.inmu.mahidol.ac.th
National Food Institute
http://nfi.foodfromthailand.com
Bureau of Laboratory Accreditation, Department of Science Service
http://www.dss.go.th/dssweb/bla/index.html
Bureau of Cosmetics and Hazardous Substances Control
http://www.dmsc.moph.go.th/webroot/cosmetics/
Centers of Disease Control and Prevention, CDC
www.cdc.gov/
World Health Organization, WHO
www.who.int
Institute of Animal Health, UK
www.iah.ac.uk
Bureau of Quality Control of Livestock Product
www.dld.go.th/qcontrol/bqclp.html
Enersol Consulting Engineers, Australia
www.enersol.com.au
Nelson Laboratory, Inc.
www.nelsonlabs.com
APLAC PT 003 JProficiency Testing DirectoryK
http://www.aplac.org
European Information System on Proficiency Testing Schemes, EPTIS
http://www.eptis.bam.de
Bureau of Laboratory Quality Standards Department of Medical Sciences, Ministry of Public Health
Policy and requirements for proficiency testing, interlaboratory comparison/
laboratorys performance assessment in test
Issue date 21 September, 2009
Bureau of Laboratory Quality Standard (BLQS), DMSc
N 07 15 003
Revision 04
page 6 of 13 pages
www.dmsc.moph.go.th
Website PT Provider schemes (Medical laboratory comply with ISO 15189)European Information System on Proficiency
- Testing Schemes, EPTIS
http://www.eptis.bam.de)
- Bureau of Laboratory Quality Standards Department of Medical Sciences, Ministry of Public Health
www.dmsc.moph.go.th
- UK National External Quality Assessment Schemes (UKN EQAS, clinical laboratory disciplines)
http://www.ukneqas.org.uk
- WEQAS Clinical Chemistry (University Hospital of Wales Medical Biological Department Health Park, UK)
- CAP Clinical Chemistry (>100 Programs ) (College Of American Pathologists, USA)
- Australian Institute of Medical Scientists (Immunohaematology)
http://www.aims.org.au
- The Royal College of Pathologist of Australia
- Bio-Red External Quality Assurances Services
www.bio-rad.com
- Diagnostic Chemicals Ltd. West Royalty Industrial Park for Veterinary Laboratory
www.delchem.com
- Toxicology Unit PaLMS Northern Sydney Area Health Service
www.toxicologyunit.com
Policy and requirements for proficiency testing, interlaboratory comparison/
laboratorys performance assessment in test
Issue date 21 September, 2009
Bureau of Laboratory Quality Standard (BLQS), DMSc
Appendix 2
1. Biological :General
Sub-disciplines Include:
• Quantitative Bacteriology
• Quantitative Mycology
• Quantitative Virology
• Qualitative Bacteriology
• Qualitative Mycology
• Qualitative Virology
• Molecular sub-typing
• Serology
• ELISA
• PCR
• Microscopy
• Quantitative Microbiology
• Qualitative Microbiology
2. Chemical:General
Sub-disciplines:
Chromatography
• TLC
• GC, GC-MS, GC :MS/MS
• HPLC, HPLC MS/MS
• UPLC, UPLC MS/MS
• IC
N 07 15 003
Revision 04
page 7 of 13 pages
Policy and requirements for proficiency testing, interlaboratory comparison/
laboratorys performance assessment in test
Issue date 21 September, 2009
Bureau of Laboratory Quality Standard (BLQS), DMSc
N 07 15 003
Revision 04
page 8 of 13 pages
Spectroscopy
• AAS
• GFAAS
• Fluorescence
• ICP, ICP-OES
• IR/FTIR
• UV/VIS
Titration
- Potentiometry
Gravimetric
- Gravimetry
3. Mechanical
Sub-disciplines include :
• Tensile
• Dimension
• Bursting pressure and volume
• Water leakage
• Oven conditioning
• Filtration (Minimum HVL for X-ray)
• Beam-limiting devices (Type of dental radiation for dental radiography using intra-oral image receptors,
a beam-limiting devices or cone)
• Distance of focus from the light source
• Diameter of a beam-limiting
• Leakage radiation
Policy and requirements for proficiency testing, interlaboratory comparison/
laboratorys performance assessment in test
Issue date 21 September, 2009
Bureau of Laboratory Quality Standard (BLQS), DMSc
N 07 15 003
Revision 04
page 9 of 13 pages
Materials/Matrices/Product Types
Foods :
- Milk and milk products
- Egg and egg products
- Meat and meat products (Fresh, Frozen,
Chilled, Heat Treated, Processed)
- Aquatic animal and aquatic animal products
(Fresh, Frozen, Heat Treated, Processed)
- Poultry and poultry products (Fresh, Frozen,
Heat Treated, Processed)
- Vegetable and vegetable products
- Cereals and grain products
- Legume and legume products
- Algae and their products
- Fruit and fruit products
Drugs
-
Cosmetics
- Hair cosmetic products
-
Flour and flour products
Oil, Fat and Butter
Supplementary foods for infant & young children
Condiments , Sauce and Spices
Noodle and noodle products
Semi processed food ,OPQPRSRTOUVRWX
Instant foods
Snack Food and Desserts
Ready to eat foods
Water, Ice, Bottled drinking water and Supply
water, Potable water
Beverages
etc.
Tablets
Liquid
Capsule
etc.
- Face cosmetic products
- Body cosmetic products
- etc.
: (Cold-wave, Straightening, Hair Dye, Bleaching, Hair
dressing, Anti-dandruff, Shampoo & Conditioner)
: (Antiacne-anti-melasma cream, Antimelasma cream,
Sunscreen cream, Creams & Lotions, Lipstick, Eyepencil, Eyebrow, Eyeshadow, Toothpaste, Dental floss,
Mouthwash, Anti bacterial spray)
: (Talcum, Body lotion, Soap, etc.)
Policy and requirements for proficiency testing, interlaboratory comparison/
laboratorys performance assessment in test
Issue date 21 September, 2009
Bureau of Laboratory Quality Standard (BLQS), DMSc
Household products :
- Pesticide products
- Larvicide sand granules products
- Repellent products
- Rodenticides, Tick, Flea products
- Cleaning and amend of pipe clogged products
- Disinfectant products
- Bleaching clothes
- Correction fluid products
- ect.
Toxicology :
- Biological samples, Clear water sac, Water bladder, Organs.
- etc.
Narcotics :
- Urine
- Biological sample, Suspected sample
- Dry plants
- etc.
Medical materials and medical devices :
- Condoms
- Examination Gloves
- Syringes
- X-ray equipments (Diagnostic)
- etc.
Veterinary:
- Muscle
- Dog Chew
- Egg and egg products
- Animal fat
N 07 15 003
Revision 04
page 10 of 13 pages
Policy and requirements for proficiency testing, interlaboratory comparison/
laboratorys performance assessment in test
Issue date 21 September, 2009
Bureau of Laboratory Quality Standard (BLQS), DMSc
- Internal organ, Visceral organ
- Carcass
- Animal serum
- Milk and milk products
- Milk
- Honey and royal jelly
- Animal tissue and processed products
- Meat and meat products
- Urine
- Mammal brain
- Animal hide
Forensic science
- Blood
- Urine
- Aqueous humor
- Serum
- Other liquid media
- Non biological physical evidence
N 07 15 003
Revision 04
page 11 of 13 pages
Policy and requirements for proficiency testing, interlaboratory comparison/
laboratorys performance assessment in test
Issue date 21 September, 2009
Bureau of Laboratory Quality Standard (BLQS), DMSc
N 07 15 003
Revision 04
page 12 of 13 pages
Appendix 3
Actions for accredited laboratories
1. Appropriate participation in proficiency testing, both in proficiency testing and interlaboratory
comparisons, covering the scope of the laboratorys accreditation, in a useful and cost-effective manner.
The laboratory should satisfy itself of the competence of the providers of PT schemes in which they
voluntarily participate.
2. The laboratory policy for participation in proficiency tests as a form of external quality control should be
adequately described in the Quality Manual or in other operational documents of the laboratory. This
particularly concerns planning, performance/operation, evaluation, corrective action, records and its
storage.
3. The laboratory should be prepared to justify non-participation in readily available proficiency testing
schemes, where one or more appropriate schemes exist
Actions for accreditation bodies and assessors
1. Promotion of the benefits of participation in proficiency testing, and how performance is used to help
assess the competence of laboratories.
2. Supporting of organization or arrangement of proficiency tests, wherever possible and useful in the most
cost-effective manner.
3. The accreditation body should judge the appropriateness of proficiency tests in which the laboratory
participates, which will be taken into account in the accreditation. Where the accreditation body
recommends participation in any particular PT scheme, for its accredited laboratories, in should satisfy
itself of the competence of the organization providing the proficiency test.
4. Ensuring that assessors have the following competences:
- Have demonstrable competence in interpretation of the assigned value and acceptability criteria
in all types of proficiency testing in order to afford a critical evaluation of quantitative and
qualitative results of laboratories;
Policy and requirements for proficiency testing, interlaboratory comparison/
laboratorys performance assessment in test
Issue date 21 September, 2009
Bureau of Laboratory Quality Standard (BLQS), DMSc
N 07 15 003
Revision 04
page 13 of 13 pages
- Have relevant knowledge about standards and Guidelines on the organization, performance and
evaluation of interlaboratory comparisons, as e.g. ISO/IEC Guide 43: 1997 [1],
ISO
5725 B1.1-6 [3];
5. Check that laboratories have a written procedure in the Quality Manual (QM) or in laboratory
instructions covering participation in proficiency testing, including how the performance in proficiency
testing is used to demonstrate the laboratorys competence and procedures followed in the event of
unsatisfactory performance.
Download