WELCOME TO THE WEBINAR! You will be connected to audio using your computer's microphone and speakers (VoIP). A headset is recommended. Or, you may select "Telephone" under the Audio tab on the Control Panel and follow the instructions. During the presentation, you are invited to submit your questions in writing using the Questions tab of the Control Panel. We will be providing a follow-up email that will include a PDF of the presentation and link to the recording. Thank you for your patience. The presentation will begin shortly. During this webinar we will have many opportunities to interact. At times you will be asked to type in short answers in the question area. At times you will be asked to Raise your hand in response to a yes or no questions. Take the time right now to find the questions area and see how to raise your hand. BRAIN TEASER What comes first… The Equipment, or the Parameter? Why? John sells rope by the inch, but Jill sells rope by the centimeter. If rope sells for about $0.25/inch, who will have an advantage? HOW TO READ A STANDARD: PART 1 How to find your way around a standard Alex Porter Global Director of Engineering STANDARDS WEBINAR SERIES • Part 2: TOMORROW @ 2pm Eastern Repeat of the Series: • Part 1: Tuesday, October 15 @ 2pm Eastern • Part 2: Wednesday, October 16 @ 2pm Eastern To Register: XXXXXXX AGENDA 01 Introduction & Meet Your Presenter 02 Requirements, Setup, Measurement Uncertainty 03 Conditioning, Test/Exposure 04 Evaluation, Data Types, Calculations, Test Uncertainty & Reporting 05 Q&A 6 MEET YOUR PRESENTER Alex Porter Director of Global Engineering Intertek Grand Rapids (MI) 7 MORE THAN 100 COUNTRIES, WITH 1,000 LOCATIONS & 43,000 EMPLOYEES, DELIVERING TOTAL QUALITY SOLUTIONS OUR SECTORS Products OUR SERVICES Assurance Testing Inspection Certification Trade Resources DEPTH AND BREADTH OF SERVICES GLOCALLY 8 DEPTH AND BREADTH OF ATIC SOLUTIONS Assurance Testing Inspection Certification Management Systems Softlines Agriculture Appliance & Electronic Benchmarking in Quality & Performance Hardlines Asset Integrity Aerospace & Automotive Automotive Building & Construction Building & Construction Biofuels Chemical & Petrochemical Conformity by Country Building & Construction Electrical Eco-Textile Chemicals & Pharma Exporter & Importer Food & Food Services Electrical Field Labelling Hazardous Locations Food Industrial HVACR1 Health & Beauty Minerals Industrial Equipment Minerals Oil & Gas IT & Telecoms Packaging Site Construction Life Safety & Security Pharmaceutical Textile & Apparel Lighting Sustainability & Environment Facility / Plant & Equipment Legal & Regulatory Product Development Vendor Compliance Corporate Social Responsibility Failure Investigation Laboratory Outsourcing Risk Management Supply Chain Assessment 1Heating Oil & Gas Ventilation Air Conditioning and Refrigeration Medical Devices 9 OUR GLOBAL NETWORK AND CAPABILITIES Global ATIC Business with over 43,000 Employees Global Market Leader in Assurance 3,000 Global Market Leader in TIC 1,000+ auditors laboratories and offices 100,000 100+ audits countries 10 HOW TO READ A STANDARD 1 Requirements, Setup, Measurement Uncertainty 2 Conditioning, Test/ Exposure 3 Evaluation, Data types, Calculations, Test Uncertainty , Reporting REQUIREMENTS, SETUP, MEASUREMENT UNCERTAINTYWEBINAR 1 PART 1 • What is needed • How to control • Is it accurate enough • When will it not be. • Where to find? • Start in your own mind: Based on scope, what do you expect? • Definitions or Terms (look for units of measure) START WITH PARAMETERS TO CONTROL/ MEASURE • Apparatus, Setup, Preparation, Equipment • Organize: • Parameter, Units, Method, Accuracy, Notes The following parameters are controlled VALUE DESCRIPTION Temperature Air Temperature Voltage Line Voltage UNITS Deg C Vac METHOD Chamber Power Supply MU % % UNITS Deg C Vac METHOD Chamber Power Supply MU % % The following parameters are monitored VALUE Temperature Voltage DESCRIPTION Air Temperature Line Voltage 13 START WITH PARAMETERS TO CONTROL/ MEASURE START IN YOUR OWN MIND: BASED ON SCOPE WHAT DO YOU EXPECT? Unitary AC and Air Source Heat Pumps: AHRI 210/240 Section 1. Purpose 1.1 Purpose. The purpose of this standard is to establish the following for Unitary Air-conditioners and Unitary Air-source Heat Pumps: definitions, classifications, test requirements, rating requirements, operating requirements, minimum data requirements for Published Ratings, marking and nameplate data, and conformance conditions. 1.1.1 Intent. This standard is intended for the guidance of the industry, including manufacturers, engineers, installers, contractors and users. 1.1.2 Review and Amendment. This standard is subject to review and amendment as technology advances Section 2. Scope 2.1 Scope. This standard applies to factory-made Unitary Air-conditioners and Unitary Air-source Heat Pumps with capacities less than 65,000 Btu/h as defined in Section 3. What do you expect? 14 Start with Parameters to Control/ Measure Definitions or Terms (look for units of measure) AHRI 210/240 Do you like word searches? Capturing the defined terms of measure or control and their units with a definition can avoid a lot of confusion when reading the standard body. 15 Start with Parameters to Control/ Measure Definitions or Terms (look for units of measure) What are the parameters that were seen in the definition? Coefficient of Performance (COP) {Watts/Watts} Degradation Coefficient (CD) {efficiency loss} Energy Efficiency Ratio (EER) {Btu/(W h)} 16 Start with Parameters to Control/ Measure Apparatus, Setup, Preparation, Equipment 5. Test Requirements .................................................................................................12 7. Minimum Data Requirements for Published Ratings............................................39 8. Operating Requirements ........................................................................................40 10. Conformance Conditions.......................................................................................42 Oh, Wait… Referenced Standard : ANSI/ASHRAE Standard 37 as amended by Appendix E 17 START WITH PARAMETERS TO CONTROL/ MEASURE ORGANIZE Parameter Units Range Accuracy Method Air dry-bulb temperature C -29 to 50 C 0.1 C RTD 0 to +/-1% Coriolis Flow Meter Water or Brine Kg/s Flow 18 Notes OVERALL STRUCTURE How would the search for Parameters in a Guide differ from finding them in a method? Write your ideas in the Question Tool. 19 Guide: Scope Definitions Discussion / Steps Method Scope Definitions Method Requirements Scope Definitions Declarations START WITH PARAMETERS TO CONTROL/ MEASURE ORGANIZE Imaging Equipment Parameter Units Range Accuracy Method Recovery Time 20 Notes Sleep or off to Ready TEC Kw-hrs ??-22.7 PdfeReady W Ready State Power PdfeSleep W Sleep Mode Power Delay Time to Sleep Min Spped Ipm 5-45 3 sig 2 significant If a Guide gives multiple options / methods Then the method chosen will need to be documented: Calculation from TEC Method Timer Typical Electrical Consumption PARAMETERS AND CONTROL: IS IT ACCURATE ENOUGH? • Look for Calculations: • Look for Denominators • Look for repeated sums or accumulations. 21 CALCULATIONS qidle = E x 60 t q = idle energy rate, Btu/h (kW), E = energy consumed during the test period, Btu (kWh), and t = test period, min. When would this be in-accurate? How is this controlled? What are the consequences of a shorter time? idle Error increases as t => 0 22 BRAIN TEASER Count the Triangles… How many are there? CONDITIONING, TEST/ EXPOSURE – WEBINAR 1 PART 2 • All about the execution of the test. WHAT ARE THE KEY POINTS TO WATCH DURING EXECUTION? USE THE QUESTIONS? AREA TO WRITE A SHORT ANSWER Are conditions held (temperature, humidity, profiles, voltage, THD, thermal gradient…) Is all data being collected / logged properly Does the product behavior meet expectations TIME: are all events and steps executed within the prescribed time. Are transient events captured Are there conditional steps, are they planned for 25 TOLERANCE, SEQUENCE AND MEASUREMENTS Condition Tolerance Performance Tolerance Sequence (This can include deviations and failure decisions) Condition Measurement Performance Measurement 26 WATCH FOR BLANKET RULES ASHRAE • What is the blanket rule? • How do we handle? • What does appropriate mean? Mil-Std-810H • What is the blanket rule? • How do we handle? • What does appropriate mean? 27 Appropriate occurs 17 times in in this standard THINK OF A DOCUMENT LIKE A DIAMOND Parameter Tolerance Parameter Monitor Product Test Requirements Calculations Pass / Fail Requirements Test Sequence Continuous Checks Final Checks and Reporting In many documents, each facet of the test sequence will be in different sections 28 MAP IT OUT Data sheet may be the easiest. Example -- modify as needed. #.# {Section Title} {Units} #.# {Section Title} {para} {Units} {parameter} {parameter} {parameter} 29 {para} {Units} {para} {Units} WHAT OTHER METHODS OTHER THEN DATA SHEET? USE THE QUESTIONS? AREA TO WRITE A SHORT ANSWER 30 PROS AND CONS OF MAPPING METHODS 31 Method Pros Cons Data Sheet Simple, Can capture units, provide guidance, Error Checking Manual Entry Work Instruction Can provide more complex guidance and customize to particular equipment Must be paired with another tool for Capturing data. Standard w/ log book Simple, free form. No error checking, no custom guidance. Automated software Simple to use, reproducible results Highest Investment, Any oversight or error is hidden. QUESTIONS TO ASK 1 What kind of document is the standard (guidance, method, requirements)? 2 Is the procedure laid out step by step or cross referenced? (hint: count the facets) 3 If I use a particular method for mapping, are all the facets traceably documented and controlled? 4 Be careful not to document through a lack of information. 32 NOTES ON DATA COLLECTION: WHAT IS GOOD AND BAD ABOUT THESE TWO STATEMENTS? Gas Pressure was maintained per standard. Or Gas Pressure was between 13.73 psi and 14.21 psi. 33 BRAIN TEASER • What is the difference? EVALUATION, DATA TYPES, CALCULATIONS, TEST UNCERTAINTY , REPORTING – WEBINAR 1 PART 3 • All about the conclusions • Reporting often involves cross reference between Standard, Method and Requirements. It is not enough to know what the standard says…under what set of rules is the standard being used. 35 EXAMPLE OF REPORT FORMATS EPA – Energy Star ISO 17025 Guidance from the Standard on what to report can give a lot of clarity on how to read the standard: Example from ASTM –E8 • Material and sample identification. • Specimen type (see Section 6). • Yield strength and the method used to determine yield strength (see 7.7). • Yield point elongation (see 7.8). • Tensile Strength (also known as Ultimate Tensile Strength) (see 7.10). • Elongation (report original gauge length, percentage increase, and method used to determine elongation; i.e. at fracture or after fracture) (see 7.11). • Uniform Elongation, if required (see 7.9). 36 • Reduction of area, if required (see 7.12). EVALUATION • Conditions and controls • What needs to have been true (think scientifically) • How to check / why? • Response Data • ….oh wait some of the evaluation is not numbers. 37 CALCULATIONS Which is faster? • Setting up calculations ahead of time Or • Building calculations after the fact Better if calculations are setup ahead of time (why?) But that takes to long??? Watch units (standards are to aggressive in canceling units). 38 NFPA 1994 -MIST Uptake Rate (cm/min) Uptake Rate = [mg] / {[cm^2][mg*min/cm^3]} Note: cm^2 (area) and cm^3 volume are measuring two different things. (area of body verse volume of gas). Although they are they same units and cancel… this makes the number cm/min confusing. It is not cm /min. It is mg absorbed per unit area per mg available per volume per minute. 39 TEST UNCERTAINTY Do you need it? • Consensus standards with controlled sources of uncertainty – no (unless asked) What type of standard is likely to needed it? 40 REPORTING Key Points Per ISO 17025: report shall include at least the following information, unless the laboratory has valid reasons for not doing so, thereby minimizing any possibility of misunderstanding or misuse: a title (e.g. “Test Report”, “Calibration Certificate” or “Report of Sampling”); the name and address of the laboratory and the location of performance of the laboratory activities, identification of the method used; a description, unambiguous identification, and, when necessary, the condition of the item; the date of receipt of the test or calibration item(s), and the date of sampling, where this is critical to the validity and application of the results; the date(s) of performance of the laboratory activity; the date of issue of the report; reference to the sampling plan and sampling method used by the laboratory or other bodies where these are relevant to the validity or application of the results; the results with, where appropriate, the units of measurement; additions to, deviations, or exclusions from the method; identification of the person(s) authorizing the report; clear identification when results are from external providers. Yeah… but what does the standard say? 41 REPORTING Annnnd what does ISO 17025 say • 7.5.1 - Traceability of all data used in reports. • 7.8.1.2 All data needed for interpretation and required by the method. • 8.8.2 Traceable data including dates, identification of samples and origins and sampling plan 42 REPORTING FAILURES Reporting passing data is easy – Everyone is happy. What about failures and retesting? 43 SAMPLE SELECTION AND RETESTING – SCENARIO ONE: SEPARATE TESTING. • Multiple Samples: 25 • Multiple tests: 5 different materials test, 5 samples each Tensile Flex Izod Impact Cold Bend HDT Pass Pass Fail Pass Pass REQUEST FROM SOMEONE New samples to re-test the Izod impact. Please report only the passing values from the first batch and the second batch. These pass HOW DO WE REPORT: We can not ignore data, all testing results must be reported in a way that is not deceptive: ISO 17025 7.8.1.2 General The results shall be provided accurately, clearly, unambiguously and objectively, usually in a report (e.g. a test report or a calibration certificate or report of sampling), and shall include all the information agreed with the customer and necessary for the interpretation of the results and all information required by the method used. All issued reports shall be retained as technical records. Report what: All data must be reported. Results report showing a section for each test. The Project folder must contain all relevant information. Do NOT present data in a deceptive way. SCENARIO TWO: STATISTICAL TESTING / PARTIAL FAILURE • Random Sample: 25 • One large test, 25 samples run: • • All samples must have Ultimate Pull strength greater then 95 MPa The average Ultimate Pull must be greater then 105 MPa Sample Ultimate Pull (MPa) 1 94 2 104 3 114 4 111 5 108 Sample Ultimate Pull (MPa) 6 98 7 115 8 117 9 111 10 105 Sample Ultimate Pull (MPa) 11 94 12 94 13 104 14 109 15 105 Sample Ultimate Pull (MPa) 16 102 17 109 18 99 19 98 20 108 Sample Ultimate Pull (MPa) 21 99 22 107 23 116 24 96 25 95 Average (MPa) 104.48 • Engineer wants to use 3 additional FAILURE samples for testing. • Have the samples tested and replace the three low, failing samples with the new ones. • ANSWER: No absolutely not. • (unless the standard specifically provides for rejection of outliers – then follow the rules of the standard) WHY NOT? A statistical sample is RANDOM sample from a population to represent the population: Which one is random? 25 Samples, taken at random Or 25 samples screened to be over 95 MPa? RECAP 1 Identify the Type of Standard (Guide, Method, Requirement) 6 Document Units, Method and Uncertainty 2 Use Parameters to be Measured or Controlled to gather and organize information 7 Choose how to Capture Information (Data sheet, Log Book, Automation) 3 Start with Definitions 8 Plan out Reporting before starting 4 Work through Setup, Execution and Report 5 Watch out for Referenced Documents 50 QUESTIONS? 51 STANDARDS WEBINAR SERIES • Part 2: TOMORROW @ 2pm Eastern Repeat of the Series: • Part 1: Tuesday, October 15 @ 2pm Eastern • Part 2: Wednesday, October 16 @ 2pm Eastern To Register: XXXXXXX Alex Porter, Director of Global Engineering +1 616 656 1348 alex.porter@intertek.com www.intertek.com ©2019 INTERTEK ALL RIGHTS RESERVED. No reproduction of this material is allowed without written permission of Intertek. Contact icenter@intertek.com for additional inquiries.