Day 2 DQO Training Course Module 3 The EPA 7-Step DQO Process Step 3 - Identify Inputs Presenter: Sebastian Tindall (45 minutes) 1 of 39 Objectives Identify applicable information/data needed for making the decisions Determine the quality of information needed Determine whether the historical/existing data are sufficient to make the decisions or whether new data are required Determine QC protocols 2 of 39 Step 3: Identify Inputs Step 1: State the Problem Step Objective: To identify the informational inputs that will be Step 3: Identify Inputs required to resolve the decision statements Step 4: Specify Boundaries identified in Step 2, and to Step 5: Define Decision Rules determine which inputs require environmental Step 6: Specify Error Tolerances measurements Step 2: Identify Decisions Step 7: Optimize Sample Design 3 of 39 Step 3a - Identify Inputs Information IN From Previous Step Actions Specify Environmental Variables to be Measured Information OUT To Next Step List General Sources of Information Decision Statements Determine Whether the Information Exists Continue Step 3 Activities Determine the General Level of Quality Required for the Data Evaluate the Appropriateness of Existing Data: Usability Assessment 4 of 39 Step 3a - Identify Inputs Information IN From Previous Step Actions Specify Environmental Variables to be Measured Information OUT To Next Step List General Sources of Information Decision Statements Determine which environmental variables or other information are needed to resolve the Continue Step 3 decision statement. Determine Whether the Information Activities Exists Determine the General Level of Quality Required for the Data Evaluate the Appropriateness of Existing Data: Usability Assessment 5 of 39 Step 3a - Identify Inputs Information IN From Previous Step Actions Specify Environmental Variables to be Measured Information OUT To Next Step List General Sources of Information Ask general questions such as: • “Is information on the physical properties of the media required?” Decision Continue Step 3 Determine Whether the Information • “Is information on the chemical/radiological characteristics of the Statements Activities Exists matrix needed?” Determine the General Level of Quality Required for the Data Evaluate the Appropriateness of Existing Data: Usability Assessment 6 of 39 Step 3a - Identify Inputs Information IN From Previous Step Actions Specify Environmental Variables to be Measured Information OUT To Next Step Examples of Physical Properties: List General Sources of Information Soil/Sediment: Air: - Kd - Temperature - Hydraulic conductivity - Moisture content Decision Continue Step 3 Determine Whether the Information - Porosity Statements Exists - Percent particulate/volumeActivities - Grain-size distribution Determine the General Level of Groundwater/Surface Water: Building Materials: Quality Required for the Data - pH - Density - Temperature - Compaction - Electrical conductivity Evaluate the Appropriateness of - Turbidity Existing Data: Usability Assessment 7 of 39 Step 3a - Identify Inputs Information IN From Previous Step Actions Specify Environmental Variables to be Measured Information OUT To Next Step Examples of Chemical / Radiological Properties: List General Sources of Information Groundwater/Surface Water: Soil/Sediment: - Concentration - Concentration Decision - Activity level Determine Whether-the Activity level Information Statements Exists Air: Building Materials: - Concentration - Concentration Determine the General Level level of - Activity level - Activity Continue Step 3 Activities Quality Required for the Data Evaluate the Appropriateness of Existing Data: Usability Assessment 8 of 39 Step 3a - Identify Inputs Information IN From Previous Step Actions Specify Environmental Variables to be Measured Information OUT To Next Step List General Sources of Information of environmental variables of interest for which DecisionCreate a listDetermine Continue Step 3 Whether the Information environmental measurements may be required. Statements Activities Exists • Levels of lead, silver, Total Metals, etc. • Levels of volatile organic compounds (VOCs), Determine the General Level of semi-volatileQuality organic compounds etc. Required for the(SVOCs), Data • Total Suspended Solids • Temperature, pH, Eh, etc. Evaluate theactivities Appropriateness of • Alpha, Beta, Gamma Existing Data: Usability Assessment 9 of 39 Step 3a - Identify Inputs Information IN From Previous Step Actions Specify Environmental Variables to be Measured Information OUT To Next Step List General Sources of Information Decision Statements Determine Whether the Information Exists Identify and list the general sources where Continue Step 3 Activities information on the environmental variables to be measure might exist. Determine the General Level of Quality Required for the Data Evaluate the Appropriateness of Existing Data: Usability Assessment 10 of 39 Step 3a - Identify Inputs Information IN From Previous Step Actions Specify Environmental Variables to be Measured Information OUT To Next Step List General Sources of Information Potential Data Sources: Modeling Data Needs: • Decision New data collection • Scenario(s) - (develop) Continue Step 3 Determine Whether the Information •Statements Existing data • Parameters - (develop) Activities Exists • Historical records - Values (obtain) • Scientific literature - Ranges (obtain) • Regulatory guidance Determine the General Level of Quality Required for the Data • Professional judgement Obtain Modeling Inputs: • Modeling • Old/New environmental measurements Evaluate the Appropriateness of • Scientific literature Existing Data: Usability Assessment • Other 11 of 39 Step 3a - Identify Inputs Information IN Actions From Previous Step Specify Environmental Variables Identify reports, historical to be Measured Information OUT To Next Step data and list the source and type of information available. List General Sources of Information Decision Statements Determine Whether the Information Exists Continue Step 3 Activities Determine the General Level of Quality Required for the Data Evaluate the Appropriateness of Existing Data: Usability Assessment 12 of 39 Step 3a - Identify Inputs Information IN From Previous Step Actions Specify Environmental Variables to be Measured Information OUT To Next Step From Step 2: Consider the human health, ecological, political, cost, and legal consequences of each action when determining the required levelSources of quality. List General of Information Decision Statements Determine Whether the Information Exists Continue Step 3 Activities Determine the General Level of Quality Required for the Data Evaluate the Appropriateness of Existing Data: Usability Assessment 13 of 39 Step 3a - Identify Inputs Information IN Actions Usability Assessment: Is data quality assured? From Previous Step Evaluate quality control data associated with each data set: Specify Environmental Variables • Spikes (bias) to be Measured • Duplicates (precision) • Blanks (evaluate contamination) Information OUT To Next Step List General Sources of Information Other considerations: • Detection limits • Data collection method (random, systematic, biased) Decision Continue Step 3 Determine Whether the Information Statements Remove data that are of poor quality of Exists or that are not representativeActivities the population Determine the General Level of Quality Required for the Data Evaluate the Appropriateness of Existing Data: Usability Assessment 14 of 39 Step 3a - Identify Inputs Information IN From Previous Step Actions Information OUT Specify Environmental Variables Usability Assessment (Statistical): Are data representative to be Measured of the population? To Next Step Can the data be used to make inferences about the population or sub-population of interest? List General Sources of Information Decision Statements Translation: Can sweeping claims be made about the site on the basis of the results of an estimate, e.g., the existing data. Determine Whether the Information Exists Continue Step 3 Activities Determine the General Level of Quality Required for the Data Evaluate the Appropriateness of Existing Data: Usability Assessment 15 of 39 Step 3a - Identify Inputs Information IN Actions From Previous Step Specify Environmental Variables to be Measured Information OUT To Next Step List General Sources of Information Usability Assessment (CSM) : Are the data reasonable for the proposed CSM? Decision Do the data Continue Step 3 fall within thethe range expected for the CSM? Determine Whether Information Statements Activities Exists Determine the General Level of Quality Required for the Data Evaluate the Appropriateness of Existing Data: Usability Assessment 16 of 39 Step 3a - Approaches Approach 1 Use predominantly fixed traditional laboratory analyses and specify the method specific details at the beginning of the DQO Process and do not change measurement objectives as more information is obtained This approach will contain serious flaws. 17 of 39 Step 3a - Approaches (cont.) Approach 2 Allow more field decisions to meet the measurement objectives and allow the objectives to be refined in the field using dynamic work plans (TRIAD approach) This approach will attempt to overcome the serious flaws shown in Approach 1. 18 of 39 Step 3a - Approaches (cont.) Approach 2 - Dynamic Work Plans – Real-time, decision making in the field allows for a seamless flow of site activities resulting in fewer mobilizations – Requires more flexible contracting approach – Requires experienced, well-trained field team (e.g., geologists, chemists and statisticians) either in the field or able to receive and process electronic data in real-time 19 of 39 Step 3a - Approaches (cont.) Approach 2 – Allows collection of more data in real-time – Allows real-time decisions to be made – Must have flexible but established decision trees approved by decision makers ahead of time – Need general statements of measurement quality that will be interpreted by field team – May be more costly due to higher level of expertise required but…more defensible 20 of 39 Step 3a - Approaches (cont.) Approach 1 defines methods, precision, accuracy, detection levels Approach 2 defines more general, flexible measurement quality objectives (MQOs) 21 of 39 Step 3b - Identify Inputs Information IN Actions From Previous Step Information OUT To Next Step Confirm that Appropriate Measurement Methods Exist to Provide the Necessary Data Specify the Matrix to be Measured Identify Action Level and Basis for Level Information From Previous Step 3 Activities Specify Required Detection Limits Information Needed to Resolve Decision Statements Specify the Precision Required Specify the Accuracy Required 22 of 39 Step 3b - Identify Inputs Information IN Actions From Previous Step Information OUT To Next Step Confirm that Appropriate Measurement Methods Exist to Provide the Necessary Data When selecting methods, Specify the Matrix to be Measured consider: • Detection limits Identify Action Level and Basis for Level • Sample size Information • Particle size Specify Required Detection Limits From • Turn around time Previous• Cost Step 3 Specify the Precision Required Activities Information Needed to Resolve Decision Statements Specify the Accuracy Required 23 of 39 Step 3b - Identify Inputs Information IN Actions From Previous Step Information OUT To Next Step Confirm that Appropriate Measurement Methods Exist to Provide the Necessary Data Specify the Matrix to be Measured Identify Action Level and Basis for Level Examples: Information • Surface and groundwater Specify Required Detection Limits From • Surface and subsurface soil Previous • Concrete Step 3 Specify the Precision Required • Air Activities • Biota Information Needed to Resolve Decision Statements Specify the Accuracy Required 24 of 39 Step 3b - Identify Inputs Information IN Actions From Previous Step To Next Step If practical, determine the actual numerical value thatMeasurement will be used as the action level for Confirm that Appropriate each environmental variable. Methods Exist to Provide the Necessary Data Specify the Matrix to be Measured Identify Action Level and Basis for Level Information From Previous Step 3 Activities Information OUT Specify Required Detection Limits Information Needed to Resolve Decision Statements Specify the Precision Required Specify Accuracy Required In Step 5 confirm thatthe action levels are greater than the detection limits. 25 of 39 Step 3b - Identify Inputs Information IN Actions From Previous Step Information OUT To Next Step Confirm that Appropriate Measurement Methods Exist to Provide the Necessary Data Specify the Matrix to be Measured Identify Action Level and Basis for Level Information Specify Required Detection Limits From Previous Step 3 Specify the Precision Required Activities Action levels are from: • Regulations (drinking water, TC) Required SpecifyRCRA the Accuracy • Derived from risk modeling (PRGs) Information Needed to Resolve Decision Statements 26 of 39 Step 3b - Identify Inputs Information IN From Previous Step Actions measurements to be made, Information OUT For any new environmental develop a comprehensive list of potentially appropriate To Next Step measurement methods for each matrix. Confirm that Appropriate Measurement Methods Exist to Provide the Necessary Data Specify the detection limits, precision, and accuracy for each environmental variable per matrix. Specify the Matrix to be Measured Identify Action Level and Basis for Level Information From Previous Step 3 Activities Specify Required Detection Limits Information Needed to Resolve Decision Statements Specify the Precision Required Specify the Accuracy Required 27 of 39 Step 3b - Identify Inputs Information IN From Previous Step • Specify the normal laboratory reporting limits. Actions Information OUT • Compare these limits to action level. To Next Step • If the detection limit exceeds action level, either: Confirm that larger Appropriate Measurement • Use sample size to lower reporting limit, Methods•Exist Provide the Necessary Data Usetoalternate method, • Develop new method, or • Make the reporting limit equal to the action level. Specify the Matrix to be Measured Information Identify Action Level and Basis for Level Information From Previous Step 3 Activities Specify Required Detection Limits Needed to Resolve Decision Statements Specify the Precision Required Specify the Accuracy Required 28 of 39 Step 3b - Identify Inputs Information IN Actions From Previous Step Information OUT To Next Step Confirm that Appropriate Measurement Methods Exist to Provide the Necessary Data Specify the Matrix to be Measured Identify Action Level and Basis for Level Precision is specified by Information • Relative percent difference Specify Required Detection Limits From • Relative standard deviation Previous • Confidence limits Step 3 Specify the Precision Required Activities Information Needed to Resolve Decision Statements Specify the Accuracy Required 29 of 39 Step 3b - Identify Inputs Information IN Actions From Previous Step Information OUT To Next Step Confirm that Appropriate Measurement Methods Exist to Provide the Necessary Data Specify the Matrix to be Measured Accuracy is specified by Identify Action Level and Basis for Level percent recovery. Information Specify Required Detection Limits From Previous Step 3 Specify the Precision Required Activities Information Needed to Resolve Decision Statements Specify the Accuracy Required 30 of 39 2 Approaches Approach 1: Traditional lab methods Approach 2: Field analytical methods with final confirmation via lab methods – Select onsite methods that focuses on driver COPCs (e.g., risk drivers, transport drivers, etc.) 31 of 39 CS Reasonable for CSM? (Y/N) Yes No No 1, 2 Uranium (total) mg/kg Laboratory No High Yes No No 1, 2 TPH (GRO & DRO) mg/kg Laboratory No High Yes No No 1, 2 PCBs mg/kg Laboratory No High Yes No No 250 Industrial PRGs 240 Industrial PRGs 100 Industrial PRGs 1 40CFR761.12 (TSCA) 3050B or 3051 6010B Soil 10 <20% 75% 125% 3050B or 3051 6010B Soil 10 <20% 75% 125% DRO-3540C (soxhlet) GRO-5035 (purge/trap) 3540C (soxhlet) or 3550B (ultrasonic) 8015B (GC/FID) Soil 10 <30% 70% 130% 8082 (Aroclors only) Soil 0.1 <30% 70% 130% Accuracy Representative of the Population? (Y/N) High Precision (RPD) Is Data quality Assured? (Y/N) No Detection Limits (PQL) General Level of quality Required (Low, Moderate, High) Laboratory Matrix Does Data Exist? (Y/N) mg/kg Appropriate Measurement Method General Source of Information Lead Preparation Method Unit of Measure 1, 2 Action Level and Basis for Action Level Chemical/radiological or Physical Attribute Usability Assessment Historical Data DS# Environmental Variable Lab Methods DRO = diesel range organics C10-28 and GRO = gasoline range organics C6-12 32 of 39 CS Reasonable for CSM? (Y/N) Yes No No 1, 2 Uranium (total) mg/kg on-site No High Yes No No 1, 2 TPH (GRO & DRO) mg/kg on-site No High Yes No No 1, 2 PCBs mg/kg On-site No High Yes No No 250 Industrial PRGs 240 Industrial PRGs 100 Industrial PRGs 1 40CFR761.12 (TSCA) NA 6200 XRF Soil 45 <25% 75% 125% NA 6200 XRF Soil 8 <25% 75% 125% Ext. in hexane for DRO GRO-5035 (purge/trap) N/A 8015B (GC/FID) Soil 10 <30% 70% 130% 4020 Soil * <30% 70% 130% Accuracy Representative of the Population? (Y/N) High Precision (RPD) Is Data quality Assured? (Y/N) No Detection Limits (PQL) General Level of quality Required (Low, Moderate, High) on-site Matrix Does Data Exist? (Y/N) mg/kg Appropriate Measurement Method General Source of Information Lead Preparation Method Unit of Measure 1, 2 Action Level and Basis for Action Level Chemical/radiological or Physical Attribute Usability Assessment Historical Data DS# Environmental Variable Onsite Methods * The detection limits vary depending on the Aroclor and range from 0.5 to 25.5 mg/kg. 33 of 39 CS Approach 2 To use XRF for onsite, the following must be done: – Develop correlation between lab methods listed in Approach 1 and on-site XRF methods for Pb and U per method 6200 – Correlation must take into account in-situ measurements without drying soil, this creates greater error than drying – In-situ must establish fixed distance of soil from source and fixed count (time exposed to X-rays) time – Develop calibration curves using all different types of soil present at the site 34 of 39 Approach 2 (cont.) CS For Diesel Range (DRO, GRO) onsite – Develop quick extraction with hexane for the DRO, 5 gr soil to 10 ml hexane – Perform short accuracy and precision study for DRO 35 of 39 CS Approach 2 (cont.) MQOs – The RPDs in the previous tables represent the analytical precision and accuracy requirements based on the published methods. – Due to biases, the correlation between the lab methods and on-site methods must meet r2 of 0.80 – Due to the higher detection limits and chance for false positives for Immunoassay, the final confirmation of the action limits must include lab analysis 36 of 39 Step 3a - Identify Inputs Information IN From Previous Step Actions Specify Environmental Variables to be Measured Information OUT To Next Step List General Sources of Information Decision Statements Determine Whether the Information Exists Continue Step 3 Activities Determine the General Level of Quality Required for the Data Evaluate the Appropriateness of Existing Data: Usability Assessment 37 of 39 Step 3b - Identify Inputs Information IN Actions From Previous Step Information OUT To Next Step Confirm that Appropriate Measurement Methods Exist to Provide the Necessary Data Specify the Matrix to be Measured Identify Action Level and Basis for Level Information From Previous Step 3 Activities Specify Required Detection Limits Information Needed to Resolve Decision Statements Specify the Precision Required Specify the Accuracy Required 38 of 39 End of Module 3 Thank you 39 of 39