Result Validation

advertisement
Result Validation
This resources applies to a majority of subjects in your course, but particularly Workplace Systems and
Practical Project.
Introduction
Before defining what “result validation” means, let’s first consider an important question.
EXERCISE 1
You’ve done an analysis to the best of your ability using the correct procedure. Is your answer correct?
Thus, result validation is the process by which you provide “evidence” regarding the accuracy of your
sample analysis. The basic methods for validating the accuracy of a method are:

calibration – not just making up standards, but keeping a check on the performance on the
instrument to make sure that it is maintaining a consistent output

blanks – “samples” known to contain no analyte which are taken through various parts of the
procedure to determine sources of contamination

controls – standards with similar matrices to the samples

spikes – addition of known amounts of analyte to “samples” of known concentration; the spiked
sample is measured to determine how much of the addition is picked up by the measurement

retesting – duplicate samples or analysis by another method or laboratory
Calibration
Calibration standards provide a day-to-day measure of an instrument response, and allow you to
determine the concentration of the analyte in samples. However, they do not necessarily provide a
measurement of the ongoing performance of the instrument. Therefore, calibration also means the
running of special standards which do not relate to sample analysis, but to instrument performance.
This is also known as Performance Qualification.
Blanks
Blanks – “samples” with no analyte – are used to test the process at any or all stages of the process.
There are:

field blanks – to check on contamination from the collection procedure, the blank is carried
through the same process (except actually collecting real sample)

transport blanks – kept in the transport vehicle at the site, and checks for problems caused by
storage and transport

container blanks – prepared at the laboratory from a container which is identical to those used
for field collection; it has the same preservation and storage time as the samples; particularly
useful for extended storage of samples

matrix blanks – materials of similar matrix to the samples, but with no analyte; are used to check
for interfering species causing a response, but are very difficult to obtain

reagent blanks – some analytical methods require a number of sample treatment steps involving
addition of different chemicals; while AR grade chemicals should be 99%+ pure, trace and ultratrace analysis can detect very low levels of analyte from the reagents (see example)
Result Validation
EXAMPLE 1
10 mL of concentrated HCl is used to acidify 50 mL of a river water sample (known to be around 25 ug/L
Pb), and the solution made up to 100 mL with ultra-pure water. The acid contains 0.1 mg/L (0.00001
%w/v) of lead. The sample is analysed by electrothermal AAS, which is capable of analysis down to 10
ug/L Pb. Is there a problem?
Using C1V1 = C2V2, the additional lead from the acid is 10 mL x 0.1 mg/L ÷ 100 mL = 10 ug/L. If the
sample was around 25 ug/L, then the reagent has added about 40% error to the answer!
CLASS EXERCISE 2
How can blanks be used?
Controls
Even if no measurable contamination was to occur, there are other sources of error:

matrix interference

method error

instrument malfunction

operator error
The only way to measure these errors is to know the right answer! However, if you already knew the
right answer for your samples, you wouldn’t be testing them. However, for certain sample types, it is
possible to have standard samples, known as controls or certified reference materials (CRM), which
are samples of the same matrix, which have known levels of the analytes. These are either purchased or
prepared in the laboratory.
The control is taken through the same procedure as the normal sample, and the result compared with
the “true value”. This can be used to judge the accuracy of the real samples.
EXAMPLE 2
A standard sample of flour known to contain 450 mg/kg of sodium is analysed together with real
samples. The standard sample is found to contain 425 mg/kg by the analysis. What does this
mean for the real samples?
The standard sample is reading 5.6% low [(425-450)/450]. It is reasonable to assume that their
results are similarly low. However, you would not simply subtract 5.6% from their results!!
Unfortunately, in environmental testing, this is not easy, because every body of water, piece of ground
or volume of air has a different matrix, and also changes over time.
Standard samples can also be used to check the accuracy of a method or a technician’s work. In this
case, there is no concern about matrix similarity. These “samples” can be inserted into a normal batch
of samples, with or without the technician’s knowledge.
p2
Result Validation
Spikes
If standard samples with matched matrices cannot be obtained (which will be the case for most
environmental testing), then an alternative approach is to “spike” a real sample or calibration standard.
This means adding a known amount of analyte to the “sample” at some point in the analysis, then
proceeding to analyse this spiked sample as normal. This is often called a recovery check.
For example, if your analysed portion of sample contained 5 mg of analyte, and another 5 mg was
added as a spike, you would expect when the spiked sample was analysed, it would contain 10 mg. If
less (or more) is recovered than was put in, then something is going wrong in the procedure.
This requires the addition of a known amount of analyte (known as a spike) to the sample, which is then
analysed as normal. The increase in concentration as analysed is then compared to how much was due
to the sample and how much was added. If a procedure works perfectly, then 100% of the added
analyte will be recovered. In general, a recovery of between 90-110% is considered perfectly
reasonable.
The key conclusion to make here is that the percent recovered is a measure of how accurate the answer
for your sample is. If only 50% of the added analyte is recovered, it suggest that 50% of the analyte in
the sample is being missed as well. However, you don’t then adjust the sample answer accordingly, just
report both results.
The recovery check process is similar in performance to standard addition, but is done for totally
different reasons. Standard addition is done to determine the sample concentration (it is an analysis
procedure), while the recovery check requires that you know the concentration in the sample (it is a
check on the analytical procedure).
Spiked samples check for matrix problems as well as method and operator errors, while spiked
standards check only for the latter errors.
The calculations associated with recovery checks are covered in a separate section in this resource. The
recovery check is a valuable way of determining whether a new method was accurate. You might
wonder why it is necessary to run recovery checks afterwards, when it is known that the method is
accurate. The reason is to keep proving that.
Retesting
Equally valuable in result validation is the retesting of samples in various ways:

analysing a duplicate sample placed in the batch (routine)

re-running a calibration standard after a certain number of samples (known as a re-slope) – this
checks for instrumental drift; if minor, then the calibration graph could be adjusted; if major,
then re-calibration and re-running of some of the samples may be required

analysing the sample by an alternative method – this is useful in checking new methods

another person (or laboratory) analysing the sample – this checks the performance of the
technician; inter-laboratory proficiency checks are commonly used as part of quality registration
Overall
A large batch of samples (e.g. 20 or more) should contain the following extra samples:

blanks of each type where appropriate

control

spiked sample

duplicate sample

re-slope standard

spiked standard/blank
p3
Result Validation
Recovery check calculations
The %recovery is calculated as below.
(
)
where
S is the amount of analyte found in the sample
SP the amount in the spike
SPS the amount found in the spiked sample
Amount can refer to mass, volume or concentration. It’s worthwhile noting that found means in
analysis, and added means as standard.
The final calculation itself could not be much easier. However, getting the three numbers to plug into
the equation is less easy, because it is easy to put the wrong number in when there are so many
numbers to choose from in a typical multi-step analysis.
Remember the two rules below and it will help you avoid some of the common errors.
1.
All three values must be in exactly the same unit, e.g. mg, mg/L
2.
All three values must be from the same stage of the analysis, e.g. the original sample, the first
solution, the analysed solution
When looking at these calculations, there are a lot of numbers and it is easy to get them mixed up. It is
a good idea, especially when you are learning, to identify which numbers belong to which solution:
sample, spike, spiked sample, or the procedure itself (details such as dilution volumes). You will find
that no number should belong to more than one of these categories.
The following relationship is useful as well:
1 mL of 1000 mg/L solution contains 1 mg of analyte
EXAMPLE 4
A 20 mL sample of river water is diluted to 100 mL, and found to contain an average of 2 mg/L of Na.
Another 20 mL aliquot of the water is spiked with 2 mL of 50 mg/L Na, made up to 100 mL and then
analysed. It was found to contain 2.9 mg/L.
S
SP
SPS
Procedure
2 mg/L
1 mL of 50 mg/L
2.9 mg/L
20 mL to 100 mL
Fairly obviously, the best unit to choose is mg/L because it is the only one in common.
This procedure has only two stages: the original river water and the diluted solution which is analysed.
Which stage do these mg/L numbers belong to?
S : 2 – diluted
SP: 50 – neither (it is a standard in another bottle)
SPS: 2.9 – diluted
p4
Result Validation
It would seem simplest to work out what the mg/L of SP in the diluted solution is, because that
completes the set of three. This is simply the dilution equation you know very well: C1V1 = C2V2.
50 x 2 = ? x 100, so SP = 1 mg/L
 2.9  2 
%RC  100 x 
 = 90%
 1 
There is a much less obvious approach to this calculation: by the mass of Na in the original solution.
S: 10 mL of 10 mg/L = 0.2 mg
SPS: 100 mL of 2.9 mg/L = 0.29 – while this is the final solution, all the Na in this came from the sample
and the spike
SP: 2 mL of 50 mg/L = 0.1
(
)
Why even think about this way, when each of the three values has to be worked out? Simply, the
“mass in the sample portion” method works regardless of the type of sample (solid or liquid) and
whether there are any dilutions.
EXAMPLE 5
Potato chips are analysed and found to contain 5.0%w/w of Na. A 1 g sample is spiked with 5 mL of
5000 mg/L Na, dissolved in 500 mL and analysed. It is found to contain 140 mg/L of Na.
S
SP
SPS
Procedure
A little tougher now as there are different units (%w/w for solid, mg/L for solution). However, there is
only one stage.
Approach 1 - concentration based
Use mg/L as the common unit, so SPS is already done.
For S, how many mg are in 1 g of 5%w/w? What is the concentration when dissolved in 500 mL?
For SP, what is the final concentration?

%RC  100 x 



 =

p5
Result Validation
Approach 2 – mass based
Use mg as the common unit, all 3 have to be calculated (but we already did S in Approach 1: 50 mg)
For SPS, how many mg are in 500 mL of140 mg/L?
For SP, how many mg are in 5 mL of 5000 mg/L?

%RC  100 x 



 =

Same answer. Is one approach better? No.
EXERCISE 3
(a) 10 mL of sample (known concentration 100 mg/L Ca) is spiked with 500 uL of 1000 mg/L Ca and
diluted to 250 mL. This solution, when analysed, has a concentration of 6.1 mg/L Ca.
S
SP
SPS
Procedure
(b)
5 g of soil (known concentration 50 mg/kg lead) is spiked with 5 mL of 50 mg/L Pb, and made to
100 mL. The concentration of this solution is 4.4 mg/L.
S
SP
SPS
Procedure
p6
Result Validation
EXERCISE 3
(c) A beer sample is diluted 1:1 and analysed for its sodium content by flame photometry, using
simple Na standards. The concentration of the beer is found to be 52 mg/L. A 50 mL aliquot of
the beer is spiked with 2 mL of 1000 mg/L Na, made up to 100 mL and this solution found to
contain 47 mg/L Na.
S
SP
SPS
Procedure
EXERCISE 4
Now for some real values, rather than nice simple whole numbers.
(a)
The concentration of Vitamin C in an orange juice sample was determined by HPLC to be 41.2
mg/100 mL. Another 25 mL aliquot of the sample was spiked with 10 mL of 1000 mg/L Vitamin C
standard and the solution made up to 50 mL. The spiked sample was analysed under the same
conditions and found to contain 398 mg/L.
(b)
The ethanol content of a wine sample was determined to be 12.3 %v/v. A 5 mL aliquot of the
wine was spiked with 200 uL of pure ethanol and diluted to 10 mL. When analysed it was found
to contain 8.2%v/v.
(c)
The sodium content of a butter sample was determined to be 475 mg/100 g. A recovery check
was prepared by weighing out 2.4376 g of sample, dispersing it in hot water, adding a 5 mL
aliquot of 1000 mg/L sodium and making up to 100 mL. A 10 mL aliquot was then diluted to 100
mL for analysis. The sodium content of this solution was 15.9 mg/L.
(d)
A 5 mL aliquot of bitter lemon (quinine concentration 27.4 mg/L) is spiked with 200 uL of 200
mg/L quinine standard and diluted to 25 mL. A 20 mL aliquot of this solution is determined to
contain 145.9 ug of quinine.
(e)
A sample toothpaste is analysed for its fluoride content and found to contain 0.115 %w/w. A
5.0762 g sample is spiked with 5 mL of 500 mg/L fluoride and dissolved in 100 mL of solution. A
25 mL aliquot is diluted to 100 mL. and analysed: it contains 21.6 mg/L.
(f)
A soluble fertiliser is analysed for its nitrate content, and found to have 10.1% w/w. A 0.5682 g
sample is dissolved in water, 5 mL of 5 g/L nitrate added and the mixture made to 500 mL. A 10
mL aliquot is diluted to 50 mL, and this solution is found to contain 32.4 mg/L.
p7
Result Validation
(g)
A 1.3825 g sample of peanuts (2.69%w/w K) is spiked with 20 mL of 1000 mg/L K, ashed and
dissolved up to 100 mL. A 10 mL aliquot is diluted to 100 mL, analysed and found to contain 52.3
mg/L.
(h)
25 mL of lemonade (385 mg/L benzoic acid) is spiked with 5 mL of 1000 mg/L benzoic acid and
made up to 100 mL. When analysed, this solution has a concentration of 138 mg/L.
(i)
2.5346 g of powdered milk (395 ug/kg Pb) is spiked with 5 mL of 100 ug/L Pb, ashed and dissolved
in 25 mL. This solution is analysed and found to have a lead concentration of 62.3 ug/L.
Worked answers to these are available from the website.
Other aspects of recovery checks
These include how much to add and when in the procedure, will covered in the Practical Project
subject.
Assessment
Your ability to perform recovery check calculations will be assessed in the theory exam associated with
the Practical Project subject later in the year.
p8
Download