Boxcar Averaging

advertisement
Instrument Components
Signal Generator (Energy Source)
Analytical Signal
Transducer
Signal Processor
Display
Can you identify these components in the following
instruments?
•UV-Vis spectrophotometer
•pH meter
•NMR spectrometer
Signal - the net response when a measurement is
performed. It consists of several components
(baseline, blank, noise) that must be subtracted
from the response to determine the true analytical
signal.
Noise - the random excursion of the signal about
some average value. If there is a lot of noise, then
the signal becomes harder to measure.
Signal-to-noise ratio (SNR) is frequently the most
important parameter to optimize in any
measurement system.
Types of noise
Shot and thermal noise are
consequences of properties of matter
and cannot be avoided. They are
distributed evenly at ALL frequencies
and are referred to as white noise.
Flicker noise is more intense at low
frequencies than high frequencies,
varying approximately as 1/f and is only
appreciable below 1 KHz.
Environmental noise is usually the
dominant source arising primarily from
60 Hz transmission lines (and higher
harmonics). Other sources of
environmental noise include vibrations
and electrical interactions between
instruments.
In the lab, if the results of an
experiment are noisy, one
typically replicates the
experiment and reports the
mean or average result. In
fact, the mean of many
measurements will more
accurately estimate the true
signal.
Detector Response
30
25
20
15
10
5
0
0
50
100
150
200
250
300
350
400
250
300
350
400
Time
Detector Response
Intuitively, the relative
amounts of signal and noise
will influence the precision
associated with the
measurement. Our
confidence in a measurement
performed in a high-noise
environment differs from that
in a low-noise environment.
30
25
20
15
10
5
0
0
50
100
150
200
Time
Boxcar Averaging
The average (or sum) of a set of points
replaces the individual values over a narrow
portion of the data set. This operation is
repeated over the entire domain of data.
interval
}
}
Original data set
Boxcar averaged data set
Boxcar Averaging
Number of points in interval  Nbox = 1
95
90
85
80
75
70
65
60
55
0
50
100
150
200
250
300
350
400
Boxcar Averaging
Nbox = 3
95
90
85
80
75
70
65
60
55
0
50
100
150
200
250
300
350
400
Boxcar Averaging
Nbox = 5
95
90
85
80
75
70
65
60
55
0
50
100
150
200
250
300
350
400
Boxcar Averaging
Nbox = 7
95
90
85
80
75
70
65
60
55
0
50
100
150
200
250
300
350
400
Boxcar Averaging
Nbox = 11
95
90
85
80
75
70
65
60
55
0
50
100
150
200
250
300
350
400
Boxcar Averaging
Limitations of boxcar averaging:
• Analysis time increases.
• Resolution decreases. *
• Distortion increases. *
• Number of points per data set reduced by a factor of N.
Time-dependent information is maintained.
Moving Average (Moving Window)
Moving Average
Number of points in moving window  Nmov box = 1
Moving Average
Nmov box = 3
Moving Average
Nmov box = 5
Moving Average
Nmov box = 7
Moving Average
Nmov box = 9
Moving Average
Nmov box = 15
Moving Average
Nmov box = 25
Moving Average
Limitations of moving average:
• Analysis time increases.
• Resolution decreases. *
• Distortion increases. *
Time-dependent information is maintained.
Savitsky-Golay Smoothing
A polynomial is fit to the data in each window. The
center value is replaced by the calculated value from
the model. The window is shifted and the fitting
process is repeated.
Savitsky and Golay developed a set of weighting
factors (integers) that, when used in a convolution
process, and achieve the same effect as as a least
squares fit to a polynomial equation, but in a faster,
neater, and more elegant manner.
Savitsky-Golay Smoothing
Number of points in moving window  Nmov box = 1
Savitsky-Golay Smoothing
Nmov box = 5
Savitsky-Golay Smoothing
Nmov box = 7
Savitsky-Golay Smoothing
Nmov box = 9
Savitsky-Golay Smoothing
Nmov box = 13
Savitsky-Golay Smoothing
Nmov box = 17
Savitsky-Golay Smoothing
Nmov box = 19
Savitsky-Golay Smoothing
Limitations of Savitsky-Golay smoothing:
• Analysis time increases.
• Resolution decreases. *
• Distortion increases. *
Time-dependent information is maintained.
Moving Average
Nmov box = 15
Savitsky-Golay Smoothing
Nmov box = 19
Which method yields the better SNR?
Which provides lower distortion?
Ensemble Averaging
Ensemble Averaging
Number of averaged data sets  Ne.a. = 1
Point by point ensemble averaging should increase
the SNR by the square root of N. Let’s check it out….
Ensemble Averaging
Ne.a. = 10
Ensemble Averaging
Ne.a. = 20
Ensemble Averaging
Ne.a. = 50
Ensemble Averaging
Ne.a. = 100
Ensemble Averaging
Ne.a. = 200
Ensemble Averaging
Ne.a. = 1000
Ensemble Averaging
Limitations of ensemble averaging:
•
Repetitive measurement of the same sample is required.
•
Time per experiment increases by a factor of N.
•
Time-dependent information is lost. You can not tell if
there is a drift, or systematic error in the data with only
the average.
SNR is dramatically improved with minimal distortion.
Digital Filtering
To remove interference noise, the following process is employed:
1. Time-domain data is transformed into frequency-domain data with
the Fourier transform.
2. Selected frequencies are deleted (or multiplied by filtering function)
3. The digitally filtered frequency-domain data back to the time-domain
using the inverse Fourier transform.
Download