An Approach for the Uncertainty Evaluation of the Overall Result from Replications of Measurement: Separately Combining Individual Uncertainty Components According to their 'systematic' and 'random' Effects

Bulletin of the Korean Chemical Society.
2014.
Apr,
35(4):
1057-1060

- Received : December 03, 2013
- Accepted : December 10, 2013
- Published : April 20, 2014

Download

PDF

e-PUB

PubReader

PPT

Export by style

Article

Metrics

Cited by

TagCloud

In our previous articles, an approach has been proposed for the evaluation of the uncertainty of overall result from multiple measurements. In the approach, uncertainty sources were classified into two groups: the first including those giving same ‘systematic’ effect on each individual measurement and the second including the others giving ‘random’ effect on each individual measurement and causing a variation among individual measurement results. The arithmetic mean of the replicated measurements is usually assigned as the value for the overall result. Uncertainty of the overall result is determined by separately evaluating and combining an overall uncertainty from sources of the ‘systematic’ effect and another overall uncertainty from sources of the ‘random’ effect. This conceptual approach has been widely adopted in chemical metrology society. In this study, further logical proof with more detailed mathematical expressions is provided on the approach.
^{1-3}
The uncertainty arises from many components related with the operational processes of the measurement. The “Guide to the Expression of Uncertainty of Measurement” (GUM) and its updated version of “Evaluation of measurement data ― Guide to the expression of uncertainty in measurement” (JCGM 100:2008) provide general rules for evaluating and expressing uncertainty in measurement across a broad spectrum of measurements.
^{1,2}
The EURACHEM/CITAC Guide “Quantifying Uncertainty in Analytical Measurement, 2nd ed.” illustrates how the concepts in GUM can be applied in the measurement in chemistry.
^{4}
The result of measurement, in many cases, is determined on the basis of series of repeated observations. And an average value and its uncertainty are usually reported as the overall result of measurement. However examples in the above guides are limited to the evaluation of uncertainty in the results from a single measurement. The 3rd edition of the EURACHEM/CITAC Guide was recently published
^{5}
, in which the repeatability of the measurement method was added as an additional uncertainty source without precise consideration of its relationship with other uncertainty sources. In our previous articles,
^{3,6}
an approach for uncertainty evaluation of the average value obtained as the result of replicated measurements has been designed. Uncertainty components are usually categorized into Type A and Type B according to their way of evaluation.
^{1,2}
However they also can be categorized into groups causing ‘systematic’ effect and ‘random’ effect to each individual measurement.
^{1,2,7-10}
The ‘systematic’ sources are such parameters associated with calibration standards, reference data, bias corrections, etc., whose effects are usually common and not altered under repeatability conditions. On the contrary, effects of the ‘random ’ sources are unique to each single measurement and they contribute to the variation among individual measurement results.
In the previous articles, the uncertainty of the average value is determined by separately evaluating and combining an overall uncertainty from the ‘systematic’ sources and another overall uncertainty from the ‘random’ sources.
^{3,6}
The approach was designed based on two general ideas: (1) the overall uncertainty from the ‘systematic’ sources would not be affected or reduced by replication number of measurement owing to the correlation, (2) the overall uncertainty from the ‘random’ sources could be obtained by combining the uncertainty components in the group, or better estimated by statistical variation among the observations. Logical proof for the approach was described in the articles.
^{3,6}
In this article, the approach is revisited and further logical proof on the approach is provided with more-detailed mathematical expressions, which was not clearly addressed in the previous articles. It was also made clear under what conditions the approach can be applied.
Uncertainty for Single Measurement.
In most cases, measurand
Y
is determined from
k
input quantities of
X
j
’s using a functional relationship of
f
.
Then value of
Y
from the
i
^{th}
replication of measurement,
y_{i}
, is determined as Eq. (2),
where
x
_{ij}
is the estimate of the input quantity of
X
_{ij}
, the
j
^{th}
input quantity in the
i
^{th}
replication of measurement. Then the combined uncertainty of
y_{i}
is calculated as Eq. (3),
1
2
where
u
(x
ij
) is the value of the standard uncertainty of the x
ij
and
u
(x
ij
,x
il
) is covariance between x
ij
and x
il
, which is estimated by the degree of correlation (
r
(x
ij
,x
il
) ) as Eq. (4).
Parameters causing the ‘systematic’ effect are not correlated with parameters causing the ‘random’ effect. Hence
u_{c}
(
y_{i}
) can be decomposed into the ‘systematic’ and ‘random’ components and be combined again to give:
^{3,6}
where
u_{s}
(
y_{i}
) and
u_{R}
(
y_{i}
) are the overall uncertainties from the ‘systematic’ and the ‘random’ sources, respectively, in the ith measurement. If the order (or sequence) of the input quantities is rearranged so that X
ij
‘s (1 ≤
j
≤
p
) should be the parameters of the ‘systematic’ sources and the others (p <
j
≤
k
) be those of the ‘random’ sources, then according to Eq. (3) and Eq. (4),
u_{S}
(
y_{i}
) and
u_{R}
(
y_{i}
) are respectively given as:
Uncertainty for Replicated Measurements.
The individual results,
y_{1}
,
y_{2}
, …
y_{n}
, and their corresponding standard uncertainties,
u_{c}
(
y_{1}
),
u_{c}
(
y2
), …
uc
(
yn
), are obtained from
n
replications of measurement. The expected value m of
M
is determined from the individual results of the
n
measurements using another functional relationship of
F
.
And, in most cases,
M
is taken as the arithmetic mean of the
n
replications of measurement.
The combined standard uncertainty of
m
, based on Eq. (3), is
However, the functional relationship between
Y_{i}
’s and
M
can be resolved into another functional relationship of g between the individual input quantities of X
_{ij}
’s and
M
,
Then the combined standard uncertainty
u_{c}
(
m
), based on Eq. (3), is also given in another form as:
where,
In Eq. (12),
r
(
x_{ij}
,
x_{ql}
) satisfies following relations; (1)
r
(
x_{ij}
,
x_{ql}
) = r(
x_{ql}
,
xij
), (2) if (
j
or
l
=
p
,
i
≠ q) then
r
(
x_{ij}
,
x_{ql}
) = 0 since the ‘random’ sources obtained from different observations cannot be correlated to each other either to the ‘systematic’ sources, (3) if (
j
,
l
≤
p
) then r(
x_{ij}
,
x_{qj}
) = 1 and
r
(
x_{ij}
,
x_{ql}
) =
r
(
x_{0j}
,
x_{0l}
) since the ‘systematic’ sources cause the same effects on
Y_{i}
and
Y_{q}
. Thus if
u
_{c}
(
m
) is decomposed into
u
_{S}
(
m
) and
u
_{R}
(
m
), just as in Eq. (5), and be combined again, then it is given as:
where
u
_{R}
(
y_{i}
) is given in Eq. (7). However, if the probability distribution of the observations could be properly evaluated,
u
_{R}
(
m
) can be evaluated also from the probability distribution;
where
s
(
y_{i}
) is the estimated standard deviation of the individual results
^{3,6}
was designed, is that the overall uncertainty from the ‘random’ sources could be obtained by combining the uncertainty components in the group, or better estimated by statistical variation among the observations. It is trivial that overall uncertainty from the ‘random’ sources could be determined by Eq. (16), if there were no unrecognized terms
^{6}
or inexactly known influent quantities
^{1,2,11}
such as inhomogeneity of analytical sample or repeatability/reproducibility of the measurement procedure, etc. However, if any unrecognized terms or inexactly known influence quantities were involved in the measurement, then Eq. (16) would cause underestimation of the overall uncertainty from the ‘random’ sources. A good consistency between
u
_{R}
(
m
)s estimated by Eq. (16) and Eq. (17) would be obtained only when a measurement were made on very well homogenized analytical sample under good repeatability conditions.
^{14}
However, in many cases, it is not easy to eliminate those unrecognized or inexactly known influence quantities. Thus
u
_{R}
(
m
) would be best estimated by Eq. (17), if statistical variation among the observations could be properly evaluated.
Another idea, based on which the approach
^{3,6}
was designed, is that the overall uncertainty from the ‘systematic’ sources should not be reduced by increasing number of replicates of measurement, since each of them are strongly correlated to itself. Eq. (15) is mathematical expression of the idea. However, Eq. (15) is too much complex for practical use. And it is found that it can be simplified under certain conditions: (1) uncertainties of the ‘systematic’ sources are nearly constant at every replication of measurement,
u
(
x_{ij}
) Δ
u
(
x_{0j}
) (
j
≤
p
), (2) different ‘systematic’ sources are not correlated to each other,
r
(
x_{0j}
,
x_{0l}
) = 0 (
j
,
l
≤
p
,
l
≠
j
).
Case I: u (x_{ij} ) ≈ u (x_{0j} ) ( j ≤ p).
If u(xij) ≈
u
(
x_{0j}
) for any
j
(
j
≤
p
), then, according to Eq. (6) and Eq. (15), it is naturally satisfied that
u_{S}
(
m
) ≈
u_{S}
(
y_{0}
), where and
uS
(
y_{0}
) is given as:
In Eq. (18),
u
(
x_{0j}
) can take any value of
u
(
x_{ij}
) obtained from a series of measurement. In some cases, each
u_{S}
(
y_{i}
) would be automatically obtained from individual replicate by the assist of spreadsheets or analysis programs, etc. then
u_{S}
'(
m
) given as Eq. (19) could be taken as the value of
u_{S}
(
m
) instead
Case II:
r
(
x_{0j}
,
x_{0l}
) = 0 (
j
,
l
≤
p
,
l
≠
j
). If
r
(
x_{0j}
,
x_{0l}
) = 0 (
j
,
l
≤
p
,
l
≠
j
) is applied to Eq. (6) and Eq. (15), then
u_{S}
(
y_{i}
) and
u_{S}
(
m
) are simply given as:
Minkowski inequality
^{12}
provides a simpler way to estimate
u_{S}
(
m
) as:
or
the equation of inequality (22) or inequality (23) is satisfied when u(xij) is constant independent of
i
for any
js
, or
u
(
x_{ij}
) =
u
(
x_{0j}
). Thus
u_{S}
(
m
) given in Eq. (19) can be taken as the estimated value of
u_{S}
(
m
) instead, also in this case. Therefore, once the condition of
u
(
x_{ij}
) ≈
u
(
x_{0j}
) or
r
(
x_{0j}
,
x_{0l}
) = 0 (
j
,
l
≤
p
,
l
≠
j
) is satisfied,
u_{c}
(
m
) can be determined as Eq. (24):
Those conditions are not rare but usually satisfied in many cases of measurement. In most of cases, the magnitudes of
u
(
x_{ij}
) (
j
≤
p
) is very similar among replicates (
i
= 1 to
n
). Even in many of cases,
x_{ij}
and
u
(
x_{ij}
) are same for all replicates when the measurements are performed under well controlled repeatable conditions.
^{13,14}
One example of the cases is concentration of standard solution used for calibration for all replicates of samples, and its uncertainty is inherently the same for all replicates. Any parameters would have the correlation among them when they rise from a series-of-procedure
^{1,2 }
or whose functional form share more than one input quantity of variable.
^{15,16}
However the correlation can be eliminated by immersing them into a new parameter, so that the new one would not be correlated with the others any more. One example of the cases is the correlation between concentrations of internal standard and calibration standard being added up to prepare a calibration solution. The correlation is simply eliminated by immersing them into a new parameter of their mass-ratio, and that scheme is a usually applied. Thus application of the approach
^{3,6}
would not be limited much by the conditions. The approach may cause
u_{c}
(
m
) be over-estimated by a little bit in some cases, but would provide convenience.
^{3,6}
proposed to evaluate uncertainty of overall result from replicates of measurement is revisited. In the approach, uncertainty sources were classified into two groups: the first including those giving same ‘systematic’ effect on each individual measurement and the second including the others giving ‘random’ effect on each individual measurement and causing a variation among individual measurement results. The arithmetic mean of the replicated measurements was assigned as the value for the overall result, and whose uncertainty was determined by separately evaluating and combining an overall uncertainty from the ‘systematic’ sources and another overall uncertainty from the ‘random’ sources.
^{3,6}
In this study, it is shown that the approach provides simple and convenient way to estimate uncertainty of the overall result from replicates of measurement but that it works under certain conditions which was not declared in the original papers. The required condition is (1) uncertainties of the ‘systematic’ sources are nearly constant at every replication of measurement or (2) different ‘systematic’ sources are not correlated to each other. However it is considered that application of the approach would not be limited much by the conditions, since these conditions are usually satisfied in many practical measurement cases. The approach discussed in this paper is a bottom-up design for uncertainty evaluation. Hence the approach would not be proper for usual laboratories to apply since it would take more effort than top-down approaches. However this kind of approach would be helpful for those who are looking for better understanding of a certain measurement and for improvement of their measurement quality.

Introduction

A result of a measurement is an estimate of the value of a measurand and its associated uncertainty which characterize the dispersion of the value.
Theory

PPT Slide

Lager Image

PPT Slide

Lager Image

PPT Slide

Lager Image

PPT Slide

Lager Image

PPT Slide

Lager Image

PPT Slide

Lager Image

PPT Slide

Lager Image

PPT Slide

Lager Image

PPT Slide

Lager Image

PPT Slide

Lager Image

PPT Slide

Lager Image

PPT Slide

Lager Image

PPT Slide

Lager Image

PPT Slide

Lager Image

PPT Slide

Lager Image

PPT Slide

Lager Image

PPT Slide

Lager Image

Results and Discussion

One of the idea, on which the approach
PPT Slide

Lager Image

PPT Slide

Lager Image

PPT Slide

Lager Image

PPT Slide

Lager Image

PPT Slide

Lager Image

PPT Slide

Lager Image

PPT Slide

Lager Image

Conclusion

An approach
Acknowledgements

This work was supported by the Korea Research Institute of Standards and Science.

1993
Guide to the Expression of Uncertainty in Measurement

2008
Evaluation of Measurement Data - Guide to the Expression of Uncertainty in Measurement, JCGM 100:2008 BIPM

Choi J.
,
Hwang E.
,
So H.-Y.
,
Kim B.
2003
Accred. Qual. Assur.
8
13 -

2000
Quantifying Uncertainty in Analytical Measurement, EURACHEM/CITAC Guide CG4
2nd ed
EURACHEM/CITAC

2012
Quantifying Uncertainty in Analytical Measurement, EURACHEM/CITAC Guide CG4

Choi J.
,
Kim D.-H.
,
Hwang E.
,
So H.-Y.
2003
Accred. Qual. Assur.
8
205 -

Taylor B. N.
,
Kuyatt C. E.
1994
Guidelines of Evaluating and Expressing the Uncertainty of NIST Measurement Results

Henrion M.
,
Fischhoff B.
1986
Am. J. Phys.
54
791 -

Colclough A. R.
1987
J. Res. Natl. Bur. Standards
92
167 -

Magnusson B.
,
Ellison S. L. R.
2008
Anal. Bioanal. Chem.
390
201 -

2012
International Vocabulary of Metrology - Basic and General Concepts and Associated Terms (VIM), JCGM 200:2012
3rd edn
BIPM, Sevrès
France

Pearson H. L.
1974
In Handbook of Applied Mathematics: Selected Results and Methods; Pearson, C. E., Ed.

Kim B.
,
Park S.
,
Lee I.
,
Lim Y.
,
Hwang E.
,
So H.-Y.
2010
Anal. Bioanal. Chem.
398
1035 -

Kim B.
,
Hwang E.
,
So H.-Y.
,
Son E. K.
,
Kim Y.
2010
Bull. Korean Chem. Soc.
31
3139 -

Baker G. A.
1942
J. Am. Stat. Assoc.
37
537 -

Sarmanov I. O.
1970
Math notes
7
372 -

Citing 'An Approach for the Uncertainty Evaluation of the Overall Result from Replications of Measurement: Separately Combining Individual Uncertainty Components According to their 'systematic' and 'random' Effects
'

@article{ JCGMCS_2014_v35n4_1057}
,title={An Approach for the Uncertainty Evaluation of the Overall Result from Replications of Measurement: Separately Combining Individual Uncertainty Components According to their 'systematic' and 'random' Effects}
,volume={4}
, url={http://dx.doi.org/10.5012/bkcs.2014.35.4.1057}, DOI={10.5012/bkcs.2014.35.4.1057}
, number= {4}
, journal={Bulletin of the Korean Chemical Society}
, publisher={Korean Chemical Society}
, author={Kim, In Jung
and
Kim, Byungjoo
and
Hwang, Euijin}
, year={2014}
, month={Apr}