Glossary of Sensitivity Testing and Analysis Terms
Definitions
Accurate:
An accurate measurement is one that gives the correct value on the average, i.e. there is no bias. See also precise.
All-Fire Level:
The minimum stimulus level (current, dose, energy, stress, voltage, etc.) that is sufficient to cause the device to function under a specific set of conditions. The All-Fire should be specified with both a probability level and a confidence level. A typical specification might 99.9% at 95% confidence. This specification means that there is a 95% confidence that at least 99.9% of the devices will function when supplied with the All-Fire level. See also No-Fire.
Bruceton Analysis:
A method of analyzing a sensitivity test. The Bruceton analysis method was invented by Dixon and Mood (1948) as a technique that would allow for simple analysis of sensitivity tests. The test was designed for efficiency in hand calculation. The Bruceton analysis can ONLY be used on tests conducted according to the Bruceton Test method. When the analysis method is applicable, it has similar precision to the asymptotic analysis of ASENT.
Bruceton Test:
Another name for the Up-and-Down Test. This test method was invented by Dixon and Mood (1948) along with the Bruceton Analysis method to allow for simple analysis of sensitivity tests. The Bruceton name is mainly used by people who test physical objects, while the Up-and Down name is mainly used by biologists. The Bruceton test is a method for choosing the stress levels in a sequential sensitivity test. The method requires the test operator to specify two test parameters, a first stimulus level and a step size. Subsequent tests are at a level one step size lower or higher than the previous test level depending on whether the previous test resulted in a response or a non-response. For best results the first stimulus level should be chosen at the populationmean and the step size should be chosen as the population standard deviation. The test efficiency is very dependent on choosing good test parameters. Because the test parameters are dependent on the unknown population parameters, the Bruceton test is not efficient. See also D-Optimal and Langlie Tests.
Confidence Interval:
A statistic constructed from sample data to provide an interval estimate of a population parameter. For example, the average of a sample is generally a good estimate of the populationmean. However, another sample chosen from the same sample would almost certainly have a different value. If the sample size is large enough, both of these estimates should be close to each other and the population mean. The confidence interval provides an interval or range of values around the estimate. For one parameter, such as the mean, standard deviation, or probability level, the most common intervals are or two sided (i.e. the statistic is between the lower and upper limit) and one sided (i.e. the statistic is smaller or larger than the end point). For two or more parameters, a confidence region, the generalization of a confidence interval, can take on arbitrary shapes. For sensitivity testing, the smallest confidence regions are oval shapes.
Confidence Level:
The probability that a confidence interval or region will contain the true parameters is given by the confidence level. A 95% confidence interval will contain the true parameters 95% of the time on average. Usually a confidence level of 95% or greater is considered statistically significant.
Critical Stimulus Level:
The stimulus level (current, dose, energy, stress, voltage, etc.) that is just sufficient to cause a response in the specimen tested. If the specimen is subjected to a stimulus level below its critical stimulus level it will not respond. If it is subjected to a stimulus level above its critical stimulus level it will respond.
D-Optimal Test:
A method for choosing the stimulus levels in a sensitivity test. This test method was invented by Neyer (1989, 1994) as a method that would efficiently calculate the population parameter estimates (estimates of the population parameters such as mean and standard deviation). The method requires the test operator to specify three test parameters, a lower and upper range for the guess of the mean and a guess for the standard deviation. Because these guesses are only used in the initial search algorithm, errors in these guesses do not have a major effect on the test efficiency. The test algorithm has four distinct phases. It uses an initial search algorithm to close in on the region of mixed response then uses a non analytical technique to determine the D-Optimal test points. These test points are the stimulus levels that maximize the information matrix.
Dud:
A device that will not function, no matter what the stimulus level is. This term is most often used in connection with explosive components. Sometimes also called a reject component.
Estimate:
Often also called a point estimate, it is the guess of the true value of a population parameter.
Langlie Test:
A method for choosing the stimulus levels in a sensitivity test. This test method was invented by Langlie (1965) as a replacement for the Bruceton Test. The method requires the test operator to specify a upper and lower test limit. The first stimulus level is the average of the two limits. Subsequent levels are found by averaging the last test level with a previous level or end point according to the rule developed by Langlie. The efficiency of the Langlie test is not as dependent on the initial choice of test parameters as is the Bruceton Test, but is more dependent than the D-Optimal Test.
Lethal Dose 50% (LD50):
The dose that is just lethal or deadly to 50% of the specimen. This terminology is used in biological experiments. It is the same as the median lethal dose or the median.
Likelihood Function:
The probability of obtaining the results obtained as a function of the population parameters.
Likelihood Ratio Analysis:
A method of computing confidence regions. The method entails computing ratios of the likelihood function at arbitrary parameters divided by the value at the maximum likelihood estimates.
Logit Curve:
A curve of a probability distribution. The distribution looks somewhat like the normal curve, but with tails that do not fall off as fast at plus and minus infinity.
Mean:
The average value of a population. This value is often symbolized by the Greek letter mu, μ. It also means the average value of a sample, in which case the symbol M is used. The sample mean is most often a good estimate of the population mean.
Median:
The 50% point or middle value of the population. If the values are ordered from smallest to largest, the median would be the middle value.
Median Lethal Dose:
The dose that is just lethal to 50% of the specimen. This terminology is used in biological experiments. It is the same as the LD50 or the median.
Mu:
The symbol μ is often used to symbolize the mean of the population.
Neyer Analysis:
A method of analyzing the results of a sensitivity test. The population parameter estimates (mean and standard deviation) are calculated by computing the maximum likelihood estimates. The confidence regions are calculated using a likelihood ratio analysis which computes contours of the likelihood function. The analysis is valid for sample sizes on the order of twenty or more but can be used for smaller sample sizes.
No-Fire Level:
The maximum current, dose, energy, stress, voltage, etc. that is not sufficient to cause the device to function under a specific set of conditions. The No-Fire should be specified with both a probability level and a confidence level. A typical specification might 10-6 at 95% confidence. This specification means that there is a 95% confidence that no more than one in 1 million of the devices will function when supplied with the All-Fire level. See also All-Fire.
Normal Curve:
A curve of a probability distribution. It is also sometimes called a bell shaped curve. The curve is completely specified by its mean and standard deviation.
Population:
The set of individuals or objects having some common observable characteristics.
Population Parameter:
A parameter that can be used to describe a population. Some examples of population parameters are the mean, standard deviation, and probability level.
Population Parameter Estimates:
Estimates of the population parameters. Estimates can be determined in a number of ways. If an estimate is computed entirely from the test result of a sample, then the estimate is called a statistic.
Precise:
A precise measurement is one that has small scatter about the average value. See also accurate.
Probability Level:
A population parameter that corresponds to a given percentile of the distribution. For example, the 90% probability level is the level for which 90% of the population has smaller value and 10% has a larger value.
Probit Analysis:
A graphical method of analyzing sensitivity tests. If multiple tests are conducted at several stimulus levels, then those that result in mixed response can be graphed on probability paper as a function of stimulus level. A straight line is fit to the graph. The slope of the line is related to the standard deviation, and the mid point of the line gives the mean. Often a transformation of the stimulus levels, such as taking the log of the stimulus levels results in data that is a closer fit to a straight line.
Random Sample:
A sample of a population that has the property that each item has an equal chance of being selected, and in which the chance of one item being selected does not affect the selection of any other item. Random samples are often used to ensure that the sample is representative of the population. Sometimes a sample that is not totally random but distributed uniformly with respect to nuisance parameters has desirable properties.
Response:
A change in the specimen from its initial state. For explosive components, a response is most often the successful function. For biological specimen, a response if often a death for toxicological tests or a cure for pharmacological tests. For a true sensitivity test, the response is binary, i.e. a clearly defined YES or NO to the question: "Did the specimen change?"
Robbins-Monro Test:
A method for choosing the stimulus levels in a sensitivity test. This method is similar to the Bruceton Test in that a first level and a step size are specified. Unlike the Bruceton test, the step size decreases by 1/N so that the stimulus levels converge to the population mean.
Sample:
Any subset of a population. A sample is often chosen for measurement because it is easier to determine the properties of a sample than the entire population.
Sample Size:
The number of items in a sample. In general, a larger sample size yields better statistical information than a smaller sample size.
Sensitivity Analysis:
A method of analyzing the results of a sensitivity test. Because a sensitivity test does not provide individual measures of the critical stress levels of members of the sample, it is not possible to compute an estimate of the mean in the normal manner of adding up the values and dividing by the sample size. It is similarly difficult to calculate the estimate of the standard deviation.
Sensitivity Test:
A test method for estimating continuous parameters that can not be measured in practice. For example, each explosive specimen has a threshold. The specimen will detonate if and only if an applied stimulus level exceeds this value. Since there is no way to determine the threshold of an individual, specimens are tested at various levels to determine parameters of the population. Repeated testing of any one sample is not possible, because the stimulus that is not sufficient to cause explosion nevertheless will generally damage the specimen.
Standard Deviation:
A measure of the variability of the population. This value is often symbolized by the Greek letter sigma, σ. It also represents the variability of a sample, in which case the symbol S is used. The sample standard deviation is most often a good estimate of the population standard deviation. If the population follows a normal distribution, then approximately 68% of the sample will be within one standard deviation of the mean and 95% will be within 2 standard deviations. The square of the standard deviation is called the variance.
Statistic:
Anything that can be computed entirely from the properties of a sample of data. The term is most often used for population parameters such as the sample mean and sample standard deviation, although minimum and vaximum values and histograms are also statistics.
Statistically Significant:
Something is statistically significant if it is unlikely that the event would occur by change less than a specific proportion of the time. If no specific proportion is given, the 5% level is assumed.
Stimulus Level:
The current, dose, energy, stress, voltage, etc. to which the specimen under test is subjected. See also the Critical Stimulus Level.
Test Efficiency:
How well a statistical test is able to extract information from a sample. Because the test efficiency for sensitivity tests is a strong function of the relationship between the test levels, the ability of different tests methods to extract precise and accurate estimates varies widely. A more efficient test requires a smaller sample size to obtain the same result as a less efficient test.
Test Parameters:
These parameters are used to determine the starting values when conducting sensitivity tests. The efficiency of the test depends on a proper choice of the test parameters.
Toxicological Tests:
Tests used to determine the potential toxic effects of chemicals and other agents on human health and the environment. Because it is often impossible to measure the threshold of the toxic level, these tests are often sensitivity tests.
Up-and-Down Test:
Another name for the Bruceton Test.
References
J. W. Dixon and A. M. Mood (1948), "A Method for Obtaining and Analyzing Sensitivity Data," Journal of the American Statistical Association, 43, pp. 109-126.
Maurice G. Kendall and Alan Stuart (1967), The Advanced Theory of Statistics, Volume 2, Second Edition, New York: Hafner Publishing Company.
H. J. Langlie (1965), "A Reliability Test Method For "One-Shot'" Items," Technical Report U-1792, Third Edition, Aeronutronic Division of Ford Motor Company, Newport Beach, CA.
Barry T. Neyer (1989), "More Efficient Sensitivity Testing," Technical Report MLM-3609, EG&G Mound Applied Technologies, Miamisburg, OH.
Barry T. Neyer (1992), Analysis of Sensitivity Tests, MLM-3736, EG&G Mound Applied Technologies, Miamisburg, Ohio.
Barry T. Neyer (1994), A D-Optimality Based Sensitivity Test, Technometrics, 36, PP 61-70.
Barry T. Neyer (1994a), Sensitivity Testing and Analysis, Proceedings of the Sixteenth International Pyrotechnics Seminar, Jönköping, Sweden, April.
Herbert Robbins and Sutton Monro (1951), "A Stochastic Approximation Method Method," Annals of Mathematical Statistics, 22, pp. 400-407.
S. D. Silvey (1980), Optimal Design, London: Chapman and Hall.