Abstract
Psychophysical studies with infants or with patients often are unable to use pilot data, training, or large numbers of trials. To evaluate threshold estimates under these conditions, computer simulations of experiments with small numbers of trials were performed by using psychometric functions based on a model of two types of noise:stimulus-related noise (affecting slope) andextraneous noise (affecting upper asymptote). Threshold estimates were biased and imprecise when extraneous noise was high, as were the estimates of extraneous noise. Strategies were developed for rejecting data sets as too noisy for unbiased and precise threshold estimation; these strategies were most successful when extraneous noise was low for most of the data sets. An analysis of 1,026 data sets from visual function tests of infants and toddlers showed that extraneous noise is often considerable, that experimental paradigms can be developed that minimize extraneous noise, and that data analysis that does not consider the effects of extraneous noise may underestimate test-retest reliability and overestimate interocular differences.
Article PDF
Similar content being viewed by others
References
Birch, E. E. (1985). Infant interocular acuity differences and binocular vision.Vision Research,25, 571–576.
Birch, E. E., &Hale, L. A. (1988). Criteria for monocular acuity deficit in infancy and early childhood.Investigative Ophthalmology & Visual Science,29, 636–643.
Brown, A. M. Dobson, V., &Maier, J. (1987). Visual acuity of human infants at scotopic, mesopic and photopic luminances.Vision Research,27, 1845–1858.
Dobson, V. (1983). Clinical applications of preferential looking measures of visual acuity.Behavioral Brain Research,10, 25–28.
Green, D. M. (1990). Stimulus selection in adaptive psychophysical procedures.Journal of the Acoustical Society of America,87, 2662–2674.
Hall, J. L. (1981). Hybrid adaptive procedure for estimation of psychometric functions.Journal of the Acoustical Society of America,69, 1763–1769.
Harvey, L. O., Jr. (1986). Efficient estimation of sensory thresholds.Behavior Research Methods, Instruments, & Computers,18, 623–632.
Klein, S. A., &Manny, R. E. (1989). Efficient estimation of thresholds with a small number of trials.Noninvasive Assessment of the Visual System (1989 Technical Digest Series),7, 80-83. Washington. DC: Optical Society of America.
Lusted, L. B. (1967). Introduction to medical decision making. In B. Jacobson (Ed.).Digest of the 7th International Conference on Medical and Biological Engineering (p. 297). Stockholm: Almqvist & Wiksell.
Madigan, R., &Williams, D. (1987). Maximum-likelihood psychometric procedures in two-alternative forced-choice: Evaluation and recommendations.Perception & Psychophysics,42, 240–249.
Manny, R. E., &Klein, S. A. (1985). A three alternative tracking paradigm to measure vernier acuity of older infants.Vision Research,25, 1245–1252.
Mayer, D. L., &Dobson, V. (1982). Visual acuity development in infants and young children, as assessed by operant preferential looking.Vision Research,22, 1141–1151.
McKee, S. P., Klein, S. A., &Teller, D. Y. (1985). Statistical properties of forced-choice psychometric functions: Implications of probit analysis.Perception & Psychophysics,37, 286–298.
Metz, C. E. (1982). ROC methodology in radiologic imaging.Investigative Radiology,21, 720–733.
Nachmias, J. (1982). Starting point bias of a recent psychophysical method.American Journal of Optometry & Physiological Optics,59, 845–847.
O’Regan, J. K., &Humbert, R. (1989). Estimating psychometric functions in forced-choice situations: Significant biases found in threshold and slope estimations when small samples are used.Perception & Psychophysics,46, 434–442.
Pelli, D., Robson, J. G., &Wilkins, A. J. (1988). The design of a new letter contrast chart for measuring contrast sensitivity.Clinical Vision Sciences,2, 187–199.
Pentland, A. (1980). Maximum likelihood estimation: The best PEST.Perception & Psychophysics,28, 377–379.
Quick, R. F. (1974). A vector-magnitude model of contrast detection.Kybernetik,16, 65–67.
Rose, R. M., Teller, D. Y., &Rendleman, P. (1970). Statistical properties of staircase estimates.Perception & Psychophysics,8, 199–204.
Swanson, W. H., &Birch, E. E. (1990). Infant spatiotemporal vision: Dependence of spatial contrast sensitivity on temporal frequency.Vision Research,30, 1033–1048.
Taylor, M. M., &Creelman, C. D. (1967). PEST: Efficient estimates on probability functions.Journal of the Acoustical Society of America,41, 782–787.
Teller, D. Y., Mar, C., & Preston, K. L. (in press). Statistical properties of 500-trial infant psychometric functions. In L. Werner & E. Rubel (Eds.),Developmental psychoacoustics. Washington, DC: American Psychological Association.
Watson, A. B. (1979). Probability summation over time.Vision Research,19, 515–522.
Watson, A. B., &Fitzhugh, A. (1990). The method of constant stimuli is inefficient.Perception & Psychophysics,47, 87–91.
Watson, A. B., &Pelli, D. G. (1983). QUEST: A Bayesian adaptive psychometric method.Perception & Psychophysics,33, 113–120.
Author information
Authors and Affiliations
Additional information
This project was supported in part by grants from the National Institutes of Health (EY05236 & EY07716). The project was started after discussions with both Davida Y. Teller and Stanley A. Klein, who also made helpful comments during the course of the research. Andrew B. Watson provided suggestions concerning simulations of maximum-likelihood adaptive methods, and John M. Foley provided suggestions concerning the ROC analysis.
Rights and permissions
About this article
Cite this article
Swanson, W.H., Birch, E.E. Extracting thresholds from noisy psychophysical data. Perception & Psychophysics 51, 409–422 (1992). https://doi.org/10.3758/BF03211637
Received:
Accepted:
Issue Date:
DOI: https://doi.org/10.3758/BF03211637