Skip to main content
Log in

Verbal uncertainty expressions: A critical review of two decades of research

  • Articles
  • Published:
Current Psychology Aims and scope Submit manuscript

Abstract

The frequency with which verbal uncertainty expressions are employed suggests that they play an important role in the communication of states of uncertainty and may have an important role in emerging technologies such as Expert Systems. This article critically reviews empirical studies of verbal uncertainty expressions spanning two decades of research between 1967 and 1987 with the principal conclusions that: (1) People are highly internally consistent in their use of verbal uncertainty expressions; (2) No conclusions about between-subject variability are justified principally because (a) there is currently no consensus as to what is to count as consistent or inconsistent use and (b) there are several factors that confound purported analyses of between-subject consistency such as the composition of the stimulus set and the scaling tasks themselves; (3) One study suggests that assessments of the meaning of verbal uncertainty expressions may be conditioned by the prior perceived probabilities of the events they describe. However, other interpretations of this study are open. The review also discusses the more general epistemological question of whether the concept of uncertainty as manifest by verbal uncertainty expressions is really amenable to the unidimensional framework within which empirical studies have been conceived.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Similar content being viewed by others

References

  • Beyth-Marom, R. (1982). “How Probable is Probable: A Numerical Translation of Verbal Probability Expressions.”Journal of Forecasting, 1, 257–269.

    Article  Google Scholar 

  • Bonissone, P.P. and Decker, K.S. (1986). “Selecting Uncertainty Calculi and Granularity: An experiment in Trading-off Precision and Complexity.” InUncertainty In Artificial Intelligence, Kanal, L.N., and Lemmer, J.F. (Eds.). North Holland: Elsevier Science Publishers.

    Google Scholar 

  • Bonissone, P.P., Gans, S.S. and Decker, K.S. (1987). “RUM: A Layered Architecture for Reasoning with Uncertainty.” IJCAI-87. Proceedings of the 10th International Joint Conference of Artificial Intelligence, Milan August 23–28 (373–379).

  • Borges, M.A. and Sawyers, B.K. (1974). “Common Verbal Quantifiers: Usage and Interpretation.”Journal of Experimental Psychology, 102(2), 335–338.

    Article  Google Scholar 

  • Bryant, G.D. and Norman, G.R. (1980). “Expressions of Probability: Words and Numbers.”New England Journal of Medicine 302(7): 411.a.

    Google Scholar 

  • Budescu, D.V. and Wallsten, T.S. (1985). “Consistency in Interpretation of Probability Phrases.”Org. Beh. and Hum. Dec. Proc. 36, 391–405.

    Article  Google Scholar 

  • Burton, M.L. (1975). “Dissimilarity of Measures for Unconstrained Sorting Data.”Multivariate Behavioral Research, 10, 409–424.

    Article  Google Scholar 

  • Coxon, A.P.M. and Jones, C.L. (1979). “Measurement and Meanings: Techniques and methods of studying occupational cognition. London: Macmillan.

    Google Scholar 

  • Coxon, A.P.M. (1982). “The User’s Guide to Multi-Dimensional Scaling.” London: Heinemann Educational Books.

    Google Scholar 

  • Fox, J. (1986a). “Knowledge, Decision Making and Uncertainty,” InArtificial Intelligence and Statistics, Gale, W.A. (Ed.). New York: Addison-Wesley.

    Google Scholar 

  • Fox, J. (1986b). “Three Arguments for Extending the Framework of Probability.” InUncertainty and Artificial Intelligence, Kanal, L.N., and Lemmer, J.F. (Eds.). North Holland: Elsevier Science Publishers.

    Google Scholar 

  • Fox, J., Barber, D. and Bardhan, K.D. (1980). “Alternatives to Bayes.”Methods of Information in Medicine, 19, 210–215.

    PubMed  Google Scholar 

  • Isaacs, P.D. (1970). “Linear Regression, Structural Relations, and Measurement Error.”Psychological Review, 74(3), 213–218.

    Google Scholar 

  • Johnson, E.M. (1973). “Numerical Encoding of Qualitative Expressions of Uncertainty.” U.S. Army Research Institute for the Behavioural and Social Sciences, Technical Paper 150.

  • Johnson, P.E., Duran, A.S., Hassebrock, F., Moller, J., Prietula, M., Feltovich, P.J. and Swanson, D.B. (1981). “Expertise and Error in Diagnostic Reasoning.”Cognitive Science, 5, 235–283.

    Article  Google Scholar 

  • Kenney, R.M. (1981). “Between Never and Always.”New England Journal of Medicine, 305, 1097–8.

    PubMed  Google Scholar 

  • Keren, G. (1987). “Facing Uncertainty in the Game of Bridge: A Calibration Study.”Org. Beh. and Hum. Dec. Proc. 39, 98–114.

    Article  Google Scholar 

  • Kong, A., Barnett, G.O., Mosteller, F. and Youtz, C. (1986). “How Medical Professionals Evaluate Expressions of Probability.”New England Journal of Medicine. p 740–744.

  • Lichtenstein, S. and Newman, J.B. (1967). “Empirical Scaling of Common Verbal Phrases Associated with Numerical Probabilities.”Psychonomic Science, 9(10), 563–564.

    Google Scholar 

  • Lichtenstein, S., Fischhoff, B. and Phillips, L.D. (1982). “Calibration of Probabilities: The State of the Art to 1980.” InJudgement Under Uncertainty, Kahneman, D., Slovic, P. and Tversky, A. (Eds.). Cambridge: University Press.

    Google Scholar 

  • Mapes, R.E.A. (1979). “Verbal and Numerical Estimates of Probability in Therapeutic Contexts.”Soc. Sci. and Med. 13A, 277–282.

    Google Scholar 

  • Miller, G.A. (1956). “The Magical Number Seven Plus or Minus Two: Some limits on our capacity for processing information.”Psychological Review, 63, 81–97.

    Article  PubMed  Google Scholar 

  • Pepper, S. and Prytulak, L.S. (1974). “Sometimes Frequently Means Seldom: Context Effects in the Interpretation of Quantitative Expressions.”J. Research in Personality, 8, 95–101.

    Article  Google Scholar 

  • Rapoport, A., Wallsten, T.S. and Cox, J.A. (1987). “Direct and Indirect Scaling of Membership Functions of Probability Phrases.”Mathematical Modeling, 9, 397–417.

    Article  Google Scholar 

  • Reyna, V.F. (1981). “The Language of Possibility and Probability: Effects of Negation on Meaning.”Memory and Cognition.9(6), 642–650.

    Google Scholar 

  • Shortliffe, E.H. (1976). “Computer Based Medical Consultations: MYCIN.” New York: Elsevier.

    Google Scholar 

  • Slovic, P. (1966). “Cue Consistency and Cue Utilization in Judgement.”American Journal of Psychology, 79, 427–434.

    Article  PubMed  Google Scholar 

  • Toogood, J.H. (1980). “What Do We Mean by ‘Usually’?”Lancet, 1, 1094.

    Article  PubMed  Google Scholar 

  • van Melle, W. (1980). “A Domain Independent System that Aids in Constructing Knowledge Based Consultation Programs.” HPP-80-11, Computer Science Dept. Stanford University, June 1978.

  • Wallsten, T.S., Budescu, D.V., Rapoport, A., Zwick, R. and Forsyth, B. (1986). “Measuring the Vague Meanings of Probability Terms.”J. of Experimental Psychology: General.115(4), 348–365.

    Article  Google Scholar 

  • Wallsten, T.S., Fillenbaum, S. and Cox, J.A. (1986). “Base Rate Effects on the Interpretations of Probability and Frequency Expressions.”Journal of Memory and Language, 25, 571–587.

    Article  Google Scholar 

  • Zadeh, L.A. (1972). “A Fuzzy-Set-Theoretic Interpretation of Linguistic Hedges.”Journal of Cybernetics, 2(3), 4–34.

    Google Scholar 

  • Zadeh, L.A. (1975). “The Concept of a Linguistic Variable and its Application to Approximate Reasoning-III.”Information Science, 9, 43–80.

    Article  Google Scholar 

  • Zimmer, A.C. (1983). “Verbal vs. Numerical Processing of Subjective Probabilities.” In Decision Making under Uncertainty. Scholz, R.W. (Ed.), North Holland: Elsevier Science Publishers B.V.

    Google Scholar 

  • Zimmer, A.C. (1984). “A Model for the Interpretation of Verbal Predictions.”Int J. Man-Machine Studies.20, 121–134.

    Article  Google Scholar 

  • Zimmer, A.C. (1986). “What Uncertainty Judgements Can Tell About the Underlying Subjective Probabilities.” InUncertainty In Artificial Intelligence, Kanal, L.N. and Lemmer, J.F. (Eds.). North Holland: Elsevier Science Publishers.

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Additional information

I am indebted to Dylan Jones (UWIST) for his encouragement and support and to John Fox, (ICRF), Tom Wallsten and David Budescu for comments on earlier drafts. This work was supported, in part, by the Science and Engineering Research Council while the author was a postgraduate student at the Department of Applied Psychology, UWIST (now UWCC School of Psychology).

Rights and permissions

Reprints and permissions

About this article

Cite this article

Clark, D.A. Verbal uncertainty expressions: A critical review of two decades of research. Current Psychology 9, 203–235 (1990). https://doi.org/10.1007/BF02686861

Download citation

  • Accepted:

  • Issue Date:

  • DOI: https://doi.org/10.1007/BF02686861

Keywords

Navigation