Skip to main content

Advertisement

Log in

Is my patient suffering clinically significant emotional distress? Demonstration of a probabilities approach to evaluating algorithms for screening for distress

  • Original Article
  • Published:
Supportive Care in Cancer Aims and scope Submit manuscript

Abstract

Goals of work

Screening oncology patients for clinically significant emotional distress is a recommended standard of care in psycho-oncology. However, principles regarding the interpretation of screening and diagnostic tests developed in other areas of medicine have not been widely applied in psycho-oncology. This paper explores the application of the concepts of likelihood ratios and post-test probabilities to the interpretation of psychological screening instruments and demonstrates the development of an algorithm for screening for emotional distress and common psychopathology.

Materials and methods

Three hundred forty oncology/haematology outpatients at the Calvary Mater Newcastle, Australia completed the Distress Thermometer (DT), the PSYCH-6 subscale of the Somatic and Psychological Health Report and the Kessler-10 scale. The Hospital Anxiety and Depression Scale (HADS) (cutoff 15+) was used as the gold standard.

Main results

Likelihood ratios showed that a score over threshold on the DT was 2.77 times more likely in patients who were cases on the HADS. These patients had a 53% post-test probability of being cases on the HADS compared with the pretest probability of 29%. Adding either the PSYCH-6 (3+) or the Kessler-10 (22+) to the DT (4+) significantly increased this post-test probability to 94% and 92%, respectively. The significance of these improvements was confirmed by logistic regression analysis.

Conclusions

This study demonstrated the application of probability statistics to develop an algorithm for screening for distress in oncology patients. In our sample, a two-stage screening algorithm improved appreciably on the performance of the DT alone to identify distressed patients. Sequential administration of a very brief instrument followed by selective use of a longer inventory may save time and increase acceptability.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Similar content being viewed by others

References

  1. National Comprehensive Cancer Network (2004) Distress management guidelines. National Comprehensive Cancer Network, Jenkintown, PA

    Google Scholar 

  2. Carlson LE, Bultz BD (2003) Cancer distress screening. Needs, models, and methods. J Psychosom Res 55:403–409. doi:10.1016/S0022-3999(03) 00514-2

    Article  PubMed  Google Scholar 

  3. Institute of Medicine (IOM) (2008) Cancer care for the whole patient: meeting psychosocial health needs. The National Academies Press, Washington, DC

    Google Scholar 

  4. Holland JC (2000) An algorithm for rapid assessment and referral of distressed patients. American Society of Clinical Oncology 2000 Educational Book. Thirty-sixth Annual Meeting May 19–23, 2000. New Orleans, LA

  5. Jacobsen PB, Donovan KA, Trask PC, Fleishman SB, Zabora J, Baker F, Holland JC (2005) Screening for psychologic distress in ambulatory cancer patients: a multicenter evaluation of the Distress Thermometer. Cancer 103:1494–1502. doi:10.1002/cncr.20940

    Article  PubMed  Google Scholar 

  6. Cull A, Gould A, House A, Smith A, Strong V, Velikova G, Wright P, Selby P (2001) Validating automated screening for psychological distress by means of computer touchscreens for use in routine oncology practice. Br J Cancer 85(12):1842–1849. doi:10.1054/bjoc.2001.2182

    Article  CAS  PubMed  Google Scholar 

  7. Gil F, Grassi L, Travado L, Tomamichel M, Gonzalez JR, Southern European Psycho-Oncology Study Group (2005) Use of distress and depression thermometers to measure psychosocial morbidity among southern European cancer patients. Support Care Cancer 13:600–606. doi:10.1007/s00520-005-0780-0

    Article  PubMed  Google Scholar 

  8. Mitchell AJ, Kaar S, Coggan C, Herdman J (2008) Acceptability of common screening methods used to detect distress and related mood disorders—preferences of cancer specialists and non-specialists. Psycho-oncology 17:226–236. doi:10.1002/pon.1228

    Article  PubMed  Google Scholar 

  9. Mitchell AJ (2007) Pooled results from 38 analyses of the accuracy of Distress Thermometer and other ultra-short methods of detecting cancer-related mood disorders. J Clin Oncol 25:4670–4681. doi:10.1200/JCO.2006.10.0438

    Article  PubMed  Google Scholar 

  10. Fann JR, Berry DL, Wolpin S, Austin-Seymour M, Bush N, Halpenny B, Lober WB, McCorkle R (2009) Depression screening using the Patient Health Questionnaire-9 administered on a touch screen computer. Psycho-oncology 18:14–22. doi:10.1002/pon.1368

    Article  PubMed  Google Scholar 

  11. Mackinnon A (2000) A spreadsheet for the calculation of comprehensive statistics for the assessment of diagnostic tests and inter-rater agreement. Comput Biol Med 30:127–134. doi:10.1016/S0010-4825(00) 00006-8

    Article  CAS  PubMed  Google Scholar 

  12. Attia J (2003) Moving beyond sensitivity and specificity: using likelihood ratios to help interpret diagnostic tests. Aust Prescr 26:111–113

    Google Scholar 

  13. Jaeschke R, Guyatt GH, Barratt A, Walter S, Cook D, McAlister F, Attia J (2002) Measures of association. In: Guyatt G, Rennie D (eds) Users' guide to the medical literature: evidence-based clinical practice. American Medical Association Press, Chicago, pp 351–368

    Google Scholar 

  14. Panzer RJ, Black ER, Griner PF (1999) Interpretation of diagnostic tests and strategies for their use in quantitative decision making. In: Black ER, Bordley DR, Tape TG, Panzer RJ (eds) Diagnostic strategies for common medical problems. American College of Physicians–American Society of Internal Medicine, Philadelphia, pp 31–36

    Google Scholar 

  15. Fagan TJ (1975) Nomogram for Bayes's theorem. N Engl J Med 293:257

    CAS  PubMed  Google Scholar 

  16. Holleman DR, Simel DL (1997) Quantitative assessments from the clinical examination. How should clinicians integrate the numerous results? J Gen Intern Med 12:165–171

    PubMed  Google Scholar 

  17. Gill CJ, Sabin L, Schmid CH (2005) Why clinicians are natural Bayesians. BMJ 330:1080–1083. doi:10.1136/bmj.330.7499.1080

    Article  PubMed  Google Scholar 

  18. Mackinnon A, Mulligan R (1998) Combined cognitive testing and informant report to increase accuracy in screening for dementia. Am J Psychiatry 155:1529–1535

    CAS  PubMed  Google Scholar 

  19. Jaeschke R, Guyatt GH, Sackett DL (1994) Users' guides to the medical literature: III. How to use an article about a diagnostic test: B. What are the results and will they help me in caring for my patients. JAMA 271:703–707. doi:10.1001/jama.271.9.703

    Article  CAS  PubMed  Google Scholar 

  20. Greenhalgh T (1997) How to read a paper: papers that report diagnostic or screening tests. BMJ 315:540–543

    CAS  PubMed  Google Scholar 

  21. Deeks JJ, Altman DG (2004) Diagnostic tests 4: likelihood ratios. BMJ 329:168–169. doi:10.1136/bmj.329.7458.168

    Article  PubMed  Google Scholar 

  22. Bjelland I, Dahl AA, Haug TT, Neckelman D (2002) The validity of the hospital anxiety and depression scale. An updated literature review. J Psychosom Res 52:69–77. doi:10.1016/S0022-3999(01) 00296-3

    Article  PubMed  Google Scholar 

  23. Herrmann C (1997) International experiences with the Hospital Anxiety and Depression Scale—a review of validations data and clinical results. J Psychosom Res 42:17–41. doi:10.1016/S0022-3999(96) 00216-4

    Article  CAS  PubMed  Google Scholar 

  24. Zigmond A, Snaith R (1983) The hospital anxiety and depression scale. Acta Psychiatr Scand 67:361–370. doi:10.1111/j.1600-0447.1983.tb09716.x

    Article  CAS  PubMed  Google Scholar 

  25. Ibbotson T, Maguire P, Selby P, Priestman T, Wallace L (1994) Screening for anxiety and depression in cancer patients: the effects of disease and treatment. Eur J Cancer 30:37–40. doi:10.1016/S0959-8049(05) 80015-2

    Article  Google Scholar 

  26. Hickie IB, Davenport T, Hadzi-Pavlovic D, Koschera A, Naismith SL, Scott EM, Wilhelm KA (2001) Development of a simple screening tool for common mental disorders in general practice. MJA 175:S10–S17

    PubMed  Google Scholar 

  27. Andrews G, Slade T (2001) Interpreting scores on the Kessler Psychological Distress Scale (K10). Aust N Z J Public Health 25(6):494–497. doi:10.1111/j.1467-842X.2001.tb00310.x

    Article  CAS  PubMed  Google Scholar 

  28. Australian Bureau of Statistics Information paper (2003) Use of the Kessler Psychological Distress Scale in ABS Health Surveys. Cat No 4817.0.55.001 Australian Bureau of Statistics, Commonwealth Publishing

  29. Suchman AL, Dolan JG (1999) Odds and likelihood ratios. In: Black ER, Bordley DR, Tape TG, Panzer RJ (eds) Diagnostic strategies for common medical problems. American College of Physicians–American Society of Internal Medicine, Philadelphia, pp 31–36

    Google Scholar 

  30. Guyatt G, Rennie D (eds) (2002) Users' guide to the medical literature: evidence-based clinical practice. American Medical Association Press, Chicago

    Google Scholar 

  31. Clover K, Rogers K, Carter C, Adams C (2008) QUICA-TOUCH: the first 12 months of screening for distress, pain and psychopathology. Asia Pac J Clin Oncol 4(Suppl 2):A60

    Google Scholar 

  32. Hutchison SD, Steginga SK, Dunn J (2006) The tiered model of psychosocial intervention in cancer: A community based approach. Psycho-oncology 15:541–546. doi:10.1002/pon.973

    Article  PubMed  Google Scholar 

  33. Irwig L, Boussuyt P, Glasziou P, Gatsonis C, Lijmer J (2002) Designing studies to ensure that estimates of test accuracy are transferable. BMJ 324:669–671. doi:10.1136/bmj.324.7338.669

    Article  PubMed  Google Scholar 

Download references

Acknowledgements

The authors wish to thank Mr. Stuart Allen for devising the computerised versions of the questionnaires and data support, Dr. Heidi Reichler for extracting clinical information, Ms. Cynthia Millar for assistance with the statistical analysis, staff and volunteers in the outpatients' department for their support of the project and the research assistants Ms. Danielle Anthony, Ms. Neta Moses and Mr. Jason O'Connor.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Kerrie Clover.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Clover, K., Carter, G.L., Mackinnon, A. et al. Is my patient suffering clinically significant emotional distress? Demonstration of a probabilities approach to evaluating algorithms for screening for distress. Support Care Cancer 17, 1455–1462 (2009). https://doi.org/10.1007/s00520-009-0606-6

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s00520-009-0606-6

Keywords

Navigation