Skip to main content
SpringerLink
Log in

Clinicians and outcome measurement: What's the use?

  • Regular Articles
  • Published:
The Journal of Behavioral Health Services & Research Aims and scope Submit manuscript

Abstract

The goal of this study was to learn more about clinicians' experiences with, and perceptions of the utility, validity, and feasibility of standardized outcome measures in practice. Fifty randomly selected clinicians from multiple disciplines and multiple service agencies in a large children's public mental health service system were interviewed individually (n=30) or in focus groups (n=20) using semistructured interviews. There was great variability across clinicians in attitudes about empirical methods of treatment evaluation. There was consensus regarding feasibility challenges of administering standardized measures, including time burden and literacy barriers. Although all participants had received scored assessment profiles for their clients, the vast majority reported that they did not use the scores in treatment planning or monitoring. Their suggestions for improved clinical utility of outcome measurement are included. With increased attention and resources devoted to performance outcome assessment, it is concerning that most clinicians perceive little clinical utility of outcome measurement.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Similar content being viewed by others

References

  1. Koch JR, Lewis A, McCall D. A multistakeholder-driven model for developing an outcome management system.The Journal of Behavioral Health Services & Research. 1998;25:151–162.

    Google Scholar 

  2. Cesare-Murphy M, McMahill C, Schyve P. Joint commission evaluation of behavioral health care organizations.Evaluation Review: Measuring Quality in Mental Health Services. 1997;21:322–329.

    Google Scholar 

  3. Bickman L, Rosof J, Salzer MS, et al. What information do clinicians value for monitoring adolescent client progress?Professional Psychology: Research and Practice. 2000;31:70–74.

    Google Scholar 

  4. Addis ME, Krasnow AD. A national survey of practicing psychologists' attitudes toward psychotherapy treatment manuals.Journal of Consulting and Clinical Psychology. 2000;68:331–339.

    Google Scholar 

  5. Lueger RJ, Howard KI, Martinovich Z, et al. Assessing treatment progress of individual patients using expected treatment response models.Journal of Consulting and Clinical Psychology. 2001;69:150–158.

    Google Scholar 

  6. Burnam MA. Measuring outcomes of care for substance use and mental disorders. In: Steinwachs DM, Flynn LM, Norquist GS, et al, eds.New Directions for Mental Health Services, No. 71: Using Client Outcomes Information to Improve Mental Health and Substance Abuse Treatment. San Francisco, Calif: Jossey-Bass; 1996:3–18.

    Google Scholar 

  7. Smith RG. State of the science of mental health and substance abuse patient outcomes assessment. In: Steinwachs DM, Flynn LM, Norquist GS, et al, eds.New Directions for Mental Health Services, No. 71: Using Client Outcomes Information to Improve Mental Health and Substance Abuse Treatment. San Francisco, Calif: Jossey-Bass; 1996:59–67.

    Google Scholar 

  8. Goebel L. A peer review of feedback method of promoting compliance with preventive care guidelines in a resident ambulatory care clinic.Joint Commission Journal on Quality Improvement. 1997;23:196–202.

    Google Scholar 

  9. Dawes RM.House of Cards: Psychology and Psychotherapy Built on Myth. New York: Free Press; 1994.

    Google Scholar 

  10. Garb HN.Studying the Clinician: Judgment Research and Psychological Assessment. Washington, DC: American Psychological Association; 1998.

    Google Scholar 

  11. Meehl PE.Clinical Versus Statistical Prediction: A Theoretical Analysis and a Review of the Evidence. Minneapolis, Minn: University of Minnesota Press; 1954.

    Google Scholar 

  12. California Mental Health Planning Council (CMHPC).Adult Performance Outcome Study: Wave 1 to Wave 2. Sacramento, Calif: CMHPC; 1997.

    Google Scholar 

  13. Achenbach TM.Manual for the Child Behavior Checklist/4–18 and 1991 Profile. Burlington, VT: University of Vermont Department of Psychiatry; 1991.

    Google Scholar 

  14. Achenbach TM.Manual for the Youth Self-Report and 1991 Profile. Burlington: University of Vermont, Department of Psychiatry; 1991.

    Google Scholar 

  15. Hodges K. Child and Adolescent Functional Assessment Scale (CAFAS). In: Maruish ME, ed.The Use of Psychological Testing for Treatment Planning and Outcomes Assessment. 2nd ed. Mahwah, NJ: Erlbaum; 1999:631–664.

    Google Scholar 

  16. Attkisson CC, Zwick R. The Client Satisfaction Questionnaire. Psychometric properties and correlations with service utilization and psychotherapy outcome.Evaluation and Program Planning. 1982;5:233–237.

    Google Scholar 

  17. Breda CS. Methodological issues in evaluating mental health outcomes of a children's mental health managed care demonstration.The Journal Of Mental Health Administration. 1996;23:40–50.

    Google Scholar 

  18. Hoagwood K, Burns BJ, Kiser L, et al. Evidence-based practice in child and adolescent mental health services.Psychiatric Services. 2001;52:1179–1189.

    Google Scholar 

  19. National Advisory Mental Health Council (NAMHC).Blueprint for Change: Research on Child and Adolescent Mental Health. A Report by the National Advisory Mental Health Council's Workgroup on Child and Adolescent Mental Health Intervention Development and Deployment. Bethesda, Md: National Institutes of Health/National Institute of Mental Health; 2001.

    Google Scholar 

  20. Abrahamson DJ. Outcomes, guidelines, and manuals: on leading horses to water.Clinical Psychology: Science and Practice. 1999;6:467–471.

    Google Scholar 

  21. Addis ME, Wade WA, Hatgis C. Barriers to dissemination of evidence-based practices: addressing practitioners' concerns about manual-based psychotherapies.Clinical Psychology: Science and Practice. 1999;6:430–441.

    Google Scholar 

  22. Aarons GA. Clinician personality and attitudes toward adoption of empirically supported treatments. Presented at the 15th International Conference on Mental Health Services Research. Evidence in Mental Health Services Research: What Types, How Much, and Then What? National Institute of Mental Health; April 2002; Washington, DC.

  23. Hoagwood K, Jensen PS, Petti T, et al. Outcomes of mental health care for children and adolescents, I: A comprehensive conceptual model.Journal of the American Academy of Child and Adolescent Psychiatry. 1996;35:1055–1062.

    Google Scholar 

  24. QSR Nudist Vivo 1.0 [computer software]. Melbourne, Australia: Qualitative Solutions & Research Pty Ltd; 1999.

  25. Beutler LE. David and Goliath: when empirical and clinical standards of practice meet.American Psychologist. 2000;55:997–1007.

    Google Scholar 

  26. Achenbach TM.Manual for the CBCL/4–18 and Profile. Burlington: University of Vermont Department of Psychiatry; 1991.

    Google Scholar 

  27. Beutler LE. Comparisons among quality assurance systems: from outcome assessment to clinical utility.Journal of Consulting and Clinical Psychology. 2001;69:197–204.

    Google Scholar 

  28. Persons JB. Conducting effectiveness studies in the context of evidence-based clinical practice.Clinical Psychology: Science and Practice. 2001;8:168–172.

    Google Scholar 

  29. Lambert MJ, Hansen NB, Finch AE. Patient-focused research: using patient outcome data to enhance treatment effects.Journal of Consulting and Clinical Psychology. 2001;69:159–172.

    Google Scholar 

Download references

Author information

Author notes

  1. Marc Kruse BA (Research Assistant at the Child and Adolescent Services Research Center and is now)

    Present address: the Department of Psychology, the University of Texas, Austin

Authors and Affiliations

  1. University of California, San Diego, 3020 Childrens Way (MC 5033), 92123, San Diego, CA

    Ann F. Garland PhD (Associate Director, Child and Adolescent Services Research Center, and Associate Professor in Psychiatry)

  2. the University of California, San Diego

    Gregory A. Aarons PhD (Research Scientist at the Child and Adolescent Services Research Center and Assistant Clinical Professor)

Authors
  1. Ann F. Garland PhD
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Marc Kruse BA
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Gregory A. Aarons PhD
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Ann F. Garland PhD.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Garland, A.F., Kruse, M. & Aarons, G.A. Clinicians and outcome measurement: What's the use?. The Journal of Behavioral Health Services & Research 30, 393–405 (2003). https://doi.org/10.1007/BF02287427

Download citation

  • Issue Date:

  • DOI: https://doi.org/10.1007/BF02287427

Keywords

Search

Navigation