Skip to main content

Advertisement

SpringerLink
Log in

Capabilities and Characteristics of Digital Measurement Feedback Systems: Results from a Comprehensive Review

  • Original Paper
  • Published:
Administration and Policy in Mental Health and Mental Health Services Research Aims and scope Submit manuscript

Abstract

Measurement feedback systems (MFS) are a class of health information technology (HIT) that function as an implementation support strategy for integrating measurement based care or routine outcome monitoring into clinical practice. Although many MFS have been developed, little is known about their functions. This paper reports findings from an application of health information technology-academic and commercial evaluation (HIT-ACE), a systematic and consolidated evaluation method, to MFS designed for use in behavioral healthcare settings. Forty-nine MFS were identified and subjected to systematic characteristic and capability coding. Results are presented with respect to the representation of characteristics and capabilities across MFS.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Similar content being viewed by others

References

  • Ash, J. S., Sittig, D. F., Campbell, E. M., Guappone, K. P., & Dykstra, R. H. (2007). Some unintended consequences of clinical decision support systems. In American Medical Informatics Association (AMIA) Annual Symposium Proceedings (pp. 26–30).

  • Bickman, L. (2008). A measurement feedback system (MFS) is necessary to improve mental health outcomes. Journal of the American Academy of Child and Adolescent Psychiatry, 47(10), 1114–1119.

    Article  PubMed  PubMed Central  Google Scholar 

  • Bickman, L., Douglas, S. R., De Andrade, A. R. V., Tomlinson, M., Gleacher, A., Olin, S., et al. (2015). Implementing a measurement feedback system: A tale of two sites. Administration and Policy in Mental Health and Mental Health Services Research. doi:10.1007/s10488-015-0647-8.

  • Bickman, L., Kelley, S. D., Breda, C., de Andrade, A. R., & Riemer, M. (2011). Effects of routine feedback to clinicians on mental health outcomes of youths: Results of a randomized trial. Psychiatric Services, 62(12), 1423–1429.

    Article  PubMed  Google Scholar 

  • Brailer, D. J. (2005). Interoperability: The key to the future health care systems. Health Affairs, 5, 19.

    Google Scholar 

  • Bruns, E. J., Hyde, K. L., Sather, A., Hook, A. N., & Lyon, A. R. (2015). Applying User Input to the Design and Testing of an Electronic Behavioral Health Information System for Wraparound Care Coordination. Administration and Policy in Mental Health and Mental Health Services Research. doi:10.1007/s10488-015-0658-5.

  • Chorpita, B. F., Daleiden, E. L., & Bernstein, A. D. (2015). At the intersection of health and information technology and decision support: Measurement feedback systems…and beyond. Administration and Policy in Mental Health and Mental Health Services Research. doi:10.1007/s10488-015-0702-5.

  • Clauson, K. A., Marsh, W. A., Polen, H. H., Seamon, M. J., & Ortiz, B. I. (2007). Clinical decision support tools: Analysis of online drug information databases. BMC Medical Informatics and Decision Making, 7(1), 1–7.

    Article  Google Scholar 

  • Courage, C., & Baxter, K. (2005). Understanding your users: A practical guide to user requirements methods, tools, and techniques. San Francisco, CA: Elsevier.

    Google Scholar 

  • De Jong, K., & De Goede, M. (2015). Why do some therapists not deal with outcome monitoring feedback? A feasibility study on the effect of regulatory focus and person–organization fit on attitude and outcome. Psychotherapy Research, 25(6), 661–668.

    Article  PubMed  Google Scholar 

  • DeSantis, L., & Ugarriza, D. N. (2000). The concept of theme as used in qualitative nursing research. Western Journal of Nursing Research, 22, 351–372.

    Article  CAS  PubMed  Google Scholar 

  • Doherty, G., Coyle, D., & Matthews, M. (2010). Design and evaluation guidelines for mental health technologies. Interacting with Computers, 22(4), 243–252.

    Article  Google Scholar 

  • Douglas, S. R., Jonghyuk, B., de Andrade, A. R. V., Tomlinson, M. M., Hargraves, R. P., & Bickman, L. (2015). Feedback mechanisms of change: How problem alerts reported by youth clients and their caregivers impact clinician-reported session content. Psychotherapy Research, 25(6), 678–693.

    Article  PubMed  Google Scholar 

  • Dowrick, C., Leydon, G. M., McBride, A., Howe, A., Burgess, H., Clarke, P., et al. (2009). Patients’ and doctors’ views on depression severity questionnaires incentivised in UK quality and outcomes framework: qualitative study. British Medical Journal, 338, b663.

    Article  PubMed  Google Scholar 

  • Electronic Health Records (EHR) Incentive Programs. (2015, October 29). Retrieved November 12, 2015, from https://www.cms.gov/Regulations-and-Guidance/Legislation/EHRIncentivePrograms/index.html?redirect=/ehrincentiveprograms.

  • Garland, A. F., Kruse, M., & Aarons, G. A. (2003). Clinicians and outcome measurement: What’s the use? The Journal of Behavioral Health Services & Research, 30(4), 393–405.

    Article  Google Scholar 

  • Gleacher, A. A., Olin, S. S., Nadeem, E., Pollock, M., Ringle, V., Bickman, L., et al. (2015). Implementing a measurement feedback system in community mental health clinics: A case study of multilevel barriers and facilitators. Administration and Policy in Mental Health and Mental Health Services Research. doi:10.1007/s10488-015-0642-0.

  • Gondek, D., Edbrooke-Childs, J., Fink, E., Deighton, J., & Wolpert, M. (2015). Feedback from outcome measures and treatment effectiveness, treatment efficiency, and collaborative practice: A systematic review. Administration and Policy in Mental Health and Mental Health Services Research. doi:10.1007/s10488-015-0710-5.

  • Hatfield, D. R., & Ogles, B. M. (2004). The use of outcome measures by psychologists in clinical practice. Professional Psychology: Research and Practice, 35(5), 485.

    Article  Google Scholar 

  • Hill, C. E., Knox, S., Thompson, B. J., Nutt Williams, E., & Hess, S. A. (2005). Consensual qualitative research: An update. Journal of Counseling Psychology, 52, 196–205.

    Article  Google Scholar 

  • Hill, C. E., Thompson, B. J., & Nutt Williams, E. (1997). A guide to conducting consensual qualitative research. The Counseling Psychologist, 25, 517–572.

    Article  Google Scholar 

  • Hsieh, H.-F., & Shannon, S. E. (2005). Three approaches to qualitative content analysis. Qualitative Health Research, 15(9), 1277–1288.

    Article  PubMed  Google Scholar 

  • Kluger, A. N., & DeNisi, A. (1996). The effects of feedback interventions on performance: A historical review, a meta-analysis, and a preliminary feedback intervention theory. Psychological Bulletin, 119(2), 254–284.

    Article  Google Scholar 

  • Krägeloh, C. U., Czuba, K. J., Billington, D. R., Kersten, P., & Siegert, R. J. (2015). Using feedback from patient-reported outcome measures in mental health services: A scoping study and typology. Psychiatric Services, 66(3), 224–241.

    Article  PubMed  Google Scholar 

  • Lambert, M. J., Whipple, J. L., Hawkins, E. J., Vermeersch, D. A., Nielsen, S. L., & Smart, D. W. (2003). Is it time for clinicians to routinely track patient outcome? A meta-analysis. Clinical Psychology: Science and Practice, 10(3), 288–301.

    Google Scholar 

  • Landis-Lewis, Z., Brehaut, J. C., Hochheiser, H., Douglas, G. P., & Jacobson, R. S. (2015). Computer-supported feedback message tailoring: theory-informed adaptation of clinical audit and feedback for learning and behavior change. Implementation Science, 10(1), 12.

    Article  PubMed  PubMed Central  Google Scholar 

  • Lewis, C. C., Boyd, M., Beidas, R. S., Lyon, A. R., Chambers, D., Aarons, G., & Mittman, B. (2015, December). A research agenda for mechanistic dissemination and implementation research. In Presentation at the Conference on the Science of Dissemination and Implementation. Bethesda, MD.

  • Lewis, C. C., Scott, K., Marti, C. N., Marriott, B. R., Kroenke, K., Putz, J. W., et al. (2015b). Implementing measurement-based care (iMBC) for depression in community mental health: a dynamic cluster randomized trial study protocol. Implementation Science, 10(1), 1–14.

    Article  Google Scholar 

  • Lyon, A. R., Lewis, C. C., Boyd, M., Melvin, A., Nicodimos, S., Liu, F., et al. Health Information Technologies—Academic and Commercial Evaluation (HIT-ACE) methodology: Description and application to clinical feedback systems (under review).

  • Lyon, A. R., Wasse, J. K., Ludwig, K., Zachry, M., Bruns, E. J., Unützer, J., & McCauley, E. (2015). The Contextualized Technology Adaptation Process (CTAP): Optimizing health information technology to improve mental health systems. Administration and Policy in Mental Health and Mental Health Services Research. doi:10.1007/s10488-015-0637-x.

  • Nadeem, E., Cappella, E., Holland, S., Coccaro, C., & Crisonino, G. (2015). Development and piloting of a classroom‐focused measurement feedback system. Administration and Policy in Mental Health and Mental Health Services Research. doi:10.1007/s10488-015-0651-z.

  • Norman, D. A., & Draper, S. W. (Eds.). (1986). User centered system design: New perspectives on human-computer interaction. Hillsdale, NJ: Lawrence Erlbaum Associates.

    Google Scholar 

  • Patient Protection and Affordable Care Act of 2010. (2010). Pub. L. No. 111-148, § 6301, 124 Stat. 727

  • Riemer, M., Rosof-Williams, J., & Bickman, L. (2005). Theories related to changing clinician practice. Child and Adolescent Psychiatric Clinics of North America, 14(2), 241–254.

    Article  PubMed  Google Scholar 

  • Rogers, E. M. (2010). Diffusions of innovations (6th ed.). New York: Free Press.

    Google Scholar 

  • Scott, K., & Lewis, C. C. (2015). Using measurement-based care to enhance any treatment. Cognitive and Behavioral Practice, 22(1), 49–59. doi:10.1016/j.cbpra.2014.01.010.

    Article  Google Scholar 

  • Steinfeld, B., Franklin, A., Mercer, B., Fraynt, R., & Simon, G. (2015). Progress monitoring in an integrated health care system: Tracking behavioral health vital signs. Administration and Policy in Mental Health and Mental Health Services Research. doi:10.1007/s10488-015-0648-7.

  • Suominen, K., Isometsä, E., Suokas, J., Haukka, J., Achte, K., & Lönnqvist, J. (2004). Completed suicide after a suicide attempt: a 37-year follow-up study. American Journal of Psychiatry, 161(3), 562–563.

    Article  PubMed  Google Scholar 

Download references

Funding

Work on this publication was supported by the Seattle Children’s Research Institute, Center for Child Health, Behavior and Development (CCHBD); and the National Institute of Mental Health (NIMH) under award numbers K08MH095939 and R01MH103310.

Author information

Author notes

    Authors and Affiliations

    1. Department of Psychiatry & Behavioral Sciences, University of Washington, 1959 NE Pacific Street, Box 356560, Rm BB1644, Seattle, WA, 98195-6560, USA

      Aaron R. Lyon, Cara C. Lewis, Ethan Hendrix & Freda Liu

    2. Department of Psychological and Brain Sciences, Indiana University, 1101 E. 10th St., Bloomington, IN, 47405, USA

      Cara C. Lewis & Meredith R. Boyd

    Authors
    1. Aaron R. Lyon
      View author publications

      You can also search for this author in PubMed Google Scholar

    2. Cara C. Lewis
      View author publications

      You can also search for this author in PubMed Google Scholar

    3. Meredith R. Boyd
      View author publications

      You can also search for this author in PubMed Google Scholar

    4. Ethan Hendrix
      View author publications

      You can also search for this author in PubMed Google Scholar

    5. Freda Liu
      View author publications

      You can also search for this author in PubMed Google Scholar

    Corresponding author

    Correspondence to Aaron R. Lyon.

    Ethics declarations

    Conflict of interest

    All authors declare that they have no conflicts of interest.

    Ethical approval

    This article does not contain any studies with human participants performed by any of the authors.

    Additional information

    Aaron R. Lyon and Cara C. Lewis have contributed equally to this work.

    Rights and permissions

    Reprints and permissions

    About this article

    Check for updates. Verify currency and authenticity via CrossMark

    Cite this article

    Lyon, A.R., Lewis, C.C., Boyd, M.R. et al. Capabilities and Characteristics of Digital Measurement Feedback Systems: Results from a Comprehensive Review. Adm Policy Ment Health 43, 441–466 (2016). https://doi.org/10.1007/s10488-016-0719-4

    Download citation

    • Published:

    • Issue Date:

    • DOI: https://doi.org/10.1007/s10488-016-0719-4

    Keywords

    Search

    Navigation