Abstract
With the growing emphasis on accountability in mental health services, outcomes management strategies are gaining popularity. However, for these techniques to be credible, it is necessary to ensure the reliability of clinical data. In other words, outcomes measures must accurately reflect the actual status of service recipients. This article presents the use of the measurement audit as one means of monitoring and improving the reliability of outcomes measurements. The methods and findings from an audit of crisis assessment workers for children in state custody are presented. Clinical assessments completed at the time of service were compared with assessments using the same measure completed via retrospective file review. Findings suggest generally good reliability, 0.72 overall, with some variation by provider and type of information.
This is a preview of subscription content, log in via an institution to check access.
References
Steinwachs DM, Flynn LM, Norquist G, Skinner EA, eds.Using Client Outcomes Information To Improve Mental Health and Substance Abuse Treatment. In:New Directions for Mental Health, no. 71. San Francisco: Jossey-Bass; 1996.
Aaronson LS, Burman ME. Use of health records in research: reliability and validity issues.Research in Nursing and Health. 1994;17:67–73.
Canfield M, Clarkin J, Lolafaye C, Grob M. Reliability of data taken from medical charts.The Psychiatric Hospital. 1986;17:173–179.
Burns BJ. What drives outcomes for emotional and behavioral disorders in children and adolescents? In: Steinwachs DM, Flynn LM, Norquist G, Skinner EA, eds.Using Client Outcomes Information To Improve Mental Health and Substance Abuse Treatment. In:New Directions for Mental Health, no. 71. San Francisco: Jossey-Bass; 1996.
Sederer LI, Dickey B, Hermann RC. The imperative of outcomes assessments in psychiatry. In: Sederer LI, Dickey B, eds.Outcomes Assessment in Clinical Practice. Baltimore, MD: Williams & Wilkins; 1996.
Strupp HH, Hadley SW. A tripartite model of mental health and therapeutic outcomes.American Psychologist. 1977;32:187–196.
Connolly MA, Ritchie S. An audit of in-patients aged 18–65 in acute psychiatric wards who are inappropriately placed three months after admission.Health Bulletin. 1997;55:156–161.
Wyatt J. Acquisition and use of clinical data for audit and research.Journal of Evaluation in Clinical Practice. 1995;1:15–27.
Stange KC, Zyanski SJ, Smith TF, et al. How valid are medical records and patient questionnaires for physician profiling and health services research? A comparison of direct observation of patient visits.Medical Care. 1998;36:851–867.
Lyons JS, Mintzer LL, Kisiel CL, Shallcross H. Understanding the mental health needs of children and adolescents in residential treatment.Professional Psychology: Research and Practice. 1998;29:582–587.
Leon SC, Uziel-Miller ND, Lyons JS, Tracy P. Psychiatric hospital service utilization of children and adolescents in state custody.Journal of the Academy of Child & Adolescent Psychiatry. 1999;38:305–310.
Lyons JS.The Severity and Acuity of Psychiatric Illness—Child and Adolescent Version. San Antonio, TX: The Psychological Corporation, Harcourt Brace; 1998.
Maclure M, Willet WC. Misinterpretation and misuse of the kappa statistic.American Journal of Epidemiology. 1987;126:161–169.
Foster H, Lieberman S. Adequacy of family history recording in psychiatric in-patient case notes.Journal of Mental Health. 1994;3:51–57.
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Lyons, J.S., Rawal, P., Yeh, I. et al. Use of measurement audit in outcomes management. The Journal of Behavioral Health Services & Research 29, 75–80 (2002). https://doi.org/10.1007/BF02287834
Issue Date:
DOI: https://doi.org/10.1007/BF02287834