Abstract
The Colorado Symptom Index (CSI: Shern et al. 1994, Milbank Quart 72:123–148) is widely used in research as a self-report measure of psychiatric symptomatology, yet little information exists regarding the scale’s psychometric properties. Additionally, the CSI has no cut-off score denoting the need for further psychiatric assessment. This study examined the CSI’s psychometric properties and established a cut-off score. Analyses were based on 3,874 adult Florida Medicaid respondents. The CSI had excellent internal consistency (.92) and test-retest reliability (.71). Evidence of the CSI’s validity was strong; CSI scores distinguished among individuals with and without mental health services needs and were significantly correlated with functioning. Results using a contrasting groups approach indicate that 30 is a reasonable “clinical” cut-off score. At this score, the CSI had respectable sensitivity (.76) and specificity (.68) and a ROC curve analysis suggests that the CSI is “fair to good” discriminator of individuals with psychiatric disabilities.
This is a preview of subscription content, log in via an institution to check access.
Similar content being viewed by others
References
Addy, J., Mundil, K., Parker, T., & Talbott, P. (2008). Intensive case management for behavioral health jail diversion: The Lancaster county, Nebraska approach. American Jails, 21(6), 31–40.
Boothroyd, R. A., & Shern, D. L. (1998). Accessing the feasibility of using mail survey Methodology with Medicaid enrollees: A summary of a pilot study for the member survey. Tampa, FL: Louis de la Parte Florida Mental Health Institute, University of South Florida.
Ciarlo, J. A., & Reihman, J. (1977). The Denver community mental health questionnaire: Development of a multi-dimensional program evaluation instrument. In R. Coursey, G. Spector, S. Murrell, & B. Hunt (Eds.), Program evaluation for mental health: Methods, strategies, and participants (pp. 131–167). New York: Grune and Stratton.
Ciarlo, J. A., Edwards, D. W., Kiresuk, T. J., et al. (1981). The assessment of client/patient outcome: Techniques for use in mental health programs (Contract No. 278-80-0005). Washington, DC: National Institute of Mental Health.
Clark, C., & Rich, A. (2003). Outcomes of homeless adults with mental illness in a housing program and in case management only. Psychiatric Services (Washington, DC), 54, 78–83. doi:10.1176/appi.ps.54.1.78.
Cohen, J. (1988). Statistical power analysis for the behavioral sciences (2nd ed.). Hillsdale, NJ: Lawrence Earlbaum Associates.
Conrad, K. J., Yagelka, J. R., Matters, M. D., Rich, A. R., Williams, V., & Buchanan, M. (2001). Reliability and validity of a Modified Colorado Symptom Index in a national homeless sample. Mental Health Services Research, 3(3), 141–153. doi:10.1023/A:1011571531303.
Dillman, D. A. (1978). Mail and telephone surveys: The total design method. New York: Wiley.
Ellis, R., Wilson, N., & Foster, F. (1984). Statewide treatment outcome assessment in Colorado: The Colorado Client Assessment Record (CCAR). Community Mental Health Journal, 20, 72–88. doi:10.1007/BF00754105.
Godfrey, J., Salyers, M., Mueser, K., & Labriola, S. (2006) Psychometrics of a recovery scale. Paper presented in the Conference on State Mental Health Agency Services Research, Program Evaluation and Policy Research to Inform the System Transformation Process. February 13, 2006.
Greenwood, R. M., Schaefer-McDaniel, N. J., Winkel, G., & Tsemberis, S. J. (2005). Decreasing psychiatric symptoms by increasing choice in services for adults with histories of homelessness. American Journal of Community Psychology, 36(3/4), 223–238. doi:10.1007/s10464-005-8617-z.
Griner, P. F., Mayewski, R. J., Mushlin, A. I., & Greenland, P. (1981). Selection and interpretation of diagnostic tests and procedures. Annals of Internal Medicine, 94, 555–600.
Kahng, S. K., Oyserman, D., Bybee, D., & Mowbray, C. (2008). Mothers with severe mental illness: When symptom declines, does parenting improve? Journal of Family Psychology, 22(1), 162–166. doi:10.1037/0893-3200.22.1.162.
Hanley, J. A., & McNeil, B. J. (1982). The meaning and use of the area under a Receiver Operating Characteristic (ROC) curve. Radiology, 43, 29–36.
Laudet, A. B., Magura, S., Cleland, C. M., Vogel, H. S., Knight, E. L., & Rosenblum, A. (2004). The effect of 12-Step based fellowship participation on abstinence among dually diagnosed persons: A 2-year longitudinal study. Journal of Psychoactive Drugs, 36(2), 207–221.
Lee, B., Shern, D., Coen, A., Bartsch, D., & Wilson, N. (2003).The Colorado Symptom Index: A measure of symptom distress for persons with severe and persistent mental illness. Unpublished Manuscript.
Lehman, A. F., Dixon, L. B., Kernan, E., DeForge, B. R., & Postrado, L. T. (1997). A randomized trail of assertive community treatment for homeless persons with severe mental illness. Archives of General Psychiatry, 54(11), 1038–1043.
Livingston, S. A., & Zieky, M. J. (1982). Passing scores. Princeton, NJ: Educational Testing Service.
Magura, S., Laudet, A. B., Mahmood, D., Rosenblum, A., Vogel, H. S., & Knight, E. L. (2003). Role of self-help processes in achieving abstinence among dually diagnosed persons. Addictive Behaviors, 28, 399–413. doi:10.1016/S0306-4603(01)00278-7.
Marx, R. G., Menezes, A., Horovitz, L., Jones, E. C., & Warren, R. F. (2003). A comparison of two time intervals for test-retest reliability of health status instruments. Journal of Clinical Epidemiology, 56(8), 730–735. doi:10.1016/S0895-4356(03)00084-2.
Mowbray, C. T., Bybee, D., Oyserman, D., & MacFarlane, P. (2005). Timing of mental illness onset and motherhood. The Journal of Nervous and Mental Disease, 193(6), 369–378. doi:10.1097/01.nmd.0000165088.82453.bd.
Murry-Swank, A., Goldberg, R., Dickerson, F., Medoff, D., Wohleiter, K., & Dixon, L. (2007). Correlates of religious service attendance and contact with religious leaders among persons with co-occurring serious mental illness and Type 2 diabetes. The Journal of Nervous and Mental Disease, 195(5), 382–388.
Nunnally, J. C., & Bernstein, I. H. (1994). Psychometric theory (3rd ed., pp. 264–265). New York, NY: McGraw-Hill Series in Psychology, McGraw-Hill, Inc.
Salant, P. A., & Dillman, D. A. (1994). How to conduct your own survey. New York: Wiley.
Salyers, M. P., Bosworth, H. B., Swanson, J. W., Lamb-Pagone, J., & Osher, F. C. (2000). Reliability and validity of the SF-12 health survey among people with sever mental illness. Medical Care, 38(11), 1141–1150. doi:10.1097/00005650-200011000-00008.
Shern, D. L., Wilson, N. Z., Coen, A. S., Patrick, D. C., Foster, M., Bartsch, D. A., et al. (1994). Client outcomes II: Longitudinal client data from the Colorado Treatment Outcome Study. The Milbank Quarterly, 72, 123–148. doi:10.2307/3350341.
Tsemberis, S., Gulcur, L., & Nakae, M. (2004). Housing first, consumer choice, and harm reduction for homeless individuals with a dual diagnosis. American Journal of Public Health, 94(4), 651–656.
Ware, J. E., Kosinski, M., & Keller, S. D. (1995). SF-12: How to score the SF-12 physical and mental health summary scales. Boston, MA: The Health Institute.
Ware, J., Jr, Kosinski, M., & Keller, S. D. (1996). A 12-item short-form health survey: Construction of scales and preliminary tests of reliability and validity. Medical Care, 32(3), 220–233. doi:10.1097/00005650-199603000-00003.
Zweig, M. H., & Campbell, G. (1993). Receiver-operating characteristic (ROC) plots: A fundamental evaluation tool in clinical medicine. Clinical Chemistry, 39, 561–577.
Acknowledgement
The study was funded in part through a contract with the Florida Agency for Health Care Administration.
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Boothroyd, R.A., Chen, H.J. The Psychometric Properties of the Colorado Symptom Index. Adm Policy Ment Health 35, 370–378 (2008). https://doi.org/10.1007/s10488-008-0179-6
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s10488-008-0179-6