Abstract
Computerized administration of mental health-related questionnaires has become relatively common, but little research has explored this mode of assessment in “real-world” settings. In the current study, 200 consumers at a community mental health center completed the BASIS-24 via handheld computer as well as paper and pen. Scores on the computerized BASIS-24 were compared with scores on the paper BASIS-24. Consumers also completed a questionnaire which assessed their level of satisfaction with the computerized BASIS-24. Results indicated that the BASIS-24 administered via handheld computer was highly correlated with pen and paper administration of the measure and was generally acceptable to consumers. Administration of the BASIS-24 via handheld computer may allow for efficient and sustainable outcomes assessment, adaptable research infrastructure, and maximization of clinical impact in community mental health agencies.
References
Beutler LE, Malik M, Talebi H, et al. Use of psychological tests/instruments for treatment planning. In: Marush ME, (ed). The Use of Psychological Testing for Treatment Planning and Outcomes Assessment. Mahwah, NJ: Lawrence Erlbaum Associates; 2004:111–146.
Derogatis LR, Culpepper WJ. Screening for psychiatric disorders. In: Marush ME, ed. The Use of Psychological Testing for Treatment Planing and Outcomes Assessment. Mahwah, NJ: Lawrence Erlbaum Associates; 2004:65–110.
Lambert MJ, Hawkins EJ. Use of psychological tests for assessing treatment outcomes. In: Marush ME, ed. The Use of Psychological Testing for Treatment Planning and Outcomes Assessment. Mahwah, NJ: Lawrence Erlbaum Associates; 2004:171–195
Palen L-A, Graham JW, Smith EA, et al. Rates of missing responses in personal digital assistant (PDA) versus paper assessments. Evaluation Review. 2008;32:257–272.
Ahluwalia MK. Multicultural issues in computer-based assessment. In: Suzuki LA, Ponterotto JG, eds. Handbook of multicultural assessment: Clinical, psychological, and educational applications. 3 rd ed. San Francisco, CA: Jossey-Bass; 2008:92–106.
Wolford G, Rosenberg SD, Rosenberg HJ, et al.A Clinical Trial Comparing Interviewer and Computer-Assisted Assessment Among Clients With Severe Mental Illness. Psychiatric Services. 2008;59:769–775.
Eisen SV, Toche-Manley LL, Grissom GR. Computer-Administered Versus Paper-and-Pencil Mental Health Surveys. Psychiatric Services. 2004;55:1316–1317.
Kobak KA, Greist JH, Jefferson JW, et al. Computer-administered clinical rating scales: A review. Psychopharmacology. 1996;127:291–301.
Chinman M, Young AS, Schell T, et al. Computer-assisted self-assessment in persons with severe mental illness. Journal of Clinical Psychiatry. 2004;65:1343–1351.
Schmitz N, Hartkamp N, Brinschwitz C, et al. Computerized administration of the Symptom Checklist (SCL-90-R) and the Inventory of Interpersonal Problems (IIP-C) in psychosomatic outpatients. Psychiatry Research. 1999;87:217–221.
Wijndaele K, Matton L, Duvigneaud N, et al. Reliability, equivalence, and respondent preference of computerized versus paper-and-pencil mental health questionnaires. Computers in Human Behavior. 2007;23:1958–1970.
Chan-Pensley E. Alcohol-use disorders identification test: A comparison between paper and pencil and computerized versions. Alcohol & Alcoholism. 1999;34:882–885.
Cook IA, Balasubramani GK, Eng H, et al. Electronic source materials in clinical research: Acceptability and validity of symptom self-rating in major depressive disorder. Journal of Psychiatric Research. 2007;41:737–743.
Gwaltney CJ, Shields AL, Shiffman S. Equivalence of electronic and paper-and pencil administration of patient-reported outcome measures: A meta-analytic review. Value in Health. 2008;11:322–333.
Weber B, Schneider B, Fritze J, et al. Acceptance of computerized compared to paper-and-pencil assessment in psychiatric inpatients. Computers in Human Behavior. 2003;19:81–93.
Summerville A, Roese NJ. Dare to compare: Fact-based versus simulation based comparison in daily life. Journal of Experimental Social Psychology. 2008;44:664–671.
Epstein DH, Willner-Reid J, Vahabzadeh M, et al. Real-time electronic diary reports of cue exposure and mood in the hours before cocaine and heroin craving and use. Archives of General Psychiatry. 2009;66:88–94.
Muehlenkamp JJ, Engel SG, Wadeson A, et al. Emotional state preceding and following acts of non-suicidal self-injury in bulimia nervosa patients. Behaviour Research and Therapy. 2009;47:83–87.
Bernhardt JM, Usdan S, Mays D, et al. Alcohol assessment using wireless handheld computers: A pilot study. Addictive Behaviors. 2007;32:3065–3070.
Younger J, Mackey S. Fibromyalgia symptoms are reduced by low-dose naltrexone. Pain Medicine. 2009;10:663–672.
Verduyn P, Delvaux E, Van Coillie H, et al. Predicting the duration of emotional experience: Two experience sampling studies. Emotion. 2009;9:83–91.
Granholm E, Loh C, Swendsen J. Feasibility and validity of computerized ecological momentary assessment in schizophrenia. Schizophrenia Bulletin. 2008;34:507–514.
Shannon LM, Walker R, Blevins M. Developing a new system to measure outcomes in a service coordination program for youth with severe emotional disturbance. Evaluation and Program Planning. 2009;32:109–118.
Eisen SV, Normand SL, Belanger AJ, et al. The Revised Behavior and Symptom Identification Scale (BASIS-R): Reliability and validity. Medical Care. 2004;42:1230–1341.
Eisen SV, Gerena M, Ranganathan G, et al. Reliability and validity of the BASIS-24 mental health survey for Whites, African-Americans, and Latinos. Journal of Behavioral Health Services & Research. 2006;33:304–323.
Palmblad M, Tiplady, B. Electronic diaries and questionnaires: Designing user interfaces that are easy for all patients to use. Quality of Life Research. 2004;13:1199–1207.
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Goldstein, L.A., Connolly Gibbons, M.B., Thompson, S.M. et al. Outcome Assessment via Handheld Computer in Community Mental Health: Consumer Satisfaction and Reliability. J Behav Health Serv Res 38, 414–423 (2011). https://doi.org/10.1007/s11414-010-9229-4
Published:
Issue Date:
DOI: https://doi.org/10.1007/s11414-010-9229-4