Skip to main content

Advertisement

SpringerLink
Log in

Factor Analysis of Therapist-Identified Treatment Targets in Community-Based Children’s Mental Health

  • Original Article
  • Published:
Administration and Policy in Mental Health and Mental Health Services Research Aims and scope Submit manuscript

Abstract

The present study used exploratory and confirmatory factor analyses to identify underlying latent factors affecting variation in community therapists’ endorsement of treatment targets. As part of a statewide practice management program, therapist completed monthly reports of treatment targets (up to 10 per month) for a sample of youth (n = 790) receiving intensive in-home therapy. Nearly 75 % of youth were diagnosed with multiple co-occurring disorders. Five factors emerged: Disinhibition, Societal Rules Evasion, Social Engagement Deficits, Emotional Distress, and Management of Biodevelopmental Outcomes. Using logistic regression, primary diagnosis predicted therapist selection of Disinhibition and Emotional Distress targets. Client age predicted endorsement of Societal Rules Evasion targets. Practice-to-research implications are discussed.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1

Similar content being viewed by others

Notes

  1. This study is an additional analysis of data previously used to examine treatment target endorsement rates and outcomes (Love et al. 2014).

  2. WRMR is recommended as an alternative for standardized root mean square residual for categorical data with n-sizes of 250 or greater (Yu 2002).

References

  • Accurso, E. C., Garland, A. F., Haine-Schlagel, R., Brookman-Frazee, L., & Baker-Ericzen, M. J. (2015). Factors contributing to reduce caregiver strain in a publically funded child mental health system. Journal of Emotional and Behavioral Disorders, 23(3), 131–143. doi:10.1177/1063426614532948.

  • American Psychiatric Association (APA). (2013). Diagnostic and statistical manual of mental disorders: DSM-5. Washington, D.C: American Psychiatric Association.

    Book  Google Scholar 

  • Bentler, P. M. (1990). Comparative fit indexes in structural models. Psychological Bulletin, 107, 238–246. doi:10.1037/0033-2909.107.2.238.

    Article  CAS  PubMed  Google Scholar 

  • Bickman, L. (2000). The most dangerous and difficult question in mental health services research. Mental Health Services Research, 2(2), 71–72. doi:10.1023/A:1010100119789.

    Article  Google Scholar 

  • Bird, H. R., Gould, M. S., & Staghezza, B. M. (1993). Patterns of diagnostic comorbidity in a community sample of children aged 9 through 16 years. Journal of the American Academy of Child & Adolescent Psychiatry, 32(2), 361–368. doi:10.1097/00004583-199303000-00018.

    Article  CAS  Google Scholar 

  • Borntrager, C. F., Chorpita, B. F., Higa-McMillan, C., & Weisz, J. (2009). Provider attitudes toward evidence-based practices: Are the concerns with the evidence or the manuals? Psychiatric Services, 60, 677–681. doi:10.1176/ps.2009.60.5.677.

    Article  PubMed  Google Scholar 

  • Borntrager, C. F., Chorpita, B. F., Orimoto, T., Love, A., & Mueller, C. W. (2015). Validity of clinician’s self-reported practice elements on the monthly treatment and progress summary. Journal of Behavioral Health Services & Research, 42(3), 367–382. doi:10.1007/s11414-013-9363-x.  

  • Brookman-Frazee, L., Haine, R. A., Baker-Ericzen, M., Zoffness, R., & Garland, A. F. (2010). Factors associated with use of evidence-based practice strategies in usual care youth psychotherapy. Administration and Policy in Mental Health and Mental Health Services Research, 37, 254–269. doi:10.1007/s10488-009-0244-9.

    Article  PubMed  Google Scholar 

  • Brown, T. A. (2006). Confirmatory factor analysis for applied research. New York: Guilford Press.

    Google Scholar 

  • Caspi, A., Houts, R. M., Belsky, D. W., Goldman-Mellor, S. J., Harrington, H., … Moffitt, T. E. (2014). The p factor: One general psychopathology factor in the structure of psychiatric disorders? Clinical Psychological Science, 2(2), 119–137. doi:10.1177/2167702613497473.

    Article  PubMed  PubMed Central  Google Scholar 

  • Cattell, R. B. (1966). The scree test for the number of factors. Multivariate Behavioral Research, 1(2), 245–276. doi:10.1207/s15327906mbr0102_10.

    Article  CAS  PubMed  Google Scholar 

  • Child and Adolescent Mental Health Division (2008). Instructions and codebook for provider monthly treatment and progress summary. Honolulu, HI: Department of Health Child and Adolescent Mental Health Division.

    Google Scholar 

  • Child and Adolescent Mental Health Division, Hawai’i Department of Health. (2012). Child and Adolescent Mental Health Performance Standards. Retrieved from http://health.hawaii.gov/camhd/files/2013/07/Orange-Book.pdf.

  • Chorpita, B. F., & Daleidan, E. L. (2014). Structuring the collaboration of science and service in pursuit of a shared vision. Journal of Clinical Child & Adolescent Psychology, 43(2), 323–338. doi:10.1080/15374416.2013.828297.

    Article  Google Scholar 

  • Chorpita, B. F., & Donkervoet, C. (2004). Implementation of the Felix Consent Decree in Hawaii: The impact of policy and practice development efforts on service delivery. In R. G. Steele & M. C. Roberts (Eds.), Handbook of mental health services for children, adolescents, and families (pp. 317–332). New York: Kluwer.

    Google Scholar 

  • Chorpita, B. F., Yim, L. M., Donkervoet, J. C., Arensdorf, A. M., Amundsen, M. J., … Morelli, P. (2002). Toward large-scale implementation of empirically supported treatments for children: A review and observations by the Hawaii Empirical Basis to Services Task Force. Clinical Psychology: Science and Practice, 9(2), 165–190. doi:10.1111/j.1468-2850.2002.tb00504.x.

  • Clark, L. A., & Watson, D. (1995). Constructing validity: Basic issues in objective scale development. Psychological Assessment, 7(3), 309–319. doi:10.1037/1040-3590.7.3.309.

    Article  Google Scholar 

  • Comrey, A. L. (1988). Factor-analytic methods of scale development in personality and clinical psychology. Journal of Consulting and Clinical Psychology, 56, 754–761. doi:10.1037/0022-006X.56.5.754.

    Article  CAS  PubMed  Google Scholar 

  • Daleiden, E. L., & Chorpita, B. F. (2005). From data to wisdom: Quality improvement strategies supporting large-scale implementation of evidence-based services. Child and Adolescent Psychiatric Clinics of North America, 14(2), 329–349. doi:10.1016/j.chc.2004.11.002.

    Article  PubMed  Google Scholar 

  • Daleiden, E. L., Chorpita, B. F., Donkervoet, C., Arensdorf, A. M., & Brogan, M. (2006). Getting better at getting them better: Health outcomes and evidence-based practice within a system of care. Journal of the American Academy of Child and Adolescent Psychiatry, 45(6), 749–456. doi:10.1097/01.chi/0000215154.07142.63.

    Article  PubMed  Google Scholar 

  • Daleiden, E. L., Lee, J., & Tolman, R. (2004). Annual evaluation report: Fiscal year 2004. Honolulu, HI: Hawai’i Department of Health Child and Adolescent Mental Health Division.

    Google Scholar 

  • Garland, A. F., Bickman, L., & Chorpita, B. F. (2010). Change what? Identifying quality improvement targets by investigating usual mental health care. Administration and Policy in Mental Health and Mental Health Services Research, 37, 15–26. doi:10.1007/s10488-010-0279y.

    Article  PubMed  PubMed Central  Google Scholar 

  • Garland, A. F., Brookman-Frazee, L., Hurlburt, M. S., Accurso, E. C., Zoffness, R. J., … Ganger, W. (2010). Mental health care for children with disruptive behavior problems: A view inside therapists’ offices. Psychiatric Services, 61, 788–795. doi:10.1176/ps.2010.61.8.788.

    Article  PubMed  PubMed Central  Google Scholar 

  • Garland, A. F., Hough, R., McCabe, K., Yeh, M., Wood, P., & Aarons, G. (2001). Prevalence of psychiatric disorders for youths in public sectors of care. Journal of the American Academy of Child and Adolescent Psychiatry, 40, 409–418. doi:10.1097/00004583-200104000-00009.

    Article  CAS  PubMed  Google Scholar 

  • Harman, J. S., Childs, G. E., & Kelleher, K. J. (2000). Mental health care utilization and expenditures by children in foster care. Archives of Pediatric Medicine, 154, 1114–1117. doi:10.1001/archpedi.154.11.1114.

    Article  CAS  Google Scholar 

  • Higa-McMillan, C., Powell, C. K. K., Daleiden, E., & Mueller, C. (2011). Pursuing an evidence-based culture through contextualized feedback: Aligning youth outcomes and provider practices. Professional Psychology: Research and Practice, 42, 137–144. doi:10.1037/a0022139.

    Article  Google Scholar 

  • Hoagwood, K., & Kolko, D. J. (2009). Introduction to the special section on practice contexts: A glimpse into the nether world of public mental health services for children and families. Administration and Policy in Mental Health and Mental Health Services Research, 36(1), 35–36. doi:10.1007/s10488-008-0201-z.

  • Hodges, K. (1998). Child and adolescent functional assessment scale (CAFAS). Ann Arbor, MI: Functional Assessment Systems.

    Google Scholar 

  • Hu, L. T., & Bentler, P. M. (1999). Cutoff criteria for fit indexes in covariance structure analysis: Conventional criteria versus new alternatives. Structural Equation Modeling: A Multidisciplinary Journal, 6(1), 1–55. doi:10.1080/10705519909540118.

    Article  Google Scholar 

  • IBM Corp. (2013). IBM SPSS Statistics for Macintosh, Version 22.0. Armonk, NY: IBM Corp.

    Google Scholar 

  • Jackson, D. L., Gillaspy, J. A. Jr., & Purc-Stephenson, R. (2000). Reporting practices in confirmatory factor analysis: An overview and some recommendations. Psychological Methods, 14(1), 6–23. doi:10.1037/a0014694.

    Article  Google Scholar 

  • Kelley, S. D., de Andrade, A. R. V., Sheffer, E., & Bickman, L. (2010). Exploring the black box: Measuring youth treatment process and progress in usual care. Administration and Policy in Mental Health and Mental Health Services Research, 37(3), 287–300. doi:10.1007/s10488-010-0298-8.

    Article  PubMed  Google Scholar 

  • Kessler, R. C., Avenevoli, S., Costello, E. J., Georgiades, K., Green, J. G., Gruber, M. J., … Merikangas, K. R. (2012). Prevalence, persistence, and sociodemographic correlates of DSM-IV disorders in the National Comorbidity Survey Replication Adolescent Supplement. Archives of General Psychiatry, 69(4), 372–380. doi:10.1001/archgenpsychiatry.2011.160.

    Article  PubMed  Google Scholar 

  • Kiresuk, T. J., & Sherman, M. R. E. (1968). Goal attainment scaling: A general method for evaluating comprehensive community mental health programs. Community Mental Health Journal, 4(6), 443–453. doi:10.1007/BF01530764.

    Article  CAS  PubMed  Google Scholar 

  • Kolko, D. J., Dorn, L. D., Bukstein, O. G., Pardini, D., Holden, E. A., & Hart, J. (2009). Community vs. clinic-based modular treatment of children with early-onset ODD or CD: A clinical trial with 3-year follow-up. Journal of Abnormal Child Psychology, 37(5), 591–609. doi:10.1007/s10802-009-9303-7.

    Article  PubMed  PubMed Central  Google Scholar 

  • Kolko, D. J., Lindhiem, O., Hart, J., & Bukstein, O. G. (2014). Evaluation of a booster intervention three years after acute treatment for early-onset disruptive behavior disorders. Journal of Abnormal Child Psychology, 42(3), 383–398. doi:10.1007/s10802-013-9724-1.

    Article  PubMed  PubMed Central  Google Scholar 

  • Krueger, R. F., & Markon, K. E. (2006). Reinterpreting comorbidity: A model-based approach to understanding and classifying psychopathology. Annual Review of Clinical Psychology, 2, 111–133. doi:10.1146/annurev.clinpsy.2022305.095213.

    Article  PubMed  PubMed Central  Google Scholar 

  • Lewinsohn, P. M., Rohde, P., Seeley, J. R., & Baldwin, C. L. (2001). Gender differences in suicide attempts from adolescence to young adulthood. Journal of the American Academy of Child & Adolescent Psychiatry, 40(4), 427–434. doi:10.1097/00004583-200104000-00011.

    Article  CAS  Google Scholar 

  • Loeber, R., Burke, J. D., Lahey, B. B., Winters, A., & Zera, M. (2000). Oppositional defiant and conduct disorder: A review of the past 10 years, part I. Journal of American Academy of Child & Adolescent Psychiatry, 39(12), 1468–1484. doi:10.1097/00004583-200012000-00007.

    Article  CAS  Google Scholar 

  • Love, A. R., Mueller, C. W., Tolman, R. T., & Powell, A. K. (2014). Frequency, level, and rate of improvement for treatment targets in a children’s mental health community-based intensive in-home therapeutic setting. Administration and Policy in Mental Health and Mental Health Services Research, 41(4), 421–433. doi:10.1007/s10488-013-0480-x.

    Article  PubMed  Google Scholar 

  • Matsunaga, M. (2010). How to factor-analyze your data right: Do’s, don’ts, and how-to’s. International Journal of Psychological Research, 3(1), 97–110.

    Article  Google Scholar 

  • Milette-Winfree, M., Mueller, C. W., Hee, P. J., & Runland, A. (2014). Therapists target externalizing problems over internalizing problems when treating comorbid youth. Poster accepted for presentation at the Forty-Eighth Annual Convention of the Association for Behavioral and Cognitive Therapies, Philadelphia, PA.

  • Mitton, C., Adair, C. E., McKenzie, E., Patten, S. B., & Perry, B. W. (2007). Knowledge transfer and exchange: Review and synthesis of the literature. Milbank Quarterly, 85(4), 729–768. doi:10.1111/j.1468-0009.2007.00506.x.

    Article  PubMed  PubMed Central  Google Scholar 

  • Moffitt, T. E. (1993). Adolescence-limited and life-course-persistent antisocial behavior: A developmental taxonomy. Psychological Review, 100(4), 674–701. doi:10.1037/0033-295X.100.4.674.

    Article  CAS  PubMed  Google Scholar 

  • Mueller, C., Tolman, R., Higa-McMillan, C. K., & Daleiden, E. (2010). Longitudinal predictors of youth functional improvement in a public mental health system. Journal of Behavioral Health Services and Research, 37, 350–362. doi:10.1007/s11414-009-9172-4.

    Article  PubMed  Google Scholar 

  • Muthén, B., Du Toit, S. H., & Spisic, D. (1997). Robust inference using weighted least squares and quadratic estimating equations in latent variable modeling with categorical and continuous outcomes. Psychometrika, 75, 1–45.

    Google Scholar 

  • Muthén, L. K., & Muthén, B. O. (2011). Mplus user’s guide (6th edn.). Los Angeles, CA: Muthén & Muthén.

    Google Scholar 

  • Nakamura, B. J., Daleiden, E. L., & Mueller, C. W. (2007). Validity of treatment target progress ratings as indicators of youth improvement. Journal of Child and Family Studies, 16(5), 729–741. doi:10.1007/s10826-006-9119-9.

    Article  Google Scholar 

  • Nelson, T. D., & Steele, R. G. (2007). Predictors of practitioner self-reported use of evidence-based practices: Practitioner training, clinical setting, and attitudes toward research. Administration and Policy in Mental Health and Mental Health Research Services, 34, 319–330. doi:10.1007/s10488-006-0111-x.

    Article  Google Scholar 

  • Nezu, A. M., & Nezu, C. M. (1993). Identifying and selecting target problems for clinical interventions: A problem-solving model. Psychological Assessment, 5(3), 254–263. doi:10.1037//1040-3590.5.3.254.

    Article  Google Scholar 

  • Nock, M. K., Green, J. G., Hwang, I., McLaughlin, K. A., Sampson, N. A., Zaslavsky, A. M., & Kessler, R. C. (2013). Prevalence, correlates, and treatment of lifetime suicidal behavior among adolescents: Results from the National Comorbidity Survey Replication Adolescent Supplement. JAMA Psychiatry, 70(3), 300–310. doi:10.1001/2013.jamapsychiatry.55.

    Article  PubMed  Google Scholar 

  • Norcross, J. C., Karpiak, C. P., & Lister, K. M. (2005). What’s an integrationist? A study of self-identified integrative and (occasionally) eclectic psychologists. Journal of Clinical Psychology, 61, 1587–1594. doi:10.1002/jclp.20203.

    Article  PubMed  Google Scholar 

  • Nunnally, J. C. (1978). Psychometric theory (2nd edn.). New York: McGraw Hill.

    Google Scholar 

  • Orimoto, T. E., Higa-McMillan, C. K., Mueller, C. W., & Daleiden, E. L. (2012). Assessment of therapy practices in community treatment for children and adolescents. Psychiatric Services, 63(4), 343–350. doi:10.1176/appi.ps.201100129.

    Article  PubMed  Google Scholar 

  • Orimoto, T. E., Mueller, C. W., Hayashi, K., & Nakamura, B. J. (2014). Community-based treatment for youth with co-and multimorbid disruptive behavior disorders. Administration and Policy in Mental Health and Mental Health Services Research, 41(2), 262–275. doi:10.1007/s10488-012-0464-2.

    Article  PubMed  Google Scholar 

  • Schmitt, T. A. (2011). Current methodological considerations in exploratory and confirmatory factor analysis. Journal of Psychoeducational Assessment, 29(4), 304–321. doi:10.1177/0734282911406653.

    Article  Google Scholar 

  • Starin, A. C., Atkins, M. S., Wehrmann, K. C., Mehta, T., Hesson-McInnis, M. S., Marinez-Lora, A., & Mehlinger, R. (2014). Moving science into state child and adolescent mental health systems: Illinois evidence-informed practice initiative. Journal of Clinical Child & Adolescent Psychology, 43(2), 169–178. doi:10.1080/15374416.2013.848772.

    Article  Google Scholar 

  • Substance Abuse and Mental Health Services Administration (SAMHSA). (2011). The comprehensive community mental health services for children and their families program: Evaluation findings—Annual report to Congress 2011 (DHHS publication no. PEP13-CMHI2011). Washington, DC: Substance Abuse and Mental Health Services Administration (SAMHSA). Retrieved from http://store.samhsa.gov/product/The-Comprehensive-Community-Mental-Health-Services-for-Children-and-Their-Families-Program-Evaluation-Findings/PEP13-CMHI2011.

  • Substance Abuse and Mental Health Services Administration (SAMHSA). (2013). Promoting recovery and independence for older adolescents and young adults who experience serious mental health challenges (HHS Publication No. SMA-13-4756). Washington, DC: Substance Abuse and Mental Health Services Administration (SAMHSA). Retrieved from http://store.samhsa.gov/shin/content//SMA13-4756/SMA13-4756.pdf.

  • Tabachnick, B. G. & Fidell, L. S. (2001). Using Multivariate Statistics (4th edn.). Needham Heights, MA: Allyn and Bacon.

    Google Scholar 

  • Trask, E. V., & Garland, A. F. (2012). Are children improving? Results from outcome measurement in a large mental health system. Administration and Policy in Mental Health and Mental Health Services Research, 39, 210–220. doi:10.1007/s10488-011-0353-0.

    Article  PubMed  Google Scholar 

  • Vaughan, E. L., Feinn, R., Bernard, S., Brereton, M., & Kaufman, J. S. (2013). Relationships between child emotional and behavioral symptoms and caregiver strain and parenting stress. Journal of Family Issues, 34(4), 534–556. doi:10.1177/0192513X12440949.

    Article  PubMed  Google Scholar 

  • Weersing, R. V., Weisz, J. R., & Donenberg, G. R. (2002). Development of the Therapy Procedures Checklist: A therapist-report measure of technique use in child and adolescent treatment. Journal of Clinical Child Psychology, 31, 168–180. doi:10.1207/153744202753604458.

    Article  Google Scholar 

  • Weisz, J. R., Chorpita, B. F., Frye, A., Ng, M. Y., Lau, N., … The Research Network on Youth Mental Health (2011). Youth top problems: Using idiographic, consumer-guided assessment to identify treatment needs and to track change during psychotherapy. Journal of Consulting and Clinical Psychology, 79(3), 369–380. doi:10.1037/a0023307.

    Article  PubMed  Google Scholar 

  • Weisz, J. R., Chorpita, B. F., Palinkas, L. A., Schoenwald, S. K., Miranda, J., Bearman, S. K., … Gray, J. (2012). Testing standard and modular designs for psychotherapy treating depression, anxiety, and conduct problems in youth: A randomized effectiveness trial. Archives of General Psychiatry, 69(3), 274–282. doi:10.1001/archgenpsychiatry.2011.147.

  • Weisz, J. R., Jensen-Doss, A., & Hawley, K. M. (2006). Evidence-based youth psychotherapies versus usual clinical care: A meta-analysis of direct comparisons. American Psychologist, 61(7), 671. doi:10.1146/annurev.psych.55.090902.141449.

    Article  PubMed  Google Scholar 

  • Yu, C. Y. (2002). Evaluating cutoff criteria of model fit indices for latent variable models with binary and continuous outcomes (Doctoral dissertation, University of California Los Angeles). Retrieved from http://statmodel2.com/download/Yudissertation.pdf.

Download references

Author information

Author notes

    Authors and Affiliations

    1. Department of Psychology, University of Hawai‘i at Mānoa, 2530 Dole Street, Sakamaki C400, Honolulu, HI, 96822, USA

      Allison R. Love, Izumi Okado, Trina E. Orimoto & Charles W. Mueller

    Authors
    1. Allison R. Love
      View author publications

      You can also search for this author in PubMed Google Scholar

    2. Izumi Okado
      View author publications

      You can also search for this author in PubMed Google Scholar

    3. Trina E. Orimoto
      View author publications

      You can also search for this author in PubMed Google Scholar

    4. Charles W. Mueller
      View author publications

      You can also search for this author in PubMed Google Scholar

    Corresponding author

    Correspondence to Charles W. Mueller.

    Additional information

    This study was supported in part from a research and evaluation contract awarded to the fourth author by the State of Hawaii Department of Health, Child and Adolescent Mental Health Division.

    Rights and permissions

    Reprints and permissions

    About this article

    Check for updates. Verify currency and authenticity via CrossMark

    Cite this article

    Love, A.R., Okado, I., Orimoto, T.E. et al. Factor Analysis of Therapist-Identified Treatment Targets in Community-Based Children’s Mental Health. Adm Policy Ment Health 45, 103–120 (2018). https://doi.org/10.1007/s10488-016-0770-1

    Download citation

    • Published:

    • Issue Date:

    • DOI: https://doi.org/10.1007/s10488-016-0770-1

    Keywords

    Search

    Navigation