Skip to main content

Advertisement

SpringerLink
Log in

The Parent Participation Engagement Measure (PPEM): Reliability and Validity in Child and Adolescent Community Mental Health Services

  • Original Article
  • Published:
Administration and Policy in Mental Health and Mental Health Services Research Aims and scope Submit manuscript

Abstract

Parent participation in community-based child mental health services is an important yet understudied process associated with treatment effectiveness. This paper describes the development and psychometrics of the Parent Participation Engagement Measure in a sample of 1374 parents and 563 youth receiving publicly-funded mental health services. Analyses indicated excellent internal consistency, and model fit indices/factor loadings supported a one-factor model. Convergent and discriminant validity were supported, although some coefficients were modest in magnitude. Psychometric results were consistent for Caucasian versus Hispanic, parent versus youth, and English versus Spanish-language respondents. The clinical and research utility of this measure are discussed.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Similar content being viewed by others

References

  • Allen, J. D., Linnan, L. A., & Emmons, K. M. (2012). Fidelity and its relationship to implementation effectiveness, adaptation, and dissemination. In R. C. Brownson, G. A. Colditz, & E. A. Proctor (Eds.), Dissemination and Implementation Research in Health: Translating Science to Practice (pp. 281–304). Oxford: Oxford University Press.

    Chapter  Google Scholar 

  • Baker-Ericzén, M. J., Jenkins, M. M., & Haine-Schlagel, R. (2013). Therapist, parent, and youth perspectives of treatment barriers to family-focused community outpatient mental health services. Journal of Child and Family Studies, 22(6), 854–868.

    Article  PubMed  Google Scholar 

  • Baydar, N., Reid, M. J., & Webster-Stratton, C. (2003). The role of mental health factors and program engagement in the effectiveness of a preventive parenting program for head start mothers. Child Development, 74(5), 1433–1453.

    Article  PubMed  Google Scholar 

  • Becker, K. D., Lee, B. R., Daleiden, E. L., Lindsey, M., Brandt, N. E., & Chorpita, B. F. (2015). The common elements of engagement in children’s mental health services: Which elements for which outcomes? Journal of Clinical Child and Adolescent Psychology, 44(1), 30–43.

    Article  PubMed  Google Scholar 

  • Bentler, P. M. (1990). Comparative fit indexes in structural models. Psychological Bulletin, 107(2), 238–246.

    Article  CAS  PubMed  Google Scholar 

  • Bentler, P. M. (2007). On tests and indices for evaluating structural models. Personality and Individual Differences, 42(5), 825–829.

    Article  Google Scholar 

  • Braswell, L., Kendall, P. C., Braith, J., Carey, M. P., & Vye, C. S. (1985). “Involvement” in cognitive-behavioral therapy with children: Process and its relationship to outcome. Cognitive Therapy and Research, 9(6), 611–630.

    Article  Google Scholar 

  • Brunk, M. (2001). Guidelines for the YSS & the YSS-F. Retrieved from Mental Health Statistics Improvement Program Website website. http://www.mhsip.org

  • Carrillo, E. (2001). Assessment and treatment of the Latino patient. In A. G. Lopez & E. Carrillo (Eds.), The Latino psychiatric patient: Assessment and treatment (pp. 37–56). Washington, DC: American Psychiatric Publishing Inc.

    Google Scholar 

  • Chacko, A., Wymbs, B. T., Chimiklis, A., Wymbs, F. A., & Pelham, W. E. (2012). Evaluating a comprehensive strategy to improve engagement to group-based behavioral parent training for high-risk families of children with ADHD. Journal of Abnormal Child Psychology, 40(8), 1351–1362.

    Article  PubMed  Google Scholar 

  • Chamberlain, P., Patterson, G., Reid, J., Kavanagh, K., & Forgatch, M. (1984). Observation of client resistance. Behavior Therapy, 15(2), 144–155.

    Article  Google Scholar 

  • Clarke, A. T., Marshall, S. A., Mautone, J. A., Soffer, S. L., Jones, H. A., Costigan, T. E., & Power, T. J. (2015). Parent attendance and homework adherence predict response to a family-school intervention for children with ADHD. Journal of Clinical Child and Adolescent Psychology, 44(1), 58–67.

    Article  PubMed  Google Scholar 

  • David-Ferdon, C., & Kaslow, N. J. (2008). Evidence-based psychosocial treatments for child and adolescent depression. Journal of Clinical Child and Adolescent Psychology, 37(1), 62–104.

    Article  PubMed  Google Scholar 

  • Dowell, K. A., & Ogles, B. M. (2010). The effects of parent participation on child psychotherapy outcome: A meta-analytic review. Journal of Clinical Child and Adolescent Psychology, 39(2), 151–162.

    Article  PubMed  Google Scholar 

  • Evans, S. W., Owens, J., & Bunford, N. (2014). Evidence-based psychosocial treatments for children and adolescents with attention-deficit/hyperactivity disorder. Journal of Clinical Child and Adolescent Psychology, 43(4), 527–551.

    Article  PubMed  Google Scholar 

  • Eyberg, S. M., Nelson, M. M., & Boggs, S. R. (2008). Evidence-based psychosocial treatments for children and adolescents with disruptive behavior. Journal of Clinical Child and Adolescent Psychology, 37(1), 215–237.

    Article  PubMed  Google Scholar 

  • Fabrigar, L. R., Wegener, D. T., MacCallum, R. C., & Strahan, E. J. (1999). Evaluating the use of exploratory factory analysis in psychological research. Psychological Methods, 4(3), 272.

    Article  Google Scholar 

  • Fawley-King, K., Haine-Schlagel, R., Trask, E. V., Zhang, J., & Garland, A. F. (2012). Caregiver participation in community-based mental health services for children receiving outpatient care. Journal of Behavioral Health Services and Research, 40(2), 180–190.

    Article  Google Scholar 

  • Garcia, J. A., & Weisz, J. R. (2002). When youth mental health care stops: Therapeutic relationship problems and other reasons for ending youth outpatient treatment. Journal of Consulting and Clinical Psychology, 70(2), 493–1443.

    Article  Google Scholar 

  • Garland, A. F., Brookman-Frazee, L., Hurlburt, M., Arnold, E., Zoffness, R., Haine-Schlagel, R., & Ganger, W. (2010). Mental health care for children with disruptive behavior problems: A view inside therapists’ offices. Psychiatric Services, 61(8), 788–795.

    Article  PubMed  PubMed Central  Google Scholar 

  • Garland, A. F., Lewczyk-Boxmeyer, C. M., Gabayan, E. N., & Hawley, K. M. (2004). Multiple stakeholder agreement on desired outcomes for adolescents’ mental health services. Psychiatric Services, 55(6), 671–676.

    Article  PubMed  Google Scholar 

  • Glasgow, R. E., & Riley, W. T. (2013). Pragmatic measures: What they are and why we need them. American Journal of Preventive Medicine, 45(2), 237–243.

    Article  PubMed  Google Scholar 

  • Gopalan, G., Goldstein, L., Klingenstein, K., Sicher, C., Blake, C., & McKay, M. M. (2010). Engaging families into child mental health treatment: Updates and special considerations. Journal of the Canadian Academy of Child and Adolescent Psychiatry, 19(3), 182–196.

    PubMed  PubMed Central  Google Scholar 

  • Gorin, S. S. (1993). The prediction of child psychotherapy outcome: Factors specific to treatment. Psychotherapy, 30(1), 152–158.

    Article  Google Scholar 

  • Haine-Schlagel, R., Brookman-Frazee, L., Fettes, D. L., Baker-Ericzén, M., & Garland, A. F. (2012). Therapist focus on parent involvement in community-based youth psychotherapy. Journal of Child and Family Studies, 21(4), 646–656.

    Article  PubMed  Google Scholar 

  • Haine-Schlagel, R., & Walsh, N. (2015). Parent participatory engagement in youth and family mental health treatment. Clinical Child and Family Psychology Review, 18(1), 133–150.

    Article  PubMed  PubMed Central  Google Scholar 

  • Hoagwood, K. E. (2005). Family-based services in children’s mental health: A research review and synthesis. Journal of Child Psychology and Psychiatry, 46(7), 690–713.

    Article  PubMed  Google Scholar 

  • Hock, R., Priester, M. A., Lachini, A. L., Browne, T., DeHart, D., & Clone, S. (2015). A Review of family engagement measures for adolescent substance use services. Journal of Child and Family Studies, 24, 1–11.

    Article  Google Scholar 

  • Hu, L. T., & Bentler, P. M. (1999). Cutoff criteria for fit indexes in covariance structure analysis: Conventional criteria versus new alternatives. Structural Equation Modeling, 6(1), 1–55.

    Article  Google Scholar 

  • Ingoldsby, E. M. (2010). Review of interventions to improve family engagement and retention in parent and child mental health programs. Journal of Child and Family Studies, 19(5), 629–645.

    Article  PubMed  PubMed Central  Google Scholar 

  • Israel, P., Thomsen, P. H., Langeveld, J. H., & Stormark, K. M. (2007). Child factors associated with parent involvement in usual clinical care of children and adolescents: A national register study. Nordic Journal of Psychiatry, 61(3), 173–181.

    Article  PubMed  Google Scholar 

  • Karver, M. S., Handelsman, J. B., Fields, S., & Bickman, L. (2006). Meta-analysis of therapeutic relationship variables in youth and family therapy: The evidence for different relationship variables in the child and adolescent treatment outcome literature. Clinical Psychology Review, 26(1), 50–65.

    Article  PubMed  Google Scholar 

  • Karver, M. S., Handelsman, J. B., Fields, S., & Bickman, L. (2005). A theoretical model of common process factors in youth and family therapy. Mental Health Services Research, 7(1), 35–51.

    Article  PubMed  Google Scholar 

  • Keel, P. K., & Haedt, A. (2008). Evidence-based psychosocial treatments for eating problems and eating disorders. Journal of Clinical Child and Adolescent Psychology, 37(1), 39–61.

    Article  PubMed  Google Scholar 

  • Kim, H., Munson, M. R., & McKay, M. M. (2012). Engagement in mental health treatment among adolescents and young adults: A systematic review. Child and Adolescent Social Work Journal, 29(3), 241–266.

    Article  Google Scholar 

  • Lindsey, M. A., Brandt, N. E., Becker, K. D., Lee, B. R., Barth, R. P., Daleiden, E. L., & Chorpita, B. F. (2014). Identifying the common elements of treatment engagement interventions in children’s mental health services: Which elements for which outcomes? Clinical Child and Family Psychology Review, 17(3), 283–298.

    Article  PubMed  Google Scholar 

  • Macdonald, E., Lee, E., Geraghty, K., McCann, K., Mohay, H., & O’Brien, T. (2007). Towards a developmental framework of consumer and carer participation in child and adolescent mental health services. Australasian Psychiatry, 15(6), 504–508.

    Article  PubMed  Google Scholar 

  • McMurran, M., Husband, N., & Overton, E. (2010). Non-completion of personality disorder treatments: A systematic review of correlates, consequences, and interventions. Clinical Psychology Review, 30(3), 277–287.

    Article  PubMed  Google Scholar 

  • Meyer, B., Pilkonis, P. A., Krupnick, J. L., Egan, M. K., Simmens, S. J., & Sotsky, S. M. (2002). Treatment expectancies, patient alliance, and outcome: Further analyses from the National Institue of Mental Health Treatment of Depression Collaborative Research Program. Journal of Consulting and Clinical Psychology, 70(4), 1051–1055.

    Article  PubMed  Google Scholar 

  • Muthén, L. K., & Muthén, B. O. (1998–2014). Mplus User’s Guide. Los Angeles, CA: Muthén & Muthén.

  • Nye, C. L., Zucker, R. A., & Fitzgerald, H. E. (1999). Early family-based intervention in the path to alcohol problems: Rationale and relationship between treatment process characteristics and child and parenting outcomes. Journal of Studies on Alcohol, Supplement No 13, 10–21.

    Article  Google Scholar 

  • Olin, S., Kutash, K., Pollock, M., Burns, B. J., Kuppinger, A., Craig, N., & Hoagwood, K. (2014). Developing quality indicators for family support services in community team-based mental health care. Administration and Policy in Mental Health and Health Services Research, 41(1), 7–20.

    Article  Google Scholar 

  • Patterson, G. R., & Forgatch, M. S. (1985). Therapist behavior as a determinant for client noncompliance: A paradox for the behavior modifier. Journal of Consulting and Clinical Psychology, 53(6), 846–851.

    Article  CAS  PubMed  Google Scholar 

  • Pelegrina, S., Garcia-Linares, M. C., & Casanova, P. F. (2003). Adolescents and their parents’ perceptions about parenting characteristics. Who can better predict the adolescent’s academic competence? Journal of Adolescence, 26(6), 651–665.

    Article  PubMed  Google Scholar 

  • Perepletchikova, F., & Kazdin, A. E. (2005). Treatment integrity and therapeutic change: Issues and research recommendations. Clinical Psychology: Science and Practice, 12(4), 365–383.

    Google Scholar 

  • Quinn, K. P., Epstein, M. H., & Cumblad, C. L. (1995). Developing comprehensive, individualized community-based services for children and youth with emotional and behavioral disorders: Direct service providers’ perspectives. Journal of Child and Family Studies, 4(1), 19–42.

    Article  Google Scholar 

  • Resendez, M. G., Quist, R. M., & Matshazi, D. G. M. (2000). A longitudinal analysis of family empowerment and client outcomes. Journal of Child and Family Studies, 9(4), 449–460.

    Article  Google Scholar 

  • Riley, S. E., Stromberg, A. J., & Clark, J. J. (2005). Assessing parental satisfaction with children’s mental health services with the youth services survey for families. Journal of Child and Family Studies, 14, 87–89.

    Article  Google Scholar 

  • Schoenwald, S. K., Sheidow, A. J., Letourneau, E. J., & Liao, J. G. (2003). Transportability of multisystemic therapy: Evidence for multilevel influences. Mental Health Services Research, 5(4), 223–239.

    Article  PubMed  Google Scholar 

  • Shafer, A. B., & Temple, J. M. (2013). Factor structure of the Mental Health Statistics Improvement Program (MHSIP) family and youth satisfaction surveys. Journal of Behavioral Health Services and Research, 40(3), 306–316.

    Article  PubMed  Google Scholar 

  • Shirk, S. R., & Saiz, C. C. (1992). Clinical, empirical, and developmental perspectives on the therapeutic relationship in child psychotherapy. Development and Psychopathology, 4(4), 713–728.

    Article  Google Scholar 

  • Silverman, W. K., Pina, A. A., & Viswesvaran, C. (2008). Evidence-based psychosocial treatments for phobic and anxiety disorders in children and adolescents. Journal of Clinical Child and Adolescent Psychology, 37(1), 105–130.

    Article  PubMed  Google Scholar 

  • Staudt, M. (2007). Treatment engagement with caregivers of at-risk children: Gaps in research and conceptualization. Journal of Child and Family Studies, 16(2), 183–196.

    Article  Google Scholar 

  • Taub, J., Tighe, T. A., & Burchard, J. (2001). The effects of parent empowerment on adjustment for children receiving comprehensive mental health services. Children’s Services: Socialy Policy, Research, and Practice, 4(3), 103–122.

    Article  Google Scholar 

  • Tetley, A., Jinks, M., Huband, N., & Howells, K. (2011). A systematic review of measures of therapeutic engagement in psychosocial and psychological treatment. Journal of Clinical Psychology, 67(9), 927–941.

    Article  PubMed  Google Scholar 

  • Tolan, P. H., & Dodge, K. A. (2005). Children’s mental health as a primary care and concern: A system for comprehensive support and service. American Psychologist, 60(6), 601–614.

    Article  PubMed  PubMed Central  Google Scholar 

Download references

Acknowledgments

Preparation of this article was supported in part by National Institute of Mental Health of the National Institutes of Health under award number K23MH080149 (PI: Haine-Schlagel).The content is solely the responsibility of the authors and does not necessarily represent the official views of the National Institutes of Health. The authors would like to acknowledge Ann Garland, Ph.D., Jonathan Martinez, Ph.D., & Natalia Walsh, M.S. for their helpful comments on an earlier version of this manuscript. The authors are grateful to the County of San Diego Health and Human Services Agency for providing deidentified data from their management information systems. The authors wish to acknowledge the family participants, the clinicians and organizations that facilitated data collection, and the System of Care Evaluation team of evaluators. This study received financial support from the County of San Diego Health and Human Services Agency.

Author information

Authors and Affiliations

  1. Department of Child and Family Development, San Diego State University, San Diego, CA, USA

    Rachel Haine-Schlagel & Scott C. Roesch

  2. Child & Adolescent Services Research Center, 3020 Children’s Way, MC 5033, San Diego, CA, 92123, USA

    Rachel Haine-Schlagel, Emily V. Trask, Kya Fawley-King, William C. Ganger & Gregory A. Aarons

  3. Department of Psychology, San Diego State University, San Diego, CA, USA

    Scott C. Roesch

  4. Department of Psychiatry, University of California, San Diego, La Jolla, CA, USA

    Emily V. Trask, Kya Fawley-King & Gregory A. Aarons

  5. Research Foundation, San Diego State University, San Diego, CA, USA

    William C. Ganger

Authors
  1. Rachel Haine-Schlagel
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Scott C. Roesch
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Emily V. Trask
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Kya Fawley-King
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. William C. Ganger
    View author publications

    You can also search for this author in PubMed Google Scholar

  6. Gregory A. Aarons
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Rachel Haine-Schlagel.

Ethics declarations

Conflicts of interest

No other potential conflicts of interest are noted.

Additional information

Manuscript submitted for publication on June 29, 2015. These results were presented at the 2015 Society of Pediatric Psychology Annual Conference, San Diego CA.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Haine-Schlagel, R., Roesch, S.C., Trask, E.V. et al. The Parent Participation Engagement Measure (PPEM): Reliability and Validity in Child and Adolescent Community Mental Health Services. Adm Policy Ment Health 43, 813–823 (2016). https://doi.org/10.1007/s10488-015-0698-x

Download citation

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s10488-015-0698-x

Keywords

Search

Navigation