Top

Gepubliceerd in:

22-05-2023 | Original Paper

Factor Structure, Reliability, and Validity of the Wraparound Fidelity Index Short Form (WFI-EZ)

Auteurs: Eric J. Bruns, Jonathan R. Olson, Ryan M. Parigoris, Elizabeth M. Parker, Janet S. Walker

Gepubliceerd in: Journal of Child and Family Studies | Uitgave 6/2023

Abstract

Wraparound care coordination has been demonstrated to promote positive mental health, residential, and cost outcomes for children and youth with serious emotional and behavioral disorders (SEBD) and their families. However, research also shows that positive outcomes are dependent on adequacy of Wraparound fidelity. The current study presents results from a series of studies that collectively assessed the factor structure, reliability, and validity of the Wraparound Fidelity Index, Short Form (WFI-EZ), a four section, multi-informant, self-report measure. Analyses of a sample of 10,955 caregivers of youth who received Wraparound and completed the WFI-EZ found a four-factor solution that aligned well with previous theories of change for Wraparound, with factors focused on team membership, team process, inclusion of natural supports, and intermediate outcomes, including increased family assets and more effective services and supports. Cronbach’s alpha was 0.90 for the full index and acceptable for all four empirically derived factors (α = 0.61–0.91); preliminary test-retest reliability data for the composite WFI-EZ fidelity index drawn from two small samples was found to be high for caregivers (r = 0.94) and moderate for care coordinators (r = 0.72). Results of known-groups analyses found that WFI-EZ scores discriminated groups theoretically expected to differ on Wraparound fidelity, including whether basic elements of Wraparound were provided and whether provider organizations were measured as having high versus low supports for Wraparound. Results indicate the WFI-EZ is a reliable and valid measure of Wraparound fidelity, while also pointing to opportunities for future refinement, further research, and opportunities for improving Wraparound training and implementation support.

vorige artikel Coding Interactive Behaviour Instrument: Mother-Infant Interaction Quality, Construct Validity, Measurement Invariance, and Postnatal Depression and Anxiety

volgende artikel Publisher Correction: Change Patterns During Family-Based Treatment for Pediatric Obsessive Compulsive Disorder

Benjamin, P. H., Robshaw, S., Olson, J. R., & Bruns, E. J. (2020). Establishing a framework for Wraparound fidelity assessment using principles of implementation science. Webinar presented as part of the National Wraparound Initiative webinar series. https://nwi.pdx.edu/previous-nwi-webinars/

Browne, D. T., Puente-Duran, S., Shlonsky, A., Thabane, L., & Verticchio, D. (2016). A randomized trial of wraparound facilitation versus usual child protection services. Research on Social Work Practice, 26(2), 168–179CrossRef

Bruns, E. J., & Sather, A. (2007). User’s manual to the wraparound team observation measure. Seattle, WA: University of Washington, Wraparound Evaluation and Research Team, Division of Public Behavioral Health and Justice Policy.

Bruns, E. J., Coldiron, J.S., Sather, A., & Hook, A. (2015a). Advances in quality and fidelity monitoring. Presentation at the 28th Annual Children’s Mental Health Research & Policy Conference, Tampa, FL

Bruns, E. J., Pullmann, M. D., Sather, A., Brinson, R. D., & Ramey, M. (2015b). Effectiveness of wraparound versus case management for children and adolescents: Results of a randomized study. Administration and Policy in Mental Health and Mental Health Services Research, 42(3), 309–322CrossRefPubMed

Bruns, E. J., Rast, J., Peterson, C., Walker, J., & Bosworth, J. (2006). Spreadsheets, service providers, and the statehouse: Using data and the wraparound process to reform systems for children and families. American Journal of Community Psychology, 38(3), 201–212PubMed

Bruns, E. J., Suter, J. C., Force, M. M., & Burchard, J. D. (2005). Adherence to wraparound principles and association with outcomes. Journal of Child and Family Studies, 14(4), 521–534CrossRef

Cicchetti, D. V. (1994). Guidelines, criteria, and rules of thumb for evaluating normed and standardized assessment instruments in psychology. Psychological Assessment, 6(4), 284–290CrossRef

Coldiron, J., Bruns, E. J., & Quick, H. (2017). A comprehensive review of wraparound care coordination research, 1986–2014. Journal of Child and Family Studies, 26(5), 1245–1265CrossRef

Costello, A. B., & Osborne, J. (2005). Best practices in exploratory factor analysis: Four recommendations for getting the most from your analysis. Practical Assessment. Research, and Evaluation, 10(7), 1–9

DeVellis, R. F. (2003). Scale Development: Theory and Applications (2nd ed., Vol. 26). Thousand Oaks, CA: Sage Publications

Estep, K., & Strader, S. (2021). State and organizational level strategies for implementing high quality fidelity Wraparound. Webinar presented as part of the University of Maryland School of Social Work Training Institutes. https://theinstitute.umaryland.edu/2021traininginstitutes/

Field, A. (2017). Discovering statistics using IBM SPSS Statistics: North American edition (5^th ed.). Sage Publications, Inc.

Graham, J. W. (2009). Missing data analysis: Making it work in the real world. Annual Review of Psychology, 60, 549–576CrossRefPubMed

Hattie, J., & Cooksey, R. W. (1984). Procedures for assessing the validities of tests using the” known-groups” method. Applied Psychological Measurement, 8(3), 295–305CrossRef

Hoagwood, K., Burns, B. J., Kiser, L., Ringeisen, H., & Schoenwald, S. K. (2001). Evidence-based practice in child and adolescent mental health services. Psychiatric Services, 52(9), 1179–1189CrossRefPubMed

Kernan, J. B. (2014). Measuring Wraparound fidelity to make quality improvements. Community Mental Health Journal, 50, 903–908CrossRefPubMed

Larson, J. (2021). Can We Finally Call Wraparound Evidence-Based for Youths With Serious Emotional Disorders? Journal of the American Academy of Child and Adolescent Psychiatry, 60(11), 1340–1341CrossRefPubMed

McCarter, S. A. (2016). Holistic representation: A randomized pilot study of wraparound services for first‐time juvenile offenders to improve functioning, decrease motions for review, and lower recidivism. Family Court Review, 54(2), 250–260CrossRef

Miles, P., & Brown, N., The National Wraparound Initiative Implementation Work Group. (2011). The Wraparound implementation guide: A handbook for administrators and managers. Portland, OR: National Wraparound Initiative

Olson, J. R., Benjamin, P. H., Azman, A. A., Kellogg, M. A., Pullmann, M. D., Suter, J. C., & Bruns, E. J. (2021a). Systematic review and meta-analysis: Effectiveness of wraparound care coordination for children and adolescents. Journal of the American Academy of Child & Adolescent Psychiatry, 60(11), 1353–1366CrossRef

Olson, J. R., Azman, A., Estep, K. M., Coviello, K. A., Robshaw, S., & Bruns, E. J. (2021b). Influences of Inner and Outer Settings on Wraparound Implementation Outcomes. Global Implementation Research and Applications, 1(2), 77–89CrossRef

Olson, J. R., Azman, A., Bruns, E. J., Estep, K. M., & Coviello, K. A. (2021c). How do program and system factors influence Wraparound implementation, fidelity, and sustainment? Webinar presented as part of the National Wraparound Initiative webinar series. https://nwi.pdx.edu/previous-nwi-webinars/

Proctor, E. K., Powell, B. J., & McMillen, J. C. (2013). Implementation strategies: recommendations for specifying and reporting. Implementation Science, 8(1), 1–11CrossRef

Pullmann, M. D., Bruns, E. J., & Sather, A. K. (2013). Evaluating fidelity to the wraparound service model for youth: application of item response theory to the Wraparound Fidelity Index. Psychological Assessment, 25(2), 583CrossRefPubMedPubMedCentral

Rescorla, L. A. (2005). Assessment of young children using the Achenbach System of Empirically Based Assessment (ASEBA). Mental Retardation and Developmental Disabilities Research Reviews, 11(3), 226–237CrossRefPubMed

Snyder, A., Marton, J., McLaren, S., & Feng, B. (2017). Do high fidelity wraparound services for youth with serious emotional disturbances save money in the long-term? Journal of Mental Health Policy and Economics, 20, 167–175PubMed

Stenersen, M. R., Kelly, A., Bracey, J., Marshall, T., Cummins, M., Clark, K., & Kaufman, J. S. (2022). Understanding racial-ethnic disparities in wraparound care for youths with emotional and behavioral disorders. Psychiatric Services, 73(5), 526–532CrossRefPubMed

Stroul, B. A., & Friedman, R. M. (2011). Issue brief: Strategies for expanding the system of care approach. Washington, DC: Technical Assistance Partnership for Child and Family Mental Health. http://rtckids.fmhi.usf.edu/rtcpubs/EBP_friedman_drews.pdf

Stroul, B. A., Blau, G. M., & Sondheimer, D. L. (2008). Systems of care: A strategy to transform children’s mental health care. In B. A. Stroul & G. M. Blau (Eds.), The system of care handbook: Transforming mental health services for children, youth, and families (pp. 3–23). Paul H. Brookes Publishing Co.

Truxillo, C. (2005). Maximum likelihood parameter estimation with incomplete data. Proceedings of the Thirtieth Annual SAS(r) Users Group International Conference. http://www2.sas.com/proceedings/sugi30/111-30.pdf

Walker, J. S. (2008). How, and why, does wraparound work: A theory of change. In E. J. Bruns & J. S. Walker (Eds.), The resource guide to Wraparound. Portland, OR: National Wraparound Initiative, Research and Training Center for Family Support and Children’s Mental Health

Walker, J. S., & Matarese, M. (2011a). Using a theory of change to drive human resource development for wraparound. Journal of Child and Family Studies, 20(6), 791–803CrossRef

Walker, J. S., & Sanders, B. (2011b). The community supports for wraparound inventory: An assessment of the implementation context for wraparound. Journal of Child and Family Studies, 20(6), 747–757CrossRef

Walker, J. S., & Schutte, K. M. (2004). Practice and process in wraparound teamwork. Journal of Emotional and Behavioral Disorders, 12(3), 182–192CrossRef

Weaver, B., & Maxwell, H. (2014). Exploratory factor analysis and reliability analysis with missing data: A simple method for SPSS users. The Quantitative Methods for Psychology, 10(2), 143–152CrossRef

West, M. A., Borrill, C. S., & Unsworth, K. L. (1998). Team effectiveness in organizations. In C. L. Cooper & I. T. Robertson (Eds.), International review of industrial and organizational psychology (Vol. 13, pp. 1–48). New York: Wiley.

Titel: Factor Structure, Reliability, and Validity of the Wraparound Fidelity Index Short Form (WFI-EZ)
Auteurs: Eric J. Bruns
Jonathan R. Olson
Ryan M. Parigoris
Elizabeth M. Parker
Janet S. Walker
Publicatiedatum: 22-05-2023
Uitgeverij: Springer US
Gepubliceerd in: Journal of Child and Family Studies / Uitgave 6/2023
Print ISSN: 1062-1024
Elektronisch ISSN: 1573-2843
DOI: https://doi.org/10.1007/s10826-023-02597-x

Bohn Stafleu van Loghum

Deel dit onderdeel of sectie (kopieer de link)

Abstract

Log in om toegang te krijgen

Andere artikelen Uitgave 6/2023

An Uncontrolled Investigation of the Feasibility of Parent-Coached Exposure Therapy for Youth with Anxiety Disorders

Adaptations to the Learning Environment for Elementary School Children in Georgia during the COVID-19 Pandemic

Examining a Key Measure of Youth Disclosure to Parents for Measurement Invariance Across Time and Reporters

Personality Traits and Parental Burnout Among Fathers: A Moderated Mediation Model

Change Patterns During Family-Based Treatment for Pediatric Obsessive Compulsive Disorder

Pilot Study Examining Caregiver–Child and Family Functioning in PEERS® for Preschoolers