Top

Gepubliceerd in:

01-03-2015 | Empirical Research

Effects of After-School Programs with At-Risk Youth on Attendance and Externalizing Behaviors: A Systematic Review and Meta-Analysis

Auteurs: Kristen P. Kremer, Brandy R. Maynard, Joshua R. Polanin, Michael G. Vaughn, Christine M. Sarteschi

Gepubliceerd in: Journal of Youth and Adolescence | Uitgave 3/2015

Abstract

The popularity, demand, and increased federal and private funding for after-school programs have resulted in a marked increase in after-school programs over the past two decades. After-school programs are used to prevent adverse outcomes, decrease risks, or improve functioning with at-risk youth in several areas, including academic achievement, crime and behavioral problems, socio-emotional functioning, and school engagement and attendance; however, the evidence of effects of after-school programs remains equivocal. This systematic review and meta-analysis, following Campbell Collaboration guidelines, examined the effects of after-school programs on externalizing behaviors and school attendance with at-risk students. A systematic search for published and unpublished literature resulted in the inclusion of 24 studies. A total of 64 effect sizes (16 for attendance outcomes; 49 for externalizing behavior outcomes) extracted from 31 reports were included in the meta-analysis using robust variance estimation to handle dependencies among effect sizes. Mean effects were small and non-significant for attendance and externalizing behaviors. A moderate to large amount of heterogeneity was present; however, no moderator variable tested explained the variance between studies. Significant methodological shortcomings were identified across the corpus of studies included in this review. Implications for practice, policy and research are discussed.

vorige artikel Are Adolescents’ Mutually Hostile Interactions at Home Reproduced in Other Everyday Life Contexts?

volgende artikel Empathy and Involvement in Bullying in Children and Adolescents: A Systematic Review

Alleen toegankelijk voor geautoriseerde gebruikers

Afterschool Alliance. (2014). America after 3PM: Afterschool programs in demand. http://afterschoolalliance.org/documents/AA3PM-2014/AA3PM_National_Report.pdf.

*Apsler, R. (2009). After-school programs for adolescents: A review of evaluation research. Adolescence, 44, 1–19.PubMedCrossRef

Arcaira, E., Vile, J. D., & Reisner, E. R. (2010). Achieving high school graduation: Citizen Schools’ youth outcomes in Boston. Washington, DC: Policy Studies Associates Inc.

*Biggart, A., Kerr, K., O’Hare, L., & Connolly, P. (2013). A randomised control trial evaluation of a literacy after-school programme for struggling beginning readers. International Journal of Educational Research, 62, 129–140.CrossRef

Biglan, A., Metzler, C. W., Wirt, R., Ary, D., Noell, J., Ochs, L., et al. (1990). Social and behavioral factors associated with high-risk sexual behaviors among adolescents. Journal of Behavioral Medicine, 13, 245–261.PubMedCrossRef

*Blumer, M. L. C., & Werner-Wilson, R. J. (2010). Leaving no girl behind: Clinical intervention effects on adolescent female academic “high-risk” behaviors. Journal of Feminist Family Therapy, 22(1), 22–42.CrossRef

Bohnert, A., Fredricks, J., & Randall, E. (2010). Capturing unique dimensions of youth organized activity involvement theoretical and methodological considerations. Review of Educational Research, 80(4), 576–610.CrossRef

Bohnert, A. M., Richards, M., Kohl, K., & Randall, E. (2009). Relationships between discretionary time activities, emotional experiences, delinquency and depressive symptoms among urban African American adolescents. Journal of Youth and Adolescence, 38, 587–601.PubMedCrossRef

Bradshaw, C. P., Waasdorp, T. E., Goldweber, A., & Johnson, S. L. (2013). Bullies, gangs, drugs, and school: Understanding the overlap and the role of ethnicity and urbanicity. Journal of Youth and Adolescence, 42(2), 220–234.PubMedCrossRef

Buscemi, N., Hartling, L., Vandemeer, B., Tjosvold, L., & Klassen, T. P. (2006). Single data extraction generated more errors than double data extraction in systematic reviews. Journal of Clinical Epidemiology, 59, 697–703.PubMedCrossRef

Bushman, B. J., & Wells, G. L. (2001). Narrative impressions of literature: The availability bias and the corrective properties of meta-analytic approaches. Personality and Social Psychology Bulletin, 27(9), 1123–1130.

Campbell Collaboration. (2014). Campbell Collaboration systematic reviews: Policies and guidelines. http://www.campbellcollaboration.org/lib/download/3308/C2_Policies_Guidelines_Version_1_0.pdf.

Cooper, H., DeNeve, K., & Charlton, K. (1997). Finding the missing science: The fate of studies submitted for review by a human subjects committee. Psychological Methods, 2(4), 447.CrossRef

Cooper, H., & Hedges, L. V. (1994). The handbook of research synthesis. New York: Russell Sage Foundation.

Cross, A. B., Gottfredson, D. C., Wilson, D. M., Rorie, M., & Connell, N. (2009). The impact of after-school programs on the routine activities of middle-school students: Results from a randomized, controlled trial. Criminology and Public Policy, 8(2), 391–412.CrossRef

DuBois, D. L., Portillo, N., Rhodes, J. E., Silverthorn, N., & Valentine, J. C. (2011). How effective are mentoring programs for youth? A systematic assessment of the evidence. Psychological Science in the Public Interest, 12, 57–91.CrossRef

Durlak, J. A., Weissberg, R. P., & Pachan, M. (2010). A meta-analysis of after-school programs that seek to promote personal social skills in children and adolescents. American Journal of Community Psychology, 45, 294–309.PubMedCrossRef

Dynarski, M., James-Burdumy, S., Moore, M., Rosenberg, L., Deke, J., Mansfield, W., et al. (2004). When schools stay open late: The national evaluation of the 21st Century Community Learning Centers program: New findings. U.S. Department of Education, Institute of Education Sciences, National Center for Education Evaluation and Regional Assistance.

Fashola, O. S. (1998). Review of extended-day and after-school programs and their effectiveness. Washington, D.C.: Center for Research on the Education of Students Placed at Risk.

Fisher, Z., & Tipton, E. (2014). Robumeta (Version 1.1) (Software). http://cran.r-project.org/web/packages/robumeta/robumeta.pdf.

*Foley, E. M., & Eddins, G. (2001). Preliminary analysis of Virtual Y after-school program participants’ patterns of school attendance and academic performance. New York, NY: Fordham University.

Fox, J.A., & Newman, S.A. (1997). After-school crime or after-school programs: Tuning into the prime time for violent juvenile crime and implications for national policy. A report to the United States Attorney General. Washington, D.C.: Fight Crime: Invest in Kids.

*Frazier, S., Mehta, T., Atkins, M., Hur, K., & Rusch, D. (2013). Not just a walk in the park: Efficacy to effectiveness for after school programs in communities of concentrated urban poverty. Administration and Policy in Mental Health and Mental Health Services Research, 40(5), 406–418.PubMedCrossRef

Glass, G. V., McGaw, B., & Smith, M. L. (1981). Meta-analysis in social research. Thousand Oaks, CA: Sage Publications.

*Gottfredson, D., Cross, A., & Soulé, D. (2007). Distinguishing characteristics of effective and ineffective after-school programs to prevent delinquency and victimization. Criminology and Public Policy, 6(2), 289–318.CrossRef

Gottfredson, D., Cross, A., Wilson, D., Connell, N., & Rorie, M. (2010a). A randomized trial of the effects of an enhanced after-school program for middle-school students. Final report submitted to the U.S. Department of Education Institute for Educational Sciences.

Gottfredson, D., Cross, A., Wilson, D., Rorie, M., & Connell, N. (2010b). An experimental evaluation of the All Stars prevention curriculum in a community after school setting. Prevention Science, 11(2), 142–154.PubMedCrossRef

Gottfredson, D., Cross, A., Wilson, D., Rorie, M., & Connell, N. (2010c). Effects of participation in after-school programs for middle school students: A randomized trial. Journal of Research on Educational Effectiveness, 3(3), 282–313.CrossRef

*Gottfredson, D., Gerstenblith, S. A., Soulé, D., Womer, S. C., & Lu, S. (2004). Do after school programs reduce delinquency? Prevention Science, 5(4), 253–266.PubMedCrossRef

Gottfredson, D. C., Gottfredson, G. D., & Weisman, S. A. (2001). The timing of delinquent behavior and its implications for after-school programs. Criminology & Public Policy, 1, 61–86.CrossRef

Gozsche, P. C., Hrogjartsson, A., Maric, K., & Tendal, B. (2007). Data extraction errors in meta-analyses that use standardized mean differences. Journal of the American Medical Association, 298, 430–437.

Halpern, R. (1999). After-school programs for low-income children: Promises and challenges. The Future of Children, 9(2), 81–95.PubMedCrossRef

Halpern, R. (2002). A different kind of child development institution: The history of after-school programs for low-income children. Teachers College Record, 104, 178–211.CrossRef

Hedges, L. V., Tipton, E., & Johnson, M. C. (2010). Robust variance estimation in meta-regression with dependent effect size estimates. Research Synthesis Methods, 1(1), 164–165.CrossRef

Higgins, J. P., Altman, D. G., Gotzsche, P. C., Juni, P., Moher, D., Oxman, A. D., et al. (2011). The Cochrane Collaboration’s tool for assessing risk of bias in randomised trials. British Medical Journal, 343, d5928. doi:10.1136/bmj.d5928.PubMedCentralPubMedCrossRef

Higgins, J. P., & Thompson, S. G. (2002). Quantifying heterogeneity in a meta-analysis. Statistics in Medicine, 21(11), 1539–1558.PubMedCrossRef

*Hirsch, B., Hedges, L.V., Stawicki, J., & Mekinda, M.A. (2011). After-school programs for high school students: An evaluation of After School Matters. Chicago, IL: Northwestern University.

Hollister, R. (2003). The growth in after-school programs and their impact. Washington, DC: Brookings Institution.

Hopewell, S., Loudon, K., Clarke, M. J., Oxman, A. D., & Dickersin, K. (2009). Publication bias in clinical trials due to statistical significance or direction of trial results. The Cochrane Database of Systematic Reviews, 1(1), 1–26.

Hopewell, S., McDonald, S., Clarke, M., & Egger, M. (2007). Grey literature in meta-analyses of randomized trials of health care interventions. The Cochrane Database of Systematic Reviews, 2(2).

Huang, D., Silver, D., Cheung, M., Duong, N., Gualpa, A., Hodson, C., Rivera, G. (2011). Independent statewide evaluation of after school programs: ASES and 21st CCLC year 2 annual report. CRESST Report 789. Los Angeles: National Center for Research on Evaluation, Standards, and Student Testing.

*James-Burdumy, S., Dynarski, M., & Deke, J. (2007). When elementary schools stay open late: Results from the national evaluation of the 21st Century Community Learning Centers program. Educational Evaluation and Policy Analysis, 29(4), 296–318.CrossRef

*James-Burdumy, S., Dynarski, M., & Deke, J. (2008). After-school program effects on behavior: Results from the 21st Century Community Learning Centers program national evaluation. Economic Inquiry, 46(1), 13–18.CrossRef

James-Burdumy, S., Dynarski, M., Moore, M., Deke. J., Mansfield, W., Pistorino, C., et al. (2005). When schools stay open late: The national evaluation of the 21st Century Community Learning Centers program: Final report. U.S. Department of Education, Institute of Education Sciences, National Center for Education Evaluation and Regional Assistance.

Kane, T.J. (2004). The impact of after-school programs: Interpreting the results of four recent evaluations. Working paper. New York, NY: W.T. Grant Foundation.

*LaFrance, S., Twersky, F., Latham, N., Foley, E., Bott, C., & Lee, L. (2001). A safe place for healthy youth development: A comprehensive evaluation of the Bayview Safe Haven. San Francisco, CA: BTW Consultants & LaFrance Associates.

*Langberg, J., Smith, B. H., Bogle, K. E., Schmidt, J. D., Cole, W. R., & Pender, C. A. S. (2007). A pilot evaluation of small group challenging horizons program (CHP): A randomized trial. Journal of Applied School Psychology, 23(1), 31–58.CrossRef

Lauer, P. A., Akiba, M., Wilkerson, S. B., Apthorp, H. S., Snow, D., & Martin-Glenn, M. L. (2006). Out-of-school-time programs: A meta-analysis of effects for at-risk students. Review of Educational Research, 76, 275–313.CrossRef

*Le, T., Arifuku, I., Vuong, L., Tran, G., Lustig, D., & Zimring, F. (2011). Community mobilization and community-based participatory research to prevent youth violence among Asian and immigrant populations. American Journal of Community Psychology, 48(1/2), 77–88.PubMed

Lipsey, M. W., & Wilson, D. B. (2001). Practical meta-analysis. Thousand Oaks, CA: Sage.

Littell, J. H., Corcoran, J., & Pillai, V. (2008). Systematic reviews and meta-analysis. Oxford: Oxford University Press.CrossRef

Mahoney, J. L., Parente, M. E., & Zigler, E. F. (2009). Afterschool programs in America: Origins, growth, popularity, and politics. Journal of Youth Development, 4(3), 25–44.

Maynard, B. R., Peters, K. E., Vaughn, M. G., & Sarteschi, C. M. (2013). Fidelity in after-school program intervention research: A systematic review. Research on Social Work Practice, 23(6), 613–623.CrossRef

Maynard, B. R., Salas-Wright, C. P., Vaughn, M. G., & Peters, K. E. (2012). Who are truant youth? Examining distinctive profiles of truant youth using latent profile analysis. Journal of Youth and Adolescence, 41(12), 1671–1684.PubMedCentralPubMedCrossRef

McKinsey & Company. (2009). The economic impact of the achievement gap in America’s schools. Washington, DC: Social Sector Office.

McLeod, B. D., & Weisz, J. R. (2004). Using dissertations to examine potential bias in child and adolescent clinical trials. Journal of Consulting and Clinical Psychology, 72(2), 235–251. doi:10.1037/0022-006x.72.2.235.PubMedCrossRef

*Molina, B. S., Flory, K., Bukstein, O. G., Greiner, A. R., Baker, J. L., Krug, V., et al. (2008). Feasibility and preliminary efficacy of an after-school program for middle schoolers with ADHD: A randomized trial in a large public middle school. Journal of Attention Disorders, 12(3), 207–217.PubMedCrossRef

Moyer, A., Schneider, S., Knapp-Oliver, S. K., & Sohl, S. J. (2010). Published versus unpublished dissertations in psycho-oncology intervention research. Psycho-Oncology, 19(3), 313–317.PubMedCentralPubMedCrossRef

Newman, S. A., Fox, J. A., Flynn, E. A., & Christeson, W. (2000). America’s after-school choice: The prime time for juvenile crime or youth enrichment and achievement. Washington, DC: Fight Crime: Invest in Kids.

*Nguyen, D. (2007). A statewide impact study of 21st Century Community Learning Center programs in Florida. Tallahassee, FL: Department of Educational Leadership and Policy Studies, Florida State University. Doctor of Philosophy.

*Oyserman, D., Terry, K., & Bybee, D. (2002). A possible selves intervention to enhance school involvement. Journal of Adolescence, 25(3), 313.PubMedCrossRef

Parsad, B., & Lewis, L. (2009). After-school programs in public elementary schools (NCES 2009-043). Washington, DC: National Center for Education Statistics.

*Pastchal-Temple, A. (2012). The effect of regular participation in an after-school program on student achievement, attendance, and behavior. Educational Administration, Mississippi State University. Doctor of Philosophy.

Pigott, T. D. (1994). Methods for handling missing data in research synthesis. In H. Cooper & L. V. Hedges (Eds.), The handbook of research synthesis (pp. 163–175). New York: Russell Sage Foundation.

Pigott, T. D. (2012). Advances in meta-analysis. New York, NY: Springer.CrossRef

Pigott, T. D., Valentine, J. C., Polanin, J. R., Williams, R. T., & Canada, D. D. (2013). Outcome-reporting bias in education research. Educational Researcher, 42(8), 424–434. doi:10.3102/0013189X13507104.CrossRef

Polanin, J.R., & Pigott, T.D. (2014). The use of meta-analytic statistical significance testing. Research Synthesis Methods. Advanced online publication. doi:10.1002/jrsm.1124.

*Prenovost, J. K. E. (2001). A first-year evaluation of after-school learning programs in four urban middle schools in the Santa Ana Unified School District. Irvine, CA: Educational Administration, University of California—Irvine. Doctor of Education.

Redd, Z., Cochran, S., Hair, E., & Moore, K. (2002). Academic achievement programs and youth development: A synthesis. www.childtrends.org/what_works/clarkwww/acadach/acadachrpt.pdf.

Richards, M. H., Miller, B. V., O’Donnell, P. C., Wasserman, M. S., & Colder, C. (2004). Parental monitoring mediates the effects of age and sex on problem behaviors among African American urban young adolescents. Journal of Youth and Adolescence, 33, 221–233.CrossRef

Richardson, J. L., Dwyer, K., McGuigan, K., Hansen, W. B., Dent, C., Johnson, C. A., et al. (1989). Substance use among eighth-grade students who take care of themselves after school. Pediatrics, 84, 556–566.PubMed

Ritter, G. W., Barnett, J. H., Denny, G. S., & Albin, G. R. (2009). The effectiveness of volunteer tutoring programs for elementary and middle school students: A meta-analysis. Review of Educational Research, 79, 3–38.CrossRef

Roth, J. L., Malone, L. M., & Brooks-Gunn, J. (2010). Does the amount of participation in afterschool programs relate to developmental outcomes? A review of the literature. American Journal of Community Psychology, 45, 310–324.PubMedCrossRef

*Schinke, S., Cole, K. C., & Poulin, S. R. (2000). Enhancing the educational achievement of at-risk youth. Prevention Science, 1(1), 51–60.PubMedCrossRef

Scott-Little, C., Hamann, M. S., & Jurs, S. G. (2002). Evaluations of after-school programs: A meta-evaluation of methodologies and narrative synthesis of findings. American Journal of Evaluation, 23, 387–419.CrossRef

Shadish, W. R., Cook, T. D., & Campbell, T. D. (2002). Experimental and quasi-experimental design for generalized causal inference. Belmont, CA: Wadsworth Cengage Learning.

Shernoff, D. J., & Vandell, D. L. (2007). Engagement in after-school program activities: Quality of experience from the perspective of participants. Journal of Youth and Adolescence, 36, 891–903.CrossRef

*Sibley-Butler, O. (2004). The impact of a 21st Century Community Learning Center after-school program on school-age children in grades 4 & 5. Hattiesburg, MS: University of Southern Mississippi. Doctor of Philosophy.

Simpkins, S.C., Little, P.M.D., & Weiss, H.B. (2004). Understanding and measuring attendance in out-of-school time programs (Number 7). http://www.gse.harvard.edu/hfrp/content/projects/afterschool/resources/issuebrief7.pdf.

*Smeallie, J. E. (1997). An evaluation of an after-school tutorial and study skills program for middle school students at risk of academic failure. Maryland: Department of Curriculum and Instruction, University of Maryland at College Park. Doctor of Education.

Tanner-Smith, E. E., & Tipton, E. (2013). Robust variance estimation with dependent effect sizes: Practical considerations including a software tutorial in Stata and SPSS. Published advance online. Research Synthesis Methods,. doi:10.1002/jrsm.1091.

*Tebes, J. K., Feinn, R., Vanderploeg, J. J., Chinman, M. J., Shepard, J., Brabham, T., et al. (2007). Impact of a positive youth development program in urban after-school settings on the prevention of adolescent substance use. Journal of Adolescent Health, 41(3), 239–247.PubMedCrossRef

Tolan, P., Henry, D., Schoeny, M., Bass, A., Lovegrove, P., & Nichols, E. (2013). Mentoring interventions to affect juvenile delinquency and associated problems: A systematic review. Campbell Collaboration Reviews, 2013, 10.

U.S. Department of Education. (2011). Elementary and secondary education: Part B—21st Century Community Learning Centers. http://www2.ed.gov/policy/elsec/leg/esea02/pg55.html.

U.S. Department of Education. (2014). Programs: 21st Century Community Learning Centers. http://www2.ed.gov/programs/21stcclc/index.html.

Vandell, D. L., Shernoff, D. J., Pierce, K. M., Bolt, D. M., Dadisman, K., & Brown, B. B. (2005). Activities, engagement, and emotion in after-school programs (and elsewhere). New Directions for Youth Development, 105, 121–129.PubMedCrossRef

*Weisman, S. A., Womer, S. C., Kellstrong, M., Bryner, S., Kahler, A., Slocum, L. A., et al. (2003). Maryland After-School Community Grant Program Part 1: Report on the 2002–2003 school year evaluation of the phase 3 after-school programs. College Park, MD: University of Maryland.

*Welsh, M. E., Russell, C. A., Williams, I., Reisner, E. R., & White, R. N. (2002). Promoting learning and school attendance through after school programs: Student level changes in education across TASC’s first three years. Washington, D. C.: Policy Studies Associates Inc.

Zief, S.G., Lauver, S., & Maynard, R.A. (2006). Impacts of after-school programs on student outcomes. Campbell Systematic Reviews.

Titel: Effects of After-School Programs with At-Risk Youth on Attendance and Externalizing Behaviors: A Systematic Review and Meta-Analysis
Auteurs: Kristen P. Kremer
Brandy R. Maynard
Joshua R. Polanin
Michael G. Vaughn
Christine M. Sarteschi
Publicatiedatum: 01-03-2015
Uitgeverij: Springer US
Gepubliceerd in: Journal of Youth and Adolescence / Uitgave 3/2015
Print ISSN: 0047-2891
Elektronisch ISSN: 1573-6601
DOI: https://doi.org/10.1007/s10964-014-0226-4

Bohn Stafleu van Loghum

Deel dit onderdeel of sectie (kopieer de link)

Abstract

Log in om toegang te krijgen

Andere artikelen Uitgave 3/2015

Empathy and Involvement in Bullying in Children and Adolescents: A Systematic Review

Richard Rosenfeld, Mark Edberg, Xiangming Fang and Curtis S. Florence (Eds.): Economics and Youth Violence: Crime, Disadvantage, and Community

Monica K. Miller, Jared Chamberlain and Twila Wingrove (Eds.): Psychology, Law, and the Wellbeing of Children

Are Adolescents’ Mutually Hostile Interactions at Home Reproduced in Other Everyday Life Contexts?

Christopher J. Ferguson: Adolescents, Crime, and the Media: A Critical Analysis

Does Age of Onset of Risk Behaviors Mediate the Relationship Between Child Abuse and Neglect and Outcomes in Middle Adulthood?