Skip to main content
Log in

The Study of Mentoring in the Learning Environment (SMILE): A Randomized Evaluation of the Effectiveness of School-based Mentoring

  • Published:
Prevention Science Aims and scope Submit manuscript

Abstract

The effect of providing youth school-based mentoring (SBM), in addition to other school-based support services, was examined with a sample of 516 predominately Latino students across 19 schools. Participants in a multi-component, school-based intervention program run by a youth development agency were randomly assigned to one of two conditions: (1) supportive services alone or (2) supportive services plus SBM. Compared to community-based mentoring, the duration of the SBM was brief (averaging eight meetings), partly because the agency experienced barriers to retaining mentors. Intent-to-treat (ITT) main effects of SBM were tested using hierarchical linear modeling (HLM) and revealed small, positive main effects of mentoring on self-reported connectedness to peers, self-esteem (global and present-oriented), and social support from friends, but not on several other measures, including grades and social skills. Three-way cross-level interactions of sex and school level (elementary, middle, and high school) revealed that elementary school boys and high school girls benefited the most from mentoring. Among elementary school boys, those in the mentoring condition reported higher social skills (empathy and cooperation), hopefulness, and connectedness both to school and to culturally different peers. Among high school girls, those mentored reported greater connectedness to culturally different peers, self-esteem, and support from friends. Findings suggest no or iatrogenic effects of mentoring for older boys and younger girls. Therefore, practitioners coordinating multi-component programs that include SBM would be wise to provide mentors to the youth most likely to benefit from SBM and bolster program practices that help to support and retain mentors.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1

Similar content being viewed by others

Notes

  1. At level 1, this is like Eq. 1 except that for β 3 the referral source [REF] term has been replaced by the two-way level-1 interaction term. Because referral source was non-significant in the main effect HLM analyses, it was omitted from the cross-level interaction models.

References

  • AOL Time Warner Foundation (2002). Mentoring in America. New York: AOL Time Warner Foundation.

    Google Scholar 

  • Baker, D., & Maguire, C. (2005). Mentoring in historical perspective. In D. L. DuBois & M. J. Karcher (Eds.) Handbook of youth mentoring (pp. 14–29). Thousand Oaks, CA: Sage.

    Google Scholar 

  • Battistich, V., Schaps, E., & Wilson, N. (2004). Effects of an elementary school intervention on students’ “connectedness” to school and social adjustment during middle school. Journal of Primary Prevention, 24, 243–262.

    Article  Google Scholar 

  • Boggan, D. (2005, June 15). Lunch Keynote. Youthfriends’ Second National School-based Mentoring Conference, Kansas City, Missouri.

  • Bogat, G. A., & Liang, L. (2005). Gender and mentoring relationships. In D. L. DuBois & M. J. Karcher (Eds.) Handbook of youth mentoring (pp. 205–218). Thousand Oaks, CA: Sage.

    Google Scholar 

  • Bramlett, R. K., Dielmann, K. B., & Smithson, M. (1999). Screening for behavior problems in preschool: A comparison of the social skills rating system (SSRS) and a structured teacher interview. Research in the Schools, 6, 47–52.

    Google Scholar 

  • Cavell, T., & Smith, A. M. (2005). Mentoring children. In D. L. DuBois & M. J. Karcher (Eds.) Handbook of youth mentoring (pp. 160–176). Thousand Oaks, CA: Sage.

    Google Scholar 

  • Conners, C. K., Sitarenios, G., Parker, J. D. A., & Epstein, J. N. (1998). The revised Conners’ Parent Rating Scale (CPRS-R): Factor structure, reliability, and criterion validity. Journal of Abnormal Child Psychology, 26, 257–268.

    Article  PubMed  CAS  Google Scholar 

  • Darling, N. (2005). Mentoring adolescents. In D. L. DuBois & M. J. Karcher (Eds.) Handbook of youth mentoring (pp. 177–190). Thousand Oaks, CA: Sage.

    Google Scholar 

  • DuBois, D. L., & Karcher, M. J. (2005). Youth mentoring: Theory, research, and practice. In D. L. DuBois & M. J. Karcher (Eds.) Handbook of youth mentoring (pp. 2–11). Thousand Oaks, CA: Sage Publications.

    Google Scholar 

  • DuBois, D. L., Burk-Braxton, C., Swenson, L. P., Tevendale, H. D., Lockerd, E. M., & Moran, B. J. (2002a). Getting by with a little help from self and others: Self-esteem and social support as resources during early adolescence. Developmental Psychology, 38, 822–839.

    Article  PubMed  Google Scholar 

  • DuBois, D. L., Felner, R. D., Brand, S., Phillips, R. S. C., & Lease, M. A. (1996). Early adolescent self-esteem: A developmental-ecological framework and assessment strategy. Journal of Research on Adolescence, 6, 543–579.

    Google Scholar 

  • DuBois, D. L., Felner, R. D., Sherman, M. D., & Bull, C. A. (1994). Socio-environmental experiences, self-esteem, and emotional/behavioral problems in early adolescence. American Journal of Community Psychology, 22, 371–397.

    Article  PubMed  CAS  Google Scholar 

  • DuBois, D. L., Holloway, B. E., Valentine, J. C., & Cooper, H. (2002b). Effectiveness of mentoring programs for youth: A meta-analytic review. American Journal of Community Psychology, 30, 157–197.

    Article  PubMed  Google Scholar 

  • DuBois, D. L., Neville, H. A., Parra, G. R., & Pugh-Lilly, A. O. (2002c). Testing a new model of mentoring. In J. E. Rhodes (Ed.) A critical view of youth mentoring, (Vol. 93, pp. 21–57). San Francisco: Jossey-Bass.

    Google Scholar 

  • Elliott, S. N., Gresham, F. M., Freeman, T., & McCloskey, G. (1988). Teacher and observer ratings of children’s social skills: Validation of the social skills rating scales. Journal of Psychoeducational Assessment, 6, 152–161.

    Article  Google Scholar 

  • Gresham, F. M., & Elliott, S. N. (1990). Social skills rating system manual. Circle Pines, MN: American Guidance Services.

    Google Scholar 

  • Grossman, J. B. (2005). Evaluating mentoring programs. In D. L. DuBois & M. J. Karcher (Eds.) Handbook of youth mentoring (pp. 251–265). Thousand Oaks, CA: Sage.

    Google Scholar 

  • Grossman, J. B., & Rhodes, J. E. (2002). The test of time: Predictors and effects of duration in youth mentoring programs. American Journal of Community Psychology, 30, 199–219.

    Article  PubMed  Google Scholar 

  • Hansen, K. (2005). School-based mentoring study phase 1 report 2003–2004 school year: Effective practices. Philadelphia: Big Brothers Big Sisters.

    Google Scholar 

  • Henrich, C. C., Brookmeyer, K. A., & Shahar, G. (2005). Weapon violence in adolescence: Parent and school connectedness as protective factors. Journal of Adolescent Health, 37, 306–312.

    Article  PubMed  Google Scholar 

  • Herrera, C. L., Sipe, W. S., & McClanahan, Z. (2000). Mentoring school-age children: Relationship development in community-based and school-based programs. Philadelphia: Public/Private Ventures.

    Google Scholar 

  • Huston, A. C., Duncan, G. J., Granger, R., Bos, J., McLoyd, V., Mistry, R., et al. (2001). Work-based antipoverty programs for parents can enhance the school performance and social behavior of children. Child Development, 72, 318–336.

    Article  PubMed  CAS  Google Scholar 

  • Kalaian, S. A. (2003). Meta-analysis methods for synthesizing treatment effects in multisite studies: Hierarchical linear modeling (HLM) perspective. Practical Assessment, Research & Evaluation, 8(15). Retrieved June 28, 2007 from http://PAREonline.net/getvn.asp?v=8&n=15.

  • Karcher, M. J. (2003). The Hemingway: Measure of adolescent connectedness: Validation studies. ERIC no. ED477969; ERIC/CASS no. CG032433. Retrieved February 28, 2005 from http://www.adolescentconnectedness.com

  • Karcher, M. J. (2004). Connectedness and school violence: A framework for developmental interventions. In E. R. Gerler Jr. (Ed.) Handbook of school violence (pp. 7–39). New York: Haworth.

    Google Scholar 

  • Karcher, M. J. (2005). The effects of school-based developmental mentoring and mentors’ attendance on mentees’ self-esteem, behavior, and connectedness. Psychology in the Schools, 42, 65–77.

    Article  Google Scholar 

  • Karcher, M. J., Davis, C., & Powell, B. (2002). Developmental mentoring in the schools: Testing connectedness as a mediating variable in the promotion of academic achievement. The School Community Journal, 12, 36–52.

    Google Scholar 

  • Karcher, M. J., & Finn, L. (2005). How connectedness contributes to experimental smoking among rural youth: Developmental and ecological analyses. Journal of Primary Prevention, 26, 25–36.

    Article  PubMed  Google Scholar 

  • Karcher, M. J., Kuperminc, G., Portwood, S., Sipe, C., & Taylor, A. (2006). Mentoring programs: A framework to inform program development, research, and evaluation. Journal of Community Psychology, 34, 709–725.

    Article  Google Scholar 

  • King, K., Vidourek, R., Davis, B., & McClellan, W. (2002). Increasing self-esteem and school connectedness through a multidimensional mentoring program. Journal of School Health, 72, 294–299.

    Article  PubMed  Google Scholar 

  • Kuperminc, G., Emshoff, J. G., Reiner, M. N., Secrest, L. A., Niolon, P., & Foster, J. D. (2005). Integration of mentoring with other programs and services. In D. L. DuBois & M. J. Karcher (Eds.) Handbook of youth mentoring (pp. 314–334). Thousand Oaks, CA: Sage.

    Google Scholar 

  • Marshall, S. (2001). Do I matter? Construct validation of adolescents’ perceived mattering to parents and friends. Journal of Adolescence, 24, 473–490.

    Article  PubMed  CAS  Google Scholar 

  • MENTOR/National Mentoring Partnership. (2004). $450 million dollars for mentoring: Issue brief. Retrieved July 18, 2004, from http://www.mentoring.org/take_action/hot_issues/president/index.adp.

  • Portwood, S. G., & Ayers, P. M. (2005). Schools. In D. L. DuBois & M. J. Karcher (Eds.) Handbook of youth mentoring (pp. 336–347). Thousand Oaks, CA: Sage.

    Google Scholar 

  • Procidano, M., & Heller, K. (1983). Measures of perceived social support from friends and from family: Three validation studies. American Journal of Community Psychology, 11, 1–24.

    Article  PubMed  CAS  Google Scholar 

  • Raudenbush, S. W., & Bryk, A. S. (2002). Hierarchical linear models: Applications and data analysis methods (2nd ed.). Newbury Park, CA: Sage.

    Google Scholar 

  • Rhodes, J. E., & Davis, A. B. (1996). Supportive ties between nonparent adults and urban adolescent girls. In B. J. Leadbeater & N. Way (Eds.) Urban girls: Resisting stereotypes, creating identities (pp. 213–225). New York: New York University Press.

    Google Scholar 

  • Rhodes, J. E., Grossman, J. B., & Resch, N. L. (2000). Agents of change: Pathways through which mentoring relationships influence adolescents’ academic adjustment. Child Development, 71, 1662–1671.

    Article  PubMed  CAS  Google Scholar 

  • Sanchez, B., & Colon, Y. (2005). Race, ethnicity, and culture in mentoring relationships. In D. L. DuBois & M. J. Karcher (Eds.) Handbook of youth mentoring (pp. 251–265). Thousand Oaks, CA: Sage.

    Google Scholar 

  • Sanchez, B., Colon, Y., & Esparza, P. (2005). The role of a sense of school belonging and gender in the academic achievement of Latino adolescents. Journal of Youth and Adolescence, 34, 619–628.

    Article  Google Scholar 

  • Sanchez, B., & Reyes, O. (1999). Descriptive profile of the mentorship relationships of Latino adolescents. Journal of Community Psychology, 27, 299–302.

    Article  Google Scholar 

  • Schafer, J. L., & Graham, J. W. (2002). Missing data: Our view of the state of the art. Psychological Methods, 7, 147–177.

    Article  PubMed  Google Scholar 

  • Shorey, H. S., Snyder, C. R., Yang, X., & Lewin, M. R. (2003). The role of hope as a mediator in recollected parenting, adult attachment, and mental health. Journal of Social & Clinical Psychology, 22, 685–715.

    Article  Google Scholar 

  • Sipe, C. L., & Roder, A. E. (1999). Mentoring school-age children: A classification of programs. Philadelphia: Public/Private Ventures.

    Google Scholar 

  • Snyder, C. R., Hoza, B., Pelham, W. E., Rapoff, M., Ware, L., Danovsky, M., et al. (1997). The development and validation of the Children’s Hope Scale. Journal of Pediatric Psychology, 22, 399–421.

    Article  PubMed  CAS  Google Scholar 

  • Snyder, C. R., Lopez, S. J., Shorey, H. S., Rand, K. L., & Feldman, D. B. (2003). Hope theory, measurements, and applications to school psychology. School Psychology Quarterly, 18, 122–139.

    Article  Google Scholar 

  • Stuart, D. L., Gresham, F. M., & Elliott, S. N. (1991). Teacher ratings of social skills in popular and rejected males and females. School Psychology Quarterly, 6, 16–26.

    Article  Google Scholar 

  • Thomas, S. P., & Smith, H. (2004). School connectedness, anger behaviors, and relationships of violent and nonviolent American youth. Perspectives in Psychiatric Care, 40, 135–148.

    Article  PubMed  Google Scholar 

  • Weisz, J. R., Weiss, B., Han, S. S., Granger, D. A., & Morton, T. (1995). Effects of psychotherapy with children and adolescents revisited: A meta-analysis of treatment outcome studies. Psychological Bulletin, 117, 450–468.

    Article  PubMed  CAS  Google Scholar 

Download references

Acknowledgements

This research was funded by the William T. Grant Foundation and received ongoing support from Drs. Robert Granger and Ed Seidman. The study was conducted through the Communities in Schools of San Antonio (CISSA) agency with the help of ChiChi Allen, Kristine Benne, Debby Gil-Hernandez, Molly Gomez, Michelle Holcomb, and Laura Roy-Carlson. David DuBois consulted on the design and data analyses. The project would not have succeeded without the support of Dr. Patrick McDaniel, Nancy Reed. Jessica Weaver, the Case Managers and Cluster Leaders at CISSA. Ed Connor assisted with data management. Bob Frasier and Ross Trevino assisted with mentor recruitment. Drs. Rich Diem, Art Hernandez, and Jesse Zapata provided a home for the 3-year project. The author thanks David DuBois, Renee Spencer, and Timothy Cavell for their feedback on earlier drafts, and both Tina Kauh and Mathilda du Toit for assistance with the HLM models.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Michael J. Karcher.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Karcher, M.J. The Study of Mentoring in the Learning Environment (SMILE): A Randomized Evaluation of the Effectiveness of School-based Mentoring. Prev Sci 9, 99–113 (2008). https://doi.org/10.1007/s11121-008-0083-z

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11121-008-0083-z

Keywords

Navigation