Skip to main content
Log in

Examining the Role of Implementation Quality in School-Based Prevention Using the PATHS Curriculum

  • Published:
Prevention Science Aims and scope Submit manuscript

Abstract

In order for empirically validated school-based prevention programs to “go to scale,” it is important to understand the processes underlying program dissemination. Data collected in effectiveness trials, especially those measuring the quality of program implementation and administrative support, are valuable in explicating important factors influencing implementation. This study describes findings regarding quality of implementation in a recent effectiveness trial conducted in a high-risk, American urban community. This delinquency prevention trial is a locally owned intervention, which used the Promoting Alternative THinking Skills Curriculum as its major program component. The intervention involved 350 first graders in 6 inner-city public schools. Three schools implemented the intervention and the other 3 were comparison schools from the same school district. Although intervention effects were not found for all the intervention schools, the intervention was effective in improving children's emotional competence and reducing their aggression in schools which effectively supported the intervention. This study, utilizing data from the 3 intervention schools (13 classrooms and 164 students), suggested that 2 factors contributed to the success of the intervention: (a) adequate support from school principals and (b) high degree of classroom implementation by teachers. These findings are discussed in light of the theory-driven models in program evaluation that emphasized the importance of the multiple factors influencing the implementation of school-based interventions.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Similar content being viewed by others

REFERENCES

  • Andrews, R., & Sober, R. (1987). Principal instructional leadership and school achievement. Educational Leadership, 44, 9-11.

    Google Scholar 

  • Blakely, C. H., Mayer, J. P., Gottschalk, R. G., Schmitt, N., Davidson, W. S., Roitman, D. B., & Emshoff, J. G. (1987). The fidelity-adaptation debate: Implications for the implementation of public sector social programs. American Journal of Community Psychology, 15, 253-268.

    Google Scholar 

  • Bossert, S., Dwyer, D., Rowan, B., & Lee, G. (1982). The instructional management role of the principal. Educational Administration Quarterly, 18, 34-64.

    Google Scholar 

  • Botvin, G. J., Baker, E., Dusenbury, L., & Botvin, E. M., & Diaz, T. (1995). Long-term follow-up results of a randomized drug abuse prevention trial in a white middle-class population. JAMA, 273, 1106-1112.

    Google Scholar 

  • Botvin, G. J., Baker, E., Dusenbury, L., Tortu, S., & Botvin, E. M. (1990). Preventing adolescent drug abuse through a multi-modal cognitive-behavioral approach: Results of a 3-year study. Journal of Consulting and Clinical Psychology, 58, 437-446.

    Google Scholar 

  • Catalano, R. F., Berglund, M. L., Ryan, J. A. M., Lonczak, H. C., & Hawkins, J. D. (1998). Positive youth development in the United States: Research findings on evaluations of positive youth development programs (NICHD Publication). Washington, DC: U.S. Department of Health and Human Services.

    Google Scholar 

  • Chen, H. T. (1990). Theory-driven evaluations. Newbury Park, CA: Sage.

    Google Scholar 

  • Chen, H. T. (1998). Theory-driven evaluations. Advances in Educational Productivity, 7, 15-34.

    Google Scholar 

  • Conduct Problems Prevention Research Group. (1999). Initial impact of the Fast Track prevention trial for conduct problems: II. Classroom effects. Journal of Consulting and Clinical Psychology, 67, 648-657.

    Google Scholar 

  • Connell, D. B., Turner, R. R., & Mason, E. F. (1985). Summary of the findings of the School Health Education Evaluation: Health promotion effectiveness, implementation, and costs. Journal of School Health, 55, 316-323.

    Google Scholar 

  • Cubberley, E. P. (1929). Public school administration. New York: Houghton Mifflin.

    Google Scholar 

  • Dane, A. V., & Schneider, B. H. (1998). Program integrity in primary and early secondary prevention: Are implementation effects out of control. Clinical Psychology Review, 18, 23-45.

    Google Scholar 

  • Deal, T. (1986). Effective school principals: Counselors, engineers, pawnbrokers, poets... or instructional leaders? In W. Greenfield (Ed.), Instructional leadership: Concepts, issues and controversies (pp. 230-245). Lexington, MA: Allyn & Bacon.

    Google Scholar 

  • Domitrovich, C. E., & Greenberg, M. T. (2000). The study of implementation: Current findings from effective programs that prevent mental disorders in school-aged children. Journal of Educational and Psychological Consultation, 11(2), 193-221.

    Google Scholar 

  • Drug Strategies. (1996). Making the grade: A guide to school drug prevention programs. Washington, DC: Drug Strategies.

    Google Scholar 

  • Drug Strategies. (1998). Safe schools, safe students: A guide to violence prevention strategies. Washington, DC: Drug Strategies.

    Google Scholar 

  • Durlak, J. A. (1997). Successful prevention programs for children and adolescents. New York: Plenum.

    Google Scholar 

  • Durlak, J. A. (1998). Why program implementation is important. Journal of Prevention and Intervention in the Community, 17, 5-18.

    Google Scholar 

  • Durlak, J. A., & Wells, A. M. (1998). Evaluation of indicated preventive intervention (secondary prevention) mental health programs for children and adolescents. American Journal of Community Psychology, 26, 775-802.

    Google Scholar 

  • Elias, M. J., Bruene-Butler, L., Blum, L., & Schuyler, T. (2000). Voices from the field: Identifying and overcoming roadblocks to carrying out programs in social and emotional learning/emotional intelligence. Journal of Educational and Psychological Consultation, 11(2), 253-272.

    Google Scholar 

  • Elliot, D. S. (1998). Blueprints for violence prevention. Center for the Study and Prevention of Violence, University of Colorado at Boulder.

  • Fullan, M., Miles, M. B., & Taylor, G. (1980). Organizational development in schools: The state of the art. Review of Educational Research, 50, 121-183.

    Google Scholar 

  • Gottfredson, D. C., Fink, C. M., Skroban, S., & Gottfredson, G. D. (1997). Making prevention work. In R. P. Weissberg, T. P. Gullotta, R. L. Hampton, B. A. Ryan, & G. R. Adams (Vol. Eds.), Issues in children's and families' lives, Vol. 9: Healthy children 2010: Establishing preventive services (pp. 219-252). Thousand Oaks, CA: Sage.

    Google Scholar 

  • Gottfredson, D. C., & Gottfredson, G. D. (2002). Quality of school-based prevention programs: Results from a national survey. Journal of Research on Crime and Delinquency, 39(1), 3-35.

    Google Scholar 

  • Greenberg, M. T., Domitrovich, C., & Bumbarger, B. (2001). The Prevention of Mental Disorders in SchoolAged Children: Current State of the Field. Prevention and Treatment., Volume 4, Article 1. Available on the World Wide Web: http://journals.apa.org/prevention/volume4/pre004001a.html.

  • Greenberg, M. T., Domitrovich, C., Graczyk, P. A., & Zins, J. E. (2000). The study of implementation in school-based prevention research: Theory, research, and practice. Report to the Center for Mental Health Services (SAMHSA). Available on the World Wide Web: http://www.prevention.psu.edu/.

  • Greenberg, M. T., & Kusché, C. A. (1998). Blueprints for violence prevention: The PATHS Project (Vol. 10). Boulder, CO: Institute of Behavioral Science, Regents of the University of Colorado.

    Google Scholar 

  • Greenberg, M. T., Kusché, C. A., Cook, E. T., & Quamma, J. P. (1995). Promoting emotional competence in school-aged children: The effects of the PATHS curriculum. Development and Psychopathology, 7, 117-136.

    Google Scholar 

  • Greenfield, W. (1986). Moral imagination and interpersonal competence: Antecedents to instructional leadership. In W. Greenfield (Ed.), Instructional leadership: Concepts, issues and controversies (pp. 56-76). Lexington, MA: Allyn & Bacon.

    Google Scholar 

  • Gresham, F. M., Gansle, K. A., Noell, G. H., & Cohen, S. (1993). Treatment integrity of school-based behavioral intervention studies: 1980-1990. School Psychology Review, 22, 254-272.

    Google Scholar 

  • Hall, G. E., & Hord, S. M. (1987). Change in schools: Facilitating the process. Albany, NY: State University of New York Press.

    Google Scholar 

  • Hall, G. E., & Loucks, S. F. (1977). A developmental model for determining whether the treatment is actually implemented. American Education Research Journal, 14, 236-276.

    Google Scholar 

  • Hallinger, P., & Heck, R. H. (1996). Reassessing the principal's role in school effectiveness: A review of empirical research, 1980-1995. Educational Administration Quarterly, 32, 5-44.

    Google Scholar 

  • Hansen, W. B., Graham, J. W., Wolkenstein, B. H., & Lundy, B. Z. (1989). Differential impact of three alcohol prevention curricula on hypothesized mediating variables. Journal of Drug Education, 18, 143-153.

    Google Scholar 

  • Heck, R. H., Larsen, T. J., & Marcoulides, G. A. (1990). Instructional leadership and school achievement: Validation of a causal model. Educational Administration Quarterly, 26, 94-125.

    Google Scholar 

  • Hopkins, D. (1990). Integrating staff development and school improvement: A study of teacher personality and school climate. In B. Joyce (Ed.), Changing school culture through staff development. Alexandria, VA: Association for Supervision and Curriculum Development.

    Google Scholar 

  • Horsley, D. L., & Horsley-Loucks, S. (1998). CBAM Brings Order to the Tornado of Change. Journal of Staff Development, 19, 17-20.

    Google Scholar 

  • Hoy, W. K., Tarter C. J., & Kottkamp, R. B. (1991). Open schools/healthy students: Measuring organizational climate. Newbury Park, CA: Sage.

    Google Scholar 

  • Institute of Medicine. (1994). Reducing risks for mental disorders: Frontiers for preventive intervention research. Washington, DC: National Academy Press.

    Google Scholar 

  • Kam, C., & Greenberg, M. T. (1998). Technical Measurement Report on the Teacher Social Competence Rating Scale. Unpublished technical report, Prevention Research Center for the Promotion of Human Development, The Pennsylvania State University.

  • Kusché, C. A., & Greenberg, M. T. (1994). The PATHS curriculum. Seattle, WA: Developmental Research and Programs.

    Google Scholar 

  • Leithwood, K. A., & Duke, (1999). A century's quest to understand school leadership. In J. Murphy & K. S. Louis (Eds.), Handbook of research on educational administration (2nd ed., pp. 45-72). San Francisco, CA: Jossey-Bass.

    Google Scholar 

  • McKibbin, M., & Joyce, B. (1980). Psychological states and staff development. Theory Into Practice, 19, 248-255.

    Google Scholar 

  • Mihalic, S. (2001). The importance of implementation fidelity. Blueprints News, 2(1), 1-2.

    Google Scholar 

  • Pentz, M. A., & Trebow, E. (1985). Implementation issues in drug abuse prevention research. In C. Leukfeld & J. Ludford (Eds.), Adolescent drug abuse: Analyses of treatment research (DHHS Pub No. [89-125488], pp. 123-139). National Institute of Drug Abuse Monograph 56. Washington, DC: Supt. of Docs., U.S. Govt. Print. Off.

    Google Scholar 

  • Pentz, M. A., Trebow, E. A., Hansen, W. B., MacKinnon, D. P., Dwyer, J. H., Flay, B. R., Daniels, S., Cormack, C., & Johnson, C. A. (1990). Effects of program implementation on adolescent drug use behavior: The Midwestern Prevention Project. Evaluation Review, 14, 264-289.

    Google Scholar 

  • Rogers, E. M. (1995). Diffusions of innovations. New York: Free Press.

    Google Scholar 

  • Rohrbach, L. A., Graham, J. W., & Hansen, W. B. (1993). Diffusion of a school-based substance abuse prevention program: Predictors of program implementation. Preventive Medicine: An International Journal Devoted to Practice and Theory, 22, 237-260.

    Google Scholar 

  • Rowan, B., & Denk, C. E. (1984). Management succession, school socioeconomic context and basic skills achievement. American Education Research Journal, 21, 517-537.

    Google Scholar 

  • Sarason, S. B. (1982). The culture of the school and the problem of change (2nd ed.). Boston: Allyn & Bacon.

    Google Scholar 

  • Taggart, V. S., Bush, P. J., Zuckerman, A. E., & Theiss, P. K. (1990). A process evaluation of the District of Columbia "know your body" project. Journal of School Health, 60, 60-66.

    Google Scholar 

  • Tierney, J. P., Grossman, J. B., & Resch, N. L. (1995). Making a difference: An impact study of big brothers big sisters. Philadelphia, PA: Public/Private Ventures.

    Google Scholar 

  • Tricker, R., & Davis, L. G. (1988). Implementing drug education in schools: An analysis of the costs and teacher perceptions. Journal of School Health, 58, 181-185.

    Google Scholar 

  • Weissberg, R. P., & Elias, M. J. (1993). Enhancing young people's social competence and health behavior: An important challenge for educators, scientists, policy makers, and funders. Applied and preventive psychology: Current scientific perspectives, 3, 179-190.

    Google Scholar 

  • Zins, J. E., Elias, M. J., Greenberg, M. T., & Pruett, M. K. (2000). Special Issue: Implementation of Prevention Programs. Journal of Educational and Psychological Consultation, 11(1), 1-172.

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Mark T. Greenberg.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Kam, CM., Greenberg, M.T. & Walls, C.T. Examining the Role of Implementation Quality in School-Based Prevention Using the PATHS Curriculum. Prev Sci 4, 55–63 (2003). https://doi.org/10.1023/A:1021786811186

Download citation

  • Issue Date:

  • DOI: https://doi.org/10.1023/A:1021786811186

Navigation