Abstract
In order for empirically validated school-based prevention programs to “go to scale,” it is important to understand the processes underlying program dissemination. Data collected in effectiveness trials, especially those measuring the quality of program implementation and administrative support, are valuable in explicating important factors influencing implementation. This study describes findings regarding quality of implementation in a recent effectiveness trial conducted in a high-risk, American urban community. This delinquency prevention trial is a locally owned intervention, which used the Promoting Alternative THinking Skills Curriculum as its major program component. The intervention involved 350 first graders in 6 inner-city public schools. Three schools implemented the intervention and the other 3 were comparison schools from the same school district. Although intervention effects were not found for all the intervention schools, the intervention was effective in improving children's emotional competence and reducing their aggression in schools which effectively supported the intervention. This study, utilizing data from the 3 intervention schools (13 classrooms and 164 students), suggested that 2 factors contributed to the success of the intervention: (a) adequate support from school principals and (b) high degree of classroom implementation by teachers. These findings are discussed in light of the theory-driven models in program evaluation that emphasized the importance of the multiple factors influencing the implementation of school-based interventions.
Similar content being viewed by others
REFERENCES
Andrews, R., & Sober, R. (1987). Principal instructional leadership and school achievement. Educational Leadership, 44, 9-11.
Blakely, C. H., Mayer, J. P., Gottschalk, R. G., Schmitt, N., Davidson, W. S., Roitman, D. B., & Emshoff, J. G. (1987). The fidelity-adaptation debate: Implications for the implementation of public sector social programs. American Journal of Community Psychology, 15, 253-268.
Bossert, S., Dwyer, D., Rowan, B., & Lee, G. (1982). The instructional management role of the principal. Educational Administration Quarterly, 18, 34-64.
Botvin, G. J., Baker, E., Dusenbury, L., & Botvin, E. M., & Diaz, T. (1995). Long-term follow-up results of a randomized drug abuse prevention trial in a white middle-class population. JAMA, 273, 1106-1112.
Botvin, G. J., Baker, E., Dusenbury, L., Tortu, S., & Botvin, E. M. (1990). Preventing adolescent drug abuse through a multi-modal cognitive-behavioral approach: Results of a 3-year study. Journal of Consulting and Clinical Psychology, 58, 437-446.
Catalano, R. F., Berglund, M. L., Ryan, J. A. M., Lonczak, H. C., & Hawkins, J. D. (1998). Positive youth development in the United States: Research findings on evaluations of positive youth development programs (NICHD Publication). Washington, DC: U.S. Department of Health and Human Services.
Chen, H. T. (1990). Theory-driven evaluations. Newbury Park, CA: Sage.
Chen, H. T. (1998). Theory-driven evaluations. Advances in Educational Productivity, 7, 15-34.
Conduct Problems Prevention Research Group. (1999). Initial impact of the Fast Track prevention trial for conduct problems: II. Classroom effects. Journal of Consulting and Clinical Psychology, 67, 648-657.
Connell, D. B., Turner, R. R., & Mason, E. F. (1985). Summary of the findings of the School Health Education Evaluation: Health promotion effectiveness, implementation, and costs. Journal of School Health, 55, 316-323.
Cubberley, E. P. (1929). Public school administration. New York: Houghton Mifflin.
Dane, A. V., & Schneider, B. H. (1998). Program integrity in primary and early secondary prevention: Are implementation effects out of control. Clinical Psychology Review, 18, 23-45.
Deal, T. (1986). Effective school principals: Counselors, engineers, pawnbrokers, poets... or instructional leaders? In W. Greenfield (Ed.), Instructional leadership: Concepts, issues and controversies (pp. 230-245). Lexington, MA: Allyn & Bacon.
Domitrovich, C. E., & Greenberg, M. T. (2000). The study of implementation: Current findings from effective programs that prevent mental disorders in school-aged children. Journal of Educational and Psychological Consultation, 11(2), 193-221.
Drug Strategies. (1996). Making the grade: A guide to school drug prevention programs. Washington, DC: Drug Strategies.
Drug Strategies. (1998). Safe schools, safe students: A guide to violence prevention strategies. Washington, DC: Drug Strategies.
Durlak, J. A. (1997). Successful prevention programs for children and adolescents. New York: Plenum.
Durlak, J. A. (1998). Why program implementation is important. Journal of Prevention and Intervention in the Community, 17, 5-18.
Durlak, J. A., & Wells, A. M. (1998). Evaluation of indicated preventive intervention (secondary prevention) mental health programs for children and adolescents. American Journal of Community Psychology, 26, 775-802.
Elias, M. J., Bruene-Butler, L., Blum, L., & Schuyler, T. (2000). Voices from the field: Identifying and overcoming roadblocks to carrying out programs in social and emotional learning/emotional intelligence. Journal of Educational and Psychological Consultation, 11(2), 253-272.
Elliot, D. S. (1998). Blueprints for violence prevention. Center for the Study and Prevention of Violence, University of Colorado at Boulder.
Fullan, M., Miles, M. B., & Taylor, G. (1980). Organizational development in schools: The state of the art. Review of Educational Research, 50, 121-183.
Gottfredson, D. C., Fink, C. M., Skroban, S., & Gottfredson, G. D. (1997). Making prevention work. In R. P. Weissberg, T. P. Gullotta, R. L. Hampton, B. A. Ryan, & G. R. Adams (Vol. Eds.), Issues in children's and families' lives, Vol. 9: Healthy children 2010: Establishing preventive services (pp. 219-252). Thousand Oaks, CA: Sage.
Gottfredson, D. C., & Gottfredson, G. D. (2002). Quality of school-based prevention programs: Results from a national survey. Journal of Research on Crime and Delinquency, 39(1), 3-35.
Greenberg, M. T., Domitrovich, C., & Bumbarger, B. (2001). The Prevention of Mental Disorders in SchoolAged Children: Current State of the Field. Prevention and Treatment., Volume 4, Article 1. Available on the World Wide Web: http://journals.apa.org/prevention/volume4/pre004001a.html.
Greenberg, M. T., Domitrovich, C., Graczyk, P. A., & Zins, J. E. (2000). The study of implementation in school-based prevention research: Theory, research, and practice. Report to the Center for Mental Health Services (SAMHSA). Available on the World Wide Web: http://www.prevention.psu.edu/.
Greenberg, M. T., & Kusché, C. A. (1998). Blueprints for violence prevention: The PATHS Project (Vol. 10). Boulder, CO: Institute of Behavioral Science, Regents of the University of Colorado.
Greenberg, M. T., Kusché, C. A., Cook, E. T., & Quamma, J. P. (1995). Promoting emotional competence in school-aged children: The effects of the PATHS curriculum. Development and Psychopathology, 7, 117-136.
Greenfield, W. (1986). Moral imagination and interpersonal competence: Antecedents to instructional leadership. In W. Greenfield (Ed.), Instructional leadership: Concepts, issues and controversies (pp. 56-76). Lexington, MA: Allyn & Bacon.
Gresham, F. M., Gansle, K. A., Noell, G. H., & Cohen, S. (1993). Treatment integrity of school-based behavioral intervention studies: 1980-1990. School Psychology Review, 22, 254-272.
Hall, G. E., & Hord, S. M. (1987). Change in schools: Facilitating the process. Albany, NY: State University of New York Press.
Hall, G. E., & Loucks, S. F. (1977). A developmental model for determining whether the treatment is actually implemented. American Education Research Journal, 14, 236-276.
Hallinger, P., & Heck, R. H. (1996). Reassessing the principal's role in school effectiveness: A review of empirical research, 1980-1995. Educational Administration Quarterly, 32, 5-44.
Hansen, W. B., Graham, J. W., Wolkenstein, B. H., & Lundy, B. Z. (1989). Differential impact of three alcohol prevention curricula on hypothesized mediating variables. Journal of Drug Education, 18, 143-153.
Heck, R. H., Larsen, T. J., & Marcoulides, G. A. (1990). Instructional leadership and school achievement: Validation of a causal model. Educational Administration Quarterly, 26, 94-125.
Hopkins, D. (1990). Integrating staff development and school improvement: A study of teacher personality and school climate. In B. Joyce (Ed.), Changing school culture through staff development. Alexandria, VA: Association for Supervision and Curriculum Development.
Horsley, D. L., & Horsley-Loucks, S. (1998). CBAM Brings Order to the Tornado of Change. Journal of Staff Development, 19, 17-20.
Hoy, W. K., Tarter C. J., & Kottkamp, R. B. (1991). Open schools/healthy students: Measuring organizational climate. Newbury Park, CA: Sage.
Institute of Medicine. (1994). Reducing risks for mental disorders: Frontiers for preventive intervention research. Washington, DC: National Academy Press.
Kam, C., & Greenberg, M. T. (1998). Technical Measurement Report on the Teacher Social Competence Rating Scale. Unpublished technical report, Prevention Research Center for the Promotion of Human Development, The Pennsylvania State University.
Kusché, C. A., & Greenberg, M. T. (1994). The PATHS curriculum. Seattle, WA: Developmental Research and Programs.
Leithwood, K. A., & Duke, (1999). A century's quest to understand school leadership. In J. Murphy & K. S. Louis (Eds.), Handbook of research on educational administration (2nd ed., pp. 45-72). San Francisco, CA: Jossey-Bass.
McKibbin, M., & Joyce, B. (1980). Psychological states and staff development. Theory Into Practice, 19, 248-255.
Mihalic, S. (2001). The importance of implementation fidelity. Blueprints News, 2(1), 1-2.
Pentz, M. A., & Trebow, E. (1985). Implementation issues in drug abuse prevention research. In C. Leukfeld & J. Ludford (Eds.), Adolescent drug abuse: Analyses of treatment research (DHHS Pub No. [89-125488], pp. 123-139). National Institute of Drug Abuse Monograph 56. Washington, DC: Supt. of Docs., U.S. Govt. Print. Off.
Pentz, M. A., Trebow, E. A., Hansen, W. B., MacKinnon, D. P., Dwyer, J. H., Flay, B. R., Daniels, S., Cormack, C., & Johnson, C. A. (1990). Effects of program implementation on adolescent drug use behavior: The Midwestern Prevention Project. Evaluation Review, 14, 264-289.
Rogers, E. M. (1995). Diffusions of innovations. New York: Free Press.
Rohrbach, L. A., Graham, J. W., & Hansen, W. B. (1993). Diffusion of a school-based substance abuse prevention program: Predictors of program implementation. Preventive Medicine: An International Journal Devoted to Practice and Theory, 22, 237-260.
Rowan, B., & Denk, C. E. (1984). Management succession, school socioeconomic context and basic skills achievement. American Education Research Journal, 21, 517-537.
Sarason, S. B. (1982). The culture of the school and the problem of change (2nd ed.). Boston: Allyn & Bacon.
Taggart, V. S., Bush, P. J., Zuckerman, A. E., & Theiss, P. K. (1990). A process evaluation of the District of Columbia "know your body" project. Journal of School Health, 60, 60-66.
Tierney, J. P., Grossman, J. B., & Resch, N. L. (1995). Making a difference: An impact study of big brothers big sisters. Philadelphia, PA: Public/Private Ventures.
Tricker, R., & Davis, L. G. (1988). Implementing drug education in schools: An analysis of the costs and teacher perceptions. Journal of School Health, 58, 181-185.
Weissberg, R. P., & Elias, M. J. (1993). Enhancing young people's social competence and health behavior: An important challenge for educators, scientists, policy makers, and funders. Applied and preventive psychology: Current scientific perspectives, 3, 179-190.
Zins, J. E., Elias, M. J., Greenberg, M. T., & Pruett, M. K. (2000). Special Issue: Implementation of Prevention Programs. Journal of Educational and Psychological Consultation, 11(1), 1-172.
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Kam, CM., Greenberg, M.T. & Walls, C.T. Examining the Role of Implementation Quality in School-Based Prevention Using the PATHS Curriculum. Prev Sci 4, 55–63 (2003). https://doi.org/10.1023/A:1021786811186
Issue Date:
DOI: https://doi.org/10.1023/A:1021786811186