Abstract
This study evaluated the Olweus Bully Prevention Program (OBPP) in urban middle schools serving a mostly African American student population. Participants were 1791 students from three communities with high rates of crime and poverty. We evaluated the impact of the OBPP using a multiple-baseline experimental design in which we randomized the order and timing of intervention activities across three schools. We assessed the frequency of violence and victimization using self-report and teachers’ ratings of students collected every 3 months over 5 years. Initiation of the OBPP was associated with reductions in teachers’ ratings of students’ frequency of aggression, with effects emerging in different years of implementation for different forms of aggression. Whereas reductions in teachers’ ratings of students’ verbal and relational aggression and victimization were evident during the second implementation year, reductions in physical aggression did not appear until the third year. Effects were consistent across gender and schools, with variability across grades for relational and verbal aggression and victimization. In contrast, there were no intervention effects on students’ reports of their behavior. Positive outcomes for teachers’, but not students’ ratings, suggest the intervention’s effects may have been limited to the school context. Variation in when effects emerged across outcomes suggests that changes in physical aggression may require more sustained intervention efforts. The intervention was also associated with increases in teachers’ concerns about school safety problems, which may indicate that teachers were more attuned to recognizing problem behaviors following exposure to the OBPP.
Similar content being viewed by others
References
Bauer, N. S., Lozano, P., & Rivara, F. P. (2007). The effectiveness of the Olweus Bullying Prevention Program in public middle schools: A controlled trial. Journal of Adolescent Health, 40, 266–274. https://doi.org/10.1016/j.jadohealth.2006.10.005.
Biglan, A., Ary, D., & Wagenaar, A. C. (2000). The value of interrupted time-series experiments for community intervention research. Prevention Science, 1, 31–49. https://doi.org/10.1023/A:1010024016308.
Black, S. A., & Jackson, E. (2007). Using bullying incident density to evaluation the Olweus Bullying Prevention Program. School Psychology International, 28, 623–638. https://doi.org/10.1177/0143034307085662.
Bosworth, K., Espelage, D. L., & Simon, T. R. (1999). Factors associated with bullying behavior in middle school students. Journal of Early Adolescence, 19, 341–362. https://doi.org/10.1177/0272431699019003003.
Bowllan, N. M. (2011). Implementation and evaluation of a comprehensive, school-wide bullying prevention program in an urban/suburban middle school. Journal of School Health, 81, 167–173. https://doi.org/10.1111/j.1746-1561.2010.00576.x.
Crone, D. A., Hawken, L. S., & Horner, R. H. (2010). Responding to problem behavior in schools: The behavior education program (2nd ed.). New York: Guilford.
Eslea, M., & Smith, P. K. (1998). The long-term effectiveness of anti-bullying work in primary schools. Educational Research, 40, 203–218. https://doi.org/10.1080/0013188980400208.
Farrell, A. D., & Vulin-Reynolds, M. (2007). Violent behavior and the science of prevention. In D. Flannery, A. Vazonsyi, & I. Waldman (Eds.), Cambridge handbook of violent behavior (pp. 766–786). New York: Cambridge University Press. https://doi.org/10.1017/CBO9780511816840.041.
Farrell, A. D., Mays, S., Bettencourt, A., Erwin, E. H., Vulin-Reynolds, M., & Allison, K. W. (2010). Environmental influences on fighting versus nonviolent behavior in peer situations: A qualitative study with urban African American adolescents. American Journal of Community Psychology, 46, 19–35. https://doi.org/10.1007/s10464-010-9331-z.
Farrell, A. D., Sullivan, T. N., Goncy, E. A., & Le, A. T. H. (2016). Assessment of adolescents’ victimization, aggression, and problem behaviors: Evaluation of the Problem Behavior Frequency Scale. Psychological Assessment, 28, 702–714. https://doi.org/10.1037/pas0000225.
Farrell, A. D., Thompson, E. L., Sullivan, T. N., & Goncy, E. A. (2017). Assessment of adolescents’ victimization, aggression, and problem behaviors: Evaluation of the Problem Behavior Frequency Scale - Adolescent Report. Manuscript submitted for publication.
Farrell, A. D., Goncy, E. A., Sullivan, T. N., & Thompson, E. L. (2018). Evaluation of the problem behavior frequency scale—teacher report form for assessing behavior in a sample of urban adolescents. Psychological Assessment. https://doi.org/10.1037/pas0000571.
Fuentes, V. E., Goncy, E. A., & Sutherland, K. S. (2015). Cross-cultural perspectives after participation in the YES program: A pilot study. Journal of Youth Development, 10, 64–73. https://doi.org/10.5195/JYD.2015.8.
Goncy, L. A., Sutherland, K. S., Farrell, A. D., Sullivan, T. N., & Doyle, S. T. (2015). Measuring teacher implementation in delivery of a bullying prevention program: The impact of instructional and protocol adherence and competence on student responsiveness. Prevention Science, 16, 440–450. https://doi.org/10.1007/s11121-014-0508-9.
Gordon, D. A. (2000). Parent training via CD-ROM: Using technology to disseminate effective prevention practices. Journal of Primary Prevention, 21, 227–251. https://doi.org/10.1023/A:1007035320118.
Haggerty, K. P., Skinner, M. L., MacKenzie, E. P., & Catalano, R. F. (2007). A randomized trial of parents who care: Effects on key outcomes at 24-month follow-up. Prevention Science, 8, 249–260. https://doi.org/10.1007/s11121-007-0077-2.
Han, S. S., & Weiss, B. (2005). Sustainability of teacher implementation of school-based mental health programs. Journal of Abnormal Child Psychology, 33, 665–679. https://doi.org/10.1007/s10802-005-7646-2.
Henry, D. B., Farrell, A. D., Schoeny, M. E., Tolan, P. H., & Dymnicki, A. (2011). Influence of school-level variables on aggression and associated attitudes during middle school. Journal of School Psychology, 49, 481–503. https://doi.org/10.1016/j.jsp.2011.04.007.
Lai, T., & Kao, G. (2018). Hit, robbed, and put down (but not bullied): Underreporting of bullying by minority and male students. Journal of Youth and Adolescence, 47, 618–635. https://doi.org/10.1007/s10964-017-0748-7.
Limber, S. P. (2011). Development, evaluation, and future directions of the Olweus Bullying Prevention Program. Journal of School Violence, 10, 71–87. https://doi.org/10.1080/15388220.2010.519375.
Matjasko, J. L., Vivolo-Kantor, A. M., Massetti, G. M., Holland, K. M., Holt, M. K., & Cruz, J. D. (2012). A systematic meta-review of evaluations of youth violence prevention programs: Common and divergent findings from 25 years of meta-analyses and systematic reviews. Aggression and Violent Behavior, 17, 540–552. https://doi.org/10.1016/j.dr.2011.10.001.
Matjasko, J. L., Massetti, G. M., & Bacon, S. (2016). Implementing and evaluating comprehensive evidence-based approaches to prevent youth violence: Partnering to create communities where youth are safe from violence. Journal of Primary Prevention, 37, 109–119. https://doi.org/10.1007/s10935-016-0422-y.
Melton, G. B., Limber, S. P., Cunningham, P., Osgood, D. W., Chambers, J., Flerx, V., et al. (1998). Violence among rural youth. Final report to the Office of Juvenile Justice and Delinquency Prevention. Washington, DC: Office of Juvenile Justice and Delinquency Prevention.
Olweus, D. (2005). A useful evaluation design, and effects of the Olweus Bullying Prevention Program. Psychology, Crime, & Law, 11, 389–402. https://doi.org/10.1080/10683160500255471.
Olweus, D., & Alsaker, F. D. (1991). Assessing change in a cohort longitudinal study with hierarchical data. In D. Magnusson, L. R. Bergman, G. Rudinger, & B. Torestad (Eds.), Problems and methods in longitudinal research (pp. 107–132). New York: Cambridge University Press. https://doi.org/10.1017/CBO9780511663260.008.
Olweus, D., & Limber, S. P. (2010). Bullying in school: Evaluation and dissemination of the Olweus Bullying Prevention Program. American Journal of Orthopsychiatry, 80, 124–134. https://doi.org/10.1111/j.1939-0025.2010.01015.x.
O'Moore, A. M., & Minton, S. J. (2005). Evaluation of the effectiveness of an anti-bullying programme in primary schools. Aggressive Behavior, 31, 609–622. https://doi.org/10.1002/ab.20098.
Pepler, D. J., Craig, W. M., Ziegler, S., & Charach, A. (1994). An evaluation of an anti-bullying intervention in Toronto schools. Canadian Journal of Community, 13, 95–110. https://doi.org/10.7870/cjcmh-1994-0014.
Schroeder, B. A., Messina, A., Schroeder, D., Good, K., Barto, S., Saylor, J., & Masiello, M. (2012). The implementation of a statewide bullying prevention program: Preliminary findings from the field and the importance of coalitions. Health Promotion Practice, 13, 489–495. https://doi.org/10.1177/1524839910386887.
Sullivan, T. N., Sutherland, K. S., Farrell, A. D., & Taylor, K. A. (2016). School as venues for prevention programming. In K. Bosworth (Ed.), Prevention science in school settings: Complex relationships and processes (pp. 201–226). Springer: New York.
Zimmerman, M. A., Stewart, S. E., Morrel-Samuels, S., Franzen, S., & Reischl, T. M. (2011). Youth empowerment solutions for peaceful communities: Combining theory and practice in a community-level violence prevention curriculum. Health Promotion Practice, 12, 425–439. https://doi.org/10.1177/1524839909357316.
Acknowledgements
The authors are grateful to John Ferron for his input on this project’s design and analysis, and to Anne Greene who served as project coordinator.
Funding
This study was funded by the National Center for Injury Prevention and Control, Centers for Disease Control and Prevention, CDC Cooperative Agreement 5U01CE001956. The findings and conclusions in this report are those of the authors and do not necessarily represent the official position of the Centers for Disease Control and Prevention.
Author information
Authors and Affiliations
Corresponding author
Ethics declarations
Ethical Approval
All procedures performed in studies involving human participants were in accordance with the ethical standards of the institutional research committee and with the 1964 Helsinki Declaration and its later amendments or comparable ethical standards.
Informed Consent
Informed consent was obtained from all individual participants in the study.
Conflict of Interest
The authors declare that they have no conflict of interest.
Rights and permissions
About this article
Cite this article
Farrell, A.D., Sullivan, T.N., Sutherland, K.S. et al. Evaluation of the Olweus Bully Prevention Program in an Urban School System in the USA. Prev Sci 19, 833–847 (2018). https://doi.org/10.1007/s11121-018-0923-4
Published:
Issue Date:
DOI: https://doi.org/10.1007/s11121-018-0923-4