Skip to main content

Advertisement

SpringerLink
Log in

Advancements in Procedural Fidelity Assessment and Intervention: Introduction to the Special Issue

  • Introduction
  • Published:
Journal of Behavioral Education Aims and scope Submit manuscript

Abstract

Interest in procedural fidelity has grown rapidly since 1981 as evidenced by the growing numbers of research publications across disciplines on this topic. As a result, the past 30 years of research has yielded a variety of procedures to guide research and practice, which we hope translates into better educational practices and services. Despite our progress, much remains unknown. As an introduction to the special issue on advancements in procedural fidelity, this article will briefly describe the conceptual and definitional issues surrounding this topic, summarize the relevance of procedural fidelity to education and research, and highlight the articles in this issue that address proposed research priorities.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1

References

  • American Psychological Association. (2002). Criteria for evaluating treatment guidelines. American Psychologist, 57(12), 1052–1059.

    Article  Google Scholar 

  • Barnett, D., Hawkins, R., & Lentz, F. F. (2011). Intervention adherence for research and practice: Necessity or triage outcome? Journal of Educational and Psychological Consultation, 21(3), 175–190. doi:10.1080/10474412.2011.595162.

    Article  Google Scholar 

  • Baron, R. M., & Kenny, D. A. (1986). The moderator–mediator variable distinction in social psychological research: Conceptual, strategic, and statistical considerations. Journal of Personality and Social Psychology, 51, 1173–1182.

    Article  PubMed  Google Scholar 

  • Barretto, J., Wacker, D. P., Harding, J., Lee, J., & Berg, W. K. (2006). Using telemedicine to conduct behavioral assessments. Journal of Applied Behavior Analysis, 39, 333–340. doi:10.1901/jaba.2006.173-04.

    Article  PubMed  Google Scholar 

  • Boisvert, M., Lang, R., Andrianopoulos, M., & Boscardin, M. L. (2010). Telepractice in the assessment and treatment of individuals with autism spectrum disorders: A systematic review. Developmental Neurorehabilitiation, 13, 423–432. doi:10.3109/17518423.2010.499889.

    Article  Google Scholar 

  • Brennan, D. M., Holtz, B. E., Chumbler, N. R., Kobb, R., & Rabinowitz, T. (2008). Visioning technology for the future of telehealth. Telemedicine and e-Health, 14, 982–985. doi:10.1089/tmj. 2008.0116.

    Article  PubMed  Google Scholar 

  • Carroll, R. A., Kodak, T., & Fisher, W. W. (2013). An evaluation of programmed treatment-integrity errors during discrete-trial instruction. Journal of Applied Behavior Analysis, 46, 379–394. doi:10.1002/jaba.49.

    Article  PubMed  Google Scholar 

  • Catania, C. N., Almeida, D., Liu-Constant, B., & DiGennaro Reed, F. D. (2009). Video modeling to train staff to implement discrete-trial instruction. Journal of Applied Behavior Analysis, 42(2), 387–392. doi:10.1901/jaba.2009.42-387.

    Article  PubMed  Google Scholar 

  • Center for the Study and Prevention of Violence: Institute of Behavioral Science (n.d.). Blueprints programs: Program Criteria Checklist. http://www.blueprintsprograms.com/resources/Blueprints_Checklist.pdf.

  • Cochrane, W. S., & Laux, J. M. (2008). A survey investigating school psychologists’ measurement of treatment integrity in school-based interventions and their beliefs about its importance. Psychology in the Schools, 45(6), 499–507. doi:10.1002/pits.20319.

    Article  Google Scholar 

  • Codding, R. S., Feinberg, A. B., Dunn, E. K., & Pace, G. M. (2005). Effects of immediate performance feedback on implementation of behavior support plans. Journal of Applied Behavior Analysis, 38, 205–219.

    Article  PubMed  Google Scholar 

  • Dane, A. V., & Schneider, B. H. (1998). Program integrity in primary and early secondary prevention: Are implementation effects out of control? Clinical Psychology Review, 18, 23–45.

    Article  PubMed  Google Scholar 

  • Dib, N., & Sturmey, P. (2007). Reducing student stereotypy by improving teachers’ implementation of discrete-trial teaching. Journal of Applied Behavior Analysis, 40, 339–343. doi:10.1901/jaba.2007.52-06.

    Article  PubMed  Google Scholar 

  • DiGennaro, F. D., Martens, B. K., & Kleinmann, A. E. (2007). A comparison of performance feedback procedures on teachers’ treatment implementation integrity and students’ inappropriate behavior in special education classrooms. Journal of Applied Behavior Analysis, 40, 447–461. doi:10.1901/jaba.2007.40-447.

    Article  PubMed  Google Scholar 

  • DiGennaro, F. D., Martens, B. K., & McIntyre, L. L. (2005). Increasing treatment integrity through negative reinforcement: Effects on teacher and student behavior. School Psychology Review, 34, 220–231.

    Google Scholar 

  • DiGennaro Reed, F. D., Codding, R., Catania, C. N., & Maguire, H. (2010). Effects of video modeling on treatment integrity of behavioral interventions. Journal of Applied Behavior Analysis, 43(2), 291–295. doi:10.1901/jaba.2010.43-291.

    Article  PubMed  Google Scholar 

  • DiGennaro Reed, F. D., & Reed, D. D. (2014). Evaluating and improving intervention integrity. In J. K. Luiselli (Ed.), Children and youth with autism spectrum disorder (ASD): Recent advances and innovations in assessment, education, and intervention. New York: Oxford University Press.

  • DiGennaro Reed, F. D., Reed, D. D., Baez, C. N., & Maguire, H. (2011). A parametric analysis of errors of commission during discrete-trial training. Journal of Applied Behavior Analysis, 44, 611–615. doi:10.1901/jaba.2011.44-611.

    Article  PubMed  Google Scholar 

  • Fiske, K. E. (2008). Treatment integrity of school-based behavior analytic interventions: A review of the research. Behavior Analysis in Practice, 1, 19–25.

    PubMed Central  PubMed  Google Scholar 

  • Fixsen, D. L., Naoom, S. F., Blasé, K. A., Friedman, R. M., & Wallace, F. (2005). Implementation research: A synthesis of the literature. Tampa, FL: University of South Florida, Louis de la Parte Florida Mental Health Institute, The National implementation Research Network (FMHI Publication #231).

    Google Scholar 

  • Fryling, M. J., Wallace, M. D., & Yassine, J. N. (2012). Impact of treatment integrity on intervention effectiveness. Journal of Applied Behavior Analysis, 45. doi:10.1901/jaba.2012.45-449.

  • Gersten, R., Fuchs, L. S., Compton, D., Coyne, M., Greenwood, C., & Innocenti, M. S. (2005). Quality indicators for group experimental and quasi-experimental research in special education. Exceptional Children, 71, 149–164.

    Google Scholar 

  • Greenwood, C. R. (2009). Treatment integrity: Revisiting some big ideas. School Psychology Review, 38(4), 547–553.

    Google Scholar 

  • Gresham, F. M. (1989). Assessment of treatment integrity in school consultation and pre-referral intervention. School Psychology Review, 18, 37–50.

    Google Scholar 

  • Gresham, F. M. (2009). Evolution of the treatment integrity concept: Current status and future directions. School Psychology Review, 38, 533–540.

    Google Scholar 

  • Gresham, F. M., Gansle, K. A., Noell, G. H., Cohen, S., & Rosenblum, S. (1993). Treatment integrity of school-based behavioral intervention studies: 1980–1990. School Psychology Review, 22, 254–272.

    Google Scholar 

  • Groskreutz, N. C., Groskreutz, M. P., & Higbee, T. S. (2011). Effects of varied levels of treatment integrity on appropriate toy manipulation in children with autism. Research in Autism Spectrum Disorders, 5, 1358–1369. doi:10.1016/j.rasd.2011.01.018.

    Article  Google Scholar 

  • Grow, L. L., Carr, J. E., Gunby, K. V., Charania, S. M., Gonsalves, L., Ktaech, I. A., et al. (2009). Deviations from prescribed prompting procedures: Implications for treatment integrity. Journal of Behavioral Education, 18, 142–156. doi:10.1007/s10864-009-9085-6.

    Article  Google Scholar 

  • Haugen, H. A., Tran, Z. V., Wyatt, H. R., Barry, M. J., & Hill, J. O. (2007). Using telehealth to increase participation in weight management programs. Obesity, 15, 3067–3077. doi:10.1038/oby.2007.365.

    Article  PubMed  Google Scholar 

  • Hirschstein, M. K., Van Schoiack Edstrom, L., Frey, K. S., Snell, J. L., & MacKenzie, E. P. (2007). Walking the talk in bullying prevention: Teacher implementation variables related to initial impact of the Steps to Respect program. School Psychology Review, 36(1), 3–21.

    Google Scholar 

  • Hirst, J. M., DiGennaro Reed, F. D., & Reed, D. D. (2013). Effects of varying feedback accuracy on task acquisitions: A computerized translational study. Journal of Behavioral Education, 22, 1–15. doi:10.1007/s10864-012-9162-0.

    Article  Google Scholar 

  • Horner, R. H., Swaminathan, H., Sugai, G., & Smolkowski, K. (2012). Considerations for the systematic analysis and use of single-case research. Education and Treatment of Children, 35(2), 269–290. doi:10.1353/etc. 2012.0011.

    Article  Google Scholar 

  • Institute of Education Sciences. (2013, May 2). Request for Applications: Education Research Grants CFDA Number: 84.305A. Retrieved from: http://ies.ed.gov/funding/pdf/2014_84305A.pdf.

  • Iwata, B. A., Bailey, J. S., Brown, K. M., Foshee, T. J., & Alpern, M. A. (1976). A performance based lottery to improve residential care and training by institutional staff. Journal of Applied Behavior Analysis, 9, 417–431.

    Article  PubMed  Google Scholar 

  • Jeffrey, J. L., McCurdy, B. L., Ewing, S., & Polis, D. (2009). Classwide PBIS for students with EBD: Initial evaluation of an integrity tool. Education and Treatment of Children, 32(4), 537–550. doi:10.1353/etc.0.0069.

    Article  Google Scholar 

  • Johnston, J., & Pennypacker, H. (1980). Strategies and tactics of human behavioral research. Mahwah, NJ: Lawrence Erlbaum.

    Google Scholar 

  • Jones, H. A., Clarke, A. T., & Power, T. J. (2008). Expanding the concept of intervention integrity: A multidimensional model of participant engagement. In Balance, 23, 4–5.

    Google Scholar 

  • Joyce, B., & Showers, B. (2002). Student achievement through staff development (3rd ed.). Alexandria, VA: Association for Supervision and Curriculum Development.

    Google Scholar 

  • Kratochwill, T. K., Stoiber, K. C., Christenson, S., Durlak, J., Levin, J. R., Talley, R. et al. (2002). Procedural and coding manual for review of evidence-based interventions. Task force on the Evidence Based Interventions in School Psychology, Sponsored by Division 16 of the American Psychological Association and Society for the Study of Psychology. Retrieved from: http://www.indiana.edu/~ebi/projects.html.

  • Kratochwill, T. R., Volpiansky, P., Clements, M., & Ball, C. (2007). Professional development in implementing and sustaining multitier prevention models: Implications for response to intervention. School Psychology Review, 36(4), 618–631.

    Google Scholar 

  • Kuhn, S. A. C., Lerman, D. C., & Vorndran, C. M. (2003). Pyramidal training families of children with problem behaviors. Journal of Applied Behavior Analysis, 36, 77–88. doi:10.1901/jaba.2003.36-77.

    Article  PubMed  Google Scholar 

  • Mace, F. C., & Critchfield, T. S. (2010). Translational research in behavior analysis: Historical traditions and imperative for the future. Journal of the Experimental Analysis of Behavior, 93, 293–312. doi:10.1901/jeab.2010.93-293.

    Article  PubMed  Google Scholar 

  • McGeary, D. D., McGeary, C. A., & Gatchel, R. (2012). A comprehensive review of telehealth for pain management. Pain Practice, 12, 570–577. doi:10.1111/j.1533-2500.2012.00534.x.

    Article  PubMed  Google Scholar 

  • McIntyre, L., Gresham, F. M., DiGennaro, F. D., & Reed, D. D. (2007). Treatment integrity of school-based interventions with children in the Journal of Applied Behavior Analysis 1991–2005. Journal of Applied Behavior Analysis, 40(4), 659–672.

    PubMed  Google Scholar 

  • Moore, J. W., & Fisher, W. W. (2007). The effects of videotape modeling on staff acquisition of functional analysis methodology. Journal of Applied Behavior Analysis, 40(1), 197–202. doi:10.1901/jaba.2007.24-06.

    Article  PubMed  Google Scholar 

  • Noell, G. H. (2008). Research examining the relationships among consultation process, treatment integrity, and outcomes. In W. P. Erchul & S. M. Sheridan (Eds.), Handbook of research in school consultation: Empirical foundations for the field (pp. 323–341). New York, NY: Lawrence Erlbaum Associates.

    Google Scholar 

  • Noell, G., Duhon, G., Gatti, S., & Connell, J. (2002). Consultation, follow-up, and implementation of behavior management interventions in general education. School Psychology Review, 31, 217–234.

    Google Scholar 

  • Noell, G. H., Witt, J. C., LaFleur, L. H., Mortenson, B. P., Ranier, D. D., & LeVelle, J. (2000). Increasing intervention implementation in general education following consultation: A comparison of two follow-up studies. Journal of Applied Behavior Analysis, 33, 271–284. doi:10.1901/jaba.2000.33-271.

    Article  PubMed  Google Scholar 

  • Noell, G. H., Witt, J. C., Slider, N. J., Connell, J. E., Gatti, S. L., Williams, K. L., et al. (2005). Treatment implementation following behavioral consultation in schools: A comparison of three follow-up strategies. School Psychology Review, 34(1), 87–106.

    Google Scholar 

  • Northup, J., Fisher, W., Kahng, S., Harrell, R., & Kurtz, P. (1997). An assessment of the necessary strength of behavioral treatments for severe behavior problems. Journal of Developmental and Physical Disabilities, 9, 1–16. doi:10.1023/A:1024984526008.

    Article  Google Scholar 

  • Nosik, M. R., & Williams, W. (2011). Component evaluation of a computer based format for teaching discrete trial and backward chaining. Research in Developmental Disabilities, 32(5), 1694–1702. doi:10.1016/j.ridd.2011.02.022.

    Article  PubMed  Google Scholar 

  • Page, T. J., Iwata, B. A., & Reid, D. H. (1982). Pyramidal training: A large scale application with institutional staff. Journal of Applied Behavior Analysis, 15, 335–351.

    Article  PubMed  Google Scholar 

  • Perepletchikova, F. (2011). On the topic of treatment integrity. Clinical Psychology: Science and Practice, 18(2), 148–153. doi:10.1111/j.1468-2850.2011.01246.x.

    Google Scholar 

  • Perepletchikova, F., Hilt, L. M., Chereji, E., & Kazdin, A. E. (2009). Barriers to implementing treatment integrity procedures: Survey of treatment outcome researchers. Journal of Consulting and Clinical Psychology, 77(2), 212–218. doi:10.1037/a0015232.

    Article  PubMed  Google Scholar 

  • Perepletchikova, F., Treat, T. A., & Kazdin, A. E. (2007). Treatment integrity in psychotherapy research: Analysis of the studies and examination of the associated factors. Journal of Consulting and Clinical Psychology, 75(6), 829–841. doi:10.1037/0022-006X.75.6.829.

    Article  PubMed  Google Scholar 

  • Reed, D. D., Fienup, D. M., Luiselli, J. K., & Pace, G. M. (2010). Performance improvement in behavioral health care: Collateral effects of planned treatment integrity observations as an applied example of schedule-induced responding. Behavior Modification, 34(5), 367–385. doi:10.1177/0145445510383524.

    Article  PubMed  Google Scholar 

  • Rhymer, K. N., Evans-Hampton, T. N., McCurdy, M., & Watson, T. S. (2002). Effects of varying levels of treatment integrity on toddler aggressive behavior. Special Services in the Schools, 18, 75–82.

    Article  Google Scholar 

  • Sanetti, L. M. H., & DiGennaro Reed, F. D. (2012). Barriers to implementing treatment integrity procedures in school psychology research: Survey of treatment outcome researchers. Assessment for Effective Intervention, 37(4), 195–202. doi:10.1177/1534508411432466.

    Article  Google Scholar 

  • Sanetti, L. M., & Fallon, L. M. (2011). Treatment integrity assessment: How estimates of adherence, quality, and exposure influence interpretation of implementation. Journal of Educational and Psychological Consultation, 21(3), 209–232. doi:10.1080/10474412.2011.595163.

    Article  Google Scholar 

  • Sanetti, L., Gritter, K. L., & Dobey, L. M. (2011). Treatment integrity of interventions with children in the school psychology literature from 1995 to 2008. School Psychology Review, 40(1), 72–84.

    Google Scholar 

  • Sanetti, L. M. H., & Kratochwill, T. R. (2009). Toward developing a science of treatment integrity: Introduction to the special series. School Psychology Review, 38, 445–459.

    Google Scholar 

  • Sarokoff, R. A., & Sturmey, P. (2004). The effects of behavioral skills training of stall implementation of discrete-trial teaching. Journal of Applied Behavioral Analysis, 37, 525–538. doi:10.1901/jaba.2004.37-535.

    Article  Google Scholar 

  • Sidman, M. (1960). Tactics of scientific research: Evaluating experimental data in psychology. New York: Basic Books.

    Google Scholar 

  • Sloan, D. M., Gallager, M. W., Feinsten, B. A., Lee, D. J., & Pruneau, G. M. (2011). Efficacy of telehealth treatments for posttraumatic stress-related symptoms: A meta-analysis. Cognitive Behaviour Therapy, 40, 111–125. doi:10.1080/16506073.2010.550058.

    Article  Google Scholar 

  • Smith, C. E., Dauz, E. R., Clements, F., Puno, F. N., Cook, D., Doolittle, G., et al. (2006). Telehealth services to improve nonadherence: A placebo-controlled study. Telemedicine and e-Health, 12, 289–296.

    Article  PubMed  Google Scholar 

  • Solomon, B. G., Klein, S. A., & Politylo, B. C. (2012). The effect of performance feedback on teacher treatment integrity: A meta-analysis of the single-case literature. School Psychology Review, 41, 160–175.

    Google Scholar 

  • Southam‐Gerow, M. A., & McLeod, B. D. (2013). Advances in applying treatment integrity research for dissemination and implementation science: Introduction to special issue. Clinical Psychology: Science and Practice, 20(1), 1–13. doi:10.1111/cpsp.12019.

    Google Scholar 

  • Speedie, S. M., Ferguson, A. S., Sanders, J., & Doarn, C. R. (2008). Telehealth: The promise of new care delivery models. Telemedicine and e-Health, 14, 964–967. doi:10.1089/tmj. 2008.0114.

    Article  PubMed  Google Scholar 

  • St. Peter Pipkin, C., Vollmer, T. R., & Sloman, K. N. (2010). Effects of treatment integrity failures during differential reinforcement of alternative behavior: A translational model. Journal of Applied Behavior Analysis, 43, 47–70. doi:10.1901/jaba.2010.43-47.

    Article  PubMed  Google Scholar 

  • Sterling-Turner, H. E., Watson, T., & Moore, J. W. (2002). The effects of direct training and treatment integrity on treatment outcomes in school consultation. School Psychology Quarterly, 17(1), 47–77. doi:10.1521/scpq.17.1.47.19906.

    Article  Google Scholar 

  • Stokes, T. F., & Baer, D. M. (1977). An implicit technology of generalization. Journal of Applied Behavior Analysis, 10, 349–367. doi:10.1901/jaba.1977.10-349.

    Article  PubMed  Google Scholar 

  • Substance Abuse and Mental Health Services Administration. National Registry of Evidence-based Programs and Practices. Retrieved from http://www.nrepp.samhsa.gov/ReviewQOR.aspx#FID.

  • US Department of Health and Human Services, Health Resources and Services Administration. (n.d.). What is telehealth?. Retrieved from http://www.hrsa.gov/healthit/toolbox/RuralHealthITtoolbox/Telehealth/whatistelehealth.html.

  • Vartuli, S., & Rohs, J. (2009). Assurance of outcome evaluation: Curriculum fidelity. Journal of Research in Childhood Education, 23, 502–512.

    Article  Google Scholar 

  • Vollmer, T. R., Roane, H. S., Ringdahl, J. E., & Marcus, B. A. (1999). Evaluating treatment challenges with differential reinforcement of alternative behavior. Journal of Applied Behavior Analysis, 32, 9–23. doi:10.1901/jaba.1999.32-9.

    Article  Google Scholar 

  • Wacker, D. P., Lee, J. F., Dalmau, Y. C. P., Kopelman, T. G., Lindgren, S. D., Kuhle, J., et al. (2013). Conducting functional communication training via telehealth to reduce the problem behavior of young children with autism. Journal of Developmental and Physical Disabilities, 25, 35–48. doi:10.1007/s10882-012-9314-0.

    Article  PubMed Central  PubMed  Google Scholar 

  • What Works Clearinghouse. (2010). Procedures and standards handbook (version 2.1). Retrieved from http://ies.ed.gov/ncee/wwc/pdf/reference_resources/wwc_procedures_v2_1_standards_handbook.pdf.

  • Wheeler, J. J., Baggett, B. A., Fox, J., & Blevins, L. (2006). Treatment integrity: A review of intervention studies conducted with children with autism. Focus on Autism and Other Developmental Disabilities, 21(1), 45–54. doi:10.1177/10883576060210010601.

    Article  Google Scholar 

  • Wilder, D. A., Atwell, J., & Wine, B. (2006). The effects of varying levels of treatment integrity on child compliance during treatment with a three-step prompting procedure. Journal of Applied Behavior Analysis, 39, 369–373. doi:10.1901/jaba.2006.144-05.

    Article  PubMed  Google Scholar 

  • Worsdell, A. S., Iwata, G. A., Hanley, G. P., Thompson, R. H., & Kahng, S. (2000). Effects of continuous and intermittent reinforcement for problem behavior during functional communication training. Journal of Applied Behavior Analysis, 33, 167–179. doi:10.1901/jaba.2000.33-167.

    Article  PubMed  Google Scholar 

  • Yeaton, W. H., & Sechrest, L. (1981). Critical dimensions in the choice and maintenance of successful treatment: Strength, integrity, and effectiveness. Journal of Consulting and Clinical Psychology, 49, 156–167.

    Article  PubMed  Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Department of Applied Behavioral Science, 4001 Dole Human Development Center, University of Kansas, 1000 Sunnyside Avenue, Lawrence, KS, 66045-7555, USA

    Florence D. DiGennaro Reed

  2. Department of Counseling and School Psychology, University of Massachusetts Boston, Boston, MA, USA

    Robin S. Codding

Authors
  1. Florence D. DiGennaro Reed
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Robin S. Codding
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Florence D. DiGennaro Reed.

Rights and permissions

Reprints and permissions

About this article

Cite this article

DiGennaro Reed, F.D., Codding, R.S. Advancements in Procedural Fidelity Assessment and Intervention: Introduction to the Special Issue. J Behav Educ 23, 1–18 (2014). https://doi.org/10.1007/s10864-013-9191-3

Download citation

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s10864-013-9191-3

Keywords

Search

Navigation