Abstract
In order to ensure the effects of early intensive behavioral interventions for children with autism, performance feedback is often used to improve procedural integrity. However, in areas where access to professionals is limited, onsite feedback may not be feasible. Researchers suggest that providing remote feedback may improve procedural integrity, but they often examined feedback along with other components. Thus, the purpose of this study is to investigate the effects of remote feedback alone on improving procedural integrity of discrete trial teaching (DTT) and incidental teaching (IT) of three interventionists in China. The interventionists received delayed remote feedback on either DTT or IT via video communication. Using an alternating treatment design, we directly compared the procedural integrity under the two conditions: with and without delayed remote feedback. Results showed that all interventionists improved procedural integrity only after feedback was introduced, suggesting that delayed remote feedback alone was effective in improving procedural integrity. The discussion addresses the practical and research implications of the findings.
This is a preview of subscription content, log in via an institution to check access.
Similar content being viewed by others
References
Alavosius, M. P., & Sulzer-Azaroff, B. (1990). Acquisition and maintenance of health-care routines as a function of feedback density. Journal of Applied Behavior Analysis,23, 151–162. https://doi.org/10.1901/jaba.1990.23-151.
Arco, L. (1997). Improving program outcome with process-based performance feedback. Journal of Organizational Behavior Management,17, 37–64.
Artman-Meeker, K., Rosenberg, N., Badgett, N., Yang, X., & Penney, A. (2017). The effects of bug-in-ear coaching on pre-service behavior analysts’ use of functional communication training. Behavior Analysis in Practice,10, 228–241. https://doi.org/10.1007/s40617-016-0166-4.
Behavior Analyst Certification Board. (2014). Applied behavior analysis treatment of autism spectrum disorder: Practice guidelines for healthcare funders and managers. https://www.bacb.com/wp-content/uploads/2017/09/ABA_Guidelines_for_ASD.pdf
Behavior Analyst Certification Board. (2019). Global certification. https://www.bacb.com/global-certification/
Belfiore, P. J., Fritts, K. M., & Herman, B. C. (2008). The role of procedural integrity: Using self-monitoring to enhance discrete trial instruction (DTI). Focus on Autism and Other Developmental Disabilities,23, 95–102. https://doi.org/10.1177/1088357607311445.
Bolton, J., & Mayer, M. D. (2008). Promoting the generalization of paraprofessional discrete trial teaching skills. Focus on Autism and Other Developmental Disabilities,23, 103–111. https://doi.org/10.1177/1088357608316269.
Carroll, R. A., Kodak, T., & Adolf, K. J. (2016). Effect of delayed reinforcement on skill acquisition during discrete-trial instruction: Implications for treatment-integrity errors in academic settings. Journal of Applied Behavior Analysis,49, 176–181. https://doi.org/10.1002/jaba.268.
Carroll, R. A., Kodak, T., & Fisher, W. W. (2013). An evaluation of programmed treatment-integrity errors during discrete-trial instruction. Journal of Applied Behavior Analysis,46, 379–394.
Centers for Disease Control and Prevention. (2018). Autism spectrum disorder (ASD): Data & statistics. https://www.cdc.gov/ncbddd/autism/data.html
Coogle, C. G., Rahn, N. L., & Ottley, J. R. (2015). Pre-service teacher use of communication strategies upon receiving immediate feedback. Early Childhood Research Quarterly,32, 105–115. https://doi.org/10.1016/j.ecresq.2015.03.003.
Cooper, J. O., Heron, T. E., & Heward, W. L. (2007). Applied behavior analysis (2nd ed.). New York: MacMillan.
Dane, A. V., & Schneider, B. H. (1998). Program integrity in primary and early secondary prevention: Are implementation effects out of control? Clinical Psychology Review,18, 23–45. https://doi.org/10.1016/S0272-7358(97)00043-3.
Fenske, E. C., Krantz, P. J., & McClannahan, L. E. (2001). Incidental teaching: A not-discrete-trial teaching procedure. In C. Maurice, G. Green, & R. M. Foxx (Eds.), Making a difference: Behavioral intervention for autism (pp. 75–82). PRO-ED, Inc.
Foster, S. L., & Mash, E. J. (1999). Assessing social validity in clinical treatment research: Issues and procedures. Journal of Consulting & Clinical Psychology,67, 308–319. https://doi.org/10.1037/0022-006X.67.3.308.
Gast, D. L., & Ledford, J. R. (2014). Single subject methodology: Application in special education and behavioral sciences (2nd ed.). New York: Routledge.
Gresham, F. M. (2014). Measuring and analyzing treatment integrity data in research. In L. M. Hagermoser Sanetti & T. R. Kratochwill (Eds.), Treatment integrity: A foundation for evidence-based practice in applied psychology (pp. 109–130). American Psychological Association.
Hagermoser Sanetti, L. M., Luiselli, J. K., & Handler, M. W. (2007). Effects of verbal and graphic performance feedback on behavior support plan implementation in a public elementary school. Behavior Modification,31, 454–465. https://doi.org/10.1177/0145445506297583.
Hall, L. J., Grundon, G. S., Pope, C., & Romero, A. B. (2010). Training paraprofessionals to use behavioral strategies when educating learners with autism spectrum disorders across environments. Behavioral Interventions,25, 37–51. https://doi.org/10.1002/bin.294.
Horner, R. H., Carr, E. G., Halle, J., McGee, G., Odom, S., & Wolery, M. (2005). The use of single-subject research to identify evidence-based practice in special education. Exceptional Children,71, 165–179. https://doi.org/10.1177/001440290507100203.
Huskens, B., Reijers, H., & Didden, R. (2012). Staff training effective in increasing learning opportunities for school-aged children with autism spectrum disorders. Developmental Neurorehabilitation,15, 435–447. https://doi.org/10.3109/17518423.2012.705910.
Kazdin, A. E. (2011). Single-Case Research Designs: Methods for Clinical and Applied Settings. Oxford: Oxford University Press.
McDonald, R., Parry-Cruwys, D., Dupere, S., & Ahearn, W. (2014). Assessing progress and outcome of early intensive behavioral intervention for toddlers with autism. Research in Developmental Disabilities,35, 3632–3644. https://doi.org/10.1016/j.ridd.2014.08.036.
Neely, L., Rispoli, M., Gerow, S., & Hong, E. R. (2016). Preparing interventionists via telepractice in incidental teaching for children with autism. Journal of Behavioral Education,25, 393–416. https://doi.org/10.1007/s10864-016-9250-7.
Neely, L., Rispoli, M., Gerow, S., Hong, E. R., & Hagan-Burke, S. (2017). Fidelity outcomes for autism-focused interventionists coached via telepractice: A systematic literature review. Journal of Developmental and Physical Disabilities,29, 849–874. https://doi.org/10.1007/s10882-017-9550-4.
Noell, G. H., & Gansle, K. A. (2014). The use of performance feedback to improve intervention implementation in schools. In L. M. Hagermoser Sanetti & T. R. Kratochwill (Eds.), Treatment integrity: A foundation for evidence-based practice in applied psychology (pp. 161–183). American Psychological Association.
Peters-Scheffer, N., Didden, R., Korzilius, H., & Sturmey, P. (2011). A meta-analytic study on the effectiveness of comprehensive ABA-based early intervention programs for children with Autism Spectrum Disorders. Research in Autism Spectrum Disorders,5, 60–69. https://doi.org/10.1016/j.rasd.2010.03.011.
Petscher, E. S., & Bailey, J. S. (2006). Effects of training, prompting, and self-monitoring on staff behavior in a classroom for students with disabilities. Journal of Applied Behavior Analysis,39, 215–226.
Reichow, B. (2012). Overview of meta-analyses on early intensive behavioral intervention for young children with Autism Spectrum Disorders. Journal of Autism & Developmental Disorders,42, 512–520. https://doi.org/10.1007/s10803-011-1218-9.
Smith, T. (2001). Discrete trial training in the treatment of autism. Focus on Autism and Other Developmental Disabilities,16, 86–92. https://doi.org/10.1177/108835760101600204.
Sun, X., & Allison, C. (2010). A review of the prevalence of autism spectrum disorder in Asia. Research in Autism Spectrum Disorders,4, 156–167. https://doi.org/10.1016/j.rasd.2009.10.003.
Tarbox, J., Dixon, D. R., & Sturmey, P. (2014). Handbook of early intervention for autism spectrum disorders: Research, policy, and practice. New York: Springer.
Wise, M. D., Little, A. A., Holliman, J. B., Wise, P. H., & Wang, C. J. (2010). Can state early intervention programs meet the increased demand of dhildren suspected of having Autism Spectrum Disorders? Journal of Developmental & Behavioral Pediatrics,31, 469–476. https://doi.org/10.1097/DBP.0b013e3181e56db2.
Xu, Y., Yang, J., Ji, L., Xu, D., & Wang, Y. (2014). Current situations and strategies of autistic children’s rehabilitation in China. Disability Research,2, 64–67.
Author information
Authors and Affiliations
Ethics declarations
Conflict of interest
The authors declare that they have no conflict of interest.
Ethical Approval
All procedures performed in this study involving human participants were in accordance with the ethical standards of the institutional and/or national research committee and with the 1964 Helsinki declaration and its later amendments or comparable ethical standards.
Informed Consent
Informed consent was obtained from all individual participants included in the study.
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
About this article
Cite this article
Zhu, J., Hua, Y. & Yuan, C. Effects of Remote Performance Feedback on Procedural Integrity of Early Intensive Behavioral Intervention Programs in China. J Behav Educ 29, 339–353 (2020). https://doi.org/10.1007/s10864-020-09380-8
Published:
Issue Date:
DOI: https://doi.org/10.1007/s10864-020-09380-8