Introduction
Method
Eligibility Criteria
Generality | Effective | Technological | Analytic | Conceptually Systematic | Applied | Behavioral | |
---|---|---|---|---|---|---|---|
Aaronson et al. (2021) | No. No generalization or maintenance probes or procedures described. | Unclear. No prior data on mask wearing behaviors to compare to, to assess effectiveness. | No. Limited detail provided on procedures. | No. No functional relation demonstrated as no pre-measure/baseline/comparison group. Correlational study design. | No. Procedures and results not explained using behavior analytic principles. | Yes. Looking at feasibility of mask wearing in school aged children during COVID-19 pandemic. | No. Data collection procedures described in little detail, no clear behavioral definitions or detailed recording methods provided. |
Ertel (2020) | Yes. Post-intervention probes were conducted in the waiting room and physician office settings | Yes. All participants were able to tolerate the mask for at least one hour after treatment. | Yes. Procedures are described in enough detail for replication. | Yes. Concurrent MBL across participants with 3 tiers to allow for functional relations to be identified. | Yes. Procedures and results are described using behavioral principles; positive reinforcement, reinforcement schedules, exposure hierarchy etc. | Yes. Aim to increase face mask wearing during COVID-19 pandemic. | Yes. Data collection procedures described in such as a breakdown of hierarchy steps and compliance defined. |
Ertel et al. (2022) | Yes. Probes in multiple settings and maintenance probes completed 1-month post-treatment. | Yes. Face mask wearing increased across all participants. | Yes. Procedures are described in enough detail for replication. | Yes. Concurrent MBL across participants with 3 tiers to allow for functional relations to be identified. | Yes. Procedures and results are described using behavioral principles; positive reinforcement, reinforcement schedules, exposure hierarchy etc. | Yes. Aim to increase face mask wearing during COVID-19 pandemic. | Yes. Clearly defined behavior data recording procedures (no behavioral definitions included in the paper – prior functional analysis completed). |
Frank-Crawford et al. (2021) | Unclear. Component analysis completed with 3 participants post-treatment phase taking additional data points to assess maintenance of mask wearing when specific intervention components are removed. | Yes. Face mask wearing increased for all participants compared to baseline, only one did not meet the terminal duration. | Yes. Procedures are described in enough detail for replication. | Yes. Changing criterion design used, stable responding achieved before increasing criterion. | Yes. Procedures and results are described using behavioral principles such as reinforcement, DRO, intervals, response effort etc. | Yes. Aim to increase face mask wearing in vulnerable populations during COVID-19 pandemic. | Yes. Clear behavioral definitions and detail on data recording procedures provided. |
Halbur et al. (2021) | Yes. Generalization probes to face shield, generalization probes completed after treatment phase, multiple masks used/available throughout to promote generalization. | Yes. Face mask wearing/steps completed increased for all participants that completed the full study compared to baseline. | Yes. Procedures are described in enough detail for replication. | Yes. 5 dyads multiple probes baseline design, 1 dyad non- concurrent MBL design. | Yes. Procedures and results described in line with behavioral concepts such as reinforcement, discriminative stimuli, extinction, intervals etc. | Yes. Aim to increase face mask wearing during COVID-19 pandemic. | Yes. Behavioral definitions developed (though not included in paper), definitions provided for data collection and detail of data collection procedures available. |
Hough (2022) | Yes. Generalization probes completed in the community. | Yes. Accuracy of mask wearing and duration increased above baseline levels for all participants. | Yes. Enough procedures are described in enough detail for replication. | Yes. Non-concurrent multiple baseline across participants | Yes. Procedures and interpretation of results in line with behavioural concepts such as behavioural skills training, positive reinforcement etc. | Yes. Aim to increase accurate face mask wearing and duration during COVID-19 pandemic. | Yes. Steps in hierarchy clearly defined along with adequate descriptions of data collect procedures. |
Lillie et al. (2021) | Yes. Two generalization probes completed outside experimenter room, with two situations; walking and working. | Yes. Passive compliance for mask wearing increased for all participants. | Yes. Procedures are described in enough detail for replication. | Yes. Changing criterion design embedded in 4 tier non- concurrent MBL design. | Yes. Procedures and results are described using underpinning principles of behavior such as schedules of reinforcement, differential reinforcement etc. | Yes. Increasing passive mask wearing during COVID-19 pandemic. | Yes. Behavioral definitions developed (though not included in paper) along with clear descriptions/definitions of data collection procedures. |
Sivaraman et al. (2021) | Yes. Two generalization probes completed with a novel mask and community setting. | Yes. Face mask wearing increased across all participants compared to baseline. | Yes. Procedures are described in enough detail for replication | Yes. Non-concurrent MBL design used with 3 tiers to allow functional relations to be identified. | Yes. Procedures and results described and hypothesized using behavioral principles such as reinforcement, graded exposure, prompt levels etc. | Yes. Aim to increase face mask wearing during global COVID-19 pandemic. Caregivers reported to have found the intervention useful and practical. | Yes. Behavioral definitions provided, clear descriptions of data collection procedures included. |
Search Strategy
Screening
Risk of Bias Assessment
Evaluative Method
Author (Year), Country, Quality Rating | Participant demographics (Number, sex, age, ethnicity, diagnosis, attrition) | Setting | Experimental design | Intervention; Implementer | Dependent variable (s) | Procedural fidelity | Generalization, Maintenance, Social Validity | Outcomes |
---|---|---|---|---|---|---|---|---|
Ertel (2020), USA, Borderline strong | N = 3 (All male) Age range: 4–8 Ethnicity: Not specified Diagnosis: All autistic Attrition: 0 | Sessions took place across EIBI clinic, in participant’s homes, and in a mock physician’s office. Pre and post intervention probes were conducted in a hospital waiting room, and physician office | Concurrent multiple baseline across participants. | MSWO preference assessment, graduated exposure hierarchy, positive reinforcement, Experimenter for intervention phase, once mastered parents were then coached to implement procedures at home and in the community. | Compliance to steps in the exposure hierarchy. Steps completed reflected duration. Data was also collected on vocal protests, negative vocalisation, and mands for mask removal. | Treatment integrity data were collected on 65% of Patrick’s sessions, 76% of Chris’s sessions, and 76% of Cameron’s sessions. Mean treatment integrity was 100% for Patrick, 99.7% for Chris, and 99.3% for Cameron | G: Post-intervention probes were conducted in the waiting room and physician office settings. M: None SV: Caregivers answered two questions and collated open ended comments | All participants were able to tolerate the mask for at least one hour after treatment. Participants were able to tolerate the mask in the untrained settings. |
Ertel et al. (2022), USA, Adequate | N = 3 (1 Female, 2 Male) Age range: 4–9 years old Ethnicity: Asian and Hispanic, Caucasian and Asian Diagnosis: All autistic Attrition: 0 | Intervention sessions took place across an EIBI clinic, in participant’s homes, and in a mock physician’s office. Probes were conducted in another community setting. | Concurrent multiple baseline across participants. | MSWO preference assessment, graduated exposure hierarchy, positive reinforcement. Experimenter for intervention phase, once mastered parents were then coached to implement procedures at home and in the community. | Compliance to exposure hierarchy steps. Data was collected on compliance to the step and total duration of mask wearing during each trial. Data was also collected on negative vocalizations, and mands to remove the mask. | Treatment integrity data taken on a 60–85% of participant’s sessions. Mean treatment integrity for all participants was 100%. Treatment integrity data were collected across all settings. | G: Training conducted at home and mock physician’s office. Novel community setting probes completed. M: Probes conducted in the EIBI clinic 1-month post-treatment SV: Caregivers completed a nine question Likert scale ranging from 0 (not at all) to 5 (very much). | Following intervention all participants wore their mask for 1 h in each setting and for multiple hours during maintenance probes. |
Frank-Crawford et al. (2021), USA, Weak | N (total) = 6 (1 Female, 5 Male), N (included) = 4 (1 Female, 3 Male), Age range: Overall 6–20, for included participants 6–14 Ethnicity: Not specified Diagnosis: All autistic & IDD Attrition: 0 | All on inpatient unit. For three included participants sessions were conducted in a 3.2 m × 3.2 m activity room and for one included participants sessions took place across various locations of the inpatient unit. | Changing-criterion design. | Blocking, reinforcement, DRO, non-contingent access to preferred activities or competing stimuli. Inpatient behavioral team. | Duration (seconds) of mask compliance. Frequency of successful attempts to remove the mask, blocked attempts to remove the mask, and frequency of targeted problem behaviors. | Not collected | G: None M: Component analysis to assess which components were necessary to maintain the terminal mask compliance goal (only completed for two included participants) SV: None. | Increases in compliance with mask wearing were achieved with all participants; however, the terminal duration was not met for one participant. |
Halbur et al. (2021), USA, Weak | N = 12 (All male). Age range: 4–10 years old Ethnicity: 10 Caucasian, 1 Hispanic, 1 South Asian Diagnosis: All autistic, 1 with ADHD and 1 with moderate ID. Attrition: 3 | 9 participants in their usual behavioral clinic only, 2 telehealth only, 1 split between telehealth and clinic. Telehealth sessions took place from an unspecified location. | Five dyads arranged according to multiple-probe design across participants, one dyad arranged as non-concurrent multiple baseline across participants. | Graduated exposure, prompts, differential reinforcement, and escape extinction; Therapist for 10, 1 parent, 1 partially parent and therapist, and one self-implemented through coaching. | Number of hierarchy steps tolerated, frequency of blocking and problem behavior. Duration of all sessions. | Taken on implementation of the procedures according to protocol. Taken on a minimum 33% of sessions for each participant. Average treatment integrity for each participant ranged from 95–99%. | G: Two to five face masks were included in treatment sessions, evaluated under different teaching conditions M: None SV: Survey completed with health providers prior to the study, asking about benefits and limitations to children wearing face coverings. | Results showed increases in compliance to wearing face masks for nine out of twelve participants. Improvements were also seen for two of three participants that were discontinued. |
Hough (2022), USA, Weak | N (total) = 4 (3 Female, 1 Male) N (included) = 1 Female Age range: Overall 18–23, included was 19 Ethnicity: 2 Caucasian 2 African American Diagnosis: 1 autistic, 1 with Downs Syndrome, all with mild intellectual/developmental disability Attrition: 0 | Baseline and training sessions took place online via Zoom and participants in private rooms in their house. Generalisation and maintenance online conducted via Zoom with the participant in the community. | Non-concurrent multiple baseline across participants | Behavioural skill training (included instructions, modelling, rehearsal, and delivery of corrective feedback), The primary investigator | Completion of steps to correct face mask wearing and the duration of face mask wearing | Taken on a minimum 33% of sessions for each participant. Average treatment integrity was 93% and ranged from 89–95%. | G: Probes completed in the community M: Probes completed twice a week for two weeks following generalisation probes SV: Likert scale survey given to participants | Mask wearing accuracy and duration improved for all participants above baseline levels, however this was inconsistent and did not meet CDC standards for mask wearing. |
Lillie et al. (2021), USA, Borderline adequate | N = 6 (1 Female, 5 Male). Age range: 4–14 years old. Ethnicity: 5 White, 1 Hispanic. Diagnosis: All autistic Attrition: 0 | In a private therapy 3 × 3 room within an ABA day-treatment centre. | Changing-criterion design embedded within a non- concurrent multiple baseline design across participants. | MSWO, free operant and concurrent chains preference assessments, DRO without escape extinction, positive and negative reinforcement, fading of DRO; Study experimenters. | Occurrences of problem behavior and removals of facemask. Percentage of trials with passive compliance and latency to errors were scored. | Collected for an average of 43.9% of session across participants and averaged 99.7% across all participants. | G: Generalization probes were completed in two other settings/situations (working/walking) simulating natural situations for face mask wearing M: Four- and eight-week probes completed for two participants that achieved mastery during baseline SV: None | Four participants met criteria within 40 sessions maximum. Compliance was generalized across novel setting. Two participants met criteria in baseline. |
Sivaraman et al. (2021), Across multiple countries (telehealth), Strong | N = 6 (1 Female, 5 Male). Age range: 6–8 years old. Ethnicity: 1 Mixed, 2 Indian, 3 Hispanic. Diagnosis: All participants were autistic. Attrition: 0 | Sessions were conducted via telehealth with the experimenter present in their home or office, and the participants present in their respective homes or therapy centers. | Non-concurrent multiple-baseline design across participants. | MSWO preference assessment, graded exposure hierarchy, in vivo modeling, prompting and positive reinforcement; Caregivers and/or therapists coached to deliver steps. | Number of hierarchy steps completed, duration of mask wearing, frequency of problem behavior (including attempts to block or remove masks) and percentage of oxygen-saturated hemoglobin in the blood. | Taken on caregivers’/therapists’ fidelity to coaching procedures. Averaged 100% for 5/6 caregivers, and 96.8% for 1/6 caregiver across at least 40% of sessions. | G: Probes completed for all participants using a different type of mask and in variety of indoor and outdoor settings M: None SV: Parent or therapist asked to complete an adapted form containing 6 items scored on a 5-point Likert scale based on training acceptability. | All participants wore a face mask for 10 min without exhibiting behaviors described as challenging. This generalized to a novel mask or community setting. Mask wearing did not affect the percentage of oxygen hemoglobin saturation. |
Risk of Bias Tool
Selection bias | Performance bias | Detection bias | Other bias | ||||||||||
---|---|---|---|---|---|---|---|---|---|---|---|---|---|
Sequence generation | Participant selection | Blinding of personnel /participants | Procedural fidelity | Blinding of outcome assessment | Selective outcome reporting | DV variable reliability | Data sampling bias | Source of other bias | |||||
Ertel (2020) | + | + | - | + | - | + | + | + | + | ||||
Ertel et al. (2022) | + | + | - | + | - | + | + | + | + | ||||
Frank-Crawford et al. (2021) | + | + | ? | - | ? | + | - | + | - | Data missing due to error and inconsistencies in the implementation of the independent variable. | |||
Selection bias | Performance bias | Detection bias | Other bias | ||||||||||
Sequence generation | Participant selection | Blinding of personnel /participants | Procedural fidelity | Blinding of outcome assessment | Selective outcome reporting | DV variable reliability | Data sampling bias | Source of other bias | |||||
Halbur et al. (2021) | + | ? | ? | + | ? | + | ? | + | - | Inconsistencies in implementation of the independent variable. | |||
Hough (2022) | + | + | - | + | - | + | + | + | + | ||||
Lillie et al. (2021) | + | + | ? | + | ? | + | + | + | + | ||||
Sivaraman et al. (2021) | + | + | - | + | - | + | + | + | + |
Data Extraction
Meta-Analysis
Non-Overlap of all Pairs & Baseline Corrected Tau
Author/Year | DV | Conditions compared | Participant | NAP | 95% CI | BCT, BSL Correction | SE | R2, Slope |
---|---|---|---|---|---|---|---|---|
Ertel (2020) | Steps of hierarchy completed | Baseline to intervention and generalization probes | Patrick | 0.93** | 0.52–1 | 0.60, No | 0.24 | - |
Chris | 0.85* | 0.43–1 | 0.03, No | 0.34 | - | |||
Cameron | 0.96** | 0.56–1 | 0.56, No | 0.23 | - | |||
Ertel et al. (2022) | Steps of hierarchy completed | Baseline to intervention and generalization/maintenance probes | Miles | 0.94** | 0.50–1 | 0.45, No | 0.23 | - |
Bennett | 0.96** | 0.50–1 | 0.54, No | 0.25 | - | |||
Vivian | 0.96** | 0.46–1 | 0.44, No | 0.24 | - | |||
Frank-Crawford et al. (2021) | Duration of mask wearing | Baseline to intervention (TX only or TX combined with TX/DRO) | Garrett | 0.70 | 0.36–1 | 0.24, No | 0.24 | 0.63, 74.72 |
Tobias | 0.57 | 0.29–1 | 0.10, No | 0.22 | 0.34, 41.91 | |||
Wesley | 0.80** | 0.46–1 | 0.36, Yes | 0.14 | 0.14, 1.47 | |||
Eleanor | 0.93** | 0.54–1 | 0.39, No | 0.20 | 0.70, 4.03 | |||
Miles | 0.95** | 0.46–1 | 0.35, No | 0.19 | 0.59, 31.50 | |||
Halbur et al. (2021) | Steps of hierarchy tolerated | Baseline to treatment and treatment extension | Carl | 0.91* | 0.42–1 | 0.37, No | 0.24 | - |
Elias | 0.95*** | 0.67–1 | 0.56, No | 0.17 | - | |||
Harrison | 1.00** | 0.50–1 | 0.49, No | 0.25 | - | |||
Pete | 1.00*** | 0.63–1 | 0.58, No | 0.19 | - | |||
Wendell | 0.69 | 0.30–1 | 0.19, No | 0.21 | - | |||
Kevin | 0.92*** | 0.59–1 | 0.51, No | 0.19 | - | |||
Allen | 0.82* | 0.39–1 | 0.53, No | 0.30 | - | |||
Nolan | 0.95*** | 0.58–1 | 0.59, No | 0.22 | - | |||
Javier | 0.85* | 0.35–1 | 0.59, No | 0.22 | - | |||
Ryan | 0.90*** | 0.58–1 | 0.38, No | 0.16 | - | |||
Malik | 1.00* | 0.35–1 | 0.84, No | 0.29 | - | |||
Hough (2022) | Duration of mask wearing | Baseline to intervention and maintenance/generalization | Summer | 0.97** | 0.47–1 | 0.50, No | 0.26 | - |
Lillie et al. (2021) | Percentage passive compliance | Baseline to intervention and generalization | Otis | 1.00* | 0.39–1 | 0.53, No | 0.30 | - |
Lucy | 0.98** | 0.49–1 | 0.47, No | 0.23 | - | |||
Roman | 0.89** | 0.53–1 | 0.59, No | 0.22 | - | |||
Rhett | 0.92*** | 0.57–1 | 0.61, No | 0.20 | - | |||
Sivaraman et al. (2021) | Percentage of hierarchy steps completed | Baseline to intervention and generalization | Thomas | 0.98** | 0.55–1 | 0.48, No | 0.22 | - |
Abhi | 0.99*** | 0.65–1 | 0.56, No | 0.91 | - | |||
Jaun | 0.99*** | 0.70–1 | 0.62, Yes | 0.17 | - | |||
Maria | 0.97** | 0.55–1 | 0.37, No | 0.18 | - | |||
Selva | 1.00*** | 0.65–1 | 0.63, No | 0.20 | - | |||
Mateo | 0.99*** | 0.69–1 | 0.61, No | 0.17 | - |