Randomization tests for single-case experiments: State of the art, state of the science, and state of the application
Section snippets
Single-case experiments
A single-case experiment (SCE) is an experiment that can be used to evaluate the effect of an independent variable for a single entity, for example a single patient, a single therapist–patient dyad, or a single family. An experimental approach is used: the independent variable is manipulated by the experimenter. The dependent variable is measured repeatedly for this entity under different levels of the independent variable. For example, in research on interventions for reducing challenging
Randomization tests for single-case experiments
There are two important schedules to include randomization into the design of SCEs: phase designs and alternation designs. In the former, the moment of phase change is randomly determined. In the latter, the treatment alternation is randomly determined. We now consecutively present these two schedules (2.1 Randomization tests for single-case phase designs, 2.3 Randomization tests for single-case alternation designs), and describe a detailed example for each schedule (2 Randomization tests for
Additions and alternatives
Some important aims of contextual behavioral science (CBS) are understanding the behavior and the promotion of human growth and development. SCE designs can be used by CBS researchers to measure processes of change and behavioral outcomes (cf. Hayes et al., 2012, Vilardaga et al., 2009). As such, CBS researchers can use SCE designs for testing CBS theories and for studying the complexity of human behavior at the level of the individual.
In 3.1 Simultaneous replication designs, 3.2 Meta-analysis
References (111)
- et al.
Calculating effect sizes for meta-analysis: The case of the single case
Behaviour Research and Therapy
(1993) - et al.
Meta-analysis for single-case consultation outcomes: Applications to research and practice
Journal of School Psychology
(1995) Randomized single-subject experimental designs
Behaviour Research and Therapy
(1996)- et al.
Contextual behavioral science: Creating a science more adequate to the challenge of the human condition
Journal of Contextual Behavioral Science
(2012) - et al.
A multilevel meta-analysis of single-case and small-n research on interventions for reducing challenging behavior in persons with intellectual disabilities
Research in Developmental Disabilities
(2012) - et al.
Psychotherapy outcome research: Methods for reporting variability and evaluating clinical significance
Behaviour Therapy
(1984) - et al.
Nonparametric statistical tests for single-case systematic and randomized ABAB…AB and alternating treatment intervention designs: New developments, new directions
Journal of School Psychology
(2012) - et al.
Extensions of a versatile randomization test for assessing single-case intervention effects
Journal of School Psychology
(2011) - et al.
A generalized least squares regression approach for computing effect sizes in single-case research: Application examples
Journal of School Psychology
(2011) - et al.
Choosing among techniques for quantifying single-case intervention effectiveness
Behavior Therapy
(2011)
Randomization tests for restricted alternating treatments designs
Behaviour Research and Therapy
Useful effect size interpretations for single case research
Behavior Therapy
Improving interpretation of clinical studies by use of confidence levels, clinical significance curves, and risk-benefit contours
Lancet
The revised CONSORT statement for reporting randomized trials: Explanation and elaboration
Annals of Internal Medicine
Publication manual of the American Psychological Association
Alternating treatments design: One strategy for comparing the effects of two treatments in a single subject
Journal of Applied Behavior Analysis
The scientist practitioner: research and accountability in clinical and educational settings
Single case experimental designs: Strategies for studying behavior change
A review of meta-analyses of single-subject experimental designs: Methodological issues and practice
Evidence-Based Communication Assessment and Intervention
A legacy neglected: Restating the case for single-case research in cognitive-behaviour therapy
Behaviour Change
An empirical examination of visual analysis procedures for clinical practice evaluation
Journal of Social Service Research
Time series analysis: forecasting and control
An R package for single-case randomization tests
Behavior Research Methods
Randomization tests for multiple baseline designs: An extension of the SCRT-R package
Behavior Research Methods
When the truth hits you between the eyes. A software tool for the visual analysis of single-case experimental data
Methodology
Statistical analysis in single-case research: Issues, procedures, and recommendations, with applications to multiple behaviors
Meta-analysis for single-case research
A methodology for the quantitative synthesis of intra-subject design research
Journal of Special Education
Experimental control and threats to internal validity of concurrent and nonconcurrent multiple baseline designs
Psychology in the Schools
Inconsistent visual analysis of intrasubject data
Journal of Applied Behavior Analysis
Single-case and small-n experimental designs: a practical guide to randomization tests
Hypothesis and evidence in psychoanalysis
Randomization tests
Statistical inference from N=1 experiments
Journal of Psychology
An additive method for combining probability values from independent experiments
Journal of Psychology
A normal curve method for combining probability values from independent experiments
Journal of Psychology
Randomization tests for one-subject operant experiments
Journal of Psychology
Overcoming obstacles to single-subject experimentation
Journal of Educational Statistics
Randomized single-subject experiments and statistical tests
Journal of Counseling Psychology
The functioning of single-case randomization tests with and without random assignment
Journal of Experimental Education
Tests for the visual analysis of response-guided multiple-baseline data
Journal of Experimental Education
The power of randomization tests for single-case phase designs
Journal of Experimental Education
Statistical power of randomization tests used with multiple-baseline designs
Journal of Experimental Education
Analyzing single-case data: The power of randomization tests
Journal of Experimental Education
Analysis of effect for single-case design research
Journal of Applied Sport Psychology
An analysis-of-variance model for the intrasubject replication design
Journal of Applied Behavior Analysis
Design and analysis of time-series experiments
Analysis of interrupted time series analysis
Cited by (71)
Changed dynamic symptom networks after a self-compassion training in patients with somatic symptom disorder: A multiple single-case pilot project
2022, Journal of Psychosomatic ResearchCitation Excerpt :Because of this design, we cannot rule out that effects found were confounded by history and maturation. A Randomized Controlled Trial (RCT) or a Single-Case Experimental Design (SCED; e.g., by randomization start of the intervention across participants or alternating treatment conditions with a placebo or waiting list condition [35,36]) are considered next steps needed to demonstrate treatment outcomes with more internal validity. An experimental design can be combined with ESM, yielding an overview of multiple single-case pre-to-post treatment changes in means and dynamic networks.
Single-Case Experimental Designs: Clinical Research and Practice
2022, Comprehensive Clinical Psychology, Second EditionEMDR therapy for PTSD symptoms in patients with mild intellectual disability or borderline intellectual functioning and comorbid psychotic disorder: A case series
2021, Research in Developmental DisabilitiesCitation Excerpt :Traditionally, the difference in the mean baseline and intervention scores forms the test statistic in the randomization test. However, since the test does not rely on any distributional assumptions, a variety of descriptive statistics can be used as a test statistic in the randomization test (Heyvaert & Onghena, 2014). In our study, we performed a randomization on the effect-size Cohen’s d.
Different randomized multiple-baseline models for different situations: A practical guide for single-case intervention researchers
2021, Journal of School PsychologyCharacteristics of Missing Data in Single-Case Experimental Designs: An Investigation of Published Data
2024, Behavior Modification