Abstract
A comparison study is an experiment whose primary purpose is to compare directly (regardless of experimental design) at least two different procedures for changing behavior or two or more components of such a procedure. This paper argues that, in spite of their popularity, such studies typically lead to inappropriate inferences with poor generality based on improper evidence gathered in support of the wrong question, thus wasting the limited experimental resources. The discussion considers problems concerning the functions of comparison studies, the nature of the comparisons that are attempted, the generality of their findings, and the limited role that they can play in technological research.
This is a preview of subscription content, log in via an institution to check access.
Similar content being viewed by others
References
Barber, T. X. (1976). Pitfalls in human research. Elmsford, NY: Pergamon Press.
Barrera, R. D., & Sulzer-Azaroff, B. (1983). An alternating treatment comparison of oral and total communication training programs with echolalic autistic children. Journal of Applied Behavior Analysis, 16, 379–394.
Campbell, D. T., & Stanley, J. C. (1963). Experimental and quasi-experimental designs for research. Chicago: Rand-McNally.
Cronbach, L. J., & Meehl, P. E. (1955). Construct validity in psychological tests. Psychological Bulletin, 52, 281–302.
Cook, T. D., & Campbell, D. T. (Eds.) (1979). Quasi-experimentation: Design and analysis issues for field settings. Chicago: Rand-McNally.
Hopkins, B. L. (1987). Comments on the future of Applied Behavior Analysis. Journal of Applied Behavior Analysis, 20, 339–346.
Hursch, D. E. (1976). Personalized systems of instruction: What do the data indicate? Journal of Personalized Instruction, 1(2), 91–105.
Johnson, K. R., & Ruskin, R. S. (1977). Behavioral instruction: An evaluative review. Washington, D.C.: American Psychological Association.
Johnston, J. M. (1975). Alphabet soup, generality, and the good old days. In James M. Johnston (Ed.) Research and technology in college and university teaching (pp. 9–13). Champaign, IL: Research Press (distributor).
Johnston, J. M. (1985). Controlling professional behavior: A review of The effects of punishment on human behavior by Axelrod and Apsche. The Behavior Analyst, 8, 111–119.
Johnston, J. M., & Pennypacker, H. S. (1980). Strategies and tactics of human behavioral research. Hillsdale, NJ: Lawrence Erlbaum Associates.
Johnston, J. M., & Pennypacker, H. S. (1986). Pure-versus quasi-behavioral research. In A. Poling, R. W. Fuqua, & R. Ulrich (Eds.) Research methods in applied behavior analysis: Issues and advances (pp. 29–54). New York: Plenum.
Judd, C. M., & Kenny, D. A. (1981). Estimating the effects of social interventions. New York: Cambridge University Press.
Kazdin, A. E. (1982). Single-case research designs. New York: Oxford University Press.
Keller, F. S. (1968). “Goodbye teacher….” Journal of Applied Behavior Analysis, 1, 79–89.
Lloyd, K. E. (1978). Behavior analysis and technology in higher education. In T. A. Brigham & A. C. Catania (Eds.) Applied analysis of social and educational behavior (pp. 482–521). New York: Irvington Publishers.
Mosk, M. D., & Bucher, B. (1984). Prompting and stimulus shaping procedures for teaching visual-motor skills to retarded children. Journal of Applied Behavior Analysis, 17, 23–34.
Rast, J., & Johnston, J. M. (In press). Effects of pre-meal chewing on ruminative behavior. American Journal of Mental Retardation.
Rast, J., Johnston, J. M., Allen, J., & Drum, C. (1985). Effects of nutritional and mechanical properties of food on ruminative behavior. Journal of the Experimental Analysis of Behavior, 44, 195–206.
Rast, J., Johnston, J. M., & Drum, C. (1984). A parametric analysis of the relationship between food quantity and rumination. Journal of the Experimental Analysis of Behavior, 41, 125–134.
Rast, J., Johnston, J. M., Drum, C., & Conrin, J. (1981). The relation of food quantity to rumination behavior. Journal of Applied Behavior Analysis, 14, 121–130.
Repp, A. C., Barton, L. E., & Brulle, A. R. (1983). A comparison of two procedures for programming the differential reinforcement of other behaviors. Journal of Applied Behavior Analysis, 16, 435–445.
Sidman, M. (1960). Tactics of scientific research. New York: Basic Books.
Van Houten, R. (1987). Comparing treatment techniques: A cautionary note. Journal of Applied Behavior Analysis, 20, 109–110.
Author information
Authors and Affiliations
Rights and permissions
About this article
Cite this article
Johnston, J.M. Strategic and Tactical Limits of Comparison Studies. BEHAV ANALYST 11, 1–9 (1988). https://doi.org/10.1007/BF03392448
Published:
Issue Date:
DOI: https://doi.org/10.1007/BF03392448