Abstract
Determining a priori power for univariate repeated measures (RM) ANOVA designs with two or more within-subjects factors that have different correlational patterns between the factors is currently difficult due to the unavailability of accurate methods to estimate the error variances used in power calculations. The main objective of this study was to determine the effect of the correlation between the levels in one RM factor on the power of the other RM factor. Monte Carlo simulation procedures were used to estimate power for the A, B, and AB tests of a 2×3, a 2×6, a 2×9, a 3×3, a 3×6, and a 3×9 design under varying experimental conditions of effect size (small, medium, and large), average correlation (.4 and .8), alpha (.01 and .05), and sample size (n = 5, 10 ,15, 20, 25, and 30). Results indicated that the greater the magnitude of the differences between the average correlation among the levels of Factor A and the average correlation in the AB matrix, the lower the power for Factor B (and vice versa). Equations for estimating the error variance of each test of the two-way model were constructed by examining power and mean square error trends across different correlation matrices. Support for the accuracy of these formulae is given, thus allowing for direct analytic power calculations in future studies.
Article PDF
Similar content being viewed by others
References
BMDP [Computer software] (1988). Los Angeles: University of California Press.
Borenstein, M., &Cohen, J. (1988).Statistical Power Analysis: A Computer Program [Computer program]. Hillsdale, NJ: Erlbaum.
Bradley, D. R. (1988).DATASIM [Computer program]. Lewiston, ME: Desktop Press.
Bradley, D. R., &Russell, R. L. (1998). Some cautions regarding statistical power in split-plot designs.Behavior Research Methods, Instruments, & Computers,30, 462–477.
Bradley, D. R., Russell, R. L., &Reeve, C. P. (1996). Statistical power in complex experimental designs.Behavior Research Methods, Instruments, & Computers,28, 319–326.
Cohen, J. (1988).Statistical power analysis for the behavioral sciences (3rd ed.). Hillsdale, NJ: Erlbaum.
Davidson, M. L. (1972). Univariate versus multivariate tests in repeated-measures experiments.Psychological Bulletin,77, 446–452.
Dodd, D. H., &Schultz, R. F., Jr. (1973). Computational procedures for estimating magnitude of effect for some analysis of variance designs.Psychological Bulletin,79, 391–395.
Eom, H. J. (1993).The interaction effects of data categorization and noncircularity of the sampling distribution of generalizability coefficients in analysis of variance models. Unpublished doctoral dissertation, University of British Columbia.
Erdfelder, E., Faul, F., &Buchner, A. (1996). GPOWER: A general power analysis program.Behavior Research Methods, Instruments, & Computers,28, 1–11.
Friedman, H. (1982). Simplified determinations of statistical power, magnitude of effect, and research sample sizes.Educational & Psychological Measurement,42, 521–526.
Gorman, B. S., Primavera, L. H., &Allison, D. B. (1995). POWPAL: A program for estimating effect sizes, statistical power, and sample sizes.Educational & Psychological Measurement,55, 773–776.
Grima, A. M., &Weinberg, S. (1987).An analysis of repeated measures data: An exploration of alternatives (MANOVA). Unpublished doctoral dissertation, New York University.
International mathematical and statistical libraries (1991). (10th ed.). Houston, TX: Visual Numbers Inc.
Kirk, R. E. (1995).Experimental design: Procedures for the behavioral sciences. Pacific Grove, CA: Brooks/Cole.
Kraemer, H. C., &Thiemann, S. (1987).How many subjects? Beverly Hills, CA: Sage.
Levin, J. R. (1997). Overcoming feelings of powerlessness in “aging” researchers: A primer on statistical power in analysis of variance designs.Psychology & Aging,12, 84–106.
Lipsey, M. W. (1990).Design sensitivity. Newbury Park, CA: Sage.
Marcucci, M. (1986). A comparison of the power of some tests for repeated measurements.Journal of Statistical Computation & Simulation,26, 37–53.
Mendoza, J. L., Toothaker, L. E., &Nicewander, W. A. (1974). A Monte Carlo comparison of the univariate and multivariate methods for the groups by trials repeated-measures design.Multivariate Behavioral Research,9, 165–177.
Muller, K. E., &Barton, C. N. (1989). Approximate power for repeated-measures ANOVA lacking sphericity.Journal of the American Statistical Association,84, 549–555.
Muller, K. E., LaVange, L. M., Ramey, S. L., &Ramey, C. (1992). Power calculations for general linear multivariate models including repeated measures applications.Journal of the American Statistical Association,87, 1209–1224.
Mulvenon, S.W., &Betz, M. A. (1993).Analytic formulae for power analysis in repeated measures designs. Unpublished doctoral dissertation, Arizona State University.
Number Cruncher Statistical System. (1991). PASS (Power Analysis and Sample Size), Version 1.0. Kaysville, UT: Jerry L. Hintze.
Pearson, E. S., &Hartley, H. O. (1951). Charts of the power function of the analysis of variance tests, derived from the noncentralF-distribution.Biometrika,38, 112–130.
Robey, R. R., &Barcikowski, R. S. (1984). Calculating the statistical power of the univariate and the multivariate repeated measures analyses of variance for the single group case under various conditions.Educational & Psychological Measurement,44, 137–143.
Rochon, J. (1991). Sample size calculations for two-group repeated-measures experiments.Biometrics,47, 1383–1398.
Rotton, J., &Schonemann, P. H. (1978). Power tables for analysis of variance.Educational & Psychological Measurement,38, 213–229.
Rouanet, H., &Lepine, D. (1970). Comparison between treatments in a repeated-measurement design: ANOVA and multivariate methods.British Journal of Mathematical & Statistical Psychology,23, 17–163.
Schutz, R. W., &Gessaroli, M. E. (1987). The analysis of repeated measures designs involving multiple dependent variables.Research Quarterly for Exercise & Sport,58, 132–149.
Tang, P. C. (1938). The power function of the analysis of variance tests with tables and illustrations of their use.Statistical Research Memoirs,2, 126–149.
Vonesh, E. F., &Schork, M. A. (1986). Sample sizes in the multivariate analysis of repeated measurements.Biometrics,42, 601–610.
Winer, B. J., Brown, D. R., &Michels, K. M. (1991).Statistical principles in experimental design (3rd ed.). New York: McGraw-Hill.
Author information
Authors and Affiliations
Corresponding author
Additional information
We wish to acknowledge the many insightful and helpful suggestions provided by Drake R. Bradley to an earlier draft of this paper.
Rights and permissions
About this article
Cite this article
Potvin, P.J., Schutz, R.W. Statistical power for the two-factor repeated measures ANOVA. Behavior Research Methods, Instruments, & Computers 32, 347–356 (2000). https://doi.org/10.3758/BF03207805
Received:
Accepted:
Issue Date:
DOI: https://doi.org/10.3758/BF03207805