Abstract
Although common in the educational and developmental areas, multilevel models are not often utilized in the analysis of data from experimental designs. This article illustrates how multilevel models can be useful with two examples from experimental designs with repeated measurements not involving time. One example demonstrates how to properly examine independent variables for experimental stimuli or individuals that are categorical, continuous, or semicontinuous in the presence of missing data. The second example demonstrates how response times and error rates can be modeled simultaneously within a multivariate model in order to examine speed—accuracy trade-offs at the experimental-condition and individual levels, as well as to examine differences in the magnitude of effects across outcomes. SPSS and SAS syntax for the examples are available electronically.
Article PDF
Similar content being viewed by others
References
Allen, P. A., Sliwinski, M. J., &Bowie, T. (2002). Differential age effects in semantic and episodic memory: Part II. Slope and intercept analyses.Experimental Aging Research,28, 111–142.
Allison, P. D. (1994). Using panel data to estimate the effects of events.Sociological Methods & Research,23, 174–199.
Cohen, J. (1983). The cost of dichotomization.Applied Psychological Measurement,7, 249–253.
Diez-Roux, A. V. (2000). Multilevel analysis in public health research.Annual Review of Public Health,21, 171–192.
Faust, M. E., Balota, D. A., Spieler, D. H., &Ferraro, F. R. (1999). Individual differences in information-processing rate and amount: Implications for group differences in response latency.Psychological Bulletin,125, 777–799.
Fitzmaurice, G., Laird, N. M., & Ware, J. H. (2004).Applied longitudinal analysis. New York: Wiley.
Hoffman, L. (2004). Attentional orienting deficits as a predictor of driving impairment in older adults.Dissertation Abstracts International,65 (4), 2130B.
Hoffman, L., & Atchley, P. (2001, November).Attentional orienting: The costs of age and the benefits of processing speed. Poster presented at the 42nd Annual Meeting of the Psychonomic Society, Orlando, FL.
Huynh, H., &Feldt, L. S. (1980). Performance of traditionalF tests in repeated measures designs under covariance heterogeneity.Communications in Statistics: Theory & Methods,9, 61–74.
Kreft, I. G. G., de Leeuw, J., &Aiken, L. S. (1995). The effect of different forms of centering in hierarchical linear models.Multivariate Behavioral Research,30, 1–21.
Laird, N. M., &Ware, J. H. (1982). Random-effects odels for longitudinal data.Biometrics,38, 963–974.
Littell, R. C., Milliken, G. A., Stroup, W. W., &Wolfinger, R. D. (1996).SAS system for mixed models. Cary, NC: SAS Institute.
Littell, R. C., Pendergast, J., &Natarajan, R. (2000). Modeling covariance structure in the analysis of repeated measures data.Statistics in Medicine,19, 1793–1819.
Lorch, R. F., &Myers, J. L. (1990). Regression analyses of repeated measures data in cognitive research.Journal of Experimental Psychology: Learning, Memory, & Cognition,16, 149–157.
Maas, C. J. M., &Snijders, T. A. B. (2003). The multilevel approach to repeated measures for complete and incomplete data.Quality & Quantity: International Journal of Methodology,37, 71–89.
MacCallum, R. C., Zhang, S., Preacher, K. J., &Rucker, D. D. (2002). On the practice of dichotomization of quantitative variables.Psychological Methods,7, 19–40.
Maxwell, S. E., &Delaney, H. D. (1993). Bivariate median splits and spurious statistical significance.Psychological Bulletin,113, 181–190.
Maxwell, S. E., &Delaney, H. D. (2003).Designing experiments and analyzing data: A model comparison perspective (2nd ed.). Mahwah, NJ: Erlbaum.
O’Brien, R. G., &Kaiser, M. K. (1985). MANOVA method for analyzing repeated measures designs: An extensive primer.Psychological Bulletin,97, 316–333.
Pringle, H. L., Irwin, D. E., Kramer, A. F., &Atchley, P. (2001). The role of attentional breadth in perceptual change detection.Psychonomic Bulletin & Review,8, 89–95.
Quené, H., &van den Bergh, H. (2004). On multi-level modeling of data from repeated measures designs: A tutorial.Speech Communication,43, 103–121.
Raaijmakers, J. G. W., Schrijnemakers, J. M. C., &Gremmen, F. (1999). How to deal with the “language-as-fixed-effect fallacy”: Common misconceptions and alternative solutions.Journal of Memory & Language,41, 416–426.
Raudenbush, S. W., &Bryk, A. S. (2002).Hierarchical linear models: Applications and data analysis methods (2nd ed.). Thousand Oaks, CA: Sage.
Rensink, R. A., O’Regan, J. K., &Clark, J. J. (1997). To see or not to see: The need for attention to perceive changes in scenes.Psychological Science,8, 368–373.
Rovine, M. J., &von Eye, A. (1991).Applied computational statistics in longitudinal research. Boston: Academic Press.
Sayer, A. G., &Klute, M. M. (2004). Analyzing couples and families. In V. L. Bengtson, A. Acock, K. R. Allen, P. Dilworth-Anderson, & D. M. Klein (Eds.),Sourcebook of family theory and research (pp. 289–314). Thousand Oaks, CA: Sage.
Schafer, J. L. (1997).Analysis of incomplete multivariate data. New York: Chapman and Hall.
Schafer, J. L., &Graham, J. W. (2002). Missing data: Our view of the state of the art.Psychological Methods,7, 147–177.
Singer, J. D. (1998). Using SAS PROC MIXED to fit multilevel models, hierarchical models, and individual growth models.Journal of Educational & Behavioral Statistics,23, 323–355.
Singer, J. D., &Willett, J. B. (2003).Applied longitudinal data analysis: Modeling change and event occurrence. Oxford: Oxford University Press.
Snijders, T. A. B., &Bosker, R. (1999).Multilevel analysis: An introduction to basic and advanced multilevel modeling. Thousand Oaks, CA: Sage.
Wallace, D., &Green, S. B. (2002). Analysis of repeated measures designs with linear mixed models. In D. S. Moskowitz & S. L. Hershberger (Eds.),Modeling intraindividual variability with repeated measures data (pp. 103–134). Mahwah, NJ: Erlbaum.
Wright, D. B. (1998). Modelling clustered data in autobiographical memory research: The multilevel approach.Applied Cognitive Psychology,12, 339–357.
Author information
Authors and Affiliations
Corresponding author
Additional information
The SAS and SPSS syntax used to estimate the example models and the accompanying data sets are available electronically from the first author at psycweb.unl.edu/psypage/hoffman/HomePage.htm.
Rights and permissions
About this article
Cite this article
Hoffman, L., Rovine, M.J. Multilevel models for the experimental psychologist: Foundations and illustrative examples. Behav Res 39, 101–117 (2007). https://doi.org/10.3758/BF03192848
Received:
Accepted:
Issue Date:
DOI: https://doi.org/10.3758/BF03192848