Skip to main content
Log in

The robustness of maximum likelihood and distribution-free estimators to non-normality in confirmatory factor analysis

  • Research Report
  • Published:
Quality and Quantity Aims and scope Submit manuscript

Abstract

The present Monte Carlo compares the estimates produced by maximum likelihood (ML) and asymptotically distribution-free (ADF) methods. The study extends prior research by investigating the combined effects of sample size, magnitude of correlation among observed indicators, number of indicators, magnitude of skewness and kurtosis, and proportion of indicators with non-normal distributions. Results indicate that both ML and ADF showed little bias in estimates of factor loadings under all conditions studied. As the number of indicators in the model increased, ADF produced greater negative bias in estimates of uniquenesses than ML. In addition, the bias in standard errors for both ML and ADF estimation increased in models with more indicators, and this effect was more pronounced for ADF than ML. Increases in skewness and kurtosis resulted in greater underestimating of standard errors; ML standard errors showed greater bias than ADF under conditions of non-normality, and ML chi-square statistics were also inflated. However, when only half the indicators departed from normality, the inflation in ML chi-square decreased.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Similar content being viewed by others

References

  • Anderson, T. & Amemiya, Y. (1988). The asymptotic normal distribution of estimators in factor analysis under general conditions,Annals of Statistics 16: 759–771.

    Google Scholar 

  • Anderson, J. & Gerbing, W. (1984). The effect of sampling error on convergence, improper solutions and goodness-of-fit indices for maximum likelihood confirmatory factor analyses,Psychometrika 49: 155–173.

    Google Scholar 

  • Boomsma, A. (1982). The robustness of LISREL against small sample sizes in factor analysis models. In K. Jöreskog & H. Wold (Eds.),Systems under Indirect Observation, Amsterdam: North-Holland.

    Google Scholar 

  • Boomsma, A. (1983).On the Robustness of LISREL (Maximum Likelihood Estimation) Against Small Sample Size and Non-Normality, unpublished doctoral dissertation, University of Groningen. Groningen, Netherlands.

    Google Scholar 

  • Boomsma, A. (1985). Nonconvergence, improper solutions and starting values in LISREL maximum likelihood estimation,Psychometrika 50: 229–242.

    Google Scholar 

  • Browne, M. (1982). Covariance Structures. In D.M. Hawkins (Ed.),Topics in Applied Multivariate Analysis, Cambridge: Cambridge University Press, pp. 72–141.

    Google Scholar 

  • Browne, M. (1984). Asymptotically distribution-free methods for the analysis of covariance structures,British Journal of Mathematical and Statistical Psychology 37: 62–83.

    Google Scholar 

  • Browne, M. (1987). Robustness of statistical inference in factor analysis and related models,Biometrika 74: 375–384.

    Google Scholar 

  • Fleishman, A. (1978). A method for simulating non-normal distributions,Psychometrika 43: 521–532.

    Google Scholar 

  • Fornell, C. (1983). Issues in the application of covariance structure analysis: A comment,Journal of Consumer Research 9: 443–448.

    Google Scholar 

  • Harlow, L. (1985).Behavior of Some Elliptical Theory Estimators with Non-Normal Data in a Covariance Structures Framework: A Monte Carlo Study, unpublished doctoral dissertation, University of California at Los Angeles.

    Google Scholar 

  • Harlow, L., Chou, C-P., & Bentler, P. (June, 1986).Performance of Chi-Square Statistic with ML. ADF, and Elliptical Estimators for Covariance Structures, paper presented at the annual meeting of the Psychometric Society, Toronto, Canada.

  • Hays, W. (1981).Statistics (3rd ed.). NY: Holt, Rinehart and Winston, Inc.

    Google Scholar 

  • IMSL (1982). International Mathematical and Statistical Library, Houston, Texas.

  • Jöreskog, K. & Sörbom, D. (1986).LISREL VI: Analysis of Linear Structural Relationships by Maximum Likelihood, Instrumental Variables and Least Squares Methods (4th Ed.), Mooresville, In.: Scientific Software Inc.

    Google Scholar 

  • Muthén, B. (1987).LISCOMP. Analysis of Linear Structural Equations with a Comprehensive Measurement Model, Mooresville, In.: Scientific Software, Inc.

    Google Scholar 

  • Muthén, B. & Kaplan, D. (1985). A comparison of some methodologies for the factor analysis of non-normal likert variables,British Journal of Mathematical and Statistical Psychology 38: 171–189.

    Google Scholar 

  • Muthén, B. & Kaplan, D. (1992). A comparison of some methodologies for the factor analysis of non-normal Likert variables: A note on the size of the model,British Journal of Mathematical and Statistical Psychology 45: 19–30.

    Google Scholar 

  • Tanaka, J. (1984).Some Results on the Estimation of Covariance Structure Models, unpublished doctoral dissertation, University of California, Los Angeles.

    Google Scholar 

  • Vale, C. & Maurelli, V. (1983). Simulating multivariate non-normal distributions,Psychometrika 48: 465–471.

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Rights and permissions

Reprints and permissions

About this article

Cite this article

Benson, J., Fleishman, J.A. The robustness of maximum likelihood and distribution-free estimators to non-normality in confirmatory factor analysis. Qual Quant 28, 117–136 (1994). https://doi.org/10.1007/BF01102757

Download citation

  • Issue Date:

  • DOI: https://doi.org/10.1007/BF01102757

Keywords

Navigation