Abstract
Correlational analyses are one of the most popular quantitative methods, yet also one of the mostly frequently misused methods in social and behavioral research, especially when analyzing ordinal data from Likert or other rating scales. Although several correlational analysis options have been developed for ordinal data, there seems to be a lack of didactically written literature illustrating the appropriate use and differences among them. The purpose of this paper is to provide a synthesis of correlational analysis options when analyzing ordinal data. These options span from the traditional methods, such as Pearson’s r, to more recent developments, such as Bayesian estimation of polychoric correlations. An illustration of these methods utilizing a contemporary dataset is provided.
Similar content being viewed by others
References
Aldrich, J. (1997). R.A. Fisher and the making of maximum likelihood 1912–1922. Statistical Science, 12, 162–176.
Bock, R., & Aitkin, M. (1981). Marginal maximum likelihood estimation of item parameters: An application of the EM algorithm. Psychometrika, 46, 443–459.
Bollen, K., & Barb, K. (1981). Pearson’s r and coarsely categorized measures. American Sociological Review, 46, 232–239.
Borgatta, E., & Bohrnstedt, G. (1980). Level of measurement once over again. Sociological Methods & Research, 9, 147–160.
Chen, J., & Choi, J. (in press). A comparison of maximum likelihood and expected a posteriori estimation for polychoric correlation using Monte Carlo simulation. Journal of Modern Applied Statistical Methods.
Chen, P., & Popovich, P. (2002). Correlation: Parametric and nonparametric measures. Thousand Oaks, CA: Sage Publications.
Choi, J., Chen, J., & Kim, S. (2009). BayesPCC (v 3.0.0): A stand-alone Microsoft Windows software program for estimating polychoric correlation matrices using Bayesian estimation methods [Computer software].
Choi, J., Chen, J., & Kim, S. (in press). EAPPCC: A Matlab subroutine for estimating polychoric correlation matrices using an expected a posteriori estimation method. Applied Psychological Measurement.
Crocker, L., & Algina, J. (1986). Introduction to classical and modern test theory. Belmont, CA: Wadsworth Group.
Green, S., & Salkind, N. (2005). Using SPSS for windows and Macintosh: Analyzing and understanding data. Upper Saddle River, NJ: Prentice Hall.
Jöreskog, K., & Moustaki, I. (2001). Factor analysis of ordinal variables: A comparison of three approaches. Multivariate Behavioral Research, 36, 347–387.
Kampen, J., & Swyngedouw, M. (2000). The ordinal controversy revisited. Quality & Quantity, 34, 87–102.
Kaplan, D. (2000). Structural equation modeling: Foundations and extensions. Thousand Oaks, CA: Sage.
Kendall, M., & Gibbons, J. (1990). Rank correlation methods. New York: Oxford University Press.
Mayer, L. (1971). A note on treating ordinal data as interval data. American Sociological Review, 36, 519–520.
NCES (2008). Program for international student assessment (PISA). Retrieved November 7, 2008, from http://nces.ed.gov/surveys/pisa/index.asp.
O’Brien, R. (1985). The relationship between ordinal measures and their underlying values: Why all the disagreement? Quality & Quantity, 19, 265–277.
Olsson, U. (1979). Maximum likelihood of the polychoric correlation coefficient. Psychometrika, 44, 443–460.
Pearson, K. (1957). The grammar of science. New York: The Meridian Library.
Poon, W., Leung, K., & Lee, S. (2002). The comparison of single item. Constructs by relative mean and relative variance. Organizational Research Methods, 5, 275–298.
Siegel, S., & Castellan, N. J. (1988). Nonparametric statistics for the behavioral sciences (2nd ed.). New York: McGraw-Hill.
Vito, G., & Blankenship, M. (2002). Statistical analysis in criminal justice and criminology: A user’s guide. Upper Saddle River, NJ: Prentice-Hall, Inc.
Ware, W., & Benson, J. (1975). Appropriate statistics and measurement scales. Science Education, 59, 575–582.
Zumbo, B., Gadermann, A., & Zeisser, C. (2007). Ordinal versions of coefficients alpha and theta for Likert rating scales. Journal of Modern Applied Statistical Methods, 6, 21–29.
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Choi, J., Peters, M. & Mueller, R.O. Correlational analysis of ordinal data: from Pearson’s r to Bayesian polychoric correlation. Asia Pacific Educ. Rev. 11, 459–466 (2010). https://doi.org/10.1007/s12564-010-9096-y
Received:
Revised:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s12564-010-9096-y