Abstract
An algorithm is presented for the best least-squares fitting correlation matrix approximating a given missing value or improper correlation matrix. The proposed algorithm is based upon a solution for Mosier's oblique Procrustes rotation problem offered by ten Berge and Nevels. A necessary and sufficient condition is given for a solution to yield the unique global minimum of the least-squares function. Empirical verification of the condition indicates that the occurrence of non-optimal solutions with the proposed algorithm is very unlikely. A possible drawback of the optimal solution is that it is a singular matrix of necessity. In cases where singularity is undesirable, one may impose the additional nonsingularity constraint that the smallest eigenvalue of the solution be δ, where δ is an arbitrary small positive constant. Finally, it may be desirable to weight the squared errors of estimation differentially. A generalized solution is derived which satisfies the additional nonsingularity constraint and also allows for weighting. The generalized solution can readily be obtained from the standard “unweighted singular” solution by transforming the observed improper correlation matrix in a suitable way.
This is a preview of subscription content, log in via an institution to check access.
Similar content being viewed by others
References
Beale, E. M. L., & Little, R. J. A. (1975). Missing values in multivariate analysis.Journal of the Royal Statistical Society, Series B, 37, 129–145.
de Leeuw, J. (1983). Models and methods for the analysis of correlation coefficients.Journal of Econometrics, 22, 113–137.
Dempster, A. P., Laird, N. M., & Rubin, D. B. (1977). Maximum likelihood from incomplete data via the EM algorithm (with discussion).Journal of the Royal Statistical Society, Series B, 39, 1–38.
Devlin, S. J., Gnanadesikan, R., & Kettenring, J. R. (1975). Robust estimation and outlier detection with correlation coefficients,Biometrika, 62, 531–545.
Devlin, S. J., Gnanadesikan, R., & Kettenring, J. R. (1981). Robust estimation of dispersion matrices and principal components.Journal of the American Statistical Association, 76, 354–362.
Dong, H. K. (1985). Non-Gramian and singular matrices in maximum likelihood factor analysis.Applied Psychological Measurement, 9, 363–366.
Frane, J. W. (1976). Some simple procedures for handling missing data in multivariate analysis.Psychometrika, 41, 409–415.
Frane, J. W. (1978). Missing data and BMDP: Some pragmatic approaches.Proceedings of the Statistical Computing Section (pp. 27–33). Washington, DC: American Statistical Association.
Gleason, T. C., & Staelin, R. (1975). A proposal for handling missing data.Psychometrika, 40, 229–252.
Gnanadesikan, R., & Kettenring, J. R. (1972). Robust estimates, residuals, and outlier detection with multiresponse data.Biometrics, 28, 81–124.
Knol, D. L., & ten Berge, J. M. F. (1987).Least-squares approximation of an improper by a proper correlation matrix using a semi-infinite convex program (Research Report 87-7). Enschede, The Netherlands: University of Twente, Department of Education.
Luenberger, D. G. (1984).Introduction to linear and nonlinear programming (2nd ed.). Reading, MA: Addison-Wesley.
Mosier, C. I. (1939). Determining a simple structure when loadings for certain tests are known.Psychometrika, 4, 149–162.
Mulaik, S. A. (1972).The foundations of factor analysis. New York: McGraw-Hill.
Orchard, T., & Woodbury, M. A. (1972). A missing information principle: Theory and applications.Proceedings of the 6th Berkeley Symposium on Mathematical Statistics and Probability (Vol. 1),6, 697–715.
Shapiro, A. (1985). Extremal problems on the set of nonnegative definite matrices.Linear Algebra and its Applications, 67, 7–18.
ten Berge, J. M. F., & Nevels, K. (1977). A general solution to Mosier's oblique Procrustes problem.Psychometrika, 42, 593–600.
Timm, N. H. (1970). The estimation of variance-covariance and correlation matrices from incomplete data.Psychometrika, 35, 417–437.
Author information
Authors and Affiliations
Rights and permissions
About this article
Cite this article
Knol, D.L., ten Berge, J.M.F. Least-squares approximation of an improper correlation matrix by a proper one. Psychometrika 54, 53–61 (1989). https://doi.org/10.1007/BF02294448
Received:
Revised:
Issue Date:
DOI: https://doi.org/10.1007/BF02294448