Abstract
Generalizability theory concerns the adequacy with which a “universe” score can be inferred from a set of observations. In this paper the theory is applied to a universe in which observations are classifiable according to two independent variable aspects of the measuring procedure. Several types of universe scores are developed and the variance components ascertained for each type. The composition of expected observed-score variance and the adequacy of inference to a particular type of universe score is a function of the procedure used in gathering data. A generalizability study provides estimates of variance components which can be used in designing an efficient procedure for a particular decision purpose.
This is a preview of subscription content, log in via an institution to check access.
Similar content being viewed by others
References
Burt, C. Test reliability estimated by analysis of variance.Brit. J. statist. Psychol., 1955,8, 103–118.
Cornfield, J. and Tukey, J. W. Average values of mean squares in factorials.Ann. math. Statist., 1956,27, 907–949.
Cronbach, L. J. Test reliability: its meaning and determination.Psychometrika, 1947,12, 1–16.
Cronbach, L. J., Rajaratnam, N., and Gleser, G. C. Theory of generalizability: a liberalization of reliability theory.Brit. J. statist. Psychol., 1963,16, 137–163.
Cronbach, L. J., Gleser, G. C., and Rajaratnam, N. Generalizability of stratified-parallel tests.Psychometrika, 1965,30, 39–56.
Endler, N. S., Hunt, J. M., and Rosenstein, A. J. An S-R inventory of anxiousness.Psychol. Monogr., 1962, No. 536.
Endler, N. S. and Hunt, J. M. Sources of behavioral variance as measured by the S-R inventory of anxiousness. Mimeographed (December, 1964).
Gulliksen, H. The content reliability of a test.Psychometrika, 1936,1, 189–194.
Guttman, L. The principal components of scalable attitudes. In P. F. Lazarsfeld (Ed.),Mathematical thinking in the social sciences. Glencoe, Ill.: Free Press, 1954.
Lindquist, E. F.Design and analysis of experiments in psychology and education. Boston: Houghton Mifflin, 1953.
Mahmoud, A. F. Test reliability in terms of factor theory.Brit. J. statist. Psychol., 1955,8, 119–135.
Medley, D. M. and Mitzel, H. E. Measuring classroom behavior by systematic observation. In N. L. Gage (Ed.),Handbook of research on teaching. Chicago: Rand-McNally, 1963. Pp. 247–328.
Moonan, W. J. Computational illustrations of the internal and external consistency analysis of examination responses.J. exp. Educ. 1957,25, 181–190.
Stanley, J. C. Analysis of three-way orthogonal classifications, with applications to rater bias and trait independence. Unpublished manuscript, 1959.
Thorndike, R. L. Research problems and techniques.Report No. 3, AAF Aviation Psychol. Program Research Reports. U. S. Government Printing Office, 1947.
Author information
Authors and Affiliations
Additional information
This study was conducted under Grant M-1839 from the National Institute of Mental Health while the authors were on the staff of the University of Illinois. Dr. Rajaratnam shared responsibility for the technical report of July, 1961 on which this paper is based. The present revision was made subsequent to her death in 1963. The present addresses of the other authors are: Goldine C. Gleser, Department of Psychiatry, Central Clinic, Cincinatti, 29, Ohio; Lee J. Cronbach, School of Education, Stanford University.
Rights and permissions
About this article
Cite this article
Gleser, G.C., Cronbach, L.J. & Rajaratnam, N. Generalizability of scores influenced by multiple sources of variance. Psychometrika 30, 395–418 (1965). https://doi.org/10.1007/BF02289531
Received:
Issue Date:
DOI: https://doi.org/10.1007/BF02289531