Abstract
From a statistical point of view, adaptive testing belongs to the class of problems of selecting a best subset of random variables. As in any other instance of this problem, adaptive testing is likely to capitalize on estimation error. An empirical example of the phenomenon is discussed, and a strategy for cross-validating results from adaptive testing is proposed. Results from a simulation study on the strategy are presented.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Birnbaum, A. (1968). Some latent trait models and their use in inferring an examinee’s ability. In F.M. Lord & M.R. Novick, Statistical theories of mental test scores (pp. 395–479). Reading, MA: Addison-Wesley.
Hambleton, R.K., & Jones, R.W. (1994). Item parameter estimation errors and their influence on test information functions. Applied Measurement in Education, 7, 171–186.
Hambleton, R.K., Jones, R.W., & Rogers, H.J. (1993). Influence of item parameter estimation errors in test development. Journal of Educational Measurement, 30, 143–155.
Hetter, R.D., & Sympson, J.B. (1997). Item exposure control in CATASVAB. In W.A. Sands, B.K. Waters, & J.R. McBride (Eds.), Computerized adaptive testing: From inquiry to operation (pp. 141–144). Washington, DC: American Psychological Association.
Lord, F.M., & Novick, M.R. (1968). Statistical theories of mental test scores. Reading, MA: Addison-Wesley.
Mosier, C.I. (1951). Symposium: The need and means of cross validation. Educational and Psychological Measurement, 11, 5–11.
Neter, J., & Wasserman, W. (1974). Applied linear statistical models: Regression, analysis of variance, and experimental design. Homewood, IL: Irwin.
Raju, N.S., Bilgic, R., Edwards, J.E., & Fleer, P.F. (1997). Methodology review: Estimation of population validity and cross validity, and the use of equal weights in prediction. Applied Psychological Measurement, 21, 291–306.
Stocking, M.L., & Lewis, C. (2000). Methods of controlling the exposure of items in computerized adaptive testing. In W.J. van der Linden & C.A.W. Glas (Eds.), Computerized adaptive testing: Theory and practice (pp. 163–182). Boston, MA: Kluwer.
Sympson, J.B., & Hetter, R.D. (1985, October). Controlling exposure rates in computerized adaptive testing [Transparencies]. Paper presented at the 27th Annual Conference of the Military Testing Association. San Diego, CA: Military Testing Association.
Tsutakawa, R.K., & Johnson, J.C. (1990). The effect of uncertainty on item parameter estimation on ability estimates. Psychometrika, 55, 371–390.
Van der Linden, W.J., & Glas, C.A.W. (2000). Capitalization on item calibration error in adaptive testing. Applied Measurement in Education, 13, 35–53.
Van der Linden, W.J., & Pashley, P.J. (2000). Item selection and ability estimation in adaptive testing. In W.J. van der Linden & C.A.W. Glas (Eds.), Computerized adaptive testing: Theory and practice (pp. 1–25). Boston, MA: Kluwer.
Wainer, H. (Ed.). (1990). Computerized adaptive testing: A primer. Hillsdale, NJ: Erlbaum.
Warm, T.A. (1989). Weighted likelihood estimation of ability in item response theory. Psychometrika, 54, 427–450.
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2001 Springer Science+Business Media New York
About this chapter
Cite this chapter
van der Linden, W.J., Glas, C.A.W. (2001). Cross-Validating Item Parameter Estimation in Adaptive Testing. In: Boomsma, A., van Duijn, M.A.J., Snijders, T.A.B. (eds) Essays on Item Response Theory. Lecture Notes in Statistics, vol 157. Springer, New York, NY. https://doi.org/10.1007/978-1-4613-0169-1_12
Download citation
DOI: https://doi.org/10.1007/978-1-4613-0169-1_12
Publisher Name: Springer, New York, NY
Print ISBN: 978-0-387-95147-8
Online ISBN: 978-1-4613-0169-1
eBook Packages: Springer Book Archive