Skip to main content

Designing and Implementing a Multistage Adaptive Test: The Uniform CPA Exam

  • Chapter
  • First Online:
Elements of Adaptive Testing

Abstract

The Uniform CPA Exam (CPA Exam) was first administered in 1917 as a requirement in the licensing of certified public accountants. It included a series of accounting problems in auditing, accounting, and commercial law that were graded by members of the American Institute of Certified Public Accountants (AICPA). Since 1917, the CPA Exam evolved to include four independently scored sections that included not only accounting problems, but essays, multiple-choice questions, and extended multiple-choice formats. Until 2004, the CPA Exam was presented twice each year, in a paper-based format. At its peak in the early 1990s, over 300,000 individual CPA Exam papers were scored each year.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 119.00
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 159.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info
Hardcover Book
USD 159.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  • Adema, J. J. (1990). The construction of customized two-stage tests. Journal of Educational Measurement, 27, 241–253.

    Article  Google Scholar 

  • American Institute of Certified Public Accountants. (June 1997). Conversion of the Uniform CPA Exam to a computer-based examination. Jersey City, NJ.

    Google Scholar 

  • American Institute of Certified Public Accountants & National Association of State Boards of Accountancy Computerization Implementation Committee. (1998, October). Conversion of the Uniform CPA Exam to a computer-based examination (Status Report Briefing Paper No. 1). Jersey City, NJ.

    Google Scholar 

  • American Institutes for Research (2001). Practice analysis of certified public accountants[Technical Report]. Norris, Russell, Goodwin & Jessee.

    Google Scholar 

  • Board of Examiners (1995). Invitation to comment: Conversion of the Uniform CPA Exam to a computer-based examination. Jersey City, NJ: American Institute of Certified Public Accountants.

    Google Scholar 

  • Breithaupt, K. & Hare, D. R. (2008). Automated assembly techniques for rapidly changing test designs. Invited presentation at the annual meeting of the National Council on Measurement in Education, New York.

    Google Scholar 

  • Geisinger, K. F. (1991). Using standard-setting data to establish cutoff scores. Educational Measurement: Issues and Practice, 10, 17–22.

    Article  Google Scholar 

  • Hambleton, R. K. & Jones, R. W. (1993). An NCME instructional module on comparison of classical test theory and item response theory and their applications to test development. Educational Measurement: Issues and Practice, 12, 38–47.

    Article  Google Scholar 

  • Hambleton, R. K. & Pitoniak, M. J. (2002). Setting passing scores on the CBT version of the Uniform CPA Exam: Comparison of several promising methods [Unpublished report]. Amherst, MA: Center for Educational Assessment, University of Massachusetts.

    Google Scholar 

  • Huitzing, H. A. (2004). Using set covering with item sampling to analyze infeasibility of linear programming test assembly models. Applied Psychological Measurement, 26, 355–375.

    Article  MathSciNet  Google Scholar 

  • Huitzing, H. A., Veldkamp, B. P. & Verschoor, A. J. (2005). Infeasibility in automated test assembly models: A comparison study of different methods. Journal of Educational Measurement, 42, 223–243.

    Article  Google Scholar 

  • ILOG. (2002). ILOG OPL Studio 3.6.1 [User Manual]. Mountain View, CA.

    Google Scholar 

  • Luecht, R. M. (2000). Implementing the computer-adaptive sequential testing (CAST) framework to mass produce high quality computer-adaptive and mastery tests. Paper presented at the Annual Meeting of the National Council on Measurement in Education, New Orleans, LA.

    Google Scholar 

  • Luecht, R. M., Brumfield, T. & Breithaupt, K. (2006). A testlet assembly design for adaptive multistage tests. Applied Measurement in Education, 19, 189–202.

    Article  Google Scholar 

  • Luecht, R. M. & Nungester, R. J. (1998). Some practical applications of computerized adaptive sequential testing. Journal of Educational Measurement, 35, 229–249.

    Article  Google Scholar 

  • Luecht, R. M. & Nungester, R. J. (2000). Computer-adaptive sequential testing. In W. J. van der Linden & C. A. W. Glas (Eds). Computer-adaptive testing: Theory and practice (pp. 117–128). Boston: Kluwer-Nijhof Publishing.

    Google Scholar 

  • Luecht, R. M., Nungester, R. J. & Hadadi, A. (1996, April). Heuristics-based CAT: Balancing item information, content, and exposure. Paper presented at annual meeting of National Council on Measurement in Education, New York.

    Google Scholar 

  • Melican, G., Breithaupt, K., Mills, C., Hambleton, R. K. & Zhao, Y. (2005). Multi-stage testing and case studies in a fully functioning licensing examination. Invited symposium paper presented at the Annual Meeting of the National Council on Measurement in Education, Montreal, Canada.

    Google Scholar 

  • Mills, C. N., Hambleton, R. K., Biskin, B., Evans, J. & Pfeffer, M. (2000, January). A comparison of two standard setting methods for Uniform CPA Exam [Technical Report]. Jersey City, NJ: American Institute of Certified Public Accountants.

    Google Scholar 

  • Nemhauser, G. L. & Wolsey, L. A. (1999). Integer and combinatorial optimization. New York: Wiley.

    MATH  Google Scholar 

  • Pitoniak, M. J., Hambleton, R. K. & Sireci, S. G. (2002). Advances in standard setting for professional licensure examinations. Paper presented at the annual meeting of the American Educational Research Association, New Orleans, LA, April 2002. [Also published as Laboratory of Psychometric and Evaluative Research Report No. 423. Amherst: University of Massachusetts, School of Education.]

    Google Scholar 

  • Professional Examination Service (1999). Final report of the conduct of a feasibility study for the computerization and implementation of a Uniform CPA Exam in fifty-four jurisdictions. New York.

    Google Scholar 

  • Rotou, O., Patsula, L., Steffen, M. & Rizavi, S. (2007). Comparison of multistage tests with computerized adaptive and paper-and-pencil tests [Research Report No. RR-07-04]. Princeton, NJ: Educational Testing Service.

    Google Scholar 

  • Stocking, M. L. & Swanson, L. (1993). A method for severely constrained item selection in adaptive testing. Applied Psychological Measurement, 17, 277–292.

    Article  Google Scholar 

  • Theunissen, T. J. J. M. (1987). Text banking and test design. Language Testing, 4, 1–8.

    Article  Google Scholar 

  • van der Linden, W. J. (2005). Linear models for optimal test design. New York: Springer-Verlag.

    MATH  Google Scholar 

  • van der Linden, W. & Boekkooi-Timminga, E. (1989). A maximin model for test design with practical constraints. Psychometrika, 54, 237–247.

    Article  Google Scholar 

  • van der Linden, W., Breithaupt, K., Chuah, S. C. & Zhang, Y. (2007). Detecting differential speededness in multistage testing. Journal of Educational Measurement, 44, 117–130.

    Article  Google Scholar 

  • Veldkamp, B. P. (2002). Multidimensional constrained test assembly. Applied Psychological Measurement, 26, 133–146.

    Article  MathSciNet  Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2009 Springer Science+Business Media, LLC

About this chapter

Cite this chapter

Melican, G.J., Breithaupt, K., Zhang, Y. (2009). Designing and Implementing a Multistage Adaptive Test: The Uniform CPA Exam. In: van der Linden, W., Glas, C. (eds) Elements of Adaptive Testing. Statistics for Social and Behavioral Sciences. Springer, New York, NY. https://doi.org/10.1007/978-0-387-85461-8_9

Download citation

Publish with us

Policies and ethics