Abstract
This article focuses on the design of competency-based performance assessment in e-learning. Though effort has been invested in designing powerful e-learning environments, relatively little attention has been paid to the design of valid and reliable assessments in such environments, leaving many questions to educational developers and teachers. As a solution to this problem, a systematic approach to designing performance assessments in e-learning contexts is presented, partly based on the 4C/ID model. This model enables the construction of realistic whole tasks instead of advocating education that is restricted to more isolated skills. A new assessment procedure also implies an alternative view of instructional design, learning and assessment. The requirements for the learning environment are addressed. Examples from a virtual seminar are presented to illustrate the design approach. The article concludes with the identification of possible pitfalls related to the approach and gives directions for future research.
Similar content being viewed by others
References
American Educational Research Association, American Psychological Association, & National Council on Measurement in Education. (1999). Standards for educational and psychological testing. Washington, DC: American Educational Research Association.
Baker, E. L., & Mayer, R. E. (1999). Computer-based assessment of problem solving. Computers in Human Behavior, 15, 269–282.
Bastiaens, Th., & Martens, R. (2000). Conditions for web-based learning with real events. In B. Abbey (Ed.), Instructional and cognitive impacts of web-based education (pp. 1–32). Hershey/London: Idea Group Publishing.
Beijaard, D., Verloop, N., Wubbels, Th., & Feiman-Nemser, S. (2000). The professional development of teachers. In R. J. Simons, J. van der Linden, & T. Duffy (Eds.), New learning (pp. 261–274). Dordrecht, The Netherlands: Kluwer.
Bennett, R. E. (1999). Using new technology to improve assessment. Educational Measurement: Issues and Practice, 18, 5–12.
Biggs, J. (1996). Enhancing teaching through constructive alignment. Higher Education, 32, 347–364.
Birenbaum, M. (2003). New insights into learning and teaching and their implications for assessment. In M. Segers, F. Dochy, & E. Cascallar (Eds.), Optimising new modes of assessment: In search of qualities and standards (pp. 13–36). Dordrecht, The Netherlands: Kluwer.
Crooks, T. J., Kane, M. T., & Cohen, A. S. (1996). Threats to the valid use of assessments. Assessment in Education, 3, 265–285.
Dierick, S., van de Watering, G., & Muijtjens, A. (2002). De actuele kwaliteit van assessment: Ontwikkelingen in de edumetrie [Current quality in assessment: Developments in edumetrics]. In F. Dochy, L. Heylen, & H. van de Mosselaer (Eds.), Assessment in onderwijs: Nieuwe toetsvormen en examinering in het studentgericht onderwijs en competentiegericht onderwijs [Assessment in education: New modes of assessment in student-centred and competency-based education] (pp. 91–122). Utrecht, The Netherlands: Lemma.
Furrer, C., & Skinner, E. (2003). Sense of relatedness as a factor in children's academic engagement and performance. Journal of Educational Psychology, 95, 148–162.
Garris, G., Ahlers, R., & Driskell, J. (2002). Games, motivation, and learning. S imulation & Gaming, 33, 441–467.
Gick, M., & Holyoak, K. J. (1983). Schema induction and analogical transfer. Cognitive Psychology, 15, 1–38.
Gulikers, J., Bastiaens, Th., & Martens, R. (2005). The surplus value of an authentic learning environment. Computers in Human Behavior, 21, 509–521.
Herman, J. L., Aschbacher, P. R., & Winters, L. (1992). A practical guide to alternative assessment. Alexandria, VA: Association for Supervision and Curriculum Development.
Jochems, W., van Merriënboer, J., & Koper, R. (2004). Integrated e-learning: Implications for pedagogy, technology & organization. London: RoutledgeFalmer.
Johnston, B. (2004). Summative assessment of portfolios: An examination of different approaches to agreement over outcomes. Studies in Higher Education, 29, 395–412.
Linn, R. L., Baker, E. L., & Dunbar, S. B. (1991). Complex, performance-based assessment: Expectations and validation criteria. Educational Researcher, 20(8), 15–21.
Lockwood, F. (1995). Students' perception of, and response to, formative and summative assessment material. In F. Lockwood (Ed.), Open and distance learning today (pp. 197–207). London: Routledge.
Martens, R. L. (1998). The use and effects of embedded support devices in independent learning (PhD thesis). Utrecht, The Netherlands: Lemma BV.
Mayer, R. E. (2002). A taxonomy for computer-based assessment of problem solving. Computers in Human Behavior, 18, 623–632.
Mehrens, W. A., Popham, W. J., & Ryan, J. M. (1998). How to prepare students for performance assessments. Educational Measurement: Issues and Practice, 17, 18–22.
Mudrack, P. E., & Farrell, G. M. (1995). An examination of functional role behaviour and its consequences for individuals in group settings. Small Group Research, 26, 542–571.
Nijhuis, J. F. H., Segers, M. S. R., & Gijselaers, W. H. (2005). Influence of redesigning a learning environment on student perceptions and learning strategies. Learning Environments Research, 8, 67–93.
Nystrand, M., Cohen, A. S., & Dowling, N. M. (1993). Addressing reliability problems in the portfolio assessment of college writing. Educational Assessment, 1, 53–70.
O'Neil, H. F. (2002). Perspectives on computer-based performance assessment of problem solving. Computers in Human Behavior, 15, 255–268.
Paas, F. G. W. C., & van Merriënboer, J. J. G. (1994). Variability of worked examples and transfer of geometrical problem solving skills: A cognitive load approach. Journal of Educational Psychology, 86, 122–133.
Pitts, J., Coles, C., & Thomas, P. (2001). Enhancing reliability in portfolio assessment: ‘Shaping’ the portfolio. Medical Teacher, 23, 351–365.
Prins, F. J., Sluijsmans, D. M. A., Kirschner, P. A., & Strijbos, J. W. (2005). Formative peer assessment in a CSCL environment: A case study. Assessment and Evaluation in Higher Education, 30, 417–444.
Quellmalz, E. (1991). Developing criteria for performance assessments: The missing link. Applied Measurement in Education, 4, 319–332.
Reeves, T. C. (2000). Alternative assessment approaches for online learning environments in higher education. Journal of Educational Computing Research, 23, 101–111.
Ryan, R. M., & Deci, E. L. (2000). Self-determination theory and the facilitation of intrinsic motivation, social development, and well being. American Psychologist, 55, 68–78.
Segers, M., & Dierick, S. (2001). Quality Standards for new modes of assessment: An exploratory study of the consequential validity of the OverAll test. European Journal of Psychology of Education, 16, 569–588.
Shavelson, R. J. (1991). Performance assessment in science. Applied Measurement in Education, 4, 347–362.
Sluijsmans, D. M. A. (2002). Student involvement in assessment: The training of peer assessment skills. Unpublished doctoral dissertation, Open University of The Netherlands, Heerlen, The Netherlands.
Sluijsmans, D., Moerkerke, G., Dochy, F., & van Merriënboer, J. (2001). Peer assessment in problem based learning. Studies in Educational Evaluation, 27, 153–173.
Snyder, B. (1973). The hidden curriculum. Cambridge, MA: The MIT Press.
Straetmans, G. J. J. M., & Sanders, P. F. (2001). Beoordelen van competenties van docenten [Assessment of competencies of teachers]. Den Haag, The Netherlands: Programmamanagement ESP/HBO-raad.
Stiggins, R. (1987). Design and development of performance assessment. Educational Measurement: Issues and Practice, 6, 33–42.
Stoof, A., Martens, R., van Merriënboer, J., & Bastiaens, Th. (2002). The boundary approach of competence: A constructivist aid for understanding and using the concept of competence. Human Resource Development Review, 1, 345–365.
Strijbos, J. W., Kirschner, P. A., & Martens, R. L. (Eds.). (2004). What we know about CSCL in higher education. Dordrecht, The Netherlands: Kluwer.
Strijbos J. W., Martens, R. L., & Jochems, W. M. G. (2004). Designing for interaction: Six steps to designing computer supported group based learning. Computers & Education, 42, 403–424.
Surgue, B. (2002). Performance-based instructional design for e-learning. Performance Improvement, 41, 45–50.
Van Merriënboer, J. J. G. (1997). Training complex cognitive skills. Englewood Cliffs, NJ: Educational Technology Publications.
Van Merriënboer, J. J. G., Jelsma, O., & Paas, F. G. W. C. (1992). Training for reflective expertise: A four-component instructional design model for training complex cognitive skills. Educational Technology, Research and Development, 40, 23–43.
Van Merriënboer, J. J. G., & Martens, R. L. (2002). Computer-based tools for instructional design. Educational Technology, Research and Development, 50, 5–9.
Wiggins, G. (1989). A true test: Toward a more authentic and equitable assessment. Phi Delta Kappan, 70, 703–713.
Zhang, J., Khan, B. H., Gibbons, A. S., & Ni, Y. (2001). Review of web-based assessment tools. In B. H. Khan (Ed.), Web-based training (pp. 287–295). Englewood Cliffs, NJ: Educational Technology Publications.
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Sluijsmans, D.M.A., Prins, F.J. & Martens, R.L. The Design of Competency-Based Performance Assessment in E-Learning. Learning Environ Res 9, 45–66 (2006). https://doi.org/10.1007/s10984-005-9003-3
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s10984-005-9003-3