Skip to main content

Advertisement

Log in

The Design of Competency-Based Performance Assessment in E-Learning

  • Published:
Learning Environments Research Aims and scope Submit manuscript

Abstract

This article focuses on the design of competency-based performance assessment in e-learning. Though effort has been invested in designing powerful e-learning environments, relatively little attention has been paid to the design of valid and reliable assessments in such environments, leaving many questions to educational developers and teachers. As a solution to this problem, a systematic approach to designing performance assessments in e-learning contexts is presented, partly based on the 4C/ID model. This model enables the construction of realistic whole tasks instead of advocating education that is restricted to more isolated skills. A new assessment procedure also implies an alternative view of instructional design, learning and assessment. The requirements for the learning environment are addressed. Examples from a virtual seminar are presented to illustrate the design approach. The article concludes with the identification of possible pitfalls related to the approach and gives directions for future research.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Similar content being viewed by others

References

  • American Educational Research Association, American Psychological Association, & National Council on Measurement in Education. (1999). Standards for educational and psychological testing. Washington, DC: American Educational Research Association.

    Google Scholar 

  • Baker, E. L., & Mayer, R. E. (1999). Computer-based assessment of problem solving. Computers in Human Behavior, 15, 269–282.

    Article  Google Scholar 

  • Bastiaens, Th., & Martens, R. (2000). Conditions for web-based learning with real events. In B. Abbey (Ed.), Instructional and cognitive impacts of web-based education (pp. 1–32). Hershey/London: Idea Group Publishing.

    Google Scholar 

  • Beijaard, D., Verloop, N., Wubbels, Th., & Feiman-Nemser, S. (2000). The professional development of teachers. In R. J. Simons, J. van der Linden, & T. Duffy (Eds.), New learning (pp. 261–274). Dordrecht, The Netherlands: Kluwer.

    Google Scholar 

  • Bennett, R. E. (1999). Using new technology to improve assessment. Educational Measurement: Issues and Practice, 18, 5–12.

    Article  Google Scholar 

  • Biggs, J. (1996). Enhancing teaching through constructive alignment. Higher Education, 32, 347–364.

    Article  Google Scholar 

  • Birenbaum, M. (2003). New insights into learning and teaching and their implications for assessment. In M. Segers, F. Dochy, & E. Cascallar (Eds.), Optimising new modes of assessment: In search of qualities and standards (pp. 13–36). Dordrecht, The Netherlands: Kluwer.

    Chapter  Google Scholar 

  • Crooks, T. J., Kane, M. T., & Cohen, A. S. (1996). Threats to the valid use of assessments. Assessment in Education, 3, 265–285.

    Article  Google Scholar 

  • Dierick, S., van de Watering, G., & Muijtjens, A. (2002). De actuele kwaliteit van assessment: Ontwikkelingen in de edumetrie [Current quality in assessment: Developments in edumetrics]. In F. Dochy, L. Heylen, & H. van de Mosselaer (Eds.), Assessment in onderwijs: Nieuwe toetsvormen en examinering in het studentgericht onderwijs en competentiegericht onderwijs [Assessment in education: New modes of assessment in student-centred and competency-based education] (pp. 91–122). Utrecht, The Netherlands: Lemma.

  • Furrer, C., & Skinner, E. (2003). Sense of relatedness as a factor in children's academic engagement and performance. Journal of Educational Psychology, 95, 148–162.

    Article  Google Scholar 

  • Garris, G., Ahlers, R., & Driskell, J. (2002). Games, motivation, and learning. S imulation & Gaming, 33, 441–467.

    Article  Google Scholar 

  • Gick, M., & Holyoak, K. J. (1983). Schema induction and analogical transfer. Cognitive Psychology, 15, 1–38.

    Article  Google Scholar 

  • Gulikers, J., Bastiaens, Th., & Martens, R. (2005). The surplus value of an authentic learning environment. Computers in Human Behavior, 21, 509–521.

    Article  Google Scholar 

  • Herman, J. L., Aschbacher, P. R., & Winters, L. (1992). A practical guide to alternative assessment. Alexandria, VA: Association for Supervision and Curriculum Development.

    Google Scholar 

  • Jochems, W., van Merriënboer, J., & Koper, R. (2004). Integrated e-learning: Implications for pedagogy, technology & organization. London: RoutledgeFalmer.

    Google Scholar 

  • Johnston, B. (2004). Summative assessment of portfolios: An examination of different approaches to agreement over outcomes. Studies in Higher Education, 29, 395–412.

    Article  Google Scholar 

  • Linn, R. L., Baker, E. L., & Dunbar, S. B. (1991). Complex, performance-based assessment: Expectations and validation criteria. Educational Researcher, 20(8), 15–21.

    Google Scholar 

  • Lockwood, F. (1995). Students' perception of, and response to, formative and summative assessment material. In F. Lockwood (Ed.), Open and distance learning today (pp. 197–207). London: Routledge.

    Google Scholar 

  • Martens, R. L. (1998). The use and effects of embedded support devices in independent learning (PhD thesis). Utrecht, The Netherlands: Lemma BV.

  • Mayer, R. E. (2002). A taxonomy for computer-based assessment of problem solving. Computers in Human Behavior, 18, 623–632.

    Article  Google Scholar 

  • Mehrens, W. A., Popham, W. J., & Ryan, J. M. (1998). How to prepare students for performance assessments. Educational Measurement: Issues and Practice, 17, 18–22.

    Article  Google Scholar 

  • Mudrack, P. E., & Farrell, G. M. (1995). An examination of functional role behaviour and its consequences for individuals in group settings. Small Group Research, 26, 542–571.

    Article  Google Scholar 

  • Nijhuis, J. F. H., Segers, M. S. R., & Gijselaers, W. H. (2005). Influence of redesigning a learning environment on student perceptions and learning strategies. Learning Environments Research, 8, 67–93.

    Article  Google Scholar 

  • Nystrand, M., Cohen, A. S., & Dowling, N. M. (1993). Addressing reliability problems in the portfolio assessment of college writing. Educational Assessment, 1, 53–70.

    Article  Google Scholar 

  • O'Neil, H. F. (2002). Perspectives on computer-based performance assessment of problem solving. Computers in Human Behavior, 15, 255–268.

    Article  Google Scholar 

  • Paas, F. G. W. C., & van Merriënboer, J. J. G. (1994). Variability of worked examples and transfer of geometrical problem solving skills: A cognitive load approach. Journal of Educational Psychology, 86, 122–133.

    Article  Google Scholar 

  • Pitts, J., Coles, C., & Thomas, P. (2001). Enhancing reliability in portfolio assessment: ‘Shaping’ the portfolio. Medical Teacher, 23, 351–365.

    Article  PubMed  Google Scholar 

  • Prins, F. J., Sluijsmans, D. M. A., Kirschner, P. A., & Strijbos, J. W. (2005). Formative peer assessment in a CSCL environment: A case study. Assessment and Evaluation in Higher Education, 30, 417–444.

    Article  Google Scholar 

  • Quellmalz, E. (1991). Developing criteria for performance assessments: The missing link. Applied Measurement in Education, 4, 319–332.

    Article  Google Scholar 

  • Reeves, T. C. (2000). Alternative assessment approaches for online learning environments in higher education. Journal of Educational Computing Research, 23, 101–111.

    Article  Google Scholar 

  • Ryan, R. M., & Deci, E. L. (2000). Self-determination theory and the facilitation of intrinsic motivation, social development, and well being. American Psychologist, 55, 68–78.

    Article  PubMed  Google Scholar 

  • Segers, M., & Dierick, S. (2001). Quality Standards for new modes of assessment: An exploratory study of the consequential validity of the OverAll test. European Journal of Psychology of Education, 16, 569–588.

    Article  Google Scholar 

  • Shavelson, R. J. (1991). Performance assessment in science. Applied Measurement in Education, 4, 347–362.

    Article  Google Scholar 

  • Sluijsmans, D. M. A. (2002). Student involvement in assessment: The training of peer assessment skills. Unpublished doctoral dissertation, Open University of The Netherlands, Heerlen, The Netherlands.

  • Sluijsmans, D., Moerkerke, G., Dochy, F., & van Merriënboer, J. (2001). Peer assessment in problem based learning. Studies in Educational Evaluation, 27, 153–173.

    Article  Google Scholar 

  • Snyder, B. (1973). The hidden curriculum. Cambridge, MA: The MIT Press.

    Google Scholar 

  • Straetmans, G. J. J. M., & Sanders, P. F. (2001). Beoordelen van competenties van docenten [Assessment of competencies of teachers]. Den Haag, The Netherlands: Programmamanagement ESP/HBO-raad.

  • Stiggins, R. (1987). Design and development of performance assessment. Educational Measurement: Issues and Practice, 6, 33–42.

    Article  Google Scholar 

  • Stoof, A., Martens, R., van Merriënboer, J., & Bastiaens, Th. (2002). The boundary approach of competence: A constructivist aid for understanding and using the concept of competence. Human Resource Development Review, 1, 345–365.

    Article  Google Scholar 

  • Strijbos, J. W., Kirschner, P. A., & Martens, R. L. (Eds.). (2004). What we know about CSCL in higher education. Dordrecht, The Netherlands: Kluwer.

  • Strijbos J. W., Martens, R. L., & Jochems, W. M. G. (2004). Designing for interaction: Six steps to designing computer supported group based learning. Computers & Education, 42, 403–424.

    Article  Google Scholar 

  • Surgue, B. (2002). Performance-based instructional design for e-learning. Performance Improvement, 41, 45–50.

    Google Scholar 

  • Van Merriënboer, J. J. G. (1997). Training complex cognitive skills. Englewood Cliffs, NJ: Educational Technology Publications.

    Google Scholar 

  • Van Merriënboer, J. J. G., Jelsma, O., & Paas, F. G. W. C. (1992). Training for reflective expertise: A four-component instructional design model for training complex cognitive skills. Educational Technology, Research and Development, 40, 23–43.

    Article  Google Scholar 

  • Van Merriënboer, J. J. G., & Martens, R. L. (2002). Computer-based tools for instructional design. Educational Technology, Research and Development, 50, 5–9.

    Article  Google Scholar 

  • Wiggins, G. (1989). A true test: Toward a more authentic and equitable assessment. Phi Delta Kappan, 70, 703–713.

    Google Scholar 

  • Zhang, J., Khan, B. H., Gibbons, A. S., & Ni, Y. (2001). Review of web-based assessment tools. In B. H. Khan (Ed.), Web-based training (pp. 287–295). Englewood Cliffs, NJ: Educational Technology Publications.

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Dominique M. A. Sluijsmans.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Sluijsmans, D.M.A., Prins, F.J. & Martens, R.L. The Design of Competency-Based Performance Assessment in E-Learning. Learning Environ Res 9, 45–66 (2006). https://doi.org/10.1007/s10984-005-9003-3

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s10984-005-9003-3

Keywords

Navigation