Skip to main content

Part of the book series: Mathematics Teacher Education ((MTEN,volume 8))

Abstract

Teachers apply their diagnostic skills when grading students’ work as well as when preparing lessons and monitoring students’ understanding during the learning process. Previous research on teachers’ diagnostic skills has focused on teachers at elementary level. Drawing on a large German sample of mathematics teachers at secondary level, this chapter empirically addresses three key questions on teachers’ diagnostic skills (depending on the research question, the number of teachers with valid data varied between n=155 and n=331). The results showed that (a) the accuracy of teachers’ judgments of their classes’ achievement level, distribution of achievement, and motivation is relatively low, (b) diagnostic skills do not represent a one-dimensional but a multidimensional construct, and (c) teachers’ diagnostic skills (in terms of tasks-related judgment error and diagnostic sensitivity) have a positive influence on their students’ achievement gains in mathematics. Training and fostering teachers’ diagnostic skills seems thus to be highly relevant for the valid assignment of grades and for student progress.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 129.00
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 169.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info
Hardcover Book
USD 169.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Notes

  1. 1.

    The class mean score on the effort scale (see Ramm et al. 2006) of the national PISA student questionnaire was used as a class-specific indicator of motivation in mathematics. A sample item from this scale is “In mathematics I make a real effort to understand everything.”

  2. 2.

    Different judgment tendencies may thus result in the same judgment error scores. A teacher who overestimates the achievement level of her class by one point will have the same judgment error score as a teacher who underestimates the performance level of her class by one point.

References

  • Anders Y, Kunter M, Brunner M, Krauss S, Baumert J (2010) Diagnostische Fähigkeiten von Mathematiklehrkräften und ihre Auswirkungen auf die Leistungen ihrer Schülerinnen und Schüler [Mathematics teachers’ diagnostic skills and their impact on students’ achievements]. Psychologie in Erziehung und Unterricht 3:175–192. doi:10.2378/peu2010.art13d

    Google Scholar 

  • Artelt C, Gräsel C (2009) Diagnostische Kompetenz von Lehrkräften. Gasteditorial [Diagnostic competence of teachers. Guest editorial]. Zeitschrift für Pädagogische Psychologie 23:157–160. doi:10.1024/1010-0652.23.34.157

    Article  Google Scholar 

  • Artelt C, Stanat P, Schneider W, Schiefele U (2001) Lesekompetenz: Testkonzeption und Ergebnisse [Reading literacy: test design and results]. In: Baumert J, Klieme E, Neubrand M, Prenzel M, Schiefele U, Schneider W, … Weiß M (eds) PISA 2000: Basiskompetenzen von Schülerinnen und Schülern im internationalen Vergleich. Leske + Budrich, Opladen, pp 69–137

    Google Scholar 

  • Baumert J, Artelt C (2002) Bereichsübergreifende Perspektiven [Cross-domain perspectives]. In: Baumert J, Artelt C, Klieme E, Neubrand M, Prenzel M, Schiefele U, … Weiß M (eds) PISA 2000: Die Länder der Bundesrepublik Deutschland im Vergleich. Leske + Budrich, Opladen, pp 219–236

    Google Scholar 

  • Baumert J, Kunter M (2006) Stichwort: Professionelle Kompetenz von Lehrkräften [Teachers’ professional competence]. Zeitschrift für Erziehungswissenschaft 9:469–520. doi:10.1007/s11618-006-0165-2

    Article  Google Scholar 

  • Baumert J, Trautwein U, Artelt C (2003) Schulumwelten – institutionelle Bedingungen des Lehrens und Lernens [School environments: institutional conditions of teaching and learning]. In: Baumert J, Artelt C, Klieme E, Neubrand M, Prenzel M, Schiefele U, … Weiß M (eds) PISA 2000: Ein differenzierter Blick auf die Länder der Bundesrepublik Deutschland. Leske + Budrich, Opladen, pp 261–332

    Google Scholar 

  • Baumert J, Kunter M, Blum W, Brunner M, Voss T, Jordan A, … Tsai Y-M (2010) Teachers’ mathematical knowledge, cognitive activation in the classroom, and student progress. Am Educ Res J 47:133–180. doi:10.3102/0002831209345157

    Google Scholar 

  • Chen S, Chaiken S (1999) The heuristic-systematic model in its broader context. In: Chaiken S, Trope Y (eds) Dual process theories in social psychology. Guilford, New York, pp 73–96

    Google Scholar 

  • Cohen J, Cohen P, West SG, Aiken LS (2003) Applied multiple regression/correlation analysis for the behavioral sciences, 3rd edn. Erlbaum, Mahwah

    Google Scholar 

  • Corno L, Snow RE (1986) Adapting teaching to individual differences among learners. In: Wittrock MC (ed) Handbook of research on teaching, 3rd edn. Macmillan, New York, pp 605–629

    Google Scholar 

  • Demaray MK, Elliot SN (1998) Teachers’ judgments of students’ academic functioning: a comparison of actual and predicted performances. School Psychol Q 13:8–24. doi:10.1037/h0088969

    Article  Google Scholar 

  • Dünnebier K, Gräsel C, Krolak-Schwerdt S (2009) Urteilsverzerrungen in der schulischen Leistungsbeurteilung: Eine experimentelle Studie zu Ankereffekten [Biases in teachers’ assessments of student performance: an experimental study of anchoring effects]. Zeitschrift für Pädagogische Psychologie 23:187–195. doi:10.1024/1010-0652.23.34.187

    Article  Google Scholar 

  • Feinberg AB, Shapiro ES (2003) Accuracy of teacher judgements in predicting oral reading ­fluency. School Psychol Q 18:52–65. doi:10.1521/scpq.18.1.52.20876

    Article  Google Scholar 

  • Fisher CW, Filby N, Marliave R, Cahen LS, Dishaw MM, Moore J (1978) Teaching behaviors, academic learning time, and student achievement: final report of phase III-B, Beginning Teacher Evaluation Study. Far West Laboratory, San Francisco

    Google Scholar 

  • Hachfeld A, Anders Y, Schroeder S, Stanat P, Kunter M (2010) Does immigration background matter? How teachers’ predictions of students’ performance relate to student background. Int J Educ Res 49:78–91. doi:10.1016/j.ijer.2010.09.002

    Article  Google Scholar 

  • Helmke A (2003) Unterrichtsqualität erfassen, bewerten, verbessern [Measuring, evaluating, and improving instructional quality]. Kallmeyersche Verlagsbuchhandlung, Seelze

    Google Scholar 

  • Helmke A, Schrader F-W (1987) Interactional effects of instructional quality and teacher judgement accuracy on achievement. Teach Teach Educ 3(2):91–98. doi:10.1016/0742-051X(87)90010-2

    Article  Google Scholar 

  • Helmke A, Hosenfeld I, Schrader F-W (2004) Vergleichsarbeiten als Instrument zur Verbesserung der Diagnosekompetenz von Lehrkräften [State-wide assessments as an instrument to improve teachers’ diagnostic skills]. In: Arnold R, Griese C (eds) Schulleitung und Schulentwicklung. Schneider Verlag Hohengehren, Baltmannsweiler, pp 119–144

    Google Scholar 

  • Hill CJ, Bloom HS, Black AR, Lipsey MW (2008) Empirical benchmarks for interpreting effect sizes in research. Child Dev Perspect 2:172–177. doi:10.1111/j.1750-8606.2008.00061.x

    Article  Google Scholar 

  • Hoge RD, Coladarci T (1989) Teacher-based judgments of academic achievement: a review of the literature. Rev Educ Res 59(3):297–313. doi:10.3102/00346543059003297

    Google Scholar 

  • Hosenfeld I, Helmke A, Schrader F-W (2002) Diagnostische Kompetenz: Unterrichts- und lernrelevante Schülermerkmale und deren Einschätzung durch Lehrkräfte in der Unterrichtsstudie SALVE [Diagnostic skills: student characteristics relevant to teaching and learning and their evaluation by teachers in the SALVE study]. Zeitschrift für Pädagogik 45 Beiheft:65–82

    Google Scholar 

  • Karing C (2009) Diagnostische Kompetenz von Grundschul- und Gymnasiallehrkräften im Leistungsbereich und im Bereich Interessen [Diagnostic competence of elementary and secondary school teachers in the domains of competence and interests]. Zeitschrift für Pädagogische Psychologie 23:197–209. doi:10.1024/1010-0652.23.34.197

    Article  Google Scholar 

  • KMK – Secretariat of the Standing Conference of the Ministers of Education and Cultural Affairs of the Länder in the Federal Republic of Germany (2004) Standards für die Lehrerbildung: Bildungswissenschaften. Beschluss der Kultusministerkonferenz vom 16.12.2004 [Standards for teacher training: educational science. KMK resolution of 16.12.2004]. Retrieved from http://www.kmk.org/fileadmin/veroeffentlichungen_beschluesse/2004/2004_12_16-­Standards-Lehrerbildung.pdf

  • Krolak-Schwerdt S, Böhmer M, Gräsel C (2009) Verarbeitung von schülerbezogener Information als zielgeleiteter Prozess. Der Lehrer als „flexibler Denker“ [Goal-directed processing of students’ attributes: the teacher as “flexible thinker”]. Zeitschrift für Pädagogische Psychologie 23:175–186. doi:10.1024/1010-0652.23.34.175

    Article  Google Scholar 

  • Kunter M, Brunner M, Baumert J, Klusmann U, Krauss S, Blum W, … Neubrand M (2005) Der Mathematikunterricht der PISA-Schülerinnen und -Schüler: Schulformunterschiede in der Unterrichtsqualität [Quality of mathematics instruction across school types: findings from PISA 2003]. Zeitschrift für Erziehungswissenschaft 8:502–520. doi:10.1007/s11618-005-0156-8

    Google Scholar 

  • Kunter M, Klusmann U, Dubberke T, Baumert J, Blum W, Brunner M, … Tsai Y-M (2007) Linking aspects of teacher competence to their instruction: results from the COACTIV project. In: Prenzel M (ed) Studies on the educational quality of schools: the final report on the DFG Priority Programme. Waxmann, Münster, pp 39–59

    Google Scholar 

  • Lehmann RH, Peek R, Gänsfuß R, Lutkat S, Mücke S, Barth I (2000) Qualitätsuntersuchungen an Schulen zum Unterricht in Mathematik (QuaSUM) [Evaluations of instructional quality in mathematics (QuaSUM)]. Ministerium für Bildung, Jugend und Sport des Landes Brandenburg (MBJS), Potsdam

    Google Scholar 

  • Lorenz C, Artelt C (2009) Fachspezifität und Stabilität diagnostischer Kompetenz von Grundschullehrkräften in den Fächern Deutsch und Mathematik [Domain specificity and stability of diagnostic competence among primary school teachers in the school subjects of German and mathematics]. Zeitschrift für Pädagogische Psychologie 23:211–222. doi:10.1024/1010-0652.23.34.211

    Article  Google Scholar 

  • McDonald RP (1981) The dimensionality of tests and items. Br J Math Stat Psychol 34:100–117

    Article  Google Scholar 

  • McElvany N, Schroeder S, Hachfeld A, Baumert J, Richter T, Schnotz W, … Ullrich M (2009) Diagnostische Fähigkeiten von Lehrkräften bei der Einschätzung von Schülerleistungen und Aufgabenschwierigkeiten bei Lernmedien mit instruktionalen Bildern [Teachers’ diagnostic skills to judge student performance and task difficulty when learning materials include instructional pictures]. Zeitschrift für Pädagogische Psychologie 23:223–235. doi:10.1024/1010-0652.23.34.223

    Google Scholar 

  • Meisels SJ, Bickel DD, Nicholson J, Xue Y, Atkins-Burnett S (2001) Trusting teachers’ judgments: a validity study of a curriculum-embedded performance assessment in kindergarten to grade 3. Am Educ Res J 38:73–95. doi:10.3102/00028312038001073

    Article  Google Scholar 

  • National Board for Professional Teaching Standards (2002) What teachers should know and be able to do. National Board for Professional Teaching Standards, Arlington

    Google Scholar 

  • National Council of Teachers of Mathematics (2000) Principles and standards for school mathematics. NCTM, Reston

    Google Scholar 

  • Pintrich PR, Marx RW, Boyle RA (1993) Beyond cold conceptual change: the role of motivational beliefs and classroom contextual factors in the process of conceptual change. Rev Educ Res 63:167–199

    Google Scholar 

  • Ramm G, Prenzel M, Baumert J, Blum W, Lehmann R, Leutner D, … Schiefele U (eds) (2006) PISA 2003: Dokumentation der Erhebungsinstrumente [PISA 2003: documentation of study instruments]. Waxmann, Münster

    Google Scholar 

  • Raudenbush SW, Bryk AS (2002) Hierarchical linear models, 2nd edn. Sage, Thousand Oaks

    Google Scholar 

  • Schrader F-W (1989) Diagnostische Kompetenzen von Lehrern und ihre Bedeutung für die Gestaltung und Effektivität des Unterrichts [Teachers’ diagnostic skills and their meaning for the delivery and effectiveness of instruction]. Lang, Frankfurt am Main

    Google Scholar 

  • Schrader F-W (2009) Anmerkungen zum Themenschwerpunkt Diagnostische Kompetenz von Lehrkräften [The diagnostic competence of teachers]. Zeitschrift für Pädagogische Psychologie 23:237–245. doi:10.1024/1010-0652.23.34.237

    Article  Google Scholar 

  • Shulman LS (1987) Knowledge and teaching: foundations of the new reform. Harv Educ Rev 57:1–22

    Google Scholar 

  • Spinath B (2005) Akkuratheit der Einschätzung von Schülermerkmalen durch Lehrer und das Konstrukt der diagnostischen Kompetenz [Accuracy of teacher judgments of student characteristics and the construct of diagnostic competence]. Zeitschrift für Pädagogische Psychologie 19:85–95. doi:10.1024/1010-0652.19.12.85

    Article  Google Scholar 

  • Tent L (2001) Zensuren [Grades]. In: Rost DH (ed) Handwörterbuch Pädagogische Psychologie, 2nd edn. Belz PVU, Weinheim, pp 805–811

    Google Scholar 

  • Tymms P (2004) Effect sizes in multilevel models. In: Schagen I, Elliot K (eds) But what does it mean? The use of effect sizes in educational research. National Foundation for Educational Research, London, pp 55–66

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Martin Brunner .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2013 Springer Science+Busine0ss Media New York

About this chapter

Cite this chapter

Brunner, M., Anders, Y., Hachfeld, A., Krauss, S. (2013). The Diagnostic Skills of Mathematics Teachers. In: Kunter, M., Baumert, J., Blum, W., Klusmann, U., Krauss, S., Neubrand, M. (eds) Cognitive Activation in the Mathematics Classroom and Professional Competence of Teachers. Mathematics Teacher Education, vol 8. Springer, Boston, MA. https://doi.org/10.1007/978-1-4614-5149-5_11

Download citation

Publish with us

Policies and ethics