Abstract
Background
Before the 1970s, research into the development of clinical competence was mainly focused on general problem-solving abilities. The scope of research changed when Elstein and colleagues discovered that individual ability to solve clinical problems varies considerably across cases. It was concluded that problem solving abilities are highly dependent on domain-specific knowledge rather than on general problem solving skills. Elstein called this phenomenon “case specificity.”
Purpose
The finding of content specificity will be contrasted with the existence of a general clinical problem solving ability, and the relationship between preclinical knowledge and a problem solving ability will be investigated.
Methods
A correlation matrix was calculated with clerkship final scores from 10 disciplines to examine the magnitude of the interrelations. A confirmatory factor analysis was applied to the corresponding covariances using structural equation modeling to investigate whether scores on finals shared any common variance across clerkships. Finally, two additional models were tested to examine the nature of the relationship between preclinical knowledge and problem solving.
Results
Low to moderate correlations across clerkship disciplines were found, supporting the original findings of content specificity. Further investigation showed that in addition to specific knowledge, a general, content-independent ability is needed to perform on these examinations.
Conclusions
Clinical competence, as measured in this study, is based on a combination of specific preclinical knowledge and a problem-solving ability. Case specificity fits perfectly well in this interactional perspective on clinical problem solving but does not explain it. The phenomenon “case specificity” is therefore not solely a result of content knowledge, but of level of experience and level of case difficulty.
Similar content being viewed by others
References
Alexander P.A., Judy J.E., (1988). The interaction of domain-specific and strategic knowledge in academic performance Review of Educational Research 58(4):375–404
Barrows H.S., Norman G.R., Neufeld V.R., Feightner J.W., (1982). The clinical reasoning process of randomly selected physicians in general medical practice Clinical and Investigative Medicine 5:49–56
Barrows H.S., Pickell G.C., (1991). Developing Clinical Problem-solving Skills (1st edn.). New York, London W.W. Norton & Compagny, Inc
Bentler P.M., (2003). EQS (Version 6.1 Beta) [Computer Software] Encino, CA Multivariate Software, Inc
Berner E.S., Bligh T.J., Guerin R.O., (1977). An indication for a process dimension in medical problem solving Medical Education, 11:324–328
Byrne B.M., (2001). Structural Equation Modeling with AMOS: Basic Concepts, Applications, and Programming MahWah, NJ Lawrence Erlbaum Associates
Chi M.T.H., (1985). Changing conception of sources of memory development Human Development 28:50–56
Chi M.T.H., Glaser R., (1985). Problem solving ability In: R. Sternberg (Eds) Human abilities: an information-processing approach San Francisco W.H. Freeman & Co (pp. 227–257)
Chi M.T.H., Glaser R., Rees E., (1982). Expertise in problem solving In: R. Sternberg (Eds) Advances in the psychology of human intelligence Vol. 1. Hillsdale, NJ Erlbaum pp. 7–76
De Champlain A.F., Macmillan M.K., King A.N., Klass D.J., Margolis M.J., (1999). Assessing the impacts of intra-site and inter-site checklist recording discrepancies on the reliability of scores obtained in a nationally administrated standardized patient examination Academic Medicine 74(10):S52–S54
De Graaf E., Post G.J., Drop M.J., (1987). Validation of a new measure of clinical problem-solving. Medical Education21:213–218
Donnelly M.B., Gallagher R.E., Hess J.W. & Hogan M.J. (1974). The dimensionality of measures derived from complex clinical simulations. Paper presented at the Thirteenth Annual Conference on Research in Medical Education, Chicago, IL, USA
Elstein A.S., (1972). Methods and Theory in the Study of Medical Inquiry Cambridge, MA Harvard University Press
Elstein A.S., Schwartz A., (2002). Clinical problem solving and diagnostic decision making: Selective review of cognitive literature British Medical Journal 324:729–732
Elstein A.S., Shulman L.S., Sprafka S.A., (1978). Medical Problem Solving: an Analysis of Clinical Reasoning London, Cambridge, Mass Harvard University Press
Ernst G., Newell A., (1969). GPS: a Case Study in Generality and Problem Solving New York Academic Press
Eva K.W., (2003). On the generality of specificity Medical Education 37:587–588
Eva K.W., Neville A.J., Norman G.R., (1998). Exploring the etiology of content specificity: Factors influencing analogic transfer and problem solving Academic Medicine 73(10 Suppl.):S1–S5
Fitzgerald J.T., Wolf F.M., Davis W.K., Barclay M.L., Bozynski M.E., Chamberlain K.R., et al. (1995). A preliminary study of the impact of case specificity on computer-based assessment of medical student clinical performance Evaluation and the Health Professions 17(3):307–321
Gale J., (1982). Some cognitive components of the diagnostic thinking process British Journal of Educational Psychology 52:64–76
Glaser R., (1984). Education and thinking: The role of knowledge American Psychologist 39:93–104
Hu L.T., Bentler P.M., (1999). Cutoff criteria for fit indexes in covariance structure analysis: Conventional criteria versus new alternatives Structural Equation Modeling 6(1):1–31
Juul D.H., Noe M.J., Nerenberg R.L., (1979). A factor analytic study of branching patient management problems Medical Education 13(3):199–205
Kline R.B., (1998). Principles and Practice of Structural Equation Modeling New York, NY The Guilford Press
McAuliffe W.E., (1978). Studies of process-outcome correlations in medical care evaluations Medical Care 16(11):907–930
McGuire C.H., (1976). Simulation technique in the teaching and testing of problem solving skills Journal of Research in Science Teaching 13(2):89–100
McGuire C.H., Babbott D., (1967). Simulation technique in the measurement of problem-solving skills Journal of Educational Measurement 4:1–10
Mueller R.O. & Hancock G.R. (2004). Evaluating studies that utilize structural equation modeling: guidelines for manuscript reviewers. Paper presented at the Annual Meeting of the American Educational Research Association, April 12–16, San Diego, CA, USA
Muzzin L.J., Hart L., (1985). Oral examinations In: V.R. Neufeld G.R. Norman (Eds) Assessing clinical competence New York Springer-Verlag
Neufeld V.R., Norman G.R., (1985). Assessing Clinical Competence. New York, Springer-Verlag
Neufeld V.R., Norman G.R., Barrows H.S., Feightner J.W., (1981). Clinical problem-solving by medical students: A longitudinal and cross-sectional analysis Medical Education 15:315–322
Newell A., Simon H.A., (1956). The logic theory machine: A complex information processing system Transactions on Information Theory (Institute of Radio Engineers), IT-2(3):61–79
Newell A., Simon H.A., (1972). Human Problem Solving: Englewood Cliffs NJ Prentice-Hall
Norman G.R., (2005). Editorial – checklists vs. ratings, the illusion of objectivity, the demise of skills and the debasement of evidence Advances in Health Sciences Education 10:1–3
Norman G.R., Bordage G., Curry L., (1985). A review of recent innovations in assessment In: R.E. Wakeford (Eds) Directions in clinical assessment Cambridge Cambridge University School of Clinical Medicine pp. 9–27
Norman G.R., Brooks L.R., Allen S.W., (1989). Recall by experts medical practitioners and novices as a record of processing attention Journal of Experimental Psychology; Learning, Memory and Cognition 15:1166–1174
Norman G.R., Tugwell P., Feighter J.W., Muzzin L.J., Jacoby L.L., (1985). Knowledge and clinical problem-solving Medical Education 19:344–356
Patel V.L., Groen G.J., (1986). Knowledge based solution strategies in medical reasoning Cognitive Science 10(1):91–116
Peverly S.T., (1991). Problems with the knowledge-based explanation of memory and development Review of Educational Research 61(1):71–93
Rimoldi H.J.A., (1955). A technique for the study of problem solving Educational and Psychological Measurement 15:450–461
Rimoldi H.J.A., (1961). The test of diagnostic skills Journal of Medical Education 36(1):73–79
Schmidt H.G., Boshuizen H.P.A., (1993). On acquiring expertise in medicine Educational Psychological Review 5(3):205–221
Schmidt H.G., Norman G.R., Boshuizen H.P.A., (1990). A cognitive perspective on medical expertise: Theory and implications Academic Medicine 65(10):611–621
Schuwirth L.W.T., Verheggen M.M., van der Vleuten C.P.M., Boshuizen H.P.A., Dinant G.J., (2001). Do short cases elicit different thinking processes than factual knowledge questions do? Medical Education 35(4):348–356
Simon H.A., (1980). Problem solving and education In: D.T. Tuma, R. Reif (Eds) Problem solving and education: Issues in teaching and research Hillsdale, NJ Erlbaum
Swanson D.B., (1987). A measurement framework for performance-based tests In: I.R. Hart, R.M. Harden (Eds) Further developments in assessing clinical competence Montreal Can-Heal Publications pp. 13–45
Van der Vleuten C.P.M., Swanson D.B., (1990). Assessment of clinical skills with standardized patients: State of the art Teaching and Learning in Medicine 2:58–76
Wimmers P.F. & Kanter S.L. (2006). Expert-novice differences in data-gathering behavior during diagnoses. Paper presented at the Northeast Group on Educational Affairs, March 3–4, Philadelphia, Pennsylvania, USA
Wimmers P.F., Schmidt H.G., Verkoeijen P.P.J.L., van de Wiel M.W.J., (2005). Inducing expertise effects in clinical case recall Medical Education 39(9):949–957
Author information
Authors and Affiliations
Corresponding author
Additional information
This research was presented at the 85th Annual Meeting of the American Educational Research Association (AERA) in San Diego, California, USA, April 12–16, 2004, with the title: How content specific is clinical competence? It received the Best Paper by an Established Investigator Award from AERA’s Division I Awards Committee.
Rights and permissions
About this article
Cite this article
Wimmers, P.F., Splinter, T.A., Hancock, G.R. et al. Clinical Competence: General Ability or Case-specific?. Adv Health Sci Educ Theory Pract 12, 299–314 (2007). https://doi.org/10.1007/s10459-006-9002-x
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s10459-006-9002-x