Swipe om te navigeren naar een ander artikel
The online version of this article (https://doi.org/10.1007/s10608-018-9908-7) contains supplementary material, which is available to authorized users.
We report on two approaches to addressing the problem of low reliability in the assessment of therapist competence in cognitive therapy (CT). In Study 1, we utilized ratings of a session from each of six therapists and investigated how CT experts evaluate specific therapist behaviors in making ratings on the Cognitive Therapy Scale (CTS). Departures from the consensus on judgments of these therapist behaviors were associated with more discrepant competence ratings. We take these results to suggest that, at least among experts, providing greater clarity about which therapist behaviors are relevant to each CTS item may enhance reliability. In Study 2, we utilize a sample of 14 therapists and pilot test a standardized assessment of therapist competence. The standardized assessment exhibited an intra-class correlation coefficient of 0.89 for a single rater. Standardized assessments of competence were related to four measures of therapist experience and qualifications, whereas the CTS was only related to two of these measures. With these promising initial results, we encourage future research to examine the predictive validity of standardized competence assessments in CT.
Log in om toegang te krijgen
Met onderstaand(e) abonnement(en) heeft u direct toegang:
Academy of Cognitive Therapy. (2018). Certification: Certification process. Retrieved from http://www.academyofct.org/.
Baldwin, S. A., & Imel, Z. E. (2013). Therapist effects: Findings and methods. In M. E. Lambert (Ed.), Bergin and Garfield’s handbook of psychotherapy and behavior change (6th ed., pp. 258–297). New York: Wiley.
Beck, A. T., Rush, A. J., Shaw, B. F., & Emery, G. (1979). Cognitive therapy of depression. New York: Guilford.
Beck Institute for Cognitive Behavior Therapy. (2018). Cognitive Therapy Scale rating manual. Retrieved from https://www.beckinstitute.org/wp-content/uploads/2015/10/CTRS-current-10-2011-Cognitive-Therapy-Rating-Scale-2.pdf.
Beck Institute for Cognitive Behavior Therapy. (2018). Cognitive Therapy Rating Scale. Retrieved from https://www.beckinstitute.org/wp-content/uploads/2015/10/CTRS-12-2011_portrait-Cognitive-Therapy-Rating-Scale-1.pdf.
Branson, A., Shafran, R., & Myles, P. (2015). Investigating the relationship between competence and patient outcome with CBT. Behaviour Research and Therapy, 68, 19–26. https://doi.org/10.1016/j.brat.2015.03.002. CrossRefPubMed
Cohen, J., Cohen, P., West, S. G., & Aiken, L. S. (2003). Applied multiple correlation/regression analysis for the behavioral sciences. Mahwah, NJ: Lawrence Erlbaum.
DeRubeis, R. J., Brotman, M. A., & Gibbons, C. J. (2005). A conceptual and methodological analysis of the nonspecifics argument. Clinical Psychology: Science and Practice, 12, 174–183. https://doi.org/10.1093/clipsy.bpi022.
DeRubeis, R. J., Gelfand, L. A., German, R. E., Fournier, J. C., & Forand, N. R. (2013). Understanding processes of change: How some patients reveal more than others—And some groups of therapists less—About what matters in psychotherapy. Psychotherapy Research, 24, 419–428. https://doi.org/10.1080/10503307.2013.838654. CrossRefPubMedPubMedCentral
DeRubeis, R. J., Hollon, S. D., Amsterdam, J. D., Shelton, R. C., Young, P. R., Salomon, R. M., … Gallop, R. (2005). Cognitive therapy vs medications in the treatment of moderate to severe depression. Archives of General Psychiatry, 62, 409–416. https://doi.org/10.1001/archpsyc.62.4.409. CrossRefPubMed
Dobson, K. S., Shaw, B. F., & Vallis, T. M. (1985). Reliability of a measure of quality of cognitive therapy. British Journal of Clinical Psychology, 24, 295–300. https://doi.org/10.1111/j.2044-8260.1985.tb00662.x. CrossRefPubMed
Fairburn, C. G., & Cooper, Z. (2011). Therapist competence, therapy quality, and therapist training. Behaviour Research and Therapy, 49, 373–378. https://doi.org/10.1016/j.brat.2011.03.005. CrossRefPubMedPubMedCentral
Hollon, S. D., Evans, M. D., Auerbach, A., DeRubeis, R. J., Elkin, I., Lowery, A., … Piasecki, J. (1988). Development of a system for rating therapies for depression: Differentiating cognitive therapy, interpersonal psychotherapy and clinical management pharmacotherapy. Unpublished manuscript. Nashville: Vanderbilt University.
Imel, Z. E., Baldwin, S. A., Baer, J. S., Hartzler, B., Dunn, C., Rosengren, D. B., & Atkins, D. C. (2014). Evaluating therapist adherence in motivational interviewing by comparing performance with standardized and real patients. Journal of Consulting and Clinical Psychology, 82, 472–481. https://doi.org/10.1037/a0036158. CrossRefPubMedPubMedCentral
Jacobson, N. S., & Gortner, E. T. (2000). Can depression be de-medicalized in the 21st century: Scientific revolutions, counter-revolutions and the magnetic field of normal science. Behaviour Research and Therapy, 38, 103–117. https://doi.org/10.1016/S0005-7967(99)00029-7. CrossRefPubMed
Lee, I. A., & Preacher, K. J. (2013). Calculation for the test of the difference between two dependent correlations with one variable in common [Computer software]. Available from http://quantpsy.org.
Lilienfeld, S. O., Ammirati, R., & Landfield, K. (2009). Giving debiasing away: Can psychological research on correcting cognitive errors promote human welfare. A Journal of the Association for Psychological Science, 4, 390–398. https://doi.org/10.1111/j.1745-6924.2009.01144.x. PubMed
Littell, R. C., Milliken, G. A., Stroup, W. W., Wolfinger, R. D., & Schabenberger, O. (2006). SAS system for mixed models (2nd ed.). Cary, NC: SAS Institute.
McManus, F., Rakovshik, S., Kennerley, H., Fennell, M., & Westbrook, D. (2012). An investigation of the accuracy of therapists’ self-assessment of cognitive-behaviour therapy skills. British Journal of Clinical Psychology, 51, 292–306. https://doi.org/10.1111/j.2044-8260.2011.02028.x. CrossRefPubMed
Muse, K., & McManus, F. (2016). Expert insight into the assessment of competence in cognitive–behavioural therapy: A qualitative exploration of experts’ experiences, opinions and recommendations. Clinical Psychology & Psychotherapy, 23, 246–259. CrossRef
Newble, D. (2004). Techniques for measuring clinical competence: objective structured clinical examinations. Medical Education, 38, 199e203. https://doi.org/10.1111/j.1365-2923.2004.01755.x. CrossRef
Shaw, B. F., Elkin, I., Yamaguchi, J., Olmstead, M., Vallis, T. M., Dobson, K. S., Lowery, A., … Imber, S. D. (1999). Therapist competence ratings in relation to clinical outcome in cognitive therapy of depression. Journal of Consulting and Clinical Psychology, 67, 837–846. https://doi.org/10.1037/0022-006X.67.6.837. CrossRefPubMed
Sholomskas, D. E., Syracuse-Siewert, G., Rounsaville, B. J., Ball, S. A., Nuro, K. F., & Carroll, K. M. (2005). We don’t train in vain: A dissemination trial of three strategies of training clinicians in cognitive-behavioral therapy. Journal of Consulting and Clinical Psychology, 73, 106–115. https://doi.org/10.1037/0022-006X.73.1.106. CrossRefPubMedPubMedCentral
Shrout, P. E., & Fleiss, J. L. (1979). Intraclass correlations: Uses in assessing rater reliability. Psychological Bulletin, 86, 420–428. https://doi.org/10.1037/0033-2909.86.2.420. CrossRefPubMed
Trepka, C., Rees, A., Shapiro, D. A., Hardy, G. E., & Barkham, M. (2004). Therapist competence and outcome of cognitive therapy for depression. Cognitive Therapy & Research, 28, 143–157. https://doi.org/10.1023/B:COTR.0000021536.39173.66. CrossRef
Vallis, T. M., Shaw, B. F., & Dobson, K. S. (1986). The Cognitive Therapy Scale: Psychometric properties. Journal of Consulting and Clinical Psychology, 54, 381–385. https://doi.org/10.1037/0022-006X.54.3.381. CrossRefPubMed
Waltz, J., Addis, M. E., Koerner, K., & Jacobson, N. S. (1993). Testing the integrity of a psychotherapy protocol: assessment of adherence and competence. Journal of Consulting and Clinical Psychology, 61, 620–630. https://doi.org/10.1037/0022-006X.61.4.620. CrossRefPubMed
- Revisiting How We Assess Therapist Competence in Cognitive Therapy
Iony D. Schmidt
Daniel R. Strunk
Robert J. DeRubeis
Laren R. Conklin
Justin D. Braun
- Springer US