Swipe om te navigeren naar een ander artikel
The online version of this article (doi:10.1007/s11136-015-1175-4) contains supplementary material, which is available to authorized users.
The thentest design aims to detect and control for recalibration response shift. This design assumes (1) more consistency in the content of the cognitive processes underlying patients’ quality of life (QoL) between posttest and thentest assessments than between posttest and pretest assessments; and (2) consistency in the time frame and description of functioning referenced at pretest and thentest. Our objective is to utilize cognitive interviewing to qualitatively examine both assumptions.
We conducted think-aloud interviews with 24 patients with cancer prior to and after radiotherapy to elicit cognitive processes underlying their assessment of seven EORTC QLQ-C30 items at pretest, posttest and thentest. We used an analytic scheme based on the cognitive process models of Tourangeau et al. and Rapkin and Schwartz that yielded five cognitive processes. We subsequently used this input for quantitative analysis of count data.
Contrary to expectation, the number of dissimilar cognitive processes between posttest and thentest was generally larger than between pretest and posttest across patients. Further, patients considered a range of time frames when answering the thentest questions. Moreover, patients’ description at the thentest of their pretest functioning was often not similar to that which was noted at pretest. Items referring to trouble taking a short walk, overall health and QoL were most often violating the assumptions.
Both assumptions underlying the thentest design appear not to be supported by the patients’ cognitive processes. Replacing the conventional pretest–posttest design with the thentest design may simply be replacing one set of biases with another.
Supplementary material 1 (DOCX 30 kb)11136_2015_1175_MOESM1_ESM.docx
Taminiau-Bloem, E. F., van Zuuren, F. J., Koeneman, M. A., Rapkin, B. D., Visser, M. R. M., Koning, C. C. E., & Sprangers, M. A. G. (2010). A ‘short walk’ is longer before radiotherapy than afterwards: A qualitative study questioning the baseline and follow-up design. Health and Quality of Life Outcomes, 8, 69. CrossRefPubMedPubMedCentral
Morak, M. J., Pek, C. J., Kompanje, E. J., Hop, W. C., Kazemier, G., & van Eijck, C. H. (2010). Quality of life after adjuvant intra-arterial chemotherapy and radiotherapy versus surgery alone in resectable pancreatic and periampullary cancer: A prospective randomized controlled study. Cancer, 116(4), 830–836. CrossRefPubMed
Komblith, A. B., Huang, H. Q., Walker, J. L., Spirtos, N. M., Rotmensch, J., & Cella, D. (2009). Quality of life of patients with endometrial cancer undergoing laparoscopic international federation of gynecology and obstetrics staging compared with laparotomy: A Gynecologic Oncology Group study. Journal of Clinical Oncology, 27(32), 5337–5342. CrossRef
Groenvold, M., Fayers, P. M., Petersen, M. A., & Mouridsen, H. T. (2006). Chemotherapy versus ovarian ablation as adjuvant therapy for breast cancer: Impact on health-related quality of life in a randomized trial. Breast Cancer Research, 98(3), 275–284. CrossRef
Weeks, J. C., Nelson, H., Gelber, S., Sargent, D., Schroeder, G., & for the Clinical Outcomes of Surgical Therapy (COST) Study Group. (2003). Short-term quality-of-life outcomes following laparoscopic-assisted colectomy vs open colectomy for colon cancer. JAMA, 287(3), 321–328. CrossRef
Howard, G. S., Ralph, K. M., Gulanick, N. A., Maxwell, S. E., Nance, S. W., & Gerber, S. K. (1979). Internal invalidity in pretest-posttest self-report evaluations and a re-evaluation of retrospective pretests. Applied Psychological Measurement, 3(1), 1–23. CrossRef
Westerman, M. J., The, A. M., Sprangers, M. A. G., Groen, H. J. M., van der Wal, G., & Hak, T. (2007). Small-cell lung cancer patients are just ‘a little bit’ tired: Response shift and self-presentation in the measurement of fatigue. Quality of Life Research, 16(5), 853–861. CrossRefPubMedPubMedCentral
Tourangeau, R., Rips, L. J., & Rasinski, K. (2000). The psychology of survey response. New York: Cambridge University Press. CrossRef
Taminiau-Bloem, E. F., Van Zuuren, F. J., Visser, M. R., Tishelman, C., Schwartz, C. E., Koeneman, M. A., et al. (2011). Opening the black box of cancer patients’ quality-of-life change assessments: A think-aloud study examining the cognitive processes underlying responses to transition items. Psychology and Health, 26(11), 1414–1428. CrossRefPubMed
Hak, T., van der Veer, K., Jansen, H. (2002). The three- step test- interview (TSTI): An observational instrument for pre- testing self- completion questionnaires. Paper for the International Conference on Questionnaire Development, Evaluation and Testing Methods (QDET). Charleston: South Carolina.
Willis, G. B. (2005). Cognitive interviewing: a tool for improving questionnaire design. California: Thousand Oaks.
Sprangers, M., & Hoogstraten, J. (1989). Pretesting effects in retrospective pretest-posttest designs. Journal of Applied Psychology, 74, 265–272. CrossRef
MAXqda (2004). [ www.maxqda.com].
Bowden, J. A. (1996). Phenomenographic research. In J. A. Bowden & E. Walsh (Eds.), Undertaking phenomenographic research: The Warburton symposium. Melbourne: EQARD.
Hill, L. G., & Betz, D. L. (2005). Revisiting the retrospective pretest. American Journal of Evaluation, 26(4), 501–517. CrossRef
Hermann, D. (1995). Reporting current, past and change health status. What we know about distortion. Medical Care, 33(4), 77–88.
- Using a retrospective pretest instead of a conventional pretest is replacing biases: a qualitative study of cognitive processes underlying responses to thentest items
Elsbeth F. Taminiau-Bloem
Carolyn E. Schwartz
Florence J. van Zuuren
Margot A. Koeneman
Mechteld R. M. Visser
Caro C. E. Koning
Mirjam A. G. Sprangers
- Springer International Publishing