Abstract
Objectives
To conduct a systematic review and meta-analysis of the accuracy of self-reported Pap smear and mammography screening compared to medical record.
Methods
About 37 articles were reviewed and accuracy indices of self-report were calculated. Meta-analysis with random effects was used. Study heterogeneity was investigated and meta-regressions were done including in the models those factors that were hypothesized, a priori, to potentially explain heterogeneity.
Results
Pooled sensitivity and specificity for Pap recall were 94.7% (95% confidence interval [CI]; 93.0%–96.4%) and 47.4% (95% CI; 39.0%–55.7%), and for mammography were 94.9% (95% CI; 93.4%–96.4%) and 61.8% (95% CI; 54.1%–69.5%), respectively. There was significant heterogeneity for all indices. Stratifying by the study population source (population versus clinic-based), population characteristics (minority or low socio-economic status versus not), length of recall (within past 12 months versus longer), and expected completeness of the medical record (authors searched radiology or pathology reports of all likely facilities women may have attended, versus studies that did not) did not eliminate heterogeneity.
Conclusions
Women tend to over-report their participation in Pap and mammography screening in a given timeframe. The pooled estimates should be interpreted with caution due to unexplained heterogeneity.
Similar content being viewed by others
References
Parkin DM, Pisani P, Ferlay J (1999) Global cancer statistics. CA Cancer J Clin 49:33–64. doi:10.3322/canjclin.49.1.33
U.S. Preventive Services Task Force (2002) Screening for breast cancer. Agency for Healthcare Research and Quality, Washington, DC
Janerich DT, Hadjimechael O, Schwartz PE et al (1995) The screening histories of women with invasive cervical cancer, Conneticut. Am J Public Health 85:791–794
McCarthy EP, Burns RB, Coughlin SS et al (1998) Mammography use helps to explain differences in breast cancer stage at diagnosis between older black and white women. Ann Intern Med 128:773–775
Maxwell CJ, Bancej CM, Snider J, Vik SA (2001) Factors important in promoting cervical cancer screening among Canadian women: findings from the 1996–97 National Population Health Survey (NPHS). Can J Public Health 92:127–133
Adams EK, Breen N, Joski PJ (2007) Impact of the national breast and cervical cancer early detection program on mammography and Pap test utilization among white, Hispanic and African American women: 1996–2000. Cancer 109:348–358. doi:10.1002/cncr.22353
Centers for Disease Control and Prevention DoCPaC (2004) The National breast and cervical cancer detection program: saving lives through screening. Center for Disease Control and Prevention, Atlanta, GA
Stein AD, Lederman RI, Shea S (1996) Reproducibility of the women’s module of the behavioral risk factor surveillance system questionnaire. Ann Epidemiol 6:47–52. doi:10.1016/1047-2797(95)00092-5
May DS, Trontell AE (1998) Mammography use by elderly women: a methodological comparison of two national data sources. Ann Epidemiol 8:439–444. doi:10.1016/S1047-2797(98)00010-6
Swan J, Breen N, Coates RJ, Rimer BK, Lee NC (2003) Progress in cancer screening practices in the United States: results from the 2000 National Health Interview Survey. Cancer 97:1528–1540. doi:10.1002/cncr.11208
Warnecke RB, Sudman S, Johnson TP, O’Rourke D, David AM, Jobe JB (1997) Cognitive aspects of recalling and reporting health-related events: Papanicolaou smears, clinical breast examinations, and mammograms. Am J Epidemiol 146:982–992
Armstrong K, Long JA, Shea JA (2004) Measuring adherence to mammography screening recommendations among low-income women. Prev Med 38:754–760. doi:10.1016/j.ypmed.2003.12.023
Rauscher GH, Johnson TP, Cho YI, Walk JA (2008) Accuracy of self-reported cancer-screening histories: a meta-analysis. Cancer Epidemiol Biomarkers Prev 17:748–757. doi:10.1158/1055-9965.EPI-07-2629
Vernon SW, Briss P, Tiro JA, Warnecke RB (2004) Some methodologic lessons learned from cancer screening research. Cancer 101:1131–1145. doi:10.1002/cncr.20513
Stange K, Zyzanski SJ, Smith TF et al (1998) How valid are medical records and patient questionnaires for physician profiling and health services research? A comparison with direct observation of patient visits. Med Care 36:851–867. doi:10.1097/00005650-199806000-00009
Newell SA, Girgis A, Sanson-Fisher RW, Savolainen NJ (1999) The accuracy of self-reported health behaviors and risk factors relating to cancer and cardiovascular disease in the general population. Am J Prev Med 17:211–229. doi:10.1016/S0749-3797(99)00069-0
Bossuyt PMM, Reitsma JB, Bruns DE et al (2003) The STARD statement for reporting studies of diagnostic accuracy: explanation and elaboration. Ann Intern Med 138:W1–W12
Saslow D, Runowicz CD, Solomon D et al (2002) American Cancer Society guideline for the early detection of cervical neoplasia and cancer. CA Cancer J Clin 52:346–362
Landis JR, Koch GG (1977) The measurement of observer agreement for categorical data. Biometrics 33:159–174. doi:10.2307/2529310
Barrat A, Cockburn J, Smith D, Redman S (1999) Reliability and validity of women’s recall of mammographic screening. Aust N Z J Public Health 24:79–81. doi:10.1111/j.1467-842X.2000.tb00728.x
Bowman JA, Sanson-Fisher R, Redman S (1997) The accuracy of self-reported Pap smear utilisation. Soc Sci Med 44:969–976. doi:10.1016/S0277-9536(96)00222-5
DiMatteo MR, Robinson JD, Heritage J, Tabbarah M, Fox SA (2003) Correspondence among patients’ self-reports, charts, and audio/videotapes of medical visits. Health Commun 15:393–413. doi:10.1207/S15327027HC1504_02
Etzi S, Lane DS, Grimson R (1994) The use of mammography vans by low-income women. The accuracy of self-reports. Am J Public Health 84:107–109
Martin LM, Leff M, Calonge N, Garrett C, Nelson DE (2000) Validation of self-reported chronic conditions and health services in a managed care population. Am J Prev Med 18:215–218. doi:10.1016/S0749-3797(99)00158-0
McPhee SJ, Nguyen TT, Shema SJ et al (2002) Validation of recall of breast and cervical screening by women in an ethnically diverse population. Prev Med 35:1463–1473. doi:10.1006/pmed.2002.1096
Montano DE, Phillips WR (1995) Cancer screening by primary care physicians: a comparison of rates obtained from physician self-report, patient survey, and chart audit. Am J Public Health 85:795–800
Zapka JG, Bigelow C, Hurley T et al (1996) Mammography use among socioeconomically diverse women. The accuracy of self-report. Am J Public Health 86:1016–1021
Bowman JA, Redman S, Dickinson JA, Gibberd R, Sanson-Fisher RW (1991) The accuracy of Pap smear utilization self-report: a methodological consideration in cervical screening research. Health Serv Res 26:197–207
Newell S, Girgis A, Sanson-Fisher R, Ireland M (2000) Accuracy of patients’ recall of Pap and cholesterol screening. Am J Public Health 90:1431–1435
Eaker S, Adami I, Sparen P (2001) Reasons women do not attend screening for cervical cancer: a population-based study in Sweden. Prev Med 32:491. doi:10.1006/pmed.2001.0844
Walter SD, Clarke EA, Hatcher H, Sitt LW (1988) A comparison of physician and patient reports of Pap smear history. Am J Epidemiol 41:401–410
Boyce JG, Fruchter RG, Romanzi L, Sillman FH, Maiman M (1990) The fallacy of the screening interval for cervical smears. Obstet Gynecol 76:627–632
Fowles JB, Fowler E, Croft C, McCoy CE (1997) Comparing claims data and self-reported data with the medical record for Pap smear rates. Eval Health Prof 20:324–342. doi:10.1177/016327879702000305
Fruchter RG, Rones K, Roth T, Webber CA, Camilien L, Boyce JG (1992) Pap smear histories in a medical clinic: accuracy of patients’ self-reports. NY State J Med 92:421–424
McKenna MT, Speers M, Mallin K, Warnecke R (1992) Agreement between patient self-reports and medical records for Pap smear histories. Am J Prev Health 8:287–291
Pizzaro J, Schneider TR, Salovey P (2002) A source of error in self-reports of Pap test utilization. J Commun Health 27:351–356. doi:10.1023/A:1019888627113
Betz Brown J, Adams ME (1992) Patients as reliable reporters of medical care process. Recall of ambulatory encounter events. Med Care 30:400–411. doi:10.1097/00005650-199205000-00003
Caplan LS, Mandelson MT, Anderson LA (2003a) Validity of self-reported mammography: examining recall and covariates among older women in a health maintenance organization. Am J Epidemiol 157:267–272. doi:10.1093/aje/kwf202
Fulton-Kehoe D, Burg M, Lane DS (1992) Are self-reported dates of mammograms accurate? Public Health Rev 20:233–240
King ES, Rimer BK, Trock B, Balshem A, Angstrom P (1990) How valid are mammography self-reports? Am J Public Health 80:1386–1388
Lawrence VA, DeMoor C, Glenn E (1999) Systematic differences in validity of self-reported mammography behavior: a problem for intergroup comparisons? Prev Med 29:577–580. doi:10.1006/pmed.1999.0575
Thompson B, Taylor V, Goldberg H, Mullen M (1999) Mammography status using patient self-reports and computerized radiology database. Am J Prev Med 17:203–206. doi:10.1016/S0749-3797(99)00068-9
Crane L, Kaplan CP, Bastani R, Schimshaw SCM (1996) Determinants of adherence among health department patients referred for a mammogram. Women Health 24:43–64. doi:10.1300/J013v24n02_03
Caplan LS, McQueen DV, Qualters JR, Leff M, Garrett C, Calonge N (2003b) Validity of women’s self-reports of cancer screening test utilization in a managed care population. Cancer Epidemiol Biomarkers Prev 12:1182–1187
Gordon NP, Hiatt RA, Lampert DI (1993) Concordance of self-reported data and medical record audit for six cancer screening procedures. J Natl Cancer Inst 85:566–570. doi:10.1093/jnci/85.7.566
Hiatt RA, Perez-Stable EJ, Quesenberry C Jr, Sabogal F, Otero-Sabogal R, McPhee SJ (1995) Agreement between self-reported early cancer detection practices and medical audits among Hispanic and non-Hispanic white health plan members in Northern California. Prev Med 24:278–285. doi:10.1006/pmed.1995.1045
McGovern PG, Lurie N, Margolis KL, Slater JS (1998) Accuracy of self-report of mammography and Pap smear in a low-income urban population. Am J Prev Med 14:201–208. doi:10.1016/S0749-3797(97)00076-7
Tumiel-Berhalter LM, Finney MF, Jaen CR (2004) Self-report and primary care medical record documentation of mammograhpy and Pap smear utilization among low-income women. J Natl Med Assoc 96:1632–1639
Sawyer JA, Earp J, Fletcher RH, Daye FF, Wynn TM (1989) Accuracy of women’s self-report of their last Pap smear. Am J Public Health 79:1036–1037
Champion VL, Menon U, Hollinden-McQuillen D, Scott C (1998) Validity of self-reported mammography in low-income African-American women. Am J Prev Med 14:111–117. doi:10.1016/S0749-3797(97)00021-4
Degnan D, Harris R, Ranney J, Quade D, Earp J, Gonzolez J (1992) Measuring the use of mammography: two methods compared. Am J Public Health 82:1386–1388
Norman SA, Localio AR, Zhou L et al (2003) Validation of self-reported screening mammography histories among women with and without breast cancer. Am J Epidemiol 158:264–271. doi:10.1093/aje/kwg136
Johnson CS, Archer J, Campos-Outcalt D (1995) Accuracy of Pap smear and mammogram self-reports in a southwestern Native American tribe. Am J Prev Med 11:360–363
Suarez L, Goldman DA, Weiss NS (1995) Validity of Pap smear and mammogram self-reports in a low-income Hispanic population. Am J Prev Health 11:94–98
Paskett ED, Tatum CM, Mack DW, Hoen H, Douglas Case L, Velez R (1996) Validation of self-reported breast and cervical cancer screening tests among low-income minority women. Cancer Epidemiol Biomarkers Prev 5:721–726
Sudman S, Bradburn NM (1973) Effects of time and memory factors on response in surveys. J Am Stat Assoc 68:805–815. doi:10.2307/2284504
Loftus EF, Klinger MR, Smith KD, Fiedler J (1990) A tale of two questions: benefits of asking more than one question. Public Opin Q 54:330–345. doi:10.1086/269210
Siegel PZ, Qualters JR, Mowery PD, Campostrini S, Leutzinger C, McQueen DV (2001) Subgroup-specific effects of questionnaire wording on population-based estimates of mammography prevalence. Am J Public Health 91:817–820
Reid MC, Lacks MS, Feinstein AR (1995) Use of methodologic standards in diagnostic test research. Getting better but still not good. JAMA 274:645–651. doi:10.1001/jama.274.8.645
Deeks JJ (2001) Systematic reviews in health care. Systematic reviews of evaluations of diagnostic and screening tests. Br Med J 323:157–162. doi:10.1136/bmj.323.7305.157
Funding Source
This was an un-funded study, supported with in-kind contributions from the Department of Family Medicine, McMaster University.
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Howard, M., Agarwal, G. & Lytwyn, A. Accuracy of self-reports of Pap and mammography screening compared to medical record: a meta-analysis. Cancer Causes Control 20, 1–13 (2009). https://doi.org/10.1007/s10552-008-9228-4
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s10552-008-9228-4