Abstract
This study investigates whether mode of administration and the interviewer's age and sex affect results obtained with a commonly used rating scale for symptoms anxiety and depression (HSCL-25). Identical versions of the scale was administered orally by experienced interviewers, either face-to-face or by phone. Another sample received self-administered questionnaires that were completed at home and returned by mail. Subjects were a total of 13,850 Norwegian adults participating in two broad population surveys. Results seem to confirm the standing presumption that in-person interviews are more vulnerable to socially desirable responding (SDR) than self-administered modes: Two to three times as many “probable cases” of psychological distress are identified with the self-administered mode compared to the interview modes. However, the SDR generated by mode of administration apparently occurs in subgroups of respondents not identified by extant measures of social desirability (the Crowne-Marlowe scale, etc.) as being high on SDR: In the present study the young and well-educated respondents appear particularly prone to under-report symptoms with the interview modes. The impact of sex and age of interviewer on symptom reports generally appears weak. However, young male interviewers receive very few symptom reports compared to other interviewers.
Similar content being viewed by others
REFERENCES
Aneshensel, C. S., An. L. Estrada, M. J. Hansell and V. A. Clark: 1987, ‘Social psychological aspects of reporting behavior: Lifetime depressive episode reports’, Journal of Health and Social Behavior 28, pp. 232–246.
Aneshensel, C. S., R. R. Frerichs, V. A. Clark and P. A. Yokopenic: 1982, ‘Measuring depression in the community: A comparison of telephone and personal interviews’, Public Opinion Quarterly 46, pp. 110–121.
Aneshensel, C. S. and P. A. Yokopenic: 1985, ‘Tests for the comparability of a causal model of depression under two conditions of interviewing’, Journal of Personality and Social Psychology 49, pp. 1337–1348.
Aquilono, W. S. and L. A. Lo Sciuto: 1990, ‘Effects of interview mode on self-reported drug use’, Public Opinion Quarterly 54, pp. 362–367.
Baumeister, R. F.: 1982, ‘A self-presentational view of social phenomena’, Psychological Bulletin 91, pp. 3–26.
Borkenau, P. and F. Ostendorf: 1992, ‘Social desirability scales as moderator and suppressor variables’, European Journal of Personality 6, pp. 199–214.
Bremer, B. A. and C. R. McCauley: 1986, ‘Quality-of-life measures: Hospital interview versus home questionnaire’, Health Psychology 5, pp. 171–177.
Bromet, E. J., L. O. Dunn, M. M. Connell and H. C. Schulberg: 1986, ‘Long-term reliability of diagnosing lifetime major depression in a community sample’, Archives of General Psychiatry 43, pp. 435–440.
Brophy, C. J., N. K. Norvell and D. J. Kiluk: 1988, ‘An examination of the factor structure and convergent and discriminant validity of the SCL-90R in an outpatient clinic population’, Journal of Personality Assessment 52, pp. 334–340.
Campbell, A., P. Converse and W. Rodgers: 1976, The Quality of American Life: Perceptions, Evaluations and Satisfaction (Russell Sage, New York).
Cattell, R. B.: 1986, ‘Dodging the third error source: Psychological interpretation and use of given scores’, in R. B. Cattell and R. Johnson (eds.), Functional Psychological Testing: Principles and Instruments (Brunner/Mazel, New York), pp. 496–543.
Central Bureau of Statistics of Norway: 1987, Health Survey 1985 (Norges Offisielle Statistikk B 692) (CBS, Oslo).
Choi, I. C. and G. W. Comstock: 1975, ‘Interviewer effect on responses to a questionnaire relating to mood’, American Journal of Epidemiology 101, pp. 84–92.
Clark, A. and M. J. Friedman: 1983, ‘Factor structure and discriminant validity of the SCL-90 in a veteran pscyhiatric population’, Journal of Personality Assessment 47, pp. 396–404.
Cloninger, C. R., T. R. Przybeck and D. M. Svrakic: 1991, ‘The tridimensional personality questionnaire: U.S. normative data’, Psychological Reports 69, pp. 1047–1057.
Cyr, J. J., M. M. McKenna-Foley and E. Peacock: 1985, ‘Factor structure of the SCL-90R: Is there one?’, Journal of Personality Assessment 49, pp. 571–578.
Davis, C. and M. Cowles: 1989, ‘Automated psychological testing: Method of administration, need for approval, and measures of anxiety’, Educational and Psychological Measurement 49, pp. 311–320.
Derogatis, L. R. and P. A. Cleary: 1977, ‘Factorial invariance across gender for the primary symptom dimensions of the SCL-90’, British Journal of Social and Clinical Psychology 16, pp. 347–356.
Derogatis, L. R., R. S. Lipman, K. Rickels, E. H. Uhlenhuth, and L. Covi: 1974, ‘The Hopkins Symptom Checklist (HSCL): A self-report symptom inventory’, Behavioral Science 19, pp. 1–15.
Dixon, W. J.: 1992. BMDP Statistical Software Manual (University of California Press, Berkeley).
Dohrenwend, B. P.: 1990, ‘The problem of validity in field studies of psychological disorders' revisited’, Psychological Medicine 20, pp. 195–208.
Dohrenwend, B. P., P. E. Shrout, G. Egri and F. S. Mendelsohn: 1980, ‘Nonspecific psychological distress and other dimensions of psychopathology’, Archives of General Psychiatry 37, pp. 1229–1236.
Dressler, W. W. and L. W. Badger: 1985, ‘Epidemiology of depressive symptoms in black communities’, The Journal of Nervous and Mental Diseases 173, pp. 212–220.
Felsman, J. K., F. T. Leong, M. C. Johnson and I. C. Felsman: 1990, ‘Estimates of psychological distress among Vietnamese refugees: Adolescents, unaccompanied minors and young adults’, Social Science and Medicine 31, pp. 1251–1256.
Fenig, S., I. Levav, R. Kohn and N. Yelin: 1993, ‘Telephone vs face-to-face interviewing in a community psychiatric survey’, American Journal of Public Health 83, pp. 896–898.
Fletcher, C. and A. Spencer: 1984, ‘Sex of candidate and sex of interviewer as determinants of self-presentation orientation in interviews: An experimental study’, International Review of Applied Psychology 33, pp. 305–313.
Goldberg, D. P.: 1972, The Detection of Psychiatric Illness by Questionnaire (Oxford University Press, London).
Goldberg, D. P. and V. F. Hillier: 1979, ‘A scaled version of the General Health Questionnaire’, Psychological Medicine 9, pp. 139–145.
Goldberg, D. P., K. Rickels, R. Downing and P. T. Hesbacher: 1976, ‘A comparison of two psychiatric screening tests’, British Journal of Psychiatry 129, pp. 61–67.
Gove, W. R. and M. R. Geerken: 1977, ‘Response bias in surveys of mental health: An empirical investigation’, American Journal of Sociology 82, pp. 1289–1317.
Gove, W. R., J. McCorkel, T. Fain and M. Hughes: 1976, ‘Response bias in community surveys of mental health: Systematic bias or random noise?’, Social Science and Medicine 10, pp. 497–502.
Hansson, L., P. Nettelbladt, L. Borgquist and G. Nordstrom: 1994, ‘Screening for psychiatric illness in primary care. A cross-sectional study in a Swedish health district’, Social Psychiatry and Psychiatric Epidemiology 29, pp. 83–87.
Helzer, J. E., L. N. Robins, J. L. Groughan and A. Welner: 1981, ‘Renard Diagnostic Interview: Its reliability and procedural validity with physicians and lay interviewers’, Archives of General Psychiatry 38, pp. 393–398.
Henderson, A. S., D. G. Byrne and P. Duncan-Jones: 1981, Neurosis and the Social Environment (Academic Press, Sydney).
Herzog, A. R. and W. L. Rodgers: 1988, ‘Interviewing older adults: Mode comparion using data from a face-to-face survey and a telephone survey’, Public Opinion Quarterly 52, pp. 84–99.
Hesbacher, P. T., K. Rickels, R. J. Morris, H. Newman, and H. Rosenfeld: 1980, ‘Psychiatric illness in family practice’, Clinical Psychiatry 41: pp. 6–10.
Hogan, J. W. and H. N. Mookherjee: 1980, ‘A multitrait test of social desirability’, Journal of Social Psychology 111, pp. 307–308.
Holden, R. R. and G. C. Fekken: 1989, ‘Three common social desirability scales: Friends, acquaintances, or strangers?’, Journal of Research in Personality 23, pp. 180–191.
Holmen, J., K. Midthjell, K. Bjartveit, P. F. Hjort, P. G. Lund-Larsen, T. Moum, S. Næss and H. T. Waaler: 1990, The Nord-Trøndelag Health Survey 1984–86: Purpose, Background and Methods (National Institute of Public Health, Verdal).
Hough, R. L., J. A. Landsverk and G. F. Jacobson: 1990, ‘The use of psychiatric screening scales to detect depression in primary care patients’, in C. C. Attkisson and J. M. Zich (eds.), Depression in Primary Care: Screening and Detection (Routledge, New York), pp. 139–155.
Ivanoff, A. and S. J. Jang: 1991, ‘The role of hoplessness and social desirability in predicting suicidal behavior: A study of prison inmates’, Journal of Consulting and Clinical Psychology 59, pp. 394–399.
Jorm, A. F., P. Duncan Jones and R. Scott: 1989, ‘An analysis of the re-test artefact in longitudinal studies of psychiatric symptoms and personality’, Psychological Medicine 19, pp. 487–493.
Jöreskog, K. G. and D. Sörbom: 1993a, Prelis 2 (Scientific Software, Chicago).
Jöreskog, K. G. and D. Sörbom: 1993b, Lisrel 8 (Scientific Software, Chicago).
Kalliopuska, M.: 1992, ‘Social desirability related to social class among adults’, Psychological Reports 70, pp. 808–810.
Kendler, K. S., M. C. Neale, R. C. Kessler, A.C. Heath and L. J. Eaves: 1992a, ‘The genetic epidemiology of phobias in women: the interrelationship of agoraphobia, social phobia, situational phobia and simple phobia’, Archives of General Psychiatry 49, pp. 273–281.
Kendler, K. S., M. C. Neale, R. C. Kessler, A.C. Heath and L. J. Eaves: 1992b, ‘Generalized anxiety disorder in women: A population-based twin study’, Archives of General Psychiatry 49, pp. 267–272.
Kendler, K. S., M. C. Neale, R. C. Kessler, A. C. Heath and L. J. Eaves: 1993, ‘The lifetime history of major depression in women: Reliability of diagnosis and heritability’, American Journal of Psychiatry 50, pp. 863–870.
Kendler, K. S., M. C. Neale, R. C. Kessler, A. C. Heath and L. J. Eaves: 1993, ‘A longitudinal twin study of 1-year prevalence of major depression in women’, Archives of General Psychiatry 50, pp. 843–852.
Kessler, R. C., J. B. Turner and J. S. House: 1989, ‘Unemployment, reemployment, and emotional functioning in a community sample’, American Sociological Review 54, pp. 648–657.
Kiers, H. A. L.: 1992, Simultaneous Components Analysis (ProGAMMA, Groningen).
Klassen, D., R. K. Hornstra and P. B. Anderson: 1975, ‘Influence of social desirability on symptom and mood reporting in a community sample’, Journal of Consulting and Clinical Psychology 43, pp. 448–452.
Kozma, A. and M. J. Stones: 1988, ‘Social desirability in measures of well-being: Age comparisons’, Social Indicator Research 20, pp. 1–14.
Lautenschlager, G. J. and V. L. Flaherty: 1990, ‘Computer administration of questions: More desirable or more social desirability?’, Journal of Applied Psychology 75, pp. 310–314.
LeVois, M., T. D. Nguyen and C. C. Attkisson: 1981, ‘Artifact in client satisfaction assessment: Experience in community mental health settings’, Evaluation and Program Planning 4, pp. 139–150.
Lewis, G., A. J. Pelosi, R. Araya and G. Dunn: 1992, ‘Measuring psychiatric disorder in the community: A standardized assessment for use by lay interviewers’, Psychological Medicine 22, pp. 465–486.
Linden, J. W., D. L. Paulhus and K. S. Dobson: 1986, ‘Effects of response styles on the report of psychological and somatic distress’, Journal of Consulting and Clinical Psychology 54, pp. 309–313.
Linehan, M. M. and S. L. Nielsen: 1981, ‘Assessment of suicide ideation and parasuicide: Hopelessness and social desirability’, Journal of Consulting and Clinical Psychology 49, pp. 773–775.
Lipman, R. S., L. Covi and A. K. Shapiro: 1979, ‘The Hopkins Symptom Checklist (HSCL): Factors Derived from the HSCL-90’, Journal of Affective Disorders 1, pp. 9–24.
McCrae, R. R.: 1986, ‘Well-being scales do not measure social desirability’, Journal of Gerontology 41, pp. 390–392.
McCrae, R. R. and P. T. Costa: 1983, ‘Social desirability scales: More substance than style’, Journal of Consulting and Clinical Psychology 51, pp. 882–888.
McHorney, C. A., M. Kosinski and J. E. Ware: 1994, ‘Comparison of the costs and quality of norms for the SF-36 Health Survey collected by mail versus telephone interview: Results from a national study’, Medical Care 32, pp. 551–567.
McKelvey, R. S., A. R. Mao and J. A. Webb: 1993, ‘Premigratory expectations and mental health symptomatology in a group of Vietnamese Amerasian youth’, Journal of the American Academy of Child and Adolescent Psychiatry 32, pp. 414–418.
McKelvey, R. S., J. A. Webb and A. R. Mao: 1993, ‘Premigratory risk factors in Vietnamese Amerasians’, American Journal of Psychiatry 150, pp. 470–473.
McNiel, D. E., T. K. Greenfield, C. C. Attkisson and R. L. Binder: 1989, ‘Factor structure of a brief symptom checklist for acute psychiatric inpatients’, Journal of Clinical Psychology 45, pp. 66–72.
Merydith, S. P. and F. H. Wallbrown: 1991, ‘Reconsidering response sets, test-taking attitudes, dissimulation, self-deception, and social desirability’, Psychological Reports 69, pp. 891–905.
Mollica, R. F., G. Wyshak, D. de Marneffe, F. Khuon and J. Lavelle: 1987, ‘Indochinese versions of the Hopkins Symptom Checklist-25: A screening instrument for the psychiatric care of refugees’, American Journal of Psychiatry 144, pp. 497–500.
Mouanoutoua, V. L. and L. G. Brown: 1995, ‘Hopkins Symptom Checklist-25, Hmong Version: A screening instrument for psychological distress’, Journal of Personality Assessment 64, pp. 376–383.
Moum, T.: 1991, ‘Is there a dose-response relationship between habitual physical exercise and minor psychiatric morbidity among healthy adults?’, in T. Sørensen, P. Abrahamsen and S. Torgersen (eds.), Psychiatric Disorders in the Social Domain: Contributions to a Scientific Basis for Understanding and Action (Norwegian University Press, Oslo), pp. 150–161.
Moum, T.: 1992, ‘Self-assessed health among Norwegian adults’, Social Science and Medicine 35, pp. 935–947.
Moum, T.: 1994, ‘Is subjective well-being a predictor of nonresponse in broad population surveys?’, Social Indicators Research 32, pp. 1–20.
Nederhof, A. J.: 1984, ‘Visibility of response as mediating factor in equity research’, Journal of Social Psychology 122, pp. 211–215.
Nederhof, A. J.: 1985, ‘Methods of coping with social desirability bias: A review’, European Journal of Social Psychology 15, pp. 263–280.
Nettelbladt, P., L. Hansson, C. G. Stefansson, L. Borgquist and G. Nordstrom: 1993, ‘Test characteristics of the Hopkins Symptom Check List-25 (HSCL-25) in Sweden, using the Present State Examination (PSE-9) as a caseness criterion’, Social Psychiatry and Psychiatric Epidemiology 28, pp. 130–133.
O'Muircheartaigh, C. A. and R. D. Wiggins: 1981, ‘The impact of interviewer variability in an epidemiological survey’, Psychological Medicine 11, pp. 817–824.
Paulhus, D. L.: 1984, ‘Two-component models of socially desirable responding’, Journal of Personality and Social Psychology 46, pp. 598–609.
Paulhus, D. L.: 1986, ‘Self-deception and impression management in test responses’, in A. Angleitner and J. S. Wiggins (eds.), Personality Assessment via Questionnaires (Springer-Verlag, Berlin), pp. 143–165.
Paulhus, D. L.: 1991, ‘Measurement and control of response bias’, in J. P. Robinson, P. S. Shaver and L. S. Wrightsman (eds.), Measures of Personality and Social Psychological Attitudes (Academic Press Inc., San Diego), pp. 17–59.
Paulhus, D. L. and K. Levitt: 1987, ‘Desirable responding triggered by affect: Automatic egotism?’, Journal of Personality and Social Psychology 52, pp. 245–259.
Paulhus, D. L. and D. B. Reid: 1991, ‘Enhancement and denial in socially desirable responding’, Journal of Personality and Social Psychology 60, pp. 307–317.
Petrie, K. and K. Chamberlain: 1983, ‘Hopelessness and social desirability as moderator variables in predicting suicidal behavior’, Journal of Consulting and Clinical Psychology 47, pp. 478–484.
Polaino, A. and C. Senra: 1991, ‘Measurement of depression: Comparison between self-reports and clinical assessments of depressed outpatients’, Journal of Psychopathology and Behavior Assessment 4, pp. 313–324.
Randolph, E. T., J. E. Escobar, D. H. Paz and A. B. Forsythe: 1985, ‘Ethnicity and reporting of schizophrenic symptoms’, The Journal of Nervous and Mental Diseases 173, pp. 332–340.
Rickels, K., W. G. Case, E. Schweizer, F. Garcia Espana, and R. Fridman: 1991, ‘Long-term benzodiazepine users 3 years after participation in a discontinuation program’, American Journal of Psychiatry 148, pp. 757–761.
Rickels, K., R. S. Lipman, C. R. Garcia and E. Fisher: 1972, ‘Evaluating clinical improvement in anxious outpatients: A comparison of normal and treated neurotic patients’, American Journal of Psychiatry 128, pp. 1005–1009.
Riessman, C. K.: 1979, ‘Interviewer effects in psychiatric epidemiology: A study of medical and lay interviewers and their impact on reported symptoms’, American Journal of Public Health 69, pp. 485–491.
Robinson, J. P., P. R. Shaver and L. S. Wrightsman: 1991, ‘Criteria for scale selection and evaluation’, in J. P. Robinson, P. S. Shaver and L. S. Wrightsman (eds.), Measures of Personality and Social Psychological Attitudes (Academic Press Inc., San Diego), pp. 1–16.
Rolnick, S. J., C. R. Gross, J. Garrard and R. W. Gibson: 1989, ‘A comparison of response rate, data quality, and cost in the collection of data on sexual history and personal behaviors’, American Journal of Epidemiology 129, pp. 1052–1061.
Ross, C. E. and J. Mirowsky: 1984, ‘Socially-desirable response and acquiescence in a cross-cultural survey of mental health’, Journal Health and Social Behavior 25, pp. 189–197.
Sackheim, H. A. and R. C. Gur: 1979, ‘Self-deception, other-deception, and self-reported psychopathology’, Journal of Consulting and Clinical Psychology 47, pp. 213–215.
Salter, D. and S. Platt: 1990, ‘Suicidal intent, hoplessness and depression in a parasuicide population: The influence of social desirability and elapsed time’, British Journal of Clinical Psychology 29, pp. 361–371.
Schuman, H. and G. Kalton: 1985, ‘Survey methods’, in G. Lindzey and E. Aronson (eds.), Handbook of Social Psychology (Random House, New York), pp. 635–697.
Schwarz, N., F. Strack, H-J. Hippler and G. Bishop: 1991, ‘The impact of administration mode on response effects in survey measurement’, Applied Cognitive Psychology 5, pp. 193–212.
Siemiatycki, J.: 1979, ‘A comparison of mail, telephone, and home interview strategies for household health surveys’, American Journal of Public Health 69, pp. 238–245.
Strosahl, K. D., M. M. Linehan and J. A. Chiles: 1984, ‘Will the real social desirability please stand up? Hopelessness, depression, social desirability, and the prediction of suicidal behavior’, Journal of Consulting and Clinical Psychology 52, pp. 449–457.
Sturt, E., P. Bebbington, J. Hurry and C. Tennant: 1981, ‘The Present State Examination used by intervieweres from a Suvey Agency: Report from the MRC Camberwell Community Survey’, Psychological Medicine 11, pp. 185–192.
Tambs, K.: 1991, ‘Transmission of symptoms of anxiety and depression in nuclear families’, Journal of Affective Disorders 21, pp. 117–126.
Tambs, K. and T. Moum: 1993, ‘Low genetic effect and age-specific family effect for symptoms of anxiety and depression in nuclear families, halfsibs and twins’, Journal of Affective Disorders 27, pp. 183–195.
Tambs, K. and T. Moum: 1993, ‘How well can a few questionnaire items indicate anxiety and depression?’, Acta Psychiatrica Scandinavica 87, pp. 364–367.
Taylor, S. E. and J. D. Brown: 1988, ‘Illusion and well-being: A social psychological perspective on mental health’, Psychological Bulletin 103, pp. 193–210.
Tucker, C.: 1983, ‘Interviewer effects in telephone surveys’, Public Opinion Quarterly 47, pp. 84–95.
van der Zouwen, J. and E. D. de Leeuw: 1990, ‘The relationship between mode of administration and quality of data in survey research’, Bulletin de Méthodologie Sociologique 29, pp. 3–14.
Verma, K.: 1987, ‘Psychological correlates of paired associates memory’, Indian Psychological Review 32, pp. 7–11.
Walker, I.: 1992, ‘Effects of interviewer's sex on responses to the attitudes toward women scale’, The Journal of Social Psychology 132: pp. 675–677.
Wells, K. B., M. A. Burnam, B. Leake and L. N. Robins: 1988, ‘Agreement between face-to-face and telephone-administered versions of the depression section of the NIMH diagnostic interview schedule’, Journal of Psychiatric Research 22, pp. 207–220.
Welte, J. W. and M. Russell: 1993, ‘Influence of socially desirable responding in a study of stress and substance abuse’, Alcohol Clinical and Experimental Research 17, pp. 758–761.
Winokur, A., M. B. Guthrie, K. Rickels and N. Slavash: 1982, ‘Extent of agreement between patient and physician ratings of emotional distress’, Psychosomatics 23, pp. 1135–1146.
Winokur, A., D. F. Winokur, K. Rickels and D. S. Cox: 1984, ‘Symptoms of emotional distress in a family planning service: Stability over a four-week period’, British Journal of Psychiatry 144, pp. 395–399.
Wiseman, F.: 1972, ‘Methodological bias in public opinion surveys’, Public Opinion Quarterly 36, pp. 105–108.
Zeller, R. A. and E. G. Carmines: 1980, Measurement in the Social Sciences (Cambridge University Press, Cambridge).
Author information
Authors and Affiliations
Rights and permissions
About this article
Cite this article
Moum, T. Mode of administration and interviewer effects in self-reported symptoms of anxiety and depression. Social Indicators Research 45, 279–318 (1998). https://doi.org/10.1023/A:1006958100504
Issue Date:
DOI: https://doi.org/10.1023/A:1006958100504