Skip to main content
SpringerLink
Log in

Response style behavior: question format dependent or personal style?

  • Published:
Quality & Quantity Aims and scope Submit manuscript

Abstract

In survey research, acquiescence response style/set (ARS) and extreme response style/set (ERS) may distort the measurement of attitudes. How response bias is evoked is still subject of research. A key question is whether it may be evoked by external factors (e.g. test conditions or fatigue) or whether it could be the result of internal factors (e.g. personality or social characteristics). In the first part of this study we explore whether scale length—the manipulated test condition—influences the occurrence of ERS and/or ARS, by varying scale length from 5 till 11 categories. In pursuit of this we apply a latent class factor model that allows for diagnosing and correcting for ERS and ARS simultaneously. Results show that ERS occurs regardless of scale length. Furthermore, we find only weak evidence of ARS. In a second step we check whether ERS might reflect an internal personal style by (a) linking it to external measures of ERS, and by (b) correlating it with a personality profile and socio-demographic characteristics. Results show that ERS is reasonably stable over questionnaires and that it is associated with the selected personality profile and age.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Similar content being viewed by others

References

  • Austin E.J., Deary I.J. and Egan V. (2006). Individual differences in response scale use: mixed Rasch modelling of responses to NEO-FFI items. Pers. Individ. Differ. 40: 1235–1245

    Article  Google Scholar 

  • Billiet J.B. and Davidov E. (2008). Testing the stability of an acquiescence style factor behind two interrelated substantive variables in a panel design. Sociol. Methods Res. 36: 542–562

    Article  Google Scholar 

  • Billiet J.B. and McClendon M.J. (2000). Modelling acquiescence in measurement models for two balanced sets of items. Struct. Equ. Model. 7: 608–628

    Article  Google Scholar 

  • Bogner F.X. and Wiseman M. (1999). Towards measuring adolescent environmental perception. Eur. Psychol. 4: 139–151

    Article  Google Scholar 

  • Bolt D.M. and Johnson T.R. (2009). Addressing score bias and differential item functioning due to individual differences in response style. Appl. Psychol. Meas. 33: 335–352

    Article  Google Scholar 

  • Chen C., Lee S.-y. and Stevenson H.W. (1995). Response style and cross-cultural comparisons of rating scales among East Asian and North American students. Psychol. Sci. 6: 170–175

    Article  Google Scholar 

  • Cheung G.W. and Rensvold R.B. (2000). Assessing extreme and acquiescence response sets in cross-cultural research using structural equations modeling. J. Cross-Cult. Psychol. 31: 187–212

    Article  Google Scholar 

  • Couch A. and Keniston K. (1960). Yeasayers and naysayers: agreeing response set as a personality variable. J. Abnorm. Soc. Psychol. 60: 151–174

    Article  Google Scholar 

  • De Jong M.G., Steenkamp J.-B.E.M., Fox J.-P. and Baumgartner H. (2008). Using item response theory to measure extreme response style in marketing research: a global investigation. J. Mark. Res. 45: 104–115

    Article  Google Scholar 

  • Diamantopoulos A., Reynolds N.L. and Simintiras A.C. (2006). The impact of response styles on the stability of cross-national comparisons. J. Bus. Res. 59: 925–935

    Article  Google Scholar 

  • DiStefano C. and Motl R.W. (2009). Personality correlates of method effects due to negatively worded items on the Rosenberg self-esteem scale. Pers. Individ. Differ. 46: 309–313

    Article  Google Scholar 

  • Dolcinar S. and Grün B. (2007). Analytical robustness in cross-cultural comparisons. Int. J. Cult Tour. Hosp. Res. 1: 140–160

    Article  Google Scholar 

  • Dolcinar S. and Grün B. (2009). Response style contamination of student evaluation data. J. Mark. Educ. 31: 160–172

    Article  Google Scholar 

  • Gibbons J.L., Zellner J.A. and Rudek D.J. (1999). Effects of language and meaningfulness on the use of extreme response style by Spanish-English bilinguals. Cross-Cult. Res. 33: 369–381

    Article  Google Scholar 

  • Greenleaf E.A. (1992). Measuring extreme response style. Public Opin. Q. 56: 328–351

    Article  Google Scholar 

  • Hamilton D.L. (1968). Personality attributes associated with extreme response style. Psychol. Bull. 69: 192–203

    Article  Google Scholar 

  • Harzing A.-W. (2006). Response styles in cross-national survey research: a 26-country study. Int. J. Cross-Cult. Manag. 6: 243–266

    Article  Google Scholar 

  • Heide M. and Grønhaug K. (1992). The impact of response styles in surveys: a simulation study. J. Mark. Res. Soc. 34: 215–230

    Google Scholar 

  • Hui C.H. and Triandis H.C. (1989). Effects of culture and response format on extreme response style. J. Cross-Cult. Psychol. 20: 296–309

    Article  Google Scholar 

  • Hurley J.R. (1998). Timidity as a response style to psychological questionnaires. J. Psychol. 132: 202–210

    Google Scholar 

  • Institute of Social and Political Opinion Research (ISPO): 1995 general election study Belgium-Flanders. http://www.data-archive.ac.uk/findingData (1997). Accessed 1 Oct 2009

  • International Social Survey Programme (ISSP): family and gender roles III. http://www.issp.org/data.shtml (2002). Accessed 1 Oct 2009

  • Johnson T.R., Kulesa P., Cho Y.I. and Shavitt S. (2005). The relation between culture and response styles: evidence from 19 countries. J. Cross-Cult. Psychol. 36: 264–277

    Article  Google Scholar 

  • Kieruj, N.D., Moors, G.: Variations in response style behavior by response scale format in attitude research. Int. J. Public Opin. Res. http://ijpor.oxfordjournals.org/content/early/2010/07/23/ijpor.edq001.full.pdf+html (2010). Accessed 31 Aug 2010

  • Knowles E.S. and Nathan K.T. (1997). Acquiescent responding in self-reports: cognitive style or social concern?. J. Res. Pers. 31: 293–301

    Article  Google Scholar 

  • Koson D., Kitchen C., Kochen M. and Stodolosky D. (1970). Psychological testing by computer: effect on response bias. Educ. Psychol. Meas. 30: 808–810

    Article  Google Scholar 

  • Krosnick J.A. (1991). Response strategies for coping with the cognitive demands of attitude measures in surveys. Appl. Cogn. Psychol. 5: 213–236

    Article  Google Scholar 

  • Lewis N. and Taylor J. (1955). Anxiety and extreme response preferences. Edu. Psychol. Meas. 15: 111–116

    Article  Google Scholar 

  • Marín G., Gamba R.J. and Marín B. (1992). Extreme response style and acquiescence among Hispanics. J. Cross-Cult. Psychol. 23: 498–509

    Article  Google Scholar 

  • Meisenberg G. and Williams A. (2008). Are acquiescent and extreme response styles related to low intelligence and education?. Pers. Individ. Differ. 44: 1539–1550

    Article  Google Scholar 

  • Moors G. (2003). Diagnosing response style behaviour by means of a latent class factor approach. Socio-demographic correlates of gender role attitudes and perceptions of ethnic discrimination re-examined. Qual. Quant. 37: 277–302

    Article  Google Scholar 

  • Morren, M.: The survey response: a mixed method study of cross-cultural differences in responding to attitude statements (Doctoral dissertation). Tilburg University, Tilburg, The Netherlands (2011)

  • Naemi, B.D.: Measuring and predicting extreme response style: a latent class approach. http://scholarship.rice.edu/bitstream/handle/1911/17901/1435749.PDF?sequence=1 (2006). Accessed 31 Aug 2010

  • Naemi B.D., Beal D.J. and Payne S.C. (2009). Personality predictors of extreme response style. J. Pers. 77: 261–286

    Article  Google Scholar 

  • Pedersen D.M. (1967). Acquiescence and social desirability response sets and some personality correlates. Edu. Psychol. Meas. 27: 691–697

    Article  Google Scholar 

  • Rorer L.G. (1965). The great response-style myth. Psychol. Bull. 63: 129–156

    Article  Google Scholar 

  • Shulman A. (1973). A comparison of two scales on extremity bias. Public Opin. Q. 37: 407–412

    Article  Google Scholar 

  • Smith P.B. (2004). Acquiescent response bias as an aspect of cultural communication style. J. Cross-Cult. Psychol. 35: 50–61

    Article  Google Scholar 

  • Thompson S.C.G. and Barton M. (1994). Ecocentric and anthropocentric attitudes toward the environment. J. Environ. Psychol. 14: 149–157

    Article  Google Scholar 

  • Van Herk H., Poortinga Y.H. and Verhallen T.M.M. (2004). Response styles in rating scales: evidence of method bias in data from six EU countries. J. Cross-Cult. Psychol. 35: 346–360

    Article  Google Scholar 

  • Van Rosmalen J., Van Herk H. and Groenen P.J.F. (2007). Identifying unknown response styles: a latent class bilinear multinomial logit model. J. Mark. Res. 47: 157–172

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Tilburg University, FSW-MTO, Room P.1.103, P.O. Box 90153, 5000 LE, Tilburg, The Netherlands

    Natalia D. Kieruj & Guy Moors

Authors
  1. Natalia D. Kieruj
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Guy Moors
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Natalia D. Kieruj.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Kieruj, N.D., Moors, G. Response style behavior: question format dependent or personal style?. Qual Quant 47, 193–211 (2013). https://doi.org/10.1007/s11135-011-9511-4

Download citation

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11135-011-9511-4

Keywords

Search

Navigation