Swipe om te navigeren naar een ander artikel
This study examines the effect of question context created by order in questionnaires on three subjective well-being measures: life satisfaction, self-rated health, and subjective life expectancy.
We conducted two Web survey experiments. The first experiment (n = 648) altered the order of life satisfaction and self-rated health: (1) life satisfaction asked immediately after self-rated health; (2) self-rated health immediately after life satisfaction; and (3) two items placed apart. We examined their correlation coefficient by experimental condition and further examined its interaction with objective health. The second experiment (n = 479) asked life expectancy before and after parental mortality questions. Responses to life expectancy were compared by order using ANOVA, and we examined interaction with parental mortality status using ANCOVA. Additionally, response time and probes were examined.
Correlation coefficients between self-rated health and life satisfaction differed significantly by order: 0.313 (life satisfaction first), 0.508 (apart), and 0.643 (self-rated health first). Differences were larger among respondents with chronic conditions. Response times were the shortest when self-rated health was asked first. When life expectancy asked after parental mortality questions, respondents reported considering parents more for answering life expectancy; and respondents with deceased parents reported significantly lower expectancy, but not those whose parents were alive.
Question context effects exist. Findings suggest placing life satisfaction and self-rated health apart to avoid artificial attenuation or inflation in their association. Asking about parental mortality prior to life expectancy appears advantageous as this leads respondents to consider parental longevity more, an important factor for true longevity.
Log in om toegang te krijgen
Met onderstaand(e) abonnement(en) heeft u direct toegang:
Campbell, A., Converse, P. E., & Rodgers, W. L. (1976). The query of American-life. New York, NY: Russell Sage.
Kahneman, D., Diener, E., & Schwarz, N. (1999). Well-being: The foundations of hedonic psychology. New York, NY: Russell Sage Foundation.
Schwarz, N., & Strack, F. (1999). Report of subjective well-being: Judgmental processes and their methodological implications. In D. Kahneman, E. Diener, & N. Schwarz (Eds.), Well-being: The foundations of hedonic psychology (pp. 61–84). New York, NY: Russell Sage Foundation.
Schuman, H., & Presser, S. (1981). Questions and answers in attitude surveys. London: Academic Press.
Schwarz, N. (1996). Cognition and communication: judgmental biases, research methods, and the logic of conversation. Hillsdale, NJ: Erlbaum.
Schuman, H. (1992). Context effects: State of the past/state of the art. In N. Schwarz & S. Sudman (Eds.), Context effects in social and psychological research (pp. 5–20). New York, NY: Springer. CrossRef
Schwarz, N. (1999). Self-reports: how the questions shape the answers. American Psychologist, 54(2), 93. CrossRef
Tourangeau, R., Rips, L. J., & Rasinski, K. (2000). The psychology of survey response. Cambridge: Cambridge University Press. CrossRef
Strack, F., Schwarz, N., & Wänke, M. (1991). Semantic and pragmatic aspects of context effects in social and psychological research. Social Cognition, 9(1), 111–125. CrossRef
Sudman, S., Bradburn, N. M., & Schwarz, N. (1996). Thinking about answers: The application of cognitive processes to survey methodology. San Francisco, CA: Jossey-Bass.
Zaller, J. (1992). The nature and origins of mass opinion. Cambridge: Cambridge University Press. CrossRef
Higgins, E. T. (1989). Knowledge accessibility and activation: Subjectivity and suffering from unconscious sources. In J. S. Uleman & J. A. Barghs (Eds.), Unintended thought (pp. 75–123). New York, NY: Guilford Press.
Tourangeau, R., & Rasinski, K. A. (1988). Cognitive processes underlying context effects in attitude measurement. Psychological Bulletin, 103(3), 299–314. CrossRef
Organisation for Economic Cooperation and Development (OECD). (2013). OECD guidelines on measuring subjective well- being. OECD Publishing. Retrieved from http://dx.doi.org/10.1787/9789264191655-en.
Pavot, W., & Diener, E. (1993). Review of the satisfaction with life scale. Psychological Assessment, 5(2), 164–172. CrossRef
Diener, E. (1994). Assessing subjective well-being: Progress and opportunities. Social Indicators Research, 31, 103–157. CrossRef
Bjørnskov, C. (2010). How comparable are the Gallup World Poll life satisfaction data? Journal of Happiness Studies, 11(1), 41–60. CrossRef
Organisation for Economic Cooperation and Development (OECD). (2015). Life satisfaction. Retrieved from http://www.oecdbetterlifeindex.org/topics/life-satisfaction/.
Mohan, R., Beydoun, H. A., Beydoun, M. A., Barnes-Eley, M., Davis, J., Lance, R., & Schellhammer, P. (2011). Self-rated health as a tool for estimating health-adjusted life expectancy among patients newly diagnosed with localized prostate cancer: A preliminary study. Quality of Life Research, 20(5), 713–721. PubMedCrossRef
Kleinman, A. (1980). Patients and healers in the context of cultures. Berkeley, CA: University of California Press.
Bury, M. (1982). Chronic illness as biological disruption. Sociology of Health and Illness, 12, 451–468.
Zullig, K. J., & White, R. J. (2011). Physical activity, life satisfaction, and self-rated health of middle school students. Applied Research in Quality of Life, 6(3), 277–289. CrossRef
Okun, M. A., & George, L. K. (1984). Physician-and self-ratings of health, neuroticism and subjective well-being among men and women. Personality and Individual Differences, 5(5), 533–539. CrossRef
Lawton, M. P. (1977). Morale: What are we measuring? In C. N. Nydeggar (Ed.), Measuring morale: A guide to effective measurement. Washington, DC: The Gerontological Society.
Hurd, M. D., & McGarry, K. (1995). Evaluation of the subjective probabilities of survival in the health and retirement study. Journal of Human Resources, 30, S268–S292.
Van Doorn, C., & Kasl, S. V. (1998). Can parental longevity and self-rated life expectancy predict mortality among older persons? Results from an Australian cohort. The Journals of Gerontology Series B: Psychological Sciences and Social Sciences, 53(1), S28–S34. CrossRef
Lee, S., & Smith, J. (2016). Methodological aspects of subjective life expectancy: Effects of culture-specific reporting heterogeneity among older adults in the U.S. The Journals of Gerontology: Series B Psychological Sciences and Social Sciences, 71(3), 558–568.
Smith, T. W. (1982). Conditional order effect. GSS technical report. no. 33. Chicago, IL: NORC.
Strack, F., Martin, L. L., & Schwarz, N. (1988). Priming and communication: Social determinants of information use in judgments of life satisfaction. European Journal of Social Psychology, 18, 429–442. CrossRef
Schwarz, N., Strack, F., & Mai, H. P. (1991). Assimilation and contrast effects in part–whole question sequences: A conversational logic analysis. Public Opinion Quarterly, 55(1), 3–23. CrossRef
Grice, H. P. (1975). Logic and conversation. In P. Cole & J. L. Morgan (Eds.), Syntax and semantics 3: Speech acts (pp. 41–58). New York, NY: Academic Press.
Baumeister, R. F., Bratslavsky, E., Finkenauer, C., & Vohs, K. D. (2001). Bad is stronger than good. Review of General Psychology, 5(4), 323–370. CrossRef
Jonas, E., Schimel, J., Greenberg, J., & Pyszczynski, T. (2002). The Scrooge effect: Evidence that mortality salience increases prosocial attitudes and behavior. Personality and Social Psychology Bulletin, 28(10), 1342–1353. CrossRef
Renkema, L. J., Stapel, D. A., & Van Yperen, N. W. (2008). Go with the flow: Conforming to others in the face of existential threat. European Journal of Social Psychology, 38(4), 747–756. CrossRef
Mathews, P., & Sear, R. (2008). Life after death: An investigation into how mortality perceptions influence fertility preferences using evidence from an internet-based experiment. Journal of Evolutionary Psychology, 6(3), 155–172. CrossRef
Murphy, J., Link, M. W., Childs, J. H., Tesfaye, C. L., Dean, E., Stern, M., & Schober, M. F. (2014). Social media in public opinion research: Report of the AAPOR task force on emerging technologies in public opinion research. American Association for Public Opinion Research. Retrieved from https://www.aapor.org/AAPORKentico/AAPOR_Main/media/MainSiteFiles/AAPOR_Social_Media_Report_FNL.pdf.
Antoun, C., Zhang, C., Conrad, F. G., & Schober, M. F. (2015). Comparisons of online recruitment strategies for convenience samples: Craigslist, Google AdWords, Facebook, and Amazon Mechanical Turk. Field Methods,. doi: 10.1177/1525822X15603149.
Berinsky, A. J., Huber, G. A., & Lenz, G. S. (2012). Evaluating online labor markets for experimental research: Amazon.com’s Mechanical Turk. Political Analysis, 20(3), 351–368. CrossRef
Paolacci, G., Chandler, J., & Ipeirotis, P. G. (2010). Running experiments on Amazon Mechanical Turk. Judgment and Decision Making, 5(5), 411–419.
Horton, J. J., & Chilton, L. B. (2010). The labor economics of paid crowdsourcing. In Proceedings of the 11th ACM Conference on Electronic Commerce (pp. 209–218). Association for Computing Machinery. Retrieved from http://arxiv.org/pdf/1001.0627.pdf.
Shapiro, D. N., Chandler, J., & Mueller, P. A. (2013). Using Mechanical Turk to study clinical populations. Clinical Psychological Science, 1(2), 213–220. CrossRef
Groves, R. M., Fultz, N. H., & Martin, E. (1992). Direct questioning about comprehension in a survey setting . Questions about questions: Inquiries into the cognitive bases of surveys. New York, NY: Russell Sage, 49–61.
Behr, D., Kaczmirek, L., Bandilla, W., & Braun, M. (2012). Asking probing questions in web surveys: Which factors have an impact on the quality of responses? Social Science Computer Review, 30(4), 487–498. CrossRef
Bassili, J. N., & Scott, B. S. (1996). Response latency as a signal to question problems in survey research. Public Opinion Quarterly, 60(3), 390–399. CrossRef
Tourangeau, R., Couper, M. P., & Conrad, F. G. (2004). Spacing, position, and order: Interpretive heuristics for visual features of survey questions. Public Opinion Quarterly, 68, 368–393. CrossRef
Malhotra, N. (2008). Completion time and response order effects in web surveys. Public Opinion Quarterly, 72(5), 914–934. CrossRef
Yan, T., & Tourangeau, R. (2008). Fast times and easy questions: The effects of age, experience and question complexity on web survey response times. Applied Cognitive Psychology, 22(1), 51–68. CrossRef
Shannon, C. E. (1948). A mathematical theory of communication. The Bell Systems Technical Journal, 27, 379–423 and 623–656.
Fisher, R. A. (1921). On the probable error of a coefficient of correlation deduced from a small sample. Metron, 1, 3–32.
Silver, N. C., & Dunlap, W. P. (1987). Averaging correlation coefficients: Should Fisher’s z transformation be used? Journal of Applied Psychology, 72(1), 146. CrossRef
Cohen, J. (1988). Statistical power analysis for the behavioral sciences (2nd ed.). Hillsdale, NJ: Erlbaum.
- Question order sensitivity of subjective well-being measures: focus on life satisfaction, self-rated health, and subjective life expectancy in survey instruments
- Springer International Publishing