Skip to main content
Top
Gepubliceerd in: Quality of Life Research 8/2016

01-08-2016 | Brief Communication

The effect of response option order on self-rated health: a replication study

Auteurs: Dana Garbarski, Nora Cate Schaeffer, Jennifer Dykema

Gepubliceerd in: Quality of Life Research | Uitgave 8/2016

Log in om toegang te krijgen
share
DELEN

Deel dit onderdeel of sectie (kopieer de link)

  • Optie A:
    Klik op de rechtermuisknop op de link en selecteer de optie “linkadres kopiëren”
  • Optie B:
    Deel de link per e-mail

Abstract

Purpose

Following calls for replication of research studies, this study documents the results of two studies that experimentally examine the impact of response option order on self-rated health (SRH).

Methods

Two studies from an online panel survey examined how the order of response options (positive to negative versus negative to positive) influences the distribution of SRH answers.

Results

The results of both studies indicate that the distribution of SRH varies across the experimental treatments, and mean SRH is lower (worse) when the response options start with “poor” rather than “excellent.” In addition, there are differences across the two studies in the distribution of SRH and mean SRH when the response options begin with “excellent,” but not when the response options begin with “poor.”

Conclusion

The similarities in the general findings across the two studies strengthen the claim that SRH will be lower (worse) when the response options are ordered beginning with “poor” rather than “excellent” in online self-administered questionnaires, with implications for the validity of SRH. The slight differences in the administration of the seemingly identical studies further strengthen the claim and also serve as a reminder of the inherent variability of a single permutation of any given study.
Voetnoten
1
BMI in this study is calculated from self-reported height and weight, and is thus subject to measurement error.
 
Literatuur
1.
go back to reference Open Science Collaboration. (2015). Estimating the reproducibility of psychological science. Science, 349(6251), aac4716. Open Science Collaboration. (2015). Estimating the reproducibility of psychological science. Science, 349(6251), aac4716.
2.
go back to reference Nosek, B. A., & Lakens, D. (2014). Registered reports: A method to increase the credibility of published results. Social Psychology, 45(3), 137–141.CrossRef Nosek, B. A., & Lakens, D. (2014). Registered reports: A method to increase the credibility of published results. Social Psychology, 45(3), 137–141.CrossRef
3.
go back to reference Idler, E. L., & Benyamini, Y. (1997). Self-rated health and mortality: A review of twenty-seven community studies. Journal of Health and Social Behavior, 38(1), 21–37.CrossRefPubMed Idler, E. L., & Benyamini, Y. (1997). Self-rated health and mortality: A review of twenty-seven community studies. Journal of Health and Social Behavior, 38(1), 21–37.CrossRefPubMed
4.
go back to reference Carp, F. M. (1974). Position effects on interview responses. Journal of Gerontology, 29(5), 581–587.CrossRefPubMed Carp, F. M. (1974). Position effects on interview responses. Journal of Gerontology, 29(5), 581–587.CrossRefPubMed
5.
go back to reference Chan, J. C. (1991). Response-order effects in Likert-type scales. Educational and Psychological Measurement, 51(3), 531–540.CrossRef Chan, J. C. (1991). Response-order effects in Likert-type scales. Educational and Psychological Measurement, 51(3), 531–540.CrossRef
6.
go back to reference Krosnick, J. A. (1991). Response strategies for coping with the cognitive demands of attitude measures in surveys. Applied Cognitive Psychology, 5(3), 213–236.CrossRef Krosnick, J. A. (1991). Response strategies for coping with the cognitive demands of attitude measures in surveys. Applied Cognitive Psychology, 5(3), 213–236.CrossRef
7.
go back to reference Krosnick, J. A., & Alwin, D. F. (1987). An evaluation of a cognitive theory of response-order effects in survey measurement. Public Opinion Quarterly, 51(2), 201–219.CrossRef Krosnick, J. A., & Alwin, D. F. (1987). An evaluation of a cognitive theory of response-order effects in survey measurement. Public Opinion Quarterly, 51(2), 201–219.CrossRef
8.
go back to reference Sudman, S., & Bradburn, N. M. (1982). Asking questions: A practical guide to questionnaire design. San Francisco: Jossey-Bass. Sudman, S., & Bradburn, N. M. (1982). Asking questions: A practical guide to questionnaire design. San Francisco: Jossey-Bass.
9.
go back to reference Garbarski, D., Schaeffer, N., & Dykema, J. (2015). The effects of response option order and question order on self-rated health. Quality of Life Research, 24(6), 1443–1453.CrossRefPubMed Garbarski, D., Schaeffer, N., & Dykema, J. (2015). The effects of response option order and question order on self-rated health. Quality of Life Research, 24(6), 1443–1453.CrossRefPubMed
10.
go back to reference Means, B., Nigam, A., Zarrow, M., Loftus, E. F., & Donaldson, M. S. (1989). Autobiographical memory for health-related events (No. DHHS (PHS) 89-1077). Rockville, MD: National Center for Health Statistics. Means, B., Nigam, A., Zarrow, M., Loftus, E. F., & Donaldson, M. S. (1989). Autobiographical memory for health-related events (No. DHHS (PHS) 89-1077). Rockville, MD: National Center for Health Statistics.
11.
go back to reference Callegaro, M., & DiSogra, C. (2008). Computing response metrics for online panels. Public Opinion Quarterly, 72(5), 1008–1032.CrossRef Callegaro, M., & DiSogra, C. (2008). Computing response metrics for online panels. Public Opinion Quarterly, 72(5), 1008–1032.CrossRef
12.
go back to reference Mutz, D. C. (2011). Population-based survey experiments. Princeton: Princeton University Press.CrossRef Mutz, D. C. (2011). Population-based survey experiments. Princeton: Princeton University Press.CrossRef
13.
go back to reference Lee, S., & Schwarz, N. (2014). Question context and priming meaning of health: Effect on differences in self-rated health between Hispanics and non-Hispanic whites. American Journal of Public Health, 104(1), 179–185.CrossRefPubMedPubMedCentral Lee, S., & Schwarz, N. (2014). Question context and priming meaning of health: Effect on differences in self-rated health between Hispanics and non-Hispanic whites. American Journal of Public Health, 104(1), 179–185.CrossRefPubMedPubMedCentral
14.
go back to reference Sanchez, G. R., & Vargas, E. D. Forthcoming. Language bias and self-rated health status among the Latino population: Evidence of the influence of translation in a wording experiment. Quality of Life Research. Sanchez, G. R., & Vargas, E. D. Forthcoming. Language bias and self-rated health status among the Latino population: Evidence of the influence of translation in a wording experiment. Quality of Life Research.
Metagegevens
Titel
The effect of response option order on self-rated health: a replication study
Auteurs
Dana Garbarski
Nora Cate Schaeffer
Jennifer Dykema
Publicatiedatum
01-08-2016
Uitgeverij
Springer International Publishing
Gepubliceerd in
Quality of Life Research / Uitgave 8/2016
Print ISSN: 0962-9343
Elektronisch ISSN: 1573-2649
DOI
https://doi.org/10.1007/s11136-016-1249-y

Andere artikelen Uitgave 8/2016

Quality of Life Research 8/2016 Naar de uitgave