Abstract
The objective of this study was to investigate the substantive aspect of construct validity of the Satisfaction with Life Scale adapted for Children (SWLS-C; Gadermann et al. in Soc Indic Res 96:229–247, 2010). Specifically, the study examined the cognitive processes of children when responding to the items of the SWLS-C to find out how they interpret and respond to the items. Think-aloud protocol interviews were conducted with 55 students in grades 4–7 (58% girls, mean age of 11 years, ranging from 8.8 to 12.8 years) and content analysis was used to analyze the data. The findings indicate that most children had no difficulty in understanding the items, and used mainly two strategies for responding to the items: (1) an absolute strategy, in which children used absolute statements to indicate the presence or absence of something that is important for their judgment of their satisfaction with life, and (2) a relative strategy, in which children used relative or comparative statements. In the absolute statements, children primarily referred to social relationships, personal characteristics, time use, and possessions. In the relative statements, the children primarily compared what they have to (a) what they want (b) what they had in the past, (c) what other people have, and (d) what they feel they need. Furthermore, most children considered it important that information on their life satisfaction is obtained. The results are discussed with regard to multiple discrepancies theory (Michalos in Soc Indic Res 16:347–413, 1985) and previous empirical findings. The results provide insights into children’s cognitive processes when responding to items on life satisfaction and provide validity evidence that the SWLS-C is an appropriate measure to assess life satisfaction in children of this age.
Similar content being viewed by others
Notes
Two of these children reported having learned English and two other languages at home.
The language label Chinese includes Mandarin, Cantonese, and Taiwanese.
As a result, the sum of all frequencies of the categories is not equal to the sample size of 55.
According to Fig. 8, it appears as if there should be a statistically significant difference in favour of the absolute strategy. Please note that in contrast to the data in Fig. 8, the data for the McNemar test were recoded into binary data, which explains why the test was statistically non-significant.
For the other propositions, please see Michalos (1985).
References
American Educational Research Association, American Psychological Association, & National Council on Measurement in Education. (1999). Standards for educational and psychological testing. Washington, DC: American Psychological Association.
Barofsky, I., Meadows, K., & McColl, E. (2003). Cognitive aspects of survey methodology and quality of life assessment: Summary of meeting. Quality of Life Research, 12, 281–282.
Bee, H. (1989). The developing child (5th ed.). New York: Harper & Row Publishers.
Ben-Arieh, A. (2005). Where are the children? Children’s role in measuring and monitoring their well-being. Social Indicators Research, 74, 573–596.
Ben-Arieh, A. (2006). Is the study of the “state of our children” changing? Re-visiting after 5 years. Children and Youth Services Review, 28, 799–811.
Ben-Arieh, A., & Goerge, R. M. (2001). Beyond the numbers: How do we monitor the state of our children? Children and Youth Services Review, 23, 603–631.
Ben-Arieh, A., & Goerge, R. M. (Eds.). (2006). Indicators of children’s well-being: Understanding their role, usage and policy influence. Dordrecht, The Netherlands: Springer Academic Publishers.
Ben-Arieh, A., Kaufman, H. N., Andrews, B. A., Goerge, R. M., Lee, B. J., & Aber, J. L. (2001). Measuring and monitoring children’s well-being. Dordrecht, The Netherlands: Kluwer Academic Press.
Berg, B. L. (2004). Qualitative research methods for the social sciences (5th ed.). Boston: Pearson Education.
Böhm, A. (2004). Theoretical coding: Text analysis in grounded theory. In U. Flick, E. von Kardoff, & I. Steinke (Eds.), A companion to qualitative research (pp. 270–275). London: Sage Publications.
Cizek, G. J., Rosenberg, S. L., & Koons, H. H. (2008). Sources of validity evidence for educational and psychological tests. Educational and Psychological Measurement, 68, 397–412.
Collins, D. (2003). Pretesting survey instruments: An overview of cognitive methods. Quality of Life Research, 12, 229–238.
Cremeens, J., Eiser, C., & Blades, M. (2006a). A qualitative investigation of school-aged children’s answers to items from a generic quality of life measure. Child: Care, Health and Development, 33, 83–89.
Cremeens, J., Eiser, C., & Blades, M. (2006b). Characteristics of health-related self-report measures for children aged three to eight years: A review of the literature. Quality of Life Research, 15, 739–754.
De Civita, M., Regier, D., Alamgir, A. H., Anis, A. H., Fitzgerald, M. J., & Marra, C. A. (2005). Evaluating health-related quality-of-life studies in paediatric populations. Some conceptual, methodological and developmental considerations and recent applications. Pharmacoeconomics, 23, 659–685.
Dew, T., & Huebner, E. S. (1994). Adolescents’ perceived quality of life: An exploratory investigation. Journal of School Psychology, 32, 185–199.
Dey, I. (1993). Qualitative data analysis: A user-friendly guide for social scientists. London: Routledge.
Diener, E., Emmons, R. A., Larsen, R. J., & Griffin, S. (1985). The Satisfaction with Life Scale. Journal of Personality Assessment, 49, 71–75.
Diener, E., Suh, E. M., Lucas, R. E., & Smith, H. L. (1999). Subjective well-being: Three decades of progress. Psychological Bulletin, 125, 276–302.
Ericsson, K. A., & Simon, H. A. (1980). Verbal reports as data. Psychological Review, 87, 215–251.
Fox, J. E., Houston, B. K., & Pittner, M. S. (1983). Trait anxiety and children’s cognitive behaviors in an evaluative situation. Cognitive Therapy and Research, 7, 149–154.
Frones, I. (2007). Theorizing indicators. Social Indicators Research, 83, 5–23.
Gadermann, A. M., Schonert-Reichl, K. A., & Zumbo, B. D. (2010). Investigating validity evidence of the Satisfaction with Life Scale adapted for Children. Social Indicators Research, 96, 229–247.
Greenspoon, P. J., & Saklofske, D. H. (1997). Validity and reliability of the Multidimensional Students’ Life Satisfaction Scale with Canadian children. Journal of Psychoeducational Assessment, 15, 138–155.
Holsti, O. R. (1969). Content analysis for the social sciences and humanities. Reading, MA: Addison-Wesley Publishing Company.
Huebner, E. S. (1991). Correlates of life satisfaction in children. School Psychology Quarterly, 6, 103–111.
Huebner, E. S., & Alderman, G. L. (1993). Convergent and discriminant validation of a children’s life satisfaction scale: Its relationship to self- and teacher-reported psychological problems and school functioning. Social Indicators Research, 30, 71–82.
Huebner, E. S., Drane, W., & Valois, R. F. (2000). Levels and demographic correlates of adolescent life satisfaction reports. School Psychology International, 21, 281–292.
Huebner, E. S., Suldo, S. M., Smith, L. C., & McKnight, C. G. (2004). Life satisfaction in children and youth: Empirical foundations and implications for school psychologists. Psychology in the Schools, 41, 81–93.
Lodge, J., Harte, D. K., & Tripp, G. (1998). Children’s self-talk under conditions of mild anxiety. Journal of Anxiety Disorders, 12, 153–176.
Lodge, J., Tripp, G., & Harte, D. K. (2000). Think-aloud, thought-listing, and video-mediated recall procedures in the assessment of children’s self-talk. Cognitive Therapy and Research, 24, 399–418.
Man, P. (1991). The influence of peers and parents on youth life satisfaction in Hong Kong. Social Indicators Research, 24, 347–365.
Mayring, P. (2004). Qualitative content analysis. In U. Flick, E. von Kardoff, & I. Steinke (Eds.), A companion to qualitative research (pp. 266–269). London: Sage Publications.
McColl, E., Meadows, K., & Barofsky, I. (2003). Cognitive aspects of survey methodology and quality of life assessment. Quality of Life Research, 12, 217–218.
Messick, S. (1989). Validity. In R. L. Linn (Ed.), Educational measurement (3rd ed., pp. 12–103). New York: Macmillan.
Messick, S. (1995). Validity of psychological assessment: Validation of inferences from person’s responses and performances as scientific inquiry into score meaning. American Psychologist, 50, 741–749.
Michalos, A. C. (1985). Multiple discrepancies theory. Social Indicators Research, 16, 347–413.
Michalos, A. C. (1991). Global report on student well-being: Life satisfaction and happiness (Vol. 1). New York: Springer.
Neuendorf, K. A. (2002). The content analysis guidebook. Thousand Oaks, CA: Sage Publications.
Rebok, G., Riley, A., Forrest, C., Starfield, B., Green, B., Robertson, J., et al. (2001). Elementary school-aged children’s reports of their health: A cognitive interviewing study. Quality of Life Research, 10, 59–70.
Riley, A. W. (2004). Evidence that school-age children can self-report on their health. Ambulatory Pediatrics, 4, 371–376.
Schilling, L. S., Dixon, J. K., Knafl, K. A., Grey, M., Ives, B., & Lynn, M. R. (2007). Determining content validity of a self-report instrument for adolescents using a heterogeneous expert panel. Nursing Research, 56, 361–366.
Schwarz, N. (1999). Self-reports: How the questions shape the answers. American Psychologist, 54, 93–105.
Sirken, M. G., & Schechter, S. (1999). Interdisciplinary survey methods research. In M. G. Sirken, D. J. Herrmann, S. Schechter, N. Schwarz, J. M. Tanur, & R. Tourangeau (Eds.), Cognition and survey research (pp. 1–10). New York: Wiley.
Stewart, J. L., Lynn, M. R., & Mishel, M. H. (2005). Evaluating content validity for children’s self-report instruments using children as content experts. Nursing Research, 54, 414–418.
Stone, W. L., & Lemanek, K. L. (1990). Developmental issues in children’s self-reports. In A. M. La Greca (Ed.), Through the eyes of the child: Obtaining self-reports from children and adolescents. Boston: Allyn & Bacon.
Willis, G. B. (2005). Cognitive interviewing: A tool for improving questionnaire design. Thousand Oaks, CA: Sage Publications.
Willis, G. B., DeMaio, T. J., & Harris-Kojetin, B. (1999). Is the Bandwagon headed to the methodological promised land? Evaluating the validity of cognitive interviewing techniques. In M. G. Sirken, D. J. Herrmann, S. Schechter, N. Schwarz, J. M. Tanur, & R. Tourangeau (Eds.), Cognition and survey research (pp. 133–153). New York: Wiley.
Young, M. H., Miller, B. C., Norton, M. C., & Hill, E. J. (1995). The effect of parental supportive behaviors on life satisfaction of adolescent offspring. Journal of Marriage & Family, 57, 813–822.
Zumbo, B. D. (2007). Validity: Foundational issues and statistical methodology. In C. R. Rao & S. Sinharay (Eds.), Handbook of statistics, Vol. 26: Psychometrics (pp. 45–79). Amsterdam: Elsevier Science B. V.
Zumbo, B. D. (2009). Validity as contextualized and pragmatic explanation, and its implications for validation practice. In R. W. Lissitz (Ed.), The concept of validity: Revisions, new directions and applications (pp. 65–82). Charlotte, NC: Information Age Publishing.
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Gadermann, A.M., Guhn, M. & Zumbo, B.D. Investigating the Substantive Aspect of Construct Validity for the Satisfaction with Life Scale Adapted for Children: A Focus on Cognitive Processes. Soc Indic Res 100, 37–60 (2011). https://doi.org/10.1007/s11205-010-9603-x
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s11205-010-9603-x