Skip to main content
Log in

Investigating the Substantive Aspect of Construct Validity for the Satisfaction with Life Scale Adapted for Children: A Focus on Cognitive Processes

Social Indicators Research Aims and scope Submit manuscript

Abstract

The objective of this study was to investigate the substantive aspect of construct validity of the Satisfaction with Life Scale adapted for Children (SWLS-C; Gadermann et al. in Soc Indic Res 96:229–247, 2010). Specifically, the study examined the cognitive processes of children when responding to the items of the SWLS-C to find out how they interpret and respond to the items. Think-aloud protocol interviews were conducted with 55 students in grades 4–7 (58% girls, mean age of 11 years, ranging from 8.8 to 12.8 years) and content analysis was used to analyze the data. The findings indicate that most children had no difficulty in understanding the items, and used mainly two strategies for responding to the items: (1) an absolute strategy, in which children used absolute statements to indicate the presence or absence of something that is important for their judgment of their satisfaction with life, and (2) a relative strategy, in which children used relative or comparative statements. In the absolute statements, children primarily referred to social relationships, personal characteristics, time use, and possessions. In the relative statements, the children primarily compared what they have to (a) what they want (b) what they had in the past, (c) what other people have, and (d) what they feel they need. Furthermore, most children considered it important that information on their life satisfaction is obtained. The results are discussed with regard to multiple discrepancies theory (Michalos in Soc Indic Res 16:347–413, 1985) and previous empirical findings. The results provide insights into children’s cognitive processes when responding to items on life satisfaction and provide validity evidence that the SWLS-C is an appropriate measure to assess life satisfaction in children of this age.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8

Similar content being viewed by others

Notes

  1. Two of these children reported having learned English and two other languages at home.

  2. The language label Chinese includes Mandarin, Cantonese, and Taiwanese.

  3. As a result, the sum of all frequencies of the categories is not equal to the sample size of 55.

  4. According to Fig. 8, it appears as if there should be a statistically significant difference in favour of the absolute strategy. Please note that in contrast to the data in Fig. 8, the data for the McNemar test were recoded into binary data, which explains why the test was statistically non-significant.

  5. For the other propositions, please see Michalos (1985).

References

  • American Educational Research Association, American Psychological Association, & National Council on Measurement in Education. (1999). Standards for educational and psychological testing. Washington, DC: American Psychological Association.

    Google Scholar 

  • Barofsky, I., Meadows, K., & McColl, E. (2003). Cognitive aspects of survey methodology and quality of life assessment: Summary of meeting. Quality of Life Research, 12, 281–282.

    Article  Google Scholar 

  • Bee, H. (1989). The developing child (5th ed.). New York: Harper & Row Publishers.

    Google Scholar 

  • Ben-Arieh, A. (2005). Where are the children? Children’s role in measuring and monitoring their well-being. Social Indicators Research, 74, 573–596.

    Article  Google Scholar 

  • Ben-Arieh, A. (2006). Is the study of the “state of our children” changing? Re-visiting after 5 years. Children and Youth Services Review, 28, 799–811.

    Article  Google Scholar 

  • Ben-Arieh, A., & Goerge, R. M. (2001). Beyond the numbers: How do we monitor the state of our children? Children and Youth Services Review, 23, 603–631.

    Article  Google Scholar 

  • Ben-Arieh, A., & Goerge, R. M. (Eds.). (2006). Indicators of children’s well-being: Understanding their role, usage and policy influence. Dordrecht, The Netherlands: Springer Academic Publishers.

    Google Scholar 

  • Ben-Arieh, A., Kaufman, H. N., Andrews, B. A., Goerge, R. M., Lee, B. J., & Aber, J. L. (2001). Measuring and monitoring children’s well-being. Dordrecht, The Netherlands: Kluwer Academic Press.

    Google Scholar 

  • Berg, B. L. (2004). Qualitative research methods for the social sciences (5th ed.). Boston: Pearson Education.

    Google Scholar 

  • Böhm, A. (2004). Theoretical coding: Text analysis in grounded theory. In U. Flick, E. von Kardoff, & I. Steinke (Eds.), A companion to qualitative research (pp. 270–275). London: Sage Publications.

    Google Scholar 

  • Cizek, G. J., Rosenberg, S. L., & Koons, H. H. (2008). Sources of validity evidence for educational and psychological tests. Educational and Psychological Measurement, 68, 397–412.

    Article  Google Scholar 

  • Collins, D. (2003). Pretesting survey instruments: An overview of cognitive methods. Quality of Life Research, 12, 229–238.

    Article  Google Scholar 

  • Cremeens, J., Eiser, C., & Blades, M. (2006a). A qualitative investigation of school-aged children’s answers to items from a generic quality of life measure. Child: Care, Health and Development, 33, 83–89.

    Article  Google Scholar 

  • Cremeens, J., Eiser, C., & Blades, M. (2006b). Characteristics of health-related self-report measures for children aged three to eight years: A review of the literature. Quality of Life Research, 15, 739–754.

    Article  Google Scholar 

  • De Civita, M., Regier, D., Alamgir, A. H., Anis, A. H., Fitzgerald, M. J., & Marra, C. A. (2005). Evaluating health-related quality-of-life studies in paediatric populations. Some conceptual, methodological and developmental considerations and recent applications. Pharmacoeconomics, 23, 659–685.

    Article  Google Scholar 

  • Dew, T., & Huebner, E. S. (1994). Adolescents’ perceived quality of life: An exploratory investigation. Journal of School Psychology, 32, 185–199.

    Article  Google Scholar 

  • Dey, I. (1993). Qualitative data analysis: A user-friendly guide for social scientists. London: Routledge.

    Book  Google Scholar 

  • Diener, E., Emmons, R. A., Larsen, R. J., & Griffin, S. (1985). The Satisfaction with Life Scale. Journal of Personality Assessment, 49, 71–75.

    Article  Google Scholar 

  • Diener, E., Suh, E. M., Lucas, R. E., & Smith, H. L. (1999). Subjective well-being: Three decades of progress. Psychological Bulletin, 125, 276–302.

    Article  Google Scholar 

  • Ericsson, K. A., & Simon, H. A. (1980). Verbal reports as data. Psychological Review, 87, 215–251.

    Article  Google Scholar 

  • Fox, J. E., Houston, B. K., & Pittner, M. S. (1983). Trait anxiety and children’s cognitive behaviors in an evaluative situation. Cognitive Therapy and Research, 7, 149–154.

    Article  Google Scholar 

  • Frones, I. (2007). Theorizing indicators. Social Indicators Research, 83, 5–23.

    Article  Google Scholar 

  • Gadermann, A. M., Schonert-Reichl, K. A., & Zumbo, B. D. (2010). Investigating validity evidence of the Satisfaction with Life Scale adapted for Children. Social Indicators Research, 96, 229–247.

    Article  Google Scholar 

  • Greenspoon, P. J., & Saklofske, D. H. (1997). Validity and reliability of the Multidimensional Students’ Life Satisfaction Scale with Canadian children. Journal of Psychoeducational Assessment, 15, 138–155.

    Article  Google Scholar 

  • Holsti, O. R. (1969). Content analysis for the social sciences and humanities. Reading, MA: Addison-Wesley Publishing Company.

    Google Scholar 

  • Huebner, E. S. (1991). Correlates of life satisfaction in children. School Psychology Quarterly, 6, 103–111.

    Article  Google Scholar 

  • Huebner, E. S., & Alderman, G. L. (1993). Convergent and discriminant validation of a children’s life satisfaction scale: Its relationship to self- and teacher-reported psychological problems and school functioning. Social Indicators Research, 30, 71–82.

    Article  Google Scholar 

  • Huebner, E. S., Drane, W., & Valois, R. F. (2000). Levels and demographic correlates of adolescent life satisfaction reports. School Psychology International, 21, 281–292.

    Article  Google Scholar 

  • Huebner, E. S., Suldo, S. M., Smith, L. C., & McKnight, C. G. (2004). Life satisfaction in children and youth: Empirical foundations and implications for school psychologists. Psychology in the Schools, 41, 81–93.

    Article  Google Scholar 

  • Lodge, J., Harte, D. K., & Tripp, G. (1998). Children’s self-talk under conditions of mild anxiety. Journal of Anxiety Disorders, 12, 153–176.

    Article  Google Scholar 

  • Lodge, J., Tripp, G., & Harte, D. K. (2000). Think-aloud, thought-listing, and video-mediated recall procedures in the assessment of children’s self-talk. Cognitive Therapy and Research, 24, 399–418.

    Article  Google Scholar 

  • Man, P. (1991). The influence of peers and parents on youth life satisfaction in Hong Kong. Social Indicators Research, 24, 347–365.

    Article  Google Scholar 

  • Mayring, P. (2004). Qualitative content analysis. In U. Flick, E. von Kardoff, & I. Steinke (Eds.), A companion to qualitative research (pp. 266–269). London: Sage Publications.

    Google Scholar 

  • McColl, E., Meadows, K., & Barofsky, I. (2003). Cognitive aspects of survey methodology and quality of life assessment. Quality of Life Research, 12, 217–218.

    Article  Google Scholar 

  • Messick, S. (1989). Validity. In R. L. Linn (Ed.), Educational measurement (3rd ed., pp. 12–103). New York: Macmillan.

    Google Scholar 

  • Messick, S. (1995). Validity of psychological assessment: Validation of inferences from person’s responses and performances as scientific inquiry into score meaning. American Psychologist, 50, 741–749.

    Article  Google Scholar 

  • Michalos, A. C. (1985). Multiple discrepancies theory. Social Indicators Research, 16, 347–413.

    Article  Google Scholar 

  • Michalos, A. C. (1991). Global report on student well-being: Life satisfaction and happiness (Vol. 1). New York: Springer.

    Google Scholar 

  • Neuendorf, K. A. (2002). The content analysis guidebook. Thousand Oaks, CA: Sage Publications.

    Google Scholar 

  • Rebok, G., Riley, A., Forrest, C., Starfield, B., Green, B., Robertson, J., et al. (2001). Elementary school-aged children’s reports of their health: A cognitive interviewing study. Quality of Life Research, 10, 59–70.

    Article  Google Scholar 

  • Riley, A. W. (2004). Evidence that school-age children can self-report on their health. Ambulatory Pediatrics, 4, 371–376.

    Article  Google Scholar 

  • Schilling, L. S., Dixon, J. K., Knafl, K. A., Grey, M., Ives, B., & Lynn, M. R. (2007). Determining content validity of a self-report instrument for adolescents using a heterogeneous expert panel. Nursing Research, 56, 361–366.

    Article  Google Scholar 

  • Schwarz, N. (1999). Self-reports: How the questions shape the answers. American Psychologist, 54, 93–105.

    Article  Google Scholar 

  • Sirken, M. G., & Schechter, S. (1999). Interdisciplinary survey methods research. In M. G. Sirken, D. J. Herrmann, S. Schechter, N. Schwarz, J. M. Tanur, & R. Tourangeau (Eds.), Cognition and survey research (pp. 1–10). New York: Wiley.

    Google Scholar 

  • Stewart, J. L., Lynn, M. R., & Mishel, M. H. (2005). Evaluating content validity for children’s self-report instruments using children as content experts. Nursing Research, 54, 414–418.

    Article  Google Scholar 

  • Stone, W. L., & Lemanek, K. L. (1990). Developmental issues in children’s self-reports. In A. M. La Greca (Ed.), Through the eyes of the child: Obtaining self-reports from children and adolescents. Boston: Allyn & Bacon.

    Google Scholar 

  • Willis, G. B. (2005). Cognitive interviewing: A tool for improving questionnaire design. Thousand Oaks, CA: Sage Publications.

    Google Scholar 

  • Willis, G. B., DeMaio, T. J., & Harris-Kojetin, B. (1999). Is the Bandwagon headed to the methodological promised land? Evaluating the validity of cognitive interviewing techniques. In M. G. Sirken, D. J. Herrmann, S. Schechter, N. Schwarz, J. M. Tanur, & R. Tourangeau (Eds.), Cognition and survey research (pp. 133–153). New York: Wiley.

    Google Scholar 

  • Young, M. H., Miller, B. C., Norton, M. C., & Hill, E. J. (1995). The effect of parental supportive behaviors on life satisfaction of adolescent offspring. Journal of Marriage & Family, 57, 813–822.

    Article  Google Scholar 

  • Zumbo, B. D. (2007). Validity: Foundational issues and statistical methodology. In C. R. Rao & S. Sinharay (Eds.), Handbook of statistics, Vol. 26: Psychometrics (pp. 45–79). Amsterdam: Elsevier Science B. V.

    Google Scholar 

  • Zumbo, B. D. (2009). Validity as contextualized and pragmatic explanation, and its implications for validation practice. In R. W. Lissitz (Ed.), The concept of validity: Revisions, new directions and applications (pp. 65–82). Charlotte, NC: Information Age Publishing.

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Anne M. Gadermann.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Gadermann, A.M., Guhn, M. & Zumbo, B.D. Investigating the Substantive Aspect of Construct Validity for the Satisfaction with Life Scale Adapted for Children: A Focus on Cognitive Processes. Soc Indic Res 100, 37–60 (2011). https://doi.org/10.1007/s11205-010-9603-x

Download citation

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11205-010-9603-x

Keywords

Navigation