Skip to main content
Original Article

Evaluating the Wording Effect and Psychometric Properties of the Kid-KINDL

Using the Multitrait-Multimethod Approach

Published Online:https://doi.org/10.1027/1015-5759/a000175

Quality of life (QoL) instruments for children provide an important health index for school healthcare professionals to understand students’ overall health status. We investigated the psychometric properties of the Chinese version of the widely used Kid-KINDL and reported on the wording effect of its positively and negatively worded items. A convenience sample of 8- to 12-year-old students (n = 443) completed the Kid-KINDL; 89 of them completed it again 7–14 days later. The internal consistency was satisfactory in the total score (α = .87) and two subscales (α = .704 [emotional] and .853 [self-esteem]), but unsatisfactory for the other subscales (α = .578 [physical], .533 [friend], .520 [family], and .560 [school]). Test-retest reliability was acceptable in all the subscales and the total score (ICC > .6). A multitrait-multimethod design using several confirmatory factor analysis models confirmed the construct validity of the Kid-KINDL when the wording effect was taken into account (GFI = .912–.934, TLI = .889–.930, CFI = 0.910–.947, IFI = 0.912–0.948, RMSEA = 0.045–0.057, SRMR = .045–.056). We conclude that the Kid-KINDL is a reliable and valid tool for teachers to use to evaluate students’ QoL if the total score is used.

References

  • Anastasi, A. (1982). Psychological testing (5th ed.). New York, NY: Macmillan. First citation in articleGoogle Scholar

  • Bollen, K. A. (1989). Structural equations with latent variables. New York, NY: Wiley. First citation in articleCrossrefGoogle Scholar

  • Cantril, H. (1940). Experiments in the wording of questions. Public Opinion Quarterly, 4, 330–332. First citation in articleCrossrefGoogle Scholar

  • Chan, K. S. , Mangione-Smith, R. , Burwinkle, T. M. , Rosen, M. , Varni, J. W. (2005). The PedsQLTM reliability and validity of the short-form generic core scales and asthma module. Medical Care, 43, 256–265. First citation in articleCrossrefGoogle Scholar

  • Chen, Y.-H. , Rendina-Gobioff, G. , Dedrick, R. F. (2010). Factorial invariance of a Chinese Self-Esteem Scale for third and sixth grade students: Evaluating method effects associated with positively and negatively worded items. The International Journal of Educational and Psychological Assessment, 6, 21–35. First citation in articleGoogle Scholar

  • Eid, M. (2000). A multitrait-multimethod model with minimal assumptions. Psychometrika, 65, 241–261. First citation in articleCrossrefGoogle Scholar

  • Erhart, M. , Ellert, U. , Kurth, B. M. , Ravens-Sieberer, U. (2009). Measuring adolescents’ HRQoL via self reports and parent proxy reports: An evaluation of the psychometric properties of both versions of the KINDL-R instrument. Health and Quality of Life Outcomes, 7, 77. First citation in articleCrossrefGoogle Scholar

  • Gana, K. , Martin, B. , Canouet, M.-D. , Trouillet, R. , Meloni, F. (2002). Factorial structure of a French version of the Penn State Worry Questionnaire. European Journal of Psychological Assessment, 18, 158–164. doi: 10.1027//1015-5759.18.2.158 First citation in articleLinkGoogle Scholar

  • Helseth, S. , Lund, T. (2005). Assessing health-related quality of life in adolescents: Some psychometric properties of the first Norwegian version of KINDL. Scandinavian Journal of Caring Sciences, 19, 102–109. First citation in articleCrossrefGoogle Scholar

  • Hoyle, R. H. , Panter, A. T. (1995). Writing about Structural Equation Modeling. In R. H. Hoyle, (Ed.), Structural Equation Modeling: Concepts, issues, and application (pp. 158–176). Thousand Oaks, CA: Sage. First citation in articleGoogle Scholar

  • Jackson, D. N. , Messick, S. (1958). Content and style in personality assessment. Psychological Bulletin, 55, 243–252. First citation in articleCrossrefGoogle Scholar

  • Jöreskog, K. G. , Sörbom, D. (1982). Recent developments in Structural Equation Modeling. Journal of Marketing Research, 19, 404–416. First citation in articleCrossrefGoogle Scholar

  • Kline, R. B. (2005). Principles and practice of Structural Equation Modeling (2nd ed.). New York, NY: Guilford Press. First citation in articleGoogle Scholar

  • Lee, P.-H. , Chang, L.-I. , Ravens-Sieberer, U. (2008). Psychometric evaluation of the Taiwanese version of the Kiddo-KINDL generic children’s health-related Quality of Life instrument. Quality of Life Research, 17, 603–611. First citation in articleCrossrefGoogle Scholar

  • Lin, C.-Y. , Luh, W.-M. , Cheng, C.-P. , Yang, A.-L. , Su, C.-T. , Ma, H.-I. (in press). Measurement equivalence across child self-reports and parent-proxy reports in the Chinese version of the Pediatric Quality of Life Inventory Version 4.0. Child Psychiatry and Human Development. First citation in articleGoogle Scholar

  • Lin, C.-Y. , Luh, W.-M. , Yang, A.-L. , Su, C.-T. , Wang, J.-D. , Ma, H.-I. (2012). Psychometric properties and gender invariance of the Chinese version of the self-report Pediatric Quality of Life Inventory Version 4.0: Short form is acceptable. Quality of Life Research, 21, 177–182. First citation in articleCrossrefGoogle Scholar

  • Lin, C.-Y. , Su, C.-T. , Ma, H.-I. (2012). Physical activity patterns and quality of life of overweight boys: A preliminary study: A preliminary study. Hong Kong Journal of Occupational Therapy, 22, 31–37. First citation in articleCrossrefGoogle Scholar

  • Marsh, H. W. (1996). Positive and negative global self-esteem: A substantively meaningful distinction or artifactors? Journal of Personality and Social Psychology, 70, 810–819. First citation in articleCrossrefGoogle Scholar

  • Marsh, H. W. , Grayson, D. (1995). Latent variable models of multitrait-multimethod data. In R. H. Hoyle, (Ed.), Structural Equation Modeling: Concepts, issues, and applications (pp. 177–198). Thousand Oaks, CA: Sage. First citation in articleGoogle Scholar

  • Motl, R. W. , DiStefano, C. (2002). Longitudinal invariance of self-esteem and method effects associated with negatively worded items. Structural Equation Modeling, 9, 562–578. First citation in articleCrossrefGoogle Scholar

  • Nunnally, J. (1978). Psychometric theory (2nd ed.). New York, NY: McGraw-Hill. First citation in articleGoogle Scholar

  • Podsakoff, P. M. , MacKenzie, S. B. , Lee, J.-Y. , Podsakoff, N. P. (2003). Common method biases in behavioral research: A critical review of the literature and recommended remedies. Journal of Applied Psychology, 88, 879–903. First citation in articleCrossrefGoogle Scholar

  • Ravens-Sieberer, U. , Bullinger, M. (1998). Assessing health-related quality of life in chronically ill children with the German KINDL: First psychometric and content analytical results. Quality of Life Research, 7, 399–407. First citation in articleCrossrefGoogle Scholar

  • Ravens-Sieberer, U. , Bullinger, M. (2000). KINDLR-questionnaire for measuring health-related quality of life in children and adolescents: Revised Version Manual. Retrieved from http://www.kindl.org/daten/pdf/ManEnglish.pdf. First citation in articleGoogle Scholar

  • Ravens-Sieberer, U. , Erhart, M. , Wille, N. , Wetzel, R. , Nickel, J. , Bullinger, M. (2006). Generic health-related quality-of-life assessment in children and adolescents: Methodological considerations. Pharmacoeconomics, 24, 1199–1220. First citation in articleCrossrefGoogle Scholar

  • Roper, E. (1940). Wording questions for the polls. Public Opinion Quarterly, 4, 129–130. First citation in articleCrossrefGoogle Scholar

  • Rugg, D. (1941). Experiments in wording questions: II. Public Opinion Quarterly, 5, 91–92. First citation in articleCrossrefGoogle Scholar

  • Salek, S. (1998). Compendium of Quality of Life instruments. Chichester, NY: Wiley. First citation in articleGoogle Scholar

  • Schweizer, K. (2010). Some guidelines concerning the modeling of traits and abilities in test construction. European Journal of Psychological Assessment, 26, 1–2. First citation in articleLinkGoogle Scholar

  • Schumann, H. , Presser, S. (1977). Question wording as an independent variable in survey analysis. Sociological Methods and Research, 6, 151–170. First citation in articleCrossrefGoogle Scholar

  • Stevanovic, D. (2009). Serbian KINDL questionnaire for Quality of Life assessments in healthy children and adolescents: Reproducibility and construct validity. Health and Quality of Life Outcomes, 7, 79. First citation in articleCrossrefGoogle Scholar

  • Stevanovic, D. , Lakic, A. , Vilotic, J. (2009). The psychometric study of the Serbian KINDL questionnaire for health-related Quality of Life assessment in children and adolescents. Scandinavian Journal of Caring Science, 23, 361–368. First citation in articleCrossrefGoogle Scholar

  • Wee, H. L. , Lee, W. W. R. , Ravens-Sieberer, U. , Erhart, M. , Li, S. C. (2005). Validation of the English version of the KINDL generic children’s health-related Quality of Life instrument for an Asian population – results from a pilot test. Quality of Life Research, 14, 1193–1200. First citation in articleCrossrefGoogle Scholar

  • Wee, H.-L. , Ravens-Sieberer, U. , Erhart, M. , Li, S.-C. (2007). Factor structure of the Singapore English version of the KINDL children Quality of Life questionnaire. Health and Quality of Life Outcomes, 5, 4. First citation in articleCrossrefGoogle Scholar

  • World Health Organization . (1993). Study protocol for the World Health Organization project to develop a Quality of Life assessment instrument (WHOQOL). Quality of Life Research, 2, 153–159. First citation in articleCrossrefGoogle Scholar