Abstract
A scale measuring quality of life (QOL) is important in adolescent research. Using the graded response model (GRM), this study evaluates the psychometric properties of the satisfaction ratings of the Quality of Life Profile Adolescent Version (QOLPAV). Data for 1,392 adolescents were used to check IRT assumptions such as unidimensionality and local item dependence (LID). The goodness of fit of the GRM to the data and the item characteristic curves were evaluated. The reliability and validity analyses included item/test information, Cronbach’s α, and convergent and discriminant validity. Differential item functioning (DIF) procedures were also performed to detect item bias. The results provide evidence that the items sufficiently measured one single dimension. Few pairs of questions were flagged as LID due to content or wording similarity. Five items did not fit the GRM, and 4 were low in item discrimination. The findings also suggest that the assessment had appropriate reliability and validity. The DIF impact on the assessment score was considered minor. Because QOLPAV includes a respondent’s perceived importance of various life aspects, a short form that only considers important life aspects in the overall QOL estimation for each respondent becomes feasible within the framework of IRT. Future studies focusing on the development of a QOL overall index using the items from QOLPAV are recommended.
Similar content being viewed by others
References
Amtmann, D., Cook, K. F., Jensen, M. P., Chen, W.-H., Choi, S., Revicki, D., et al. (2010). Development of a PROMIS item bank to measure pain interference. Pain, 150, 173–182. doi:10.1016/j.pain.2010.04.025.
Bjorner, J. B., Smith, K. J., Stone, C., & Sun, X. W. (2007). IRTFIT: A macro for item fit and local dependence tests under IRT models [Computer program]. Lincoln, RI: Quality Metric.
Bradford, R., Rutherford, D. L., & John, A. (2002). Quality of life in young people: ratings and factor structure of the quality of life profile-adolescent version. Journal of adolescence, 25, 261–274. doi:10.1006/yjado/469.
Browne, M. W., & Cudeck, R. (1993). Alternative ways of assessing model fit. In K. A. Bollen & J. S. Long (Eds.), Testing structural equation models (pp. 136–162). Beverly Hills, CA: Sage.
Cook, K. F., Kallen, M. A., & Amtmann, D. (2009). Having a fit: impact of number of items and distribution of data on traditional criteria for assessing IRT’s unidimensionality assumption. [Article]. Quality of Life Research, 18(4), 447–460. doi:10.1007/s11136-009-9464-4.
Goldbeck, L., Schmitz, T. G., Besier, T., Herschbach, P., & Henrich, G. (2007). Life satisfaction decreases during adolescence. Quality of Life Research, 16, 969–979. doi:10.1007/s11136-007-9205-5.
Gomez, R. (2008). Parent ratings of the ADHD items of the disruptive behavior rating scale: Analyses of their IRT properties based on the generalized partial credit model. Personality and Individual Differences, 45, 181–186.
Hays, R. D., Liu, H., Spritzer, K., & Cella, D. (2007). Item response theory analyses of physical functioning items in the medical outcomes study. Medical Care, 45(1), S32–S38.
Hill, C. D., Edwards, M. C., Thissen, D., Langer, M. M., Wirth, R. J., Burwinkle, T. M., et al. (2007). Pratical issues in the application of item response theory: A demonstration using items from the pediatric quality of life inventory (PedsQL) 4.0 generic core scales. Medical Care, 45(1), S39–S47. doi:10.1097/01.mlr.0000259879.05499.eb.
Hu, L. T., & Bentler, P. M. (1999). Cutoff criteria for fit indices in covariance structure analysis: Conventional criteria versus new alternatives. Structural Equation Model, 6, 1–55.
Jöreskog, K., & Sörbom, D. (1993). LISREL8: Structural equation modeling with the command language. Hillsdale, NJ: Erlbaum.
Lee, A. H., Meuleners, L. B., & Fraser, M. L. (2009). Adolescent quality of life in Australia. In V. R. Preedy & R. R. Watson (Eds.), Handbook of disease burdens and quality of life measures (pp. 2538–2554). New York: Springer.
McDonald, R. P., & Ho, M.-H. (2002). Principles and practice in reporting structural equation analyses. Psychological Methods, 7, 64–82.
Meade, A. W. (2010). A taxonomy of effect size measures for the differential functioning of items and scales. Journal of Applied Psychology, 95, 728–743.
Meuleners, L. B., & Lee, A. H. (2005). Quality of life profile—Adolescents: Assessing the relationship of covariates to scale scores using structural equation modeling. Quality of Life Research, 14, 1057–1063. doi:10.1007/s11136-004-2573-1.
Meuleners, L. B., Lee, A. H., Binns, C. W., & Lower, A. (2003). Quality of life for adolescents: Assessing measurement properties using structural equation modeling. Quality of Life Research, 12, 283–290.
Muraki, E., & Bock, R. D. (2003). PARSCALE for windows (version 4.0) [computer software]. Lincolnwood, IL: Scientific Software International.
Orlando, M., & Thissen, D. (2000). Likelihood-based item-fit indices for dichotomous item response theory models. Applied Psychological Measurement, 24, 50–64. doi:10.1177/01466216000241003.
Orlando, M., & Thissen, D. (2003). Further examination of the performance of S-X2, an item fit index for dichotomous item response theory models. Applied Psychological Measurement, 27, 289–298. doi:10.1177/0146621603027004004.
Patrick, D. L., Edwards, T. C., & Topolski, T. D. (2002). Adolescent quality of life, part II: Initial validation of a new instrument. Journal of Adolescence, 25, 287–300. doi:10.1006/yjado/471.
Phillips, D. (2006). Quality of life: Concept, policy and practice. New York, NY: Routledge.
Raphael, D., Rukholm, E. B., Hill-Bailey, P., & Donato, E. (1996). The quality of life profile-adolescent version: Background, description, and initial validation. Journal of Adolescent Health, 19, 366–375.
Reeve, B. B., Hays, R. D., Bjorner, J. B., Cook, K. F., Crane, P. K., Teresi, J. A., et al. (2007). Psychometric evaluation and calibration of health-related quality of life item banks: Plans for the patient-reported outcomes measurement information system (PROMIS). Medical Care, 45(5 Suppl. 1), 22–31. doi:10.1097/01.mlr.0000250483.85507.04.
Reise, S. P., Morizot, J., & Hays, R. D. (2007). The role of bifaction model in resolving dimensionality issues in health outcome measures. Quality of Life Research, 16, 19–31. doi:10.1007/s11136-007-9183-7.
Renwick, R., & Brown, I. (1996). The centre for health promotion’s conceptual approach to quality of life: being, belonging, and becoming. In R. Renwick, J. Brown, & M. Nagler (Eds.), Quality of life in health promotion and rehabilitation: Conceptual approaches, issues and applications. Thousand Oaks, CA: Sage Publications.
Samejima, F. (1969). Estimation of latent ability using a response pattern of graded scores. Psychometrika Monograph Supplement, 17, 34.
Shek, D. T. L. (2005). Economic stress, emotional quality of life, and problem behavior in Chinese adolescents with and without economic disadvantage. Social Indicators Research, 71, 363–383. doi:10.1007/1-4020-3602-7_12.
Snyder, A. R., Martinez, J. C., Bay, R. C., Parsons, J. T., Sauers, E. L., & McLeod, T. C. V. (2010). Health-related quality of life differs between adolescent athletes and adolescent nonathletes. Journal of Sport Rehabilitation, 19, 237–248.
Thissen, D. (2001). Software for the computation of the statistics involved in item response theory likelihood-ratio tests for differential item functioning [computer software]. Chapel Hill: University of North Carolina.
Thissen, D., Steinberg, L., & Wainer, H. (1993). Detection of differential item functioning using the parameters of item response models. In P. W. Holland & H. Wainer (Eds.), Differential item functioning (pp. 67–113). Hillsdale, NJ: Erlbaum.
Trauer, T., & Mackinnon, A. (2001). Why are we weighting? The role of importance ratings in quality of life measurement. Quality of Life Research, 10, 579–585. doi:10.1023/A:1013159414364.
Valois, R. F., Zullig, K. J., Huebner, E. S., & Drane, J. W. (2004). Life satisfaction and suicide among high school adolescents. Social Indicators Research, 66, 81–105. doi:10.1023/B:SOCI.0000007499.19430.2f.
Wallander, J. L., Schmitt, M., & Koot, H. M. (2001). Quality of life measurement in children and adolescents: Issues, instruments, and applications. Journal of Clinical Psychology, 57, 571–585. doi:10.1002/jclp.1029.
WHOQOL Group. (1994). The development of the WHO quality of life assessment instrument (the WHOQOL). In J. Orley & W. Kuyken (Eds.), Quality of life Assessment: International perspectives (pp. 41–60). Berlin: Springer.
Zekovic, B., & Renwick, R. (2003). Quality of life for children and adolescents with developmental disabilities: review of conceptual and methodological issues relevant to public policy. Disability and Society, 18, 19–34.
Acknowledgments
This research was funded by the ROC National Academy of Educational Research (NAER-95-24-A-2-01-00-2-14) and the ROC National Science Council through three projects: “The Net and Taiwan Adolescents’ Physical and Mental Development” (NSC 97-2631-S-009-001), “Internet Use and Well-being of Taiwan Students: Longitudinal Analysis and the Extension of Fact Bank” (NSC-100-2631-S-009-001), and “Internet Use and Its Socio-cultural Impacts on Taiwan Adolescent Students” (NSC 97-2631-S-415-003).
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Chen, SK., Hwang, FM. & Lin, S.S.J. Satisfaction Ratings of QOLPAV: Psychometric Properties Based on the Graded Response Model. Soc Indic Res 110, 367–383 (2013). https://doi.org/10.1007/s11205-011-9935-1
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s11205-011-9935-1