Skip to main content
Log in

Satisfaction Ratings of QOLPAV: Psychometric Properties Based on the Graded Response Model

  • Published:
Social Indicators Research Aims and scope Submit manuscript

Abstract

A scale measuring quality of life (QOL) is important in adolescent research. Using the graded response model (GRM), this study evaluates the psychometric properties of the satisfaction ratings of the Quality of Life Profile Adolescent Version (QOLPAV). Data for 1,392 adolescents were used to check IRT assumptions such as unidimensionality and local item dependence (LID). The goodness of fit of the GRM to the data and the item characteristic curves were evaluated. The reliability and validity analyses included item/test information, Cronbach’s α, and convergent and discriminant validity. Differential item functioning (DIF) procedures were also performed to detect item bias. The results provide evidence that the items sufficiently measured one single dimension. Few pairs of questions were flagged as LID due to content or wording similarity. Five items did not fit the GRM, and 4 were low in item discrimination. The findings also suggest that the assessment had appropriate reliability and validity. The DIF impact on the assessment score was considered minor. Because QOLPAV includes a respondent’s perceived importance of various life aspects, a short form that only considers important life aspects in the overall QOL estimation for each respondent becomes feasible within the framework of IRT. Future studies focusing on the development of a QOL overall index using the items from QOLPAV are recommended.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3

Similar content being viewed by others

References

  • Amtmann, D., Cook, K. F., Jensen, M. P., Chen, W.-H., Choi, S., Revicki, D., et al. (2010). Development of a PROMIS item bank to measure pain interference. Pain, 150, 173–182. doi:10.1016/j.pain.2010.04.025.

    Article  Google Scholar 

  • Bjorner, J. B., Smith, K. J., Stone, C., & Sun, X. W. (2007). IRTFIT: A macro for item fit and local dependence tests under IRT models [Computer program]. Lincoln, RI: Quality Metric.

    Google Scholar 

  • Bradford, R., Rutherford, D. L., & John, A. (2002). Quality of life in young people: ratings and factor structure of the quality of life profile-adolescent version. Journal of adolescence, 25, 261–274. doi:10.1006/yjado/469.

    Article  Google Scholar 

  • Browne, M. W., & Cudeck, R. (1993). Alternative ways of assessing model fit. In K. A. Bollen & J. S. Long (Eds.), Testing structural equation models (pp. 136–162). Beverly Hills, CA: Sage.

    Google Scholar 

  • Cook, K. F., Kallen, M. A., & Amtmann, D. (2009). Having a fit: impact of number of items and distribution of data on traditional criteria for assessing IRT’s unidimensionality assumption. [Article]. Quality of Life Research, 18(4), 447–460. doi:10.1007/s11136-009-9464-4.

    Article  Google Scholar 

  • Goldbeck, L., Schmitz, T. G., Besier, T., Herschbach, P., & Henrich, G. (2007). Life satisfaction decreases during adolescence. Quality of Life Research, 16, 969–979. doi:10.1007/s11136-007-9205-5.

    Article  Google Scholar 

  • Gomez, R. (2008). Parent ratings of the ADHD items of the disruptive behavior rating scale: Analyses of their IRT properties based on the generalized partial credit model. Personality and Individual Differences, 45, 181–186.

    Article  Google Scholar 

  • Hays, R. D., Liu, H., Spritzer, K., & Cella, D. (2007). Item response theory analyses of physical functioning items in the medical outcomes study. Medical Care, 45(1), S32–S38.

    Article  Google Scholar 

  • Hill, C. D., Edwards, M. C., Thissen, D., Langer, M. M., Wirth, R. J., Burwinkle, T. M., et al. (2007). Pratical issues in the application of item response theory: A demonstration using items from the pediatric quality of life inventory (PedsQL) 4.0 generic core scales. Medical Care, 45(1), S39–S47. doi:10.1097/01.mlr.0000259879.05499.eb.

    Article  Google Scholar 

  • Hu, L. T., & Bentler, P. M. (1999). Cutoff criteria for fit indices in covariance structure analysis: Conventional criteria versus new alternatives. Structural Equation Model, 6, 1–55.

    Article  Google Scholar 

  • Jöreskog, K., & Sörbom, D. (1993). LISREL8: Structural equation modeling with the command language. Hillsdale, NJ: Erlbaum.

    Google Scholar 

  • Lee, A. H., Meuleners, L. B., & Fraser, M. L. (2009). Adolescent quality of life in Australia. In V. R. Preedy & R. R. Watson (Eds.), Handbook of disease burdens and quality of life measures (pp. 2538–2554). New York: Springer.

    Google Scholar 

  • McDonald, R. P., & Ho, M.-H. (2002). Principles and practice in reporting structural equation analyses. Psychological Methods, 7, 64–82.

    Article  Google Scholar 

  • Meade, A. W. (2010). A taxonomy of effect size measures for the differential functioning of items and scales. Journal of Applied Psychology, 95, 728–743.

    Article  Google Scholar 

  • Meuleners, L. B., & Lee, A. H. (2005). Quality of life profile—Adolescents: Assessing the relationship of covariates to scale scores using structural equation modeling. Quality of Life Research, 14, 1057–1063. doi:10.1007/s11136-004-2573-1.

    Article  Google Scholar 

  • Meuleners, L. B., Lee, A. H., Binns, C. W., & Lower, A. (2003). Quality of life for adolescents: Assessing measurement properties using structural equation modeling. Quality of Life Research, 12, 283–290.

    Article  Google Scholar 

  • Muraki, E., & Bock, R. D. (2003). PARSCALE for windows (version 4.0) [computer software]. Lincolnwood, IL: Scientific Software International.

    Google Scholar 

  • Orlando, M., & Thissen, D. (2000). Likelihood-based item-fit indices for dichotomous item response theory models. Applied Psychological Measurement, 24, 50–64. doi:10.1177/01466216000241003.

    Article  Google Scholar 

  • Orlando, M., & Thissen, D. (2003). Further examination of the performance of S-X2, an item fit index for dichotomous item response theory models. Applied Psychological Measurement, 27, 289–298. doi:10.1177/0146621603027004004.

    Article  Google Scholar 

  • Patrick, D. L., Edwards, T. C., & Topolski, T. D. (2002). Adolescent quality of life, part II: Initial validation of a new instrument. Journal of Adolescence, 25, 287–300. doi:10.1006/yjado/471.

    Article  Google Scholar 

  • Phillips, D. (2006). Quality of life: Concept, policy and practice. New York, NY: Routledge.

    Google Scholar 

  • Raphael, D., Rukholm, E. B., Hill-Bailey, P., & Donato, E. (1996). The quality of life profile-adolescent version: Background, description, and initial validation. Journal of Adolescent Health, 19, 366–375.

    Article  Google Scholar 

  • Reeve, B. B., Hays, R. D., Bjorner, J. B., Cook, K. F., Crane, P. K., Teresi, J. A., et al. (2007). Psychometric evaluation and calibration of health-related quality of life item banks: Plans for the patient-reported outcomes measurement information system (PROMIS). Medical Care, 45(5 Suppl. 1), 22–31. doi:10.1097/01.mlr.0000250483.85507.04.

    Article  Google Scholar 

  • Reise, S. P., Morizot, J., & Hays, R. D. (2007). The role of bifaction model in resolving dimensionality issues in health outcome measures. Quality of Life Research, 16, 19–31. doi:10.1007/s11136-007-9183-7.

    Article  Google Scholar 

  • Renwick, R., & Brown, I. (1996). The centre for health promotion’s conceptual approach to quality of life: being, belonging, and becoming. In R. Renwick, J. Brown, & M. Nagler (Eds.), Quality of life in health promotion and rehabilitation: Conceptual approaches, issues and applications. Thousand Oaks, CA: Sage Publications.

    Google Scholar 

  • Samejima, F. (1969). Estimation of latent ability using a response pattern of graded scores. Psychometrika Monograph Supplement, 17, 34.

    Google Scholar 

  • Shek, D. T. L. (2005). Economic stress, emotional quality of life, and problem behavior in Chinese adolescents with and without economic disadvantage. Social Indicators Research, 71, 363–383. doi:10.1007/1-4020-3602-7_12.

    Article  Google Scholar 

  • Snyder, A. R., Martinez, J. C., Bay, R. C., Parsons, J. T., Sauers, E. L., & McLeod, T. C. V. (2010). Health-related quality of life differs between adolescent athletes and adolescent nonathletes. Journal of Sport Rehabilitation, 19, 237–248.

    Google Scholar 

  • Thissen, D. (2001). Software for the computation of the statistics involved in item response theory likelihood-ratio tests for differential item functioning [computer software]. Chapel Hill: University of North Carolina.

    Google Scholar 

  • Thissen, D., Steinberg, L., & Wainer, H. (1993). Detection of differential item functioning using the parameters of item response models. In P. W. Holland & H. Wainer (Eds.), Differential item functioning (pp. 67–113). Hillsdale, NJ: Erlbaum.

    Google Scholar 

  • Trauer, T., & Mackinnon, A. (2001). Why are we weighting? The role of importance ratings in quality of life measurement. Quality of Life Research, 10, 579–585. doi:10.1023/A:1013159414364.

    Article  Google Scholar 

  • Valois, R. F., Zullig, K. J., Huebner, E. S., & Drane, J. W. (2004). Life satisfaction and suicide among high school adolescents. Social Indicators Research, 66, 81–105. doi:10.1023/B:SOCI.0000007499.19430.2f.

    Article  Google Scholar 

  • Wallander, J. L., Schmitt, M., & Koot, H. M. (2001). Quality of life measurement in children and adolescents: Issues, instruments, and applications. Journal of Clinical Psychology, 57, 571–585. doi:10.1002/jclp.1029.

    Article  Google Scholar 

  • WHOQOL Group. (1994). The development of the WHO quality of life assessment instrument (the WHOQOL). In J. Orley & W. Kuyken (Eds.), Quality of life Assessment: International perspectives (pp. 41–60). Berlin: Springer.

    Chapter  Google Scholar 

  • Zekovic, B., & Renwick, R. (2003). Quality of life for children and adolescents with developmental disabilities: review of conceptual and methodological issues relevant to public policy. Disability and Society, 18, 19–34.

    Article  Google Scholar 

Download references

Acknowledgments

This research was funded by the ROC National Academy of Educational Research (NAER-95-24-A-2-01-00-2-14) and the ROC National Science Council through three projects: “The Net and Taiwan Adolescents’ Physical and Mental Development” (NSC 97-2631-S-009-001), “Internet Use and Well-being of Taiwan Students: Longitudinal Analysis and the Extension of Fact Bank” (NSC-100-2631-S-009-001), and “Internet Use and Its Socio-cultural Impacts on Taiwan Adolescent Students” (NSC 97-2631-S-415-003).

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Fang-Ming Hwang.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Chen, SK., Hwang, FM. & Lin, S.S.J. Satisfaction Ratings of QOLPAV: Psychometric Properties Based on the Graded Response Model. Soc Indic Res 110, 367–383 (2013). https://doi.org/10.1007/s11205-011-9935-1

Download citation

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11205-011-9935-1

Keywords

Navigation