Skip to main content
Top
Gepubliceerd in: Quality of Life Research 9/2016

01-09-2016

Refining a Web-based goal assessment interview: item reduction based on reliability and predictive validity

Auteurs: Carolyn E. Schwartz, Jei Li, Bruce D. Rapkin

Gepubliceerd in: Quality of Life Research | Uitgave 9/2016

Log in om toegang te krijgen
share
DELEN

Deel dit onderdeel of sectie (kopieer de link)

  • Optie A:
    Klik op de rechtermuisknop op de link en selecteer de optie “linkadres kopiëren”
  • Optie B:
    Deel de link per e-mail

Abstract

Background

Goals are an important basis for patients’ cognitive appraisal processes underlying quality-of-life (QOL) assessment because they are the foundation to one’s frame of reference. We sought to identify the best of six goal delineation items and relevant themes for two new versions of the QOL Appraisal Profile: an interview tool using a subset of the best open-ended goal delineation items, and a shorter close-ended version for use in survey research.

Methods

This is a secondary analysis of longitudinal data (n = 1126) of participants in the North American Research Committee on Multiple Sclerosis (MS) registry. The open-ended data were coded by at least two trained coders with moderately high inter-rater agreement. There were 31 themes reflecting goal content such as health, interpersonal, independence, mental health, and financial themes. Descriptive statistics identified most prevalent themes. Reliability analysis (alpha, item-total correlations) and hierarchical linear modeling identified the best goal items.

Results

Based on these qualitative and quantitative analyses, Solve (item 2) is the best single item because it is clear anchor for about a third of the goal themes, and explains the most variance in outcomes and demographic characteristics, suggesting that it taps into and reveals diversity in the sample. The next best items are Accomplish and Maintain (items 1 and 4), which are useful in tapping into and revealing diversity among people reporting cognitive deficits (Accomplish), and demographic factors (both Accomplish and Maintain items).

Conclusions

The goal delineation items identified as best performers in this study will be used to develop a shorter open-ended version of the QOL Appraisal Profile, and an entirely close-ended version of the QOL Appraisal Profile for use in more standard survey research settings. These tools will enable coaching patients in medical decision making as well as investigations of appraisal and response shift in QOL research.
Bijlagen
Alleen toegankelijk voor geautoriseerde gebruikers
Literatuur
1.
go back to reference Rapkin, B. D., & Fischer, K. (1992). Framing the construct of life satisfaction in terms of older adults’ personal goals. Psychology and Aging, 7(1), 138–149.CrossRefPubMed Rapkin, B. D., & Fischer, K. (1992). Framing the construct of life satisfaction in terms of older adults’ personal goals. Psychology and Aging, 7(1), 138–149.CrossRefPubMed
2.
go back to reference Ryff, C. D. (1989). Beyond Ponce de Leon and life satisfaction: New directions in quest of successful ageing. International Journal of Behavioral Development, 12(1), 35–55.CrossRef Ryff, C. D. (1989). Beyond Ponce de Leon and life satisfaction: New directions in quest of successful ageing. International Journal of Behavioral Development, 12(1), 35–55.CrossRef
3.
go back to reference Emmons, R. A. (1986). Personal strivings: An approach to personality and subjective well-being. Journal of Personality and Social Psychology, 51(5), 1058.CrossRef Emmons, R. A. (1986). Personal strivings: An approach to personality and subjective well-being. Journal of Personality and Social Psychology, 51(5), 1058.CrossRef
4.
go back to reference Palys, T. S., & Little, B. R. (1983). Perceived life satisfaction and the organization of personal project systems. Journal of Personality and Social Psychology, 44(6), 1221.CrossRef Palys, T. S., & Little, B. R. (1983). Perceived life satisfaction and the organization of personal project systems. Journal of Personality and Social Psychology, 44(6), 1221.CrossRef
5.
go back to reference Klinger, E., Barta, S. G., & Maxeiner, M. E. (1980). Motivational correlates of thought content frequency and commitment. Journal of Personality and Social Psychology, 39(6), 1222.CrossRef Klinger, E., Barta, S. G., & Maxeiner, M. E. (1980). Motivational correlates of thought content frequency and commitment. Journal of Personality and Social Psychology, 39(6), 1222.CrossRef
6.
go back to reference Rapkin, B. D., & Fischer, K. (1992). Personal goals of older adults: issues in assessment and prediction. Psychology and Aging, 7(1), 127–137.CrossRefPubMed Rapkin, B. D., & Fischer, K. (1992). Personal goals of older adults: issues in assessment and prediction. Psychology and Aging, 7(1), 127–137.CrossRefPubMed
7.
go back to reference Wolfe, J., et al. (2000). Understanding of prognosis among parents of children who died of cancer: Impact on treatment goals and integration of palliative care. Journal of the American Medical Association, 284(19), 2469–2475.CrossRefPubMed Wolfe, J., et al. (2000). Understanding of prognosis among parents of children who died of cancer: Impact on treatment goals and integration of palliative care. Journal of the American Medical Association, 284(19), 2469–2475.CrossRefPubMed
8.
go back to reference Donovan, K. A., et al. (2002). Treatment preferences in recurrent ovarian cancer. Gynecologic Oncology, 86(2), 200–211.CrossRefPubMed Donovan, K. A., et al. (2002). Treatment preferences in recurrent ovarian cancer. Gynecologic Oncology, 86(2), 200–211.CrossRefPubMed
9.
go back to reference Campbell, A., Converse, P. E., & Rodgers, W. L. (1976). The quality of American life. New York: Russell Sage Foundation. Campbell, A., Converse, P. E., & Rodgers, W. L. (1976). The quality of American life. New York: Russell Sage Foundation.
10.
go back to reference Schwartz, C. E., et al. (2002). Early intervention in planning end-of-life care with ambulatory geriatric patients: results of a pilot trial. Archives of Internal Medicine, 162(14), 1611–1618.CrossRefPubMed Schwartz, C. E., et al. (2002). Early intervention in planning end-of-life care with ambulatory geriatric patients: results of a pilot trial. Archives of Internal Medicine, 162(14), 1611–1618.CrossRefPubMed
11.
go back to reference Rollnick, S., & Miller, W. R. (1995). What is motivational interviewing? Behavioural and Cognitive Psychotherapy, 23(04), 325–334.CrossRef Rollnick, S., & Miller, W. R. (1995). What is motivational interviewing? Behavioural and Cognitive Psychotherapy, 23(04), 325–334.CrossRef
12.
go back to reference Messer, S. B., & McWilliams, N. (2007). Insight in psychodynamic therapy: Theory and assessment. In L. G. Castonguay & C. Hill (Eds.), Insight in psychotherapy (pp. 9–29). American Psychological Association: Washington, DC.CrossRef Messer, S. B., & McWilliams, N. (2007). Insight in psychodynamic therapy: Theory and assessment. In L. G. Castonguay & C. Hill (Eds.), Insight in psychotherapy (pp. 9–29). American Psychological Association: Washington, DC.CrossRef
13.
go back to reference Zimmerman, B. J., Bandura, A., & Martinez-Pons, M. (1992). Self-motivation for academic attainment: The role of self-efficacy beliefs and personal goal setting. American Educational Research Journal, 29(3), 663–676.CrossRef Zimmerman, B. J., Bandura, A., & Martinez-Pons, M. (1992). Self-motivation for academic attainment: The role of self-efficacy beliefs and personal goal setting. American Educational Research Journal, 29(3), 663–676.CrossRef
14.
go back to reference Elliot, A. J., et al. (2001). A cross-cultural analysis of avoidance (relative to approach) personal goals. Psychological Science, 12(6), 505–510.CrossRefPubMed Elliot, A. J., et al. (2001). A cross-cultural analysis of avoidance (relative to approach) personal goals. Psychological Science, 12(6), 505–510.CrossRefPubMed
15.
go back to reference Saajanaho, M., et al. (2016). Mobility limitation and changes in personal goals among older women. The Journals of Gerontology Series B: Psychological Sciences and Social Sciences, 71(1), 1–10.CrossRef Saajanaho, M., et al. (2016). Mobility limitation and changes in personal goals among older women. The Journals of Gerontology Series B: Psychological Sciences and Social Sciences, 71(1), 1–10.CrossRef
16.
go back to reference Nie, Y., & Liem, G. A. D. (2013). Extending antecedents of achievement goals: The double-edged sword effect of social-oriented achievement motive and gender differences. Learning and Individual Differences, 23, 249–255.CrossRef Nie, Y., & Liem, G. A. D. (2013). Extending antecedents of achievement goals: The double-edged sword effect of social-oriented achievement motive and gender differences. Learning and Individual Differences, 23, 249–255.CrossRef
17.
go back to reference Twenge, J. M., Campbell, W. K., & Freeman, E. C. (2012). Generational differences in young adults’ life goals, concern for others, and civic orientation, 1966–2009. Journal of Personality and Social Psychology, 102(5), 1045.CrossRefPubMed Twenge, J. M., Campbell, W. K., & Freeman, E. C. (2012). Generational differences in young adults’ life goals, concern for others, and civic orientation, 1966–2009. Journal of Personality and Social Psychology, 102(5), 1045.CrossRefPubMed
18.
go back to reference Gushue, G. V., & Whitson, M. L. (2006). The relationship of ethnic identity and gender role attitudes to the development of career choice goals among black and Latina girls. Journal of counseling psychology, 53(3), 379.CrossRef Gushue, G. V., & Whitson, M. L. (2006). The relationship of ethnic identity and gender role attitudes to the development of career choice goals among black and Latina girls. Journal of counseling psychology, 53(3), 379.CrossRef
19.
go back to reference Morganstern, B. A., et al. (2011). The psychological context of quality of life: a psychometric analysis of a novel idiographic measure of bladder cancer patients’ personal goals and concerns prior to surgery. Health and Quality of Life Outcomes, 9(10), 1. Morganstern, B. A., et al. (2011). The psychological context of quality of life: a psychometric analysis of a novel idiographic measure of bladder cancer patients’ personal goals and concerns prior to surgery. Health and Quality of Life Outcomes, 9(10), 1.
20.
go back to reference Rapkin, B. D., Schwartz, C. E., & Sprangers, M. A. G. (2000). Personal goals and response shifts: understanding the impact of illness and events on the quality of life of people living with AIDS 8400. In C. E. Schwartz & M. A. G. Sprangers (Eds.), Adaptation to changing health: Response shift in quality-of-life research (pp. 53–71). Washington, DC: American Psychological Association.CrossRef Rapkin, B. D., Schwartz, C. E., & Sprangers, M. A. G. (2000). Personal goals and response shifts: understanding the impact of illness and events on the quality of life of people living with AIDS 8400. In C. E. Schwartz & M. A. G. Sprangers (Eds.), Adaptation to changing health: Response shift in quality-of-life research (pp. 53–71). Washington, DC: American Psychological Association.CrossRef
21.
go back to reference Kiresuk, T. J., & Sherman, M. R. E. (1968). Goal attainment scaling: A general method for evaluating comprehensive community mental health programs. Community Mental Health Journal, 4(6), 443–453.CrossRefPubMed Kiresuk, T. J., & Sherman, M. R. E. (1968). Goal attainment scaling: A general method for evaluating comprehensive community mental health programs. Community Mental Health Journal, 4(6), 443–453.CrossRefPubMed
22.
go back to reference Duda, J., & Whitehead, J. (1998). Measurement of goal perspectives in the physical domain. In: J. L. Duda (Ed.), Advances in sport and exercise psychology measurement (pp. 21–48). Duda, J., & Whitehead, J. (1998). Measurement of goal perspectives in the physical domain. In: J. L. Duda (Ed.), Advances in sport and exercise psychology measurement (pp. 21–48).
23.
go back to reference Kiresuk, T. J., Smith, A., & Cardillo, J. E. (2014). Goal attainment scaling: Applications, theory, and measurement. New York: Psychology Press. Kiresuk, T. J., Smith, A., & Cardillo, J. E. (2014). Goal attainment scaling: Applications, theory, and measurement. New York: Psychology Press.
24.
go back to reference Klein, H. J., et al. (2001). The assessment of goal commitment: A measurement model meta-analysis. Organizational Behavior and Human Decision Processes, 85(1), 32–55.CrossRefPubMed Klein, H. J., et al. (2001). The assessment of goal commitment: A measurement model meta-analysis. Organizational Behavior and Human Decision Processes, 85(1), 32–55.CrossRefPubMed
25.
go back to reference Malec, J. F., Smigielski, J. S., & DePompolo, R. W. (1991). Goal attainment scaling and outcome measurement in postacute brain injury rehabilitation. Archives of Physical Medicine and Rehabilitation, 72(2), 138–143.PubMed Malec, J. F., Smigielski, J. S., & DePompolo, R. W. (1991). Goal attainment scaling and outcome measurement in postacute brain injury rehabilitation. Archives of Physical Medicine and Rehabilitation, 72(2), 138–143.PubMed
26.
go back to reference O’Boyle, C. A. (1994). The schedule for the evaluation of individual quality of life (SEIQoL). International Journal of Mental Health, 23(3), 3–23.CrossRef O’Boyle, C. A. (1994). The schedule for the evaluation of individual quality of life (SEIQoL). International Journal of Mental Health, 23(3), 3–23.CrossRef
27.
go back to reference Rapkin, B. D., & Schwartz, C. E. (2004). Toward a theoretical model of quality-of-life appraisal: Implications of findings from studies of response shift. Health and Quality of Life Outcomes, 2(1), 14.CrossRefPubMedPubMedCentral Rapkin, B. D., & Schwartz, C. E. (2004). Toward a theoretical model of quality-of-life appraisal: Implications of findings from studies of response shift. Health and Quality of Life Outcomes, 2(1), 14.CrossRefPubMedPubMedCentral
28.
go back to reference Schwartz, C. E., & Rapkin, B. D. (2012). Understanding appraisal processes underlying the thentest: A mixed methods investigation. Quality of Life Research, 21(3), 381–388.CrossRefPubMed Schwartz, C. E., & Rapkin, B. D. (2012). Understanding appraisal processes underlying the thentest: A mixed methods investigation. Quality of Life Research, 21(3), 381–388.CrossRefPubMed
29.
go back to reference Li, Y., & Rapkin, B. (2009). Classification and regression tree analysis to identify complex cognitive paths underlying quality of life response shifts: A study of individuals living with HIV/AIDS. Journal of Clinical Epidemiology, 62, 1138–1147.CrossRefPubMedPubMedCentral Li, Y., & Rapkin, B. (2009). Classification and regression tree analysis to identify complex cognitive paths underlying quality of life response shifts: A study of individuals living with HIV/AIDS. Journal of Clinical Epidemiology, 62, 1138–1147.CrossRefPubMedPubMedCentral
30.
go back to reference Rapkin, B. D., et al. (1994). Development of the idiographic functional status assessment: A measure of the personal goals and goal attainment activities of people with AIDS. Psychology and Health., 9, 111–129.CrossRef Rapkin, B. D., et al. (1994). Development of the idiographic functional status assessment: A measure of the personal goals and goal attainment activities of people with AIDS. Psychology and Health., 9, 111–129.CrossRef
31.
go back to reference Schwartz, C. E., et al. (2013). Cognitive reserve and appraisal in multiple sclerosis. Multiple Sclerosis and Related Disorders, 2(1), 36–44.CrossRefPubMed Schwartz, C. E., et al. (2013). Cognitive reserve and appraisal in multiple sclerosis. Multiple Sclerosis and Related Disorders, 2(1), 36–44.CrossRefPubMed
32.
go back to reference NMSS. (2005). Multiple sclerosis information sourcebook. New York, NY: Information Resource Center and Library of the National Multiple Sclerosis Society. NMSS. (2005). Multiple sclerosis information sourcebook. New York, NY: Information Resource Center and Library of the National Multiple Sclerosis Society.
33.
go back to reference Rammohan, K. W., & Shoemaker, J. (2010). Emerging multiple sclerosis oral therapies. Neurology, 74(Supplement 1), S47–S53.CrossRefPubMed Rammohan, K. W., & Shoemaker, J. (2010). Emerging multiple sclerosis oral therapies. Neurology, 74(Supplement 1), S47–S53.CrossRefPubMed
34.
go back to reference Tremlett, H., et al. (2010). New perspectives in the natural history of multiple sclerosis. Neurology, 74, 2004–2015.CrossRefPubMed Tremlett, H., et al. (2010). New perspectives in the natural history of multiple sclerosis. Neurology, 74, 2004–2015.CrossRefPubMed
35.
go back to reference Kurtzke, J. F. (1983). Rating neurologic impairment in multiple sclerosis: an expanded disability status scale (EDSS). Neurology, 33(11), 1444–1452.CrossRefPubMed Kurtzke, J. F. (1983). Rating neurologic impairment in multiple sclerosis: an expanded disability status scale (EDSS). Neurology, 33(11), 1444–1452.CrossRefPubMed
36.
go back to reference Cutter, G. R., et al. (1999). Development of a multiple sclerosis functional composite as a clinical trial outcome measure. Brain, 122, 101–112.CrossRef Cutter, G. R., et al. (1999). Development of a multiple sclerosis functional composite as a clinical trial outcome measure. Brain, 122, 101–112.CrossRef
37.
go back to reference Schwartz, C. E., Cole, B. F., & Gelber, R. D. (1995). Measuring patient-centered outcomes in neurologic disease. Extending the Q-TWiST method. Archives of Neurology, 52(8), 754–762.CrossRefPubMed Schwartz, C. E., Cole, B. F., & Gelber, R. D. (1995). Measuring patient-centered outcomes in neurologic disease. Extending the Q-TWiST method. Archives of Neurology, 52(8), 754–762.CrossRefPubMed
38.
go back to reference Schwartz, C. E., & Patrick, D. L. (2014). Composite scores for PRO measures in comparative effectiveness research: Counterbalancing parsimony and dimensionality. Journal of Comparative Effectiveness Research, 3(4), 423–433.CrossRefPubMed Schwartz, C. E., & Patrick, D. L. (2014). Composite scores for PRO measures in comparative effectiveness research: Counterbalancing parsimony and dimensionality. Journal of Comparative Effectiveness Research, 3(4), 423–433.CrossRefPubMed
40.
go back to reference Hays, R. D., Sherbourne, C. D., Mazel, R. M., & User’s Manual for the Medical Outcome Study (MOS). (1995). Core measures of health-related quality of life. Santa Monica, CA: RAND. Hays, R. D., Sherbourne, C. D., Mazel, R. M., & User’s Manual for the Medical Outcome Study (MOS). (1995). Core measures of health-related quality of life. Santa Monica, CA: RAND.
41.
go back to reference Schwartz, C. E., Vollmer, T., & Lee, H. (1999). Reliability and validity of two self-report measures of impairment and disability for MS. North American Research Consortium on Multiple Sclerosis Outcomes Study Group. Neurology, 52(1), 63–70.CrossRefPubMed Schwartz, C. E., Vollmer, T., & Lee, H. (1999). Reliability and validity of two self-report measures of impairment and disability for MS. North American Research Consortium on Multiple Sclerosis Outcomes Study Group. Neurology, 52(1), 63–70.CrossRefPubMed
42.
go back to reference Hohol, M. J., Orav, E. J., & Weiner, H. L. (1995). Disease steps in multiple sclerosis: A simple approach to evaluate disease progression. Neurology, 45, 251–255.CrossRefPubMed Hohol, M. J., Orav, E. J., & Weiner, H. L. (1995). Disease steps in multiple sclerosis: A simple approach to evaluate disease progression. Neurology, 45, 251–255.CrossRefPubMed
43.
go back to reference Sullivan, J. J. L., Edgley, K., & Dehoux, E. (1990). A survey of multiple sclerosis. Part 1: Perceived cognitive problems and compensatory strategy use. Canadian Journal of Rehabilitation, 4, 99–105. Sullivan, J. J. L., Edgley, K., & Dehoux, E. (1990). A survey of multiple sclerosis. Part 1: Perceived cognitive problems and compensatory strategy use. Canadian Journal of Rehabilitation, 4, 99–105.
44.
go back to reference Ryff, C. D. (1989). Happiness is everything, or is it? Explorations on the meaning of psychological well-being. Journal of Personality and Social Psychology, 57, 1069–1081.CrossRef Ryff, C. D. (1989). Happiness is everything, or is it? Explorations on the meaning of psychological well-being. Journal of Personality and Social Psychology, 57, 1069–1081.CrossRef
46.
go back to reference Rapkin, B. D., et al. (2011). User manual for the quality of life appraisal profile. Concord, MA: DeltaQuest Foundation Inc. Rapkin, B. D., et al. (2011). User manual for the quality of life appraisal profile. Concord, MA: DeltaQuest Foundation Inc.
47.
go back to reference Bobinski, J., & Lipinski, M. (2009). EORTC risk tables—A new diagnostic tool in urology. Pol Merkur Lekarski, 27(162), 524–528.PubMed Bobinski, J., & Lipinski, M. (2009). EORTC risk tables—A new diagnostic tool in urology. Pol Merkur Lekarski, 27(162), 524–528.PubMed
48.
go back to reference Corp., I., (2012). IBM SPSS Statistics for Windows. Armonk, NY: IBM Corp. Corp., I., (2012). IBM SPSS Statistics for Windows. Armonk, NY: IBM Corp.
49.
go back to reference Stata 13, (2013). College Station, TX: StataCorp LP. Stata 13, (2013). College Station, TX: StataCorp LP.
50.
go back to reference Matthews, W. B. (Ed.). (1991). McAlpine’s multiple sclerosis (2nd ed.). New York: Churchill Livingstone. Matthews, W. B. (Ed.). (1991). McAlpine’s multiple sclerosis (2nd ed.). New York: Churchill Livingstone.
51.
go back to reference Ware, J. E, Jr, Kosinski, M., & Keller, S. D. (1996). A 12-item short-form health survey. Medical Care, 34(3), 220–233.CrossRefPubMed Ware, J. E, Jr, Kosinski, M., & Keller, S. D. (1996). A 12-item short-form health survey. Medical Care, 34(3), 220–233.CrossRefPubMed
Metagegevens
Titel
Refining a Web-based goal assessment interview: item reduction based on reliability and predictive validity
Auteurs
Carolyn E. Schwartz
Jei Li
Bruce D. Rapkin
Publicatiedatum
01-09-2016
Uitgeverij
Springer International Publishing
Gepubliceerd in
Quality of Life Research / Uitgave 9/2016
Print ISSN: 0962-9343
Elektronisch ISSN: 1573-2649
DOI
https://doi.org/10.1007/s11136-016-1258-x

Andere artikelen Uitgave 9/2016

Quality of Life Research 9/2016 Naar de uitgave