Skip to main content
Top
Gepubliceerd in: Quality of Life Research 3/2016

01-03-2016 | Special Section: PROs in Non-Standard Settings (by invitation only)

Advantages and psychometric validation of proximal intensive assessments of patient-reported outcomes collected in daily life

Auteurs: Eve B. Carlson, Nigel P. Field, Josef I. Ruzek, Richard A. Bryant, Constance J. Dalenberg, Terrence M. Keane, David A. Spain

Gepubliceerd in: Quality of Life Research | Uitgave 3/2016

Log in om toegang te krijgen
share
DELEN

Deel dit onderdeel of sectie (kopieer de link)

  • Optie A:
    Klik op de rechtermuisknop op de link en selecteer de optie “linkadres kopiëren”
  • Optie B:
    Deel de link per e-mail

Abstract

Objectives

Ambulatory assessment data collection methods are increasingly used to study behavior, experiences, and patient-reported outcomes (PROs), such as emotions, cognitions, and symptoms in clinical samples. Data collected close in time at frequent and fixed intervals can assess PROs that are discrete or changing rapidly and provide information about temporal dynamics or mechanisms of change in clinical samples and individuals, but clinical researchers have not yet routinely and systematically investigated the reliability and validity of such measures or their potential added value over conventional measures. The present study provides a comprehensive, systematic evaluation of the psychometrics of several proximal intensive assessment (PIA) measures in a clinical sample and investigates whether PIA appears to assess meaningful differences in phenomena over time.

Methods

Data were collected on a variety of psychopathology constructs on handheld devices every 4 h for 7 days from 62 adults recently exposed to traumatic injury of themselves or a family member. Data were also collected on standard self-report measures of the same constructs at the time of enrollment, 1 week after enrollment, and 2 months after injury.

Results

For all measure scores, results showed good internal consistency across items and within persons over time, provided evidence of convergent, divergent, and construct validity, and showed significant between- and within-subject variability.

Conclusions

Results indicate that PIA measures can provide valid measurement of psychopathology in a clinical sample. PIA may be useful to study mechanisms of change in clinical contexts, identify targets for change, and gauge treatment progress.
Literatuur
1.
go back to reference Schwarz, N. (2012). Why researchers should think “real-time”: A cognitive rationale. In M. R. Mehl & T. S. Conner (Eds.), Handbook of research methods for studying daily life (pp. 22–42). New York: Guilford Press. Schwarz, N. (2012). Why researchers should think “real-time”: A cognitive rationale. In M. R. Mehl & T. S. Conner (Eds.), Handbook of research methods for studying daily life (pp. 22–42). New York: Guilford Press.
2.
go back to reference Reis, H. T., & Gable, S. L. (2000). Event-sampling and other methods for studying everyday experience. In H. T. Reis & C. M. Judd (Eds.), Handbook of research methods for social and personality psychology (pp. 190–222). New York: Wiley. Reis, H. T., & Gable, S. L. (2000). Event-sampling and other methods for studying everyday experience. In H. T. Reis & C. M. Judd (Eds.), Handbook of research methods for social and personality psychology (pp. 190–222). New York: Wiley.
3.
go back to reference Nezlek, J. B. (2012). Diary methods for personality and social psychology. Los Angeles: Sage. Nezlek, J. B. (2012). Diary methods for personality and social psychology. Los Angeles: Sage.
4.
go back to reference Myin-Germeys, I., Oorschot, M., Collip, D., Lataster, J., Delespaul, P., & van Os, J. (2009). Experience sampling research in psychopathology: Opening the black box of daily life. Psychological Medicine, 39(9), 1533–1547.CrossRefPubMed Myin-Germeys, I., Oorschot, M., Collip, D., Lataster, J., Delespaul, P., & van Os, J. (2009). Experience sampling research in psychopathology: Opening the black box of daily life. Psychological Medicine, 39(9), 1533–1547.CrossRefPubMed
5.
go back to reference Shrout, P. E., & Lane, S. P. (2012). Psychometrics. In M. R. Mehl & T. S. Conner (Eds.), Handbook of research methods for studying daily life (pp. 302–320). New York: Guilford. Shrout, P. E., & Lane, S. P. (2012). Psychometrics. In M. R. Mehl & T. S. Conner (Eds.), Handbook of research methods for studying daily life (pp. 302–320). New York: Guilford.
6.
go back to reference Kashdan, T. B., & Nezlek, J. B. (2012). Whether, when, and how is spirituality related to well-being? Moving beyond single occasion questionnaires to understanding daily process. Personality and Social Psychology Bulletin, 38, 1523–1535.CrossRefPubMed Kashdan, T. B., & Nezlek, J. B. (2012). Whether, when, and how is spirituality related to well-being? Moving beyond single occasion questionnaires to understanding daily process. Personality and Social Psychology Bulletin, 38, 1523–1535.CrossRefPubMed
7.
go back to reference Nezlek, J. B., Sorrentino, R. M., Yasunaga, S., Otsubo, Y., Allen, M., Kouhara, S., & Shuper, P. (2008). Cross-cultural differences in reactions to daily events as indicators of cross-cultural differences in self-construction and affect. Journal of Cross-Cultural Psychology, 39, 685–702.CrossRef Nezlek, J. B., Sorrentino, R. M., Yasunaga, S., Otsubo, Y., Allen, M., Kouhara, S., & Shuper, P. (2008). Cross-cultural differences in reactions to daily events as indicators of cross-cultural differences in self-construction and affect. Journal of Cross-Cultural Psychology, 39, 685–702.CrossRef
8.
go back to reference Nezlek, J. B., & Gable, S. L. (2001). Depression as a moderator of relationships between positive daily events and day-to-day psychological adjustment. Personality and Social Psychology Bulletin, 27, 1692–1704.CrossRef Nezlek, J. B., & Gable, S. L. (2001). Depression as a moderator of relationships between positive daily events and day-to-day psychological adjustment. Personality and Social Psychology Bulletin, 27, 1692–1704.CrossRef
9.
go back to reference Wilhelm, P., & Schoebi, D. (2007). Assessing mood in daily life: Structural validity, sensitivity to change, and reliability of a short-scale to measure three basic dimensions of mood. European Journal of Psychological Assessment, 23, 258–267.CrossRef Wilhelm, P., & Schoebi, D. (2007). Assessing mood in daily life: Structural validity, sensitivity to change, and reliability of a short-scale to measure three basic dimensions of mood. European Journal of Psychological Assessment, 23, 258–267.CrossRef
10.
go back to reference Kimhy, D., Delespaul, P., Corcoran, C., Ahn, H., Yale, S., & Malaspina, D. (2006). Computerized experience sampling method (ESMc): Assessing feasibility and validity among individuals with schizophrenia. Journal of Psychiatric Research, 40, 221–230.CrossRefPubMedPubMedCentral Kimhy, D., Delespaul, P., Corcoran, C., Ahn, H., Yale, S., & Malaspina, D. (2006). Computerized experience sampling method (ESMc): Assessing feasibility and validity among individuals with schizophrenia. Journal of Psychiatric Research, 40, 221–230.CrossRefPubMedPubMedCentral
11.
go back to reference Granholm, E., Loh, C., & Swendsen, J. (2008). Feasibility and validity of computerized ecological momentary assessment in schizophrenia. Schizophrenia Bulletin, 34, 507–514.CrossRefPubMedPubMedCentral Granholm, E., Loh, C., & Swendsen, J. (2008). Feasibility and validity of computerized ecological momentary assessment in schizophrenia. Schizophrenia Bulletin, 34, 507–514.CrossRefPubMedPubMedCentral
12.
go back to reference Kimhy, D., Delespaul, P., Ahn, H., Cai, S., Shikhman, M., Lieberman, J. A., et al. (2010). Concurrent measurement of “real-world” stress and arousal in individuals with psychosis: Assessing the feasibility and validity of a novel methodology. Schizophrenia Bulletin, 36, 1131–1139.CrossRefPubMedPubMedCentral Kimhy, D., Delespaul, P., Ahn, H., Cai, S., Shikhman, M., Lieberman, J. A., et al. (2010). Concurrent measurement of “real-world” stress and arousal in individuals with psychosis: Assessing the feasibility and validity of a novel methodology. Schizophrenia Bulletin, 36, 1131–1139.CrossRefPubMedPubMedCentral
13.
go back to reference Wheeler, L., & Reis, H. T. (1991). Self-recording of everyday life events: Origins, types, and uses. Journal of Personality, 59, 339–354.CrossRef Wheeler, L., & Reis, H. T. (1991). Self-recording of everyday life events: Origins, types, and uses. Journal of Personality, 59, 339–354.CrossRef
14.
go back to reference Csikszentmihalyi, M., & Larson, R. (1987). Validity and reliability of the experience-sampling method. Journal of Nervous and Mental Disease, 175(9), 526–536.CrossRefPubMed Csikszentmihalyi, M., & Larson, R. (1987). Validity and reliability of the experience-sampling method. Journal of Nervous and Mental Disease, 175(9), 526–536.CrossRefPubMed
15.
go back to reference Stone, A. A., & Shiffman, S. (1994). Ecological momentary assessment in behavioral medicine. Annals of Behavioral Medicine, 16, 199–202. Stone, A. A., & Shiffman, S. (1994). Ecological momentary assessment in behavioral medicine. Annals of Behavioral Medicine, 16, 199–202.
16.
go back to reference Ariely, D., & Carmon, Z. (2000). Gestalt characteristics of experiences: The defining features of summarized events. Journal of Behavioral Decision Making, 13, 191–201.CrossRef Ariely, D., & Carmon, Z. (2000). Gestalt characteristics of experiences: The defining features of summarized events. Journal of Behavioral Decision Making, 13, 191–201.CrossRef
17.
go back to reference Redelmeier, D. A., & Kahneman, D. (1996). Patients’ memories of painful medical treatments: Real-time and retrospective evaluations of two minimally invasive procedures. Pain, 66, 3–8.CrossRefPubMed Redelmeier, D. A., & Kahneman, D. (1996). Patients’ memories of painful medical treatments: Real-time and retrospective evaluations of two minimally invasive procedures. Pain, 66, 3–8.CrossRefPubMed
18.
go back to reference Redelmeier, D. A., Katz, J., & Kahneman, D. (2003). Memories of colonoscopy: A randomized trial. Pain, 104, 187–194.CrossRefPubMed Redelmeier, D. A., Katz, J., & Kahneman, D. (2003). Memories of colonoscopy: A randomized trial. Pain, 104, 187–194.CrossRefPubMed
19.
go back to reference Kamarck, T. W., Shiffman, S., Muldoon, M. F., Sutton-Tyrrell, K., Gwaltney, C. J., Janicki, D. L., & Schwartz, J. E. (2007). Ecological momentary assessment as a resource for social epidemiology. In A. A. Stone, S. Shiffman, A. Atienza, & L. Nebeling (Eds.), The science of real-time data capture: Self-reports in health research (pp. 268–285). New York: Oxford University Press. Kamarck, T. W., Shiffman, S., Muldoon, M. F., Sutton-Tyrrell, K., Gwaltney, C. J., Janicki, D. L., & Schwartz, J. E. (2007). Ecological momentary assessment as a resource for social epidemiology. In A. A. Stone, S. Shiffman, A. Atienza, & L. Nebeling (Eds.), The science of real-time data capture: Self-reports in health research (pp. 268–285). New York: Oxford University Press.
20.
go back to reference Carlson, E. B. (2001). Psychometric study of a brief screen for PTSD: Assessing the impact of multiple traumatic events. Assessment, 8, 431–441.CrossRefPubMed Carlson, E. B. (2001). Psychometric study of a brief screen for PTSD: Assessing the impact of multiple traumatic events. Assessment, 8, 431–441.CrossRefPubMed
21.
go back to reference Caspi, Y., Carlson, E. B., & Klein, E. (2007). Validation of a screening instrument for posttraumatic stress disorder in a community sample of Bedouin men serving in the Israeli Defense Forces. Journal of Traumatic Stress, 20, 529–539.CrossRef Caspi, Y., Carlson, E. B., & Klein, E. (2007). Validation of a screening instrument for posttraumatic stress disorder in a community sample of Bedouin men serving in the Israeli Defense Forces. Journal of Traumatic Stress, 20, 529–539.CrossRef
22.
go back to reference Carlson, E. B., Waelde, L., Palmieri, P. A., Smith, S. R., McDade-Montez, E., & Macia, K. (in press). Development and validation of the Dissociative Symptoms Scale. Assessment. Carlson, E. B., Waelde, L., Palmieri, P. A., Smith, S. R., McDade-Montez, E., & Macia, K. (in press). Development and validation of the Dissociative Symptoms Scale. Assessment.
23.
go back to reference Ehlers, A., & Clark, D. M. (2000). A cognitive model of posttraumatic stress disorder. Behaviour Research and Therapy, 38, 319–345.CrossRefPubMed Ehlers, A., & Clark, D. M. (2000). A cognitive model of posttraumatic stress disorder. Behaviour Research and Therapy, 38, 319–345.CrossRefPubMed
24.
go back to reference Stanton, A. L., Kirk, S. B., Cameron, C. L., & Danoff-Burg, S. (2000). Coping through emotional approach: Scale construction and validation. Journal of Personality and Social Psychology, 78, 1150–1169.CrossRefPubMed Stanton, A. L., Kirk, S. B., Cameron, C. L., & Danoff-Burg, S. (2000). Coping through emotional approach: Scale construction and validation. Journal of Personality and Social Psychology, 78, 1150–1169.CrossRefPubMed
25.
go back to reference Foa, E. B., Ehlers, A., Clark, D. M., Tolin, D. F., & Orsillo, S. M. (1999). The posttraumatic cognitions inventory (PTCI): Development and validation. Psychological Assessment, 11, 303–314.CrossRef Foa, E. B., Ehlers, A., Clark, D. M., Tolin, D. F., & Orsillo, S. M. (1999). The posttraumatic cognitions inventory (PTCI): Development and validation. Psychological Assessment, 11, 303–314.CrossRef
26.
go back to reference Bolton, E. E., Glenn, D. M., Orsillo, S., Roemer, L., & Litz, B. T. (2003). The relationship between self-disclosure and symptoms of posttraumatic stress disorder in peacekeepers deployed to Somalia. Journal of Traumatic Stress, 16, 203–210.CrossRefPubMed Bolton, E. E., Glenn, D. M., Orsillo, S., Roemer, L., & Litz, B. T. (2003). The relationship between self-disclosure and symptoms of posttraumatic stress disorder in peacekeepers deployed to Somalia. Journal of Traumatic Stress, 16, 203–210.CrossRefPubMed
27.
go back to reference Cordova, M. J., Ruzek, J. I., Benoit, M., & Brunet, A. (2003). Promotion of emotional disclosure following illness and injury: A brief intervention for medical patients and their families. Cognitive and Behavioral Practice, 10, 358–371.CrossRef Cordova, M. J., Ruzek, J. I., Benoit, M., & Brunet, A. (2003). Promotion of emotional disclosure following illness and injury: A brief intervention for medical patients and their families. Cognitive and Behavioral Practice, 10, 358–371.CrossRef
28.
go back to reference Emmons, R. A., McCullough, M. E., & Tsang, J.-A. (2003). The assessment of gratitude. In S. J. Lopez & C. R. Snyder (Eds.), Positive psychological assessment: A handbook of models and measures (pp. 327–341). Washington, DC: American Psychological Association.CrossRef Emmons, R. A., McCullough, M. E., & Tsang, J.-A. (2003). The assessment of gratitude. In S. J. Lopez & C. R. Snyder (Eds.), Positive psychological assessment: A handbook of models and measures (pp. 327–341). Washington, DC: American Psychological Association.CrossRef
29.
go back to reference Feldman Barrett, E., & Barrett, D. J. (1999). Experience sampling program. Boston: Boston College. Feldman Barrett, E., & Barrett, D. J. (1999). Experience sampling program. Boston: Boston College.
30.
go back to reference Jacobs, N., Nicolson, N., Derom, C., Delespaul, P., van Os, J., & Myin-Germeys, I. (2005). Electronic monitoring of salivary cortisol sampling compliance in daily life. Life Sciences, 76, 2431–2443.CrossRefPubMed Jacobs, N., Nicolson, N., Derom, C., Delespaul, P., van Os, J., & Myin-Germeys, I. (2005). Electronic monitoring of salivary cortisol sampling compliance in daily life. Life Sciences, 76, 2431–2443.CrossRefPubMed
31.
go back to reference Wichers, M. C., Myin-Germeys, I., Jacobs, N., Peeters, F., Kenis, G., Derom, C., et al. (2007). Evidence that moment-to-moment variation in positive emotions buffer genetic risk for depression: A momentary assessment twin study. Acta Psychiatrica Scandinavica, 115, 451–457.CrossRefPubMed Wichers, M. C., Myin-Germeys, I., Jacobs, N., Peeters, F., Kenis, G., Derom, C., et al. (2007). Evidence that moment-to-moment variation in positive emotions buffer genetic risk for depression: A momentary assessment twin study. Acta Psychiatrica Scandinavica, 115, 451–457.CrossRefPubMed
32.
go back to reference Delespaul, P., deVries, M., & Van Os, J. (2002). Determinants of occurrence and recovery from hallucinations in daily life. Social Psychiatry and Psychiatric Epidemiology, 37, 97–104.CrossRefPubMed Delespaul, P., deVries, M., & Van Os, J. (2002). Determinants of occurrence and recovery from hallucinations in daily life. Social Psychiatry and Psychiatric Epidemiology, 37, 97–104.CrossRefPubMed
33.
go back to reference Myin-Germeys, I., van Os, J., Schwartz, J. E., Stone, A. A., & Delespaul, P. A. (2001). Emotional reactivity to daily life stress in psychosis. Archives of General Psychiatry, 58(12), 1137–1144.CrossRefPubMed Myin-Germeys, I., van Os, J., Schwartz, J. E., Stone, A. A., & Delespaul, P. A. (2001). Emotional reactivity to daily life stress in psychosis. Archives of General Psychiatry, 58(12), 1137–1144.CrossRefPubMed
34.
go back to reference Geschwind, N., Peeters, F., Jacobs, N., Delespaul, P., Derom, C., Thiery, E., et al. (2010). Meeting risk with resilience: High daily life reward experience preserves mental health. Acta Psychiatra Scandinavica, 122, 129–138.CrossRef Geschwind, N., Peeters, F., Jacobs, N., Delespaul, P., Derom, C., Thiery, E., et al. (2010). Meeting risk with resilience: High daily life reward experience preserves mental health. Acta Psychiatra Scandinavica, 122, 129–138.CrossRef
35.
go back to reference Nezlek, J. B. (2011). Mutilevel modeling for social and personality psychology. Los Angeles: Sage. Nezlek, J. B. (2011). Mutilevel modeling for social and personality psychology. Los Angeles: Sage.
36.
go back to reference Singer, J. D., & Willett, J. B. (2003). Applied longitudinal data analysis: Modeling change and event occurrence. New York: Oxford University Press.CrossRef Singer, J. D., & Willett, J. B. (2003). Applied longitudinal data analysis: Modeling change and event occurrence. New York: Oxford University Press.CrossRef
37.
go back to reference Dalenberg, C. J., & Carlson, E. B. (2012). Dissociation in posttraumatic stress disorder part II: How theoretical models fit the empirical evidence and recommendations for modifying the diagnostic criteria for PTSD. Psychological Trauma, 4, 551–559.CrossRef Dalenberg, C. J., & Carlson, E. B. (2012). Dissociation in posttraumatic stress disorder part II: How theoretical models fit the empirical evidence and recommendations for modifying the diagnostic criteria for PTSD. Psychological Trauma, 4, 551–559.CrossRef
38.
go back to reference Breslau, N., Kessler, R. C., Chilcoat, H. D., Schultz, L. R., Davis, G. C., & Andreski, P. (1998). Trauma and posttraumatic stress disorder in the community: The 1996 Detroit Area Survey of Trauma. Archives of General Psychiatry, 55, 626–631.CrossRefPubMed Breslau, N., Kessler, R. C., Chilcoat, H. D., Schultz, L. R., Davis, G. C., & Andreski, P. (1998). Trauma and posttraumatic stress disorder in the community: The 1996 Detroit Area Survey of Trauma. Archives of General Psychiatry, 55, 626–631.CrossRefPubMed
39.
go back to reference Carlson, E. B., Dalenberg, C. J., & McDade-Montez, E. (2012). Dissociation in posttraumatic stress disorder part I: Definitions and review of research. Psychological Trauma, 4, 479–489.CrossRef Carlson, E. B., Dalenberg, C. J., & McDade-Montez, E. (2012). Dissociation in posttraumatic stress disorder part I: Definitions and review of research. Psychological Trauma, 4, 479–489.CrossRef
40.
go back to reference Kaniasty, K. (2005). Social support and traumatic stress. PTSD Research Quarterly, 16(2), 1–7. Kaniasty, K. (2005). Social support and traumatic stress. PTSD Research Quarterly, 16(2), 1–7.
41.
go back to reference Cordova, M. J., Cunningham, L. L. C., Carlson, C. R., & Andrykowski, M. A. (2001). Social constraints, cognitive processing, and adjustment to breast cancer. Journal of Consulting and Clinical Psychology, 69, 706–711.CrossRefPubMed Cordova, M. J., Cunningham, L. L. C., Carlson, C. R., & Andrykowski, M. A. (2001). Social constraints, cognitive processing, and adjustment to breast cancer. Journal of Consulting and Clinical Psychology, 69, 706–711.CrossRefPubMed
42.
go back to reference Christianson, S. (Ed.). (1992). Handbook of emotion and memory: Research and theory. Hillsdale, NJ: Erlbaum. Christianson, S. (Ed.). (1992). Handbook of emotion and memory: Research and theory. Hillsdale, NJ: Erlbaum.
43.
go back to reference Myin-Germeys, I. (2012). Psychiatry. In M. R. Mehl & T. S. Conner (Eds.), Handbook of research methods for studying daily life (pp. 636–650). New York: Guilford Press. Myin-Germeys, I. (2012). Psychiatry. In M. R. Mehl & T. S. Conner (Eds.), Handbook of research methods for studying daily life (pp. 636–650). New York: Guilford Press.
44.
go back to reference Stone, A. A. (2007). Thoughts on the present state of real-time data capture. In A. A. Stone, S. Shiffman, A. Atienza, & L. Nebeling (Eds.), The science of real-time data capture: Self-reports in health research (pp. 361–370). New York: Oxford University Press. Stone, A. A. (2007). Thoughts on the present state of real-time data capture. In A. A. Stone, S. Shiffman, A. Atienza, & L. Nebeling (Eds.), The science of real-time data capture: Self-reports in health research (pp. 361–370). New York: Oxford University Press.
Metagegevens
Titel
Advantages and psychometric validation of proximal intensive assessments of patient-reported outcomes collected in daily life
Auteurs
Eve B. Carlson
Nigel P. Field
Josef I. Ruzek
Richard A. Bryant
Constance J. Dalenberg
Terrence M. Keane
David A. Spain
Publicatiedatum
01-03-2016
Uitgeverij
Springer International Publishing
Gepubliceerd in
Quality of Life Research / Uitgave 3/2016
Print ISSN: 0962-9343
Elektronisch ISSN: 1573-2649
DOI
https://doi.org/10.1007/s11136-015-1170-9

Andere artikelen Uitgave 3/2016

Quality of Life Research 3/2016 Naar de uitgave