Skip to main content
Log in

Measuring Loneliness Among Middle-Aged and Older Adults: The UCLA and de Jong Gierveld Loneliness Scales

  • Published:
Social Indicators Research Aims and scope Submit manuscript

Abstract

This study examined the measurement and invariance properties of the R-UCLA and de Jong Gierveld loneliness scales for research involving middle-aged and older adults. Confirmatory factor analyses (CFAs) of data from interviews with adults aged 45–84 revealed limited support for the unidimensionality of either scale while subsequent analyses indicated the multidimensionality of both. However, method effects associated with positive and negative item wording were also evident. Multiple group CFAs provided limited support for assumptions of measurement invariance across age groups and from baseline to follow-up with regard to the R-UCLA scale. In contrast, strong measurement invariance across age groups and successive measurements was established for the bi-dimensional dJG scale. Overall, the findings supported the relative utility of the dJG scale for research involving middle-aged and older adults but suggested a need for attention to the implications of method effects associated with item wording and lack of measurement invariance with respect to item residuals.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Similar content being viewed by others

Notes

  1. The response rate for the telephone screening survey was 39.2 % using Statistics Canada and MRIA guidelines (see http://www.mria-arim.ca/STANDARDS/Response.asp). Although somewhat low, the denominator includes those whose eligibility to participate in the study was unknown (i.e., those who we were unable to reached by telephone, who were hospitalized or unable to participate for health or language reasons, who refused to participate in the screening interview but who may have been ineligible to participate in the study due to their age, etc.).

  2. Testing configural invariance involved a baseline model (M0) with identical items to factors assignment but freely estimated factor loadings, intercepts, and variances across groups, fitted to the data simultaneously. If configural invariance was confirmed, weak invariance was tested using a model (M1) with equal factor loadings but freely estimated indicator intercepts and variances. Evidence for the equivalence of factor loadings across groups is said to indicate ‘weak’ measurement invariance—i.e., that the latent variable is related to the items in the same way across groups. Next, if weak invariance was confirmed, strong invariance was tested in a model (M2) with equal factor loadings and equal indicator intercepts.‘Strong’ invariance is present when both item factor loadings and intercepts are equivalent across groups, indicating that observed mean group differences reflect latent mean group differences (Gregorich 2006). Finally, where strong invariance was present, a fourth model (M3) tested ‘strict’ measurement invariance (present when item residuals are equivalent across groups). Insofar as unique item variances influence the magnitude of correlations among observed variables, strict measurement invariance is required for comparing correlations among manifest variables across groups (Gregorich 2006). Models M1, M2 and M3 were each compared to the preceding model through a comparison of their X2 values. Measurement invariance holds when the X2 values obtained in the increasingly restrictive model do not differ significantly from the prior model.

  3. FIML is a model-based method for estimating parameters in the presence of missing data (Olinsky et al. 2003).FIML estimates parameters based on the available complete data as well as the implied values of the missing data given the observed data. It is conceptually similar to regression imputation and produces results similar to multiple imputation methods (see Graham et al. 1996; Olinsky et al. 2003).

  4. CFA analyses also assessed the fit of a three-factor structure previously validated by Hawkley et al. (2005) using a sample of 225 middle-aged adults (aged 50–68). Our analyses did not indicate acceptable fit of their three-factor structure within the current sample (χ2 = 479.380, df = 167, p < .001; CFI = 0.845, TLI = 0.824, RMSEA = 0.089, SRMR = 0.077).

  5. The use of a separate data set is generally recommended when CFA analyses follow EFA to identify a best-fitting factor structure (De Coster 1998). Often this is handled by splitting the sample in half and using one subsample for each component of the study. Given sample size limitations, we drew on the follow-up sample for the CFAs.

  6. CFA analyses did not indicate cross-loading involving item 14.

  7. CFA analyses did not reveal cross-loading involving item 6.

References

  • Allen, R. L., & Oshagan, H. (1995). The UCLA Loneliness Scale: Invariance of social structural characteristics. Personality and Individual Differences, 19(2), 185–195.

    Article  Google Scholar 

  • Alpass, F. M., & Neville, S. (2003). Loneliness, health and depression in older males. Aging and Mental Health, 7(3), 212–216.

    Article  Google Scholar 

  • Andersson, L. (1998). Loneliness research and interventions: A review of the literature. Aging and Mental Health, 2, 264–274.

    Article  Google Scholar 

  • Banks, J., Breeze, E., Lessof, C., & Nazroo, J. (Eds.). (2006). Retirement, health and relationships of the older population in England: The 2004 English longitudinal study of ageing. London, England: Institute for Fiscal Studies.

    Google Scholar 

  • Barrett, P. (2007). Structural equation modelling: Adjudging model fit. Personality and Individual Differences, 42, 815–824.

    Article  Google Scholar 

  • Bentler, P. M. (1990). Comparative fit indexes in structural models. Psychological Bulletin, 107, 238–246.

    Article  Google Scholar 

  • Bontempo, D. E., & Hofer, S. M. (2006). Assessing factorial invariance in cross-sectional and longitudinal studies. In A. D. Ong & M. H. M. van Dulmen (Eds.), Oxford handbook of methods in positive psychology (pp. 153–175). Toronto: Oxford University Press.

    Google Scholar 

  • Brown, M. W., & Cudeck, R. (1993). Alternative ways of assessing model fit. In K. A. Bollen & J. S. Long (Eds.), Testing structural equation models (pp. 445–455). Newbury Park, CA: Sage.

    Google Scholar 

  • Cacioppo, J. T., Hawkley, L. C., & Thisted, R. A. (2010). Perceived social isolation makes me sad: 5-year cross-lagged analyses of loneliness and depressive symptomatology in the Chicago Health, Aging and Social Relations study. Psychology and Aging, 25(3), 453–463.

    Article  Google Scholar 

  • Cacioppo, J. T., Hughes, M. E., Waite, L. J., Hawkley, L. C., & Thisted, R. A. (2006). Loneliness as a specific risk factor for depressive symptoms: Cross-sectional and longitudinal analyses. Psychology and Aging, 21(1), 140–151.

    Article  Google Scholar 

  • Cohen-Mansfield, J., & Parpura-Gill, A. (2007). Loneliness in older persons: A theoretical model and empirical findings. International Psychogeriatrics, 19(2), 279–294.

    Article  Google Scholar 

  • Cramer, K. M., & Barry, J. E. (1999). Conceptualizations and measures of loneliness: A comparison of subscales. Personality and Individual Differences, 27(3), 491–502.

    Article  Google Scholar 

  • De Coster, J. (1998). Overview of factor analysis. Retrieved 8 June 2011 from http://www.stat-help.com/notes.html.

  • de Jong Gierveld, J. (1987). Developing and testing a model of loneliness. Journal of Personality and Social Psychology, 53, 119–128.

    Article  Google Scholar 

  • de Jong Gierveld, J. (1998). A review of loneliness: Concept and definitions, determinants and consequences. Reviews in Clinical Gerontology, 8, 73–80.

    Article  Google Scholar 

  • de Jong Gierveld, J., & Havens, B. (2004). Cross-national comparisons of social isolation and loneliness: Introduction and overview. Canadian Journal on Aging, 23(2), 109–113.

    Article  Google Scholar 

  • de Jong Gierveld, J., & Kamphuis, F. (1985). The development of a RASCH-type loneliness scale. Applied Psychological Measurement, 9, 289–299.

    Article  Google Scholar 

  • de Jong Gierveld, J., & Van Tilburg, T. (1999). Manual of the Loneliness Scale. Vrije Universiteit Amsterdam, Department of Social Research Methodology (ISBN 90-9012523-X). http://home.fsw.vu.nl/tg.van.tilburg/manual_loneliness_scale_1999.html (updated from the printed version: 9-10-2008).

  • de Jong Gierveld, J., & Van Tilburg, T. (2006). A 6-tem scale for overall, emotional, and social loneliness: Confirmatory tests on survey data. Research on Aging, 28(5), 582–598.

    Article  Google Scholar 

  • DiStefano, C., & Hess, B. (2005). Using confirmatory factor analysis for construct validation: An empirical review. Journal of Psychoeducational Assessment, 23, 225–241.

    Article  Google Scholar 

  • DiStefano, C., & Motl, R. W. (2006). Further investigating method effects associated with negatively worded items on self-report surveys. Structural Equation Modeling, 13(3), 440–464.

    Article  Google Scholar 

  • DiStefano, C., & Motl, R. W. (2009a). Personality correlates of method effects due to negatively worded items on the Rosenberg self-esteem scale. Personality and Individual Differences, 46, 309–313.

    Article  Google Scholar 

  • DiStefano, C., & Motl, R. W. (2009b). Self-esteem and method effects associated with negatively worded items: Investigating factorial invariance by sex. Structural Equation Modeling, 16(1), 134–146.

    Article  Google Scholar 

  • Dussault, M., Fernet, C., Austin, S., & Leroux, M. (2009). Revisiting the factorial validity of the revised UCLA loneliness scale: A test of competing models in a sample of teachers. Psychological Reports, 105, 849–856.

    Article  Google Scholar 

  • Dykstra, P. A., & de Jong Gierveld, J. (2004). Gender and marital history differences in emotional and social loneliness among Dutch older adults. Canadian Journal on Aging, 23(2), 141–155.

    Article  Google Scholar 

  • Dykstra, P. A., & Fokkema, T. (2007). Social and emotional loneliness among divorced and married men and women: Comparing the deficit and cognitive perspectives. Basic and Applied Social Psychology, 29(1), 1–12.

    Article  Google Scholar 

  • Dykstra, P. A., van Tilburg, T. G., & de Jong Gierveld, J. (2005). Changes in older adult loneliness: Results from a seven-year longitudinal study. Research on Aging, 27(6), 725–747.

    Article  Google Scholar 

  • Graham, J. W., Hofer, S. M., & MacKinnon, D. P. (1996). Maximizing the usefulness of data obtained with planned missing value patterns: An application f maximum likelihood procedures. Multivariate Behavioral Research, 31, 197–218.

    Article  Google Scholar 

  • Greenberger, E., Chen, C. S., Dmitrieva, J., & Farruggia, S. P. (2003). Item-wording and the dimensionality of then Rosenberg self-Esteem Scale: Do they matter? Personality and Individual Differences, 35(6), 1241–1254.

    Article  Google Scholar 

  • Gregorich, S. E. (2006). Do self-report instruments allow meaningful comparisons across diverse population groups? Testing measurement invariance using the confirmatory factor analysis framework. Medical Care, 44(11), S78–S94.

    Article  Google Scholar 

  • Hartshorne, T. S. (1993). Psychometric properties and confirmatory factor analysis of the UCLA loneliness scale. Journal of Personality Assessment, 61, 182–195.

    Article  Google Scholar 

  • Havens, B., & Hall, M. (2001). Social isolation, loneliness, and the health of older adults in Manitoba, Canada. Indian Journal of Gerontology, 15(1–2), 126–144.

    Google Scholar 

  • Hawkley, L. C., Browne, M. W., & Cacioppo, J. T. (2005). How can I connect with thee? Let me count the ways. Psychological Science, 16(10), 798–804.

    Article  Google Scholar 

  • Hawkley, L. C., & Cacioppo, J. T. (2007). Aging and loneliness: Downhill quickly? Current Directions in Psychological Science, 16(4), 187–191.

    Article  Google Scholar 

  • Hawkley, L. C., Hughes, M. E., Waite, L. J., Masi, C. M., Thisted, R. A., & Cacioppo, J. T. (2008). From social structural factors to perceptions of relationship quality and loneliness: The Chicago Health, Aging, and Social Relations study. Journal of Gerontology: Social Sciences, 63B(6), S375–S384.

    Article  Google Scholar 

  • Hawkley, L. C., Masi, C. M., Berry, J. D., & Cacioppo, J. T. (2006). Loneliness as a unique predictor of age-related differences in systolic blood pressure. Psychology and Aging, 21(1), 152–164.

    Article  Google Scholar 

  • Hawkley, L. C., Thisted, R. A., & Cacioppo, J. T. (2009). Loneliness predicts reduced physical activity: Cross-sectional and longitudinal analyses. Health Psychology, 28(3), 354–363.

    Article  Google Scholar 

  • Hawkley, L. C., Thisted, R. A., Masi, C. M., & Cacioppo, J. T. (2010). Loneliness predicts increased blood pressure: 5-year cross-lagged analyses in middle-aged and older adults. Psychology and Aging, 25(1), 132–141.

    Article  Google Scholar 

  • Horan, P. M., DeStefano, C., & Motl, R. W. (2003). Wording Effects in Self-Esteem Scales: Methodological artifact or response style? Structural Equation Modeling, 10(3), 435–455.

    Article  Google Scholar 

  • Hu, L., & Bentler, P. M. (1999). Cutoff criteria for fit indexes in covariance structure analysis: Conventional criteria versus new alternatives. Structural Equation Modeling, 6, 1–55.

    Article  Google Scholar 

  • Hughes, M. E., Waite, L. J., Hawkley, L. C., & Cacioppo, J. T. (2004). A short scale for measuring loneliness in large surveys. Research on Aging, 26, 655–672.

    Article  Google Scholar 

  • Judge, T. A., Erez, A., Bono, J. E., & Thoresen, C. J. (2003). The core self-evaluations scale: Development of a measure. Personnel Psychology, 56(2), 303–331.

    Article  Google Scholar 

  • Jylha, M. (2004). Old age and loneliness: Cross-sectional and longitudinal analyses in the Tampere Longitudinal Study on Aging. Canadian Journal on Aging, 23(2), 157–168.

    Article  Google Scholar 

  • Lance, C. E., Noble, C. L., & Scullen, S. E. (2002). A critique of the correlated trait-correlated method and correlated uniqueness models for multitrait-multimethod data. Psychological Methods, 7, 228–244.

    Article  Google Scholar 

  • Lauder, W., Mummery, K., Jones, M., & Caperchione, C. (2006). A comparison of health behaviours in lonely and non-lonely populations. Psychology, Health and Medicine, 11(2), 233–245.

    Article  Google Scholar 

  • Maul, A. (2013). Method effect and the meaning of measurement. Frontiers in Psychology, 4, 1–13.

    Article  Google Scholar 

  • McWhirter, B. T. (1990). Factor analysis of the revised UCLA loneliness scale. Current Psychology, 9(1), 56–69.

    Article  Google Scholar 

  • Meredith, W. (1993). Measurement invariance, factor analysis and factorial invariance. Psychometrika, 58, 525–543.

    Article  Google Scholar 

  • Moorer, P., & Suurmeijer, T. P. B. M. (1993). Unidimensionality and cumulativeness of the loneliness scale using Mokken scale analysis for polychotomous items. Psychological Reports, 73, 1324–1326.

    Article  Google Scholar 

  • Motl, R. W., & DiStefano, C. (2002). Longitudinal invariance of self-esteem and methods effects associated with negatively-worded items. Structural Equation Modeling, 9, 562–578.

    Article  Google Scholar 

  • Mueller, R.O. (2000). Basic principles of structural equation modeling: An introduction to LISREL and EQS. New York: Springer.

  • Muthén, L. K., & Muthén, B. O. (1998–2010). Mplus user’s guide (6th edn). Los Angeles, CA: Muthén & Muthén.

  • Olinsky, A., Chen, S., & Harlow, L. (2003). The comparative efficacy of imputation methods for missing data in structural equation modeling. European Journal of Operational Research, 151, 53–79.

    Article  Google Scholar 

  • Oshagan, H., & Allen, R. L. (1992). Three loneliness scales: An assessment of their measurement properties. Journal of Personality Assessment, 59(2), 380–409.

    Article  Google Scholar 

  • Paul, C., Ayis, S., & Ebrahim, S. (2006). Psychological distress, loneliness and disability in old age. Psychology, Health and Medicine, 11(2), 221–232.

    Article  Google Scholar 

  • Penninx, B. W., van Tilburg , T., Kriegsman, D. M., Deeg, D. J., Boeke, A. J., & van Eijk, J. T. (1997). Effects of social support and personal coping resources on mortality in older age: the longitudinal aging study Amsterdam. American Journal of Epidemiology, 146(6), 510–519.

    Google Scholar 

  • Pinquart, M., & Sorensen, S. (2001a). Influences on loneliness in older adults: A meta-analysis. Basic and Applied Social Psychology, 23, 245–266.

    Article  Google Scholar 

  • Pinquart, M., & Sorensen, S. (2001b). Gender differences in self-concept and psychological well-being in old age: A meta-analysis. Journals of Gerontology: Psychologcial Sciences, 56B(4), P195–P213.

    Article  Google Scholar 

  • Podsakoff, P. M., MacKenzie, S. B., Podsakoff, N. P., & Lee, J.-Y. (2003). Common method biases in behavioural research: A critical review of the literature and recommended remedies. Journal of Applied Psychology, 88(5), 879–903.

    Article  Google Scholar 

  • Raina, P. S., Wolfson, C., Kirkland, S. A., Griffith, L. E., Oremus, M., Patterson, C., et al. (2009). The Canadian Longitudinal Study on Aging (CLSA). Canadian Journal on Aging, 28(3), 221–229.

    Article  Google Scholar 

  • Robinson, J. P., Shaver, P. R., & Wrightsman, L. S. (1991). Measures of personality and social psychological attitudes (Vol. 1). San Diego: Academic Press.

    Google Scholar 

  • Routasalo, P., & Pitkala, K. H. (2003). Loneliness among older people. Reviews in Clinical Gerontology, 13, 303–311.

    Article  Google Scholar 

  • Russell, D. W. (1996). UCLA Loneliness Scale (Version 3): Reliability, validity, factor structure. Journal of Personality Assessment, 66, 20–40.

    Article  Google Scholar 

  • Russell, D. W., Cutrona, C. E., de la Mora, A., & Wallace, R. B. (1997). Loneliness and nursing home admission among rural older adults. Psychology and Aging, 12, 574–589.

    Article  Google Scholar 

  • Russell, D. W., Peplau, L. A., & Cutrona, C. E. (1980). The revised UCLA Loneliness Scale: Concurrent and discriminant validity evidence. Journal of Personality and Social Psychology, 39, 472–480.

    Article  Google Scholar 

  • Russell, D., Peplau, L. A., & Ferguson, M. L. (1978). Developing a measure of loneliness. Journal of Personality Assessment, 42(3), 290–294.

    Article  Google Scholar 

  • Schriesheim, C. A., Eisenbach, R. J., & Hill, K. D. (1991). The effect of negation and polar opposite item reversals on questionnaire reliability and validity: An experimental investigation. Educational and Psychological Measurement, 51, 67–78.

    Article  Google Scholar 

  • Shaver, P. R., & Brennan, K. B. (1991). Measures of depression and loneliness. In J. P. Robinson, P. R. Shaver, & L. S. Wrightsman (Eds.), Measures of social psychological attitudes (Vol. 1, Measures of personality and social psychological attitudes, pp. 195–289). San Diego, CA: Academic Press.

  • Shiovitz-Ezra, S., & Ayalon, L. (2010). Situational versus chronic loneliness as risk factors for all-cause mortality. International Psychogeriatrics, 22(3), 455–462.

    Google Scholar 

  • Stek, M. L., Gusseklook, J., Beekman, A. T. F., van Tilburg, W., & Westendorp, R. G. J. (2004). Prevalence, correlates and recognition of depression in the oldest old: The Leiden 85-Plus study. Journal of Affective Disorders, 78(3), 193–200.

    Article  Google Scholar 

  • Stek, M. L., Vinkers, D. J., Gussekloo, J., Beekman, A. T. F., van der Mast, R. C., & Westendorp, R. G. J. (2005). Is depression in old age fatal only when people feel lonely? American Journal of Psychiatry, 162, 178–180.

    Article  Google Scholar 

  • Thurston, R. C., & Kubzansky, L. D. (2009). Women, loneliness, and incident coronary heart disease. Psychosomatic Medicine, 71(8), 836–842.

    Google Scholar 

  • Tiikkainen, P., & Heikkinen, R. L. (2005). Associations between loneliness, depressive symptoms and perceived togetherness in older people. Aging and Mental Health, 9(6), 526–534.

    Article  Google Scholar 

  • Tijhuis, M. A. R., de Jong Gierveld, J., Feskens, E. J. M., & Kromhout, D. (1999). Changes in and factors related to loneliness in older men. The Zutphen Elderly Study. Age and Ageing, 28(5), 491–495.

    Google Scholar 

  • Tomaka, J., Thompson, S., & Palacios, R. (2006). The relation of social isolation, loneliness, and social support to disease outcomes among the elderly. Journal of Aging and Health, 18(3), 359–384.

    Article  Google Scholar 

  • Törmäkangas, T. M., Heikkinen, R., & Ilmarinen, J. E. (2003). Change and stability in measuring social functioning among aging Finnish municipal workers in two repeated measurements. Hallym International Journal of Aging, 5(2), 159–182.

    Article  Google Scholar 

  • Tucker, L. R., & Lewis, C. (1973). A reliability coefficient for maximum likelihood factor analysis. Psychometrika, 38, 1–10.

    Article  Google Scholar 

  • van Baarsen, B., Smit, J. H., Snijders, T. A. B., & Knipscheer, C. P. M. (1999). Do personal conditions and circumstances surrounding partner loss explain loneliness in newly bereaved older adults. Ageing and Society, 19, 441–469.

    Article  Google Scholar 

  • van Baarsen, B., Snijders, T. A. B., Smit, J. H., & van Druijn, M. A. J. (2001). Lonely but not alone: Emotional isolation and social isolation as two distinct dimensions of loneliness in older people. Educational and Psychological Measurement, 61(1), 119–135.

    Article  Google Scholar 

  • van Tilburg, T., Havens, B., & de Jong Gierveld, J. (2004). Loneliness among older adults in the Netherlands, Italy, and Canada: A multifaceted comparison. Canadian Journal on Aging, 23(2), 169–180.

    Article  Google Scholar 

  • Vassar, M., & Crosby, J. W. (2008). A reliability generalization study of coefficient Alpha for the UCLA Loneliness Scale. Journal of Personality Assessment, 90(6), 601–607.

    Article  Google Scholar 

  • Weems, G. H., Onwuegbuzie, A. J., Schreiber, J. B., & Eggers, S. J. (2003). Characteristics of respondents who respond differently to positively and negatively worded items on rating scales. Assessment and Evaluation in Higher Education, 28(6), 587–607.

    Article  Google Scholar 

  • Weiss, R. S. (1973). Loneliness: The experience of emotional and social isolation. Cambridge, MA: MIT Press.

    Google Scholar 

  • Wu, A. D., Li, Z., & Zumbo, B. D. (2007). Decoding the meaning of factorial invariance and updating the practice of multi-group Confirmatory Factor Analysis: A demonstration with TIMSS data. Practical Assessment, Research and Evaluation, 12(3), 1–26.

    Google Scholar 

  • Wu, A. D., Liu, Y., Gadermann, A. M., & Zumbo, B. D. (2010). Multiple-indicator multilevel growth model: A solution to multiple methodological challenges in longitudinal studies. Social Indicators Research: International Interdisciplinary Journal for Quality of Life Measurement, 97, 123–142.

Download references

Acknowledgments

This study was conducted as part of the Canadian Longitudinal Study on Aging (CLSA): Developmental Activities, Phase II, supported by grants from the Canadian Institutes of Health Research (CIHR; Raina et al. 2009) and the Michael Smith Foundation for Health Research through the BC Network of Aging Research (BCNAR). The authors wish to thank Drs. Holly Tuokko and Laura Funk for their comments on an earlier version of the manuscript.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Margaret J. Penning.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Penning, M.J., Liu, G. & Chou, P.H.B. Measuring Loneliness Among Middle-Aged and Older Adults: The UCLA and de Jong Gierveld Loneliness Scales. Soc Indic Res 118, 1147–1166 (2014). https://doi.org/10.1007/s11205-013-0461-1

Download citation

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11205-013-0461-1

Keywords

Navigation