Original Article
Measuring patient satisfaction with health care treatment using the Short Assessment of Patient Satisfaction measure delivered superior and robust satisfaction estimates

https://doi.org/10.1016/j.jclinepi.2013.12.010Get rights and content

Abstract

Objectives

Reviews of patient satisfaction suggest seven dimensions, each of which should be assessed. This study reports development of a short generic patient satisfaction measure for use in routine clinical practice.

Study Design and Settings

Participants were randomly recruited from two Australian incontinence clinics. Participants completed a follow-up questionnaire including patient satisfaction items. Iterative Mokken and Rasch analyses derived the Short Assessment of Patient Satisfaction (SAPS) scale from the item bank.

Results

The SAPS psychometric properties illustrated the following features, namely its descriptive system covers all seven patient satisfaction dimensions, there were no misfitting items, and the scale exceeded the Loevinger H criteria for a strong unidimensional scale. The reliability of the SAPS was Cronbach α = 0.86. When discriminatory function was examined, the SAPS scale was more sensitive than two other generic patient satisfaction instruments.

Conclusion

The SAPS scale is based on a firm theoretical model of patient satisfaction and its descriptive system covers the known dimensions contributing to patient satisfaction. Its internal psychometric properties exceeded standard psychometric standards, and it discriminated at least as well as other longer patient satisfaction measures. Although it needs further validation, the study results suggest that it may be useful for assessing patient satisfaction with health care.

Introduction

What is new?

Key findings

  1. There are few valid and reliable outcome measures assessing patient satisfaction with health care.

  2. The Short Assessment of Patient Satisfaction (SAPS) scale is a new instrument with initially demonstrated validity and reliability.

What this adds to what was known?
  1. Based on a sound conceptual model of patient satisfaction, the SAPS scale meets several calls over the past 20 years for a modern, short generic measure of patient satisfaction.

  2. Initial validation tests suggested that it outperformed leading existing measures of patient satisfaction.

What is the implication and what should change now?
  1. The SAPS scale needs to be tested in a variety of clinical settings.

  2. If validation studies support its psychometric properties, it will meet the need for a modern, psychometrically valid measure of patient satisfaction.

  3. It can be used in a wide variety of clinical settings in place of older instruments, which have known measurement problems.

During the past 30 years, the measurement of patient satisfaction has increased in popularity mainly owing to three changes in health care. First, the role of clinicians has changed from one of helping patients through their illness to one where the clinician is expected to either cure the patient or alleviate chronic symptoms. Second, the patient-centered care movement—which presents patients as consumers of health care—has changed the priority in health care from a belief in beneficence to autonomy and has led to patient views being taken into account during medical decision making. Third, patient perspectives are increasingly sought for inclusion in the monitoring of health care and the legitimizing of health policy [1], [2].

Despite this rise in the popularity of patient satisfaction assessment, there are conflicting definitions of it. The major patient satisfaction theories were all published during the 1980s; almost all research since then is based on these. Ware et al. [3] argued that patient satisfaction was a function of patients' subjective responses to experienced care mediated by personal preferences and expectations. Linder-Pelz [4] postulated that it was mediated by personal beliefs and values about care as well as prior expectations of the care. Fox and Storms [5] advocated that a person's orientation determined satisfaction; dissatisfaction occurred where there was transgression of the relationship between expectation and experience. Fitzpatrick and Hopkins [6] argued that expectations were socially mediated, reflecting the health goals of the patient and the extent to which illness and health care violated the patient's personal sense of self. Finally, Donabedian [7], [8] postulated that it was based on personal relationships within health care systems and health care outcomes from treatment, where these were mediated by the values of the patient. Consistent with this, subsequent research has shown that the dominant predictor appears to be the patient–practitioner relationship, mediated by expectations of this relationship, prior experiences, and health outcomes [9], [10].

The implication is that the construct of patient satisfaction covers all aspects of care quality, particularly the interpersonal processes. A review of the literature arising from these theories [1] revealed that although these theories have been operationalized in various ways, an overall inclusive model of patient satisfaction should cover the following key dimensions:

  • 1.

    Appropriate access to health services, including the environment within which treatment takes place and the level of care coordination [3], [5], [11], [12];

  • 2.

    The provision of health information [5], [8], [9], [11], [12], [13], [14];

  • 3.

    The relationship between the patient and health care staff, specifically empathy with the patient [3], [7], [9], [11], [12], [15], [16], [17], [18];

  • 4.

    Participation in making choices regarding health treatment, including the associated fears and sense of loss of control as well as the appropriate use of treatment therapies and medications [11], [19], [20], [21];

  • 5.

    Satisfaction with the treatment provided, that is, the technical quality of the care provided [3], [5], [11], [14], [18], [22];

  • 6.

    The effectiveness of treatment, including the extent to which treatment meets patient expectations of care and helps the patient in their daily life [3], [7], [9], [11], [12], [14]; and

  • 7.

    General satisfaction [23], [24].

Regarding assessing patient satisfaction, as this operationalized model implies, there is an obvious tension between condition-specific instruments, which cover just one or two of these dimensions and generic instruments, which cover all. Although condition-specific instruments are attractive, the limitations are that they may not be valid when used in other settings, with other conditions or provide estimates that are comparable. Generic instruments overcome these restrictions. Where their descriptive systems cover all the dimensions described previously, construct validity and generalizability may be claimed, although there may be a loss of discriminatory power in particular diseases or situations.

However, few generic instruments have been published to date for which adequate psychometric profiles are available, and there seems to be a general dissatisfaction with published instruments (especially in light of the fact that there are, literally, thousands of patient satisfaction measures available on the Internet). These judgments rest on the findings of review articles. Sitzia [25] reviewed the literature and found that just half of all reviewed articles reported any psychometric data; yet, 81% reported using a new patient satisfaction instrument and a further 10% reported modifying a previously existing instrument. Most of the instruments used had little evidence of reliability or validity; and of articles reporting a new instrument, 60% reported no psychometric data whatsoever. More recently, Hawthorne [1] reported similar findings; viz., that many studies reported patient satisfaction in a single sentence where it was offered as complimentary evidence of treatment success. Few articles reported the instruments used, their psychometric properties, or the actual results.

It is possible that this long-standing unsatisfactory situation is, in part, a function of available instruments. Available instruments may be culturally specific [26], [27], [28], they may be too long to be used in busy clinical or research settings [3], [29], they may be condition specific [30], [31], biased (eg, where there is over measurement of some dimensions and under measurement of others) [32], [33], or they may lack psychometric robustness in the sense that there is very little evidence supporting instrument validity or reliability [4], [28], [34]. Both the Sitzia and Hawthorne reports also suggested that there are no modern, generic patient satisfaction instruments that have been developed using contemporary psychometric practices, which are short and easy to use and for which robust psychometric data are available. In light of this situation, Hawthorne recommended the development of a short, valid, and reliable generic patient satisfaction instrument. Consistent with this call, this study reports the development of a new generic, short, valid, and reliable measure of patient satisfaction, the Short Assessment of Patient Satisfaction (SAPS) scale.

Section snippets

Method

The methods used in the study are fully described in Hawthorne et al. [35]. Because this report may not be widely available to those without Internet access, the methods are briefly described.

Results

A total of 178 completed questionnaires were returned, giving a simple response rate of 42%. Because questionnaires were distributed through the clinics without the researchers' participation, the number of patients out of scope is unknown. Participants' demographic details were that 80% were Australian born; age cohorts were 31–45 years (17%), 46–60 (41%), 61–75 (32%), and 75+ (10%). Education attainment was primary school only (9%), high school (43%), a trade certificate (21%), and

Discussion

Although patient satisfaction is a notoriously slippery concept as evidenced by the number of patient satisfaction theories and measures, its popularity has increased quite dramatically over the past decade. In November 2012, typing the term into the Internet produced more than 19 million hits. What is surprising about this situation is the basic contradiction between this popularity; the availability of thousands of different measures of patient satisfaction; and the paucity of high quality,

Conclusion

The SAPS scale was developed in response to calls for a short, valid, and reliable measure of patient satisfaction. The SAPS scale is based on a firm theoretical model of patient satisfaction, and its descriptive system covers the known dimensions that contribute to patient satisfaction. Its internal properties appear to exceed standard psychometric criteria, and it discriminates as least as well as other longer patient satisfaction measures. Given that the SAPS is a short measure at just seven

Acknowledgments

This study was funded by the Australian Commonwealth Government through the Department of Health Care and Aging. In addition to the authors' thanks for this support, they would like to thank all the study participants who gave their time to complete the questionnaire, and to the clinicians and staff of the participating clinics.

References (78)

  • J.S. Kalantar et al.

    The effects of lottery incentive and length of questionnaire on health survey response rates: a randomized study

    J Clin Epidemiol

    (1999)
  • G. Hawthorne

    Review of patient satisfaction measures. ISBN: 0 642 82800 8

    (2006)
  • R.L. Kravitz

    Patients' expectations for medical care: an expanded formulation based on review of the literature

    Med Care Res Rev

    (1996)
  • R. Fitzpatrick et al.

    Problems in the conceptual framework of patient satisfaction research: an empirical exploration

    Sociol Health Illn

    (1983)
  • A. Donabedian

    The quality of care: how can it be assessed?

    JAMA

    (1988)
  • A. Donabedian

    Explorations in quality assessment and monitoring: Vol. 1 The definition of quality and the approaches to its assessment

    (1980)
  • R. Crow et al.

    The measurement of satisfaction with healthcare: implications for practice from a systematic review of the literature

    Health Technol Assess

    (2002)
  • R.L. Kravitz et al.

    Prevalence and sources of patients' unmet expectations for care

    Ann Intern Med

    (1996)
  • G. Hardy et al.

    Components and predictors of patient satisfaction

    Br J Health Psychol

    (1996)
  • U. Yucelt

    An investigation of causes of patient satisfaction/dissatisfaction with physician services

    Health Mark Q

    (1994)
  • E.A. Suchman

    Social patterns of illness and medical care

    J Health Hum Behav

    (1965)
  • G. Hawthorne et al.

    GUTSS: The Genito-Urinary Treatment Satisfaction Scale Study. Working Paper

    (2000)
  • Z. Ben-Sira

    The function of the professional's affective behaviour in client satisfaction: a revised approach to social interaction theory

    J Health Soc Behav

    (1976)
  • R. Fitzpatrick

    Measurement of patient satisfaction

  • R.L. Kane et al.

    The relationship of patient satisfaction with care and clinical outcomes

    Med Care

    (1997)
  • J.R. Adams et al.

    Shared decision-making and evidence-based practice

    Community Ment Health J

    (2006)
  • J. Hamann et al.

    Shared decision making in psychiatry

    Acta Psychiatr Scand

    (2003)
  • S. Linder-Pelz et al.

    The multidimensionality of patient satisfaction with a clinic visit

    J Community Health

    (1985)
  • R. Baker

    Development of a questionnaire to assess patients' satisfaction with consultations in general practice

    Br J Gen Pract

    (1990)
  • J. Sitzia

    How valid and reliable are patient satisfaction data? An analysis of 195 studies

    Int J Qual Health Care

    (1999)
  • A.G. Cryns et al.

    The hierarchical structure of geriatric patient satisfaction. An Older Patient Satisfaction Scale designed for HMOs

    Med Care

    (1989)
  • C. Henderson et al.

    Cross-cultural differences in the conceptualisation of patients' satisfaction with psychiatric services—content validity of the English version of the Verona Service Satisfaction Scale

    Soc Psychiatry Psychiatr Epidemiol

    (2003)
  • R. Meakin et al.

    The ‘Medical Interview satisfaction scale’ (MISS-21) adapted for British general practice

    Fam Pract

    (2002)
  • E.L. La Monica et al.

    Development of a patient satisfaction scale

    Res Nurs Health

    (1986)
  • A.M. Dozier et al.

    Development of an instrument to measure patient perception of the quality of nursing care

    Res Nurs Health

    (2001)
  • P.L. Hudak et al.

    Understanding the meaning of satisfaction with treatment outcome

    Med Care

    (2004)
  • K.L. Burgio et al.

    Behavioral vs drug treatment for urge urinary incontinence in older women: a randomized controlled trial

    JAMA

    (1998)
  • J. Ramsay et al.

    The General Practice Assessment Survey (GPAS): tests of data quality and measurement properties

    Fam Pract

    (2000)
  • T. Meehan et al.

    Monitoring consumer satisfaction with inpatient service delivery: the Inpatient Evaluation of Service Questionnaire

    Aust N Z J Psychiatry

    (2002)
  • Cited by (0)

    View full text