Skip to main content
SpringerLink
Log in

Using the Nominal Group Technique: how to analyse across multiple groups

  • Published:
Health Services and Outcomes Research Methodology Aims and scope Submit manuscript

Abstract

The nominal group technique (NGT) is a method to elicit healthcare priorities. Yet, there is variability on how to conduct the NGT, and limited guidance on how to analyse a diverse sample of multiple groups. This paper addresses some of this ambiguity, and explores whether different approaches to analysis provide the same outcome/s. Conceptual papers and empirical studies were identified via PubMed and informed an adapted version of the NGT. Twenty-six nominal groups were conducted, which provided in-depth knowledge on how to best conduct this method. Pilot group data were used to compare different analysis methods and to explore how this impacted on reported outcomes. Data analyses for large data-sets are complex; thematic analysis is needed to be able to conduct across group comparisons of participant priorities. Consideration should be given not just to the strength, i.e. sum of votes, or relative importance of the priority, but to the voting frequency, i.e. the popularity of the idea amongst participants; our case study demonstrated that this can affect priority rankings for those ideas with the same score. As a case study, this paper provides practical information on analysis for complex data sets. Researchers need to consider more than one analysis process to ensure that the results truly reflect participant priorities. A priority that has a high score may not necessarily reflect its popularity within the group; the voting frequency may also need to be considered.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2

Similar content being viewed by others

References

  • Allen, J., Dyas, J., Jones, M.: Building consensus in health care: a guide to using the nominal group technique. Br. J. Community Nurs. 9(3), 110–114 (2004)

    Article  PubMed  Google Scholar 

  • Aspinal, F., Hughes, R., Dunckley, M., Addington-Hall, J.: What is important to measure in the last months and weeks of life?: a modified nominal group study. Int. J. Nurs. Stud. 43(4), 393–403 (2006)

    Article  PubMed  Google Scholar 

  • Bartunek, J.M., Murninghan, J.K.: The Nominal Group Technique: expanding the basic procedure and underlying assumptions. Group Organ. Manag. 9(3), 417–432 (1984)

    Article  Google Scholar 

  • Bissell, P., Ward, P.R., Noyce, P.R.: Appropriateness measurement: application to advice-giving in community pharmacies. Soc. Sci. Med. 51(3), 343–359 (2000)

    Article  CAS  PubMed  Google Scholar 

  • Cantrill, J.A., Sibbald, B., Buetow, S.: The Delphi and nominal group techniques in health services research. Int. J. Pharm. Pract. 4(2), 67–74 (1996)

    Article  Google Scholar 

  • Carney, O., McIntosh, J., Worth, A.: The use of the Nominal Group Technique in research with community nurses. J. Adv. Nurs. 23(5), 1024–1029 (1996)

    Article  CAS  PubMed  Google Scholar 

  • Claxton, J.D., Ritchie, J.R.B., Zaichkowsky, J.: The Nominal Group Technique: its potential for consumer research. J. Consum. Res. 7, 308–313 (1980)

    Article  Google Scholar 

  • Delbecq, A., Van de Ven, A., Gustafson, D.: Group techniques for program planning: a guide to nominal group and delphi processes. Scott, Foresman and Company, Glenview (1975)

    Google Scholar 

  • Delbecq, A.L., Van de Ven, A.H.: A group process model for problem identification and program planning. J. Appl. Behav. Sci. 7(4), 466–492 (1971)

    Article  Google Scholar 

  • Dening, K.H., Jones, L., Sampson, E.L.: Preferences for end-of-life care: a nominal group study of people with dementia and their family carers. Palliat. Med. 27(5), 409–417 (2012)

    Article  PubMed  Google Scholar 

  • Dewar, A., White, M., Posade, S.T., Dillon, W.: Using nominal group technique to assess chronic pain, patients’ perceived challenges and needs in a community health region. Health Expect. 6(1), 44–52 (2003)

    Article  PubMed  Google Scholar 

  • Drennan, V., Walters, K., Lenihan, P., Cohen, S., Myerson, S., Iliffe, S., Group, S.R.: Priorities in identifying unmet need in older people attending general practice: a nominal group technique study. Fam. Pract. 24(5), 454–460 (2007)

    Article  PubMed  Google Scholar 

  • Gallagher, M., Hares, T., Spencer, J., Bradshaw, C., Webb, I.: The nominal group technique: a research tool for general practice? Fam. Pract. 10(1), 76–81 (1993)

    Article  CAS  PubMed  Google Scholar 

  • Gastelurrutia, M.A., Benrimoj, S.I., Castrillon, C.C., de Amezua, M.J., Fernandez-Llimos, F., Faus, M.J.: Facilitators for practice change in Spanish community pharmacy. Pharm. World Sci. 31(1), 32–39 (2009)

    Article  PubMed  Google Scholar 

  • Gonzales, C.K., Leroy, G.: Eliciting used requirements using appreciative inquiry. Empir. Softw. Eng. 16, 733–772 (2011)

    Article  Google Scholar 

  • Harvey, N., Holmes, C.A.: Nominal group technique: an effective method for obtaining group consensus. Int. J. Nurs. Pract. 18(2), 188–194 (2012)

    Article  PubMed  Google Scholar 

  • Hiligsmann, M., van Durme, C., Geusens, P., Dellaert, B.G., Dirksen, C.D., van der Weijden, T., Reginster, J.Y., Boonen, A.: Nominal group technique to select attributes for discrete choice experiments: an example for drug treatment choice in osteoporosis. Patient Prefer. Adherence. 7, 133–139 (2013)

    Article  PubMed Central  PubMed  Google Scholar 

  • Hutchings, A., Raine, R.: A systematic review of factors affecting the judgments produced by formal consensus development methods in health care. J. Health Serv. Res. Policy. 11(3), 172–179H (2006)

    Article  PubMed  Google Scholar 

  • Hutchings, H., Rapport, F., Wright, S., Doel, M., Jones, A.: Obtaining consensus about patient-centred professionalism in community nursing: nominal group work activity with professionals and the public. J. Adv. Nurs. 68(11), 2429–2442 (2012)

    Article  PubMed  Google Scholar 

  • Hutchings, H.A., Rapport, F.L., Wright, S., Doel, M.A., Wainwright, P.: Obtaining consensus regarding patient-centred professionalism in community pharmacy: nominal group work activity with professionals, stakeholders and members of the public. Int. J. Pharm. Pract. 18(3), 149–158 (2010)

    PubMed  Google Scholar 

  • Jones, J., Hunter, D.: Consensus methods for medical and health services research. BMJ 311(7001), 376–380 (1995)

    Article  CAS  PubMed Central  PubMed  Google Scholar 

  • Kristofco, R., Shewchuk, R., Casebeer, L., Bellande, B., Bennett, N.: Attributes of an ideal continuing medical education institution identified through nominal group technique. J. Contin. Educ. Health Prof. 25(3), 221–228 (2005)

    Article  PubMed  Google Scholar 

  • McMillan, S.S., Kelly, F., Sav, A., King, M., Whitty, J., Wheeler, A.: Consumer and carer views of Australian community pharmacy practice: awareness, experiences and expectations. J. Pharm. Health Serv. Res. 5(1), 29–36 (2014)

    Article  Google Scholar 

  • Miller, D., Shewchuk, R., Elliot, T.R., Richards, S.: Nominal group technique: a process for identifying diabetes self-care issues among patients and caregivers. Diabetes Educ. 26(2), 305–310 (2000)., 312, 314

    Article  PubMed  Google Scholar 

  • Naik-Panvelkar, P., Armour, C., Saini, B.: Discrete choice experiments in pharmacy: a review of the literature. Int. J. Pharm. Pract. 21(1), 3–19 (2013)

    Article  PubMed  Google Scholar 

  • Potter, M., Gordon, S., Hamer, P.: The physiotherapy experience in private practice: the patients’ perspective. Aust. J. Physiother. 49(3), 195–202 (2003)

    Article  PubMed  Google Scholar 

  • Potter, M., Gordon, S., Hamer, P.: The Nominal Group Technique: a useful consensus methodology in physiotherapy research. N. Z. J. Physiother. 32, 126–130 (2004)

    Google Scholar 

  • Ryan, M., Scott, D.A., Reeves, C., Bate, A., van Teijlingen, E.R., Russell, E.M., Napper, M., Robb, C.M.: Eliciting public preferences for healthcare: a systematic review of techniques. Health Technol. Assess. 5(5), 1–186 (2001)

    CAS  PubMed  Google Scholar 

  • Sanderson, T., Hewlett, S., Richards, P., Morris, M., Calnan, M.: Utilizing qualitative data from nominal groups: exploring the influences on treatment outcome prioritization with rheumatoid arthritis patients. J. Health Psychol. 17(1), 132–142 (2012)

    Article  PubMed  Google Scholar 

  • Sink, D.S.: Using the Nominal Group Technique effectively. Natl. product. rev. 2(2), 173–184 (1983)

    Article  Google Scholar 

  • Tuffrey-Wijne, I., Bernal, J., Butler, G., Hollins, S., Curfs, L.: Using Nominal Group Technique to investigate the views of people with intellectual disabilities on end-of-life care provision. J. Adv. Nurs. 58(1), 80–89 (2007)

    Article  PubMed  Google Scholar 

  • Tully, M.P., Cantrill, J.A.: Exploring the domains of appropriateness of drug therapy, using the Nominal Group Technique. Pharm. World Sci. 24(4), 128–131 (2002)

    Article  PubMed  Google Scholar 

  • Van Breda, A.D.: Steps to analysing multiple-group NGT data. Soc. Work Pract. Res. 17(1), 1–14 (2005)

    Google Scholar 

  • Vella, K., Goldfrad, C., Rowan, K., Bion, J., Black, N.: Use of consensus development to establish national research priorities in critical care. BMJ 320(7240), 976–980 (2000)

    Article  CAS  PubMed Central  PubMed  Google Scholar 

Download references

Acknowledgments

The authors would like to thank Peter Walsh and Shane Scahill for their feedback on the manuscript, and to all pilot group participants for their time. This project is funded by the Australian Government Department of Health as part of the Fifth Community Pharmacy Agreement Research and Development Program managed by The Pharmacy Guild of Australia. The financial assistance provided must not be taken as endorsement of the contents of this study.

Ethics approval

Ethics approval was obtained from Griffith University Human Research Ethics Committee (PHM/12/11/HREC). Informed consent was obtained from all participants who were involved in the nominal groups.

Conflict of interest

None.

Author information

Authors and Affiliations

  1. Griffith Health Institute, Griffith University, University Drive, Meadowbrook, QLD, 4131, Australia

    Fiona Kelly, Adem Sav, Elizabeth Kendall, Jennifer A. Whitty & Amanda J. Wheeler

  2. Faculty of Medical and Health Sciences, School of Pharmacy, University of Auckland, Auckland, New Zealand

    Fiona Kelly & Amanda J. Wheeler

  3. School of Pharmacy, Griffith Health Institute, Griffith University, University Dve, Southport, QLD, 4215, Australia

    Michelle A. King

  4. School of Pharmacy, University of Queensland, Cornwall Street, Wooloongabba, QLD, 4102, Australia

    Jennifer A. Whitty

  5. Griffith Health Institute, School of Human Services and Social Work, Griffith University, University Drive, Room 2.15, Building L08, Meadowbrook, 4131, Australia

    Sara S. McMillan

Authors
  1. Sara S. McMillan
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Fiona Kelly
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Adem Sav
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Elizabeth Kendall
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Michelle A. King
    View author publications

    You can also search for this author in PubMed Google Scholar

  6. Jennifer A. Whitty
    View author publications

    You can also search for this author in PubMed Google Scholar

  7. Amanda J. Wheeler
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Sara S. McMillan.

Electronic supplementary material

Below is the link to the electronic supplementary material.

Supplementary material 1 (DOC 83 kb)

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

McMillan, S.S., Kelly, F., Sav, A. et al. Using the Nominal Group Technique: how to analyse across multiple groups. Health Serv Outcomes Res Method 14, 92–108 (2014). https://doi.org/10.1007/s10742-014-0121-1

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s10742-014-0121-1

Keywords

Search

Navigation