Acceptability of an online modified Delphi panel approach for developing health services performance measures: results from 3 panels on arthritis research

Dmitry Khodyakov, Sean Grant, Claire E.H. Barber, Deborah A. Marshall, John M. Esdaile, Diane Lacaille

Research output: Contribution to journalArticle

14 Scopus citations

Abstract

Rationale, aims, and objectives: Online modified Delphi (OMD) panel approaches can be used to engage large and diverse groups of clinical experts and stakeholders in developing health services performance measures. Such approaches are increasing in popularity among health researchers. However, information about their acceptability to participating experts and stakeholders is lacking but important to determine before recommending widespread use of online approaches. Therefore, the objective of this paper is to explore acceptability of the OMD panel approach from the participants' perspective. Method: We use data from participants in three OMD panels designed to develop performance measures for use in arthritis research and quality improvement efforts. At the end of each online panel, we surveyed clinical experts and stakeholders who shared their experiences with the OMD process by answering 13 close-ended questions using 7-point Likert-type scales. A mean of 5 or higher on a given question was treated as an indication of acceptability. Results: Ninety-eight clinical experts and stakeholders (92% participation rate) answered survey questions about the online process. They considered the OMD panel approach to be acceptable, particularly the ease of using the online system (mean = 5.3, standard deviation = 1.3) and the understanding gained from online discussions (mean = 5.2, standard deviation = 1.0). Participants also felt that participation in the Delphi study was interesting (mean = 5.6, standard deviation =1.1). Conclusion: These findings illustrate likely acceptability and a potential for a more widespread use of OMD panel approaches by stakeholders in developing health services performance measures.

Original languageEnglish (US)
Pages (from-to)354-360
Number of pages7
JournalJournal of Evaluation in Clinical Practice
Volume23
Issue number2
DOIs
StatePublished - Apr 1 2017
Externally publishedYes

Keywords

  • Delphi
  • expert panel
  • health care
  • health services research
  • online modified Delphi
  • performance measures

ASJC Scopus subject areas

  • Health Policy
  • Public Health, Environmental and Occupational Health

Fingerprint Dive into the research topics of 'Acceptability of an online modified Delphi panel approach for developing health services performance measures: results from 3 panels on arthritis research'. Together they form a unique fingerprint.

  • Cite this