BACKGROUND: Delphi techniques are conducted across different subfields in the health sciences. The reporting practices of studies using Delphi techniques vary, and current reporting guidelines for Delphi techniques focus on individual subfields of the health sciences or on different aspects of research and are therefore of limited applicability. The aim of this article was to identify similarities, differences, and possible shortcomings of existing Delphi reporting guidelines and to draft an initial proposal for a comprehensively applicable reporting guideline.
METHODS: A systematic literature search for reporting guidelines on Delphi studies was performed in existing data resources based on databases in the health sciences (Scopus, MEDLINE, CINAHL, Epistemonikos) including publications from 2016 to 2021. In June 2021, we conducted an additional search in PubMed and included further studies by contacting experts of the scientific Delphi expert network (DeWiss). Title and abstract screening of articles was performed, followed by a full-text screening of the articles included. We qualitatively and quantitatively evaluated, compared and contrasted the reporting guidelines identified using content analysis and discussed the results among the members of the Delphi expert network.
RESULTS: We retrieved ten health science articles with reporting guidelines for Delphi studies. In analyzing them, we identified nine main categories (Justification, Expert panel, Questionnaire, Survey design, Process regulation, Analyses, Results, Discussion, Methods reflection & Ethics). The current reporting guidelines vary significantly, with only the aspect of consensus appearing in all of them. Frequency distributions show that most of the subcategories are only addressed in individual articles (e.g., meeting of participants, proceeding with the survey method, transfer of the results, validation, prevention of bias) and that epistemological foundations of the Delphi technique are rarely mentioned or reflected on. We drafted an initial proposal for Delphi reporting guidelines for the health science sector.
DISCUSSION: A well-justified position concerning epistemological foundations of Delphi studies is necessary to make the quality of the process assessable and, along with the reporting of the process, to classify and compare study results. This will increase the acceptance of both the method in the health science sector and the results in medical practice. A Delphi reporting guideline must, above all, take into account the diversity of variants, subfield-related objectives and application areas, and their modifications of the Delphi technique in order to be comprehensively applicable in the health sciences.
CONCLUSION: The results of our methodological review do not provide a final reporting guideline. The newly developed proposal is intended to encourage discussion and agreement in further analyses.
