Characterising and justifying sample size sufficiency in interview-based studies: systematic analysis of qualitative health research over a 15-year period.

Konstantina Vasileiou, Julie Barnett, Susan Thorpe, Terry Young
Author Information
  1. Konstantina Vasileiou: Department of Psychology, University of Bath, Building 10 West, Claverton Down, Bath, BA2 7AY, UK. K.Vasileiou@bath.ac.uk. ORCID
  2. Julie Barnett: Department of Psychology, University of Bath, Building 10 West, Claverton Down, Bath, BA2 7AY, UK.
  3. Susan Thorpe: School of Psychology, Newcastle University, Ridley Building 1, Queen Victoria Road, Newcastle upon Tyne, NE1 7RU, UK.
  4. Terry Young: Department of Computer Science, Brunel University London, Wilfred Brown Building 108, Uxbridge, UB8 3PH, UK.

Abstract

BACKGROUND: Choosing a suitable sample size in qualitative research is an area of conceptual debate and practical uncertainty. That sample size principles, guidelines and tools have been developed to enable researchers to set, and justify the acceptability of, their sample size is an indication that the issue constitutes an important marker of the quality of qualitative research. Nevertheless, research shows that sample size sufficiency reporting is often poor, if not absent, across a range of disciplinary fields.
METHODS: A systematic analysis of single-interview-per-participant designs within three health-related journals from the disciplines of psychology, sociology and medicine, over a 15-year period, was conducted to examine whether and how sample sizes were justified and how sample size was characterised and discussed by authors. Data pertinent to sample size were extracted and analysed using qualitative and quantitative analytic techniques.
RESULTS: Our findings demonstrate that provision of sample size justifications in qualitative health research is limited; is not contingent on the number of interviews; and relates to the journal of publication. Defence of sample size was most frequently supported across all three journals with reference to the principle of saturation and to pragmatic considerations. Qualitative sample sizes were predominantly - and often without justification - characterised as insufficient (i.e., 'small') and discussed in the context of study limitations. Sample size insufficiency was seen to threaten the validity and generalizability of studies' results, with the latter being frequently conceived in nomothetic terms.
CONCLUSIONS: We recommend, firstly, that qualitative health researchers be more transparent about evaluations of their sample size sufficiency, situating these within broader and more encompassing assessments of data adequacy. Secondly, we invite researchers critically to consider how saturation parameters found in prior methodological studies and sample size community norms might best inform, and apply to, their own project and encourage that data adequacy is best appraised with reference to features that are intrinsic to the study at hand. Finally, those reviewing papers have a vital role in supporting and encouraging transparent study-specific reporting.

Keywords

References

  1. Psychol Health. 2010 Dec;25(10):1229-45 [PMID: 20204937]
  2. PLoS Med. 2009 Jul 21;6(7):e1000097 [PMID: 19621072]
  3. Res Nurs Health. 2001 Jun;24(3):230-40 [PMID: 11526621]
  4. Sociol Health Illn. 2010 Nov;32(7):1059-71 [PMID: 20942822]
  5. Am Psychol. 2015 Jan;70(1):1-9 [PMID: 25581004]
  6. Res Nurs Health. 1996 Dec;19(6):525-9 [PMID: 8948406]
  7. Qual Health Res. 2017 Mar;27(4):591-608 [PMID: 27670770]
  8. Res Aging. 1995 Mar 1;17(1):89-113 [PMID: 22058580]
  9. PLoS One. 2017 Jul 26;12(7):e0181689 [PMID: 28746358]
  10. Qual Quant. 2018;52(4):1893-1907 [PMID: 29937585]
  11. Qual Health Res. 2016 Nov;26(13):1753-1760 [PMID: 26613970]
  12. J Nutr Educ. 2001 Jul-Aug;33(4):184-92 [PMID: 11953239]
  13. Expert Rev Pharmacoecon Outcomes Res. 2010 Jun;10(3):269-81 [PMID: 20545592]
  14. Nurs Health Sci. 2016 Mar;18(1):4-7 [PMID: 26931367]
  15. Qual Health Res. 2005 Nov;15(9):1277-88 [PMID: 16204405]
  16. Expert Rev Med Devices. 2014 Sep;11(5):513-25 [PMID: 25033757]
  17. BMJ. 1995 Jul 22;311(6999):251-3 [PMID: 7627048]
  18. Implement Sci. 2018 Jan 25;13(Suppl 1):14 [PMID: 29384077]
  19. Res Nurs Health. 1995 Apr;18(2):179-83 [PMID: 7899572]
  20. BMJ. 2016 Feb 10;352:i563 [PMID: 26865572]
  21. BMC Med Res Methodol. 2011 Mar 11;11:26 [PMID: 21396104]
  22. Soc Sci Med. 2014 Nov;120:135-41 [PMID: 25241120]
  23. Health Educ Behav. 2004 Feb;31(1):9-21 [PMID: 14768654]
  24. Fam Pract. 1996 Dec;13(6):522-5 [PMID: 9023528]
  25. Qual Health Res. 2015 May;25(5):587-8 [PMID: 25829508]

MeSH Term

Humans
Interviews as Topic
Periodicals as Topic
Qualitative Research
Research Personnel
Researcher-Subject Relations
Sample Size
Systematic Reviews as Topic

Word Cloud

Created with Highcharts 10.0.0sizesamplequalitativeresearchhealthSampleresearcherssufficiencyanalysisQualitativeadequacyreportingoftenacrosssystematicwithinthreejournals15-yearperiodsizescharacteriseddiscussedDatainterviewsfrequentlyreferencesaturation-justificationstudytransparentdatabestBACKGROUND:ChoosingsuitableareaconceptualdebatepracticaluncertaintyprinciplesguidelinestoolsdevelopedenablesetjustifyacceptabilityindicationissueconstitutesimportantmarkerqualityNeverthelessshowspoorabsentrangedisciplinaryfieldsMETHODS:single-interview-per-participantdesignshealth-relateddisciplinespsychologysociologymedicineconductedexaminewhetherjustifiedauthorspertinentextractedanalysedusingquantitativeanalytictechniquesRESULTS:findingsdemonstrateprovisionjustificationslimitedcontingentnumberrelatesjournalpublicationDefencesupportedprinciplepragmaticconsiderationspredominantlywithoutinsufficientie'small'contextlimitationsinsufficiencyseenthreatenvaliditygeneralizabilitystudies'resultslatterconceivednomothetictermsCONCLUSIONS:recommendfirstlyevaluationssituatingbroaderencompassingassessmentsSecondlyinvitecriticallyconsiderparametersfoundpriormethodologicalstudiescommunitynormsmightinformapplyprojectencourageappraisedfeaturesintrinsichandFinallyreviewingpapersvitalrolesupportingencouragingstudy-specificCharacterisingjustifyinginterview-basedstudies:ReviewcharacterisationSystematic

Similar Articles

Cited By