Reproducibility and Rigor in Animal-Based Research.

Malcolm Macleod, Swapna Mohan
Author Information
  1. Malcolm Macleod: Centre for Clinical Brain Sciences, University of Edinburgh, Edinburgh, United Kingdom.
  2. Swapna Mohan: National Institutes of Health, 8600 Rockville Pike, Bethesda, Maryland (previously in the Division of Policy and Education at the NIH Office of Laboratory Animal Welfare, NIH).

Abstract

Increasing focus on issues of research reproducibility affords us the opportunity to review some of the key issues related in vivo research. First, we set out some key definitions, to guide the reader through the rest of the paper. Next we consider issues of epistemology, of how animal experiments lead to changes in our understanding of biomedicine and, potentially, to the development of new therapeutics. Here we consider the meaning of statistical significance; the importance of understanding whether findings have general truth; and the advances in knowledge which can result from 'failed' replication. Then, we consider weaknesses in the design, conduct and reporting of experiments, and review evidence for this from systematic reviews and from experimental studies addressing these issues. We consider the impact that these weaknesses have on the development of new treatments for human disease, and reflect on the response to these issues from the biomedical research community. Finally, we consider strategies for improvement including increased use of brief, pre-registered study protocols; pre-registration, open publication and open data; and the central importance of education in improving research performance.

Keywords

References

  1. Stroke. 2008 Oct;39(10):2824-9 [PMID: 18635842]
  2. Genome Res. 2012 Feb;22(2):299-306 [PMID: 22009989]
  3. Nat Rev Drug Discov. 2004 Aug;3(8):711-5 [PMID: 15286737]
  4. Sci Transl Med. 2016 Jun 1;8(341):341ps12 [PMID: 27252173]
  5. J Young Pharm. 2010 Jul;2(3):332-6 [PMID: 21042496]
  6. Nat Hum Behav. 2018 Sep;2(9):616-617 [PMID: 31346265]
  7. J Cereb Blood Flow Metab. 2017 Nov;37(11):3488-3517 [PMID: 28797196]
  8. Proc Natl Acad Sci U S A. 2015 Dec 15;112(50):15343-7 [PMID: 26553988]
  9. Elife. 2018 Mar 13;7: [PMID: 29533182]
  10. Implement Sci. 2011 Apr 23;6:42 [PMID: 21513547]
  11. Med Health Care Philos. 2019 Jun;22(2):245-252 [PMID: 30155851]
  12. Trends Pharmacol Sci. 2016 Jul;37(7):509-510 [PMID: 27211784]
  13. BMJ Open Sci. 2019 Feb 26;3(1):e000035 [PMID: 35047682]
  14. Nat Commun. 2017 Feb 21;8:14256 [PMID: 28220799]
  15. Lab Anim. 2018 Apr;52(2):135-141 [PMID: 28771074]
  16. Nature. 2012 Mar 28;483(7391):531-3 [PMID: 22460880]
  17. J Clin Epidemiol. 2014 Sep;67(9):973-83 [PMID: 24972762]
  18. BMJ. 2018 Jan 10;360:k66 [PMID: 29321154]
  19. Nature. 2017 Aug 22;548(7668):387-388 [PMID: 28836615]
  20. CMAJ. 2013 Sep 17;185(13):1117-8 [PMID: 23979868]
  21. Nature. 2012 Oct 11;490(7419):187-91 [PMID: 23060188]
  22. Stroke. 2016 Jan;47(1):267-72 [PMID: 26658439]
  23. PLoS Biol. 2010 Jun 29;8(6):e1000412 [PMID: 20613859]
  24. N Engl J Med. 2007 Aug 9;357(6):562-71 [PMID: 17687131]
  25. PLoS Biol. 2010 Mar 30;8(3):e1000344 [PMID: 20361022]
  26. Res Integr Peer Rev. 2019 Jun 12;4:12 [PMID: 31205756]
  27. Circ Res. 2017 Jun 9;120(12):1916-1926 [PMID: 28373349]
  28. Nature. 2019 Jun;570(7759):5 [PMID: 31160744]
  29. Lancet. 2014 Jan 11;383(9912):166-75 [PMID: 24411645]
  30. Nature. 2017 Feb 22;542(7642):409-411 [PMID: 28230138]
  31. Stroke. 2009 Mar;40(3):e50-2 [PMID: 18703798]
  32. Lancet. 2009 Jul 4;374(9683):86-9 [PMID: 19525005]
  33. PLoS Biol. 2013 Jul;11(7):e1001609 [PMID: 23874156]
  34. Nat Rev Drug Discov. 2011 Aug 31;10(9):712 [PMID: 21892149]
  35. PLoS Biol. 2014 Jan;12(1):e1001756 [PMID: 24409096]
  36. Br J Cancer. 2013 Jan 15;108(1):64-71 [PMID: 23321511]
  37. PLoS Biol. 2015 Oct 13;13(10):e1002273 [PMID: 26460723]
  38. Circ Res. 2016 Apr 15;118(8):1223-32 [PMID: 26888636]
  39. Parkinsonism Relat Disord. 2011 Jun;17(5):313-20 [PMID: 21376651]

MeSH Term

Animal Experimentation
Animals
Biomedical Research
Research Design

Word Cloud

Created with Highcharts 10.0.0researchissuesconsiderreproducibilityreviewkeyexperimentsunderstandingdevelopmentnewimportanceweaknessesimprovementopenIncreasingfocusaffordsusopportunityrelatedvivoFirstsetdefinitionsguidereaderrestpaperNextepistemologyanimalleadchangesbiomedicinepotentiallytherapeuticsmeaningstatisticalsignificancewhetherfindingsgeneraltruthadvancesknowledgecanresult'failed'replicationdesignconductreportingevidencesystematicreviewsexperimentalstudiesaddressingimpacttreatmentshumandiseasereflectresponsebiomedicalcommunityFinallystrategiesincludingincreasedusebriefpre-registeredstudyprotocolspre-registrationpublicationdatacentraleducationimprovingperformanceReproducibilityRigorAnimal-BasedResearchethicsactivityrigorrisksbias

Similar Articles

Cited By