Scientific guidelines for evaluating the validity of forensic feature-comparison methods.

Nicholas Scurich, David L Faigman, Thomas D Albright
Author Information
  1. Nicholas Scurich: Department of Psychological Science, Department of Criminology, Law and Society, University of California, Irvine, CA 92697. ORCID
  2. David L Faigman: University of California College of the Law, San Francisco, CA 94102.
  3. Thomas D Albright: Salk Institute for Biological Studies, La Jolla, CA 92037. ORCID

Abstract

When it comes to questions of fact in a legal context-particularly questions about measurement, association, and causality-courts should employ ordinary standards of applied science. Applied sciences generally develop along a path that proceeds from a basic scientific discovery about some natural process to the formation of a theory of how the process works and what causes it to fail, to the development of an invention intended to assess, repair, or improve the process, to the specification of predictions of the instrument's actions and, finally, empirical validation to determine that the instrument achieves the intended effect. These elements are salient and deeply embedded in the cultures of the applied sciences of medicine and engineering, both of which primarily grew from basic sciences. However, the inventions that underlie most forensic science disciplines have few roots in basic science, and they do not have sound theories to justify their predicted actions or results of empirical tests to prove that they work as advertised. Inspired by the "Bradford Hill Guidelines"-the dominant framework for causal inference in epidemiology-we set forth four guidelines that can be used to establish the validity of forensic comparison methods generally. This framework is not intended as a checklist establishing a threshold of minimum validity, as no magic formula determines when particular disciplines or hypotheses have passed a necessary threshold. We illustrate how these guidelines can be applied by considering the discipline of firearm and tool mark examination.

Keywords

References

  1. J Forensic Sci. 2007 May;52(3):586-94 [PMID: 17456086]
  2. Forensic Sci Int. 2017 Aug;277:66-76 [PMID: 28622536]
  3. JAMA. 2003 Jan 22-29;289(4):454-65 [PMID: 12533125]
  4. BMJ Evid Based Med. 2018 Feb;23(1):21-22 [PMID: 29367321]
  5. Proc Natl Acad Sci U S A. 2023 May 16;120(20):e2210428120 [PMID: 37155908]
  6. Science. 2003 Dec 5;302(5651):1625 [PMID: 14657460]
  7. J Forensic Sci. 2020 May;65(3):809-814 [PMID: 31922611]
  8. J Forensic Sci. 2020 May;65(3):815-822 [PMID: 31873940]
  9. BMJ. 2006 Apr 22;332(7547):969-71 [PMID: 16627519]
  10. West J Med. 2000 Apr;172(4):271-3 [PMID: 10778385]
  11. Nature. 1993 Sep 16;365(6443):250-2 [PMID: 8371779]
  12. Daedalus. 2015 Winter;144(1):22-41 [PMID: 30636778]
  13. Psychol Bull. 1957 Jul;54(4):297-312 [PMID: 13465924]
  14. Emerg Themes Epidemiol. 2015 Sep 30;12:14 [PMID: 26425136]
  15. Forensic Sci Int Synerg. 2020 Dec 21;2:703-704 [PMID: 33385151]
  16. J Forensic Sci. 2015 May;60(3):549-55 [PMID: 25716577]
  17. J Forensic Sci. 2023 Jan;68(1):86-100 [PMID: 36183147]
  18. Forensic Sci Int Synerg. 2020 Sep 24;2:293-298 [PMID: 33083776]
  19. Proc R Soc Med. 1965 May;58:295-300 [PMID: 14283879]
  20. Forensic Sci Int Synerg. 2022 Jun 08;5:100273 [PMID: 35800204]
  21. J Forensic Sci. 2019 Mar;64(2):551-557 [PMID: 30261099]
  22. J Forensic Sci. 2016 Jul;61(4):939-46 [PMID: 27135174]
  23. Forensic Sci Int Synerg. 2020 Sep 06;2:333-338 [PMID: 33385131]
  24. Law Hum Behav. 2001 Oct;25(5):433-58 [PMID: 11688367]
  25. Science. 2005 Aug 5;309(5736):892-5 [PMID: 16081727]
  26. PLoS One. 2013 Sep 02;8(9):e72484 [PMID: 24023744]
  27. J Forensic Sci. 2010 Sep;55(5):1291-5 [PMID: 20533988]
  28. Law Hum Behav. 2020 Oct;44(5):412-423 [PMID: 33090867]
  29. Front Genet. 2013 Oct 28;4:220 [PMID: 24194748]
  30. Psychol Sci. 2011 Aug;22(8):995-7 [PMID: 21724948]
  31. Trials. 2014 Dec 23;15:508 [PMID: 25539637]
  32. Proc Natl Acad Sci U S A. 2012 Dec 11;109(50):20198-9 [PMID: 23236127]
  33. J Forensic Sci. 2021 Jan;66(1):129-134 [PMID: 32990979]
  34. Proc Natl Acad Sci U S A. 1950 Jun;36(6):344-55 [PMID: 15430309]
  35. Forensic Sci Int Synerg. 2022 Apr 20;4:100228 [PMID: 35510144]
  36. Neuron. 2012 Apr 26;74(2):227-45 [PMID: 22542178]

MeSH Term

Forensic Medicine
Forensic Sciences
Causality

Word Cloud

Created with Highcharts 10.0.0scienceforensicappliedsciencesbasicprocessintendedguidelinesvalidityquestionsmeasurementgenerallyactionsempiricaldisciplinesframeworkcanmethodsthresholdcomesfactlegalcontext-particularlyassociationcausality-courtsemployordinarystandardsApplieddevelopalongpathproceedsscientificdiscoverynaturalformationtheoryworkscausesfaildevelopmentinventionassessrepairimprovespecificationpredictionsinstrument'sfinallyvalidationdetermineinstrumentachieveseffectelementssalientdeeplyembeddedculturesmedicineengineeringprimarilygrewHoweverinventionsunderlierootssoundtheoriesjustifypredictedresultstestsproveworkadvertisedInspired"BradfordHillGuidelines"-thedominantcausalinferenceepidemiology-wesetforthfourusedestablishcomparisonchecklistestablishingminimummagicformuladeterminesparticularhypothesespassednecessaryillustrateconsideringdisciplinefirearmtoolmarkexaminationScientificevaluatingfeature-comparisonDaubertdecision-makingresearchmethodology

Similar Articles

Cited By