An image classification deep-learning algorithm for shrapnel detection from ultrasound images.

Eric J Snider, Sofia I Hernandez-Torres, Emily N Boice
Author Information
  1. Eric J Snider: Engineering Technology and Automation Combat Casualty Care Research Team, United States Army Institute of Surgical Research, Ft. Sam Houston, TX, USA. eric.j.snider3.civ@mail.mil.
  2. Sofia I Hernandez-Torres: Engineering Technology and Automation Combat Casualty Care Research Team, United States Army Institute of Surgical Research, Ft. Sam Houston, TX, USA.
  3. Emily N Boice: Engineering Technology and Automation Combat Casualty Care Research Team, United States Army Institute of Surgical Research, Ft. Sam Houston, TX, USA.

Abstract

Ultrasound imaging is essential for non-invasively diagnosing injuries where advanced diagnostics may not be possible. However, image interpretation remains a challenge as proper expertise may not be available. In response, artificial intelligence algorithms are being investigated to automate image analysis and diagnosis. Here, we highlight an image classification convolutional neural network for detecting shrapnel in ultrasound images. As an initial application, different shrapnel types and sizes were embedded first in a tissue mimicking phantom and then in swine thigh tissue. The algorithm architecture was optimized stepwise by minimizing validation loss and maximizing F1 score. The final algorithm design trained on tissue phantom image sets had an F1 score of 0.95 and an area under the ROC curve of 0.95. It maintained higher than a 90% accuracy for each of 8 shrapnel types. When trained only on swine image sets, the optimized algorithm format had even higher metrics: F1 and area under the ROC curve of 0.99. Overall, the algorithm developed resulted in strong classification accuracy for both the tissue phantom and animal tissue. This framework can be applied to other trauma relevant imaging applications such as internal bleeding to further simplify trauma medicine when resources and image interpretation are scarce.

References

  1. Curr Med Imaging Rev. 2020;16(2):174-180 [PMID: 32003318]
  2. Nat Methods. 2012 Jun 28;9(7):676-82 [PMID: 22743772]
  3. Med Phys. 2006 Apr;33(4):916-21 [PMID: 16696466]
  4. J Trauma. 1999 Mar;46(3):466-72 [PMID: 10088853]
  5. Afr Health Sci. 2006 Sep;6(3):187-90 [PMID: 17140344]
  6. J Craniomaxillofac Surg. 2012 Sep;40(6):534-40 [PMID: 22070881]
  7. Sci Rep. 2021 Apr 20;11(1):8546 [PMID: 33879808]
  8. Brain Sci. 2020 Jul 03;10(7): [PMID: 32635409]
  9. Ing Rech Biomed. 2022 Apr;43(2):114-119 [PMID: 32837679]
  10. Sci Rep. 2020 Jun 23;10(1):10200 [PMID: 32576905]
  11. Sci Rep. 2018 Apr 26;8(1):6600 [PMID: 29700427]
  12. J Ophthalmol. 2019 Feb 13;2019:5208092 [PMID: 30895158]
  13. Mol Reprod Dev. 2015 Jul-Aug;82(7-8):518-29 [PMID: 26153368]
  14. J Xray Sci Technol. 2020;28(5):841-850 [PMID: 32804113]
  15. Sci Rep. 2020 Mar 6;10(1):4218 [PMID: 32144320]
  16. Ann Emerg Med. 1997 Mar;29(3):353-6 [PMID: 9055774]
  17. IEEE J Biomed Health Inform. 2021 Oct;25(10):3812-3823 [PMID: 34057900]
  18. J Trauma Nurs. 2017 Nov/Dec;24(6):376-380 [PMID: 29117056]
  19. IEEE Trans Med Imaging. 2007 Mar;26(3):393-404 [PMID: 17354644]
  20. Medicine (Baltimore). 2019 Apr;98(15):e15133 [PMID: 30985680]
  21. Comput Intell Neurosci. 2021 Apr 9;2021:5580914 [PMID: 33897774]
  22. IEEE Trans Med Imaging. 2017 Nov;36(11):2204-2215 [PMID: 28708546]
  23. Ultrasound Med Biol. 2020 Oct;46(10):2819-2833 [PMID: 32709519]
  24. IEEE Trans Med Imaging. 2019 Jan;38(1):240-249 [PMID: 30059297]
  25. Mil Med. 2010 Oct;175(10):742-4 [PMID: 20968263]

MeSH Term

Algorithms
Animals
Artificial Intelligence
Deep Learning
Image Processing, Computer-Assisted
Swine
Ultrasonography

Word Cloud

Created with Highcharts 10.0.0imagetissuealgorithmshrapnelclassificationphantomF10imagingmayinterpretationultrasoundimagestypesswineoptimizedscoretrainedsets95areaROCcurvehigheraccuracytraumaUltrasoundessentialnon-invasivelydiagnosinginjuriesadvanceddiagnosticspossibleHoweverremainschallengeproperexpertiseavailableresponseartificialintelligencealgorithmsinvestigatedautomateanalysisdiagnosishighlightconvolutionalneuralnetworkdetectinginitialapplicationdifferentsizesembeddedfirstmimickingthigharchitecturestepwiseminimizingvalidationlossmaximizingfinaldesignmaintained90%8formatevenmetrics:99Overalldevelopedresultedstronganimalframeworkcanappliedrelevantapplicationsinternalbleedingsimplifymedicineresourcesscarcedeep-learningdetection

Similar Articles

Cited By