Seeing the random forest through the decision trees. Supporting learning health systems from histopathology with machine learning models: Challenges and opportunities.

Ricardo Gonzalez, Ashirbani Saha, Clinton J V Campbell, Peyman Nejat, Cynthia Lokker, Andrew P Norgan
Author Information
  1. Ricardo Gonzalez: DeGroote School of Business, McMaster University, Hamilton, Ontario, Canada.
  2. Ashirbani Saha: Department of Oncology, Faculty of Health Sciences, McMaster University, Hamilton, Ontario, Canada.
  3. Clinton J V Campbell: William Osler Health System, Brampton, Ontario, Canada.
  4. Peyman Nejat: Department of Artificial Intelligence and Informatics, Mayo Clinic, Rochester, MN, United States.
  5. Cynthia Lokker: Health Information Research Unit, Department of Health Research Methods, Evidence and Impact, McMaster University, Hamilton, Ontario, Canada.
  6. Andrew P Norgan: Department of Laboratory Medicine and Pathology, Mayo Clinic, Rochester, MN, United States.

Abstract

This paper discusses some overlooked challenges faced when working with machine learning models for histopathology and presents a novel opportunity to support "Learning Health Systems" with them. Initially, the authors elaborate on these challenges after separating them according to their mitigation strategies: those that need innovative approaches, time, or future technological capabilities and those that require a conceptual reappraisal from a critical perspective. Then, a novel opportunity to support "Learning Health Systems" by integrating hidden information extracted by ML models from digitalized histopathology slides with other healthcare big data is presented.

Keywords

References

  1. Nat Med. 2018 Oct;24(10):1559-1567 [PMID: 30224757]
  2. Nat Biomed Eng. 2021 Jun;5(6):555-570 [PMID: 33649564]
  3. Histopathology. 2022 Oct;81(4):439-446 [PMID: 35942645]
  4. BMC Med Inform Decis Mak. 2022 Jun 16;22(Suppl 2):156 [PMID: 35710407]
  5. Leukemia. 2022 Jul;36(7):1720-1748 [PMID: 35732829]
  6. Patient Educ Couns. 2021 Nov;104(11):2606-2615 [PMID: 34312032]
  7. Nat Med. 2019 Oct;25(10):1519-1525 [PMID: 31591589]
  8. J Pathol Inform. 2018 Nov 14;9:38 [PMID: 30607305]
  9. Behav Brain Sci. 2010 Jun;33(2-3):61-83; discussion 83-135 [PMID: 20550733]
  10. Nat Med. 2022 May;28(5):924-933 [PMID: 35585198]
  11. JMIR Public Health Surveill. 2022 Dec 29;8(12):e35750 [PMID: 36426919]
  12. J Am Med Inform Assoc. 2019 Dec 1;26(12):1645-1650 [PMID: 31504588]
  13. Med Health Care Philos. 2022 Mar;25(1):47-60 [PMID: 34460042]
  14. NPJ Digit Med. 2020 Mar 10;3:31 [PMID: 32195366]
  15. Toxicol Pathol. 1996 Sep-Oct;24(5):654-6 [PMID: 8923693]
  16. Cancer Res Treat. 2019 Oct;51(4):1568-1577 [PMID: 30971066]
  17. Eur J Cancer. 2019 Jul;115:57-60 [PMID: 31108243]
  18. PLOS Digit Health. 2022 Mar 31;1(3):e0000022 [PMID: 36812532]
  19. Am J Manag Care. 2020 Jan;26(1):26-31 [PMID: 31951356]
  20. JAMA Netw Open. 2022 Mar 1;5(3):e220269 [PMID: 35289862]
  21. Sci Transl Med. 2018 Feb 28;10(430): [PMID: 29491186]
  22. Adv Anat Pathol. 2020 Jul;27(4):241-250 [PMID: 32541594]
  23. JMIR Med Inform. 2022 May 31;10(5):e36388 [PMID: 35639450]
  24. Sci Rep. 2021 Apr 26;11(1):8894 [PMID: 33903725]
  25. Nat Med. 2020 Jan;26(1):25-26 [PMID: 31932798]
  26. Med Image Anal. 2019 Dec;58:101544 [PMID: 31466046]
  27. BMC Med Res Methodol. 2022 Dec 12;22(1):316 [PMID: 36510134]
  28. Neuroimaging Clin N Am. 2020 Nov;30(4):433-445 [PMID: 33038994]
  29. Fam Pract. 2001 Jun;18(3):304-8 [PMID: 11356739]
  30. Commun Med (Lond). 2022 Sep 1;2:111 [PMID: 36059892]
  31. JAMA Oncol. 2022 Oct 1;8(10):1493-1501 [PMID: 36006639]
  32. Ned Tijdschr Geneeskd. 2017;160:D981 [PMID: 28120732]
  33. N Engl J Med. 2021 Jul 1;385(1):1-5 [PMID: 34192452]
  34. Neurosurg Focus. 2008;24(5):E3 [PMID: 18447742]
  35. J Eval Clin Pract. 2021 Jun;27(3):537-542 [PMID: 33164284]
  36. Cancer Cell. 2022 Aug 8;40(8):865-878.e6 [PMID: 35944502]
  37. Front Med (Lausanne). 2019 Nov 22;6:264 [PMID: 31824952]
  38. Proc IEEE Comput Soc Conf Comput Vis Pattern Recognit. 2016 Jun-Jul;2016:2424-2433 [PMID: 27795661]
  39. Nat Biomed Eng. 2018 Oct;2(10):719-731 [PMID: 31015651]
  40. Virchows Arch. 2021 Aug;479(2):425-430 [PMID: 33796909]
  41. Anesth Analg. 2020 May;130(5):1115-1118 [PMID: 32287118]
  42. CA Cancer J Clin. 1979 Mar-Apr;29(2):66-77 [PMID: 219944]
  43. Behav Brain Sci. 2017 Jan;40:e253 [PMID: 27881212]
  44. Dtsch Arztebl Int. 2021 Mar 26;118(12):194-204 [PMID: 34024323]
  45. Health Inf Manag. 2018 Sep;47(3):103-105 [PMID: 29719995]
  46. Nat Med. 2019 May;25(5):792-804 [PMID: 31068711]
  47. JMIR Public Health Surveill. 2020 Oct 22;6(4):e22400 [PMID: 33090117]
  48. AMA J Ethics. 2019 Feb 1;21(2):E167-179 [PMID: 30794127]
  49. J Pathol Inform. 2021 Aug 04;12:30 [PMID: 34497734]
  50. Nature. 2023 Apr;616(7956):259-265 [PMID: 37045921]
  51. Learn Health Syst. 2021 Mar 11;6(1):e10259 [PMID: 35036547]
  52. Endocr Relat Cancer. 2022 Dec 22;30(2): [PMID: 36445235]
  53. J Oral Pathol Med. 2020 Aug;49(7):630-635 [PMID: 31899572]
  54. J Pathol Transl Med. 2022 Mar;56(2):109-110 [PMID: 35086188]
  55. Arch Pathol Lab Med. 2009 Jan;133(1):124-32 [PMID: 19123724]
  56. J Med Internet Res. 2022 Feb 15;24(2):e34560 [PMID: 35166689]
  57. Cancer Sci. 2020 May;111(5):1452-1460 [PMID: 32133724]
  58. Pathologica. 2020 Mar;112(1):25-41 [PMID: 32202537]
  59. Nat Commun. 2022 Oct 20;13(1):6039 [PMID: 36266298]
  60. Semin Diagn Pathol. 2023 Mar;40(2):100-108 [PMID: 36882343]
  61. Arch Pathol Lab Med. 2021 Oct 1;145(10):1228-1254 [PMID: 33493264]
  62. NPJ Digit Med. 2023 May 31;6(1):101 [PMID: 37258851]
  63. BMC Public Health. 2020 May 1;20(1):608 [PMID: 32357871]
  64. Sci Rep. 2020 Nov 2;10(1):18802 [PMID: 33139755]
  65. J Pathol. 2019 Nov;249(3):286-294 [PMID: 31355445]
  66. Neural Netw. 2019 May;113:54-71 [PMID: 30780045]
  67. Am J Surg Pathol. 2015 Jan;39(1):93-100 [PMID: 25188867]
  68. Am J Clin Pathol. 1994 Aug;102(2):152-3 [PMID: 8042580]
  69. Chest. 2022 Jun;161(6):1621-1627 [PMID: 35143823]
  70. Clin Pharmacol Ther. 2022 Dec;112(6):1172-1182 [PMID: 35213741]
  71. NPJ Digit Med. 2022 Aug 6;5(1):110 [PMID: 35933478]
  72. NPJ Digit Med. 2020 Sep 14;3:119 [PMID: 33015372]
  73. Br J Cancer. 2021 Feb;124(4):686-696 [PMID: 33204028]
  74. Int J Cancer. 2020 Jun 15;146(12):3516-3521 [PMID: 32170735]
  75. Micron. 2009 Jun;40(4):486-94 [PMID: 19171487]
  76. Histopathology. 2022 Oct;81(4):459-466 [PMID: 35502823]
  77. Arch Public Health. 2022 Jan 17;80(1):29 [PMID: 35039082]
  78. BMC Med Res Methodol. 2021 Oct 17;21(1):216 [PMID: 34657597]
  79. J Med Internet Res. 2016 Dec 16;18(12):e323 [PMID: 27986644]
  80. J Pathol Clin Res. 2019 Apr;5(2):81-90 [PMID: 30767396]
  81. Sci Rep. 2023 Jan 31;13(1):1724 [PMID: 36720907]
  82. Front Med (Lausanne). 2017 Nov 10;4:193 [PMID: 29209611]
  83. PLOS Digit Health. 2022 Dec 2;1(12):e0000145 [PMID: 36812609]
  84. Nat Med. 2022 Sep;28(9):1773-1784 [PMID: 36109635]
  85. Int J Environ Res Public Health. 2022 Dec 06;19(23): [PMID: 36498432]
  86. Patholog Res Int. 2011;2011:656079 [PMID: 21876845]
  87. J Pathol. 2009 Jul;218(3):285-91 [PMID: 19291709]
  88. World J Urol. 2021 Feb;39(2):425-431 [PMID: 32266509]
  89. Value Health. 2022 Mar;25(3):359-367 [PMID: 35227446]
  90. Med Educ. 2009 Apr;43(4):312-9 [PMID: 19335572]
  91. J Clin Pathol. 2019 Sep;72(9):622-629 [PMID: 31217255]
  92. J Am Acad Dermatol. 2021 May;84(5):1458-1459 [PMID: 32645400]
  93. Acad Forensic Pathol. 2021 Dec;11(4):185-195 [PMID: 35003450]
  94. Cancer Treat Rev. 2022 Jul;108:102410 [PMID: 35609495]
  95. Arch Pathol Lab Med. 2012 Oct;136(10):1266-97 [PMID: 22742517]
  96. Lancet Haematol. 2020 Jul;7(7):e541-e550 [PMID: 32589980]
  97. Med Image Anal. 2023 May;86:102791 [PMID: 36933385]
  98. Arch Pathol Lab Med. 2017 Sep;141(9):1267-1275 [PMID: 28557614]
  99. Sci Rep. 2022 Oct 26;12(1):17981 [PMID: 36289266]
  100. Nat Commun. 2022 Sep 29;13(1):5711 [PMID: 36175413]
  101. Science. 2009 Dec 11;326(5959):1496-9 [PMID: 20007893]
  102. Nat Med. 2020 Jun;26(6):807-808 [PMID: 32514173]
  103. Breast J. 2020 Jan;26(1):27-34 [PMID: 31876097]
  104. Circ Heart Fail. 2022 Nov;15(11):e009473 [PMID: 36378761]
  105. Arch Pathol Lab Med. 2016 Jan;140(1):29-40 [PMID: 25965939]
  106. Ann Diagn Pathol. 2020 Aug;47:151561 [PMID: 32623312]
  107. NPJ Digit Med. 2022 May 12;5(1):62 [PMID: 35551275]
  108. BMJ Health Care Inform. 2021 Aug;28(1): [PMID: 34426417]
  109. J Law Med Ethics. 2022;50(1):92-100 [PMID: 35243993]
  110. Ann Intern Med. 2015 Jan 6;162(1):55-63 [PMID: 25560714]
  111. Br J Oral Maxillofac Surg. 2022 Jun;60(5):577-583 [PMID: 35365340]
  112. Chin J Cancer Res. 2016 Feb;28(1):58-64 [PMID: 27041927]
  113. Adv Ther. 2023 Apr;40(4):1379-1392 [PMID: 36418841]
  114. J Med Syst. 2022 Jan 12;46(2):12 [PMID: 35020064]
  115. Learn Health Syst. 2016 Nov 29;1(1):e10020 [PMID: 31245555]
  116. PLOS Digit Health. 2022 Oct 6;1(10):e0000102 [PMID: 36812599]
  117. Genome Med. 2016 Dec 19;8(1):134 [PMID: 27993174]
  118. J Med Internet Res. 2023 Jan 10;25:e39742 [PMID: 36626192]
  119. J Pers Med. 2022 Sep 01;12(9): [PMID: 36143229]
  120. Front Cardiovasc Med. 2022 Apr 27;9:840262 [PMID: 35571171]
  121. J Coll Physicians Surg Pak. 2021 Sep;31(9):1120-1122 [PMID: 34500536]
  122. Korean J Radiol. 2021 Mar;22(3):442-453 [PMID: 33629545]
  123. J Am Med Inform Assoc. 2003 Jan-Feb;10(1):39-51 [PMID: 12509356]
  124. NPJ Digit Med. 2020 Aug 27;3:110 [PMID: 32904379]
  125. J Pathol. 2019 Oct;249(2):143-150 [PMID: 31144302]
  126. Sci Rep. 2020 Apr 29;10(1):7275 [PMID: 32350370]
  127. BMC Public Health. 2022 Nov 22;22(1):2146 [PMID: 36419010]
  128. BMJ Open. 2019 May 9;9(5):e026589 [PMID: 31076472]
  129. J Am Heart Assoc. 2023 Jul 4;12(13):e029765 [PMID: 37345825]
  130. J Clin Epidemiol. 2022 Feb;142:252-257 [PMID: 34748907]
  131. Diagn Progn Res. 2021 Jan 11;5(1):1 [PMID: 33431065]
  132. Science. 2018 Apr 20;360(6386):243 [PMID: 29674567]
  133. Radiol Artif Intell. 2022 May 04;4(3):e210064 [PMID: 35652114]
  134. NPJ Breast Cancer. 2022 Dec 6;8(1):129 [PMID: 36473870]
  135. J Health Econ Outcomes Res. 2022 Apr 26;9(1):101-110 [PMID: 35620451]
  136. Virchows Arch. 2006 Jun;448(6):739-43 [PMID: 16550394]
  137. J Eval Clin Pract. 2015 Jun;21(3):357-64 [PMID: 25923823]
  138. Nature. 2016 Oct 12;538(7624):161-164 [PMID: 27734877]
  139. Comput Struct Biotechnol J. 2018 Feb 09;16:34-42 [PMID: 30275936]
  140. BMC Med. 2020 May 28;18(1):114 [PMID: 32460859]
  141. J Am Med Inform Assoc. 2021 Aug 13;28(9):1874-1884 [PMID: 34260720]
  142. Form Ontol Inf Syst. 2004;2004:185-195 [PMID: 25745641]
  143. Acad Pathol. 2016 Apr 19;3:2374289516643543 [PMID: 28725765]
  144. BMC Med Res Methodol. 2014 Mar 25;14:42 [PMID: 24669751]
  145. N Engl J Med. 2017 Oct 12;377(15):1409-1412 [PMID: 29020592]
  146. Br J Philos Sci. 2019 Jun;70(2):609-627 [PMID: 31086424]
  147. AJR Am J Roentgenol. 2023 Jul;221(1):7-16 [PMID: 36629307]
  148. NPJ Digit Med. 2022 Nov 7;5(1):171 [PMID: 36344814]
  149. Lancet Digit Health. 2021 Nov;3(11):e693-e695 [PMID: 34561202]
  150. Acad Pathol. 2016 Jul 25;3:2374289516659079 [PMID: 28725774]
  151. N Engl J Med. 2018 Oct 11;379(15):1452-1462 [PMID: 30304648]
  152. Nat Cancer. 2020 Aug;1(8):800-810 [PMID: 35122049]
  153. Hum Pathol. 2015 Nov;46(11):1722-9 [PMID: 26344416]
  154. Hum Pathol. 2023 Feb;132:31-38 [PMID: 35870567]
  155. Nat Med. 2020 Sep;26(9):1320-1324 [PMID: 32908275]
  156. J Clin Pathol. 2018 Nov;71(11):995-1000 [PMID: 30068638]
  157. Genome Med. 2021 Sep 27;13(1):152 [PMID: 34579788]
  158. Am J Clin Pathol. 2022 May 4;157(5):767-773 [PMID: 35512255]
  159. Histopathology. 2020 Jan;76(1):112-127 [PMID: 31846527]
  160. BMC Med. 2023 Feb 24;21(1):70 [PMID: 36829188]
  161. Nat Commun. 2022 Nov 10;13(1):6812 [PMID: 36357420]
  162. Science. 2019 Oct 25;366(6464):447-453 [PMID: 31649194]
  163. Pathol Res Pract. 2014 Oct;210(10):628-33 [PMID: 24939143]
  164. Patterns (N Y). 2020 Nov 13;1(8):100129 [PMID: 33294870]
  165. Cancers (Basel). 2020 Apr 15;12(4): [PMID: 32326638]
  166. Mod Pathol. 2022 Dec;35(12):1759-1769 [PMID: 36088478]
  167. Lancet Digit Health. 2020 Sep;2(9):e489-e492 [PMID: 32864600]
  168. Mod Pathol. 2001 Mar;14(3):258-60 [PMID: 11266535]
  169. Am J Hematol. 2023 Mar;98(3):481-492 [PMID: 36606297]
  170. Hum Pathol. 2013 Mar;44(3):357-64 [PMID: 22835956]
  171. J Clin Epidemiol. 2021 Oct;138:60-72 [PMID: 34214626]
  172. Histopathology. 2008 Mar;52(4):494-9 [PMID: 18315602]
  173. Patterns (N Y). 2023 Jul 05;4(8):100788 [PMID: 37602217]
  174. Int J Nurs Stud. 2011 Jun;48(6):661-71 [PMID: 21514934]
  175. Bioengineering (Basel). 2022 Aug 30;9(9): [PMID: 36134972]
  176. J Invest Dermatol. 2015 Mar;135(3):1-4 [PMID: 25666678]
  177. N Engl J Med. 2020 Feb 27;382(9):791-793 [PMID: 32101661]
  178. Nat Commun. 2021 Feb 19;12(1):1193 [PMID: 33608558]
  179. Arch Pathol Lab Med. 2000 Jul;124(7):1040-6 [PMID: 10888781]
  180. J Clin Pathol. 2018 Apr;71(4):285-290 [PMID: 29113995]
  181. Health Informatics J. 2020 Sep;26(3):1926-1951 [PMID: 31884843]
  182. J Pathol Clin Res. 2023 Jul;9(4):251-260 [PMID: 37045794]
  183. J Pathol Inform. 2021 Jan 23;12:5 [PMID: 34012709]
  184. PLoS One. 2020 Jun 25;15(6):e0235064 [PMID: 32584879]
  185. Patterns (N Y). 2021 Oct 08;2(10):100347 [PMID: 34693373]
  186. Hum Pathol. 2017 Apr;62:74-82 [PMID: 28034727]
  187. IEEE Trans Med Imaging. 2022 Nov;41(11):3003-3015 [PMID: 35594209]
  188. Nat Cancer. 2022 Sep;3(9):1026-1038 [PMID: 36138135]
  189. BMJ. 2020 Mar 25;368:m689 [PMID: 32213531]

Word Cloud

Created with Highcharts 10.0.0learninghistopathologychallengesmachinemodelsnovelopportunitysupport"LearningHealthSystems"healthpaperdiscussesoverlookedfacedworkingpresentsInitiallyauthorselaborateseparatingaccordingmitigationstrategies:needinnovativeapproachestimefuturetechnologicalcapabilitiesrequireconceptualreappraisalcriticalperspectiveintegratinghiddeninformationextractedMLdigitalizedslideshealthcarebigdatapresentedSeeingrandomforestdecisiontreesSupportingsystemsmodels:ChallengesopportunitiesArtificialintelligenceComputer-assistedImageprocessingLearningsystemMachinePathology

Similar Articles

Cited By (3)