Ethical Considerations in Human-Centered AI: Advancing Oncology Chatbots Through Large Language Models.

James C L Chow, Kay Li
Author Information
  1. James C L Chow: Department of Radiation Oncology, University of Toronto, Toronto, ON, Canada. ORCID
  2. Kay Li: Department of English, University of Toronto, Toronto, ON, Canada. ORCID

Abstract

The integration of chatbots in oncology underscores the pressing need for Human-centered artificial intelligence (AI) that addresses patient and family concerns with empathy and precision. Human-centered AI emphasizes ethical principles, empathy, and user-centric approaches, ensuring technology aligns with Human values and needs. This review critically examines the ethical implications of using large language models (LLMs) like GPT-3 and GPT-4 (OpenAI) in oncology chatbots. It examines how these models replicate Human-like language patterns, impacting the design of ethical AI systems. The paper identifies key strategies for ethically developing oncology chatbots, focusing on potential biases arising from extensive datasets and neural networks. Specific datasets, such as those sourced from predominantly Western medical literature and patient interactions, may introduce biases by overrepresenting certain demographic groups. Moreover, the training methodologies of LLMs, including fine-tuning processes, can exacerbate these biases, leading to outputs that may disproportionately favor affluent or Western populations while neglecting marginalized communities. By providing examples of biased outputs in oncology chatbots, the review highlights the ethical challenges LLMs present and the need for mitigation strategies. The study emphasizes integrating Human-centric values into AI to mitigate these biases, ultimately advocating for the development of oncology chatbots that are aligned with ethical principles and capable of serving diverse patient populations equitably.

Keywords

References

  1. J Med Internet Res. 2023 Dec 19;25:e47217 [PMID: 38113097]
  2. JMIR Cancer. 2021 Nov 29;7(4):e27850 [PMID: 34847056]
  3. Ann Biomed Eng. 2023 Feb;51(2):291-295 [PMID: 36572824]
  4. J Med Internet Res. 2021 May 6;23(5):e27460 [PMID: 33882012]
  5. NPJ Digit Med. 2024 Jul 8;7(1):183 [PMID: 38977771]
  6. Diabetes Metab Syndr. 2023 Apr;17(4):102744 [PMID: 36989584]
  7. Nat Commun. 2024 Feb 21;15(1):1603 [PMID: 38383555]
  8. Methodist Debakey Cardiovasc J. 2023 Nov 16;19(5):77-84 [PMID: 38028967]
  9. Pract Radiat Oncol. 2023 Nov-Dec;13(6):e484-e490 [PMID: 37598727]
  10. Brief Bioinform. 2022 Nov 19;23(6): [PMID: 36156661]
  11. J Pathol. 2024 Mar;262(3):310-319 [PMID: 38098169]
  12. Med Health Care Philos. 2022 Mar;25(1):61-71 [PMID: 34480711]
  13. Cureus. 2023 May 21;15(5):e39305 [PMID: 37378099]
  14. Digit Health. 2021 Aug 31;7:20552076211038151 [PMID: 34513002]
  15. J Med Internet Res. 2023 Jun 30;25:e47479 [PMID: 37389908]
  16. Lancet Digit Health. 2023 Mar;5(3):e105-e106 [PMID: 36754725]
  17. Healthcare (Basel). 2023 Mar 19;11(6): [PMID: 36981544]
  18. Front Digit Health. 2023 Apr 12;5:1161098 [PMID: 37122812]
  19. J Med Internet Res. 2022 Apr 27;24(4):e32630 [PMID: 35475761]
  20. J Med Internet Res. 2023 Aug 11;25:e48009 [PMID: 37566454]
  21. Nat Med. 2023 Oct;29(10):2396-2398 [PMID: 37391665]
  22. JMIR Med Educ. 2023 Sep 19;9:e50514 [PMID: 37725411]
  23. JAMA Intern Med. 2023 Jun 1;183(6):589-596 [PMID: 37115527]
  24. BioData Min. 2023 Jul 13;16(1):20 [PMID: 37443040]
  25. JMIR Form Res. 2022 Dec 2;6(12):e39443 [PMID: 36327383]
  26. JAMA. 2023 Sep 5;330(9):866-869 [PMID: 37548965]
  27. JAMA Oncol. 2023 Oct 1;9(10):1437-1440 [PMID: 37615960]
  28. J Med Humanit. 2022 Jun;43(2):211-232 [PMID: 32654043]
  29. JAMA Psychiatry. 2023 Jul 1;80(7):662-664 [PMID: 37195694]
  30. JAMA. 2023 Apr 25;329(16):1349-1350 [PMID: 36972070]
  31. Inform Health Soc Care. 2022 Apr 3;47(2):194-210 [PMID: 34617857]
  32. Healthcare (Basel). 2023 Aug 29;11(17): [PMID: 37685452]
  33. Methods Inf Med. 2021 Dec;60(5-06):171-179 [PMID: 34719011]
  34. Front Public Health. 2023 Apr 25;11:1166120 [PMID: 37181697]
  35. JMIR Hum Factors. 2022 Oct 5;9(4):e35882 [PMID: 36197708]
  36. J Transl Med. 2024 Mar 29;22(1):319 [PMID: 38553705]
  37. J Am Acad Orthop Surg. 2024 Mar 1;32(5):205-210 [PMID: 38175996]
  38. J Med Internet Res. 2023 Nov 28;25:e47551 [PMID: 38015597]
  39. Medicines (Basel). 2023 Oct 20;10(10): [PMID: 37887265]
  40. Front Artif Intell. 2023 Apr 05;6:1166014 [PMID: 37091303]
  41. Clin Nucl Med. 2023 Sep 1;48(9):838-839 [PMID: 37083827]
  42. Diagn Interv Radiol. 2023 Oct 03;30(2):80-90 [PMID: 37789676]
  43. Adv Anat Pathol. 2024 Jan 1;31(1):15-21 [PMID: 37501529]
  44. Commun Med (Lond). 2022 Nov 21;2(1):149 [PMID: 36414774]
  45. Cureus. 2023 Sep 25;15(9):e45911 [PMID: 37885556]
  46. IEEE Intell Syst. 2019 Jul-Aug;34(4):24-30 [PMID: 34690576]
  47. Hastings Cent Rep. 2019 Jan;49(1):36-39 [PMID: 30790317]
  48. Int J Neural Syst. 1993 Sep;4(3):203-22 [PMID: 8293227]
  49. JAMA Netw Open. 2023 Oct 2;6(10):e2336483 [PMID: 37782499]
  50. BMJ Lead. 2023 May 2;: [PMID: 37192124]
  51. Electron Mark. 2023;33(1):24 [PMID: 37252674]
  52. Front Artif Intell. 2023 May 04;6:1169595 [PMID: 37215063]
  53. Nat Med. 2023 Aug;29(8):1930-1940 [PMID: 37460753]

Word Cloud

Created with Highcharts 10.0.0AIoncologyethicalchatbotslanguagebiasespatientmodelsLLMsneedhuman-centeredartificialintelligenceempathyemphasizesprinciplesvaluesreviewexamineslargestrategiesdatasetsWesternmayoutputspopulationsintegrationunderscorespressingaddressesfamilyconcernsprecisionHuman-centereduser-centricapproachesensuringtechnologyalignshumanneedscriticallyimplicationsusinglikeGPT-3GPT-4OpenAIreplicatehuman-likepatternsimpactingdesignsystemspaperidentifieskeyethicallydevelopingfocusingpotentialarisingextensiveneuralnetworksSpecificsourcedpredominantlymedicalliteratureinteractionsintroduceoverrepresentingcertaindemographicgroupsMoreovertrainingmethodologiesincludingfine-tuningprocessescanexacerbateleadingdisproportionatelyfavoraffluentneglectingmarginalizedcommunitiesprovidingexamplesbiasedhighlightschallengespresentmitigationstudyintegratinghuman-centricmitigateultimatelyadvocatingdevelopmentalignedcapableservingdiverseequitablyEthicalConsiderationsHuman-CenteredAI:AdvancingOncologyChatbotsLargeLanguageModelsChatGPThealthcarehumanisticmachinelearningnaturalprocessingchatbottransformer-basedmodel

Similar Articles

Cited By