CORE-MD clinical risk score for regulatory evaluation of artificial intelligence-based medical device software.

Frank E Rademakers, Elisabetta Biasin, Nico Bruining, Enrico G Caiani, Rhodri H Davies, Stephen H Gilbert, Eric Kamenjasevic, Gearóid McGauran, Gearóid O'Connor, Jean-Baptiste Rouffet, Baptiste Vasey, Alan G Fraser
Author Information
  1. Frank E Rademakers: Emeritus Professor of Cardiology, KU Leuven, Leuven, Belgium. frank.rademakers@kuleuven.be. ORCID
  2. Elisabetta Biasin: Researcher in Law, Center for IT & IP Law (CiTiP), KU Leuven, Leuven, Belgium. ORCID
  3. Nico Bruining: Department of Cardiology, Erasmus Medical Center, Thorax Center, Rotterdam, the Netherlands. ORCID
  4. Enrico G Caiani: Department of Electronics, Information and Biomedical Engineering, Politecnico di Milano, Milan, Italy. ORCID
  5. Rhodri H Davies: Institute of Cardiovascular Science, University College London, London, UK.
  6. Stephen H Gilbert: Professor for Medical Device Regulatory Science, Else Kröner Fresenius Center, for Digital Health, TUD Dresden University of Technology, Dresden, Germany.
  7. Eric Kamenjasevic: Doctoral researcher in Law and Ethics, Center for IT & IP Law (CiTiP), KU Leuven, Leuven, Belgium.
  8. Gearóid McGauran: Medical Officer, Medical Devices, Health Products Regulatory Authority, Dublin, Ireland. ORCID
  9. Gearóid O'Connor: Medical Officer, Medical Devices, Health Products Regulatory Authority, Dublin, Ireland. ORCID
  10. Jean-Baptiste Rouffet: Policy Advisor, European Affairs, European Federation of National Societies of Orthopaedics and Traumatology, Rolle, Switzerland.
  11. Baptiste Vasey: Nuffield Department of Surgical Sciences, University of Oxford, Oxford, UK.
  12. Alan G Fraser: Consultant Cardiologist, University Hospital of Wales, and Emeritus Professor of Cardiology, School of Medicine, Cardiff University, Heath Park, Cardiff, UK.

Abstract

The European CORE-MD consortium (Coordinating Research and Evidence for Medical Devices) proposes a score for medical devices incorporating artificial intelligence or machine learning algorithms. Its domains are summarised as valid clinical association, technical performance, and clinical performance. High scores indicate that extensive clinical investigations should be undertaken before regulatory approval, whereas lower scores indicate devices for which less pre-market clinical evaluation may be balanced by more post-market evidence.

References

  1. J Med Internet Res. 2021 Oct 26;23(10):e30545 [PMID: 34697010]
  2. Lancet Digit Health. 2021 Nov;3(11):e745-e750 [PMID: 34711379]
  3. NPJ Digit Med. 2024 Oct 2;7(1):270 [PMID: 39358559]
  4. Nat Med. 2024 Mar;30(3):837-849 [PMID: 38504016]
  5. JAMA Dermatol. 2021 Nov 1;157(11):1271-1273 [PMID: 34550304]
  6. BMJ Surg Interv Health Technol. 2021 Mar 4;3(1):e000066 [PMID: 35047800]
  7. Science. 2019 Oct 25;366(6464):447-453 [PMID: 31649194]
  8. Expert Rev Med Devices. 2023 Jun;20(6):467-491 [PMID: 37157833]
  9. NPJ Digit Med. 2020 Apr 7;3:53 [PMID: 32285013]
  10. Sci Transl Med. 2018 Dec 12;10(471): [PMID: 30541791]
  11. JAMA Dermatol. 2019 Jan 1;155(1):58-65 [PMID: 30484822]
  12. Hum Factors. 2018 Mar;60(2):262-273 [PMID: 29185818]
  13. JAMA Netw Open. 2021 Mar 1;4(3):e211276 [PMID: 33704476]
  14. Nat Med. 2022 Jan;28(1):31-38 [PMID: 35058619]
  15. BMJ. 1996 Jan 13;312(7023):71-2 [PMID: 8555924]
  16. JACC Cardiovasc Imaging. 2023 Sep;16(9):1209-1223 [PMID: 37480904]
  17. Digit Health. 2023 Jul 18;9:20552076231189331 [PMID: 37485326]
  18. N Engl J Med. 2023 Sep 28;389(13):1211-1219 [PMID: 37754286]
  19. Eur Heart J Qual Care Clin Outcomes. 2022 May 5;8(3):249-258 [PMID: 34448829]
  20. Nat Med. 2020 Aug;26(8):1229-1234 [PMID: 32572267]
  21. BMC Med. 2019 Oct 29;17(1):195 [PMID: 31665002]
  22. Eur Radiol. 2024 Dec;34(12):7895-7903 [PMID: 38861161]
  23. NPJ Digit Med. 2021 Feb 19;4(1):31 [PMID: 33608629]
  24. N Engl J Med. 2023 Nov 30;389(22):2021-2024 [PMID: 38009607]
  25. JAMA. 2025 Jan 21;333(3):241-247 [PMID: 39405330]
  26. Jt Comm J Qual Saf. 2004 Jan;30(1):5-14 [PMID: 14738031]
  27. J Med Internet Res. 2019 Nov 8;21(11):e16323 [PMID: 31702559]
  28. J Med Internet Res. 2023 Dec 20;25:e50158 [PMID: 38117545]
  29. NPJ Digit Med. 2022 Sep 15;5(1):143 [PMID: 36104535]
  30. BMJ Health Care Inform. 2021 Apr;28(1): [PMID: 33853863]
  31. JAMA. 2024 Feb 27;331(8):639-640 [PMID: 38285467]
  32. Am J Med Qual. 2020 Jul/Aug;35(4):341-348 [PMID: 31581790]
  33. Hastings Cent Rep. 2013 Jan-Feb;Spec No:S16-27 [PMID: 23315888]

Grants

  1. 945260/EC | Horizon 2020 Framework Programme (EU Framework Programme for Research and Innovation H2020)
  2. 945260/EC | Horizon 2020 Framework Programme (EU Framework Programme for Research and Innovation H2020)
  3. 945260/EC | Horizon 2020 Framework Programme (EU Framework Programme for Research and Innovation H2020)
  4. 945260/EC | Horizon 2020 Framework Programme (EU Framework Programme for Research and Innovation H2020)
  5. 945260/EC | Horizon 2020 Framework Programme (EU Framework Programme for Research and Innovation H2020)
  6. 945260/EC | Horizon 2020 Framework Programme (EU Framework Programme for Research and Innovation H2020)
  7. 945260/EC | Horizon 2020 Framework Programme (EU Framework Programme for Research and Innovation H2020)
  8. 945260/EC | Horizon 2020 Framework Programme (EU Framework Programme for Research and Innovation H2020)
  9. 945260/EC | Horizon 2020 Framework Programme (EU Framework Programme for Research and Innovation H2020)
  10. 945260/EC | Horizon 2020 Framework Programme (EU Framework Programme for Research and Innovation H2020)
  11. 945260/EC | Horizon 2020 Framework Programme (EU Framework Programme for Research and Innovation H2020)
  12. 945260/EC | Horizon 2020 Framework Programme (EU Framework Programme for Research and Innovation H2020)

Word Cloud

Created with Highcharts 10.0.0clinicalCORE-MDscoremedicaldevicesartificialperformancescoresindicateregulatoryevaluationEuropeanconsortiumCoordinatingResearchEvidenceMedicalDevicesproposesincorporatingintelligencemachinelearningalgorithmsdomainssummarisedvalidassociationtechnicalHighextensiveinvestigationsundertakenapprovalwhereaslowerlesspre-marketmaybalancedpost-marketevidenceriskintelligence-baseddevicesoftware

Similar Articles

Cited By