OpenLB
Open Library of Bioscience
Advanced Search
Journal of digital imaging
04, 2022;35 (2): 340-355.

Studierfenster: an Open Science Cloud-Based Medical Imaging Analysis Platform.

Jan Egger, Daniel Wild, Maximilian Weber, Christopher A Ramirez Bedoya, Florian Karner, Alexander Prutsch, Michael Schmied, Christina Dionysio, Dominik Krobath, Yuan Jin, Christina Gsaxner, Jianning Li, Antonio Pepe
Author Information
  1. Jan Egger: Institute of Computer Graphics and Vision, Faculty of Computer Science and Biomedical Engineering, Graz University of Technology, Inffeldgasse 16, 8010, Graz, Australia. egger@tugraz.at.
  2. Daniel Wild: Institute of Computer Graphics and Vision, Faculty of Computer Science and Biomedical Engineering, Graz University of Technology, Inffeldgasse 16, 8010, Graz, Australia.
  3. Maximilian Weber: Institute of Computer Graphics and Vision, Faculty of Computer Science and Biomedical Engineering, Graz University of Technology, Inffeldgasse 16, 8010, Graz, Australia.
  4. Christopher A Ramirez Bedoya: Institute of Computer Graphics and Vision, Faculty of Computer Science and Biomedical Engineering, Graz University of Technology, Inffeldgasse 16, 8010, Graz, Australia.
  5. Florian Karner: Institute of Computer Graphics and Vision, Faculty of Computer Science and Biomedical Engineering, Graz University of Technology, Inffeldgasse 16, 8010, Graz, Australia.
  6. Alexander Prutsch: Institute of Computer Graphics and Vision, Faculty of Computer Science and Biomedical Engineering, Graz University of Technology, Inffeldgasse 16, 8010, Graz, Australia.
  7. Michael Schmied: Institute of Computer Graphics and Vision, Faculty of Computer Science and Biomedical Engineering, Graz University of Technology, Inffeldgasse 16, 8010, Graz, Australia.
  8. Christina Dionysio: Institute of Computer Graphics and Vision, Faculty of Computer Science and Biomedical Engineering, Graz University of Technology, Inffeldgasse 16, 8010, Graz, Australia.
  9. Dominik Krobath: Institute of Computer Graphics and Vision, Faculty of Computer Science and Biomedical Engineering, Graz University of Technology, Inffeldgasse 16, 8010, Graz, Australia.
  10. Yuan Jin: Institute of Computer Graphics and Vision, Faculty of Computer Science and Biomedical Engineering, Graz University of Technology, Inffeldgasse 16, 8010, Graz, Australia.
  11. Christina Gsaxner: Institute of Computer Graphics and Vision, Faculty of Computer Science and Biomedical Engineering, Graz University of Technology, Inffeldgasse 16, 8010, Graz, Australia.
  12. Jianning Li: Institute of Computer Graphics and Vision, Faculty of Computer Science and Biomedical Engineering, Graz University of Technology, Inffeldgasse 16, 8010, Graz, Australia.
  13. Antonio Pepe: Institute of Computer Graphics and Vision, Faculty of Computer Science and Biomedical Engineering, Graz University of Technology, Inffeldgasse 16, 8010, Graz, Australia.
PMID: 35064372 DOI: 10.1007/s10278-021-00574-8

Abstract

Imaging modalities such as computed tomography (CT) and magnetic resonance imaging (MRI) are widely used in diagnostics, clinical studies, and treatment planning. Automatic algorithms for image analysis have thus become an invaluable tool in medicine. Examples of this are two- and three-dimensional visualizations, image segmentation, and the registration of all anatomical structure and pathology types. In this context, we introduce Studierfenster ( www.Studierfenster.at ): a free, non-commercial open science client-server framework for (bio-)medical image analysis. Studierfenster offers a wide range of capabilities, including the visualization of medical data (CT, MRI, etc.) in two-dimensional (2D) and three-dimensional (3D) space in common web browsers, such as Google Chrome, Mozilla Firefox, Safari, or Microsoft Edge. Other functionalities are the calculation of medical metrics (dice score and Hausdorff distance), manual slice-by-slice outlining of structures in medical images, manual placing of (anatomical) landmarks in medical imaging data, visualization of medical data in virtual reality (VR), and a facial reconstruction and registration of medical data for augmented reality (AR). More sophisticated features include the automatic cranial implant design with a convolutional neural network (CNN), the inpainting of aortic dissections with a generative adversarial network, and a CNN for automatic aortic landmark detection in CT angiography images. A user study with medical and non-medical experts in medical image analysis was performed, to evaluate the usability and the manual functionalities of Studierfenster. When participants were asked about their overall impression of Studierfenster in an ISO standard (ISO-Norm) questionnaire, a mean of 6.3 out of 7.0 possible points were achieved. The evaluation also provided insights into the results achievable with Studierfenster in practice, by comparing these with two ground truth segmentations performed by a physician of the Medical University of Graz in Austria. In this contribution, we presented an online environment for (bio-)medical image analysis. In doing so, we established a client-server-based architecture, which is able to process medical data, especially 3D volumes. Our online environment is not limited to medical applications for humans. Rather, its underlying concept could be interesting for researchers from other fields, in applying the already existing functionalities or future additional implementations of further image processing applications. An example could be the processing of medical acquisitions like CT or MRI from animals [Clinical Pharmacology & Therapeutics, 84(4):448-456, 68], which get more and more common, as veterinary clinics and centers get more and more equipped with such imaging devices. Furthermore, applications in entirely non-medical research in which images/volumes need to be processed are also thinkable, such as those in optical measuring techniques, astronomy, or archaeology.

Keywords

Augmented reality CNN Client/server Cloud Deep learning GAN ITK Medical image analysis Python VTK Virtual reality Whitepaper

References

  1. Artif Intell Med. 2015 Jun;64(2):75-87 [PMID: 26025124]
  2. Sci Data. 2019 Jan 29;6:190003 [PMID: 30694227]
  3. Int J Comput Assist Radiol Surg. 2017 Mar;12(3):363-378 [PMID: 27581336]
  4. J Digit Imaging. 2004 Sep;17(3):205-16 [PMID: 15534753]
  5. Expert Rev Med Devices. 2020 Apr;17(4):345-356 [PMID: 32105159]
  6. IEEE Trans Med Imaging. 2021 Sep;40(9):2329-2342 [PMID: 33939608]
  7. J Biomed Inform. 2015 Jun;55:124-31 [PMID: 25882923]
  8. Annu Int Conf IEEE Eng Med Biol Soc. 2019 Jul;2019:6724-6729 [PMID: 31947384]
  9. PLoS One. 2017 Mar 21;12(3):e0173972 [PMID: 28323840]
  10. J Equine Sci. 2018;29(1):9-13 [PMID: 29593443]
  11. Lancet. 2018 Dec 1;392(10162):2388-2396 [PMID: 30318264]
  12. Sci Transl Med. 2021 Mar 24;13(586): [PMID: 33762434]
  13. Med Image Comput Comput Assist Interv. 2018;2018:563-571 [PMID: 34095901]
  14. Nat Commun. 2020 Nov 4;11(1):5577 [PMID: 33149150]
  15. Neural Comput Appl. 2022 Jan 16;:1-21 [PMID: 35068703]
  16. Nat Rev Urol. 2019 Jul;16(7):391-403 [PMID: 31092914]
  17. Med Image Anal. 2020 Oct;65:101773 [PMID: 32738647]
  18. BMC Med Imaging. 2015 Aug 12;15:29 [PMID: 26263899]
  19. Sci Data. 2018 Sep 04;5:180180 [PMID: 30179235]
  20. Sci Rep. 2017 Aug 31;7(1):10117 [PMID: 28860628]
  21. Int J Med Robot. 2012 Sep;8(3):282-90 [PMID: 22374845]
  22. Neurosurgery. 2013 Jan;72 Suppl 1:165-75 [PMID: 23254805]
  23. PLoS One. 2019 Mar 5;14(3):e0212550 [PMID: 30835746]
  24. IEEE Trans Med Imaging. 2015 Oct;34(10):1993-2024 [PMID: 25494501]
  25. Skin Res Technol. 2012 May;18(2):133-42 [PMID: 21507072]
  26. IEEE Trans Inf Technol Biomed. 2008 Nov;12(6):800-12 [PMID: 19000961]
  27. PLoS One. 2017 Mar 6;12(3):e0172694 [PMID: 28264062]
  28. PLoS One. 2017 Aug 17;12(8):e0182839 [PMID: 28817607]
  29. Comput Methods Programs Biomed. 2021 Mar;200:105854 [PMID: 33261944]
  30. PeerJ Comput Sci. 2021 Nov 17;7:e773 [PMID: 34901429]
  31. Annu Int Conf IEEE Eng Med Biol Soc. 2019 Jul;2019:3463-3467 [PMID: 31946624]
  32. Data Brief. 2021 Feb 24;35:106902 [PMID: 33997188]
  33. No Shinkei Geka. 2009 Dec;37(12):1193-9 [PMID: 19999551]
  34. Comput Methods Programs Biomed. 2010 Dec;100(3):201-21 [PMID: 20478640]
  35. Neuroimage. 2006 Jul 1;31(3):1116-28 [PMID: 16545965]
  36. Sci Rep. 2013;3:1364 [PMID: 23455483]
  37. Insights Imaging. 2020 Jun 8;11(1):77 [PMID: 32514649]
  38. Clin Pharmacol Ther. 2008 Oct;84(4):448-56 [PMID: 18754000]
  39. Healthc Technol Lett. 2018 Sep 21;5(5):148-153 [PMID: 30800321]

Grants

  1. KLI 678/Austrian Science Fund FWF

MeSH Term

Cloud Computing
Humans
Image Processing, Computer-Assisted
Magnetic Resonance Imaging
Neural Networks, Computer
Tomography, X-Ray Computed
Journal Article Research Support, Non-U.S. Gov't
Article has an altmetric score of 5

Word Cloud

Created with Highcharts 10.0.0medicalimageanalysisStudierfensterdataCTrealityimagingMRIfunctionalitiesmanualCNNMedicalapplicationsImagingthree-dimensionalregistrationanatomicalbio-visualization3Dcommonimagesautomaticnetworkaorticnon-medicalperformedalsoonlineenvironmentprocessinggetmodalitiescomputedtomographymagneticresonancewidelyuseddiagnosticsclinicalstudiestreatmentplanningAutomaticalgorithmsthusbecomeinvaluabletoolmedicineExamplestwo-visualizationssegmentationstructurepathologytypescontextintroducewwwstudierfensterat:freenon-commercialopenscienceclient-serverframeworkofferswiderangecapabilitiesincludingetctwo-dimensional2DspacewebbrowsersGoogleChromeMozillaFirefoxSafariMicrosoftEdgecalculationmetricsdicescoreHausdorffdistanceslice-by-sliceoutliningstructuresplacinglandmarksvirtualVRfacialreconstructionaugmentedARsophisticatedfeaturesincludecranialimplantdesignconvolutionalneuralinpaintingdissectionsgenerativeadversariallandmarkdetectionangiographyuserstudyexpertsevaluateusabilityparticipantsaskedoverallimpressionISOstandardISO-Normquestionnairemean6370possiblepointsachievedevaluationprovidedinsightsresultsachievablepracticecomparingtwogroundtruthsegmentationsphysicianUniversityGrazAustriacontributionpresentedestablishedclient-server-basedarchitectureableprocessespeciallyvolumeslimitedhumansRatherunderlyingconceptinterestingresearchersfieldsapplyingalreadyexistingfutureadditionalimplementationsexampleacquisitionslikeanimals[ClinicalPharmacology&Therapeutics844:448-45668]veterinaryclinicscentersequippeddevicesFurthermoreentirelyresearchimages/volumesneedprocessedthinkableopticalmeasuringtechniquesastronomyarchaeologyStudierfenster:OpenScienceCloud-BasedAnalysisPlatformAugmentedClient/serverCloudDeeplearningGANITKPythonVTKVirtualWhitepaper

Similar Articles

Cited By