A novel deep learning-based 3D cell segmentation framework for future image-based disease detection.

Andong Wang, Qi Zhang, Yang Han, Sean Megason, Sahand Hormoz, Kishore R Mosaliganti, Jacqueline C K Lam, Victor O K Li
Author Information
  1. Andong Wang: Department of Electrical and Electronic Engineering, The University of Hong Kong, Hong Kong, China.
  2. Qi Zhang: Department of Electrical and Electronic Engineering, The University of Hong Kong, Hong Kong, China.
  3. Yang Han: Department of Electrical and Electronic Engineering, The University of Hong Kong, Hong Kong, China.
  4. Sean Megason: Department of Systems Biology, Harvard Medical School, Boston, MA, USA.
  5. Sahand Hormoz: Department of Systems Biology, Harvard Medical School, Boston, MA, USA.
  6. Kishore R Mosaliganti: Department of Systems Biology, Harvard Medical School, Boston, MA, USA.
  7. Jacqueline C K Lam: Department of Electrical and Electronic Engineering, The University of Hong Kong, Hong Kong, China. jcklam@eee.hklu.hk.
  8. Victor O K Li: Department of Electrical and Electronic Engineering, The University of Hong Kong, Hong Kong, China. vli@eee.hku.hk.

Abstract

Cell segmentation plays a crucial role in understanding, diagnosing, and treating diseases. Despite the recent success of deep learning-based cell segmentation methods, it remains challenging to accurately segment densely packed cells in 3D cell membrane images. Existing approaches also require fine-tuning multiple manually selected hyperparameters on the new datasets. We develop a deep learning-based 3D cell segmentation pipeline, 3DCellSeg, to address these challenges. Compared to the existing methods, our approach carries the following novelties: (1) a robust two-stage pipeline, requiring only one hyperparameter; (2) a light-weight deep convolutional neural network (3DCellSegNet) to efficiently output voxel-wise masks; (3) a custom loss function (3DCellSeg Loss) to tackle the clumped cell problem; and (4) an efficient touching area-based clustering algorithm (TASCAN) to separate 3D cells from the foreground masks. Cell segmentation experiments conducted on four different cell datasets show that 3DCellSeg outperforms the baseline models on the ATAS (plant), HMS (animal), and LRP (plant) datasets with an overall accuracy of 95.6%, 76.4%, and 74.7%, respectively, while achieving an accuracy comparable to the baselines on the Ovules (plant) dataset with an overall accuracy of 82.2%. Ablation studies show that the individual improvements in accuracy is attributable to 3DCellSegNet, 3DCellSeg Loss, and TASCAN, with the 3DCellSeg demonstrating robustness across different datasets and cell shapes. Our results suggest that 3DCellSeg can serve a powerful biomedical and clinical tool, such as histo-pathological image analysis, for cancer diagnosis and grading.

References

  1. Medicine (Baltimore). 2017 May;96(21):e6843 [PMID: 28538375]
  2. Neuroimage. 2018 Apr 15;170:446-455 [PMID: 28445774]
  3. Sci Rep. 2021 Jan 28;11(1):2561 [PMID: 33510185]
  4. PLoS One. 2020 Dec 8;15(12):e0243219 [PMID: 33290432]
  5. Cell. 2007 Sep 7;130(5):784-95 [PMID: 17803903]
  6. IEEE Trans Pattern Anal Mach Intell. 2022 Oct;44(10):6377-6392 [PMID: 34061733]
  7. Adv Anat Pathol. 2010 Mar;17(2):130-49 [PMID: 20179435]
  8. Nat Methods. 2019 Jan;16(1):67-70 [PMID: 30559429]
  9. Diagn Cytopathol. 2010 May;38(5):382-90 [PMID: 19894267]
  10. Mol Syst Biol. 2006;2:64 [PMID: 17130866]
  11. IEEE Trans Pattern Anal Mach Intell. 2017 Jun;39(6):1137-1149 [PMID: 27295650]
  12. IEEE Trans Biomed Eng. 2014 May;61(5):1400-11 [PMID: 24759275]
  13. IEEE Trans Med Imaging. 2020 Nov;39(11):3257-3267 [PMID: 31283474]
  14. Elife. 2020 Jul 29;9: [PMID: 32723478]
  15. Trends Cell Biol. 2016 Aug;26(8):598-611 [PMID: 27118708]
  16. Med Image Anal. 2017 Oct;41:40-54 [PMID: 28526212]
  17. Curr Biol. 2019 Aug 5;29(15):2443-2454.e5 [PMID: 31327713]
  18. PLoS Comput Biol. 2016 Nov 4;12(11):e1005177 [PMID: 27814364]
  19. Proc Natl Acad Sci U S A. 2016 Dec 20;113(51):E8238-E8246 [PMID: 27930326]
  20. Plant Methods. 2019 Oct 25;15:120 [PMID: 31673277]
  21. Front Neuroanat. 2015 Nov 05;9:142 [PMID: 26594156]
  22. Dev Biol. 2020 Jun 1;462(1):7-19 [PMID: 32061886]

Grants

  1. T41-709/17-N/Research Grants Council, University Grants Committee
  2. T41-709/17-N/Research Grants Council, University Grants Committee
  3. T41-709/17-N/Research Grants Council, University Grants Committee
  4. T41-709/17-N/Research Grants Council, University Grants Committee
  5. T41-709/17-N/Research Grants Council, University Grants Committee

MeSH Term

Animals
Arabidopsis
Cell Membrane
Deep Learning
Embryo, Nonmammalian
Image Interpretation, Computer-Assisted
Imaging, Three-Dimensional
Microscopy
Predictive Value of Tests
Reproducibility of Results
Zebrafish

Word Cloud

Created with Highcharts 10.0.0cell3DCellSegsegmentationdeep3Ddatasetsaccuracylearning-basedplantCellmethodscellspipeline3DCellSegNetmasksLossTASCANdifferentshowoverallplayscrucialroleunderstandingdiagnosingtreatingdiseasesDespiterecentsuccessremainschallengingaccuratelysegmentdenselypackedmembraneimagesExistingapproachesalsorequirefine-tuningmultiplemanuallyselectedhyperparametersnewdevelopaddresschallengesComparedexistingapproachcarriesfollowingnovelties:1robusttwo-stagerequiringonehyperparameter2light-weightconvolutionalneuralnetworkefficientlyoutputvoxel-wise3customlossfunctiontackleclumpedproblem4efficienttouchingarea-basedclusteringalgorithmseparateforegroundexperimentsconductedfouroutperformsbaselinemodelsATASHMSanimalLRP956%764%747%respectivelyachievingcomparablebaselinesOvulesdataset822%Ablationstudiesindividualimprovementsattributabledemonstratingrobustnessacrossshapesresultssuggestcanservepowerfulbiomedicalclinicaltoolhisto-pathologicalimageanalysiscancerdiagnosisgradingnovelframeworkfutureimage-baseddiseasedetection

Similar Articles

Cited By