Hybrid transformer-CNN and LSTM model for lung disease segmentation and classification.

Syed Mohammed Shafi, Sathiya Kumar Chinnappan
Author Information
  1. Syed Mohammed Shafi: Vellore Institute of Technology, Vellore, Tamil Nadu, India.
  2. Sathiya Kumar Chinnappan: Vellore Institute of Technology, Vellore, Tamil Nadu, India.

Abstract

According to the World Health Organization (WHO) report, lung disorders are the third leading cause of mortality worldwide. Approximately three million individuals are affected with various types of lung disorders annually. This issue alarms us to take control measures related to early diagnostics, accurate treatment procedures, . The precise identification through the assessment of medical images is crucial for pulmonary disease diagnosis. Also, it remains a formidable challenge due to the diverse and unpredictable nature of pathological lung appearances and shapes. Therefore, the efficient lung disease segmentation and classification model is essential. By taking this initiative, a novel lung disease segmentation with a hybrid LinkNet-Modified LSTM (L-MLSTM) model is proposed in this research article. The proposed model utilizes four essential and fundamental steps for its implementation. The first step is pre-processing, where the input lung images are pre-processed using median filtering. Consequently, an improved Transformer-based convolutional neural network (CNN) model (ITCNN) is proposed to segment the affected region in the segmentation process. After segmentation, essential features such as texture, shape, color, and deep features are retrieved. Specifically, texture features are extracted using modified Local Gradient Increasing Pattern (LGIP) and Multi-texton analysis. Then, the classification step utilizes a hybrid model, the L-MLSTM model. This work leverages two datasets such as the COVID-19 normal pneumonia-CT images dataset (Dataset 1) and the Chest CT scan images dataset (Dataset 2). The dataset is crucial for training and evaluating the model, providing a comprehensive basis for robust and generalizable results. The L-MLSTM model outperforms several existing models, including HDE-NN, DBN, LSTM, LINKNET, SVM, Bi-GRU, RNN, CNN, and VGG19 + CNN, with accuracies of 89% and 95% at learning percentages of 70 and 90, respectively, for datasets 1 and 2. The improved accuracy achieved by the L-MLSTM model highlights its capability to better handle the complexity and variability in lung images. This hybrid approach enhances the model's ability to distinguish between different types of lung diseases and reduces diagnostic errors compared to existing methods.

Keywords

References

  1. Neural Comput Appl. 2023;35(21):15343-15364 [PMID: 37273912]
  2. IEEE Trans Med Imaging. 2020 May;39(5):1419-1429 [PMID: 31675322]
  3. Comput Methods Programs Biomed. 2020 Dec;197:105720 [PMID: 32877818]
  4. Health Inf Sci Syst. 2019 Dec 23;8(1):4 [PMID: 31915523]
  5. Phys Med Biol. 2023 Aug 22;68(17): [PMID: 37605997]
  6. iScience. 2022 Dec 05;25(12):105712 [PMID: 36582483]
  7. Multimed Tools Appl. 2023 May 31;:1-21 [PMID: 37362653]
  8. Neural Process Lett. 2020;52(2):1631-1649 [PMID: 32837245]
  9. iScience. 2023 May 30;26(7):107005 [PMID: 37534183]
  10. Comput Biol Med. 2020 Nov;126:104037 [PMID: 33065387]
  11. Artif Intell Med. 2020 Mar;103:101792 [PMID: 32143797]
  12. Inform Med Unlocked. 2021;25:100681 [PMID: 34337140]
  13. BMC Bioinformatics. 2022 Jul 6;23(1):264 [PMID: 35794537]
  14. Transl Oncol. 2021 Aug;14(8):101141 [PMID: 34087705]
  15. Healthcare (Basel). 2020 Apr 23;8(2): [PMID: 32340344]
  16. J Transl Med. 2021 Jul 26;19(1):318 [PMID: 34311742]
  17. Biomed Signal Process Control. 2023 Aug;85:104896 [PMID: 36998783]
  18. Int J Med Inform. 2021 Dec 20;158:104667 [PMID: 34952282]
  19. Biomed Signal Process Control. 2023 Feb;80:104366 [PMID: 36415848]
  20. Res Diagn Interv Imaging. 2022 Mar;1:100003 [PMID: 37520010]
  21. Comput Methods Programs Biomed. 2023 Mar;230:107348 [PMID: 36706618]
  22. Acad Radiol. 2019 Sep;26(9):1245-1252 [PMID: 30502076]

Word Cloud

Created with Highcharts 10.0.0modellungimagesdiseasesegmentationL-MLSTMclassificationessentialhybridLSTMproposedCNNfeaturesdatasetdisordersaffectedtypescrucialutilizesstepusingfilteringimprovedtextureLGIPdatasetsDataset12existingAccordingWorldHealthOrganizationWHOreportthirdleadingcausemortalityworldwideApproximatelythreemillionindividualsvariousannuallyissuealarmsustakecontrolmeasuresrelatedearlydiagnosticsaccuratetreatmentprocedurespreciseidentificationassessmentmedicalpulmonarydiagnosisAlsoremainsformidablechallengeduediverseunpredictablenaturepathologicalappearancesshapesThereforeefficienttakinginitiativenovelLinkNet-Modifiedresearcharticlefourfundamentalstepsimplementationfirstpre-processinginputpre-processedmedianConsequentlyTransformer-basedconvolutionalneuralnetworkITCNNsegmentregionprocessshapecolordeepretrievedSpecificallyextractedmodifiedLocalGradientIncreasingPatternMulti-textonanalysisworkleveragestwoCOVID-19normalpneumonia-CTChestCTscantrainingevaluatingprovidingcomprehensivebasisrobustgeneralizableresultsoutperformsseveralmodelsincludingHDE-NNDBNLINKNETSVMBi-GRURNNVGG19+accuracies89%95%learningpercentages7090respectivelyaccuracyachievedhighlightscapabilitybetterhandlecomplexityvariabilityapproachenhancesmodel'sabilitydistinguishdifferentdiseasesreducesdiagnosticerrorscomparedmethodsHybridtransformer-CNNClassificationLungMedianModifiedSegmentation

Similar Articles

Cited By