Multi-Classification of Skin Lesion Images Including Mpox Disease Using Transformer-Based Deep Learning Architectures.

Seyfettin Vuran, Murat Ucan, Mehmet Akin, Mehmet Kaya
Author Information
  1. Seyfettin Vuran: Department of Information Technologies, Dicle University, Diyarbakir 21200, Turkey. ORCID
  2. Murat Ucan: Department of Computer Technologies, Dicle University, Diyarbakir 21200, Turkey. ORCID
  3. Mehmet Akin: Electrical-Electronics Engineering, Faculty of Engineering, Dicle University, Diyarbakir 21280, Turkey.
  4. Mehmet Kaya: Department of Computer Engineering, Firat University, Elazig 23119, Turkey.

Abstract

As reported by the World Health Organization, Mpox (monkeypox) is an important disease present in 110 countries, mostly in South Asia and Africa. The number of Mpox cases has increased rapidly, and the medical world is worried about the emergence of a new pandemic. Detection of Mpox by traditional methods (using test kits) is a costly and slow process. For this reason, there is a need for methods that have high success rates and can diagnose Mpox disease from skin images with a deep-learning-based autonomous method. In this work, we propose a multi-class, fast, and reliable autonomous disease diagnosis model using transformer-based deep learning architectures and skin lesion images, including for Mpox disease. Our other aim is to investigate the effects of self-supervised learning, self-distillation, and shifted window techniques on classification success when multi-class skin lesion images are trained with transformer-based deep learning architectures. The Mpox Skin Lesion Dataset, Version 2.0, which was publicly released in 2024, was used in the training, validation, and testing processes of the study. The SwinTransformer architecture we proposed in our study achieved about 8% higher accuracy evaluation metric classification success compared to its closest competitor in the literature. ViT, MAE, DINO, and SwinTransformer architectures achieved 93.10%, 84.60%, 90.40%, and 93.71% accuracy classification success, respectively. The results obtained in the study showed that Mpox disease and other skin lesion images can be diagnosed with high success and can support doctors in decision-making. In addition, the study provides important results that can be used in other medical fields where the number of images is low in terms of transformer-based architecture and technique to use.

Keywords

References

  1. Cancers (Basel). 2024 Nov 21;16(23): [PMID: 39682085]
  2. Cancers (Basel). 2025 Jan 02;17(1): [PMID: 39796749]
  3. J Affect Disord. 2020 Dec 1;277:379-391 [PMID: 32861839]
  4. Ann Emerg Med. 2023 Jan;81(1):20-30 [PMID: 36117012]
  5. IEEE J Biomed Health Inform. 2024 Oct;28(10):6180-6192 [PMID: 38968015]
  6. Comput Biol Med. 2023 May;157:106791 [PMID: 36958234]
  7. Med Image Anal. 2020 Oct;65:101794 [PMID: 32781377]
  8. J Med Virol. 2023 Jan;95(1):e28229 [PMID: 36253931]
  9. Diagnostics (Basel). 2024 Dec 29;15(1): [PMID: 39795589]
  10. Neural Netw. 2023 Apr;161:757-775 [PMID: 36848828]
  11. IEEE Trans Pattern Anal Mach Intell. 2023 Jan;45(1):87-110 [PMID: 35180075]
  12. Comput Biol Med. 2023 Jul;161:107037 [PMID: 37230020]
  13. Int J Environ Res Public Health. 2023 Mar 01;20(5): [PMID: 36901430]
  14. World J Urol. 2023 Aug;41(8):2233-2241 [PMID: 37382622]

Grants

  1. ADEP.23.11/ADEP

Word Cloud

Created with Highcharts 10.0.0Mpoxdiseasesuccessskinimagescanlesionclassificationstudytransformer-basedlearningarchitecturesSwinTransformerimportantnumbermedicalmethodsusinghighautonomousmulti-classdeepSkinLesionusedarchitectureachievedaccuracyViTMAEDINO93resultsreportedWorldHealthOrganizationmonkeypoxpresent110countriesmostlySouthAsiaAfricacasesincreasedrapidlyworldworriedemergencenewpandemicDetectiontraditionaltestkitscostlyslowprocessreasonneedratesdiagnosedeep-learning-basedmethodworkproposefastreliablediagnosismodelincludingaiminvestigateeffectsself-supervisedself-distillationshiftedwindowtechniquestrainedDatasetVersion20publiclyreleased2024trainingvalidationtestingprocessesproposed8%higherevaluationmetriccomparedclosestcompetitorliterature10%8460%9040%71%respectivelyobtainedshoweddiagnosedsupportdoctorsdecision-makingadditionprovidesfieldslowtermstechniqueuseMulti-ClassificationImagesIncludingDiseaseUsingTransformer-BasedDeepLearningArchitecturestransformers

Similar Articles

Cited By