Sul-BertGRU: an ensemble deep learning method integrating information entropy-enhanced BERT and directional multi-GRU for S-sulfhydration sites prediction.

Xirun Wei, Qiao Ning, Kuiyang Che, Zhaowei Liu, Hui Li, Shikai Guo
Author Information
  1. Xirun Wei: Department of Information Science and Technology, Dalian Maritime University, Dalian 116026, P.R. China.
  2. Qiao Ning: Department of Information Science and Technology, Dalian Maritime University, Dalian 116026, P.R. China. ORCID
  3. Kuiyang Che: Department of Information Science and Technology, Dalian Maritime University, Dalian 116026, P.R. China.
  4. Zhaowei Liu: Department of Information Science and Technology, Dalian Maritime University, Dalian 116026, P.R. China.
  5. Hui Li: Department of Information Science and Technology, Dalian Maritime University, Dalian 116026, P.R. China.
  6. Shikai Guo: Department of Information Science and Technology, Dalian Maritime University, Dalian 116026, P.R. China.

Abstract

MOTIVATION: S-sulfhydration, a crucial post-translational protein modification, is pivotal in cellular recognition, signaling processes, and the development and progression of cardiovascular and neurological disorders, so identifying S-sulfhydration sites is crucial for studies in cell biology. Deep learning shows high efficiency and accuracy in identifying protein sites compared to traditional methods that often lack sensitivity and specificity in accurately locating nonsulfhydration sites. Therefore, we employ deep learning methods to tackle the challenge of pinpointing S-sulfhydration sites.
RESULTS: In this work, we introduce a deep learning approach called Sul-BertGRU, designed specifically for predicting S-sulfhydration sites in proteins, which integrates multi-directional gated recurrent unit (GRU) and BERT. First, Sul-BertGRU proposes an information entropy-enhanced BERT (IE-BERT) to preprocess protein sequences and extract initial features. Subsequently, confidence learning is employed to eliminate potential S-sulfhydration samples from the nonsulfhydration samples and select reliable negative samples. Then, considering the directional nature of the modification process, protein sequences are categorized into left, right, and full sequences centered on cysteines. We build a multi-directional GRU to enhance the extraction of directional sequence features and model the details of the enzymatic reaction involved in S-sulfhydration. Ultimately, we apply a parallel multi-head self-attention mechanism alongside a convolutional neural network to deeply analyze sequence features that might be missed at a local level. Sul-BertGRU achieves sensitivity, specificity, precision, accuracy, Matthews correlation coefficient, and area under the curve scores of 85.82%, 68.24%, 74.80%, 77.44%, 55.13%, and 77.03%, respectively. Sul-BertGRU demonstrates exceptional performance and proves to be a reliable method for predicting protein S-sulfhydration sites.
AVAILABILITY AND IMPLEMENTATION: The source code and data are available at https://github.com/Severus0902/Sul-BertGRU/.

Grants

  1. 62302075/National Natural Science Foundation of China

MeSH Term

Deep Learning
Proteins
Protein Processing, Post-Translational
Entropy
Computational Biology
Cysteine

Chemicals

Proteins
Cysteine

Word Cloud

Created with Highcharts 10.0.0S-sulfhydrationsitesproteinlearningSul-BertGRUdeepBERTsequencesfeaturessamplesdirectionalcrucialmodificationidentifyingaccuracymethodssensitivityspecificitynonsulfhydrationpredictingmulti-directionalGRUinformationentropy-enhancedreliablesequence77methodMOTIVATION:post-translationalpivotalcellularrecognitionsignalingprocessesdevelopmentprogressioncardiovascularneurologicaldisordersstudiescellbiologyDeepshowshighefficiencycomparedtraditionaloftenlackaccuratelylocatingThereforeemploytacklechallengepinpointingRESULTS:workintroduceapproachcalleddesignedspecificallyproteinsintegratesgatedrecurrentunitFirstproposesIE-BERTpreprocessextractinitialSubsequentlyconfidenceemployedeliminatepotentialselectnegativeconsideringnatureprocesscategorizedleftrightfullcenteredcysteinesbuildenhanceextractionmodeldetailsenzymaticreactioninvolvedUltimatelyapplyparallelmulti-headself-attentionmechanismalongsideconvolutionalneuralnetworkdeeplyanalyzemightmissedlocallevelachievesprecisionMatthewscorrelationcoefficientareacurvescores8582%6824%7480%44%5513%03%respectivelydemonstratesexceptionalperformanceprovesAVAILABILITYANDIMPLEMENTATION:sourcecodedataavailablehttps://githubcom/Severus0902/Sul-BertGRU/Sul-BertGRU:ensembleintegratingmulti-GRUprediction

Similar Articles

Cited By