GBERT: A hybrid deep learning model based on GPT-BERT for fake news detection.

Pummy Dhiman, Amandeep Kaur, Deepali Gupta, Sapna Juneja, Ali Nauman, Ghulam Muhammad
Author Information
  1. Pummy Dhiman: Chitkara University Institute of Engineering and Technology, Chitkara University, Rajpura, 140601, Punjab, India.
  2. Amandeep Kaur: Chitkara University Institute of Engineering and Technology, Chitkara University, Rajpura, 140601, Punjab, India.
  3. Deepali Gupta: Chitkara University Institute of Engineering and Technology, Chitkara University, Rajpura, 140601, Punjab, India.
  4. Sapna Juneja: Department of CSE (AI), KIET Group of Institutions, Ghaziabad, 201206, India.
  5. Ali Nauman: School of Computer Science and Engineering , Yeungnam University , Republic of Korea.
  6. Ghulam Muhammad: Department of Computer Engineering, College of Computer and Information Sciences, King Saud University, Riyadh, Saudi Arabia.

Abstract

The digital era has expanded social exposure with easy internet access for mobile users, allowing for global communication. Now, people can get to know what is going on around the globe with just a click; however, this has also resulted in the issue of fake news. Fake news is content that pretends to be true but is actually false and is disseminated to defraud. Fake news poses a threat to harmony, politics, the economy, and public opinion. As a result, bogus news detection has become an emerging research domain to identify a given piece of text as genuine or fraudulent. In this paper, a new framework called Generative Bidirectional Encoder Representations from Transformers (GBERT) is proposed that leverages a combination of Generative pre-trained transformer (GPT) and Bidirectional Encoder Representations from Transformers (BERT) and addresses the fake news classification problem. This framework combines the best features of both cutting-edge techniques-BERT's deep contextual understanding and the generative capabilities of GPT-to create a comprehensive representation of a given text. Both GPT and BERT are fine-tuned on two real-world benchmark corpora and have attained 95.30 % accuracy, 95.13 % precision, 97.35 % sensitivity, and a 96.23 % F1 score. The statistical test results indicate the effectiveness of the fine-tuned framework for fake news detection and suggest that it can be a promising approach for eradicating this global issue of fake news in the digital landscape.

Keywords

References

  1. J Ambient Intell Humaniz Comput. 2022 Jul 27;:1-13 [PMID: 35910294]
  2. Complex Intell Systems. 2023;9(3):2843-2863 [PMID: 34777983]
  3. Sensors (Basel). 2023 Feb 04;23(4): [PMID: 36850346]
  4. Multimed Tools Appl. 2022;81(4):5587-5620 [PMID: 34975284]
  5. Soc Netw Anal Min. 2021;11(1):108 [PMID: 34721721]
  6. Indian J Psychol Med. 2019 May-Jun;41(3):210-215 [PMID: 31142921]
  7. Complex Intell Systems. 2023 May 24;:1-12 [PMID: 37361971]
  8. Int J Data Sci Anal. 2022;13(4):335-362 [PMID: 35128038]
  9. PeerJ Comput Sci. 2022 Feb 22;8:e881 [PMID: 35494811]

Word Cloud

Created with Highcharts 10.0.0newsfakedetectionFakeframeworkTransformersdigitalaccessglobalcanissuegiventextGenerativeBidirectionalEncoderRepresentationsGPTBERTclassificationdeepfine-tuned95learningmodeleraexpandedsocialexposureeasyinternetmobileusersallowingcommunicationNowpeoplegetknowgoingaroundglobejustclickhoweveralsoresultedcontentpretendstrueactuallyfalsedisseminateddefraudposesthreatharmonypoliticseconomypublicopinionresultbogusbecomeemergingresearchdomainidentifypiecegenuinefraudulentpapernewcalledGBERTproposedleveragescombinationpre-trainedtransformeraddressesproblemcombinesbestfeaturescutting-edgetechniques-BERT'scontextualunderstandinggenerativecapabilitiesGPT-tocreatecomprehensiverepresentationtworeal-worldbenchmarkcorporaattained30 %accuracy13 %precision9735 %sensitivity9623 %F1scorestatisticaltestresultsindicateeffectivenesssuggestpromisingapproacheradicatinglandscapeGBERT:hybridbasedGPT-BERTDeepInternetLargelanguageSocialmediaTechnologyText

Similar Articles

Cited By (1)