Political Fake Statement Detection via Multistage Feature-assisted Neural Modeling

Fuad Mire Hassan, Mark Lee

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

Fake news detection has recently gained much attention from the wider NLP community due to its importance for preventing the spread of misinformation and its negative impact through the social media. The goal of this task is to classify the veracity labels of a statement expressed by a politician into fine-grained classes (degrees of truth). Previous deep learning approaches have significantly improved the performance of Political Fake Statement Detection by modeling statement with the speaker's credit history. However, the credit history may not be available in reality and most approaches did not consider about the evidence that supporting or denying claims when detecting fake news. In addition, state-of-the-art models may struggle to detect fine-grained labels because the statement of the speaker expresses factual and incorrect instances at the same time. In this paper, we approach the Political Fake Statement Detection problem by proposing two multi-stage feature-assisted neural models that consider claims and justifications as an input in a stance detection manner. We explore five-stage and three-stage classification strategies to better discern between the fine-grained labels of fake news. The proposed model in each stage is built on the powerful combination between dual GRU layers and lexical features which we further optimise by using Gaussian Noise. An extensive experimental work on a real-world benchmark LIARPLUS (an extended version of LIAR) dataset shows that three-stage model achieves state-of-the-art Accuracy (46.13%) and F1score (45.13%) without using metadata and the credit history of the speaker. We also experimentally show that modeling the credit history in conjunction with statement and justification gives more than 6% improvement (e.g. 52.23% and 52.26% respectively).

Original languageEnglish
Title of host publicationProceedings - 2020 IEEE International Conference on Intelligence and Security Informatics, ISI 2020
PublisherInstitute of Electrical and Electronics Engineers (IEEE)
ISBN (Electronic)9781728188003
DOIs
Publication statusPublished - 9 Nov 2020
Event18th IEEE International Conference on Intelligence and Security Informatics, ISI 2020 - Virtual, Arlington, United States
Duration: 9 Nov 202010 Nov 2020

Publication series

NameProceedings - 2020 IEEE International Conference on Intelligence and Security Informatics, ISI 2020

Conference

Conference18th IEEE International Conference on Intelligence and Security Informatics, ISI 2020
Country/TerritoryUnited States
CityVirtual, Arlington
Period9/11/2010/11/20

Bibliographical note

Publisher Copyright:
© 2020 IEEE.

Copyright:
Copyright 2020 Elsevier B.V., All rights reserved.

Keywords

  • deep learning
  • Fake news detection
  • lexical features
  • multistage classification
  • political fake statement detection

ASJC Scopus subject areas

  • Information Systems and Management
  • Safety, Risk, Reliability and Quality
  • Computer Networks and Communications
  • Computer Vision and Pattern Recognition
  • Information Systems

Fingerprint

Dive into the research topics of 'Political Fake Statement Detection via Multistage Feature-assisted Neural Modeling'. Together they form a unique fingerprint.

Cite this