The Copenhagen team participation in the factuality task of the competition of automatic identification and verification of claims in political debates of the CLEF-2018 Fact Checking Lab

Research output: Chapter in Book/Report/Conference proceedingArticle in proceedingsResearchpeer-review

Documents

  • paper_98

    Final published version, 556 KB, PDF document

Given a set of political debate claims that have been already identified as worth checking, we consider the task of automatically checking the factuality of these claims. In particular, given a sentence that is worth checking, the goal is for the system to determine whether the claim is likely to be true, false, half-true or that it is unsure of its factuality. We implement a variety of models, including Bayes, SVM, RNN, to either step-wise assist our model or work as potential baselines. Then, we develop additional multi-scale Convolutional Neural Networks (CNNs) with different kernel sizes that learn from external sources whether a claim is true, false, half-true or unsure as follows: we treat claims as search engine queries and step-wise retrieve the top-N documents from Google with as much original claim as possible. We strategically select most relevant but sufficient documents with respect to the claims, and extract features, such as title, total number of results returned, and snippet to train the prediction model. We submitted results of SVM and CNNs, and the overall performance of our techniques is successful, achieving the overall best performing run (with lowest error rate 0.7050 from our SVM and highest accuracy 46.76% from our CNNs) in the competition.

Original languageEnglish
Title of host publicationCLEF 2018 Working Notes
EditorsLinda Cappellato , Nicola Ferro , Jian-Yun Nie, Laure Soulier
Number of pages10
PublisherCEUR-WS.org
Publication date2018
Edition10
Article number98
Publication statusPublished - 2018
Event19th Working Notes of CLEF Conference and Labs of the Evaluation Forum, CLEF 2018 - Avignon, France
Duration: 10 Sep 201814 Sep 2018

Conference

Conference19th Working Notes of CLEF Conference and Labs of the Evaluation Forum, CLEF 2018
LandFrance
ByAvignon
Periode10/09/201814/09/2018
SeriesCEUR Workshop Proceedings
Volume2125
ISSN1613-0073

    Research areas

  • CNN, Fact checking, Political debates, RNN

Number of downloads are based on statistics from Google Scholar and www.ku.dk


No data available

ID: 202539509