Semantic Textual Similarity of Sentences with Emojis

Research output: Chapter in Book/Report/Conference proceedingArticle in proceedingsResearchpeer-review


In this paper, we extend the task of semantic textual similarity to include sentences which contain emojis. Emojis are ubiquitous on social media today, but are often removed in the pre-processing stage of curating datasets for NLP tasks. In this paper, we qualitatively ascertain the amount of semantic information lost by discounting emojis, as well as show a mechanism of accounting for emojis in a semantic task. We create a sentence similarity dataset of 4000 pairs of tweets with emojis, which have been annotated for relatedness. The corpus contains tweets curated based on common topic as well as by replacement of emojis. The latter was done to analyze the difference in semantics associated with different emojis. We aim to provide an understanding of the information lost by removing emojis by providing a qualitative analysis of the dataset. We also aim to present a method of using both emojis and words for downstream NLP tasks beyond sentiment analysis.

Original languageEnglish
Title of host publicationThe Web Conference 2020 - Companion of the World Wide Web Conference, WWW 2020
PublisherAssociation for Computing Machinery
Publication date2020
ISBN (Electronic)9781450370240
Publication statusPublished - 2020
Event29th International World Wide Web Conference, WWW 2020 - Taipei, Taiwan, Province of China
Duration: 20 Apr 202024 Apr 2020


Conference29th International World Wide Web Conference, WWW 2020
LandTaiwan, Province of China
SponsorChunghwa Telecom, et al., Microsoft, Quanta Computer, Taiwan Mobile, ZOOM

    Research areas

  • datasets, emoji, sentence similarity

Number of downloads are based on statistics from Google Scholar and

No data available

ID: 250434538