Joint Semantic Analysis with Document-Level Cross-Task Coherence Rewards

Research output: Chapter in Book/Report/Conference proceedingArticle in proceedingsResearchpeer-review

Documents

  • Fulltext

    Final published version, 466 KB, PDF document

Coreference resolution and semantic role labeling are NLP tasks that capture different aspects of semantics, indicating respectively, which expressions refer to the same entity, and what semantic roles expressions serve in the sentence. However, they are often closely interdependent, and both generally necessitate natural language understanding. Do they form a coherent abstract representation of documents? We present a neural network architecture for joint coreference resolution and semantic role labeling for English, and train graph neural networks to model the 'coherence' of the combined shallow semantic graph. Using the resulting coherence score as a reward for our joint semantic analyzer, we use reinforcement learning to encourage global coherence over the document and between semantic annotations. This leads to improvements on both tasks in multiple datasets from different domains, and across a range of encoders of different expressivity, calling, we believe, for a more holistic approach to semantics in NLP.
Original languageEnglish
Title of host publicationProceedings of the AAAI-21 International Joint Conference on Artificial Intelligence
Number of pages10
PublisherAAAI Press
Publication date2021
ISBN (Electronic)978-1-57735-866-4
Publication statusPublished - 2021
Event35th AAAI Conference on Artificial Intelligence - Virtual
Duration: 2 Feb 20219 Feb 2021

Conference

Conference35th AAAI Conference on Artificial Intelligence
ByVirtual
Periode02/02/202109/02/2021
SeriesProceedings of the International Joint Conference on Artificial Intelligence
Number14
Volume35
ISSN1045-0823

ID: 287187332