Proceedings of the Third Deep Learning Inside Out (DeeLIO):Workshop: Knowledge Extraction and Integration for Deep Learning Architecture
Jointly Identifying and Fixing Inconsistent Readings from Information Extraction Systems
May 27, 2022
Information extraction systems analyze text to produce entities and beliefs, but their output often has errors. In this paper, we analyze the reading consistency of the extracted facts with respect to the text from which they were derived and show how to detect and correct errors. We consider both the scenario when the provenance text is automatically found by an information extraction system and when it is curated by humans. We contrast consistency with credibility; define and explore consistency and repair tasks; and demonstrate a simple yet effective and generalizable model. We analyze these tasks and evaluate this approach on three datasets. Against a strong baseline model, we consistently improve both consistency and repair across three datasets using a simple MLP model with attention and lexical features.
Association for Computational Linguistics
Downloads: 253 downloads