UMBC ebiquity

Evaluating the Quality of a Knowledge Base Populated from Text

Authors: James Mayfield, and Tim Finin

Book Title: Joint Workshop on Automatic Knowledge Base Construction and Web-scale Knowledge Extraction

Date: June 07, 2012

Abstract: The steady progress of information extraction systems has been helped by sound methodologies for evaluating their performance in controlled experiments. Annual events like MUC, ACE and TAC have developed evaluation approaches enabling researchers to score and rank their systems relative to reference results. Yet these evaluations have only assessed component technologies needed by a knowledge base population system; none has required the construction of a knowledge base that is then evaluated directly. We describe an approach to the direct evaluation of a knowledge base and an instantiation that will be used in a 2012 TAC Knowledge Base Population track.


Type: InProceedings

Publisher: Association for Computational Linguistics

Note: held in conjunction with 2012 NAACL-HLT

Tags: knowledge base, machine reading, knowledge base population, entity linking, slot filling, information extraction, natural language processing, nist, text analysis conference, tac, cold start, rdf, semantic web

Google Scholar: search

Number of downloads: 1814

 

Available for download as


size: 128362 bytes

size: 1785588 bytes

size: 7789935 bytes