UMBC ebiquity UMBC ebiquity

Joint Workshop on Automatic Knowledge Base Construction and Web-scale Knowledge Extraction

Evaluating the Quality of a Knowledge Base Populated from Text

and

The steady progress of information extraction systems has been helped by sound methodologies for evaluating their performance in controlled experiments. Annual events like MUC, ACE and TAC have developed evaluation approaches enabling researchers to score and rank their systems relative to reference results. Yet these evaluations have only assessed component technologies needed by a knowledge base population system; none has required the construction of a knowledge base that is then evaluated directly. We describe an approach to the direct evaluation of a knowledge base and an instantiation that will be used in a 2012 TAC Knowledge Base Population track.



  • 128362 bytes

  • 1785588 bytes

  • 7789935 bytes

BibTeX OWL Tweet Scholar

cold start, entity linking, information extraction, knowledge base population, knowledge base, machine reading, natural language processing, nist, rdf, semantic web, slot filling, tac, text analysis conference

InProceedings

Association for Computational Linguistics

held in conjunction with 2012 NAACL-HLT

Downloads: 4721 downloads

UMBC ebiquity