UMBC ebiquity

Improving Accuracy of Named Entity Recognition on Social Media Data

Authors: Will Murnane

Date: August 01, 2010

Abstract: In recent years, social media outlets such as Twitter and Facebook have drawn attention from companies and researchers interested in detecting trends. The informal nature of status updates from these services leads to a higher volume of updates, because each update takes little care to generate, but each update is usually short and noisy (misspellings, lack of punctuation, non-standard abbreviations and capitalization). These shortcomings cause traditional Natural Language Processing (NLP) techniques to have substantially lower accuracy than is found with structured text such as newswire articles. We present a system for improving the accuracy of one NLP technique, Named Entity Recognition or NER, on Twitter data by training a recognizer specifically for this type of data. NER is the process of automatically recognizing which words are names of people, places, or organizations. This trained model is compared to baseline entity detection rate with an off-the-shelf NER system.

Type: MastersThesis

Organization: Computer Science and Electrical Engineering

Publisher: University of Maryland, Baltimore County

Tags: twitter, social media, named entity recognition, ner, language, natural language processing, social

Google Scholar: iwKAIGVp0C0J

Number of Google Scholar citations: 3 [show citations]

Number of downloads: 4014

 

Available for download as


size: 521515 bytes

size: 497249 bytes