Improving Accuracy of Named Entity Recognition on Social Media Data

In recent years, social media outlets such as Twitter and Facebook have drawn attention from companies and researchers interested in detecting trends. The informal nature of status updates from these services leads to a higher volume of updates, because each update takes little care to generate, but each update is usually short and noisy (misspellings, lack of punctuation, non-standard abbreviations and capitalization). These shortcomings cause traditional Natural Language Processing (NLP) techniques to have substantially lower accuracy than is found with structured text such as newswire articles. We present a system for improving the accuracy of one NLP technique, Named Entity Recognition or NER, on Twitter data by training a recognizer specifically for this type of data. NER is the process of automatically recognizing which words are names of people, places, or organizations. This trained model is compared to baseline entity detection rate with an off-the-shelf NER system.

  • 521515 bytes

  • 497249 bytes

language, named entity recognition, natural language processing, ner, social media, social, twitter


University of Maryland, Baltimore County

Computer Science and Electrical Engineering

Downloads: 5605 downloads

Google Scholar Citations: 3 citations

UMBC ebiquity