]> 2017-09-01T00:00:00-05:00 { "@context": "http://schema.org/", "@type": "Dataset", "name": "Structural Metadata from ArXiv Articles", "version": "1.0", "license": "https://creativecommons.org/licenses/by-sa/4.0/", "description": "The dataset contains metadata encoded in JSON and extracted from more than one million arXiv articles that were put online before the end of 2016. The metadata includes the arXiv id, category names, title, author names, abstract, link to article, publication date and table of contents.", "url": "https://ebiquity.umbc.edu/resource/html/id/374/Structural-Metadata-from-ArXiv-Articles", "keywords": [ "document understanding", "natural language understanding", "machine learning" ], "citation": "Muhammad Mahbubur Rahman and Tim Finin. 2017. Deep Understanding of a Document's Structure. In Proceedings of the Fourth IEEE/ACM International Conference on Big Data Computing, Applications and Technologies (BDCAT '17). ACM, New York, NY, USA, 63-73. DOI: https://doi.org/10.1145/3148055.3148080", "creator": { "@type": "Person", "honorificPrefix": "Dr.", "givenName": "Muhammad", "familyName": "Rahman", "email": "mrahman1@umbc.edu", "memberOf": { "@type": "Organization", "url": "http://ebiquity.umbc.edu", "name": "Ebiquity Research Group", "parentOrganization": "University of Maryland, Baltimore County (UMBC)" } }, "distribution": { "@type": "DataDownload", "encodingFormat": "zip", "contentSize": "566 megabytes, compressed", "contentUrl": "https://ebiquity.umbc.edu/redirect/to/resource/id/374/Structural-Metadata-from-ArXiv-Articles", "fileFormat": "zip compressed JSON object" }, "temporalCoverage": "1991/2016" }

The data set contains metadata extracted from more than one million arXiv articles that were put online before the end of 2016.

Data Set Characteristics: Text
Number of Instances: 1107138 arXiv articles
Size: 566 megabytes, compressed
Area: NLP and Machine Learning
Attribute Characteristics: String/Text
Associated Tasks: Classification and Clustering
Date Released: 2017-09-01
Source : arXiv repository
File format: JSON

The JSON file contains information 1,107,138 arXiv articles put online during or before 2016. Each of the top level keys in he JSON file is the arXiv article id. For each article, following information is given.

key	type	description
category	list	Category names for the article
title	string	Title of the article
authors	list	Name of all of the authors
summary	string	A short summary of the article
link	string	Link to the original arXiv article for full contents
published_date	string	Date of the publication
toc	list	The table of contents for the article. This is a nested list upto few levels of subsections. Some articles may not have toc. Each title in the toc represents section/subsection/sub-subsection header and children represents next level section headers

You can view some examples of the json objects here.

If you write about or use this dataset, please cite:

Muhammad Mahbubur Rahman and Tim Finin. 2017. Deep Understanding of a Document's Structure. In Proceedings of the Fourth IEEE/ACM International Conference on Big Data Computing, Applications and Technologies (BDCAT '17). ACM, New York, NY, USA, 63-73. DOI: https://doi.org/10.1145/3148055.3148080"

For more information, please contact mrahman1@umbc.edu

]]>