Python wrapper for the arXiv API: http://arxiv.org/help/api/index
arXiv is a project by the Cornell University Library that provides open access to 1,000,000+ articles in Physics, Mathematics, Computer Science, Quantitative Biology, Quantitative Finance, and Statistics.
They have an API that uses ATOM feeds to serve simple database queries. Unfortunately, handling these ATOM requsts can be clumsy (especially given inconsistency in data between different result objects, even in the same query). This is where arxiv.py comes it: it constructs requests for arXiv and gets ATOM feeds via a simple handful of methods, and parses the results into an intuitive format.
$ pip install arxiv
In your Python script, include the line
import arxiv
arxiv.query(search_query, id_list, prune, start, max_results, sort_by, sort_order)
Argument | Type | Default | Required? |
---|---|---|---|
search_query |
string | "" |
No |
id_list |
list of strings | [] |
No |
start |
int | 0 | No |
max_results |
int | 10 | No |
sort_by |
string | "relevance" |
No |
sort_order |
string | "descending" |
No |
search_query
is a query string; details of its usage are documented here.id_list
contains arXiv record IDs (typically of the format"0710.5765v1"
)start
is the result offset for paging through a long query result. If set to 0, the API response will begin with the first result; if set to 10, the API response will begin with the 11th.max_results
is the maximum number of results per query.
All of these arguments are documented more comprehensively in the arXiv API documentation.
Query examples:
import arxiv
# Keyword search
arxiv.query(search_query="quantum")
# Get single record by ID
arxiv.query(id_list=["1707.08567"])
# Get multiple records by ID
arxiv.query(id_list=["1707.08567", "1707.08567"])
For a more detailed description of the interaction between search_query
and id_list
, see this section of the arXiv documentation.
arxiv.download(obj, dirname, prepend_id, slugify)
Argument | Type | Default | Required? |
---|---|---|---|
obj |
dict | N/A | Yes |
dirname |
string | "./" |
No |
prepend_id |
boolean | False | No |
slugify |
boolean | False | No |
obj
is a result object, one of a list returned by query(). This function looks up keyspdf_url
andtitle
inobj
to make the download request.dirname
is the relative directory path to which the downloaded PDF will be saved. It defaults to the present working directory.- When
prepend_id
is True, the arXiv record ID will be prepended to the download filename. - When
slugify
is True, the paper title will be stripped of non-alphanumeric characters before being used as a filename.
Download PDF examples:
import arxiv
# Query for a paper of interest, then download
paper = arxiv.query(id_list=["1707.08567"])[0]
arxiv.download(paper)
# You can skip the query step if you have the paper info!
paper2 = {"pdf_url": "http://arxiv.org/pdf/1707.08567v1",
"title": "The Paper Title"}
arxiv.download(paper2)