Developer tools

arXiv Research Papers & Abstracts Scraper

Scrape arXiv preprints by keyword, author or subject with arXiv ID, title, authors, abstract, subject categories, DOI, publication and update dates and PDF links. Export to JSON, CSV or Excel.

16 fields per record JSON · CSV · Excel · API Pay per use

Run on Apify Request custom

arxiv-papers-scraper.json 200 OK

{
  "arxivId": "2201.00978v1",
  "title": "PyramidTNT: Improved Transformer-in-Transforme…",
  "authors": ["Kai Han","Jianyuan Guo","Yehui Tang","Yunh…,
  "authorCount": 4,
  "summary": "Transformer networks have achieved great progr…",
  "categories": ["cs.CV"],
  "primaryCategory": "cs.CV",
  "published": "2022-01-04T04:56:57Z",
  "updated": "2022-01-04T04:56:57Z"
}

What you get

Every run returns clean, typed records, ready for your CRM, spreadsheet or database.

One clean record per result, deduped and normalized
Stable schema in JSON, CSV or Excel, or read it via the Apify API
Pay per use in the cloud, nothing to install or maintain

Fields it returns

Arxiv IdTitleAuthorsAuthor CountSummaryCategoriesPrimary CategoryPublishedUpdatedCommentPdf UrlAbs UrlVersionHtml Url

Sample output

A real example record, exactly the shape you receive.

Arxiv Id	Title	Authors	Author Count
2201.00978v1	PyramidTNT: Improved Transformer-…	["Kai Han","Jianyuan Guo","Yehui …	4
2104.11502v1	Learning to Cluster Faces via Tra…	["Jinxing Ye","Xioajiang Peng","B…	7
2404.05657v1	MLP Can Be A Good Transformer Lea…	["Sihao Lin","Pumeng Lyu","Dongru…	7

GET /arxiv-papers-scraper

{
  "arxivId": "2201.00978v1",
  "title": "PyramidTNT: Improved Transformer-in-Transforme…",
  "authors": ["Kai Han","Jianyuan Guo","Yehui Tang","Yunh…,
  "authorCount": 4,
  "summary": "Transformer networks have achieved great progr…",
  "categories": ["cs.CV"],
  "primaryCategory": "cs.CV",
  "published": "2022-01-04T04:56:57Z",
  "updated": "2022-01-04T04:56:57Z"
}

Example use cases

Arxiv Llm Papers Relevance Open on Apify Arxiv Diffusion Models Newest Open on Apify Arxiv Reinforcement Learning Updated Open on Apify Arxiv Graph Neural Networks Newest Open on Apify Arxiv Quantum Computing Relevance Open on Apify Arxiv Protein Folding Newest Open on Apify

Related scrapers

Frequently asked questions

Can I search by author or subject category?

Yes. Set the search field to Author or Category code, or pass a native query such as `au:hinton` or `cat:cs.CL`. You can also combine terms with AND / OR.

Do I get the full abstract?

Yes. Each record includes the complete abstract text, not just a snippet.

Does every paper have a DOI?

No. A DOI is included whenever the paper has one registered; otherwise the field is null. Every record still has a stable arXiv ID and links.

How many papers can I collect?

Set Max Items to whatever you need. Results are gathered page by page until that limit or the end of the matches is reached.

Ready when you are.

Run the scraper live on Apify right now, or have us build one tailored to exactly what you need.

Run on Apify Request custom