開発ツール
arXiv Research Papers & Abstracts Scraper
Scrape arXiv preprints by keyword, author or subject with arXiv ID, title, authors, abstract, subject categories, DOI, publication and update dates and PDF links. Export to JSON, CSV or Excel.
arxiv-papers-scraper.json 200 OK
{ "arxivId": "2201.00978v1", "title": "PyramidTNT: Improved Transformer-in-Transforme…", "authors": ["Kai Han","Jianyuan Guo","Yehui Tang","Yunh…, "authorCount": 4, "summary": "Transformer networks have achieved great progr…", "categories": ["cs.CV"], "primaryCategory": "cs.CV", "published": "2022-01-04T04:56:57Z", "updated": "2022-01-04T04:56:57Z" }
得られるもの
各実行で、型が揃ったきれいなレコードを返します。CRM・スプレッドシート・データベースにそのまま使えます。
- 結果ごとに 1 レコード、重複排除・正規化済み
- JSON・CSV・Excel の安定したスキーマ、または Apify API で読み取り
- クラウドで従量課金。インストールも保守も不要
返される項目
Arxiv IdTitleAuthorsAuthor CountSummaryCategoriesPrimary CategoryPublishedUpdatedCommentPdf UrlAbs UrlVersionHtml Url
出力サンプル
実際の 1 レコード例。受け取る形そのままです。
| Arxiv Id | Title | Authors | Author Count |
|---|---|---|---|
| 2201.00978v1 | PyramidTNT: Improved Transformer-… | ["Kai Han","Jianyuan Guo","Yehui … | 4 |
| 2104.11502v1 | Learning to Cluster Faces via Tra… | ["Jinxing Ye","Xioajiang Peng","B… | 7 |
| 2404.05657v1 | MLP Can Be A Good Transformer Lea… | ["Sihao Lin","Pumeng Lyu","Dongru… | 7 |
GET /arxiv-papers-scraper
{ "arxivId": "2201.00978v1", "title": "PyramidTNT: Improved Transformer-in-Transforme…", "authors": ["Kai Han","Jianyuan Guo","Yehui Tang","Yunh…, "authorCount": 4, "summary": "Transformer networks have achieved great progr…", "categories": ["cs.CV"], "primaryCategory": "cs.CV", "published": "2022-01-04T04:56:57Z", "updated": "2022-01-04T04:56:57Z" }
関連スクレイパー
よくある質問
Can I search by author or subject category?
Yes. Set the search field to Author or Category code, or pass a native query such as `au:hinton` or `cat:cs.CL`. You can also combine terms with AND / OR.
Do I get the full abstract?
Yes. Each record includes the complete abstract text, not just a snippet.
Does every paper have a DOI?
No. A DOI is included whenever the paper has one registered; otherwise the field is null. Every record still has a stable arXiv ID and links.
How many papers can I collect?
Set Max Items to whatever you need. Results are gathered page by page until that limit or the end of the matches is reached.