開発ツール
GitHub Repositories Scraper - Stars, Forks & Topics
Scrape GitHub repositories by keyword with stars, forks, language, topics, license, open issues, owner and timestamps. Export to JSON, CSV or Excel.
github-repositories-scraper.json 200 OK
{ "id": 529502, "fullName": "scrapy/scrapy", "name": "scrapy", "owner": "scrapy", "ownerType": "Organization", "ownerUrl": "https://github.com/scrapy", "ownerAvatar": "https://avatars.githubusercontent.com/u/733635…", "description": "Scrapy, a fast high-level web crawling & scrap…", "htmlUrl": "https://github.com/scrapy/scrapy" }
得られるもの
各実行で、型が揃ったきれいなレコードを返します。CRM・スプレッドシート・データベースにそのまま使えます。
- 結果ごとに 1 レコード、重複排除・正規化済み
- JSON・CSV・Excel の安定したスキーマ、または Apify API で読み取り
- クラウドで従量課金。インストールも保守も不要
返される項目
IdFull NameNameOwnerOwner TypeOwner UrlOwner AvatarDescriptionHtml UrlHomepageStarsForksWatchersOpen Issues
出力サンプル
実際の 1 レコード例。受け取る形そのままです。
| Id | Full Name | Name | Owner |
|---|---|---|---|
| 529502 | scrapy/scrapy | scrapy | scrapy |
| 1209343409 | h4ckf0r0day/obscura | obscura | h4ckf0r0day |
| 5483330 | soimort/you-get | you-get | soimort |
| 40621231 | lorien/awesome-web-scraping | awesome-web-scraping | lorien |
| 9787912 | lorien/grab | grab | lorien |
GET /github-repositories-scraper
{ "id": 529502, "fullName": "scrapy/scrapy", "name": "scrapy", "owner": "scrapy", "ownerType": "Organization", "ownerUrl": "https://github.com/scrapy", "ownerAvatar": "https://avatars.githubusercontent.com/u/733635…", "description": "Scrapy, a fast high-level web crawling & scrap…", "htmlUrl": "https://github.com/scrapy/scrapy" }
関連スクレイパー
よくある質問
What can I search for?
Any keyword works, and you can also use qualifiers such as `language:python`, `stars:>1000` or `topic:cli` to narrow results.
How many repositories can I get per run?
A single search returns up to 1000 repositories, sorted by relevance.
Which fields are numeric?
Stars, forks, watchers, open issues and size are parsed as numbers so you can sort and filter directly.
How fresh is the data?
Every record is read live at run time, so stars and timestamps reflect the moment of the run (see observedAt).