开发者工具
GitHub Repositories Scraper - Stars, Forks & Topics
Scrape GitHub repositories by keyword with stars, forks, language, topics, license, open issues, owner and timestamps. Export to JSON, CSV or Excel.
github-repositories-scraper.json 200 OK
{ "id": 529502, "fullName": "scrapy/scrapy", "name": "scrapy", "owner": "scrapy", "ownerType": "Organization", "ownerUrl": "https://github.com/scrapy", "ownerAvatar": "https://avatars.githubusercontent.com/u/733635…", "description": "Scrapy, a fast high-level web crawling & scrap…", "htmlUrl": "https://github.com/scrapy/scrapy" }
你会得到什么
每次运行都返回干净、带类型的记录，可直接用于你的 CRM、表格或数据库。
- 每个结果对应一条干净记录，已去重并规范化
- JSON、CSV 或 Excel 的稳定结构，也可通过 Apify API 读取
- 在云端按用量付费，无需安装或维护
返回的字段
IdFull NameNameOwnerOwner TypeOwner UrlOwner AvatarDescriptionHtml UrlHomepageStarsForksWatchersOpen Issues
示例输出
一条真实的示例记录，正是你收到的结构。
| Id | Full Name | Name | Owner |
|---|---|---|---|
| 529502 | scrapy/scrapy | scrapy | scrapy |
| 1209343409 | h4ckf0r0day/obscura | obscura | h4ckf0r0day |
| 5483330 | soimort/you-get | you-get | soimort |
| 40621231 | lorien/awesome-web-scraping | awesome-web-scraping | lorien |
| 9787912 | lorien/grab | grab | lorien |
GET /github-repositories-scraper
{ "id": 529502, "fullName": "scrapy/scrapy", "name": "scrapy", "owner": "scrapy", "ownerType": "Organization", "ownerUrl": "https://github.com/scrapy", "ownerAvatar": "https://avatars.githubusercontent.com/u/733635…", "description": "Scrapy, a fast high-level web crawling & scrap…", "htmlUrl": "https://github.com/scrapy/scrapy" }
相关爬虫
常见问题
What can I search for?
Any keyword works, and you can also use qualifiers such as `language:python`, `stars:>1000` or `topic:cli` to narrow results.
How many repositories can I get per run?
A single search returns up to 1000 repositories, sorted by relevance.
Which fields are numeric?
Stars, forks, watchers, open issues and size are parsed as numbers so you can sort and filter directly.
How fresh is the data?
Every record is read live at run time, so stars and timestamps reflect the moment of the run (see observedAt).