Ferramentas dev
GitHub Repositories Scraper - Stars, Forks & Topics
Scrape GitHub repositories by keyword with stars, forks, language, topics, license, open issues, owner and timestamps. Export to JSON, CSV or Excel.
github-repositories-scraper.json 200 OK
{ "id": 529502, "fullName": "scrapy/scrapy", "name": "scrapy", "owner": "scrapy", "ownerType": "Organization", "ownerUrl": "https://github.com/scrapy", "ownerAvatar": "https://avatars.githubusercontent.com/u/733635…", "description": "Scrapy, a fast high-level web crawling & scrap…", "htmlUrl": "https://github.com/scrapy/scrapy" }
O que você recebe
Cada execução retorna registros limpos e tipados, prontos para o seu CRM, planilha ou banco de dados.
- Um registro limpo por resultado, deduplicado e normalizado
- Esquema estável em JSON, CSV ou Excel, ou leia pela API da Apify
- Pague pelo uso na nuvem, sem instalar ou manter nada
Campos que retorna
IdFull NameNameOwnerOwner TypeOwner UrlOwner AvatarDescriptionHtml UrlHomepageStarsForksWatchersOpen Issues
Saída de exemplo
Um registro real de exemplo, exatamente no formato que você recebe.
| Id | Full Name | Name | Owner |
|---|---|---|---|
| 529502 | scrapy/scrapy | scrapy | scrapy |
| 1209343409 | h4ckf0r0day/obscura | obscura | h4ckf0r0day |
| 5483330 | soimort/you-get | you-get | soimort |
| 40621231 | lorien/awesome-web-scraping | awesome-web-scraping | lorien |
| 9787912 | lorien/grab | grab | lorien |
GET /github-repositories-scraper
{ "id": 529502, "fullName": "scrapy/scrapy", "name": "scrapy", "owner": "scrapy", "ownerType": "Organization", "ownerUrl": "https://github.com/scrapy", "ownerAvatar": "https://avatars.githubusercontent.com/u/733635…", "description": "Scrapy, a fast high-level web crawling & scrap…", "htmlUrl": "https://github.com/scrapy/scrapy" }
Scrapers relacionados
Perguntas frequentes
What can I search for?
Any keyword works, and you can also use qualifiers such as `language:python`, `stars:>1000` or `topic:cli` to narrow results.
How many repositories can I get per run?
A single search returns up to 1000 repositories, sorted by relevance.
Which fields are numeric?
Stars, forks, watchers, open issues and size are parsed as numbers so you can sort and filter directly.
How fresh is the data?
Every record is read live at run time, so stars and timestamps reflect the moment of the run (see observedAt).
Pronto quando você estiver.
Rode o scraper na Apify agora mesmo, ou peça um feito sob medida para o que você precisa.