Open source scrapy projects
Every project in the registry tagged scrapy, ranked by real GitHub adoption.
Distributed web crawler admin platform for spiders management regardless of languages and frameworks. 分布式爬虫管理平台，支持任何语言和框架
A multi-thread crawler framework with many builtin image crawlers provided.
High-performance asynchronous Douyin(抖音) TikTok Xiaohongshu(小红书) Kuaishou(快手) Weibo(微博) Instagram YouTube(油管) Twitter(X) Captcha Solver(验证码解决器) Temp Mail(临时邮箱)
Related tags
Frequently asked questions
How many open source scrapy projects are there?
This registry tracks 3 projects tagged scrapy, with 14,095 GitHub stars between them. The most-adopted is crawlab at 12,272 stars.
Are these scrapy projects free to use?
Yes — 3 of the 3 carry an explicit open-source licence across 3 distinct licences, so there is no licence fee. Where a project also sells a hosted or enterprise version, the self-hosted path remains free.
Which scrapy project should I choose?
The list above is ranked by GitHub stars, but stars measure attention rather than fit. Check three things on each card: the licence (permissive versus copyleft), the language it is written in, and the last-push date — a high-star project that has not been pushed in a year is a liability.
Are these scrapy projects still maintained?
0 of the 3 were pushed in the last 90 days, and every card shows its exact last-push date so you can see the rest. Sort your shortlist by that date before committing to a migration.