Open Source Data & Analytics Tools

Browser Use ★ 120K

Let AI agents control any browser, at scale

Scrapling ★ 93K

🕷️ An adaptive Web Scraping framework that handles everything from a single request to a full-scale crawl! Don't be shy, join here: https://discord.gg/EMgGbDce

Mermaid ★ 91K

Text-based diagramming that renders in code and docs

Crawl4AI ★ 87K

LLM-ready web crawler built for AI data pipelines

Apache Superset ★ 75K

Self-serve data exploration and dashboard builder

echarts ★ 68K

Apache ECharts is a powerful, interactive charting and data visualization library for browser

scrapy ★ 65K

Scrapy, a fast high-level web crawling & scraping framework for Python.

diagram-design ★ 64K

38 editorial diagram types for Claude Code, Codex, and Pi. Self-contained HTML + SVG. No shadows. No Mermaid slop.

ClickHouse ★ 51K

Lightning-fast analytics for massive datasets

Metabase ★ 50K

Unlock data insights with powerful, user-friendly analytics

pixijs ★ 49K

The HTML5 Creation Engine: Create beautiful digital content with the fastest, most flexible 2D WebGL renderer.

airflow ★ 47K

Apache Airflow - A platform to programmatically author, schedule, and monitor workflows

EasySpider ★ 45K

A visual no-code/code-free web crawler/spider易采集：一个可视化浏览器自动化测试/数据采集/网页爬虫软件，可以无代码图形化的设计和执行爬虫任务。别名：ServiceWrapper面向Web应用的智能化服务封装系统。

Lightpanda ★ 41K

Fast, AI-native web browser built for automation and scraping

PostHog ★ 41K

Unlock Product Insights with Open-Source Analytics

Umami ★ 40K

Empower your website with privacy-focused analytics

seaweedfs ★ 36K

SeaweedFS is a distributed storage system for object storage (S3), file systems, and Iceberg tables, designed to handle billions of files with O(1) disk access

rustfs ★ 36K

RustFS is an open-source, S3-compatible high-performance object storage system supporting migration and coexistence with other S3-compatible platforms such as M

changedetection.io ★ 35K

Best and simplest tool for website change detection, web page monitoring, and website change alerts. Perfect for tracking content changes, price drops, restock

CloakBrowser ★ 33K

Stealth Chromium that passes every bot detection test. Drop-in Playwright replacement with source-level fingerprint patches. 30/30 tests passed.

Scrapegraph-ai ★ 32K

Python scraper based on AI

dots ★ 32K

Open-source dots for the web: an AI agent with its own browser, one that does not get blocked.

lux ★ 32K

👾 Fast and simple video download library and CLI tool written in Go

Plausible ★ 30K

Privacy-focused, lightweight web analytics

page-agent ★ 30K

JavaScript in-page GUI agent. Control web interfaces with natural language.

ArchiveBox ★ 29K

🗃 Open source self-hosted web archiving. Takes URLs/browser history/bookmarks/Pocket/Pinboard/etc., saves HTML, JS, PDFs, media, and more...

Redash ★ 29K

Connect, query, visualize, and share your data

crawlee ★ 26K

Crawlee—A web scraping and browser automation library for Node.js to build reliable crawlers. In JavaScript and TypeScript. Extract data for AI, LLMs, RAG, or G

stagehand ★ 26K

The SDK to extract data and interact with any site on the web. Get started with Claude Code, Codex, Eve, Mastra, and more.

colly ★ 26K

Elegant Scraper and Crawler Framework for Golang

dataease ★ 25K

🔥 人人可用的开源 BI 工具，数据可视化神器。An open-source BI tool alternative to Tableau.

dash ★ 24K

Data Apps & Dashboards for Python. No JavaScript Required.

proxy_pool ★ 24K

Python ProxyPool for web spider

Skyvern ★ 23K

Automate any website workflow with AI and computer vision

Airbyte ★ 22K

Open-source data integration for modern teams

moli ★ 22K

Best headless browser for AI agents. Lite, Fast, High-Compatibility. Built in Rust

Matomo ★ 22K

Empower your digital strategy with actionable insights

Automa ★ 22K

Build AI agents and RPA workflows without writing code

parse-server ★ 21K

Parse Server for Node.js / Express

Cube ★ 21K

Unify data models and metrics across your entire stack

Douyin_TikTok_Download_API ★ 21K

🚀 Self-hosted TikTok & Douyin scraper and no-watermark video downloader — async REST API, MCP server, CLI and web console for posts, profiles, comments and pla

shardingsphere ★ 21K

Empowering Data Intelligence with Distributed SQL for Sharding, Scalability, and Security Across All Databases.

plotly.js ★ 18K

Open-source JavaScript charting library behind Plotly and Dash

Maxun ★ 18K

No-code web scraping, crawling, and extraction platform

katana ★ 18K

A next-generation crawling and spidering framework.

deck.gl ★ 15K

WebGL2 powered visualization framework

debezium ★ 13K

Change data capture for a variety of databases. Please log issues at https://github.com/debezium/dbz/issues.

SeleniumBase ★ 13K

APIs for browser automation, testing, and bypassing bot-detection. Includes CDP Mode: A stealthy configuration for chromium that passes every bot detection test

Rybbit ★ 13K

Understand your audience with privacy-first analytics.

G6 ★ 12K

♾ A Graph Visualization Framework in JavaScript.

crawlab ★ 12K

Distributed web crawler admin platform for spiders management regardless of languages and frameworks. 分布式爬虫管理平台，支持任何语言和框架

sigma.js ★ 12K

A JavaScript library aimed at visualizing graphs of thousands of nodes and edges

camofox-browser ★ 12K

Stealth headless browser for AI agents — bypass Cloudflare, bot detection, and anti-scraping. Drop-in Puppeteer/Playwright replacement.

kepler.gl ★ 12K

Kepler.gl is a powerful open source geospatial analysis tool for large-scale data sets.

CocoIndex ★ 12K

Ultra-fast data transformation for AI with lineage

webmagic ★ 12K

A scalable web crawler framework for Java.

jsoup ★ 11K

jsoup: the Java HTML parser, built for HTML editing, cleaning, scraping, and XSS safety.

nopecha-extension ★ 11K

Automated CAPTCHA solver for your browser. Works with Selenium, Puppeteer, Playwright, and more.

pinchtab ★ 11K

High-performance browser automation bridge and multi-instance orchestrator with advanced stealth injection and real-time dashboard.

OpenBot ★ 9.9K

Open-source AI coworkers that each get a computer of their own: a browser, files and tools, with every action decided before it happens and recorded after. Brin

seatunnel ★ 9.8K

SeaTunnel is a multimodal, high-performance, distributed, massive data integration tool.

crawlee-python ★ 9.6K

Crawlee—A web scraping and browser automation library for Python to build reliable crawlers. Extract data for AI, LLMs, RAG, or GPTs. Download HTML, PDF, JPG, P

c3 ★ 9.4K

:bar_chart: A D3-based reusable chart library

rawgraphs-app ★ 9.1K

A web interface to create custom vector-based visualizations on top of RAWGraphs core

Claude-Code-Usage-Monitor ★ 8.8K

Real-time Claude Code usage monitor with predictions and warnings

Fathom Lite ★ 8.0K

Privacy-focused analytics without the complexity

F2 ★ 8.0K

📱📈An elegant, interactive and flexible charting library for mobile.

steampipe ★ 8.0K

Zero-ETL, infinite possibilities. Live query APIs, code & more with SQL. No DB required.

Steel ★ 7.9K

Cloud browser sessions for AI agents and web automation

JMComic-Crawler-Python ★ 7.9K

Python API for JMComic | 提供Python API访问禁漫天堂，同时支持网页端和移动端 | 禁漫天堂GitHub Actions下载器🚀

firecrawl-mcp-server ★ 7.8K

🔥 Official Firecrawl MCP Server - Adds powerful web scraping and search to Cursor, Claude and any other LLM clients.

realtime ★ 7.7K

Broadcast, Presence, and Postgres Changes via WebSockets

mcp ★ 7.3K

Browser MCP is a Model Context Provider (MCP) server that allows AI applications to control your browser

google-maps-scraper ★ 7.2K

scrape data from Google Maps. Extracts data such as the name, address, phone number, website URL, rating, reviews number, latitude and longitude, reviews,emai

rod ★ 7.1K

A Chrome DevTools Protocol driver for web automation and scraping.

pydoll ★ 7.1K

Pydoll is a library for automating chromium-based browsers without a WebDriver, offering realistic interactions.

Evidence ★ 7.1K

Transform SQL into beautiful data stories

trafilatura ★ 7.1K

Python & Command-line tool to gather text and metadata on the Web: Crawling, scraping, extraction, output as CSV, JSON, HTML, MD, TXT, XML

firebase-ios-sdk ★ 7.0K

Firebase SDK for Apple App Development

react-chartjs-2 ★ 6.9K

React components for Chart.js, the most popular charting library

curl_cffi ★ 6.8K

Python binding for curl-impersonate fork via cffi. A http client that can impersonate browser tls/ja3/http2 fingerprints.

node-crawler ★ 6.8K

Web Crawler/Spider for NodeJS + server-side jQuery ;-)

ScottPlot ★ 6.8K

Interactive plotting library for .NET

charts.css ★ 6.6K

Open source CSS framework for data visualization.

CloudQuery ★ 6.6K

Sync and transform data from any source to any destination

open-dots ★ 6.5K

Open-source alternative to OpenAI Dots: self-hosted AI chat, tools, approvals, connectors, and computer tasks.

flink-cdc ★ 6.5K

Flink CDC is a streaming data integration tool

skills ★ 6.3K

Browser automation CLI built for AI agents. Break through anti-bot walls, hand off to humans across platforms when stuck. Parallel multi-task execution, indepen

Lightdash ★ 6.2K

Open-source BI for modern data teams

Apache Pinot ★ 6.2K

Distributed OLAP database for real-time analytics at scale

dlt ★ 6.1K

data load tool (dlt) is an open source Python library that makes data loading easy 🛠️

ferret ★ 6.0K

Declarative data automation language and Go runtime for structured extraction workflows.

Countly ★ 5.9K

Comprehensive analytics for data-driven decisions

mountpoint-s3 ★ 5.8K

A simple, high-throughput file client for mounting an Amazon S3 bucket as a local file system.

cubefs ★ 5.7K

cloud-native distributed storage

allure2 ★ 5.6K

Allure Report is a flexible, lightweight multi-language test reporting tool. It provides clear graphical reports and allows everyone involved in the development

lakeFS ★ 5.6K

lakeFS - Data version control for your data lake | Git for data

plot ★ 5.4K

A concise API for exploratory data visualization implementing a layered grammar of graphics

fluvio ★ 5.3K

🦀 event stream processing for developers to collect and transform data in motion to power responsive data intensive applications.

dtale ★ 5.2K

Visualizer for pandas data structures

whodb ★ 5.0K

Where data access meets operational intelligence

patchright ★ 5.0K

Undetected version of the Playwright testing and automation library.

matplotplusplus ★ 4.9K

Matplot++: A C++ Graphics Library for Data Visualization 📊🗾

CoDiver ★ 4.7K

An advanced, unified platform for code quality, architectural metrics, and Agile analytics. Features Python AST parsing, Java static analysis (code smells), an

Noria ★ 4.6K

An agentic extractor for messaging platforms. Noria receives messages & URLs via chat; scrapes web data to evaluate the content against custom scoring matrices

flint-chart ★ 4.5K

🪄 Flint is a visualization language that lets AI agents reliably create expressive, good-looking charts from simple, human-editable chart specs.

design-extract ★ 4.5K

Extract any website's complete design system with one command. DTCG tokens, semantic+primitive+composite, MCP server for Claude Code/Cursor/Windsurf, multi-plat

radzen-blazor ★ 4.4K

Radzen Blazor is the most sophisticated free UI component library for Blazor, featuring 145+ native components including DataGrid, Scheduler, Charts, and advanc

workflow-use ★ 4.2K

⚙️ Create and run workflows (RPA 2.0)

docetl ★ 4.2K

A system for agentic LLM-powered data processing and ETL

DotnetSpider ★ 4.1K

DotnetSpider, a .NET standard web crawling library. It is lightweight, efficient and fast high-level web crawling & scraping framework

aws-sdk-pandas ★ 4.1K

pandas on AWS - Easy integration with Athena, Glue, Redshift, Timestream, Neptune, OpenSearch, QuickSight, Chime, CloudWatchLogs, DynamoDB, EMR, SecretManager,

chunjun ★ 4.1K

A data integration framework

L7 ★ 4.1K

🌎 Large-scale WebGL-powered Geospatial Data Visualization analysis engine.

scrape-it ★ 4.1K

🔮 A Node.js scraper for humans.

electricitymaps-contrib ★ 4.0K

The open source repository for Electricity Maps data parsers that powers the world's most comprehensive electricity data platform

puppeteer-sharp ★ 3.9K

Headless Chrome .NET API

anakin ★ 3.9K

Open-source web scraping API. Turn any website into clean markdown or structured JSON. Anti-detect browser, proxy auto-selection, self-hosted. One command: make

echotrace ★ 3.9K

EchoTrace 是一个本地、安全的微信聊天记录导出、分析与年度报告生成工具 | EchoTrace is a local, secure tool for exporting, analyzing, and generating annual reports of WeChat chat records

vizro ★ 3.8K

Vizro is a low-code toolkit for building high-quality data visualization apps.

cariddi ★ 3.8K

Take a list of domains, crawl urls and scan for endpoints, secrets, api keys, file extensions, tokens and more

XCharts ★ 3.8K

A charting and data visualization library for Unity. Unity数据可视化图表插件。

britecharts ★ 3.7K

Composable Charting Library based on reusable D3.js components.

VTable ★ 3.7K

VTable is not just a high-performance multidimensional data analysis table, but also a grid artist that creates art between rows and columns.

toapi ★ 3.6K

Every web site provides APIs.

playwright-go ★ 3.5K

Playwright for Go a browser automation library to control Chromium, Firefox and WebKit with a single API.

atomic-agent ★ 3.5K

Atomic Agent is a local-first AI agent. Runs open-weight models on your own machine via llama.cpp.

react-simple-maps ★ 3.4K

Composable SVG map charts for data visualization in React

sqlmesh ★ 3.3K

Scalable and efficient data transformation framework - backwards compatible with dbt.

stealth-browser-mcp ★ 3.3K

The only browser automation that bypasses anti-bot systems. AI writes network hooks, clones UIs pixel-perfect via simple chat.

peerdb ★ 3.3K

Fast, Simple and a cost effective tool to replicate data from Postgres to Data Warehouses, Queues and Storage

VirtualBrowser ★ 3.2K

Free anti fingerprint browser, 指纹浏览器, 隐私浏览器, 防识别浏览器, 反识别浏览器, 防关联浏览器, 免费的web3空投专用指纹浏览器 https://virtualbrowser.cc/?src=github

devlake ★ 3.2K

Apache DevLake is an open-source dev data platform to ingest, analyze, and visualize the fragmented data from DevOps tools, extracting insights for engineering

ZeroFS ★ 3.2K

ZeroFS: A log-structured filesystem for S3. ZeroFS serves S3-compatible buckets as POSIX filesystems over NFS and 9P, or as raw block devices over NBD.

shynet ★ 3.2K

Modern, privacy-friendly, and detailed web analytics that works without cookies or JS.

browser-control ★ 3.2K

A tiny, fast Rust CLI that drives a real browser over the Chrome DevTools Protocol — built for coding agents.

tianji ★ 3.1K

Tianji: Insight into everything, Website Analytics + Uptime Monitor + Server Status. not only another GA alternatives

react-native-chart-kit ★ 3.1K

Beautiful charts for React Native. Line, area, bar, pie, donut, progress, and contribution heatmaps for dashboards, reports, and data-rich mobile apps.

FastReport ★ 3.1K

Free Open Source Reporting tool for .NET6/.NET Core/.NET Framework that helps your application generate document-like reports

CBoard ★ 3.1K

An easy to use, self-service open BI reporting and BI dashboard platform.

versitygw ★ 3.1K

A simple to deploy but feature rich S3 object storage server for your filesystem

FinalRecon ★ 3.0K

All In One Web Recon

js-reverse-mcp ★ 3.0K

AI Agent-first JS 逆向 MCP Server：有头 Chrome 调试、断点、网络/WebSocket 分析、Patchright 反检测，可选 CloakBrowser。

Deepnote ★ 3.0K

Python, SQL, and AI in a collaborative data notebook

google-play-scraper ★ 3.0K

Node.js scraper to get data from Google Play

rill ★ 3.0K

The fastest business intelligence tool for humans and agents.

twscrape ★ 2.9K

Python library and CLI for X/Twitter scraping with multi-account rotation and built-in rate-limit handling.

unovis ★ 2.9K

Modular data visualization framework for React, Angular, Svelte, Vue, and vanilla TypeScript or JavaScript

spider ★ 2.8K

Foundational low latency web data collecting in Rust

geziyor ★ 2.8K

Geziyor, blazing fast web crawling & scraping framework for Go. Supports JS rendering.

Open Wearables ★ 2.7K

Convert wearable data into actionable health insights with open algorithms

semiotic ★ 2.7K

React data visualization library for streaming, networks, and AI-assisted development

brightdata-mcp ★ 2.7K

A powerful Model Context Protocol (MCP) server that provides an all-in-one solution for public web access.

OpenWebAnalytics ★ 2.7K

Powerful, customizable web analytics for your site

php-spx ★ 2.6K

A simple & straight-to-the-point PHP profiling extension with its built-in web UI

HolyClaude ★ 2.6K

AI coding workstation: Claude Code + web UI + 8 AI CLIs + headless browser + 50+ tools

invisible_playwright ★ 2.5K

Free antidetect browser stealth for Playwright: undetected headless Firefox fingerprint. Python scraping, recaptcha and bot detection bypass. Open source

AAChartKit-Swift ★ 2.5K

📈📊📱💻🖥️An elegant modern declarative data visualization chart framework for iOS, iPadOS and macOS. Extremely powerful, supports line, spline, area, areaspli

API ★ 2.5K

API for Current cases and more stuff about COVID-19 and Influenza

grab ★ 2.5K

Web Scraping Framework

vue-data-ui ★ 2.5K

An open source user-empowering data visualization Vue 3 components library for eloquent data storytelling

reverse-api-engineer ★ 2.5K

The agent that turns websites into APIs!

Elementary Data ★ 2.4K

Data observability for modern data teams

webclaw ★ 2.4K

Fast, local-first web content extraction for LLMs. Scrape, crawl, extract structured data — all from Rust. CLI, REST API, and MCP server.

DeepBI ★ 2.4K

LLM based data scientist, AI native data application. AI-driven infinite thinking redefines BI.

lcu ★ 2.4K

Codex computer use, decoupled from the app, for usage inside any harness.

talivia ★ 2.3K

Open-source, self-hosted revenue-first analytics for founders: web analytics, Session Replay, revenue attribution, and customer revenue integrations. datafast a

abot ★ 2.3K

Cross Platform C# web crawler framework built for speed and flexibility. Please star this project! +1.

recipe-scrapers ★ 2.3K

Python package for scraping recipes data

go-streams ★ 2.2K

A lightweight stream processing library for Go

google-maps-scraper-kit ★ 2.1K

Free Google Maps scraper for lead generation. Exports phones, emails, websites and socials to CSV. Runs locally in Docker, no API keys. Claude Code skill includ

doit ★ 2.1K

CLI task management & automation tool

jshookmcp ★ 2.1K

js hook toolkit that all you need

CherryUSB ★ 2.1K

CherryUSB is a tiny and beautiful, high performance and portable USB host and device stack for embedded system with USB IP

vizzu-lib ★ 2.0K

Library for animated data visualizations and data stories.

NewPipeExtractor ★ 2.0K

NewPipe's core library for extracting data from streaming sites

ara ★ 2.0K

ARA Records Ansible and makes it easier to understand and troubleshoot.

gain ★ 2.0K

Web crawling framework based on asyncio.

helix-foundry ★ 2.0K

Connect your company's data, let an agent draft an ontology over it, and load it into HelixDB as one graph you can explore and ask questions of. Hosted at found

troika ★ 2.0K

A JavaScript framework for interactive 3D and 2D visualizations

cloudserver ★ 2.0K

Zenko CloudServer, an open-source Node.js implementation of the Amazon S3 protocol on the front-end and backend storage capabilities to multiple clouds, includi

Ghostwriter ★ 2.0K

The SpecterOps project management and reporting engine

aistore ★ 2.0K

AIStore: scalable storage for AI applications

article-extractor ★ 1.9K

To extract article from given URL

hypertools ★ 1.9K

A Python toolbox for gaining geometric insights into high-dimensional data

x-crawl ★ 1.9K

Flexible Node.js AI-assisted crawler library

bklit-ui ★ 1.9K

Open-source UI & Charts library

Aptabase ★ 1.9K

Privacy-first analytics for mobile and desktop apps

OpenAdapt ★ 1.9K

For EHRs, payer portals, and any app your team clicks through. A person or an agent shows the task; OpenAdapt turns it into a local program that repeats the ste

browserless ★ 1.8K

The headless Chrome/Chromium driver on top of Puppeteer. Take screenshots, generate PDFs, extract text and HTML with a production-ready API.

diskover-community ★ 1.8K

Diskover Community Edition - Open source file indexer, file search engine and data management and analytics powered by Elasticsearch

graphic ★ 1.8K

A grammar of data visualization and Flutter charting library.

lets-plot ★ 1.8K

Multiplatform plotting library based on the Grammar of Graphics

finvizfinance ★ 1.8K

Finviz analysis python library.

Litlyx ★ 1.7K

Cookie-less analytics for privacy-focused insights

ruia ★ 1.7K

Async Python 3.6+ web scraping micro-framework based on asyncio

datalens ★ 1.7K

A modern, scalable analytics system

selectolax ★ 1.7K

Python binding to Modest and Lexbor engines. Fast HTML5 parser with CSS selectors for Python.

multiwoven ★ 1.7K

🔥🔥🔥 Open source Reverse ETL - alternative to hightouch and census.

single-file-cli ★ 1.7K

CLI tool for saving a faithful copy of a complete web page in a single HTML file (based on SingleFile)

Scweet ★ 1.7K

Scrape tweets, profiles, followers and following from Twitter/X, no API key needed. Python library with smart multi-account pooling, proxy support and async.

Seal-Report ★ 1.6K

Database Reporting Tool and Tasks (.Net)

actionbook ★ 1.6K

Let your AI agent get the sources behind logins and paywalls.

fredy ★ 1.6K

❤️ Fredy - [F]ind [R]eal [E]state [D]amn Eas[y] - Fredy keeps searching for new apartments, houses, and flats in Europe on platforms like ImmoScout24, Immowelt,

PDFLayoutTextStripper ★ 1.6K

Converts a pdf file into a text file while keeping the layout of the original pdf. Useful to extract the content from a table in a pdf file for instance. This i

Mink ★ 1.6K

PHP web browser emulator abstraction

riko ★ 1.6K

A Python stream processing engine modeled after Yahoo! Pipes

AVA ★ 1.6K

🤖 AI-native Visual Analytics framework build for agents.

just-dashboard ★ 1.6K

:bar_chart: :clipboard: Dashboards using YAML or JSON files

patchright-python ★ 1.6K

Undetected Python version of the Playwright testing and automation library.

open-dronelog ★ 1.6K

Drone Log analyzer: A high-performance universal dashboard application for organizing and analyzing DJI/Litchi flight logs privately in one place. Supports plug

olake ★ 1.6K

OLake - Fastest Databases, Kafka & S3 Replication to Apache Iceberg with Table optimization (Called OLake Fusion). ⚡ Efficient, quick and scalable data ingestio

duckle ★ 1.5K

Open-source ETL/ELT you deploy on your own servers or cloud. Built on DuckDB: no-code/low-code visual pipelines or SQL, 385 components, dbt, CDC, data quality,

OpenSERP ★ 1.5K

Self-hosted SERP API for Google, Bing, Yandex, and more

OpenContracts ★ 1.5K

The open document intelligence platform for builders and hackers - DMS for the agentic world

hop ★ 1.5K

Hop Orchestration Platform

wreq-python ★ 1.5K

An ergonomic, privacy-aware Python HTTP Client

agentql ★ 1.5K

AgentQL is a suite of tools for connecting your AI to the web. Featuring a query language and Playwright integrations for interacting with elements and extracti

jsxgraph ★ 1.5K

JSXGraph is a cross-browser library for interactive geometry, function plotting, charting, and data visualization in a web browser.

zendriver ★ 1.5K

A blazing fast, async-first, undetectable webscraping/web automation framework based on ultrafunkamsterdam/nodriver. Now with Docker support!

scrapy-playwright ★ 1.5K

🎭 Playwright integration for Scrapy

fscrawler ★ 1.5K

Elasticsearch File System Crawler (FS Crawler)

rebrowser-patches ★ 1.5K

Collection of patches for puppeteer and playwright to avoid automation detection and leaks. Helps to avoid Cloudflare and DataDome CAPTCHA pages. Easy to patch/

Addax ★ 1.5K

Actively maintained fork of Alibaba DataX — a fast, versatile ETL tool for RDBMS/NoSQL data transfer

miasma ★ 1.4K

Trap AI web scrapers in an endless poison pit.

pgsync ★ 1.4K

Postgres, MySQL, or MariaDB to Elasticsearch/OpenSearch sync

WebAI2API ★ 1.4K

WebAI2API: 基于 Camoufox 的网页 AI 转 API 工具，支持 LMArena/Gemini等，多窗口并发与账号隔离。 | Web AI to OpenAI API via Camoufox. Supports LMArena/Gemini and more, multi-window concur

hue ★ 1.4K

Open source SQL Query Assistant service for Databases/Warehouses

jfreechart ★ 1.4K

A 2D chart library for Java applications (JavaFX, Swing or server-side).

jasperreports ★ 1.4K

JasperReports® - Free Java Reporting Library

react-native-gifted-charts ★ 1.4K

The most loved library for Bar, Line, Area, Pie, Donut, Stacked Bar, Population Pyramid, Radar, Bubble, Scatter and Candle Stick charts in React Native. Allows

parsera ★ 1.4K

Lightweight library for scraping web-sites with LLMs

httpcloak ★ 1.4K

Go HTTP client with browser-identical TLS/HTTP2 fingerprinting. Bypass bot detection by perfectly mimicking Chrome, Firefox, and Safari at the cryptographic lev

squid-sdk ★ 1.3K

TypeScript ETL toolkit for indexing Ethereum, Solana, and Substrate data, sourced from SQD Network.

storage ★ 1.3K

S3 compatible object storage service that stores metadata in Postgres

jsreport ★ 1.3K

javascript based business reporting platform :rocket:

sentinl ★ 1.3K

Kibana Alert & Report App for Elasticsearch

bigquery-utils ★ 1.3K

Useful scripts, udfs, views, and other utilities for migration and data warehouse operations in BigQuery.

AIPex ★ 1.3K

AIPex: AI browser automation assistant, no migration and privacy first. Alternative to Manus Browser Operator、 Claude Chrome and Agent Browser

drasi-platform ★ 1.3K

The Data Change Processing platform

reaviz ★ 1.3K

📊 Data visualization library for React. Maintained by @goodcodeus.

Databuddy ★ 1.2K

Privacy-first analytics without cookies or tracking

Swetrix ★ 1.2K

Cookieless, privacy-first web analytics without the complexity

crw ★ 1.2K

Fast, lightweight Firecrawl/Tavily alternative in Rust. Web scraper, crawler & search API with MCP server for AI agents. Drop-in Firecrawl-compatible API (/scra

ClawBench ★ 1.2K

Open-source benchmark for browser AI agents on daily tasks.

browsertrix-crawler ★ 1.2K

Run a high-fidelity browser-based web archiving crawler in a single Docker container

newspaper4k ★ 1.2K

📰 Newspaper4k a fork of the beloved Newspaper3k. Extraction of articles, titles, and metadata from news websites.

pdf_oxide ★ 1.2K

The fastest PDF library for Python and Rust. Text extraction, image extraction, markdown conversion, PDF creation & editing. 0.8ms mean, 5× faster than industry

fess ★ 1.1K

Open-source, self-hosted enterprise & site search server built on OpenSearch. Crawls web / file / DB / cloud sources, 20+ languages, REST API, and AI/RAG & sema

socid-extractor ★ 1.1K

⛏️ The extraction engine behind Maigret: turn any profile URL into a structured OSINT record across 150+ sites

faster-than-requests ★ 1.1K

Faster requests on Python 3

trawl ★ 1.1K

Self-hosted scraping engine — bypasses any JS challenge & captcha: Cloudflare, Turnstile, reCAPTCHA, hCaptcha, GeeTest. FlareSolverr & Byparr alternative and dr

wreq ★ 1.1K

An ergonomic, privacy-aware Rust HTTP Client

power-bi-agentic-development ★ 1.1K

Power BI AI skills and Power BI agents for Claude Code and GitHub Copilot: a plugin marketplace of Power BI skills, subagents, and hooks for semantic models, DA

ovobrowser ★ 1.1K

源码级 Chromium 指纹内核，检测站按普通 Chrome 评分。Source-level Chromium fingerprint kernel that passes bot detection tests. Not JS injection — C++ patches compiled into the bi

Frappe Insights ★ 1.0K

Powerful open-source business intelligence for data-driven decisions

zerocode ★ 1.0K

zerocode-tdd is a community-developed, free, open-source, outcome-driven automated testing framework for Data Pipelines, ETL, REST API, Kafka(Data Streams), Dat

opentabs ★ 1.0K

Browser automation clicks buttons. OpenTabs calls APIs.

siteone-crawler ★ 994

SiteOne Crawler is a cross-platform website crawler and analyzer for SEO, security, accessibility, and performance optimization—ideal for developers, DevOps, QA

x-reader ★ 988

Universal content reader MCP Server for 10+ platforms

offen ★ 982

Offen Fair Web Analytics

scout ★ 948

Scout: the open-source browser agent, by Outcrawl. Mirrored automatically from Outcrawl's own repository.

TikHub-API-Python-SDK ★ 934

High-performance asynchronous Douyin(抖音) TikTok Xiaohongshu(小红书) Kuaishou(快手) Weibo(微博) Instagram YouTube(油管) Twitter(X) Captcha Solver(验证码解决器) Temp Mail(临时邮箱)

icrawler ★ 934

A multi-thread crawler framework with many builtin image crawlers provided.

nitrite-java ★ 921

NoSQL embedded document store for Java

sling-cli ★ 919

Sling is a CLI tool that extracts data from a source storage/database and loads it in a target storage/database.

auto-browser ★ 916

Give your AI agent a real browser — with a human in the loop. Open-source MCP-native browser agent.

seatunnel-web ★ 888

SeaTunnel is a distributed, high-performance data integration platform for the synchronization and transformation of massive data (offline & real-time).

skrape.it ★ 874

A Kotlin-based testing/scraping/parsing library providing the ability to analyze and extract data from HTML (server & client-side rendered). It places particula

ArrowDL ★ 853

ArrowDL (Arrow Downloader) is a download manager for Windows, MacOS and Linux

wexflow ★ 844

Workflow Automation Engine

wa-js ★ 832

Browser-side WhatsApp Web automation library. Exposes the WPP JavaScript API for chats, messages, contacts, groups, media and events; powers WPPConnect integrat

allure-python ★ 820

Allure integrations for Python test frameworks

Etl.Net ★ 813

Mass processing data with a complete ETL for .net developers

patchright-nodejs ★ 803

Undetected NodeJS version of the Playwright testing and automation library.

GEOInflow ★ 785

Self-hosted web and AI crawler analytics for Generative Engine Optimization (GEO). Track visitors, AI search referrals, crawl logs, content coverage, and conver

js-cookie-monitor-debugger-hook ★ 782

js cookie逆向利器：js cookie变动监控可视化工具 & js cookie hook打条件断点

figranium ★ 780

Stack blocks visually to build complex browser workflows and execute them via API

MasterParser ★ 767

MasterParser is a powerful DFIR tool designed for analyzing and parsing Linux logs

bigfunctions ★ 761

Supercharge BigQuery with BigFunctions

xxl-crawler ★ 756

A lightweight web crawler framework.（Java爬虫框架）

allure-docker-service ★ 754

This docker container allows you to see up to date reports simply mounting your "allure-results" directory in the container (for a Single Project) or your "proj

Prism-Browser-Community ★ 749

Local-first open-source multi-profile fingerprint browser based on Chromium and Electron

TumblThree ★ 742

A Tumblr and Twitter Blog Backup Application

ketch ★ 740

Fast, stateless CLI for web search and scrape. Built for AI agents.

puppetboard ★ 735

Web frontend for PuppetDB

PyPtt ★ 734

The best PTT library

EventViewerX ★ 734

Windows Event Log tooling for PowerShell and .NET: typed queries, reporting, export, WEC, automation, and the PSEventViewer module.

scrapecraft ★ 724

🤖 AI-powered web scraping editor with visual workflow builder. Build, test & deploy web scrapers using natural language. Powered by ScrapeGraphAI & LangGraph.

InsightFlare ★ 711

A powerful, privacy-friendly open source web analytics tool that runs entirely on Cloudflare.

deepcrawl ★ 696

100% free and full open-source edge Firecrawl alternative with better links extraction for agents - that you can deploy to cloudflare or vercel by yourself.

arc ★ 689

Open, SQL-native time-series database for telemetry you need to keep. 34M+ records/sec ingestion, 8M+ rows/sec queries. InfluxDB Line Protocol and Telegraf comp

datavzrd ★ 683

A tool to create visual HTML reports from collections of CSV/TSV tables

openchatbi ★ 676

OpenChatBI is an intelligent chat-based BI tool powered by large language models, designed to help users query, analyze, and visualize data through natural lang

Zenko ★ 672

Zenko is the open source multi-cloud data controller: own and keep control of your data on any cloud.

terminal ★ 659

Terminal UI to get stuff done in the browser

agent-browser-cli ★ 643

使用 agent-browser-cli 进行浏览器感知与控制。适用于标签页扫描/切换、页面 JS 执行、Cookie、CDP、contentSettings、截图、文件上传、下拉框点击、tmwd_cdp_bridge 初始化和 Web 工具排障

openanalytics ★ 643

Open-source, privacy-first and cookieless web analytics with revenue attribution and an MCP server.

countly-sdk-ios ★ 628

Countly Digital Analytics iOS SDK with macOS, watchOS and tvOS support.

conduit ★ 618

Conduit streams data between data stores. Kafka Connect replacement. No JVM required.

pudl ★ 613

The Public Utility Data Liberation Project provides analysis-ready energy system data to climate advocates, researchers, policymakers, and journalists.

beginner_de_project ★ 611

Beginner data engineering project - batch edition

redun ★ 608

Yet another redundant workflow engine

sycamore ★ 605

🍁 Sycamore is an LLM-powered search and analytics platform for unstructured data.

faction ★ 604

Pen Test Report Generation and Assessment Collaboration

django-slick-reporting ★ 604

The Reporting Engine for Django. Create dashboards and standalone Reports and Charts.

domainmod ★ 602

DomainMOD is an open source application written in PHP & MySQL used to manage your domains and other internet assets in a central location. DomainMOD also inclu

automate-dv ★ 598

A free to use dbt package for creating and loading Data Vault 2.0 compliant Data Warehouses (powered by dbt, an open source data engineering tool, registered t

metorikku ★ 589

A simplified, lightweight ETL Framework based on Apache Spark

PHPScraper ★ 588

A universal web-util for PHP.

vulnrepo ★ 583

VULNRΞPO - Free vulnerability report generator and repository, end-to-end encrypted! Templates of issues, CWE,CVE,MITRE ATT&CK,PCI DSS, import Nmap/Nessus/Burp/

freeproxy ★ 573

FreeProxy: Collecting free proxies from internet. (全球海量高质量免费代理，支持爬取数十个免费代理分享源，支持自定义规则代理筛选，爬虫与数据分析必备，每日更新海量免费代理。)

Stealth-Requests ★ 567

Undetected web-scraping & seamless HTML parsing in Python!

basketball_reference_web_scraper ★ 563

NBA Stats API via Basketball Reference

reader ★ 561

Open source web infrastructure for AI. Scrape, crawl, and automate the web, clean markdown, browser sessions, ready for your agents.

genblaze ★ 552

Genblaze is an open source Python SDK for orchestrating generative AI media pipelines across video, audio, and image providers with built in provenance for ever

oc ★ 547

Turn any website into a compact CLI tailored for AI agents. Browse the web in hundreds of tokens, not tens of thousands.

browser-search ★ 539

A skill for AI agents: search the web with SearXNG, browse with Camofox, bypass protections with CloakBrowser. Anti-hallucination by design. Self-hosted, free,

ff-ruyijs ★ 537

Run any site JavaScript from Python with the real Firefox engine. Headless SpiderMonkey + Necko for automation and scraping.

jxls ★ 533

Java library for creating Excel reports using Excel templates

NoKV ★ 510

The State Layer of Agent Sandbox

ReplicaDB ★ 504

ReplicaDB is open source tool for database replication, designed for efficiently transferring bulk data between relational and non-relational databases

Vemetric ★ 396

Simple, powerful web & product analytics for user insights

Lua.sh ★ 343

Professional link management for modern teams

Impler ★ 294

Seamless data import for your applications

invisible_selenium ★ 270

Selenium that anti-bots cannot see, so no captchas: same API, anti-detect stealth headless Firefox, undetected fingerprint, bypass bot detection, Python web scr

Betterlytics ★ 180

Privacy-first, cookieless analytics without consent banners

Prisme Analytics ★ 136

Privacy-friendly web analytics for data-driven decisions

HitKeep ★ 105

Privacy-first analytics you own completely

dsh-antibrow ★ 12

DeepSeek Harness plugin: give your agent a browser with a persistent identity - engine-level fingerprint spoofing, unlimited free local profiles, Android device