Incremental engine for long horizon agents 🌟 Star if you like it!
Created Mar 2025
Repositories
19
Total stars
32,782
Incremental engine for long horizon agents 🌟 Star if you like it!
Created Mar 2025
Open-source ETL/ELT you deploy on your own servers or cloud. Built on DuckDB: no-code/low-code visual pipelines or SQL, 437 components, dbt, CDC, data quality, reverse ETL, lineage, MCP for AI agents. No vendor cloud, no per-row billing.
Created May 2026
Event streaming platform for agentic AI. Continuously ingest, transform, and serve event streams in real time, at scale.
Created Jan 2022
Drop-in Apache Spark replacement written in Rust, unifying batch processing, stream processing, and compute-intensive AI workloads.
Created Dec 2023
Blazing-fast, Neuro-symbolic Data-Wrangling toolkit
Created Dec 2020
🌊 Continuously synchronize the systems where your data lives, to the systems where you _want_ it to live, by managing your data flows with Estuary. 🌊
Created Feb 2020
A SQL transformation engine that type-checks your whole pipeline and catches breaking changes before they run — branches, replay, column-level lineage, compile-time contracts, per-model cost. Adapters: Databricks, Snowflake, BigQuery, DuckDB. Single static Rust binary. Apache 2.0.
Created Apr 2026
ultra low latency graph based stream processing framework
Created Sep 2025
Incremental engine for long horizon agents 🌟 Star if you like it!
Created Mar 2025
Event streaming platform for agentic AI. Continuously ingest, transform, and serve event streams in real time, at scale.
Created Jan 2022
Blazing-fast, Neuro-symbolic Data-Wrangling toolkit
Created Dec 2020
Drop-in Apache Spark replacement written in Rust, unifying batch processing, stream processing, and compute-intensive AI workloads.
Created Dec 2023
Open-source ETL/ELT you deploy on your own servers or cloud. Built on DuckDB: no-code/low-code visual pipelines or SQL, 437 components, dbt, CDC, data quality, reverse ETL, lineage, MCP for AI agents. No vendor cloud, no per-row billing.
Created May 2026
🌊 Continuously synchronize the systems where your data lives, to the systems where you _want_ it to live, by managing your data flows with Estuary. 🌊
Created Feb 2020
A SQL transformation engine that type-checks your whole pipeline and catches breaking changes before they run — branches, replay, column-level lineage, compile-time contracts, per-model cost. Adapters: Databricks, Snowflake, BigQuery, DuckDB. Single static Rust binary. Apache 2.0.
Created Apr 2026
ultra low latency graph based stream processing framework
Created Sep 2025
Create and manage data pipes with Meerschaum.
Created Jul 2020
DataFrame / Data Engineering Library with familiar syntax like ones we love: PySpark and SQL, focused on user experience, spead and accuracy.
Created Dec 2024
High-throughput synthetic and pretraining dataset sifter for TypeSafe Jev. Rust streaming core, Parquet and JSONL I/O, typed Choice/Score/Noul judgments, speculative fan-out, 24.0 rows/sec measured.
Created Sep 2026
Fast, minimal, and ergonomic zero-copy Apache Arrow tabular data implementation in Rust, with PyO3, Python bindings, NdArray, XArray, shared-memory and low-latency SIMD for data-engineering and columnar workloads. Bridge to Polars and Arrow-rs over FFI effortlessly.
Created Aug 2025
A Minimalistic Rust Implementation of Delta Sharing Server.
Created Mar 2023
Stream PostgreSQL changes into standard Apache Iceberg tables, built in Rust.
Created Sep 2026
A robust (🐢) and fast (🐇) MLOps tool for managing data and pipelines in Rust (🦀)
Created Oct 2022
Incan: a modern, Pythonic language that compiles to Rust! Type-safe, async-friendly, with fixtures, testing, and web/inter-op built in.
Created Dec 2025
Move whole tables between databases fast — Postgres, MySQL, ClickHouse, BigQuery. Rust engine, one-line Python API, bounded memory.
Created Jul 2026
SQL transformation framework with custom compile-time checks, end-to-end testing and safe renames that keep your table history.
Created May 2026
Journeys between the two worlds of Python 🐍 and Rust 🦀
Created Dec 2023