GitHub topics

big-data

10% of these repos are in Data processing, 10% in Kubernetes and Containers.

Repositories

19

Total stars

38,143

Trending

lakehq

Drop-in Apache Spark replacement written in Rust, unifying batch processing, stream processing, and compute-intensive AI workloads.

Created Dec 2023

apache-iceberg apache-spark arrow artificial-intelligence big-data
Total3,503
30 days +46
apache

Apache Paimon Rust The rust implementation of Apache Paimon.

Created Jul 2024

big-data data-ingestion paimon real-time-analytics rust
Total215
30 days +10
matanolabs

Open source security data lake for threat hunting, detection & response, and cybersecurity analytics at petabyte scale on AWS

Created Jul 2022

alerting apache-iceberg aws aws-security big-data
Total1,708
30 days +9

Top

lakehq

Drop-in Apache Spark replacement written in Rust, unifying batch processing, stream processing, and compute-intensive AI workloads.

Created Dec 2023

apache-iceberg apache-spark arrow artificial-intelligence big-data
Total3,503
matanolabs

Open source security data lake for threat hunting, detection & response, and cybersecurity analytics at petabyte scale on AWS

Created Jul 2022

alerting apache-iceberg aws aws-security big-data
Total1,708
apache

Apache Paimon Rust The rust implementation of Apache Paimon.

Created Jul 2024

big-data data-ingestion paimon real-time-analytics rust
Total215
CortexFlow

CortexBrain is an ambitious open-source project designed to build an intelligent, lightweight, and highly efficient monitoring platform for distributed cloud and hybrid (cloud-edge) workflows

Created Aug 2024

big-data bpf-programs cluster-analysis cluster-monitoring-tool devops
Total96
stackabletech

Kubernetes operator for Apache Hadoop HDFS. Deploy and run HDFS NameNodes, DataNodes and JournalNodes with the Stackable Data Platform (SDP).

Created Sep 2021

apache-hadoop big-data data-platform hadoop hdfs
Total53

Related

All topics →