GitHub topics

cuda

19% of these repos are in Artificial Intelligence, 19% in LLM Infrastructure.

Repositories

56

Total stars

61,227

Trending

NVIDIA

NVIDIA's CUDA platform for Rust. Host runtime crates plus Tile (cutile-rs) and SIMT (cuda-oxide) kernel programming models in idiomatic Rust.

Created Apr 2026

async compiler-backend cuda gpu heterogeneous-computing
Total4,072
30 days +335
RustingStudio

Pure-Rust inference engine for Qwen GGUF models (Qwen3 to Qwen3.8, dense and MoE up to 770B+). CUDA and Vulkan (NVIDIA, AMD), hybrid CPU+GPU experts, MTP speculative decoding, OpenAI and Anthropic compatible server. Up to ~1.7x llama.cpp decode on a 12 GB RTX 3060.

Created Oct 2026

anthropic-api cuda gguf inference llama-cpp
Total294
30 days +286
tracel-ai

Burn is a next generation tensor library and Deep Learning Framework that doesn't compromise on flexibility, efficiency and portability.

Created Jul 2022

autodiff cross-platform cuda deep-learning kernel-fusion
Total16,307
30 days +202
vosen

CUDA on non-NVIDIA GPUs

Created Jan 2020

cuda rust
Total15,219
30 days +134
tracel-ai

Multi-platform high-performance compute language extension for Rust.

Created Jun 2024

cuda gpgpu gpu jit linalg
Total2,506
30 days +66
ultralytics

High-performance Ultralytics YOLO inference in Rust with ONNX Runtime, GPU backends, CLI, and WebGPU/WASM.

Created Nov 2025

cli computer-vision coreml cuda depth-estimation
Total225
30 days +27
Rust-GPU

Ecosystem of libraries and tools for writing and executing fast GPU code fully in Rust.

Created Oct 2021

cuda cuda-kernels cuda-programming gpgpu gpu
Total5,431
30 days +27

Top

Top 50 of 56

tracel-ai

Burn is a next generation tensor library and Deep Learning Framework that doesn't compromise on flexibility, efficiency and portability.

Created Jul 2022

autodiff cross-platform cuda deep-learning kernel-fusion
Total16,307
vosen

CUDA on non-NVIDIA GPUs

Created Jan 2020

cuda rust
Total15,219
Rust-GPU

Ecosystem of libraries and tools for writing and executing fast GPU code fully in Rust.

Created Oct 2021

cuda cuda-kernels cuda-programming gpgpu gpu
Total5,431
NVIDIA

NVIDIA's CUDA platform for Rust. Host runtime crates plus Tile (cutile-rs) and SIMT (cuda-oxide) kernel programming models in idiomatic Rust.

Created Apr 2026

async compiler-backend cuda gpu heterogeneous-computing
Total4,072
apache

Apache Mahout - an environment for quickly creating scalable, performant machine learning applications.

Created May 2014

apache-mahout cuda python qumat qumat-qdp
Total2,312
chelsea0x3b

Deep learning in Rust, with shape checked tensors and neural networks

Created Oct 2021

autodiff autodifferentiation autograd backpropagation cuda
Total1,943
chelsea0x3b

Safe rust wrapper around CUDA toolkit

Created Sep 2022

cublas cuda cuda-kernels cuda-programming cuda-toolkit
Total1,244
fff-rs

The Hacker's Machine Learning Engine

Created Jan 2017

agnostic coaster cuda extinsible framework
Total1,128
NVlabs

cuTile Rust provides a safe, tile-based kernel programming DSL for the Rust programming language. It features a safe host-side API for passing tensors to asynchronously executed kernel functions.

Created Mar 2026

Total1,051
LegNeato

Demo project showing a single Rust codebase running on CPU and directly on GPUs

Created Jul 2025

cuda gpu rust rust-cuda rust-gpu
Total506
jamjamjon

A Rust library integrated with ONNXRuntime, providing a collection of Computer Vison and Vision-Language models such as YOLO, FastVLM, and more.

Created Mar 2024

cuda florence2 grounding-dino imshow ocr
Total447
RustingStudio

Pure-Rust inference engine for Qwen GGUF models (Qwen3 to Qwen3.8, dense and MoE up to 770B+). CUDA and Vulkan (NVIDIA, AMD), hybrid CPU+GPU experts, MTP speculative decoding, OpenAI and Anthropic compatible server. Up to ~1.7x llama.cpp decode on a 12 GB RTX 3060.

Created Oct 2026

anthropic-api cuda gguf inference llama-cpp
Total294
giannisanni

SSD-streaming inference engine for giant MoE models (Rust + CUDA). GLM 5.2 743B at 2 tok/s and Hy3 295B at 7 tok/s on two consumer 16GB GPUs. Zero-config multi-GPU: measures PCIe bandwidth, places attention and hot experts where they fit.

Created Jul 2026

Total239
helyim

seaweedfs implemented in pure Rust

Created Aug 2023

cuda dpdk erasure-coding hdfs iouring
Total211
rust-dd

High-performance quantitative finance in Rust and Python — 130+ stochastic processes, option pricing, calibration, fixed income, risk & copulas, with SIMD/GPU acceleration.

Created May 2023

black-scholes calibration copulas cuda derivatives-pricing
Total201
ferrumox

A local LLM server built for concurrent work. Drop-in replacement for Ollama and/or OpenAI and Ollama APIs on one port. Requests that share a prompt reuse each other's KV cache instead of each prefilling it. Rust, wrapping llama.cpp.

Created Mar 2026

Total191
avencera

Speaker diarization in Rust with pyannote-level accuracy. 1790–5970x realtime on NVIDIA GPUs, 430–910x on Apple Silicon.

Created Mar 2026

audio coreml cuda diarization metal
Total191
truespar

Native Rust inference server for open models on NVIDIA and Apple Silicon. OpenAI- and Anthropic-compatible APIs, GGUF + safetensors + MLX, FP8/NVFP4/MXFP4/Q8/Q4, built-in Studio

Created Sep 2026

ai aimodels blackwell cuda inference
Total165
abyo-software

GPU-accelerated transparent compression S3-compatible storage gateway. Drop-in replacement for AWS S3 endpoints; cuts your S3 bill 50-80% with no app changes (Rust, nvCOMP, zstd).

Created May 2026

apache-2 aws-s3 compression cost-optimization cuda
Total159
cool-japan

OxiCUDA replaces the entire NVIDIA CUDA Toolkit software stack with type-safe, memory-safe Rust code.

Created Apr 2026

cuda cuda-programming nvidia nvidia-gpu pure-rust
Total145
MWATelescope

Calibration software for the Murchison Widefield Array (MWA) radio telescope

Created Mar 2020

astronomy cuda mwa radio-astronomy rust
Total138
AnicetNgrt

A Deep Learning and preprocessing framework in Rust with support for CPU and GPU.

Created Mar 2023

adam classification cuda data-analysis deep-learning
Total130
Sparticle62ops

PSSA: a non-transformer language model written from scratch in Rust. Recurrent state-space layer, episodic memory, self-modifying weights, CUDA training, and a full terminal dashboard.

Created Aug 2026

cuda language-model machine-learning rust state-space-model
Total120
H4V1K-dev

Neuromorphic Computing Engine. SNN AI Architecture base from biology

Created Feb 2026

agi biological-neural-networks computational-neuroscience cuda embodied-ai
Total96
fff-rs

Extendable HPC-Framework for CUDA, OpenCL and common CPU

Created Jan 2017

cuda framework hpc opencl
Total85
elftausend

A minimal OpenCL, CUDA, Vulkan and host CPU array manipulation engine / framework.

Created Mar 2022

array-manipulations autograd automatic-differentiation cpu cuda
Total78
gpillon

An inference engine for NVIDIA RTX card card family, built for a coding agent and its subagents, and a companion that listens, reads and draws: Qwen3.8 27B and 125B Flash-Next MoE, Qwen-Image-2.1, Qwen3-ASR on the CPU. OpenAI-compatible API and Playground in one binary.

Created Sep 2026

Total67
seekbytes

Binary Ninja plugin for reverse engineering PTX -- the virtual instruction set architecture of CUDA-based GPUs.

Created Mar 2026

binaryninja cuda decompilation ptx seekbytes-ptxninja-41d6b9de
Total65
bokutotu

A Deep Learning framework with very few dependencies, Written in Rust

Created Nov 2023

ai autograd blas cublas cuda
Total65

Related

All topics →