scientist-labs/red-candle
Ruby gem for running state-of-the-art language models locally. Access LLMs, embeddings, rerankers, and NER models directly from Ruby using Rust-powered Candle with Metal/CUDA acceleration.
Created
Aug 2023
Total stars
204
Last 7 days
0
Last 30 days
0
Last 12 months
+23
README badge
[](https://rustystars.dev/scientist-labs/red-candle)