Categories / Artificial Intelligence

zurawiki

zurawiki/tiktoken-rs

Ready-made tokenizer library for working with GPT and tiktoken

Last push 1 month ago

Created

Feb 2023

Total stars

412

Last 7 days

+1

Last 30 days

+4

Last 12 months

+70

Used by crates

483

Downloads, 90 days

11,712,688

README badge

Rusty Stars badge for zurawiki/tiktoken-rs
[![Rusty Stars](https://rustystars.dev/badge/zurawiki/tiktoken-rs.svg)](https://rustystars.dev/zurawiki/tiktoken-rs)