Categories / Artificial Intelligence
Ready-made tokenizer library for working with GPT and tiktoken
Created
Feb 2023
Total stars
412
Last 7 days
+1
Last 30 days
+4
Last 12 months
+70
Used by crates
Downloads, 90 days
README badge
[](https://rustystars.dev/zurawiki/tiktoken-rs)