Categories / Text processing (Libraries)

benbrandt

benbrandt/text-splitter

Split text into semantic chunks, up to a desired chunk size. Supports calculating length by characters and tokens, and is callable from Rust and Python.

Last push 34 minutes ago

Created

Apr 2023

Total stars

643

Last 7 days

0

Last 30 days

+10

Last 12 months

+133

Used by crates

64

Downloads, 90 days

826,266

README badge

Rusty Stars badge for benbrandt/text-splitter
[![Rusty Stars](https://rustystars.dev/badge/benbrandt/text-splitter.svg)](https://rustystars.dev/benbrandt/text-splitter)