rustio rustio.net
62

text-splitter

v0.30.1 Growing

Split text into semantic chunks, up to a desired chunk size. Supports calculating length by characters and tokens, and is callable from Rust and Python.

MIT Edition 2021 MSRV 1.86.0
Text processing #text#ai#tokenizer#nlp#split

Quick Verdict

  • โœ“Actively maintained (updated 38d ago)
  • !Pre-1.0: API may have breaking changes
  • โœ“Trusted by 782 crates
  • !Heavy dependency tree (21 direct deps)
  • โœ“Permissive license (MIT)

Security

Checking security advisories...
Downloads
1.4M
Dependents
782
Releases
62
Size
60KB

Deep Insights

๐Ÿ“ˆ
Strong growth momentum

153.4K downloads in the last 30 days (5.1K/day), up 45% from the previous period.

๐Ÿ”—
Moderate adoption

782 crates depend on text-splitter. Reasonable ecosystem adoption, though not yet a core dependency.

๐Ÿ”ฌ
Pre-1.0 for over a year

Despite being 3+ years old, text-splitter hasn't reached 1.0 yet. Expect potential API changes between versions.

๐Ÿ“ฆ
Heavy dependency tree

21 direct dependencies. Consider the impact on compile times and supply chain complexity.

๐ŸŒŸ
Used by top crates

Notable dependents include ollama-rs, langchain-rust, llama-core, swiftide-indexing, annatto. When high-quality crates choose text-splitter, it's a strong quality signal.

Health Breakdown

Maintenance 17/25

Recency, release consistency, active ratio

Quality 13/25

Yanked ratio, deps, size, maturity, features

Community 13/20

Reverse deps, ownership, ecosystem

Popularity 7/15

Downloads, momentum, growth trend

Documentation 12/15

Docs, repo, license, metadata

Download Trend

Daily downloads ยท last 90 days
4K/day avg+36%
02K4K6K8K2/263/164/34/215/95/26

Top Dependents

Version Adoption

v0.27.0
48%
v0.25.1
19%
v0.29.3
17%
v0.28.0
12%
v0.26.0
3%

Release Timeline

10 releasessince 2025
J
F
M
A
M
J
J
A
S
O
N
D
2025
8
2026
2
Less
More

Feature Flags

codemarkdowntokenizerstiktoken-rs

README

Loading README...

Maintainers

Dependencies
21
direct dependencies
Dependents
782
crates depend on text-splitter

Similar Crates