rustio rustio.net
62

text-splitter

v0.32.0 Growing

Split text into semantic chunks, up to a desired chunk size. Supports calculating length by characters and tokens, and is callable from Rust and Python.

MIT Edition 2021 MSRV 1.86.0
Text processing #text#ai#tokenizer#nlp#split

Quick Verdict

  • โœ“Actively maintained (updated 27d ago)
  • !Pre-1.0: API may have breaking changes
  • โœ“Trusted by 908 crates
  • !Heavy dependency tree (21 direct deps)
  • โœ“Permissive license (MIT)

Security

Checking security advisories...
Downloads
1.7M
Dependents
908
Releases
64
Size
63KB

Deep Insights

๐Ÿ“Š
Steady growth

189.5K downloads in the last 30 days (6.3K/day), up 4% from the previous period.

๐Ÿ”—
Moderate adoption

908 crates depend on text-splitter. Reasonable ecosystem adoption, though not yet a core dependency.

๐Ÿ”ฌ
Pre-1.0 for over a year

Despite being 3+ years old, text-splitter hasn't reached 1.0 yet. Expect potential API changes between versions.

๐Ÿ“ฆ
Heavy dependency tree

21 direct dependencies. Consider the impact on compile times and supply chain complexity.

๐ŸŒŸ
Used by top crates

Notable dependents include ollama-rs, langchain-rust, llama-core, kreuzberg, swiftide-indexing. When high-quality crates choose text-splitter, it's a strong quality signal.

Health Breakdown

Maintenance 17/25

Recency, release consistency, active ratio

Quality 13/25

Yanked ratio, deps, size, maturity, features

Community 13/20

Reverse deps, ownership, ecosystem

Popularity 7/15

Downloads, momentum, growth trend

Documentation 12/15

Docs, repo, license, metadata

Download Trend

Daily downloads ยท last 90 days
5K/day avg-24%
02K4K6K8K10K4/265/146/16/197/77/24

Top Dependents

Version Adoption

v0.27.0
52%
v0.29.3
20%
v0.28.0
19%
v0.30.1
8%
v0.31.0
1%

Release Timeline

10 releasessince 2025
J
F
M
A
M
J
J
A
S
O
N
D
2025
6
2026
4
Less
More

Feature Flags

codemarkdowntokenizerstiktoken-rs

README

Loading README...

Maintainers

Dependencies
21
direct dependencies
Dependents
908
crates depend on text-splitter

Similar Crates