rustio rustio.net
59

text-splitter

v0.29.3 Growing

Split text into semantic chunks, up to a desired chunk size. Supports calculating length by characters and tokens, and is callable from Rust and Python.

MIT Edition 2021 MSRV 1.83.0
Text processing #text#ai#tokenizer#nlp#split

Quick Verdict

  • โœ“Actively maintained (updated 87d ago)
  • !Pre-1.0: API may have breaking changes
  • โœ“Trusted by 654 crates
  • !Heavy dependency tree (21 direct deps)
  • โœ“Permissive license (MIT)

Security

Checking security advisories...
Downloads
1.1M
Dependents
654
Releases
60
Size
59KB

Deep Insights

๐Ÿ“Š
Steady growth

117.1K downloads in the last 30 days (3.9K/day), up 19% from the previous period.

๐Ÿ”—
Moderate adoption

654 crates depend on text-splitter. Reasonable ecosystem adoption, though not yet a core dependency.

๐Ÿ”ฌ
Pre-1.0 for over a year

Despite being 2+ years old, text-splitter hasn't reached 1.0 yet. Expect potential API changes between versions.

๐Ÿ“ฆ
Heavy dependency tree

21 direct dependencies. Consider the impact on compile times and supply chain complexity.

๐ŸŒŸ
Used by top crates

Notable dependents include ollama-rs, langchain-rust, llama-core, swiftide-indexing, annatto. When high-quality crates choose text-splitter, it's a strong quality signal.

Health Breakdown

Maintenance 14/25

Recency, release consistency, active ratio

Quality 13/25

Yanked ratio, deps, size, maturity, features

Community 13/20

Reverse deps, ownership, ecosystem

Popularity 7/15

Downloads, momentum, growth trend

Documentation 12/15

Docs, repo, license, metadata

Download Trend

Daily downloads ยท last 90 days
3K/day avg+25%
02K4K6K12/291/162/32/213/113/28

Top Dependents

Version Adoption

v0.27.0
50%
v0.25.1
20%
v0.29.3
12%
v0.28.0
9%
v0.16.1
9%

Release Timeline

60 releases1 yankedsince 2023
J
F
M
A
M
J
J
A
S
O
N
D
2023
13
2024
31
2025
16
2026
Less
More|
Yanked

Feature Flags

codemarkdowntokenizerstiktoken-rs

README

Loading README...

Maintainers

Dependencies
21
direct dependencies
Dependents
654
crates depend on text-splitter

Similar Crates