Decision Workspace
tocken vs text-splitter vs torsh-text
Side-by-side comparison of Rust crates
40
tocken
growingv0.1.0
Clustering algorithms.
62
text-splitter
growingv0.30.1
Split text into semantic chunks, up to a desired chunk size. Supports calculating length by characters and tokens, and is callable from Rust and Python.
58
torsh-text
experimentalv0.1.2
Natural language processing utilities for ToRSh deep learning framework
Core Metrics
| tocken | text-splitter | torsh-text | |
|---|---|---|---|
| Health Score | 40 | 62 | 58 |
| Total Downloads | 4.2K | 1.4M | 650 |
| 30d Downloads | 0 | 150.5K | 0 |
| Dependents | 0 | 782 | 8 |
| Releases | 1 | 62 | 7 |
| Last Updated | 509d ago | 38d ago | 29d ago |
| Age | 1y 4m | 3y | 7m |
Health Breakdown
tocken
Maintenance
2
Quality
13
Community
6
Popularity
4
Documentation
15
text-splitter
Maintenance
17
Quality
13
Community
13
Popularity
7
Documentation
12
torsh-text
Maintenance
20
Quality
11
Community
9
Popularity
3
Documentation
15
Technical Details
| tocken | text-splitter | torsh-text | |
|---|---|---|---|
| Version | 0.1.0 | 0.30.1 | 0.1.2 |
| Stable (≥1.0) | ✗ No | ✗ No | ✗ No |
| License | Apache-2.0 | MIT | Apache-2.0 |
| Dependencies | 9 | 21 | 23 |
| Crate Size | 15KB | 60KB | 639KB |
| Features | 0 | 4 | 2 |
| Yanked % | 0.0% | 1.6% | 0.0% |
| Edition | 2021 | 2021 | 2021 |
| MSRV | 1.78 | 1.86.0 | 1.77 |
| Owners | 1 | 1 | 1 |
Links
Quick Verdict
- •text-splitter leads with a health score of 62/100, but none of the options score above 80.
- •text-splitter is depended on by 782 crates — strongest ecosystem trust.
- •⚠ tocken has not been updated in over a year.