Decision Workspace
tocken vs text-splitter vs torsh-text
Side-by-side comparison of Rust crates
40
tocken
growingv0.1.0
Clustering algorithms.
59
text-splitter
growingv0.29.3
Split text into semantic chunks, up to a desired chunk size. Supports calculating length by characters and tokens, and is callable from Rust and Python.
57
torsh-text
experimentalv0.1.1
Natural language processing utilities for ToRSh deep learning framework
Core Metrics
| tocken | text-splitter | torsh-text | |
|---|---|---|---|
| Health Score | 40 | 59 | 57 |
| Total Downloads | 3.9K | 1.1M | 573 |
| 30d Downloads | 215 | 113.6K | 65 |
| Dependents | 0 | 654 | 7 |
| Releases | 1 | 60 | 6 |
| Last Updated | 450d ago | 87d ago | 7d ago |
| Age | 1y 2m | 2y 10m | 5m |
Health Breakdown
tocken
Maintenance
2
Quality
13
Community
6
Popularity
4
Documentation
15
text-splitter
Maintenance
14
Quality
13
Community
13
Popularity
7
Documentation
12
torsh-text
Maintenance
20
Quality
11
Community
8
Popularity
3
Documentation
15
Technical Details
| tocken | text-splitter | torsh-text | |
|---|---|---|---|
| Version | 0.1.0 | 0.29.3 | 0.1.1 |
| Stable (≥1.0) | ✗ No | ✗ No | ✗ No |
| License | Apache-2.0 | MIT | Apache-2.0 |
| Dependencies | 9 | 21 | 23 |
| Crate Size | 15KB | 59KB | 636KB |
| Features | 0 | 4 | 2 |
| Yanked % | 0.0% | 1.7% | 0.0% |
| Edition | 2021 | 2021 | 2021 |
| MSRV | 1.78 | 1.83.0 | 1.77 |
| Owners | 1 | 1 | 1 |
Links
Quick Verdict
- •text-splitter leads with a health score of 59/100, but none of the options score above 80.
- •text-splitter is depended on by 654 crates — strongest ecosystem trust.
- •⚠ tocken has not been updated in over a year.