rustio rustio.net

nipah_tokenizer vs toklen vs text-splitter

Side-by-side comparison of Rust crates

Core Metrics

nipah_tokenizertoklentext-splitter
Health Score344264
Total Downloads1.6K402.4M
30d Downloads000
Dependents001.0K
Releases1265
Last Updated1364d ago84d ago16d ago
Age3y 8m2m3y 5m

Health Breakdown

nipah_tokenizer
Maintenance
1
Quality
15
Community
6
Popularity
4
Documentation
8
toklen
Maintenance
9
Quality
16
Community
3
Popularity
2
Documentation
12
text-splitter
Maintenance
18
Quality
13
Community
13
Popularity
8
Documentation
12

Technical Details

nipah_tokenizertoklentext-splitter
Version0.1.00.2.00.33.0
Stable (≥1.0)✗ No✗ No✗ No
Licensenon-standardMIT OR Apache-2.0MIT
Dependencies2920
Crate Size7KB35KB62KB
Features0244
Yanked %0.0%0.0%1.5%
Edition202120242021
MSRV—1.851.90.0
Owners111

Quick Verdict

  • •text-splitter leads with a health score of 64/100, but none of the options score above 80.
  • •text-splitter is depended on by 1.0K crates — strongest ecosystem trust.
  • •⚠ nipah_tokenizer has not been updated in over a year.