rustio rustio.net

language-model-type vs minbpe vs tiktoken-rs

Side-by-side comparison of Rust crates

Core Metrics

language-model-typeminbpetiktoken-rs
Health Score453265
Total Downloads23.0K1.8K20.2M
30d Downloads000
Dependents1708.7K
Releases6136
Last Updated313d ago915d ago15d ago
Age1y 6m2y 6m3y 8m

Health Breakdown

language-model-type
Maintenance
8
Quality
13
Community
9
Popularity
5
Documentation
10
minbpe
Maintenance
1
Quality
14
Community
3
Popularity
4
Documentation
10
tiktoken-rs
Maintenance
18
Quality
12
Community
12
Popularity
8
Documentation
15

Technical Details

language-model-typeminbpetiktoken-rs
Version0.1.50.1.00.12.1
Stable (≥1.0)✗ No✗ No✗ No
LicenseMITMIT OR Apache-2.0MIT
Dependencies888
Crate Size28KB856KB3.8MB
Features052
Yanked %0.0%0.0%0.0%
Edition202420212024
MSRV——1.85.0
Owners111

Quick Verdict

  • •tiktoken-rs leads with a health score of 65/100, but none of the options score above 80.
  • •tiktoken-rs is depended on by 8.7K crates — strongest ecosystem trust.
  • •⚠ minbpe has not been updated in over a year.