Decision Workspace
language-model-type vs minbpe vs tiktoken-rs
Side-by-side comparison of Rust crates
49
language-model-type
experimentalv0.1.5
A Rust crate providing an enumeration for various language model types used in machine learning applications, enabling precise model specification through enums.
32
minbpe
growingv0.1.0
Port of Andrej Karpathy's minbpe to Rust
59
tiktoken-rs
growingv0.9.1
Library for encoding and decoding with the tiktoken library in Rust
Core Metrics
| language-model-type | minbpe | tiktoken-rs | |
|---|---|---|---|
| Health Score | 49 | 32 | 59 |
| Total Downloads | 15.4K | 1.8K | 5.3M |
| 30d Downloads | 1.5K | 5 | 848.2K |
| Dependents | 17 | 0 | 3.8K |
| Releases | 6 | 1 | 32 |
| Last Updated | 117d ago | 719d ago | 138d ago |
| Age | 12m | 1y 11m | 3y 1m |
Health Breakdown
language-model-type
Maintenance
13
Quality
12
Community
9
Popularity
5
Documentation
10
minbpe
Maintenance
1
Quality
14
Community
3
Popularity
4
Documentation
10
tiktoken-rs
Maintenance
12
Quality
12
Community
12
Popularity
8
Documentation
15
Technical Details
| language-model-type | minbpe | tiktoken-rs | |
|---|---|---|---|
| Version | 0.1.5 | 0.1.0 | 0.9.1 |
| Stable (≥1.0) | ✗ No | ✗ No | ✗ No |
| License | MIT | MIT OR Apache-2.0 | MIT |
| Dependencies | 8 | 8 | 9 |
| Crate Size | 28KB | 856KB | 3.8MB |
| Features | 0 | 5 | 2 |
| Yanked % | 0.0% | 0.0% | 0.0% |
| Edition | 2024 | 2021 | 2021 |
| MSRV | — | — | 1.61.0 |
| Owners | 1 | 1 | 1 |
Links
Quick Verdict
- •tiktoken-rs leads with a health score of 59/100, but none of the options score above 80.
- •tiktoken-rs is depended on by 3.8K crates — strongest ecosystem trust.
- •⚠ minbpe has not been updated in over a year.