Decision Workspace
language-model-type vs minbpe vs tiktoken-rs
Side-by-side comparison of Rust crates
45
language-model-type
growingv0.1.5
A Rust crate providing an enumeration for various language model types used in machine learning applications, enabling precise model specification through enums.
32
minbpe
growingv0.1.0
Port of Andrej Karpathy's minbpe to Rust
65
tiktoken-rs
growingv0.12.1
Library for encoding and decoding with the tiktoken library in Rust
Core Metrics
| language-model-type | minbpe | tiktoken-rs | |
|---|---|---|---|
| Health Score | 45 | 32 | 65 |
| Total Downloads | 23.0K | 1.8K | 20.2M |
| 30d Downloads | 0 | 0 | 0 |
| Dependents | 17 | 0 | 8.7K |
| Releases | 6 | 1 | 36 |
| Last Updated | 313d ago | 915d ago | 15d ago |
| Age | 1y 6m | 2y 6m | 3y 8m |
Health Breakdown
language-model-type
Maintenance
8
Quality
13
Community
9
Popularity
5
Documentation
10
minbpe
Maintenance
1
Quality
14
Community
3
Popularity
4
Documentation
10
tiktoken-rs
Maintenance
18
Quality
12
Community
12
Popularity
8
Documentation
15
Technical Details
| language-model-type | minbpe | tiktoken-rs | |
|---|---|---|---|
| Version | 0.1.5 | 0.1.0 | 0.12.1 |
| Stable (≥1.0) | ✗ No | ✗ No | ✗ No |
| License | MIT | MIT OR Apache-2.0 | MIT |
| Dependencies | 8 | 8 | 8 |
| Crate Size | 28KB | 856KB | 3.8MB |
| Features | 0 | 5 | 2 |
| Yanked % | 0.0% | 0.0% | 0.0% |
| Edition | 2024 | 2021 | 2024 |
| MSRV | — | — | 1.85.0 |
| Owners | 1 | 1 | 1 |
Links
Quick Verdict
- •tiktoken-rs leads with a health score of 65/100, but none of the options score above 80.
- •tiktoken-rs is depended on by 8.7K crates — strongest ecosystem trust.
- •⚠ minbpe has not been updated in over a year.