Decision Workspace
xet-runtime vs safetensors vs tokenizers
Side-by-side comparison of Rust crates
56
xet-runtime
experimentalv1.5.2
Async runtime, configuration, logging, and utility infrastructure for the Hugging Face Xet client tools.
67
safetensors
growingv0.7.0
Provides functions to read and write safetensors which aim to be safer than their PyTorch counterpart. The format is 8 bytes which is an unsized int, being the size of a JSON header, the JSON header refers the `dtype` the `shape` and `data_offsets` which are the offsets for the values in the rest of the file.
64
tokenizers
growingv0.23.1
Provides an implementation of today's most used tokenizers, with a focus on performances and versatility.
Core Metrics
| xet-runtime | safetensors | tokenizers | |
|---|---|---|---|
| Health Score | 56 | 67 | 64 |
| Total Downloads | 125.9K | 14.2M | 17.0M |
| 30d Downloads | 100.3K | 1.8M | 2.5M |
| Dependents | 12 | 2.1K | 5.5K |
| Releases | 4 | 21 | 40 |
| Last Updated | 35d ago | 187d ago | 28d ago |
| Age | 1m | 3y 5m | 6y 9m |
Health Breakdown
xet-runtime
Maintenance
12
Quality
15
Community
13
Popularity
6
Documentation
10
safetensors
Maintenance
14
Quality
16
Community
14
Popularity
8
Documentation
15
tokenizers
Maintenance
16
Quality
12
Community
16
Popularity
8
Documentation
12
Technical Details
| xet-runtime | safetensors | tokenizers | |
|---|---|---|---|
| Version | 1.5.2 | 0.7.0 | 0.23.1 |
| Stable (≥1.0) | ✓ Yes | ✗ No | ✗ No |
| License | Apache-2.0 | Apache-2.0 | Apache-2.0 |
| Dependencies | 40 | 6 | 33 |
| Crate Size | 113KB | 31KB | 196KB |
| Features | 8 | 3 | 6 |
| Yanked % | 0.0% | 0.0% | 2.5% |
| Edition | 2024 | 2021 | 2018 |
| MSRV | — | 1.80 | — |
| Owners | 3 (team) | 2 | 4 |
Links
Quick Verdict
- •safetensors leads with a health score of 67/100, but none of the options score above 80.
- •tokenizers has the most downloads (17.0M), suggesting wider adoption.
- •tokenizers is depended on by 5.5K crates — strongest ecosystem trust.
- •safetensors, tokenizers are pre-1.0 — API may change.