Decision Workspace
mistralrs-kv-cache vs turboquant-rs vs oxibonsai-model
Side-by-side comparison of Rust crates
54
mistralrs-kv-cache
experimentalv0.3.0
Trait interface for compressed KV-cache implementations in mistral.rs
53
turboquant-rs
experimentalv0.4.1
TurboQuant KV-Cache Quantization — 3-bit compression with zero accuracy loss (Zandieh et al., ICLR 2026)
59
oxibonsai-model
experimentalv0.2.2
Qwen3-8B Transformer implementation for OxiBonsai 1-bit inference
Core Metrics
| mistralrs-kv-cache | turboquant-rs | oxibonsai-model | |
|---|---|---|---|
| Health Score | 54 | 53 | 59 |
| Total Downloads | 287 | 1.4K | 669 |
| 30d Downloads | 0 | 248 | 0 |
| Dependents | 4 | 1 | 36 |
| Releases | 3 | 5 | 9 |
| Last Updated | 85d ago | 85d ago | 35d ago |
| Age | 3m | 3m | 3m |
Health Breakdown
mistralrs-kv-cache
Maintenance
14
Quality
14
Community
8
Popularity
3
Documentation
15
turboquant-rs
Maintenance
14
Quality
13
Community
7
Popularity
4
Documentation
15
oxibonsai-model
Maintenance
18
Quality
13
Community
10
Popularity
3
Documentation
15
Technical Details
| mistralrs-kv-cache | turboquant-rs | oxibonsai-model | |
|---|---|---|---|
| Version | 0.3.0 | 0.4.1 | 0.2.2 |
| Stable (≥1.0) | ✗ No | ✗ No | ✗ No |
| License | MIT OR Apache-2.0 | MIT OR Apache-2.0 | Apache-2.0 |
| Dependencies | 1 | 9 | 14 |
| Crate Size | 17KB | 144KB | 432KB |
| Features | 0 | 4 | 3 |
| Yanked % | 0.0% | 0.0% | 0.0% |
| Edition | 2021 | 2021 | 2021 |
| MSRV | 1.75 | 1.75 | 1.86 |
| Owners | 1 | 1 | 1 |
Links
Quick Verdict
- •oxibonsai-model leads with a health score of 59/100, but none of the options score above 80.
- •turboquant-rs has the most downloads (1.4K), suggesting wider adoption.