Decision Workspace
mistralrs-kv-cache vs turboquant-rs vs ruvllm
Side-by-side comparison of Rust crates
51
mistralrs-kv-cache
experimentalv0.3.0
Trait interface for compressed KV-cache implementations in mistral.rs
51
turboquant-rs
experimentalv0.4.1
TurboQuant KV-Cache Quantization — 3-bit compression with zero accuracy loss (Zandieh et al., ICLR 2026)
62
ruvllm
growingv2.5.0
LLM serving runtime with Ruvector integration - Paged attention, KV cache, and SONA learning
Core Metrics
| mistralrs-kv-cache | turboquant-rs | ruvllm | |
|---|---|---|---|
| Health Score | 51 | 51 | 62 |
| Total Downloads | 531 | 5.4K | 54.1K |
| 30d Downloads | 0 | 0 | 0 |
| Dependents | 4 | 5 | 7 |
| Releases | 3 | 5 | 13 |
| Last Updated | 173d ago | 173d ago | 1d ago |
| Age | 6m | 6m | 10m |
Health Breakdown
mistralrs-kv-cache
Maintenance
11
Quality
14
Community
8
Popularity
3
Documentation
15
turboquant-rs
Maintenance
11
Quality
13
Community
8
Popularity
4
Documentation
15
ruvllm
Maintenance
20
Quality
16
Community
8
Popularity
6
Documentation
12
Technical Details
| mistralrs-kv-cache | turboquant-rs | ruvllm | |
|---|---|---|---|
| Version | 0.3.0 | 0.4.1 | 2.5.0 |
| Stable (≥1.0) | ✗ No | ✗ No | ✓ Yes |
| License | MIT OR Apache-2.0 | MIT OR Apache-2.0 | MIT |
| Dependencies | 1 | 9 | 46 |
| Crate Size | 17KB | 144KB | 1.3MB |
| Features | 0 | 4 | 29 |
| Yanked % | 0.0% | 0.0% | 0.0% |
| Edition | 2021 | 2021 | 2021 |
| MSRV | 1.75 | 1.75 | 1.77 |
| Owners | 1 | 1 | 1 |
Links
Quick Verdict
- •ruvllm leads with a health score of 62/100, but none of the options score above 80.
- •mistralrs-kv-cache, turboquant-rs are pre-1.0 — API may change.