Decision Workspace
mistralrs-kv-cache vs turboquant-rs vs ruvllm
Side-by-side comparison of Rust crates
52
mistralrs-kv-cache
experimentalv0.3.0
Trait interface for compressed KV-cache implementations in mistral.rs
49
turboquant-rs
experimentalv0.4.1
TurboQuant KV-Cache Quantization — 3-bit compression with zero accuracy loss (Zandieh et al., ICLR 2026)
59
ruvllm
experimentalv2.2.1
LLM serving runtime with Ruvector integration - Paged attention, KV cache, and SONA learning
Core Metrics
| mistralrs-kv-cache | turboquant-rs | ruvllm | |
|---|---|---|---|
| Health Score | 52 | 49 | 59 |
| Total Downloads | 230 | 271 | 16.1K |
| 30d Downloads | 0 | 0 | 8.6K |
| Dependents | 4 | 0 | 3 |
| Releases | 3 | 5 | 10 |
| Last Updated | 36d ago | 36d ago | 20d ago |
| Age | 1m | 1m | 5m |
Health Breakdown
mistralrs-kv-cache
Maintenance
12
Quality
14
Community
8
Popularity
3
Documentation
15
turboquant-rs
Maintenance
12
Quality
13
Community
6
Popularity
3
Documentation
15
ruvllm
Maintenance
19
Quality
15
Community
8
Popularity
5
Documentation
12
Technical Details
| mistralrs-kv-cache | turboquant-rs | ruvllm | |
|---|---|---|---|
| Version | 0.3.0 | 0.4.1 | 2.2.1 |
| Stable (≥1.0) | ✗ No | ✗ No | ✓ Yes |
| License | MIT OR Apache-2.0 | MIT OR Apache-2.0 | MIT |
| Dependencies | 1 | 9 | 44 |
| Crate Size | 17KB | 144KB | 1.2MB |
| Features | 0 | 4 | 25 |
| Yanked % | 0.0% | 0.0% | 0.0% |
| Edition | 2021 | 2021 | 2021 |
| MSRV | 1.75 | 1.75 | 1.77 |
| Owners | 1 | 1 | 1 |
Links
Quick Verdict
- •ruvllm leads with a health score of 59/100, but none of the options score above 80.
- •mistralrs-kv-cache, turboquant-rs are pre-1.0 — API may change.