Decision Workspace
candle-fused-attn vs baracuda-flashinfer-sys vs baracuda-flashinfer
Side-by-side comparison of Rust crates
Fused fp32 scaled-dot-product attention for candle, forward AND backward: the FlashAttention-2 algorithm in plain fp32, a bit-reproducible backward, over stock candle.
Raw C-ABI FFI surface for the vendored FlashInfer inference kernels (paged-KV decode, paged-KV append, cascade state merge, sort-free sampling). The launcher shims + vendored FlashInfer sources are compiled by `baracuda-kernels-sys`; this crate is a thin re-export facade so the FlashInfer C-ABI is reachable under its own crate name. Apache-2.0 (FlashInfer upstream) — see `crates/baracuda-kernels-sys/vendor/flashinfer/`.
Safe, typed Rust wrappers for NVIDIA FlashInfer's inference-serving kernels: batched paged-KV attention decode, decode-time KV-cache append, cascade / prefix-cache attention-state merge, and sort-free top-K / top-P / min-P sampling. The canonical vLLM-style serving surface for the baracuda CUDA stack. Apache-2.0 (FlashInfer upstream).
Core Metrics
| candle-fused-attn | baracuda-flashinfer-sys | baracuda-flashinfer | |
|---|---|---|---|
| Health Score | 57 | 57 | 53 |
| Total Downloads | 60 | 509 | 394 |
| 30d Downloads | 0 | 0 | 0 |
| Dependents | 0 | 19 | 0 |
| Releases | 4 | 19 | 19 |
| Last Updated | 4d ago | 3d ago | 2d ago |
| Age | 7d | 4m | 4m |
Health Breakdown
Technical Details
| candle-fused-attn | baracuda-flashinfer-sys | baracuda-flashinfer | |
|---|---|---|---|
| Version | 0.4.0 | 0.0.1-alpha.86 | 0.0.1-alpha.86 |
| Stable (≥1.0) | ✗ No | ✗ No | ✗ No |
| License | MIT OR Apache-2.0 | MIT OR Apache-2.0 | MIT OR Apache-2.0 |
| Dependencies | 2 | 1 | 5 |
| Crate Size | 152KB | 11KB | 24KB |
| Features | 2 | 2 | 2 |
| Yanked % | 0.0% | 0.0% | 0.0% |
| Edition | 2024 | 2024 | 2024 |
| MSRV | 1.88 | — | — |
| Owners | 1 | 1 | 1 |
Links
Quick Verdict
- •candle-fused-attn leads with a health score of 57/100, but none of the options score above 80.
- •baracuda-flashinfer-sys has the most downloads (509), suggesting wider adoption.