Decision Workspace
baracuda-transformer-engine vs baracuda-transformer-engine-sys vs baracuda-kernels-sys
Side-by-side comparison of Rust crates
Safe Rust wrapper for baracuda's port of NVIDIA TransformerEngine's FP8 cast/transpose + delayed-scaling recipe primitives. Provides `Fp8Recipe` (delayed-scaling state with amax history), `Fp8CastPlan` for {f32, f16, bf16} → FP8 with running amax, `Fp8DequantPlan` for FP8 → {f32, f16, bf16}. Cast/recipe subset only — `normalization` / `fused_rope` / `fused_attn` / `fused_softmax` / `activation` / `gemm` skipped (overlap existing baracuda phases). NO cuDNN dep, NO pybind11. On Ada (sm_89) the FP8 wins are bandwidth-saving only (KV cache, weights); FP8 tensor-core math throughput equals BF16. Forward-compatible with Hopper / Blackwell where the compute wins also materialize.
Build + raw FFI bindings to baracuda's port of NVIDIA TransformerEngine's FP8 cast/transpose + delayed-scaling recipe primitives. Cast/recipe subset only — `normalization` / `fused_rope` / `fused_attn` / `fused_softmax` / `activation` / `gemm` deliberately skipped (overlap existing baracuda Phase 3/5/14/17/30/31/36/41/42). NO cuDNN dep (recipe + cast paths don't need it; `fused_attn` would, and we skip it); NO pybind11 (the safe wrapper lives in `baracuda-transformer-engine` and exposes a raw C ABI defined in `csrc/baracuda_te_shim.cu`). Apache-2.0 per upstream — see `ATTRIBUTION.md`.
Compiled bespoke .cu kernel template instantiations for the baracuda ML kernel facade plus C-ABI FFI facades for the library-backed plans (cuDNN conv/pool, cuSOLVER linalg, cuFFT/cuRAND, CUTLASS GEMM re-export). Hosts curated CUDA kernel sources (int8/FP8/int4/bin GEMM RRR, elementwise, reduce, norm, attention, …), builds them via baracuda-forge, exposes extern "C" entry points for the safe baracuda-kernels crate. CUTLASS template kernels live in the sibling baracuda-cutlass-kernels-sys crate and are re-exported here under the unified baracuda_kernels_gemm_* namespace.
Core Metrics
| baracuda-transformer-engine | baracuda-transformer-engine-sys | baracuda-kernels-sys | |
|---|---|---|---|
| Health Score | 58 | 59 | 60 |
| Total Downloads | 603 | 727 | 3.1K |
| 30d Downloads | 0 | 0 | 0 |
| Dependents | 25 | 25 | 94 |
| Releases | 25 | 26 | 56 |
| Last Updated | 3d ago | 3d ago | 3d ago |
| Age | 4m | 4m | 4m |
Health Breakdown
Technical Details
| baracuda-transformer-engine | baracuda-transformer-engine-sys | baracuda-kernels-sys | |
|---|---|---|---|
| Version | 0.0.1-alpha.86 | 0.0.1-alpha.86 | 0.0.1-alpha.86 |
| Stable (≥1.0) | ✗ No | ✗ No | ✗ No |
| License | MIT OR Apache-2.0 | MIT OR Apache-2.0 | MIT OR Apache-2.0 |
| Dependencies | 5 | 3 | 3 |
| Crate Size | 21KB | 26KB | 1.1MB |
| Features | 5 | 5 | 16 |
| Yanked % | 0.0% | 0.0% | 0.0% |
| Edition | 2024 | 2024 | 2024 |
| MSRV | — | — | — |
| Owners | 1 | 1 | 1 |
Links
Quick Verdict
- •baracuda-kernels-sys leads with a health score of 60/100, but none of the options score above 80.