Decision Workspace
baracuda-transformer-engine-sys vs baracuda-transformer-engine vs baracuda-cutlass-sys
Side-by-side comparison of Rust crates
Build + raw FFI bindings to baracuda's port of NVIDIA TransformerEngine's FP8 cast/transpose + delayed-scaling recipe primitives. Cast/recipe subset only — `normalization` / `fused_rope` / `fused_attn` / `fused_softmax` / `activation` / `gemm` deliberately skipped (overlap existing baracuda Phase 3/5/14/17/30/31/36/41/42). NO cuDNN dep (recipe + cast paths don't need it; `fused_attn` would, and we skip it); NO pybind11 (the safe wrapper lives in `baracuda-transformer-engine` and exposes a raw C ABI defined in `csrc/baracuda_te_shim.cu`). Apache-2.0 per upstream — see `ATTRIBUTION.md`.
Safe Rust wrapper for baracuda's port of NVIDIA TransformerEngine's FP8 cast/transpose + delayed-scaling recipe primitives. Provides `Fp8Recipe` (delayed-scaling state with amax history), `Fp8CastPlan` for {f32, f16, bf16} → FP8 with running amax, `Fp8DequantPlan` for FP8 → {f32, f16, bf16}. Cast/recipe subset only — `normalization` / `fused_rope` / `fused_attn` / `fused_softmax` / `activation` / `gemm` skipped (overlap existing baracuda phases). NO cuDNN dep, NO pybind11. On Ada (sm_89) the FP8 wins are bandwidth-saving only (KV cache, weights); FP8 tensor-core math throughput equals BF16. Forward-compatible with Hopper / Blackwell where the compute wins also materialize.
Header acquisition for NVIDIA CUTLASS as a baracuda workspace dependency. Sparse-checkout fetch with file-locked caching; emits cargo:include for downstream build.rs consumers.
Core Metrics
| baracuda-transformer-engine-sys | baracuda-transformer-engine | baracuda-cutlass-sys | |
|---|---|---|---|
| Health Score | 59 | 58 | 60 |
| Total Downloads | 727 | 603 | 3.7K |
| 30d Downloads | 0 | 0 | 0 |
| Dependents | 25 | 25 | 85 |
| Releases | 26 | 25 | 59 |
| Last Updated | 3d ago | 3d ago | 3d ago |
| Age | 4m | 4m | 5m |
Health Breakdown
Technical Details
| baracuda-transformer-engine-sys | baracuda-transformer-engine | baracuda-cutlass-sys | |
|---|---|---|---|
| Version | 0.0.1-alpha.86 | 0.0.1-alpha.86 | 0.0.1-alpha.86 |
| Stable (≥1.0) | ✗ No | ✗ No | ✗ No |
| License | MIT OR Apache-2.0 | MIT OR Apache-2.0 | MIT OR Apache-2.0 |
| Dependencies | 3 | 5 | 1 |
| Crate Size | 26KB | 21KB | 13KB |
| Features | 5 | 5 | 2 |
| Yanked % | 0.0% | 0.0% | 0.0% |
| Edition | 2024 | 2024 | 2024 |
| MSRV | — | — | — |
| Owners | 1 | 1 | 1 |
Links
Quick Verdict
- •baracuda-cutlass-sys leads with a health score of 60/100, but none of the options score above 80.