Decision Workspace
baracuda-transformer-engine-sys vs baracuda-transformer-engine vs baracuda-cutlass-sys
Side-by-side comparison of Rust crates
Build + raw FFI bindings to baracuda's port of NVIDIA TransformerEngine's FP8 cast/transpose + delayed-scaling recipe primitives. Cast/recipe subset only — `normalization` / `fused_rope` / `fused_attn` / `fused_softmax` / `activation` / `gemm` deliberately skipped (overlap existing baracuda Phase 3/5/14/17/30/31/36/41/42). NO cuDNN dep (recipe + cast paths don't need it; `fused_attn` would, and we skip it); NO pybind11 (the safe wrapper lives in `baracuda-transformer-engine` and exposes a raw C ABI defined in `csrc/baracuda_te_shim.cu`). Apache-2.0 per upstream — see `ATTRIBUTION.md`.
Safe Rust wrapper for baracuda's port of NVIDIA TransformerEngine's FP8 cast/transpose + delayed-scaling recipe primitives. Provides `Fp8Recipe` (delayed-scaling state with amax history), `Fp8CastPlan` for {f32, f16, bf16} → FP8 with running amax, `Fp8DequantPlan` for FP8 → {f32, f16, bf16}. Cast/recipe subset only — `normalization` / `fused_rope` / `fused_attn` / `fused_softmax` / `activation` / `gemm` skipped (overlap existing baracuda phases). NO cuDNN dep, NO pybind11. On Ada (sm_89) the FP8 wins are bandwidth-saving only (KV cache, weights); FP8 tensor-core math throughput equals BF16. Forward-compatible with Hopper / Blackwell where the compute wins also materialize.
Header acquisition for NVIDIA CUTLASS as a baracuda workspace dependency. Sparse-checkout fetch with file-locked caching; emits cargo:include for downstream build.rs consumers.
Core Metrics
| baracuda-transformer-engine-sys | baracuda-transformer-engine | baracuda-cutlass-sys | |
|---|---|---|---|
| Health Score | 56 | 55 | 57 |
| Total Downloads | 437 | 370 | 2.8K |
| 30d Downloads | 0 | 0 | 1.3K |
| Dependents | 20 | 20 | 73 |
| Releases | 20 | 20 | 53 |
| Last Updated | 4d ago | 4d ago | 4d ago |
| Age | 1m | 1m | 2m |
Health Breakdown
Technical Details
| baracuda-transformer-engine-sys | baracuda-transformer-engine | baracuda-cutlass-sys | |
|---|---|---|---|
| Version | 0.0.1-alpha.77 | 0.0.1-alpha.77 | 0.0.1-alpha.77 |
| Stable (≥1.0) | ✗ No | ✗ No | ✗ No |
| License | MIT OR Apache-2.0 | MIT OR Apache-2.0 | MIT OR Apache-2.0 |
| Dependencies | 3 | 5 | 1 |
| Crate Size | 24KB | 16KB | 9KB |
| Features | 5 | 5 | 2 |
| Yanked % | 0.0% | 0.0% | 0.0% |
| Edition | 2024 | 2024 | 2024 |
| MSRV | 1.85 | 1.85 | 1.85 |
| Owners | 1 | 1 | 1 |
Links
Quick Verdict
- •baracuda-cutlass-sys leads with a health score of 57/100, but none of the options score above 80.