rustio rustio.net

baracuda-transformer-engine vs baracuda-transformer-engine-sys vs baracuda-kernels-sys

Side-by-side comparison of Rust crates

58
baracuda-transformer-engine
experimentalv0.0.1-alpha.86

Safe Rust wrapper for baracuda's port of NVIDIA TransformerEngine's FP8 cast/transpose + delayed-scaling recipe primitives. Provides `Fp8Recipe` (delayed-scaling state with amax history), `Fp8CastPlan` for {f32, f16, bf16} → FP8 with running amax, `Fp8DequantPlan` for FP8 → {f32, f16, bf16}. Cast/recipe subset only — `normalization` / `fused_rope` / `fused_attn` / `fused_softmax` / `activation` / `gemm` skipped (overlap existing baracuda phases). NO cuDNN dep, NO pybind11. On Ada (sm_89) the FP8 wins are bandwidth-saving only (KV cache, weights); FP8 tensor-core math throughput equals BF16. Forward-compatible with Hopper / Blackwell where the compute wins also materialize.

59
baracuda-transformer-engine-sys
experimentalv0.0.1-alpha.86

Build + raw FFI bindings to baracuda's port of NVIDIA TransformerEngine's FP8 cast/transpose + delayed-scaling recipe primitives. Cast/recipe subset only — `normalization` / `fused_rope` / `fused_attn` / `fused_softmax` / `activation` / `gemm` deliberately skipped (overlap existing baracuda Phase 3/5/14/17/30/31/36/41/42). NO cuDNN dep (recipe + cast paths don't need it; `fused_attn` would, and we skip it); NO pybind11 (the safe wrapper lives in `baracuda-transformer-engine` and exposes a raw C ABI defined in `csrc/baracuda_te_shim.cu`). Apache-2.0 per upstream — see `ATTRIBUTION.md`.

60
baracuda-kernels-sys
experimentalv0.0.1-alpha.86

Compiled bespoke .cu kernel template instantiations for the baracuda ML kernel facade plus C-ABI FFI facades for the library-backed plans (cuDNN conv/pool, cuSOLVER linalg, cuFFT/cuRAND, CUTLASS GEMM re-export). Hosts curated CUDA kernel sources (int8/FP8/int4/bin GEMM RRR, elementwise, reduce, norm, attention, …), builds them via baracuda-forge, exposes extern "C" entry points for the safe baracuda-kernels crate. CUTLASS template kernels live in the sibling baracuda-cutlass-kernels-sys crate and are re-exported here under the unified baracuda_kernels_gemm_* namespace.

Core Metrics

baracuda-transformer-enginebaracuda-transformer-engine-sysbaracuda-kernels-sys
Health Score585960
Total Downloads6037273.1K
30d Downloads000
Dependents252594
Releases252656
Last Updated3d ago3d ago3d ago
Age4m4m4m

Health Breakdown

baracuda-transformer-engine
Maintenance
19
Quality
16
Community
10
Popularity
3
Documentation
10
baracuda-transformer-engine-sys
Maintenance
19
Quality
17
Community
10
Popularity
3
Documentation
10
baracuda-kernels-sys
Maintenance
19
Quality
16
Community
11
Popularity
4
Documentation
10

Technical Details

baracuda-transformer-enginebaracuda-transformer-engine-sysbaracuda-kernels-sys
Version0.0.1-alpha.860.0.1-alpha.860.0.1-alpha.86
Stable (≥1.0)✗ No✗ No✗ No
LicenseMIT OR Apache-2.0MIT OR Apache-2.0MIT OR Apache-2.0
Dependencies533
Crate Size21KB26KB1.1MB
Features5516
Yanked %0.0%0.0%0.0%
Edition202420242024
MSRV———
Owners111

Quick Verdict

  • •baracuda-kernels-sys leads with a health score of 60/100, but none of the options score above 80.