rustio rustio.net
53

baracuda-flashinfer

v0.0.1-alpha.86 Experimental

Safe, typed Rust wrappers for NVIDIA FlashInfer's inference-serving kernels: batched paged-KV attention decode, decode-time KV-cache append, cascade / prefix-cache attention-state merge, and sort-free top-K / top-P / min-P sampling. The canonical vLLM-style serving surface for the baracuda CUDA stack. Apache-2.0 (FlashInfer upstream).

MIT OR Apache-2.0 Edition 2024
API bindingsScience #cuda#llm#attention#paged-attention#flashinfer

Quick Verdict

  • โœ“Actively maintained (updated 2d ago)
  • !Pre-1.0: API may have breaking changes
  • โœ“Permissive license (MIT OR Apache-2.0)

Security

Checking security advisories...
Downloads
394
Dependents
0
Releases
19
Size
24KB

Deep Insights

๐Ÿ“‰
Download decline

37 downloads in the last 30 days, down 45% from the previous period. May indicate migration to alternatives.

๐Ÿ‘ค
Prolific maintainer

The primary maintainer publishes 187 crates. This suggests deep Rust expertise and long-term commitment to the ecosystem.

๐Ÿ“
Compact crate

At 23KB, baracuda-flashinfer is lightweight. Small crate size correlates with focused, well-scoped functionality.

Health Breakdown

Maintenance 19/25

Recency, release consistency, active ratio

Quality 15/25

Yanked ratio, deps, size, maturity, features

Community 6/20

Reverse deps, ownership, ecosystem

Popularity 3/15

Downloads, momentum, growth trend

Documentation 10/15

Docs, repo, license, metadata

Download Trend

Daily downloads ยท last 90 days
0/day avg
08/239/109/2810/1611/311/20

Version Adoption

v0.0.1-alpha.77
22%
v0.0.1-alpha.75
21%
v0.0.1-alpha.76
20%
v0.0.1-alpha.74
18%
v0.0.1-alpha.79
18%

Release Timeline

10 releasessince 2026
J
F
M
A
M
J
J
A
S
O
N
D
2026
10
Less
More

Feature Flags

flashinfer

README

Loading README...

Maintainers

Dependencies
5
direct dependencies
Dependents
0
crates depend on baracuda-flashinfer

Similar Crates