rustio rustio.net
58

ruvllm

v2.1.0 Experimental

LLM serving runtime with Ruvector integration - Paged attention, KV cache, and SONA learning

MIT Edition 2021 MSRV 1.77
AlgorithmsScience #inference#llm#kv-cache#paged-attention#ruvector

Quick Verdict

  • โœ“Actively maintained (updated 0d ago)
  • !Heavy dependency tree (44 direct deps)
  • โœ“Permissive license (MIT)

Security

Checking security advisories...
Downloads
4.8K
Dependents
1
Releases
8
Size
1.2MB

Deep Insights

๐Ÿ“ˆ
Strong growth momentum

3.4K downloads in the last 30 days (113/day), up 170% from the previous period.

๐Ÿ‘ค
Prolific maintainer

The primary maintainer publishes 293 crates. This suggests deep Rust expertise and long-term commitment to the ecosystem.

๐Ÿ“ฆ
Heavy dependency tree

44 direct dependencies. Consider the impact on compile times and supply chain complexity.

Health Breakdown

Maintenance 20/25

Recency, release consistency, active ratio

Quality 15/25

Yanked ratio, deps, size, maturity, features

Community 7/20

Reverse deps, ownership, ecosystem

Popularity 4/15

Downloads, momentum, growth trend

Documentation 12/15

Docs, repo, license, metadata

Download Trend

Daily downloads ยท last 90 days
53/day avg+444%
010020030040012/291/162/32/213/113/28

Top Dependents

Most downloaded crates that depend on ruvllm

Version Adoption

v2.0.4
68%
v2.0.1
30%
v0.2.3
1%
v2.0.6
0%
v2.0.2
0%

Release Timeline

8 releasessince 2025
J
F
M
A
M
J
J
A
S
O
N
D
2025
1
2026
7
Less
More

Feature Flags

default =["async-runtime", "candle", "routing-metrics", "quantize"]

gnncudammapwasmgraphmetalcandle*coremlminimalparallelquantize*attentiongguf-mmapwasm-simdacceleratehybrid-aneasync-runtime*metal-computeruvector-fullinference-cudainference-metalrouting-metrics*inference-metal-native

README

Loading README...

Maintainers

Dependencies
44
direct dependencies
Dependents
1
crates depend on ruvllm

Similar Crates