rustio rustio.net
50

rakka-inference-runtime

v0.2.6 Experimental

Runtime-agnostic actor topology for rakka-inference — gateway, request actor, dp-coordinator, engine-core, two-tier worker, placement, deployment manager, metrics.

Apache-2.0 Edition 2021 MSRV 1.78
AsynchronousConcurrencyScience #actor#inference#openai#llm#rakka

Quick Verdict

  • Actively maintained (updated 71d ago)
  • !Pre-1.0: API may have breaking changes
  • !Heavy dependency tree (21 direct deps)
  • Permissive license (Apache-2.0)

Security

Checking security advisories...
Downloads
129
Dependents
8
Releases
2
Size
27KB

Deep Insights

📈
Strong growth momentum

56 downloads in the last 30 days (2/day), up 65% from the previous period.

👤
Prolific maintainer

The primary maintainer publishes 196 crates. This suggests deep Rust expertise and long-term commitment to the ecosystem.

📦
Heavy dependency tree

21 direct dependencies. Consider the impact on compile times and supply chain complexity.

📐
Compact crate

At 26KB, rakka-inference-runtime is lightweight. Small crate size correlates with focused, well-scoped functionality.

🌟
Used by top crates

Notable dependents include rakka-inference-runtime-openai, rakka-inference-runtime-litellm, rakka-inference-runtime-anthropic, rakka-inference-runtime-gemini. When high-quality crates choose rakka-inference-runtime, it's a strong quality signal.

Health Breakdown

Maintenance 10/25

Recency, release consistency, active ratio

Quality 13/25

Yanked ratio, deps, size, maturity, features

Community 9/20

Reverse deps, ownership, ecosystem

Popularity 3/15

Downloads, momentum, growth trend

Documentation 15/15

Docs, repo, license, metadata

Download Trend

Daily downloads · last 90 days
0/day avg
04/275/156/26/207/87/25

Top Dependents

Version Adoption

v0.2.6
89%
v0.2.5
11%

Release Timeline

2 releasessince 2026
J
F
M
A
M
J
J
A
S
O
N
D
2026
2
Less
More

Feature Flags

local-gpu

README

Loading README...

Maintainers

Dependencies
21
direct dependencies
Dependents
8
crates depend on rakka-inference-runtime

Similar Crates