59
tokio-prompt-orchestrator
v2.0.1 GrowingPut a queue, deduplication and a circuit breaker in front of any LLM API, so repeated prompts cost one call and outages fail fast. Rust library, HTTP server and CLI.
MIT Edition 2021 MSRV 1.88
AsynchronousCommand line utilitiesNetwork programmingWeb programming::HTTP server #proxy#circuit-breaker#openai#llm#anthropic
Quick Verdict
- โActively maintained (updated 6d ago)
- !Heavy dependency tree (57 direct deps)
- โPermissive license (MIT)
Security
Checking security advisories...
Downloads
157
Dependents
0
Releases
11
Size
1.0MB
Deep Insights
๐
Download activity
81 downloads in the last 30 days (3/day avg).
๐ค
Prolific maintainer
The primary maintainer publishes 69 crates. This suggests deep Rust expertise and long-term commitment to the ecosystem.
๐ฆ
Heavy dependency tree
57 direct dependencies. Consider the impact on compile times and supply chain complexity.
Health Breakdown
Maintenance 19/25
Recency, release consistency, active ratio
Quality 16/25
Yanked ratio, deps, size, maturity, features
Community 6/20
Reverse deps, ownership, ecosystem
Popularity 3/15
Downloads, momentum, growth trend
Documentation 15/15
Docs, repo, license, metadata
Download Trend
Daily downloads ยท last 90 days
0/day avg
Version Adoption
v1.2.0
29%
v1.1.0
20%
v1.0.1
18%
v1.4.0
18%
v1.4.1
15%
Release Timeline
10 releasessince 2026
J
F
M
A
M
J
J
A
S
O
N
D
2026
10
LessMore
Feature Flags
climcprigtuifullotelgenaitowerschemazipkincachingdatadogtantivyweb-apitiktokendashboardevolutionfastembedself-tunehot-reloaddistributedself-modifyasync-openaicore-pinningintelligencerate-limitingmetrics-serverself-improving
README
Loading README...
Maintainers
Dependencies
57
direct dependencies
Dependents
0
crates depend on tokio-prompt-orchestrator