rustio rustio.net
49

mistralrs-server-core

v0.8.1 Experimental

Fast, flexible LLM inference.

MIT Edition 2021 MSRV 1.88
API bindingsScienceText processing #ai#machine-learning#inference#transformers#llm

Quick Verdict

  • !Pre-1.0: API may have breaking changes
  • !Heavy dependency tree (23 direct deps)
  • โœ“Permissive license (MIT)

Security

Checking security advisories...
Downloads
5.1K
Dependents
9
Releases
5
Size
125KB

Deep Insights

๐Ÿ“Š
Stable downloads

666 downloads in the last 30 days (22/day). Volume is roughly flat compared to the previous period.

๐Ÿ“ฆ
Heavy dependency tree

23 direct dependencies. Consider the impact on compile times and supply chain complexity.

๐ŸŒŸ
Used by top crates

Notable dependents include mistralrs-cli, smaxd-config, smaxd-core. When high-quality crates choose mistralrs-server-core, it's a strong quality signal.

Health Breakdown

Maintenance 10/25

Recency, release consistency, active ratio

Quality 14/25

Yanked ratio, deps, size, maturity, features

Community 9/20

Reverse deps, ownership, ecosystem

Popularity 4/15

Downloads, momentum, growth trend

Documentation 12/15

Docs, repo, license, metadata

Download Trend

Daily downloads ยท last 90 days
0/day avg
08/239/109/2810/1611/311/20

Top Dependents

Most downloaded crates that depend on mistralrs-server-core

Version Adoption

v0.8.1
83%
v0.7.0
15%
v0.8.0
1%
v0.7.0-alpha.3
0%
v0.7.0-alpha.4
0%

Release Timeline

5 releasessince 2026
J
F
M
A
M
J
J
A
S
O
N
D
2026
5
Less
More

Feature Flags

default =["swagger-ui"]

mklcudancclringcudnnmetalaccelerateflash-attnswagger-ui*flash-attn-v3

README

Loading README...

Maintainers

Dependencies
23
direct dependencies
Dependents
9
crates depend on mistralrs-server-core

Similar Crates