rustio rustio.net
61

mistralrs

v0.8.1 Experimental

Fast, flexible LLM inference.

MIT Edition 2021 MSRV 1.88
API bindingsScienceText processing #ai#machine-learning#inference#transformers#llm

Quick Verdict

  • โœ“Actively maintained (updated 53d ago)
  • !Pre-1.0: API may have breaking changes
  • โœ“Trusted by 132 crates
  • โœ“Permissive license (MIT)

Security

Checking security advisories...
Downloads
43.1K
Dependents
132
Releases
5
Size
111KB

Deep Insights

๐Ÿ“ˆ
Strong growth momentum

20.3K downloads in the last 30 days (677/day), up 102% from the previous period.

๐Ÿ”—
Moderate adoption

132 crates depend on mistralrs. Reasonable ecosystem adoption, though not yet a core dependency.

๐ŸŒŸ
Used by top crates

Notable dependents include dotscope, saorsa, mistralrs-cli, uni-xervo, blazen-llm-mistralrs. When high-quality crates choose mistralrs, it's a strong quality signal.

Health Breakdown

Maintenance 15/25

Recency, release consistency, active ratio

Quality 13/25

Yanked ratio, deps, size, maturity, features

Community 12/20

Reverse deps, ownership, ecosystem

Popularity 6/15

Downloads, momentum, growth trend

Documentation 15/15

Docs, repo, license, metadata

Download Trend

Daily downloads ยท last 90 days
455/day avg+86%
01K2K3K2/263/164/34/215/95/26

Top Dependents

Version Adoption

v0.8.1
59%
v0.7.0
40%
v0.8.0
0%
v0.7.0-alpha.4
0%
v0.7.0-alpha.3
0%

Release Timeline

5 releasessince 2026
J
F
M
A
M
J
J
A
S
O
N
D
2026
5
Less
More

Feature Flags

mklcudancclringcudnnmetalaccelerateflash-attn

README

Loading README...

Maintainers

Dependencies
20
direct dependencies
Dependents
132
crates depend on mistralrs

Similar Crates