rustio rustio.net
55

mistralrs-core

v0.8.1 Experimental

Fast, flexible LLM inference.

MIT Edition 2021 MSRV 1.88
API bindingsScienceText processing #ai#machine-learning#inference#transformers#llm

Quick Verdict

  • โœ“Actively maintained (updated 53d ago)
  • !Pre-1.0: API may have breaking changes
  • !Heavy dependency tree (97 direct deps)
  • โœ“Permissive license (MIT)

Security

Checking security advisories...
Downloads
43.1K
Dependents
34
Releases
5
Size
1.0MB

Deep Insights

๐Ÿ“ˆ
Strong growth momentum

20.4K downloads in the last 30 days (679/day), up 102% from the previous period.

๐Ÿ“ฆ
Heavy dependency tree

97 direct dependencies. Consider the impact on compile times and supply chain complexity.

๐ŸŒŸ
Used by top crates

Notable dependents include mistralrs, mistralrs-server-core, mistralrs-cli, spnl-run, hanzo-engine. When high-quality crates choose mistralrs-core, it's a strong quality signal.

Health Breakdown

Maintenance 15/25

Recency, release consistency, active ratio

Quality 12/25

Yanked ratio, deps, size, maturity, features

Community 10/20

Reverse deps, ownership, ecosystem

Popularity 6/15

Downloads, momentum, growth trend

Documentation 12/15

Docs, repo, license, metadata

Download Trend

Daily downloads ยท last 90 days
456/day avg+86%
01K2K3K2/263/164/34/215/95/26

Top Dependents

Version Adoption

v0.8.1
59%
v0.7.0
40%
v0.8.0
0%
v0.7.0-alpha.4
0%
v0.7.0-alpha.3
0%

Release Timeline

5 releasessince 2026
J
F
M
A
M
J
J
A
S
O
N
D
2026
5
Less
More

Feature Flags

mklcudancclringcudnnmetalutoipaaccelerateflash-attnpyo3_macrosflash-attn-v3

README

Loading README...

Maintainers

Dependencies
97
direct dependencies
Dependents
34
crates depend on mistralrs-core

Similar Crates