rustio rustio.net
49

classeve-rai-infer

v0.2.5 Experimental

CPU inference engine for 4-bit quantized LLMs — hand-written AVX2 GEMM kernels, .raimodel format, speculative decoding

Apache-2.0 Edition 2021 MSRV 1.87
Command line utilitiesScience #cpu#simd#quantization#inference#llm

Quick Verdict

  • ✓Actively maintained (updated 31d ago)
  • !Pre-1.0: API may have breaking changes
  • ✓Permissive license (Apache-2.0)

Security

Checking security advisories...
Downloads
81
Dependents
0
Releases
4
Size
522KB

Deep Insights

📉
Download decline

5 downloads in the last 30 days, down 91% from the previous period. May indicate migration to alternatives.

Health Breakdown

Maintenance 17/25

Recency, release consistency, active ratio

Quality 12/25

Yanked ratio, deps, size, maturity, features

Community 6/20

Reverse deps, ownership, ecosystem

Popularity 2/15

Downloads, momentum, growth trend

Documentation 12/15

Docs, repo, license, metadata

Download Trend

Daily downloads · last 90 days
0/day avg
08/229/99/2710/1511/211/19

Version Adoption

v0.1.0
28%
v0.2.1
28%
v0.2.5
22%
v0.2.4
21%

Release Timeline

4 releasessince 2026
J
F
M
A
M
J
J
A
S
O
N
D
2026
4
Less
More

Feature Flags

default =["cli"]

cli*

README

Loading README...

Maintainers

Dependencies
12
direct dependencies
Dependents
0
crates depend on classeve-rai-infer

Similar Crates