rustio rustio.net
52

alice-llm

v1.6.0 Experimental

Pure Rust LLM inference engine — GGUF v3 parser, K-quants, hybrid CPU/GPU DeltaNet+Attention, wgpu compute shaders, speculative decoding, OpenAI-compatible HTTP server.

AGPL-3.0-or-later Edition 2021
AlgorithmsScienceWebAssembly #quantization#gpu#inference#llm#gguf

Quick Verdict

  • ✓Actively maintained (updated 76d ago)

Security

Checking security advisories...
Downloads
398
Dependents
1
Releases
4
Size
523KB

Deep Insights

📈
Strong growth momentum

98 downloads in the last 30 days (3/day), up 600% from the previous period.

Health Breakdown

Maintenance 13/25

Recency, release consistency, active ratio

Quality 16/25

Yanked ratio, deps, size, maturity, features

Community 7/20

Reverse deps, ownership, ecosystem

Popularity 3/15

Downloads, momentum, growth trend

Documentation 13/15

Docs, repo, license, metadata

Download Trend

Daily downloads · last 90 days
0/day avg
08/229/99/2710/1511/211/19

Top Dependents

Most downloaded crates that depend on alice-llm

Version Adoption

v1.6.0
71%
v1.4.0
20%
v1.5.0
5%
v1.3.0
5%

Release Timeline

4 releasessince 2026
J
F
M
A
M
J
J
A
S
O
N
D
2026
4
Less
More

Feature Flags

default =["std"]

gpustd*ggufsimdservergrammarparallel

README

Loading README...

Maintainers

Dependencies
12
direct dependencies
Dependents
1
crates depend on alice-llm

Similar Crates