Decision Workspace
teeny-llm vs oxibonsai-serve vs shimmy
Side-by-side comparison of Rust crates
46
teeny-llm
experimentalv0.2.0
Teenygrad is a high-performance, memory-safe Rust ML training and inference library. It targets devices from microcontrollers to traditional GPUs with statically-typed kernels and full async support.
53
oxibonsai-serve
experimentalv0.2.3
Standalone OpenAI-compatible inference server for OxiBonsai
52
shimmy
stablev2.6.4
Lightweight Ollama-compatible inference server with native SafeTensors support. No Python dependencies, cross-platform WebGPU acceleration via Airframe.
Core Metrics
| teeny-llm | oxibonsai-serve | shimmy | |
|---|---|---|---|
| Health Score | 46 | 53 | 52 |
| Total Downloads | 101 | 282 | 13.4K |
| 30d Downloads | 0 | 0 | 0 |
| Dependents | 0 | 12 | 0 |
| Releases | 5 | 10 | 34 |
| Last Updated | 54d ago | 80d ago | 40d ago |
| Age | 2m | 6m | 1y 1m |
Health Breakdown
teeny-llm
Maintenance
11
Quality
14
Community
6
Popularity
2
Documentation
13
oxibonsai-serve
Maintenance
15
Quality
13
Community
9
Popularity
3
Documentation
13
shimmy
Maintenance
17
Quality
14
Community
6
Popularity
5
Documentation
10
Technical Details
| teeny-llm | oxibonsai-serve | shimmy | |
|---|---|---|---|
| Version | 0.2.0 | 0.2.3 | 2.6.4 |
| Stable (≥1.0) | ✗ No | ✗ No | ✓ Yes |
| License | Apache-2.0 | Apache-2.0 | MIT |
| Dependencies | 0 | 18 | 37 |
| Crate Size | 121KB | 64KB | 167KB |
| Features | 0 | 2 | 8 |
| Yanked % | 0.0% | 0.0% | 5.9% |
| Edition | 2024 | 2021 | 2021 |
| MSRV | — | — | — |
| Owners | 1 | 1 | 1 |
Links
Quick Verdict
- •oxibonsai-serve leads with a health score of 53/100, but none of the options score above 80.
- •shimmy has the most downloads (13.4K), suggesting wider adoption.
- •teeny-llm, oxibonsai-serve are pre-1.0 — API may change.