Decision Workspace
metrum-ai-bench-cli vs metrum-ai-bench vs llmnop
Side-by-side comparison of Rust crates
45
metrum-ai-bench-cli
experimentalv1.5.3
Metrum AI Bench CLI: load testing and benchmarking tools for OpenAI-compatible LLM, VLM, ASR and image generation endpoints
41
metrum-ai-bench
experimentalv1.1.3
Metrum AI Bench CLI: load testing and benchmarking tools for OpenAI-compatible LLM, VLM, ASR and image generation endpoints
50
llmnop
growingv0.12.0
A command-line tool for benchmarking the performance of LLM inference endpoints.
Core Metrics
| metrum-ai-bench-cli | metrum-ai-bench | llmnop | |
|---|---|---|---|
| Health Score | 45 | 41 | 50 |
| Total Downloads | 88 | 24 | 1.2K |
| 30d Downloads | 0 | 0 | 0 |
| Dependents | 0 | 0 | 0 |
| Releases | 8 | 2 | 14 |
| Last Updated | 7d ago | 17d ago | 14d ago |
| Age | 17d | 17d | 1y 3m |
Health Breakdown
metrum-ai-bench-cli
Maintenance
14
Quality
11
Community
6
Popularity
2
Documentation
12
metrum-ai-bench
Maintenance
13
Quality
8
Community
6
Popularity
2
Documentation
12
llmnop
Maintenance
18
Quality
10
Community
6
Popularity
4
Documentation
12
Technical Details
| metrum-ai-bench-cli | metrum-ai-bench | llmnop | |
|---|---|---|---|
| Version | 1.5.3 | 1.1.3 | 0.12.0 |
| Stable (≥1.0) | ✓ Yes | ✓ Yes | ✗ No |
| License | Apache-2.0 | Apache-2.0 | Apache-2.0 |
| Dependencies | 28 | 22 | 17 |
| Crate Size | 2.0MB | 404KB | 2.0MB |
| Features | 3 | 3 | 1 |
| Yanked % | 0.0% | 100.0% | 0.0% |
| Edition | 2021 | 2021 | 2024 |
| MSRV | 1.85 | 1.85 | 1.85 |
| Owners | 1 | 1 | 1 |
Links
Quick Verdict
- •llmnop leads with a health score of 50/100, but none of the options score above 80.
- •llmnop is pre-1.0 — API may change.