Decision Workspace
lance-tokenizer vs fsst vs lance-index
Side-by-side comparison of Rust crates
56
lance-tokenizer
experimentalv6.0.1
Tokenizer abstractions and implementations for Lance
73
fsst
stablev6.0.1
FSST string compression for Lance
72
lance-index
stablev6.0.1
Lance indices implementation
Core Metrics
| lance-tokenizer | fsst | lance-index | |
|---|---|---|---|
| Health Score | 56 | 73 | 72 |
| Total Downloads | 19.5K | 1.1M | 1.3M |
| 30d Downloads | 19.7K | 229.1K | 222.8K |
| Dependents | 4 | 59 | 372 |
| Releases | 2 | 55 | 117 |
| Last Updated | 5d ago | 5d ago | 5d ago |
| Age | 14d | 1y 10m | 2y 7m |
Health Breakdown
lance-tokenizer
Maintenance
14
Quality
17
Community
8
Popularity
5
Documentation
12
fsst
Maintenance
22
Quality
16
Community
16
Popularity
7
Documentation
12
lance-index
Maintenance
20
Quality
15
Community
18
Popularity
7
Documentation
12
Technical Details
| lance-tokenizer | fsst | lance-index | |
|---|---|---|---|
| Version | 6.0.1 | 6.0.1 | 6.0.1 |
| Stable (≥1.0) | ✓ Yes | ✓ Yes | ✓ Yes |
| License | Apache-2.0 | Apache-2.0 | Apache-2.0 |
| Dependencies | 5 | 7 | 75 |
| Crate Size | 32KB | 34KB | 482KB |
| Features | 4 | 0 | 6 |
| Yanked % | 0.0% | 0.0% | 0.0% |
| Edition | 2024 | 2024 | 2024 |
| MSRV | 1.91.0 | 1.91.0 | 1.91.0 |
| Owners | 1 | 6 (team) | 7 (team) |
Links
Quick Verdict
- •fsst leads with a health score of 73/100, but none of the options score above 80.
- •lance-index has the most downloads (1.3M), suggesting wider adoption.
- •lance-index is depended on by 372 crates — strongest ecosystem trust.