Decision Workspace
fabric-lexer vs sentience-tokenize vs tokenizer-core
Side-by-side comparison of Rust crates
44
fabric-lexer
experimentalv1.0.0
Logos-based tokenizer for the Fabric robotics DSL
50
sentience-tokenize
growingv0.2.3
Tiny Rust zero-dep tokenizer (ident, number, string, parens, operators, keywords).
44
tokenizer-core
experimentalv0.1.0
Generic zero-copy token infrastructure for Logos lexers
Core Metrics
| fabric-lexer | sentience-tokenize | tokenizer-core | |
|---|---|---|---|
| Health Score | 44 | 50 | 44 |
| Total Downloads | 83 | 2.6K | 85 |
| 30d Downloads | 0 | 0 | 0 |
| Dependents | 2 | 0 | 0 |
| Releases | 1 | 8 | 1 |
| Last Updated | 89d ago | 406d ago | 55d ago |
| Age | 2m | 1y 1m | 1m |
Health Breakdown
fabric-lexer
Maintenance
8
Quality
17
Community
7
Popularity
2
Documentation
10
sentience-tokenize
Maintenance
9
Quality
16
Community
6
Popularity
4
Documentation
15
tokenizer-core
Maintenance
10
Quality
14
Community
6
Popularity
2
Documentation
12
Technical Details
| fabric-lexer | sentience-tokenize | tokenizer-core | |
|---|---|---|---|
| Version | 1.0.0 | 0.2.3 | 0.1.0 |
| Stable (≥1.0) | ✓ Yes | ✗ No | ✗ No |
| License | MIT | MIT | MIT OR Apache-2.0 |
| Dependencies | 2 | 4 | 2 |
| Crate Size | 10KB | 18KB | 12KB |
| Features | 0 | 2 | 0 |
| Yanked % | 0.0% | 0.0% | 0.0% |
| Edition | 2021 | 2021 | 2024 |
| MSRV | — | 1.81 | 1.97.1 |
| Owners | 1 | 1 | 1 |
Links
Quick Verdict
- •sentience-tokenize leads with a health score of 50/100, but none of the options score above 80.
- •⚠ sentience-tokenize has not been updated in over a year.
- •sentience-tokenize, tokenizer-core are pre-1.0 — API may change.