rustio rustio.net

fabric-lexer vs sentience-tokenize vs tokenizer-core

Side-by-side comparison of Rust crates

Core Metrics

fabric-lexersentience-tokenizetokenizer-core
Health Score445044
Total Downloads832.6K85
30d Downloads000
Dependents200
Releases181
Last Updated89d ago406d ago55d ago
Age2m1y 1m1m

Health Breakdown

fabric-lexer
Maintenance
8
Quality
17
Community
7
Popularity
2
Documentation
10
sentience-tokenize
Maintenance
9
Quality
16
Community
6
Popularity
4
Documentation
15
tokenizer-core
Maintenance
10
Quality
14
Community
6
Popularity
2
Documentation
12

Technical Details

fabric-lexersentience-tokenizetokenizer-core
Version1.0.00.2.30.1.0
Stable (≥1.0)✓ Yes✗ No✗ No
LicenseMITMITMIT OR Apache-2.0
Dependencies242
Crate Size10KB18KB12KB
Features020
Yanked %0.0%0.0%0.0%
Edition202120212024
MSRV—1.811.97.1
Owners111

Quick Verdict

  • •sentience-tokenize leads with a health score of 50/100, but none of the options score above 80.
  • •⚠ sentience-tokenize has not been updated in over a year.
  • •sentience-tokenize, tokenizer-core are pre-1.0 — API may change.