rustio rustio.net

bpe-tokenizer vs bpe vs bpe-openai

Side-by-side comparison of Rust crates

Core Metrics

bpe-tokenizerbpebpe-openai
Health Score476056
Total Downloads7.5K257.3K242.8K
30d Downloads000
Dependents31736
Releases566
Last Updated744d ago2d ago2d ago
Age2y2y2y

Health Breakdown

bpe-tokenizer
Maintenance
10
Quality
11
Community
8
Popularity
5
Documentation
13
bpe
Maintenance
16
Quality
15
Community
13
Popularity
6
Documentation
10
bpe-openai
Maintenance
16
Quality
10
Community
14
Popularity
6
Documentation
10

Technical Details

bpe-tokenizerbpebpe-openai
Version0.1.40.2.30.3.2
Stable (≥1.0)✗ No✗ No✗ No
Licensenon-standardMITMIT
Dependencies8712
Crate Size12.6MB197KB3.6MB
Features320
Yanked %0.0%0.0%0.0%
Edition202120212021
MSRV1.64——
Owners144

Quick Verdict

  • •bpe leads with a health score of 60/100, but none of the options score above 80.
  • •⚠ bpe-tokenizer has not been updated in over a year.