rustio rustio.net

bpe vs bpe-openai vs bpe-tokenizer

Side-by-side comparison of Rust crates

Core Metrics

bpebpe-openaibpe-tokenizer
Health Score605647
Total Downloads257.3K242.8K7.5K
30d Downloads000
Dependents17363
Releases665
Last Updated2d ago2d ago744d ago
Age2y2y2y

Health Breakdown

bpe
Maintenance
16
Quality
15
Community
13
Popularity
6
Documentation
10
bpe-openai
Maintenance
16
Quality
10
Community
14
Popularity
6
Documentation
10
bpe-tokenizer
Maintenance
10
Quality
11
Community
8
Popularity
5
Documentation
13

Technical Details

bpebpe-openaibpe-tokenizer
Version0.2.30.3.20.1.4
Stable (≥1.0)✗ No✗ No✗ No
LicenseMITMITnon-standard
Dependencies7128
Crate Size197KB3.6MB12.6MB
Features203
Yanked %0.0%0.0%0.0%
Edition202120212021
MSRV——1.64
Owners441

Quick Verdict

  • •bpe leads with a health score of 60/100, but none of the options score above 80.
  • •⚠ bpe-tokenizer has not been updated in over a year.