rustio rustio.net
51

bbpe

v0.6.3 Experimental

Binary byte pair encoding (BPE) trainer and CLI compatible with Hugging Face tokenizers

Apache-2.0 Edition 2021 MSRV 1.74
EncodingText processing #binary#tokenizer#malware#huggingface#bpe

Quick Verdict

  • !Pre-1.0: API may have breaking changes
  • !Heavy dependency tree (22 direct deps)
  • โœ“Permissive license (Apache-2.0)

Security

Checking security advisories...
Downloads
999
Dependents
0
Releases
13
Size
88KB

Deep Insights

๐Ÿ“ˆ
Strong growth momentum

28 downloads in the last 30 days (1/day), up 100% from the previous period.

๐Ÿ“ฆ
Heavy dependency tree

22 direct dependencies. Consider the impact on compile times and supply chain complexity.

Health Breakdown

Maintenance 13/25

Recency, release consistency, active ratio

Quality 13/25

Yanked ratio, deps, size, maturity, features

Community 6/20

Reverse deps, ownership, ecosystem

Popularity 4/15

Downloads, momentum, growth trend

Documentation 15/15

Docs, repo, license, metadata

Download Trend

Daily downloads ยท last 90 days
1/day avg-82%
051012/291/162/32/213/113/28

Version Adoption

v0.2.0
28%
v0.1.0
25%
v0.3.1
21%
v0.3.0
18%
v0.6.3
7%

Release Timeline

13 releasessince 2025
J
F
M
A
M
J
J
A
S
O
N
D
2025
13
2026
Less
More

Feature Flags

default =["cli"]

cli*

README

Loading README...

Maintainers

Dependencies
22
direct dependencies
Dependents
0
crates depend on bbpe

Similar Crates