rustio rustio.net

Decision Workspace

fibpetokenizer

Side-by-side comparison of Rust crates

46
fibpetokenizer
experimentalv0.1.0

A blazing fast Byte Pair Encoding (BPE) tokenizer library with Python bindings

Core Metrics

fibpetokenizer
Health Score46
Total Downloads14
30d Downloads14
Dependents0
Releases1
Last Updated24d ago
Age24d

Health Breakdown

fibpetokenizer
Maintenance
11
Quality
15
Community
6
Popularity
1
Documentation
13

Technical Details

fibpetokenizer
Version0.1.0
Stable (≥1.0)✗ No
LicenseMIT OR Apache-2.0
Dependencies6
Crate Size24KB
Features2
Yanked %0.0%
Edition2021
MSRV—
Owners1

Links

fibpetokenizer detail →GitHub ↗Docs ↗crates.io ↗

Quick Verdict

  • •fibpetokenizer leads with a health score of 46/100, but none of the options score above 80.