rustio rustio.net
45

superfluid-tokenizer-hf

v0.1.2 Experimental

HF tokenizer.json as a superfluid Tokenizer: the daemon's built-in tokenizer for HF-layout artifacts (MLX, safetensors), no runtime FFI

Apache-2.0 Edition 2021
Command line utilitiesScience #inference#mlx#llm#llama-cpp#serving

Quick Verdict

  • โœ“Actively maintained (updated 1d ago)
  • !Pre-1.0: API may have breaking changes
  • โœ“Permissive license (Apache-2.0)

Security

Checking security advisories...
Downloads
15
Dependents
4
Releases
1
Size
16KB

Deep Insights

๐Ÿ“Š
Download activity

15 downloads in the last 30 days (1/day avg).

๐Ÿ“
Compact crate

At 15KB, superfluid-tokenizer-hf is lightweight. Small crate size correlates with focused, well-scoped functionality.

๐ŸŒŸ
Used by top crates

Notable dependents include superfluid-engine-ffi, superfluid-adapter-llamacpp, superfluid-adapter-mlx, superfluid. When high-quality crates choose superfluid-tokenizer-hf, it's a strong quality signal.

Health Breakdown

Maintenance 13/25

Recency, release consistency, active ratio

Quality 13/25

Yanked ratio, deps, size, maturity, features

Community 8/20

Reverse deps, ownership, ecosystem

Popularity 1/15

Downloads, momentum, growth trend

Documentation 10/15

Docs, repo, license, metadata

Download Trend

Daily downloads ยท last 90 days
0/day avg
08/229/99/2710/1511/211/19

Top Dependents

Version Adoption

v0.1.2
100%

Release Timeline

1 releasessince 2026
J
F
M
A
M
J
J
A
S
O
N
D
2026
1
Less
More

README

Loading README...

Maintainers

Dependencies
4
direct dependencies
Dependents
4
crates depend on superfluid-tokenizer-hf

Similar Crates