tekken-rs

v0.1.1 Experimental

Rust implementation of Mistral Tekken tokenizer with audio support

Apache-2.0 Edition 2024

Multimedia::Audio Science Text processing #audio#ai#tokenizer#nlp#mistral

GitHub ↗ Docs ↗ crates.io ↗ Compare with…

Quick Verdict

!Pre-1.0: API may have breaking changes
✓Permissive license (Apache-2.0)

Security

Checking security advisories...

Downloads

3.5K

Dependents

Releases

Size

33KB

Deep Insights

📈

Strong growth momentum

595 downloads in the last 30 days (20/day), up 169% from the previous period.

📐

Compact crate

At 32KB, tekken-rs is lightweight. Small crate size correlates with focused, well-scoped functionality.

Health Breakdown

Maintenance 8/25

Recency, release consistency, active ratio

Quality 11/25

Yanked ratio, deps, size, maturity, features

Community 8/20

Reverse deps, ownership, ecosystem

Popularity 4/15

Downloads, momentum, growth trend

Documentation 13/15

Docs, repo, license, metadata

Download Trend

Daily downloads · last 90 days

15/day avg+11%

Top Dependents

Most downloaded crates that depend on tekken-rs

Version Adoption

v0.1.1

90%

v0.1.0

10%

Release Timeline

2 releasessince 2025

2025

2026

Less

README

Loading README...

Maintainers

Jorge Menjivar

Dependencies

direct dependencies