tiktoken-rs
v0.9.1 GrowingLibrary for encoding and decoding with the tiktoken library in Rust
Quick Verdict
- !Pre-1.0: API may have breaking changes
- ✓Massive adoption (3.8K crates depend on it)
- ✓Permissive license (MIT)
Security
Deep Insights
873.8K downloads in the last 30 days (29.1K/day), up 37% from the previous period.
3.8K crates depend on tiktoken-rs. Strong ecosystem adoption means battle-tested code and long-term stability.
tiktoken-rs has only 1 owner despite 3.8K dependents. This is a bus-factor concern — consider the implications for long-term support.
Despite being 3+ years old, tiktoken-rs hasn't reached 1.0 yet. Expect potential API changes between versions.
3.8MB is relatively large. May impact download and compile times.
Notable dependents include spider, text-splitter, llm-tokenizer, langchain-rust, bpe. When high-quality crates choose tiktoken-rs, it's a strong quality signal.
Health Breakdown
Recency, release consistency, active ratio
Yanked ratio, deps, size, maturity, features
Reverse deps, ownership, ecosystem
Downloads, momentum, growth trend
Docs, repo, license, metadata
