tiktoken-rs
v0.11.0 GrowingLibrary for encoding and decoding with the tiktoken library in Rust
Quick Verdict
- ✓Actively maintained (updated 47d ago)
- !Pre-1.0: API may have breaking changes
- ✓Massive adoption (5.4K crates depend on it)
- ✓Permissive license (MIT)
Security
Deep Insights
1.7M downloads in the last 30 days (56.4K/day), up 77% from the previous period.
5.4K crates depend on tiktoken-rs. Strong ecosystem adoption means battle-tested code and long-term stability.
tiktoken-rs has only 1 owner despite 5.4K dependents. This is a bus-factor concern — consider the implications for long-term support.
Despite being 3+ years old, tiktoken-rs hasn't reached 1.0 yet. Expect potential API changes between versions.
3.8MB is relatively large. May impact download and compile times.
Notable dependents include spider, text-splitter, llm-tokenizer, toon-format, langchain-rust. When high-quality crates choose tiktoken-rs, it's a strong quality signal.
Health Breakdown
Recency, release consistency, active ratio
Yanked ratio, deps, size, maturity, features
Reverse deps, ownership, ecosystem
Downloads, momentum, growth trend
Docs, repo, license, metadata
