tiktoken-rs
v0.12.0 GrowingLibrary for encoding and decoding with the tiktoken library in Rust
Quick Verdict
- โActively maintained (updated 41d ago)
- !Pre-1.0: API may have breaking changes
- โMassive adoption (6.6K crates depend on it)
- โPermissive license (MIT)
Security
Deep Insights
1.9M downloads in the last 30 days, down 32% from the previous period. May indicate migration to alternatives.
6.6K crates depend on tiktoken-rs. Strong ecosystem adoption means battle-tested code and long-term stability.
tiktoken-rs has only 1 owner despite 6.6K dependents. This is a bus-factor concern โ consider the implications for long-term support.
Despite being 3+ years old, tiktoken-rs hasn't reached 1.0 yet. Expect potential API changes between versions.
3.8MB is relatively large. May impact download and compile times.
Notable dependents include spider, text-splitter, llm-tokenizer, toon-format, langchain-rust. When high-quality crates choose tiktoken-rs, it's a strong quality signal.
Health Breakdown
Recency, release consistency, active ratio
Yanked ratio, deps, size, maturity, features
Reverse deps, ownership, ecosystem
Downloads, momentum, growth trend
Docs, repo, license, metadata
Download Trend
Top Dependents
Most downloaded crates that depend on tiktoken-rs