rustio rustio.net

tiktoken vs toktok-rs vs toklab-core

Side-by-side comparison of Rust crates

Core Metrics

tiktokentoktok-rstoklab-core
Health Score616146
Total Downloads57.8K1.1K40
30d Downloads000
Dependents24500
Releases2642
Last Updated57d ago37d ago152d ago
Age3y 1m1m5m

Health Breakdown

tiktoken
Maintenance
16
Quality
13
Community
13
Popularity
6
Documentation
13
toktok-rs
Maintenance
17
Quality
14
Community
11
Popularity
4
Documentation
15
toklab-core
Maintenance
10
Quality
13
Community
6
Popularity
2
Documentation
15

Technical Details

tiktokentoktok-rstoklab-core
Version4.1.20.1.40.1.1
Stable (≥1.0)✓ Yes✗ No✗ No
LicenseMIT OR Apache-2.0MITMIT OR Apache-2.0
Dependencies904
Crate Size5.3MB2.3MB7KB
Features2320
Yanked %26.9%0.0%0.0%
Edition202420212021
MSRV—1.701.75
Owners12 (team)1

Quick Verdict

  • •tiktoken leads with a health score of 61/100, but none of the options score above 80.
  • •tiktoken is depended on by 245 crates — strongest ecosystem trust.
  • •toktok-rs, toklab-core are pre-1.0 — API may change.