rustio rustio.net

toklab-core vs tiktoken vs toktok-rs

Side-by-side comparison of Rust crates

Core Metrics

toklab-coretiktokentoktok-rs
Health Score466161
Total Downloads4057.8K1.1K
30d Downloads000
Dependents02450
Releases2264
Last Updated152d ago57d ago37d ago
Age5m3y 1m1m

Health Breakdown

toklab-core
Maintenance
10
Quality
13
Community
6
Popularity
2
Documentation
15
tiktoken
Maintenance
16
Quality
13
Community
13
Popularity
6
Documentation
13
toktok-rs
Maintenance
17
Quality
14
Community
11
Popularity
4
Documentation
15

Technical Details

toklab-coretiktokentoktok-rs
Version0.1.14.1.20.1.4
Stable (≥1.0)✗ No✓ Yes✗ No
LicenseMIT OR Apache-2.0MIT OR Apache-2.0MIT
Dependencies490
Crate Size7KB5.3MB2.3MB
Features0232
Yanked %0.0%26.9%0.0%
Edition202120242021
MSRV1.75—1.70
Owners112 (team)

Quick Verdict

  • •tiktoken leads with a health score of 61/100, but none of the options score above 80.
  • •tiktoken is depended on by 245 crates — strongest ecosystem trust.
  • •toklab-core, toktok-rs are pre-1.0 — API may change.