Decision Workspace
rune-tokenize vs tokf-common vs tokf-filter
Side-by-side comparison of Rust crates
41
rune-tokenize
experimentalv0.1.0
Approximate token counting, budget checking, text truncation, and overlapping chunk splitting for LLM context windows
56
tokf-common
experimentalv0.2.54
Shared types and utilities for the tokf CLI tool
55
tokf-filter
experimentalv0.2.54
Pure filter engine for tokf — config-driven output compression
Core Metrics
| rune-tokenize | tokf-common | tokf-filter | |
|---|---|---|---|
| Health Score | 41 | 56 | 55 |
| Total Downloads | 245 | 1.9K | 1.5K |
| 30d Downloads | 0 | 0 | 0 |
| Dependents | 2 | 91 | 42 |
| Releases | 1 | 51 | 42 |
| Last Updated | 152d ago | 33d ago | 33d ago |
| Age | 5m | 7m | 7m |
Health Breakdown
rune-tokenize
Maintenance
6
Quality
15
Community
7
Popularity
3
Documentation
10
tokf-common
Maintenance
17
Quality
14
Community
11
Popularity
4
Documentation
10
tokf-filter
Maintenance
17
Quality
14
Community
10
Popularity
4
Documentation
10
Technical Details
| rune-tokenize | tokf-common | tokf-filter | |
|---|---|---|---|
| Version | 0.1.0 | 0.2.54 | 0.2.54 |
| Stable (≥1.0) | ✗ No | ✗ No | ✗ No |
| License | MIT | MIT | MIT |
| Dependencies | 0 | 8 | 8 |
| Crate Size | 5KB | 44KB | 71KB |
| Features | 0 | 3 | 2 |
| Yanked % | 0.0% | 0.0% | 0.0% |
| Edition | 2021 | 2024 | 2024 |
| MSRV | — | — | — |
| Owners | 1 | 1 | 1 |
Links
Quick Verdict
- •tokf-common leads with a health score of 56/100, but none of the options score above 80.