40
simple-tokenizer
v0.4.2 GrowingA tiny no_std tokenizer with line & column tracking.
MIT Edition 2021
Quick Verdict
- ✕Not updated for 1+ year
- !Pre-1.0: API may have breaking changes
- ✓Tiny footprint (6KB, 1 deps)
- ✓Permissive license (MIT)
Security
Checking security advisories...
Downloads
6.6K
Dependents
0
Releases
5
Size
6KB
Deep Insights
📈
Strong growth momentum
7 downloads in the last 30 days (0/day), up 40% from the previous period.
🔬
Pre-1.0 for over a year
Despite being 2+ years old, simple-tokenizer hasn't reached 1.0 yet. Expect potential API changes between versions.
🪶
Minimal dependencies
Only 1 direct dependencies. Lean dependency tree means faster builds and lower supply chain risk.
📐
Compact crate
At 6KB, simple-tokenizer is lightweight. Small crate size correlates with focused, well-scoped functionality.
Health Breakdown
Maintenance 5/25
Recency, release consistency, active ratio
Quality 16/25
Yanked ratio, deps, size, maturity, features
Community 4/20
Reverse deps, ownership, ecosystem
Popularity 5/15
Downloads, momentum, growth trend
Documentation 10/15
Docs, repo, license, metadata
Download Trend
Daily downloads · last 90 days
0/day avg-17%
Version Adoption
v0.4.1
22%
v0.4.2
21%
v0.4.0
20%
v0.2.0
19%
v0.1.0
18%
Release Timeline
5 releasessince 2023
J
F
M
A
M
J
J
A
S
O
N
D
2023
2
2024
3
2025
2026
LessMore
Feature Flags
README
Loading README...
Maintainers
Dependencies
1
direct dependencies
Dependents
0
crates depend on simple-tokenizer