rustio rustio.net
45

segtok

v0.1.5 Growing

Sentence segmentation and word tokenization tools

MIT Edition 2021
Text processing #tokenizer#word#split#segmenter

Quick Verdict

  • โœ•Not updated for 1+ year
  • !Pre-1.0: API may have breaking changes
  • โœ“Permissive license (MIT)

Security

Checking security advisories...
Downloads
275.0K
Dependents
10
Releases
6
Size
36KB

Deep Insights

๐Ÿ“ˆ
Strong growth momentum

188.3K downloads in the last 30 days (6.3K/day), up 278% from the previous period.

๐Ÿ”ฌ
Pre-1.0 for over a year

Despite being 1+ years old, segtok hasn't reached 1.0 yet. Expect potential API changes between versions.

๐Ÿ“
Compact crate

At 36KB, segtok is lightweight. Small crate size correlates with focused, well-scoped functionality.

Health Breakdown

Maintenance 8/25

Recency, release consistency, active ratio

Quality 13/25

Yanked ratio, deps, size, maturity, features

Community 8/20

Reverse deps, ownership, ecosystem

Popularity 6/15

Downloads, momentum, growth trend

Documentation 10/15

Docs, repo, license, metadata

Download Trend

Daily downloads ยท last 90 days
3K/day avg+383%
02K4K6K8K12/291/162/32/213/113/28

Top Dependents

Most downloaded crates that depend on segtok

Version Adoption

v0.1.5
99%
v0.1.3
0%
v0.1.4
0%
v0.1.0
0%
v0.1.1
0%

Release Timeline

6 releasessince 2025
J
F
M
A
M
J
J
A
S
O
N
D
2025
6
2026
Less
More

README

Loading README...

Maintainers

Dependencies
8
direct dependencies
Dependents
10
crates depend on segtok

Similar Crates