rustio rustio.net
44

tokengeex

v1.1.0 Growing

TokenGeeX is an efficient tokenizer for code based on UnigramLM and TokenMonster.

Apache-2.0 Edition 2021
#tokenizer#nlp#llm#codegeex

Quick Verdict

  • โœ•Not updated for 1+ year
  • โœ“Stable API (1.x for 2+ years)
  • โœ“Permissive license (Apache-2.0)

Security

Checking security advisories...
Downloads
13.6K
Dependents
0
Releases
11
Size
52KB

Deep Insights

๐Ÿ“Š
Download activity

15 downloads in the last 30 days (1/day avg).

โœ…
Stable for 2+ years

The API has been stable (1.x) for over 2 years with 11 releases. This level of maturity means you can depend on it without worrying about breaking changes.

Health Breakdown

Maintenance 7/25

Recency, release consistency, active ratio

Quality 16/25

Yanked ratio, deps, size, maturity, features

Community 3/20

Reverse deps, ownership, ecosystem

Popularity 5/15

Downloads, momentum, growth trend

Documentation 13/15

Docs, repo, license, metadata

Download Trend

Daily downloads ยท last 90 days
0/day avg+10%
024681012/291/162/32/213/113/28

Version Adoption

v1.1.0
21%
v0.5.0
20%
v0.1.0
20%
v0.4.1
19%
v0.6.2
19%

Release Timeline

11 releasessince 2024
J
F
M
A
M
J
J
A
S
O
N
D
2024
11
2025
2026
Less
More

README

Loading README...

Maintainers

Dependencies
20
direct dependencies
Dependents
0
crates depend on tokengeex

Similar Crates