tokenizers

Name: tokenizers
Rating: 3.24 (1 reviews)
Author: Hugging Face

#804 · by Hugging Face

infra serverless GPU

3.24/ 5.00

trustedBeta

Mar 3, 2026 at 7:21 AM6 signals analysedNo manual reviews · fully automated

Trust Signal Breakdown

high3 sub-signals across 6 dimensions

CVEs, dependency health, and supply chain integrity

3 of 3 sub-signals with data

Known CVEs40%5.0

No known CVEs

via OSV.dev

Dependency Health30%5.0

12 dependencies (minimal)

via npm / PyPI

Supply Chain30%4.8

28 transitive CVEs found (penalty: -0.25)

via npm provenance

Uptime, latency, error rates, and incident history

0 of 0 sub-signals with data

Commit recency, release cadence, issue response, CI/CD

0 of 0 sub-signals with data

Downloads, stars, dependents, and growth trajectory

0 of 0 sub-signals with data

License, documentation, security policy, changelog

0 of 0 sub-signals with data

Track record, org maturity, community standing

0 of 0 sub-signals with data

About this score

Scored across 3 sub-signals in 6 dimensionsScoring engine v1 (beta) — actively being expandedPhase 1: Core sub-signal architecture (live)Phase 2: Permission scope & expanded collection (in progress)

Trust AssessmentAI Assessment

Fast, state-of-the-art tokenizers optimized for research and production, built by Hugging Face.

Package Availability (30d)

100.00%

p50: 44ms · p99: 84ms

Avg Latency

54ms

averaged across 30d health checks

Weekly Downloads

—

no package registry data

Incidents & Alertslast 90 days

Mar 1Trust score decreased by 1.373.24

Feb 24Trust score increased by 2.004.52

Feb 23tokenizers added to Trust Index3.43

Showing 3 of 3 events

Score History90 snapshots

5.003.752.501.250.00

Feb 23Feb 27

Supply Chain & Dependenciestrust chain

◈

datasets

pypi · *

◈

huggingface-hub

pypi · <2.0,>=0.16.4

◈

numpy

pypi · * · 16 CVEs16L

◈

pytest

pypi · *

◈

pytest-asyncio

pypi · *

◈

requests

pypi · * · 12 CVEs11L1M

Showing 6 of 12 dependencies

Data Sources6 indexed

◎

OSV.devCVE database · vulnerability scanning for npm & PyPI packages

◈

GitHub APICommits, issues, releases, repo metadata, transparency checks

⬡

npm RegistryPackage metadata, weekly downloads, maintainers, dependencies

⬡

PyPIPackage metadata, weekly downloads, dependency tree

△

HTTP Health Checks15-min pings · uptime, latency, status monitoring

◎

PyPI StatsDownload statistics and trends

Version Historyscore per release

VERSIONRELEASEDSCOREDELTA

v0.22.2Dec 2, 20254.16—

v0.22.1Sep 19, 20254.16—

v0.22.0Aug 29, 20254.16—

v0.21.4Jul 28, 20254.16—

v0.21.3Jul 4, 20254.16—

v0.21.2Jun 24, 20254.16—

Showing 6 of 10 releases

Are you the publisher?

Claim this profile to unlock deeper evaluation, real-time monitoring,
and trust signals that help agents discover your service.

Share this Trust Score

Generate a scorecard image optimised for X, LinkedIn and other social platforms.

⬇ Download Score Card