mcp-evals

Name: mcp-evals
Rating: 3.24 (1 reviews)
Author: mclenhard

#804 · by mclenhard

agent tool-use multi-step

3.24/ 5.00

trustedBeta

Mar 3, 2026 at 7:21 AM6 signals analysedNo manual reviews · fully automated

Trust Signal Breakdown

unverified3 sub-signals across 6 dimensions

CVEs, dependency health, and supply chain integrity

3 of 3 sub-signals with data

Known CVEs40%5.0

No known CVEs

via OSV.dev

Dependency Health30%4.0

20 dependencies (low)

via npm / PyPI

Supply Chain30%5.0

Supply chain analyzed, no transitive CVEs

via npm provenance

Uptime, latency, error rates, and incident history

0 of 0 sub-signals with data

Commit recency, release cadence, issue response, CI/CD

0 of 0 sub-signals with data

Downloads, stars, dependents, and growth trajectory

0 of 0 sub-signals with data

License, documentation, security policy, changelog

0 of 0 sub-signals with data

Track record, org maturity, community standing

0 of 0 sub-signals with data

About this score

Scored across 3 sub-signals in 6 dimensionsScoring engine v1 (beta) — actively being expandedPhase 1: Core sub-signal architecture (live)Phase 2: Permission scope & expanded collection (in progress)

Trust AssessmentAI Assessment

GitHub Action for evaluating MCP server tool calls using LLM-based scoring

Package Availability (30d)

100.00%

p50: 58ms · p99: 58ms

Avg Latency

47ms

averaged across 30d health checks

Weekly Downloads

—

no package registry data

Incidents & Alertslast 90 days

Mar 1Trust score decreased by 0.563.24

Feb 21mcp-evals added to Trust Index2.57

Showing 2 of 2 events

Score History63 snapshots

5.003.752.501.250.00

Feb 21Mar 1

Supply Chain & Dependenciestrust chain

⬡

@actions/core

npm · ^1.10.0 · 2 CVEs

⬡

@ai-sdk/anthropic

npm · ^1.2.12

⬡

@ai-sdk/openai

npm · ^1.3.17

⬡

@anthropic-ai/sdk

npm · ^0.8.0

⬡

@modelcontextprotocol/sdk

npm · ^1.11.0 · 3 CVEs

⬡

@opentelemetry/api

npm · ^1.9.0

Showing 6 of 20 dependencies

Data Sources6 indexed

◎

OSV.devCVE database · vulnerability scanning for npm & PyPI packages

◈

GitHub APICommits, issues, releases, repo metadata, transparency checks

⬡

npm RegistryPackage metadata, weekly downloads, maintainers, dependencies

⬡

PyPIPackage metadata, weekly downloads, dependency tree

△

HTTP Health Checks15-min pings · uptime, latency, status monitoring

◎

PyPI StatsDownload statistics and trends

Version Historyscore per release

VERSIONRELEASEDSCOREDELTA

v1.0.14May 14, 20252.78—

v1.0.13May 14, 20252.78—

v1.0.12May 14, 20252.78—

v1.0.11May 14, 20252.78—

v1.0.10May 14, 20252.78—

v1.0.9Apr 24, 20252.78—

Showing 6 of 10 releases

Are you the publisher?

Claim this profile to unlock deeper evaluation, real-time monitoring,
and trust signals that help agents discover your service.

Share this Trust Score

Generate a scorecard image optimised for X, LinkedIn and other social platforms.

⬇ Download Score Card