Skip to content

Iris

Local package path declaredNo credentials listedRepository declared by sourceUpdated 2026-10-04

io.github.iris-eval/mcp-server · Registry status: active

Report data on this entry

At a glance

Stop shipping agents on vibes. Score every agent output for quality, safety, and cost.

Vendor's own description, untranslated and unverified

Execution location
Local package path declaredMCP-Register · 2026-08-06
Required secrets declared
No credentials listedMCP-Register · 2026-08-06
Declared version and change
0.20.0 · Source-reported change date 2026-10-04MCP-Register · 2026-10-05
Repository as declared
github.com/iris-eval/mcp-serverMCP-Register · 2026-08-06
Configuration
can be built from the disclosed start template

Inspect connection paths and prerequisites

Related categories

Page last changed:

Sources and collection
Runs
Local package path declared
Credentials
No credentials listed
Registry record changed
2026-10-04
Setup
Template available
Registry name
io.github.iris-eval/mcp-server
Package coordinate
npm:@iris-eval/mcp-server
Declared version
0.20.0
Source-reported listing date
2026-10-04
Source-reported change date
2026-10-04
First seen by tracevero
2026-08-06
Vendor's website
https://iris-eval.com

Evidence for this page: The values on this page come from several collections. Each row therefore states its own origin. What the confidence levels mean

Measured values

Measured values
Required secrets declaredNo credentials listed no
Original data – Required secret variables (raw): confirmed absent
Original data – Required secret headers (raw): confirmed absent
Source: MCP-Register · collected on 2026-08-06 · derived
Execution locationLocal package path declared local
Original data – Transports (raw): stdio, stdio
Source: MCP-Register · collected on 2026-08-06 · derived
Path argument presentno
Original data – Path arguments (raw): confirmed absent
Original data – Path environment variables (raw): confirmed absent
Source: MCP-Register · collected on 2026-08-06 · derived
Repository URL listedRepository declared by source yes
Original data – Repository (raw): https://github.com/iris-eval/mcp-server
Source: MCP-Register · collected on 2026-08-06 · derived
Declared version0.20.0
Source: MCP-Register · collected on 2026-10-05 · self-declared

What is measured is what a manifest declares, not what a piece of software does. This registry fetches no repository URL, no endpoint and no package index; nothing here is verified. Which value comes from which source, and by which rule it was formed, is set out in the Methodology.

Source data25

Evidence for this page: The values on this page come from several collections. Each row therefore states its own origin.

Raw values
Description (raw)Stop shipping agents on vibes. Score every agent output for quality, safety, and cost.
Source: MCP-Register · collected on 2026-09-04 · self-declared
Environment variables (raw)IRIS_API_KEY, IRIS_API_KEY_FILE, IRIS_ALLOW_UNAUTHENTICATED, IRIS_DB_PATH, IRIS_SQLITE_DRIVER, IRIS_SEARCH_BUDGET_MS, IRIS_SEARCH_INDEX, IRIS_LOG_LEVEL, IRIS_HOME, IRIS_ANTHROPIC_API_KEY, IRIS_OPENAI_API_KEY, IRIS_LLM_JUDGE_MAX_COST_USD_PER_EVAL, IRIS_RELEVANCE_JUDGE_MODEL, IRIS_RELEVANCE_JUDGE_DAILY_BUDGET_USD, IRIS_RELEVANCE_JUDGE_MAX_CALLS_PER_REQUEST, IRIS_RELEVANCE_JUDGE_REDACT, IRIS_CITATION_ALLOW_FETCH, IRIS_DASHBOARD, IRIS_DASHBOARD_PORT, IRIS_PORT, IRIS_OTEL_ENDPOINT, IRIS_CITATION_DOMAINS, IRIS_TRANSPORT, IRIS_HOST, IRIS_ALLOWED_ORIGINS, IRIS_DASHBOARD_HOST, IRIS_OTEL_HEADERS, IRIS_OTEL_SERVICE_NAME, IRIS_OTEL_TIMEOUT_MS, IRIS_WEBHOOK_URL, IRIS_WEBHOOK_SECRET
Source: MCP-Register · collected on 2026-10-05 · self-declared
Required secret variables (raw)confirmed absent
Source: MCP-Register · collected on 2026-08-06 · self-declared
Transports (raw)stdio, stdio
Source: MCP-Register · collected on 2026-10-05 · self-declared
Path arguments (raw)confirmed absent
Source: MCP-Register · collected on 2026-08-06 · self-declared
Repository (raw)https://github.com/iris-eval/mcp-server
Source: MCP-Register · collected on 2026-08-06 · self-declared
Package registries (raw)mcpb, npm
Source: MCP-Register · collected on 2026-10-05 · self-declared
Required secret headers (raw)confirmed absent
Source: MCP-Register · collected on 2026-08-16 · self-declared
Path environment variables (raw)confirmed absent
Source: MCP-Register · collected on 2026-08-16 · self-declared
Remote URLs (raw)confirmed absent
Source: MCP-Register · collected on 2026-08-16 · self-declared
Remote hosts (raw)confirmed absent
Source: MCP-Register · collected on 2026-08-16 · self-declared
Registry status message (raw)confirmed absent
Source: MCP-Register · collected on 2026-08-16 · self-declared
First listed in the registry (raw)2026-10-04
Source: MCP-Register · collected on 2026-10-05 · self-declared
Last changed in the registry (raw)2026-10-04
Source: MCP-Register · collected on 2026-10-05 · self-declared
Schema version of the raw record (raw)https://static.modelcontextprotocol.io/schemas/2025-12-11/server.schema.json
Source: MCP-Register · collected on 2026-08-16 · self-declared
Delivery form (raw)package
Source: MCP-Register · collected on 2026-08-16 · self-declared
Repository platform (raw)github
Source: MCP-Register · collected on 2026-08-16 · self-declared
Repository subfolder (raw)confirmed absent
Source: MCP-Register · collected on 2026-08-16 · self-declared
Package identifiers (raw)@iris-eval/mcp-server, https://github.com/iris-eval/mcp-server/releases/download/v0.20.0/iris-eval.mcpb
Source: MCP-Register · collected on 2026-10-05 · self-declared
Package versions (raw)0.20.0
Source: MCP-Register · collected on 2026-10-05 · self-declared
Runtime hints (raw)confirmed absent
Source: MCP-Register · collected on 2026-08-16 · self-declared
Environment variable formats (raw)boolean, number, string
Source: MCP-Register · collected on 2026-09-05 · self-declared
Environment variable descriptions (raw)IRIS_ALLOWED_ORIGINS=Comma-separated Origin allowlist for the HTTP transport and dashboard CORS (default http://localhost:*) · IRIS_ALLOW_UNAUTHENTICATED=Set to 1 to run a non-loopback bind with NO API key on purpose (lifts the startup refusal; the network is then your boundary) · IRIS_ANTHROPIC_API_KEY=Enables evaluate_with_llm_judge and verify_citations with an Anthropic model. Optional: the deterministic rules never need a key · IRIS_API_KEY=API key for HTTP authentication. Required to bind the HTTP transport or the dashboard beyond loopback (0.0.0.0, a LAN address, a container): without it the server refuses to start · IRIS_API_KEY_FILE=Path to a file whose trimmed contents are the API key (the secret-file pattern Docker and Kubernetes mount). Set this or IRIS_API_KEY, not both; further keys and rotation are security.apiKeys in config.json · IRIS_CITATION_ALLOW_FETCH=Let verify_citations fetch URLs (off by default) · IRIS_CITATION_DOMAINS=Comma-separated domain allowlist for verify_citations fetches (only consulted when IRIS_CITATION_ALLOW_FETCH is on) · IRIS_DASHBOARD=Start the dashboard alongside the server (same as --dashboard) · IRIS_DASHBOARD_HOST=Bind host for the dashboard (default 127.0.0.1); same as --dashboard-host · IRIS_DASHBOARD_PORT=Dashboard port (default 6920); IRIS_PORT is the MCP HTTP transport port (default 3000) · IRIS_DB_PATH=SQLite database path · IRIS_HOME=Directory for the database, custom rules and preferences (default ~/.iris) · IRIS_HOST=Bind host for the HTTP transport (default 127.0.0.1); only used with --transport http · IRIS_LLM_JUDGE_MAX_COST_USD_PER_EVAL=Hard cap on the worst-case cost of one judge or citation call (default 0.25) · IRIS_LOG_LEVEL=Log level: debug, info, warn, error · IRIS_OPENAI_API_KEY=Enables evaluate_with_llm_judge and verify_citations with an OpenAI model. Optional: the deterministic rules never need a key · IRIS_OTEL_ENDPOINT=OTLP/HTTP collector URL; when set, every stored trace is also exported as OpenTelemetry spans (best-effort, asynchronous) · IRIS_OTEL_HEADERS=Comma-separated key=value headers sent with every OTLP export (for example an auth token for your collector) · IRIS_OTEL_SERVICE_NAME=service.name resource attribute on exported spans (default iris-eval) · IRIS_OTEL_TIMEOUT_MS=Timeout in milliseconds for each OTLP export request · IRIS_PORT=MCP HTTP transport port (default 3000); only used with --transport http · IRIS_RELEVANCE_JUDGE_DAILY_BUDGET_USD=What the relevance judge may spend per UTC day, per tenant, in USD (default 1); past it answers_the_ask reads the ask lexically · IRIS_RELEVANCE_JUDGE_MAX_CALLS_PER_REQUEST=Relevance judge calls one request may make (default 20) · IRIS_RELEVANCE_JUDGE_MODEL=A priced judge model; answers_the_ask then asks it on every evaluation with input, sending that input and output to the model's provider, and gates on its verdict (off by default) · IRIS_RELEVANCE_JUDGE_REDACT=on (default) replaces the PII and credentials no_pii flags before the relevance judge sends input and output to its provider; off sends them as they are · IRIS_SEARCH_BUDGET_MS=How long one trace search may read before it answers with the matches found so far, in milliseconds (50-60000, default 1000) · IRIS_SEARCH_INDEX=on (default) or off. off keeps no full-text index of the traces: writes are cheaper, and a search reads the traces within its time budget · IRIS_SQLITE_DRIVER=Which SQLite driver holds the database: native (better-sqlite3, the default) or node (Node's built-in node:sqlite, Node 22.13+). Unset: native, falling back to node when the native module cannot load · IRIS_TRANSPORT=Transport: stdio (default) or http; same as --transport · IRIS_WEBHOOK_SECRET=The signing key of that webhook (any string, or whsec_ + base64); the iris format refuses to run without one · IRIS_WEBHOOK_URL=The receiver of the webhook that fires on a moment (docs/webhooks.md); merged over notify.webhook in config.json
Source: MCP-Register · collected on 2026-10-05 · self-declared
Icon formats (raw)image/png, image/svg+xml
Source: MCP-Register · collected on 2026-09-23 · self-declared
Connection paths (source structure){"packages":[{"registryType":"npm","identifier":"@iris-eval/mcp-server","version":"0.20.0","transport":"stdio","environment":[{"name":"IRIS_API_KEY","description":"API key for HTTP authentication. Required to bind the HTTP transport or the dashboard beyond loopback (0.0.0.0, a LAN address, a container): without it the server refuses to start","format":"string","required":false,"secret":true},{"name":"IRIS_API_KEY_FILE","description":"Path to a file whose trimmed contents are the API key (the secret-file pattern Docker and Kubernetes mount). Set this or IRIS_API_KEY, not both; further keys and rotation are security.apiKeys in config.json","format":"string","required":false,"secret":false},{"name":"IRIS_ALLOW_UNAUTHENTICATED","description":"Set to 1 to run a non-loopback bind with NO API key on purpose (lifts the startup refusal; the network is then your boundary)","format":"string","required":false,"secret":false},{"name":"IRIS_DB_PATH","description":"SQLite database path","format":"string","required":false,"secret":false},{"name":"IRIS_SQLITE_DRIVER","description":"Which SQLite driver holds the database: native (better-sqlite3, the default) or node (Node's built-in node:sqlite, Node 22.13+). Unset: native, falling back to node when the native module cannot load","format":"string","required":false,"secret":false},{"name":"IRIS_SEARCH_BUDGET_MS","description":"How long one trace search may read before it answers with the matches found so far, in milliseconds (50-60000, default 1000)","format":"string","required":false,"secret":false},{"name":"IRIS_SEARCH_INDEX","description":"on (default) or off. off keeps no full-text index of the traces: writes are cheaper, and a search reads the traces within its time budget","format":"string","required":false,"secret":false},{"name":"IRIS_LOG_LEVEL","description":"Log level: debug, info, warn, error","format":"string","required":false,"secret":false},{"name":"IRIS_HOME","description":"Directory for the database, custom rules and preferences (default ~/.iris)","format":"string","required":false,"secret":false},{"name":"IRIS_ANTHROPIC_API_KEY","description":"Enables evaluate_with_llm_judge and verify_citations with an Anthropic model. Optional: the deterministic rules never need a key","format":"string","required":false,"secret":true},{"name":"IRIS_OPENAI_API_KEY","description":"Enables evaluate_with_llm_judge and verify_citations with an OpenAI model. Optional: the deterministic rules never need a key","format":"string","required":false,"secret":true},{"name":"IRIS_LLM_JUDGE_MAX_COST_USD_PER_EVAL","description":"Hard cap on the worst-case cost of one judge or citation call (default 0.25)","format":"string","required":false,"secret":false},{"name":"IRIS_RELEVANCE_JUDGE_MODEL","description":"A priced judge model; answers_the_ask then asks it on every evaluation with input, sending that input and output to the model's provider, and gates on its verdict (off by default)","format":"string","required":false,"secret":false},{"name":"IRIS_RELEVANCE_JUDGE_DAILY_BUDGET_USD","description":"What the relevance judge may spend per UTC day, per tenant, in USD (default 1); past it answers_the_ask reads the ask lexically","format":"string","required":false,"secret":false},{"name":"IRIS_RELEVANCE_JUDGE_MAX_CALLS_PER_REQUEST","description":"Relevance judge calls one request may make (default 20)","format":"string","required":false,"secret":false},{"name":"IRIS_RELEVANCE_JUDGE_REDACT","description":"on (default) replaces the PII and credentials no_pii flags before the relevance judge sends input and output to its provider; off sends them as they are","format":"string","required":false,"secret":false},{"name":"IRIS_CITATION_ALLOW_FETCH","description":"Let verify_citations fetch URLs (off by default)","format":"boolean","required":false,"secret":false},{"name":"IRIS_DASHBOARD","description":"Start the dashboard alongside the server (same as --dashboard)","format":"boolean","required":false,"secret":false},{"name":"IRIS_DASHBOARD_PORT","description":"Dashboard port (default 6920); IRIS_PORT is the MCP HTTP transport port (default 3000)","format":"number","required":false,"secret":false},{"name":"IRIS_PORT","description":"MCP HTTP transport port (default 3000); only used with --transport http","format":"number","required":false,"secret":false},{"name":"IRIS_OTEL_ENDPOINT","description":"OTLP/HTTP collector URL; when set, every stored trace is also exported as OpenTelemetry spans (best-effort, asynchronous)","format":"string","required":false,"secret":false},{"name":"IRIS_CITATION_DOMAINS","description":"Comma-separated domain allowlist for verify_citations fetches (only consulted when IRIS_CITATION_ALLOW_FETCH is on)","format":"string","required":false,"secret":false},{"name":"IRIS_TRANSPORT","description":"Transport: stdio (default) or http; same as --transport","format":"string","required":false,"secret":false},{"name":"IRIS_HOST","description":"Bind host for the HTTP transport (default 127.0.0.1); only used with --transport http","format":"string","required":false,"secret":false},{"name":"IRIS_ALLOWED_ORIGINS","description":"Comma-separated Origin allowlist for the HTTP transport and dashboard CORS (default http://localhost:*)","format":"string","required":false,"secret":false},{"name":"IRIS_DASHBOARD_HOST","description":"Bind host for the dashboard (default 127.0.0.1); same as --dashboard-host","format":"string","required":false,"secret":false},{"name":"IRIS_OTEL_HEADERS","description":"Comma-separated key=value headers sent with every OTLP export (for example an auth token for your collector)","format":"string","required":false,"secret":false},{"name":"IRIS_OTEL_SERVICE_NAME","description":"service.name resource attribute on exported spans (default iris-eval)","format":"string","required":false,"secret":false},{"name":"IRIS_OTEL_TIMEOUT_MS","description":"Timeout in milliseconds for each OTLP export request","format":"number","required":false,"secret":false},{"name":"IRIS_WEBHOOK_URL","description":"The receiver of the webhook that fires on a moment (docs/webhooks.md); merged over notify.webhook in config.json","format":"string","required":false,"secret":false},{"name":"IRIS_WEBHOOK_SECRET","description":"The signing key of that webhook (any string, or whsec_ + base64); the iris format refuses to run without one","format":"string","required":false,"secret":true}],"additional_arguments_declared":false},{"registryType":"mcpb","identifier":"https://github.com/iris-eval/mcp-server/releases/download/v0.20.0/iris-eval.mcpb","version":"0.20.0","transport":"stdio","environment":[],"additional_arguments_declared":false}],"remotes":[]}
Source: MCP-Register · collected on 2026-10-05 · self-declared
Embed this badge

Paste this line into a README of your own. The badge states how many values the registry holds for the entry and when it last looked, and it links back to this page.

tracevero: number of measured values and date of collection for this registry entry

[![tracevero: number of measured values and date of collection for this registry entry](https://tracevero.com/badge/mcp/io-github-iris-eval-mcp-server.svg)](https://tracevero.com/mcp/io-github-iris-eval-mcp-server)

The image is drawn again on every request, so it always reports the current state while the pasted line stays as it is. It carries no rating and no traffic light – only the two measured figures.

Changes

Changes
2026-10-05Declared version: 0.19.0 → 0.20.0
2026-10-05Last changed in the registry (raw): 2026-09-25 → 2026-10-04
2026-10-05First listed in the registry (raw): 2026-09-25 → 2026-10-04

These are the 3 most recent changes to this entry. Full history

tracevero · https://tracevero.com/mcp/io-github-iris-eval-mcp-server