Skip to content

Raw values for Iris

io.github.iris-eval/mcp-server · Registry status: active

Report data on this entry

What the source declared verbatim, unchanged and uninterpreted. The derived values on the overview page are computed from these.

Evidence for this page: The values on this page come from several collections. Each row therefore states its own origin.

Raw values
Description (raw)Stop shipping agents on vibes. Score every agent output for quality, safety, and cost.
Source: MCP-Register · collected on 2026-09-04 · self-declared
Environment variables (raw)IRIS_API_KEY, IRIS_API_KEY_FILE, IRIS_ALLOW_UNAUTHENTICATED, IRIS_DB_PATH, IRIS_SQLITE_DRIVER, IRIS_SEARCH_BUDGET_MS, IRIS_SEARCH_INDEX, IRIS_LOG_LEVEL, IRIS_HOME, IRIS_ANTHROPIC_API_KEY, IRIS_OPENAI_API_KEY, IRIS_LLM_JUDGE_MAX_COST_USD_PER_EVAL, IRIS_RELEVANCE_JUDGE_MODEL, IRIS_RELEVANCE_JUDGE_DAILY_BUDGET_USD, IRIS_RELEVANCE_JUDGE_MAX_CALLS_PER_REQUEST, IRIS_RELEVANCE_JUDGE_REDACT, IRIS_CITATION_ALLOW_FETCH, IRIS_DASHBOARD, IRIS_DASHBOARD_PORT, IRIS_PORT, IRIS_OTEL_ENDPOINT, IRIS_CITATION_DOMAINS, IRIS_TRANSPORT, IRIS_HOST, IRIS_ALLOWED_ORIGINS, IRIS_DASHBOARD_HOST, IRIS_OTEL_HEADERS, IRIS_OTEL_SERVICE_NAME, IRIS_OTEL_TIMEOUT_MS, IRIS_WEBHOOK_URL, IRIS_WEBHOOK_SECRET
Source: MCP-Register · collected on 2026-10-05 · self-declared
Required secret variables (raw)confirmed absent
Source: MCP-Register · collected on 2026-08-06 · self-declared
Transports (raw)stdio, stdio
Source: MCP-Register · collected on 2026-10-05 · self-declared
Path arguments (raw)confirmed absent
Source: MCP-Register · collected on 2026-08-06 · self-declared
Repository (raw)https://github.com/iris-eval/mcp-server
Source: MCP-Register · collected on 2026-08-06 · self-declared
Package registries (raw)mcpb, npm
Source: MCP-Register · collected on 2026-10-05 · self-declared
Required secret headers (raw)confirmed absent
Source: MCP-Register · collected on 2026-08-16 · self-declared
Path environment variables (raw)confirmed absent
Source: MCP-Register · collected on 2026-08-16 · self-declared
Remote URLs (raw)confirmed absent
Source: MCP-Register · collected on 2026-08-16 · self-declared
Remote hosts (raw)confirmed absent
Source: MCP-Register · collected on 2026-08-16 · self-declared
Registry status message (raw)confirmed absent
Source: MCP-Register · collected on 2026-08-16 · self-declared
First listed in the registry (raw)2026-10-04
Source: MCP-Register · collected on 2026-10-05 · self-declared
Last changed in the registry (raw)2026-10-04
Source: MCP-Register · collected on 2026-10-05 · self-declared
Schema version of the raw record (raw)https://static.modelcontextprotocol.io/schemas/2025-12-11/server.schema.json
Source: MCP-Register · collected on 2026-08-16 · self-declared
Delivery form (raw)package
Source: MCP-Register · collected on 2026-08-16 · self-declared
Repository platform (raw)github
Source: MCP-Register · collected on 2026-08-16 · self-declared
Repository subfolder (raw)confirmed absent
Source: MCP-Register · collected on 2026-08-16 · self-declared
Package identifiers (raw)@iris-eval/mcp-server, https://github.com/iris-eval/mcp-server/releases/download/v0.20.0/iris-eval.mcpb
Source: MCP-Register · collected on 2026-10-05 · self-declared
Package versions (raw)0.20.0
Source: MCP-Register · collected on 2026-10-05 · self-declared
Runtime hints (raw)confirmed absent
Source: MCP-Register · collected on 2026-08-16 · self-declared
Environment variable formats (raw)boolean, number, string
Source: MCP-Register · collected on 2026-09-05 · self-declared
Environment variable descriptions (raw)IRIS_ALLOWED_ORIGINS=Comma-separated Origin allowlist for the HTTP transport and dashboard CORS (default http://localhost:*) · IRIS_ALLOW_UNAUTHENTICATED=Set to 1 to run a non-loopback bind with NO API key on purpose (lifts the startup refusal; the network is then your boundary) · IRIS_ANTHROPIC_API_KEY=Enables evaluate_with_llm_judge and verify_citations with an Anthropic model. Optional: the deterministic rules never need a key · IRIS_API_KEY=API key for HTTP authentication. Required to bind the HTTP transport or the dashboard beyond loopback (0.0.0.0, a LAN address, a container): without it the server refuses to start · IRIS_API_KEY_FILE=Path to a file whose trimmed contents are the API key (the secret-file pattern Docker and Kubernetes mount). Set this or IRIS_API_KEY, not both; further keys and rotation are security.apiKeys in config.json · IRIS_CITATION_ALLOW_FETCH=Let verify_citations fetch URLs (off by default) · IRIS_CITATION_DOMAINS=Comma-separated domain allowlist for verify_citations fetches (only consulted when IRIS_CITATION_ALLOW_FETCH is on) · IRIS_DASHBOARD=Start the dashboard alongside the server (same as --dashboard) · IRIS_DASHBOARD_HOST=Bind host for the dashboard (default 127.0.0.1); same as --dashboard-host · IRIS_DASHBOARD_PORT=Dashboard port (default 6920); IRIS_PORT is the MCP HTTP transport port (default 3000) · IRIS_DB_PATH=SQLite database path · IRIS_HOME=Directory for the database, custom rules and preferences (default ~/.iris) · IRIS_HOST=Bind host for the HTTP transport (default 127.0.0.1); only used with --transport http · IRIS_LLM_JUDGE_MAX_COST_USD_PER_EVAL=Hard cap on the worst-case cost of one judge or citation call (default 0.25) · IRIS_LOG_LEVEL=Log level: debug, info, warn, error · IRIS_OPENAI_API_KEY=Enables evaluate_with_llm_judge and verify_citations with an OpenAI model. Optional: the deterministic rules never need a key · IRIS_OTEL_ENDPOINT=OTLP/HTTP collector URL; when set, every stored trace is also exported as OpenTelemetry spans (best-effort, asynchronous) · IRIS_OTEL_HEADERS=Comma-separated key=value headers sent with every OTLP export (for example an auth token for your collector) · IRIS_OTEL_SERVICE_NAME=service.name resource attribute on exported spans (default iris-eval) · IRIS_OTEL_TIMEOUT_MS=Timeout in milliseconds for each OTLP export request · IRIS_PORT=MCP HTTP transport port (default 3000); only used with --transport http · IRIS_RELEVANCE_JUDGE_DAILY_BUDGET_USD=What the relevance judge may spend per UTC day, per tenant, in USD (default 1); past it answers_the_ask reads the ask lexically · IRIS_RELEVANCE_JUDGE_MAX_CALLS_PER_REQUEST=Relevance judge calls one request may make (default 20) · IRIS_RELEVANCE_JUDGE_MODEL=A priced judge model; answers_the_ask then asks it on every evaluation with input, sending that input and output to the model's provider, and gates on its verdict (off by default) · IRIS_RELEVANCE_JUDGE_REDACT=on (default) replaces the PII and credentials no_pii flags before the relevance judge sends input and output to its provider; off sends them as they are · IRIS_SEARCH_BUDGET_MS=How long one trace search may read before it answers with the matches found so far, in milliseconds (50-60000, default 1000) · IRIS_SEARCH_INDEX=on (default) or off. off keeps no full-text index of the traces: writes are cheaper, and a search reads the traces within its time budget · IRIS_SQLITE_DRIVER=Which SQLite driver holds the database: native (better-sqlite3, the default) or node (Node's built-in node:sqlite, Node 22.13+). Unset: native, falling back to node when the native module cannot load · IRIS_TRANSPORT=Transport: stdio (default) or http; same as --transport · IRIS_WEBHOOK_SECRET=The signing key of that webhook (any string, or whsec_ + base64); the iris format refuses to run without one · IRIS_WEBHOOK_URL=The receiver of the webhook that fires on a moment (docs/webhooks.md); merged over notify.webhook in config.json
Source: MCP-Register · collected on 2026-10-05 · self-declared
Icon formats (raw)image/png, image/svg+xml
Source: MCP-Register · collected on 2026-09-23 · self-declared
Connection paths (source structure){"packages":[{"registryType":"npm","identifier":"@iris-eval/mcp-server","version":"0.20.0","transport":"stdio","environment":[{"name":"IRIS_API_KEY","description":"API key for HTTP authentication. Required to bind the HTTP transport or the dashboard beyond loopback (0.0.0.0, a LAN address, a container): without it the server refuses to start","format":"string","required":false,"secret":true},{"name":"IRIS_API_KEY_FILE","description":"Path to a file whose trimmed contents are the API key (the secret-file pattern Docker and Kubernetes mount). Set this or IRIS_API_KEY, not both; further keys and rotation are security.apiKeys in config.json","format":"string","required":false,"secret":false},{"name":"IRIS_ALLOW_UNAUTHENTICATED","description":"Set to 1 to run a non-loopback bind with NO API key on purpose (lifts the startup refusal; the network is then your boundary)","format":"string","required":false,"secret":false},{"name":"IRIS_DB_PATH","description":"SQLite database path","format":"string","required":false,"secret":false},{"name":"IRIS_SQLITE_DRIVER","description":"Which SQLite driver holds the database: native (better-sqlite3, the default) or node (Node's built-in node:sqlite, Node 22.13+). Unset: native, falling back to node when the native module cannot load","format":"string","required":false,"secret":false},{"name":"IRIS_SEARCH_BUDGET_MS","description":"How long one trace search may read before it answers with the matches found so far, in milliseconds (50-60000, default 1000)","format":"string","required":false,"secret":false},{"name":"IRIS_SEARCH_INDEX","description":"on (default) or off. off keeps no full-text index of the traces: writes are cheaper, and a search reads the traces within its time budget","format":"string","required":false,"secret":false},{"name":"IRIS_LOG_LEVEL","description":"Log level: debug, info, warn, error","format":"string","required":false,"secret":false},{"name":"IRIS_HOME","description":"Directory for the database, custom rules and preferences (default ~/.iris)","format":"string","required":false,"secret":false},{"name":"IRIS_ANTHROPIC_API_KEY","description":"Enables evaluate_with_llm_judge and verify_citations with an Anthropic model. Optional: the deterministic rules never need a key","format":"string","required":false,"secret":true},{"name":"IRIS_OPENAI_API_KEY","description":"Enables evaluate_with_llm_judge and verify_citations with an OpenAI model. Optional: the deterministic rules never need a key","format":"string","required":false,"secret":true},{"name":"IRIS_LLM_JUDGE_MAX_COST_USD_PER_EVAL","description":"Hard cap on the worst-case cost of one judge or citation call (default 0.25)","format":"string","required":false,"secret":false},{"name":"IRIS_RELEVANCE_JUDGE_MODEL","description":"A priced judge model; answers_the_ask then asks it on every evaluation with input, sending that input and output to the model's provider, and gates on its verdict (off by default)","format":"string","required":false,"secret":false},{"name":"IRIS_RELEVANCE_JUDGE_DAILY_BUDGET_USD","description":"What the relevance judge may spend per UTC day, per tenant, in USD (default 1); past it answers_the_ask reads the ask lexically","format":"string","required":false,"secret":false},{"name":"IRIS_RELEVANCE_JUDGE_MAX_CALLS_PER_REQUEST","description":"Relevance judge calls one request may make (default 20)","format":"string","required":false,"secret":false},{"name":"IRIS_RELEVANCE_JUDGE_REDACT","description":"on (default) replaces the PII and credentials no_pii flags before the relevance judge sends input and output to its provider; off sends them as they are","format":"string","required":false,"secret":false},{"name":"IRIS_CITATION_ALLOW_FETCH","description":"Let verify_citations fetch URLs (off by default)","format":"boolean","required":false,"secret":false},{"name":"IRIS_DASHBOARD","description":"Start the dashboard alongside the server (same as --dashboard)","format":"boolean","required":false,"secret":false},{"name":"IRIS_DASHBOARD_PORT","description":"Dashboard port (default 6920); IRIS_PORT is the MCP HTTP transport port (default 3000)","format":"number","required":false,"secret":false},{"name":"IRIS_PORT","description":"MCP HTTP transport port (default 3000); only used with --transport http","format":"number","required":false,"secret":false},{"name":"IRIS_OTEL_ENDPOINT","description":"OTLP/HTTP collector URL; when set, every stored trace is also exported as OpenTelemetry spans (best-effort, asynchronous)","format":"string","required":false,"secret":false},{"name":"IRIS_CITATION_DOMAINS","description":"Comma-separated domain allowlist for verify_citations fetches (only consulted when IRIS_CITATION_ALLOW_FETCH is on)","format":"string","required":false,"secret":false},{"name":"IRIS_TRANSPORT","description":"Transport: stdio (default) or http; same as --transport","format":"string","required":false,"secret":false},{"name":"IRIS_HOST","description":"Bind host for the HTTP transport (default 127.0.0.1); only used with --transport http","format":"string","required":false,"secret":false},{"name":"IRIS_ALLOWED_ORIGINS","description":"Comma-separated Origin allowlist for the HTTP transport and dashboard CORS (default http://localhost:*)","format":"string","required":false,"secret":false},{"name":"IRIS_DASHBOARD_HOST","description":"Bind host for the dashboard (default 127.0.0.1); same as --dashboard-host","format":"string","required":false,"secret":false},{"name":"IRIS_OTEL_HEADERS","description":"Comma-separated key=value headers sent with every OTLP export (for example an auth token for your collector)","format":"string","required":false,"secret":false},{"name":"IRIS_OTEL_SERVICE_NAME","description":"service.name resource attribute on exported spans (default iris-eval)","format":"string","required":false,"secret":false},{"name":"IRIS_OTEL_TIMEOUT_MS","description":"Timeout in milliseconds for each OTLP export request","format":"number","required":false,"secret":false},{"name":"IRIS_WEBHOOK_URL","description":"The receiver of the webhook that fires on a moment (docs/webhooks.md); merged over notify.webhook in config.json","format":"string","required":false,"secret":false},{"name":"IRIS_WEBHOOK_SECRET","description":"The signing key of that webhook (any string, or whsec_ + base64); the iris format refuses to run without one","format":"string","required":false,"secret":true}],"additional_arguments_declared":false},{"registryType":"mcpb","identifier":"https://github.com/iris-eval/mcp-server/releases/download/v0.20.0/iris-eval.mcpb","version":"0.20.0","transport":"stdio","environment":[],"additional_arguments_declared":false}],"remotes":[]}
Source: MCP-Register · collected on 2026-10-05 · self-declared

Position within the directory

How many of the 41,867 published entries carry the same measured value. A reference figure, not an assessment.

All 4 values together are carried by 12,140 of 41,867 entries.

tracevero · https://tracevero.com/mcp/io-github-iris-eval-mcp-server/rohangaben