MCP Radar
MCP-Server

rubrkit

com.rubrkit/rubrkit
KI & Agenten Entwicklertools Öffentlich und erreichbar MCP 2025-11-25

Was dieses MCP kann

Manages AI evaluation artifacts, rubric audits, eval runs, golden cases, proof reports, and drift monitoring for LLM outputs.

Funktionen

Tools

39 Tools
rubrkit_add_golden_case
Add golden case
Add a golden case (a real edge-case input with a confirmed-correct output) to an artifact bundle via POST /api/v1/artifact-bundles/{artifactBundleId}/golden-cases. Requires artifact_bundles:write for API keys.
Eingabeschema 
{'type': 'object', 'required': ['artifactBundleId', 'input'], 'properties': {'tags': {'type': 'array', 'items': {'type': 'string'}}, 'input': {'type': 'object'}, 'origin': {'enum': ['audit', 'human', 'prod'], 'type': 'string'}, 'weight': {'type': 'integer', 'minimum': 1}, 'criteria': {'type': 'object'}, 'originRef': {'type': 'object'}, 'expectedOutput': {'type': 'object'}, 'artifactBundleId': {'type': 'string', 'format': 'uuid'}}}
rubrkit_apply_audit_rewrite
Apply audit rewrite
Apply a completed audit's AI rewrite to the bundle files (a new version per changed file). Requires audits:run for API keys.
Eingabeschema 
{'type': 'object', 'required': ['artifactBundleId', 'auditRunId'], 'properties': {'auditRunId': {'type': 'string', 'format': 'uuid'}, 'artifactBundleId': {'type': 'string', 'format': 'uuid'}}}
rubrkit_compact_artifact_file
Compact artifact file
Deterministically shorten a markdown or text prompt without losing instructions (free, no credits). Saves a new version unless dryRun is true. Requires files:write for API keys.
Eingabeschema 
{'type': 'object', 'required': ['artifactBundleId', 'fileId'], 'properties': {'level': {'enum': ['safe', 'aggressive'], 'type': 'string', 'default': 'safe'}, 'dryRun': {'type': 'boolean', 'default': False}, 'fileId': {'type': 'string', 'format': 'uuid'}, 'artifactBundleId': {'type': 'string', 'format': 'uuid'}}}
rubrkit_create_artifact_bundle
Create artifact bundle
Create an artifact bundle through /api/v1/artifact-bundles. Requires artifact_bundles:write for API keys.
Eingabeschema 
{'type': 'object', 'required': ['name'], 'properties': {'name': {'type': 'string', 'maxLength': 120, 'minLength': 1}, 'settings': {'type': 'object', 'additionalProperties': True}, 'description': {'type': ['string', 'null'], 'maxLength': 2000}, 'customRubric': {'type': 'object', 'additionalProperties': True}}}
rubrkit_create_drift_monitor
Create drift monitor
Create a drift monitor pinned to a file version via POST /api/v1/artifact-bundles/{artifactBundleId}/drift-monitors. Requires artifact_bundles:write for API keys.
Eingabeschema 
{'type': 'object', 'required': ['artifactBundleId', 'pinnedVersionId'], 'properties': {'cadence': {'type': 'string'}, 'repeats': {'type': 'integer', 'maximum': 5, 'minimum': 2}, 'pinnedVersionId': {'type': 'string', 'format': 'uuid'}, 'artifactBundleId': {'type': 'string', 'format': 'uuid'}}}
rubrkit_delete_artifact_bundle
Delete artifact bundle
Archive an artifact bundle (soft delete) through DELETE /api/v1/artifact-bundles/{artifactBundleId}. The bundle moves to the archived state and can be restored or permanently deleted later. Requires artifact_bundles:write for API keys.
Eingabeschema 
{'type': 'object', 'required': ['artifactBundleId'], 'properties': {'artifactBundleId': {'type': 'string', 'format': 'uuid'}}}
rubrkit_export_proof_report
Export proof report
Start an async proof report job with export storage enabled by default. Requires evals:run for API keys.
Eingabeschema 
{'type': 'object', 'required': ['artifactBundleId'], 'properties': {'evalRunId': {'type': 'string', 'format': 'uuid'}, 'auditRunId': {'type': 'string', 'format': 'uuid'}, 'sourceFileId': {'type': 'string', 'format': 'uuid'}, 'includeExport': {'type': 'boolean', 'default': True}, 'rubricVersion': {'type': 'string'}, 'candidateFileId': {'type': 'string', 'format': 'uuid'}, 'artifactBundleId': {'type': 'string', 'format': 'uuid'}, 'sourceFileVersionId': {'type': 'string', 'format': 'uuid'}, 'sourceVersionNumber': {'type': 'integer', 'minimum': 1}, 'candidateFileVersionId': {'type': 'string', 'format': 'uuid'}, 'candidateVersionNumber': {'type': 'integer', 'minimum': 1}}}
rubrkit_hard_delete_artifact_bundle
Permanently delete artifact bundle
Permanently delete an archived artifact bundle and all of its files, versions, and run history through DELETE /api/v1/artifact-bundles/{artifactBundleId}/permanent. This is irreversible and only works on bundles that are already archived. Requires artifact_bundles:write for API keys.
Eingabeschema 
{'type': 'object', 'required': ['artifactBundleId'], 'properties': {'artifactBundleId': {'type': 'string', 'format': 'uuid'}}}
rubrkit_list_artifact_bundles
List artifact bundles
List artifact bundles through /api/v1/artifact-bundles. Requires artifact_bundles:read for API keys.
Eingabeschema 
{'type': 'object', 'properties': {'limit': {'type': 'integer', 'default': 100, 'maximum': 100, 'minimum': 1}, 'status': {'enum': ['active', 'archived', 'all'], 'type': 'string', 'default': 'active'}}}
rubrkit_list_artifact_bundle_versions
List artifact bundle versions
List bundle-level version events. Requires artifact_bundles:read for API keys.
Eingabeschema 
{'type': 'object', 'required': ['artifactBundleId'], 'properties': {'limit': {'type': 'integer', 'default': 100, 'maximum': 100, 'minimum': 1}, 'artifactBundleId': {'type': 'string', 'format': 'uuid'}}}
rubrkit_list_artifact_files
List artifact files
List files in an artifact bundle. Requires files:read for API keys.
Eingabeschema 
{'type': 'object', 'required': ['artifactBundleId'], 'properties': {'limit': {'type': 'integer', 'default': 200, 'maximum': 200, 'minimum': 1}, 'artifactBundleId': {'type': 'string', 'format': 'uuid'}}}
rubrkit_list_audits
List audits
List persisted audit history. Requires artifact_bundles:read for API keys.
Eingabeschema 
{'type': 'object', 'required': ['artifactBundleId'], 'properties': {'limit': {'type': 'integer', 'default': 25, 'maximum': 100, 'minimum': 1}, 'artifactBundleId': {'type': 'string', 'format': 'uuid'}}}
rubrkit_list_drift_monitors
List drift monitors
List the drift monitors for an artifact bundle via /api/v1/artifact-bundles/{artifactBundleId}/drift-monitors. Requires artifact_bundles:read (or artifacts:pull) for API keys.
Eingabeschema 
{'type': 'object', 'required': ['artifactBundleId'], 'properties': {'artifactBundleId': {'type': 'string', 'format': 'uuid'}}}
rubrkit_list_evals
List evals
List eval history. Requires artifact_bundles:read for API keys.
Eingabeschema 
{'type': 'object', 'required': ['artifactBundleId'], 'properties': {'limit': {'type': 'integer', 'default': 25, 'maximum': 100, 'minimum': 1}, 'artifactBundleId': {'type': 'string', 'format': 'uuid'}}}
rubrkit_list_file_versions
List file versions
List immutable versions for a file. Requires files:read for API keys.
Eingabeschema 
{'type': 'object', 'required': ['artifactBundleId', 'fileId'], 'properties': {'limit': {'type': 'integer', 'default': 100, 'maximum': 100, 'minimum': 1}, 'fileId': {'type': 'string', 'format': 'uuid'}, 'artifactBundleId': {'type': 'string', 'format': 'uuid'}}}
rubrkit_list_golden_cases
List golden cases
List the golden cases for an artifact bundle via /api/v1/artifact-bundles/{artifactBundleId}/golden-cases. Requires artifact_bundles:read (or artifacts:pull) for API keys.
Eingabeschema 
{'type': 'object', 'required': ['artifactBundleId'], 'properties': {'status': {'enum': ['active', 'retired', None], 'type': ['string', 'null']}, 'artifactBundleId': {'type': 'string', 'format': 'uuid'}}}
rubrkit_list_job_events
List job events
Read append-only job progress events. Requires jobs:read for API keys.
Eingabeschema 
{'type': 'object', 'required': ['jobId'], 'properties': {'jobId': {'type': 'string', 'format': 'uuid'}, 'limit': {'type': 'integer', 'default': 100, 'maximum': 100, 'minimum': 1}}}
rubrkit_poll_job
Poll job progress
Read async job progress. Requires jobs:read for API keys.
Eingabeschema 
{'type': 'object', 'required': ['jobId'], 'properties': {'jobId': {'type': 'string', 'format': 'uuid'}}}
rubrkit_read_api_doc
Read Rubrkit API doc
Read a docs/api Markdown guide or OpenAPI source by slug, file name, or docs/api path.
Eingabeschema 
{'type': 'object', 'required': ['slugOrPath'], 'properties': {'slugOrPath': {'type': 'string', 'minLength': 1}}}
rubrkit_read_artifact_bundle
Read artifact bundle
Read artifact bundle details, files, and file tree. Requires artifact_bundles:read for API keys.
Eingabeschema 
{'type': 'object', 'required': ['artifactBundleId'], 'properties': {'artifactBundleId': {'type': 'string', 'format': 'uuid'}}}
rubrkit_read_artifact_file
Read artifact file
Read the latest file metadata and content. Requires files:read for API keys.
Eingabeschema 
{'type': 'object', 'required': ['artifactBundleId', 'fileId'], 'properties': {'fileId': {'type': 'string', 'format': 'uuid'}, 'artifactBundleId': {'type': 'string', 'format': 'uuid'}}}
rubrkit_read_audit
Read audit
Read a single audit run. Requires artifact_bundles:read for API keys.
Eingabeschema 
{'type': 'object', 'required': ['artifactBundleId', 'auditRunId'], 'properties': {'auditRunId': {'type': 'string', 'format': 'uuid'}, 'artifactBundleId': {'type': 'string', 'format': 'uuid'}}}
rubrkit_read_drift_observations
Read drift observations
List the recorded observations for a drift monitor via /api/v1/drift-monitors/{driftMonitorId}/observations. Requires artifact_bundles:read (or artifacts:pull) for API keys.
Eingabeschema 
{'type': 'object', 'required': ['driftMonitorId'], 'properties': {'driftMonitorId': {'type': 'string', 'format': 'uuid'}}}
rubrkit_read_eval
Read eval
Read one eval run, including the `stats` statistical verdict on advanced-mode runs (empty for standard runs). Requires artifact_bundles:read for API keys.
Eingabeschema 
{'type': 'object', 'required': ['artifactBundleId', 'evalRunId'], 'properties': {'evalRunId': {'type': 'string', 'format': 'uuid'}, 'artifactBundleId': {'type': 'string', 'format': 'uuid'}}}
rubrkit_read_input_drift
Read input drift
Compare recent production inputs against a prior reference window (population stability index) for an artifact bundle via GET /api/v1/artifact-bundles/{artifactBundleId}/drift/input. Requires artifact_bundles:read (or artifacts:pull) for API keys.
Eingabeschema 
{'type': 'object', 'required': ['artifactBundleId'], 'properties': {'binCount': {'type': 'integer', 'minimum': 1}, 'windowDays': {'type': 'integer', 'minimum': 1}, 'artifactBundleId': {'type': 'string', 'format': 'uuid'}}}
rubrkit_read_openapi_contract
Read Rubrkit OpenAPI contract
Read the canonical docs/api/openapi.yaml contract.
Eingabeschema 
{'type': 'object', 'properties': {}}
rubrkit_read_proof_report
Read proof report
Read one proof report. Requires artifact_bundles:read for API keys.
Eingabeschema 
{'type': 'object', 'required': ['artifactBundleId', 'proofReportId'], 'properties': {'proofReportId': {'type': 'string', 'format': 'uuid'}, 'artifactBundleId': {'type': 'string', 'format': 'uuid'}}}
rubrkit_read_validity_drift
Read validity drift
Correlate rubric scores against recorded outcome metrics for an artifact bundle to check whether the rubric is still predictive via GET /api/v1/artifact-bundles/{artifactBundleId}/drift/validity. Requires artifact_bundles:read (or artifacts:pull) for API keys.
Eingabeschema 
{'type': 'object', 'required': ['artifactBundleId'], 'properties': {'artifactBundleId': {'type': 'string', 'format': 'uuid'}}}
rubrkit_record_outcome
Record outcome
Record a production outcome event (input feature, metric, and/or label) for an artifact bundle via POST /api/v1/artifact-bundles/{artifactBundleId}/outcomes. Requires artifact_bundles:write for API keys.
Eingabeschema 
{'type': 'object', 'required': ['artifactBundleId'], 'properties': {'inputHash': {'type': 'string'}, 'occurredAt': {'type': 'string', 'format': 'date-time'}, 'inputFeature': {'type': 'number'}, 'outcomeLabel': {'type': 'string'}, 'outcomeMetric': {'type': 'number'}, 'artifactBundleId': {'type': 'string', 'format': 'uuid'}, 'artifactVersionId': {'type': 'string', 'format': 'uuid'}}}
rubrkit_restore_artifact_bundle_version
Restore artifact bundle version
Restore files from a prior artifact-bundle version by creating new file versions. Requires artifact_bundles:write and files:write for API keys.
Eingabeschema 
{'type': 'object', 'required': ['artifactBundleId', 'versionNumber'], 'properties': {'message': {'type': 'string', 'maxLength': 500}, 'versionNumber': {'type': 'integer', 'minimum': 1}, 'artifactBundleId': {'type': 'string', 'format': 'uuid'}}}
rubrkit_restore_file_version
Restore file version
Restore a prior file version by creating a new version. Requires files:write for API keys.
Eingabeschema 
{'type': 'object', 'required': ['artifactBundleId', 'fileId', 'versionNumber'], 'properties': {'fileId': {'type': 'string', 'format': 'uuid'}, 'message': {'type': 'string', 'maxLength': 500}, 'versionNumber': {'type': 'integer', 'minimum': 1}, 'artifactBundleId': {'type': 'string', 'format': 'uuid'}}}
rubrkit_retire_golden_case
Retire golden case
Retire a golden case via DELETE /api/v1/golden-cases/{goldenCaseId}. Requires artifact_bundles:write for API keys.
Eingabeschema 
{'type': 'object', 'required': ['goldenCaseId'], 'properties': {'goldenCaseId': {'type': 'string', 'format': 'uuid'}}}
rubrkit_run_drift_check
Run drift check now
Queue a drift check immediately instead of waiting for the monitor's schedule, via POST /api/v1/drift-monitors/{driftMonitorId}/check. The first check on a new monitor calibrates its baseline. Costs one audit per repeat. Requires artifact_bundles:write for API keys.
Eingabeschema 
{'type': 'object', 'required': ['driftMonitorId'], 'properties': {'driftMonitorId': {'type': 'string', 'format': 'uuid'}}}
rubrkit_run_evals
Run evals
Start an async eval run. Requires evals:run for API keys. Set mode: "advanced" with baselineVersionId and candidateVersionId to run a statistically-backed A/B (repeats defaults to 3, max 5).
Eingabeschema 
{'type': 'object', 'required': ['artifactBundleId'], 'properties': {'mode': {'enum': ['standard', 'advanced'], 'type': 'string'}, 'repeats': {'type': 'integer', 'maximum': 5, 'minimum': 1}, 'maxCases': {'type': 'integer', 'maximum': 20, 'minimum': 1}, 'testCases': {'type': 'array', 'items': {'type': 'object', 'additionalProperties': True}}, 'auditRunId': {'type': 'string', 'format': 'uuid'}, 'sourceFileId': {'type': 'string', 'format': 'uuid'}, 'rubricVersion': {'type': 'string'}, 'candidateFileId': {'type': 'string', 'format': 'uuid'}, 'artifactBundleId': {'type': 'string', 'format': 'uuid'}, 'baselineVersionId': {'type': 'string', 'format': 'uuid'}, 'candidateVersionId': {'type': 'string', 'format': 'uuid'}, 'sourceFileVersionId': {'type': 'string', 'format': 'uuid'}, 'sourceVersionNumber': {'type': 'integer', 'minimum': 1}, 'candidateFileVersionId': {'type': 'string', 'format': 'uuid'}, 'candidateVersionNumber': {'type': 'integer', 'minimum': 1}}}
rubrkit_search_api_docs
Search Rubrkit API docs
Search the canonical docs/api Markdown guides and OpenAPI operation summaries.
Eingabeschema 
{'type': 'object', 'required': ['query'], 'properties': {'limit': {'type': 'integer', 'default': 8, 'maximum': 20, 'minimum': 1}, 'query': {'type': 'string', 'minLength': 1}}}
rubrkit_set_drift_monitor_status
Set drift monitor status
Pause or resume a drift monitor via PATCH /api/v1/drift-monitors/{driftMonitorId}. Requires artifact_bundles:write for API keys.
Eingabeschema 
{'type': 'object', 'required': ['driftMonitorId', 'status'], 'properties': {'status': {'enum': ['active', 'paused'], 'type': 'string'}, 'driftMonitorId': {'type': 'string', 'format': 'uuid'}}}
rubrkit_start_audit
Start audit
Start an async audit job. Audit results are cached per account by a content hash of their inputs; pass force: true to bypass the cache and run a fresh audit (the same as the CLI's --no-cache flag). Requires audits:run for API keys.
Eingabeschema 
{'type': 'object', 'required': ['artifactBundleId'], 'properties': {'force': {'type': 'boolean', 'default': False}, 'modelTier': {'enum': ['cheap', 'standard', 'premium'], 'type': 'string'}, 'rubricKey': {'type': 'string'}, 'artifactType': {'type': 'string'}, 'targetFileId': {'type': 'string', 'format': 'uuid'}, 'reasoningEffort': {'enum': ['minimal', 'low', 'medium', 'high'], 'type': 'string'}, 'artifactBundleId': {'type': 'string', 'format': 'uuid'}, 'customRequirements': {'type': 'array', 'items': {'type': 'string'}}, 'targetVersionNumber': {'type': 'integer', 'minimum': 1}, 'artifactBundleVersionNumber': {'type': 'integer', 'minimum': 1}}}
rubrkit_update_artifact_file
Update artifact file
Write a new editable version for a file. Requires files:write for API keys.
Eingabeschema 
{'type': 'object', 'required': ['artifactBundleId', 'fileId', 'content'], 'properties': {'fileId': {'type': 'string', 'format': 'uuid'}, 'content': {'type': 'string'}, 'message': {'type': 'string', 'maxLength': 500}, 'mediaType': {'type': 'string'}, 'artifactBundleId': {'type': 'string', 'format': 'uuid'}}}
rubrkit_upload_artifact_files
Upload artifact files
Upload one or more text files into an artifact bundle. Requires files:write for API keys.
Eingabeschema 
{'type': 'object', 'required': ['artifactBundleId', 'files'], 'properties': {'files': {'type': 'array', 'items': {'type': 'object', 'required': ['path', 'content'], 'properties': {'path': {'type': 'string', 'minLength': 1}, 'content': {'type': 'string'}, 'message': {'type': 'string', 'maxLength': 500}, 'mediaType': {'type': 'string'}, 'artifactType': {'type': 'string'}}}, 'minItems': 1}, 'artifactBundleId': {'type': 'string', 'format': 'uuid'}}}
Verlauf

Letzte Tool-Änderungen

Entfernt
rubrkit_compress_artifact_file
1. October 2026 02:54
Hinzugefügt
rubrkit_compact_artifact_file
1. October 2026 02:54
Entfernt
rubrkit_read_rubr_flow_conversion
25. September 2026 03:03
Entfernt
rubrkit_list_rubr_flow_conversions
25. September 2026 03:03
Entfernt
rubrkit_convert_to_rubr_flow
25. September 2026 03:03
Hinzugefügt
rubrkit_compress_artifact_file
25. September 2026 03:03
Hinzugefügt
rubrkit_read_validity_drift
17. September 2026 12:37
Hinzugefügt
rubrkit_read_input_drift
17. September 2026 12:37
Hinzugefügt
rubrkit_record_outcome
17. September 2026 12:37
Hinzugefügt
rubrkit_set_drift_monitor_status
17. September 2026 12:37
Hinzugefügt
rubrkit_run_drift_check
17. September 2026 12:37
Hinzugefügt
rubrkit_read_drift_observations
17. September 2026 12:37
Hinzugefügt
rubrkit_list_drift_monitors
17. September 2026 12:37
Hinzugefügt
rubrkit_create_drift_monitor
17. September 2026 12:37
Hinzugefügt
rubrkit_retire_golden_case
17. September 2026 12:37
Hinzugefügt
rubrkit_add_golden_case
17. September 2026 12:37
Hinzugefügt
rubrkit_list_golden_cases
17. September 2026 12:37
Hinzugefügt
rubrkit_read_proof_report
17. September 2026 12:37
Hinzugefügt
rubrkit_export_proof_report
17. September 2026 12:37
Hinzugefügt
rubrkit_read_eval
17. September 2026 12:37
Hinzugefügt
rubrkit_list_evals
17. September 2026 12:37
Hinzugefügt
rubrkit_run_evals
17. September 2026 12:37
Hinzugefügt
rubrkit_restore_file_version
17. September 2026 12:37
Hinzugefügt
rubrkit_list_file_versions
17. September 2026 12:37
Hinzugefügt
rubrkit_restore_artifact_bundle_version
17. September 2026 12:37
Hinzugefügt
rubrkit_list_artifact_bundle_versions
17. September 2026 12:37
Hinzugefügt
rubrkit_list_job_events
17. September 2026 12:37
Hinzugefügt
rubrkit_poll_job
17. September 2026 12:37
Hinzugefügt
rubrkit_read_rubr_flow_conversion
17. September 2026 12:37
Hinzugefügt
rubrkit_list_rubr_flow_conversions
17. September 2026 12:37
Entdecken

Ähnliche MCP-Server

Andreax

io.github.moralito311-andr/andreax

Offers pay-per-call AI services for inference, agent and workflow design, OCR and transcription, code generation and review, clas…

IA-QA — 130+ QA & Dev Tools for AI Agents

io.github.JcJamet/ia-qa-toolbox

Provides deterministic QA, evaluation, testing, code analysis, prompt and RAG checks, model comparison, and web security diagnost…

CompletionKit

com.completionkit/evals

Runs prompt evaluation workflows over datasets using deterministic checks and LLM judges, with metrics, scoring runs, agreements,…

Replicate

io.github.pipeworx-io/replicate

Provides access to Replicate models, versions, collections, hardware, predictions, and deployments for running and managing hoste…

Huggingface

io.github.pipeworx-io/huggingface

Provides access to Hugging Face model, dataset, and Space metadata, alongside broader structured research and data-routing tools.

Ai Model Experiments

io.github.pipeworx-io/ai-model-experiments

Runs prompts across multiple AI models and compares their outputs, costs, latency, token usage, and errors.

Hipocampo MCP

io.github.carrasquelalex1/hipocampo

Provides bilingual semantic memory, embeddings, graph links, code indexing and search, context preload, deduplication, compressio…

Axint

io.github.agenticempire/axint

Supports Apple development by generating Swift features, compiling intent definitions, validating and repairing Swift, coordinati…