MCPサーバー

robots-txt-checker

io.github.ryuamarines/robots-txt-checker
開発者向けツール 認証が必要 MCP 2025-11-25

このMCPでできること

Checks whether a URL path is permitted by a website's robots.txt rules.

robots_txt_checker
robots_txt_checker
Checks if a URL path is allowed by robots.txt. x402 payment required (Base mainnet USDC).
入力スキーマ
{'type': 'object', '$schema': 'http://json-schema.org/draft-07/schema#', 'required': ['checks'], 'properties': {'checks': {'type': 'array', 'items': {'type': 'string'}, 'description': 'JSON-encoded strings, each an object like {"url":...,"path":...,"userAgent":...}'}, 'payment': {'type': 'string', 'description': 'x402 payment payload (base64 JSON), signed EIP-712 exact/transferWithAuthorization. Omit on the first call â\x80\x94 the tool will return payment requirements (accepts[]) as an error result.'}}, 'additionalProperties': False}
追加
robots_txt_checker
2026年9月17日12:49