calibration.test_judge_agreement

What calibration.test_judge_agreement does on ContextForge MCP Gateway

AI agents call calibration.test_judge_agreement to retrieve information from ContextForge MCP Gateway without modifying anything. It is typically the context-gathering step in research, monitoring, and reporting workflows, before the agent takes action elsewhere.

Why calibration.test_judge_agreement is rated Low

This tool performs a read-only analytical operation—it measures and evaluates agreement metrics between judges. It does not create, modify, or delete data; it does not execute code or external commands; and it does not commit financial obligations. The function is purely observational and informational, consistent with the 'Read' category for data retrieval and query operations.

From the tool's definition Tool name 'calibration.test_judge_agreement' and description 'Measure agreement between different judges and human evaluators' indicate a measurement or analysis operation that retrieves and compares existing evaluation data without modifying, executing…

The rule that runs calibration.test_judge_agreement safely

PolicyLayer is an MCP gateway: it sits between your AI agents and ContextForge MCP Gateway, and checks every tool call against a rule you set before the call runs. Nothing changes on the server itself. For calibration.test_judge_agreement, this is the rule to start with:

{
  "version": "1",
  "default": "deny",
  "tools": {
    "calibration.test_judge_agreement": {}
  }
}

Questions about calibration.test_judge_agreement