High Risk →

run_ab_test

运行A/B测试对比序列模式和批处理模式

How to control run_ab_test ↓

What run_ab_test does on Guru Pk

AI agents invoke run_ab_test to trigger actions in Guru Pk. What it does depends on the arguments the agent supplies, and its effects often reach beyond the immediate call — builds kicked off, notifications sent, workflows started.

High Risk

Why run_ab_test needs a policy

This tool executes A/B testing operations that compare different modes. While the tests themselves are not destructive (results are temporary, insights only), the tool triggers computational processes with side effects (test execution, data collection, metric calculation). It is not a simple read (which would only retrieve pre-existing test results), but rather executes test logic based on arguments.

From the tool's definition Tool name is 'run_ab_test' and description states it '运行A/B测试' (runs A/B tests), which involves executing comparative testing operations between sequence mode and batch processing mode.

Documented attack patterns abuse exactly the kind of access run_ab_test gives an agent:

How to control run_ab_test

PolicyLayer is an MCP gateway — it sits between your AI agents and Guru Pk, and nothing reaches the server without passing your rules. This is the rule we recommend for run_ab_test:

policy.json
{
  "version": "1",
  "default": "deny",
  "tools": {
    "run_ab_test": {
      "limits": [
        {
          "counter": "run_ab_test_rate",
          "window": "minute",
          "max": 10,
          "scope": "grant"
        }
      ]
    }
  }
}

run_ab_test stays usable, but rate-capped — a runaway agent can't fire it dozens of times a minute. Everything else on the server is denied unless you say otherwise.

  1. Create a free account and register Guru Pk — nothing to install.
  2. Add this policy — paste it, or build it visually.
  3. Point your MCP client (Claude, Cursor, anything) at your gateway URL.
RATE-LIMIT THIS TOOL →

Free to start. No card required.

Related tools and policies

Go deeper

Questions about run_ab_test

What does the run_ab_test tool do? +

运行A/B测试对比序列模式和批处理模式. It is categorised as a Execute tool in the Guru Pk MCP Server, which means it can trigger actions or run processes. Use rate limits and argument validation.

How do I enforce a policy on run_ab_test? +

Register the Guru Pk MCP server in PolicyLayer and add a rule for run_ab_test: allow, deny, rate-limit, or require approval. Point your MCP client at the PolicyLayer proxy URL and the rule is enforced on every call, before it reaches Guru Pk. Nothing to install.

What risk level is run_ab_test? +

run_ab_test is a Execute tool with high risk. Execute tools should be rate-limited and have argument validation enabled.

Can I rate-limit run_ab_test? +

Yes. Add a rate_limit block to the run_ab_test rule in your PolicyLayer policy. For example, setting max: 10 and window: 60 limits the tool to 10 calls per minute. Rate limits are tracked per agent session and reset automatically.

How do I block run_ab_test completely? +

Set action: deny in the PolicyLayer policy for run_ab_test. The AI agent will receive a policy violation error and cannot call the tool. You can also include a reason field to explain why the tool is blocked.

What MCP server provides run_ab_test? +

run_ab_test is provided by the Guru Pk MCP server (mitsudoai/guru-pk-mcp). PolicyLayer sits as a proxy in front of this server to enforce policies before tool calls reach the server.

Enforce policy on every Guru Pk tool call.

Start from Guru Pk, add the rest of your stack, and see everything your agents can call. Then put policy on all of it.

Free to start. No card required.

22 Guru Pk tools catalogued and risk-classified — across an index of 43,000+ MCP servers.

// GET IN TOUCH

Have a question or want to learn more? Send us a message.

Message sent.

We'll get back to you soon.