create-test-run · QA Studio MCP Server MCP: Risk & Policy

WHAT IT DOES

What create-test-run does on QA Studio MCP Server

AI agents use create-test-run to create or update resources in QA Studio MCP Server — usually the action step of a workflow, after the agent has gathered context. Every call changes real data in your QA Studio MCP Server environment.

WHY IT NEEDS A POLICY

Why create-test-run needs a policy

The tool creates a new test run record, which is a reversible write operation. It adds data to the system but does not execute tests, delete data, or trigger financial transactions. The severity is medium because creating test runs could affect test workflows and project planning, but the action is reversible (test runs can typically be deleted or recreated).

From the tool's definition Tool name 'create-test-run' and description 'Create a new test run for a project' indicate creation of new data in the QA Studio test management platform.

Attacks that exploit this kind of access

Recommended rule Ready

Verdict

create-test-run Rate-limited

create-test-run stays usable, but capped — an agent stuck in a loop can't make hundreds of changes a minute. Everything else on the server is denied unless you say otherwise.

View as policy code

policy.json

{
  "version": "1",
  "default": "deny",
  "tools": {
    "create-test-run": {
      "limits": [
        {
          "counter": "create-test-run_rate",
          "window": "minute",
          "max": 30,
          "scope": "grant"
        }
      ]
    }
  }
}

LIMIT THIS TOOL →

Instant setup, no code required.

PolicyLayer is an MCP gateway: every tool call is checked against your rule before it reaches QA Studio MCP Server, so you can run agents against it safely.

FAQ

Questions about create-test-run

What does the create-test-run tool do? +

Create a new test run for a project. It is categorised as a Write tool in the QA Studio MCP Server MCP Server, which means it can create or modify data. Consider rate limits to prevent runaway writes.

How do I enforce a policy on create-test-run? +

Register the QA Studio MCP Server MCP server in PolicyLayer and add a rule for create-test-run: allow, deny, rate-limit, or require approval. Point your MCP client at the PolicyLayer proxy URL and the rule is enforced on every call, before it reaches QA Studio MCP Server. Nothing to install.

What risk level is create-test-run? +

create-test-run is a Write tool with medium risk. Write tools should be rate-limited to prevent accidental bulk modifications.

Can I rate-limit create-test-run? +

Yes. Add a rate_limit block to the create-test-run rule in your PolicyLayer policy. For example, setting max: 10 and window: 60 limits the tool to 10 calls per minute. Rate limits are tracked per agent session and reset automatically.

How do I block create-test-run completely? +

Set action: deny in the PolicyLayer policy for create-test-run. The AI agent will receive a policy violation error and cannot call the tool. You can also include a reason field to explain why the tool is blocked.

What MCP server provides create-test-run? +

create-test-run is provided by the QA Studio MCP Server MCP server (qastudio-dev/mcp-server). PolicyLayer sits as a proxy in front of this server to enforce policies before tool calls reach the server.