High Risk →

crawl_start

crawl_start

How to control crawl_start ↓

What crawl_start does on Scrapegraph

AI agents invoke crawl_start to trigger actions in Scrapegraph. What it does depends on the arguments the agent supplies, and its effects often reach beyond the immediate call — builds kicked off, notifications sent, workflows started.

High Risk

Why crawl_start needs a policy

This tool initiates a web crawling operation, which is an Execute action—it triggers an external process (web crawler) whose effects depend on the target URL and crawl parameters provided as arguments. The severity is high because uncontrolled crawling can trigger DoS-like behavior, violate site terms of service, or extract sensitive data.

From the tool's definition Tool name is 'crawl_start' with empty description; sibling tools include 'crawl_resume', 'crawl_stop', and 'monitor_*' operations suggesting automated web crawling/scraping orchestration; 'extract' on same server indicates data extraction capabilities.

Documented attack patterns abuse exactly the kind of access crawl_start gives an agent:

How to control crawl_start

PolicyLayer is an MCP gateway — it sits between your AI agents and Scrapegraph, and nothing reaches the server without passing your rules. This is the rule we recommend for crawl_start:

policy.json
{
  "version": "1",
  "default": "deny",
  "tools": {
    "crawl_start": {
      "limits": [
        {
          "counter": "crawl_start_rate",
          "window": "minute",
          "max": 10,
          "scope": "grant"
        }
      ]
    }
  }
}

crawl_start stays usable, but rate-capped — a runaway agent can't fire it dozens of times a minute. Everything else on the server is denied unless you say otherwise.

  1. Create a free account and register Scrapegraph — nothing to install.
  2. Add this policy — paste it, or build it visually.
  3. Point your MCP client (Claude, Cursor, anything) at your gateway URL.
RATE-LIMIT THIS TOOL →

Free to start. No card required.

Related tools and policies

Go deeper

Questions about crawl_start

What does the crawl_start tool do? +

crawl_start. It is categorised as a Execute tool in the Scrapegraph MCP Server, which means it can trigger actions or run processes. Use rate limits and argument validation.

How do I enforce a policy on crawl_start? +

Register the Scrapegraph MCP server in PolicyLayer and add a rule for crawl_start: allow, deny, rate-limit, or require approval. Point your MCP client at the PolicyLayer proxy URL and the rule is enforced on every call, before it reaches Scrapegraph. Nothing to install.

What risk level is crawl_start? +

crawl_start is a Execute tool with high risk. Execute tools should be rate-limited and have argument validation enabled.

Can I rate-limit crawl_start? +

Yes. Add a rate_limit block to the crawl_start rule in your PolicyLayer policy. For example, setting max: 10 and window: 60 limits the tool to 10 calls per minute. Rate limits are tracked per agent session and reset automatically.

How do I block crawl_start completely? +

Set action: deny in the PolicyLayer policy for crawl_start. The AI agent will receive a policy violation error and cannot call the tool. You can also include a reason field to explain why the tool is blocked.

What MCP server provides crawl_start? +

crawl_start is provided by the Scrapegraph MCP server (ScrapeGraphAI/scrapegraph-mcp). PolicyLayer sits as a proxy in front of this server to enforce policies before tool calls reach the server.

Enforce policy on every Scrapegraph tool call.

Start from Scrapegraph, add the rest of your stack, and see everything your agents can call. Then put policy on all of it.

Free to start. No card required.

17 Scrapegraph tools catalogued and risk-classified — across an index of 43,000+ MCP servers.

// GET IN TOUCH

Have a question or want to learn more? Send us a message.

Message sent.

We'll get back to you soon.