get_bots_crawlers_data

Retrieve web crawler HTTP request data. Shows crawler traffic patterns by client type, user agent, referrer, and industry. Useful for analyzing crawler behavior and traffic distribution.

SERVERCloudflare SOURCEhttps://builds.mcp.cloudflare.com/sse

Low RISK CLASS

Category Read

Parameters 00 required

Recommended Allowedsee the rule below

Registry record Grade D, identity verified Pull the record →

This record as markdown: /tools/cloudflare/get-bots-crawlers-data.md

WHAT IT DOES

What get_bots_crawlers_data does on Cloudflare

AI agents call get_bots_crawlers_data to retrieve information from Cloudflare without modifying anything. It is typically the context-gathering step in research, monitoring, and reporting workflows, before the agent takes action elsewhere.

RISK

Why get_bots_crawlers_data is rated Low

This tool queries and retrieves historical crawler traffic data for analysis purposes. It performs no writes, deletions, code execution, or financial operations. The data retrieved is informational metadata about past HTTP requests, making this a straightforward Read operation with minimal blast radius if misused by an agent.

From the tool's definition Tool name contains 'get_' and description states 'Retrieve web crawler HTTP request data' with verbs like 'Shows' and 'analyzing' indicating data retrieval without modification or deletion.

Attacks that exploit this kind of access

RECOMMENDED RULE

The rule that runs get_bots_crawlers_data safely

PolicyLayer is an MCP gateway: it sits between your AI agents and Cloudflare, and checks every tool call against a rule you set before the call runs. Nothing changes on the server itself. For get_bots_crawlers_data, this is the rule to start with:

get_bots_crawlers_data Allowed

get_bots_crawlers_data is read-only, so it stays allowed. Everything else on the server is denied unless you say otherwise.

View as policy code

policy.json

{
  "version": "1",
  "default": "deny",
  "tools": {
    "get_bots_crawlers_data": {}
  }
}

ALLOW ONLY THIS TOOL → Instant setup, no code required.

The button opens the PolicyLayer dashboard: create your workspace, connect Cloudflare, apply this rule, and every get_bots_crawlers_data call is checked against it from then on.

FAQ

Questions about get_bots_crawlers_data

What does the get_bots_crawlers_data tool do? +

Retrieve web crawler HTTP request data. Shows crawler traffic patterns by client type, user agent, referrer, and industry. Useful for analyzing crawler behavior and traffic distribution. It is categorised as a Read tool in the Cloudflare MCP Server, which means it retrieves data without modifying state.

How do I enforce a policy on get_bots_crawlers_data? +

Register the Cloudflare MCP server in PolicyLayer and add a rule for get_bots_crawlers_data: allow, deny, rate-limit, or require approval. Point your MCP client at the PolicyLayer proxy URL and the rule is enforced on every call, before it reaches Cloudflare. Nothing to install.

What risk level is get_bots_crawlers_data? +

get_bots_crawlers_data is a Read tool with low risk. Read-only tools are generally safe to allow by default.

Can I rate-limit get_bots_crawlers_data? +

Yes. Add a rate_limit block to the get_bots_crawlers_data rule in your PolicyLayer policy. For example, setting max: 10 and window: 60 limits the tool to 10 calls per minute. Rate limits are tracked per agent session and reset automatically.

How do I block get_bots_crawlers_data completely? +

Set action: deny in the PolicyLayer policy for get_bots_crawlers_data. The AI agent will receive a policy violation error and cannot call the tool. You can also include a reason field to explain why the tool is blocked.

What MCP server provides get_bots_crawlers_data? +

get_bots_crawlers_data is provided by the Cloudflare MCP server (https://builds.mcp.cloudflare.com/sse). PolicyLayer sits as a proxy in front of this server to enforce policies before tool calls reach the server.

KEEP EXPLORING

More on Cloudflare, and thousands of servers like it.

This server

All 92 Cloudflare tools →

Across the catalogue

get_cocktail_by_category on Cocktails RAG MCP Server →get_torrent_detail on M-Team MCP Server →aiva_get_affiliate on AIVA MCP Server →get-chuck-categories on Jokes MCP Server → The MCP Attack Database →

Guides

Roll out MCP under one policy →Data exfiltration →MCP token cost →