list_allowed_bots

List bots that should be allowed. If a robots.txt is given, the answer reflects what that file actually permits.

Server Mcp Bot Crawler merulocal/hellogrowthcrmwebsite_mcp
Category Read
Risk class Low
Parameters 00 required

What list_allowed_bots does on Mcp Bot Crawler

AI agents call list_allowed_bots to retrieve information from Mcp Bot Crawler without modifying anything — typically the context-gathering step in research, monitoring, and reporting workflows, before the agent takes action elsewhere.

Why list_allowed_bots needs a policy

This tool performs a query/retrieval operation that returns information about allowed bots based on existing configuration (robots.txt). It has no side effects, does not modify any state, and does not execute external operations. It is purely informational in nature, making it a Read operation with low severity.

From the tool's definition Tool name 'list_allowed_bots' and description explicitly states it 'lists' bots, with no mention of modification, creation, or deletion. The description indicates it retrieves information about permitted bots, potentially by reading a robots.txt file.

Questions about list_allowed_bots

What does the list_allowed_bots tool do? +

List bots that should be allowed. If a robots.txt is given, the answer reflects what that file actually permits. It is categorised as a Read tool in the Mcp Bot Crawler MCP Server, which means it retrieves data without modifying state.

How do I enforce a policy on list_allowed_bots? +

Register the Mcp Bot Crawler MCP server in PolicyLayer and add a rule for list_allowed_bots: allow, deny, rate-limit, or require approval. Point your MCP client at the PolicyLayer proxy URL and the rule is enforced on every call, before it reaches Mcp Bot Crawler. Nothing to install.

What risk level is list_allowed_bots? +

list_allowed_bots is a Read tool with low risk. Read-only tools are generally safe to allow by default.

Can I rate-limit list_allowed_bots? +

Yes. Add a rate_limit block to the list_allowed_bots rule in your PolicyLayer policy. For example, setting max: 10 and window: 60 limits the tool to 10 calls per minute. Rate limits are tracked per agent session and reset automatically.

How do I block list_allowed_bots completely? +

Set action: deny in the PolicyLayer policy for list_allowed_bots. The AI agent will receive a policy violation error and cannot call the tool. You can also include a reason field to explain why the tool is blocked.

What MCP server provides list_allowed_bots? +

list_allowed_bots is provided by the Mcp Bot Crawler MCP server (merulocal/hellogrowthcrmwebsite_mcp). PolicyLayer sits as a proxy in front of this server to enforce policies before tool calls reach the server.

// LOOK UP ANOTHER SERVER

Every MCP server has a record like this.

Type a name, get the same breakdown: verified identity, auth posture, risk grade, capabilities, recommended policy.

Teams ship this data inside their own products. See what a licence covers →

// GET IN TOUCH

Have a question or want to learn more? Send us a message.

Message sent.

We'll get back to you soon.