tavily_crawl

Crawl a website starting from a URL. Extracts content from pages with configurable depth and breadth.

Server Mcp Nexus xydong-web/mcp-nexus
Category Read
Risk class Low
Parameters 00 required

What tavily_crawl does on Mcp Nexus

AI agents call tavily_crawl to retrieve information from Mcp Nexus without modifying anything — typically the context-gathering step in research, monitoring, and reporting workflows, before the agent takes action elsewhere.

Why tavily_crawl needs a policy

This tool retrieves and reads website content without modifying, deleting, or executing operations. It is purely informational in nature—a web scraping/crawling operation. The configurable depth and breadth parameters control scope but do not change the read-only nature of the operation. No side effects, reversible operations, code execution, data destruction, or financial transactions are involved.

From the tool's definition Tool description states it 'Crawl a website starting from a URL. Extracts content from pages with configurable depth and breadth.' The verb 'extract' and 'crawl' indicate data retrieval with no modification, deletion, or execution of code on the target system.

Questions about tavily_crawl

What does the tavily_crawl tool do? +

Crawl a website starting from a URL. Extracts content from pages with configurable depth and breadth. It is categorised as a Read tool in the Mcp Nexus MCP Server, which means it retrieves data without modifying state.

How do I enforce a policy on tavily_crawl? +

Register the Mcp Nexus MCP server in PolicyLayer and add a rule for tavily_crawl: allow, deny, rate-limit, or require approval. Point your MCP client at the PolicyLayer proxy URL and the rule is enforced on every call, before it reaches Mcp Nexus. Nothing to install.

What risk level is tavily_crawl? +

tavily_crawl is a Read tool with low risk. Read-only tools are generally safe to allow by default.

Can I rate-limit tavily_crawl? +

Yes. Add a rate_limit block to the tavily_crawl rule in your PolicyLayer policy. For example, setting max: 10 and window: 60 limits the tool to 10 calls per minute. Rate limits are tracked per agent session and reset automatically.

How do I block tavily_crawl completely? +

Set action: deny in the PolicyLayer policy for tavily_crawl. The AI agent will receive a policy violation error and cannot call the tool. You can also include a reason field to explain why the tool is blocked.

What MCP server provides tavily_crawl? +

tavily_crawl is provided by the Mcp Nexus MCP server (xydong-web/mcp-nexus). PolicyLayer sits as a proxy in front of this server to enforce policies before tool calls reach the server.

// LOOK UP ANOTHER SERVER

Every MCP server has a record like this.

Type a name, get the same breakdown: verified identity, auth posture, risk grade, capabilities, recommended policy.

Teams ship this data inside their own products. See what a licence covers →

// GET IN TOUCH

Have a question or want to learn more? Send us a message.

Message sent.

We'll get back to you soon.