scrape_batch
Batch scrape multiple webpages
Part of the Bright Data MCP server. Enforce policies on this tool with Intercept, the open-source MCP proxy.
WHEN AI AGENTS USE THIS TOOL
AI agents call scrape_batch to perform operations in Bright Data. While the risk category is not fully classified, applying a rate limit gives you visibility into how often the tool is called and prevents unexpected bursts of activity from autonomous agents.
WHY ENFORCE A POLICY ON SCRAPE_BATCH
Applying a policy to scrape_batch gives you an audit trail of every call an AI agent makes. Even for low-risk tools, visibility into agent behaviour helps you debug issues, optimise workflows, and maintain compliance with your organisation's security requirements.
RECOMMENDED POLICY
Apply a rate limit to control usage and monitor for unexpected behaviour.
tools:
scrape_batch:
rules:
- action: allow
rate_limit:
max: 60
window: 60See the full Bright Data policy for all 24 tools.
DETAILS
MORE BRIGHT DATA TOOLS
scrape_as_markdown Other scrape_as_html Other extract Other scraping_browser_snapshot Other scraping_browser_click_ref Other scraping_browser_screenshot Other web_data_amazon_product Other web_data_walmart_product Other SIMILAR OTHER TOOLS ON OTHER SERVERS
RELATED READING
FREQUENTLY ASKED QUESTIONS
What does the scrape_batch tool do?
Batch scrape multiple webpages. It is categorised as a Other tool in the Bright Data MCP Server, which means it performs auxiliary operations.
How do I enforce a policy on scrape_batch?
Add a rule in your Intercept YAML policy under the tools section for scrape_batch. You can allow, deny, rate-limit, or validate arguments. Then run Intercept as a proxy in front of the Bright Data MCP server.
What risk level is scrape_batch?
scrape_batch is a Other tool with low risk. Read-only tools are generally safe to allow by default.
Can I rate-limit scrape_batch?
Yes. Add a rate_limit block to the scrape_batch rule in your Intercept policy. For example, setting max: 10 and window: 60 limits the tool to 10 calls per minute. Rate limits are tracked per agent session and reset automatically.
How do I block scrape_batch completely?
Set action: deny in the Intercept policy for scrape_batch. The AI agent will receive a policy violation error and cannot call the tool. You can also include a reason field to explain why the tool is blocked.
What MCP server provides scrape_batch?
scrape_batch is provided by the Bright Data MCP server (@brightdata/mcp). Intercept sits as a proxy in front of this server to enforce policies before tool calls reach the server.
ENFORCE POLICIES ON BRIGHT DATA
Open source. One binary. Zero dependencies.