Generate a production-ready llms.txt file for any URL so AI crawlers (ChatGPT, Claude, Perplexity) can index the site cleanly. Fetches the page, extracts title/description/key links, and emits the standard llms.txt markdown format. Output is a single text blob ready to drop at site-root/llms.txt....
AI agents use generate_llms_txt to create or update resources in Mcp Sefaria — usually the action step of a workflow, after the agent has gathered context. Every call changes real data in your Mcp Sefaria environment.
| Parameter | Type | Required | Description |
|---|---|---|---|
url | string | Yes | Full URL of the site to summarize, e.g. "https://example.com" or a specific landing page. |
max_links | number | — | Maximum number of link entries to include (default 25, max 50). |
Parameters from the server's own tool schema.
An AI agent can call generate_llms_txt faster than any human can review — one bad instruction and it creates or modifies resources in Mcp Sefaria by the hundred, each call as confident as the last.
Risk signalsAccepts URL/endpoint input (url) · Admin/system-level operation
Attacks that exploit this kind of access
Generate a production-ready llms.txt file for any URL so AI crawlers (ChatGPT, Claude, Perplexity) can index the site cleanly. Fetches the page, extracts title/description/key links, and emits the standard llms.txt markdown format. Output is a single text blob ready to drop at site-root/llms.txt. Useful for: getting a client's site indexed by AI, drafting llms.txt for your own project, or auditing how an AI crawler would see a competitor. It is categorised as a Write tool in the Mcp Sefaria MCP Server, which means it can create or modify data. Consider rate limits to prevent runaway writes.
generate_llms_txt accepts 2 parameters: url, max_links. Required: url. The full parameter table on this page comes from the server's own tool schema.
Register the Mcp Sefaria MCP server in PolicyLayer and add a rule for generate_llms_txt: allow, deny, rate-limit, or require approval. Point your MCP client at the PolicyLayer proxy URL and the rule is enforced on every call, before it reaches Mcp Sefaria. Nothing to install.
generate_llms_txt is a Write tool with medium risk. Write tools should be rate-limited to prevent accidental bulk modifications.
Yes. Add a rate_limit block to the generate_llms_txt rule in your PolicyLayer policy. For example, setting max: 10 and window: 60 limits the tool to 10 calls per minute. Rate limits are tracked per agent session and reset automatically.
Set action: deny in the PolicyLayer policy for generate_llms_txt. The AI agent will receive a policy violation error and cannot call the tool. You can also include a reason field to explain why the tool is blocked.
generate_llms_txt is provided by the Mcp Sefaria MCP server (pipeworx-io/mcp-sefaria). PolicyLayer sits as a proxy in front of this server to enforce policies before tool calls reach the server.
Every MCP server has a record like this.
Type a name, get the same breakdown: verified identity, auth posture, risk grade, capabilities, recommended policy.
Teams ship this data inside their own products. See what a licence covers →