push_prompt · Langsmith MCP: Risk & Policy

WHAT IT DOES

What push_prompt does on Langsmith

AI agents use push_prompt to create or update resources in Langsmith — usually the action step of a workflow, after the agent has gathered context. Every call changes real data in your Langsmith environment.

WHY IT NEEDS A POLICY

Why push_prompt needs a policy

This tool creates and modifies prompts in LangSmith, which is a reversible operation (prompts can be updated or reverted via version control). It does not delete data (Destructive), execute arbitrary code (Execute), involve financial transactions (Financial), or retrieve-only operations (Read).

From the tool's definition Tool description explicitly states it "Call this tool when you need to understand how to create and push prompts to LangSmith" and mentions "Push prompts to LangSmith for version control and management" and "Handle prompt creation vs. version updates".

Attacks that exploit this kind of access

Recommended rule Ready

Verdict

push_prompt Rate-limited

push_prompt stays usable, but capped — an agent stuck in a loop can't make hundreds of changes a minute. Everything else on the server is denied unless you say otherwise.

View as policy code

policy.json

{
  "version": "1",
  "default": "deny",
  "tools": {
    "push_prompt": {
      "limits": [
        {
          "counter": "push_prompt_rate",
          "window": "minute",
          "max": 30,
          "scope": "grant"
        }
      ]
    }
  }
}

LIMIT THIS TOOL →

Instant setup, no code required.

PolicyLayer is an MCP gateway: every tool call is checked against your rule before it reaches Langsmith, so you can run agents against it safely.

FAQ

Questions about push_prompt

What does the push_prompt tool do? +

Call this tool when you need to understand how to create and push prompts to LangSmith. This is a documentation-only tool that explains how to: - Create prompts using LangChain's prompt templates - Push prompts to LangSmith for version control and management - Handle prompt creation vs. version updates Use the LangSmith Client's push_prompt() method. See LangSmith documentation for details. It is categorised as a Write tool in the Langsmith MCP Server, which means it can create or modify data. Consider rate limits to prevent runaway writes.

How do I enforce a policy on push_prompt? +

Register the Langsmith MCP server in PolicyLayer and add a rule for push_prompt: allow, deny, rate-limit, or require approval. Point your MCP client at the PolicyLayer proxy URL and the rule is enforced on every call, before it reaches Langsmith. Nothing to install.

What risk level is push_prompt? +

push_prompt is a Write tool with medium risk. Write tools should be rate-limited to prevent accidental bulk modifications.

Can I rate-limit push_prompt? +

Yes. Add a rate_limit block to the push_prompt rule in your PolicyLayer policy. For example, setting max: 10 and window: 60 limits the tool to 10 calls per minute. Rate limits are tracked per agent session and reset automatically.

How do I block push_prompt completely? +

Set action: deny in the PolicyLayer policy for push_prompt. The AI agent will receive a policy violation error and cannot call the tool. You can also include a reason field to explain why the tool is blocked.

What MCP server provides push_prompt? +

push_prompt is provided by the Langsmith MCP server (langsmith-mcp-server). PolicyLayer sits as a proxy in front of this server to enforce policies before tool calls reach the server.