list_datasets

Fetch LangSmith datasets. If no arguments are provided, all datasets will be returned. Args: dataset_ids (str, optional): Dataset IDs as JSON array string or single ID data_type (str, optional): Filter by dataset data type (e.g., 'chat', 'kv') dataset_name (str, optional): Filter by exact dataset...

Server Langsmith langsmith-mcp-server
Category Read
Risk class Low
Parameters 60 required

What list_datasets does on Langsmith

AI agents call list_datasets to retrieve information from Langsmith without modifying anything — typically the context-gathering step in research, monitoring, and reporting workflows, before the agent takes action elsewhere.

ParameterTypeRequiredDescription
limit number Max number of datasets to return
metadata string Filter by metadata as JSON object string
data_type string Filter by dataset data type
dataset_ids string Dataset IDs as JSON array string or single ID
dataset_name string Filter by exact dataset name
dataset_name_contains string Filter by substring in dataset name

Parameters from the server's own tool schema.

Why list_datasets needs a policy

This is a pure data retrieval tool that queries and returns datasets based on optional filter criteria. It has no capability to create, modify, delete, or execute operations. The blast radius of misuse is minimal—an agent could potentially list datasets it shouldn't have access to, but this is an authorization/access control concern rather than a tool-level risk.

From the tool's definition Tool name 'list_datasets' and description 'Fetch LangSmith datasets' indicates a retrieval operation. All arguments are filters (dataset_ids, data_type, dataset_name, dataset_name_contains, metadata, limit) with no mutation or deletion capability.

Questions about list_datasets

What does the list_datasets tool do? +

Fetch LangSmith datasets. If no arguments are provided, all datasets will be returned. Args: dataset_ids (str, optional): Dataset IDs as JSON array string or single ID data_type (str, optional): Filter by dataset data type (e.g., 'chat', 'kv') dataset_name (str, optional): Filter by exact dataset name dataset_name_contains (str, optional): Filter by substring in dataset name metadata (str, optional): Filter by metadata as JSON object string limit (int): Max number of datasets to return (default: 20). It is categorised as a Read tool in the Langsmith MCP Server, which means it retrieves data without modifying state.

What parameters does list_datasets accept? +

list_datasets accepts 6 parameters: limit, metadata, data_type, dataset_ids, dataset_name, dataset_name_contains. The full parameter table on this page comes from the server's own tool schema.

How do I enforce a policy on list_datasets? +

Register the Langsmith MCP server in PolicyLayer and add a rule for list_datasets: allow, deny, rate-limit, or require approval. Point your MCP client at the PolicyLayer proxy URL and the rule is enforced on every call, before it reaches Langsmith. Nothing to install.

What risk level is list_datasets? +

list_datasets is a Read tool with low risk. Read-only tools are generally safe to allow by default.

Can I rate-limit list_datasets? +

Yes. Add a rate_limit block to the list_datasets rule in your PolicyLayer policy. For example, setting max: 10 and window: 60 limits the tool to 10 calls per minute. Rate limits are tracked per agent session and reset automatically.

How do I block list_datasets completely? +

Set action: deny in the PolicyLayer policy for list_datasets. The AI agent will receive a policy violation error and cannot call the tool. You can also include a reason field to explain why the tool is blocked.

What MCP server provides list_datasets? +

list_datasets is provided by the Langsmith MCP server (langsmith-mcp-server). PolicyLayer sits as a proxy in front of this server to enforce policies before tool calls reach the server.

// LOOK UP ANOTHER SERVER

Every MCP server has a record like this.

Type a name, get the same breakdown: verified identity, auth posture, risk grade, capabilities, recommended policy.

Teams ship this data inside their own products. See what a licence covers →

// GET IN TOUCH

Have a question or want to learn more? Send us a message.

Message sent.

We'll get back to you soon.