Skip to main content

Tools

When to use this

Use ToolNode when you want to expose Python functions (or MCP/Composio/LangChain tools) to an LLM agent. ToolNode generates JSON schemas automatically, executes calls, handles errors, and publishes execution events.

Import path

from agentflow.core.graph import ToolNode

ToolNode

A unified registry and executor for callable tools from multiple sources.

Constructor

tools = ToolNode([my_function, another_function])
ParameterTypeDefaultDescription
toolsIterable[Callable]requiredLocal Python functions to register. Each is registered under its __name__.
clientfastmcp.Client | NoneNoneMCP client for remote tool access. Requires pip install "10xscale-agentflow[mcp]".
pass_user_info_to_mcpboolFalseForward the run config's user dict to MCP tool calls as request metadata, readable on the server via ctx.request_context.meta.

Pass an empty list when the node only serves MCP tools: ToolNode([], client=client).

Raises: TypeError when an item in tools is not callable, ImportError when a client is given but the MCP packages are not installed.


Defining local tools

Any Python function can be a tool. Use docstrings and type annotations to generate accurate JSON schemas:

def get_weather(location: str, unit: str = "celsius") -> str:
"""Get the current weather for a location.

Args:
location: City name or coordinates.
unit: Temperature unit, either 'celsius' or 'fahrenheit'.

Returns:
A string describing the current weather.
"""
# ... actual implementation
return f"Sunny, 24°C in {location}"


def search_web(query: str, max_results: int = 5) -> list[dict]:
"""Search the web for information.

Args:
query: Search query string.
max_results: Maximum number of results to return (1-20).

Returns:
List of results with 'title', 'url', and 'snippet' keys.
"""
# ... search implementation
return [{"title": "...", "url": "...", "snippet": "..."}]


tools = ToolNode([get_weather, search_web])

Supported annotation types

ToolNode reads Python type annotations to produce the parameters section of each tool's JSON Schema:

Python typeJSON Schema type
strstring
intinteger
floatnumber
boolboolean
list / list[T]array
dictobject
T | NoneT with nullable: true

Using ToolNode in a graph (React pattern)

from agentflow.core.graph import StateGraph, Agent, ToolNode
from agentflow.utils import START, END

def get_weather(location: str) -> str:
"""Get weather for a location."""
return f"Sunny in {location}"

tool_node = ToolNode([get_weather])

agent = Agent(
model="gpt-4o",
system_prompt=[{"role": "system", "content": "You are a weather assistant."}],
tool_node=tool_node,
)

graph = StateGraph()
graph.add_node("MAIN", agent)
graph.add_node("TOOL", tool_node)
graph.set_entry_point("MAIN")

def should_use_tools(state, config):
last = state.context[-1]
if any(b.type == "tool_call" for b in last.content):
return "TOOL"
return END

graph.add_conditional_edges("MAIN", should_use_tools)
graph.add_edge("TOOL", "MAIN")

app = graph.compile()

MCP integration

ToolNode talks to MCP servers through a fastmcp.Client. Install the extra with pip install "10xscale-agentflow[mcp]", then pass the client to ToolNode:

from fastmcp import Client
from agentflow.core.graph import StateGraph, ToolNode

client = Client({
"mcpServers": {
"local": {"url": "http://localhost:8080/mcp", "transport": "streamable-http"},
}
})

tools = ToolNode([], client=client)
# tools.mcp_tools contains the list of available MCP tool names

graph = StateGraph()
graph.add_node("TOOL", tools)

See Use MCP servers for the full setup.

When client is provided, ToolNode fetches available tool schemas from the MCP server on startup and routes calls matching MCP tool names to the remote server.


Filtering tools by tag

Use the tools_tags parameter on Agent to present only a subset of tools to the LLM:

def search_web(query: str) -> str:
"""Search the web."""
...

def read_file(path: str) -> str:
"""Read a file from disk."""
...

tool_node = ToolNode([search_web, read_file])

# Agent only sees tools tagged "safe"
agent = Agent(
model="gpt-4o",
tool_node=tool_node,
tools_tags={"safe"},
)

To tag a function, add a __tags__ attribute:

search_web.__tags__ = {"safe", "web"}
read_file.__tags__ = {"filesystem"}

Tool execution result

When ToolNode executes a tool, it:

  1. Calls the function with the arguments from ToolCallBlock.args.
  2. Converts the return value to a string.
  3. Returns a ToolResultBlock(tool_call_id=..., content=..., is_error=False).

If the function raises an exception, the exception message is captured and is_error=True is set — the error is reported to the LLM so it can recover gracefully.


Async tools

ToolNode supports both sync and async tool functions:

import httpx

async def fetch_data(url: str) -> str:
"""Fetch content from a URL asynchronously."""
async with httpx.AsyncClient() as client:
resp = await client.get(url)
return resp.text

tools = ToolNode([fetch_data])

invoke method (direct use)

In most cases you do not call ToolNode.invoke directly — the graph handles this. But for testing:

result = await tool_node.invoke(
name="get_weather",
args={"location": "Paris"},
tool_call_id="call_abc123",
config={"thread_id": "test"},
state=AgentState(),
)

Getting tool schemas

ToolNode exposes the JSON schemas it will send to the LLM:

schemas = tool_node.get_tool_schemas()
# [{"name": "get_weather", "description": "...", "parameters": {...}}, ...]

Common errors

ErrorCauseFix
ToolExecutionErrorThe function raised an exception.Check tool implementation. The is_error=True result is returned to the LLM to handle.
ToolNotFoundErrorLLM requested a tool name that is not registered.Verify the function is in the tools list and that the name matches exactly.
TypeErrorTool called with wrong argument types.Add type annotations and docstrings to improve schema accuracy.