Model Context Protocol (MCP) in AnythingLLM

AnythingLLM supports the all Model Context Protocol (MCP) tools (opens in a new tab) for use with AI Agents.

What is MCP?

MCP is and open-source protocol developed by Anthropic (opens in a new tab) to enable seamless integration between LLM applications and external data sources and tools.

There are many tools (opens in a new tab) that exist already built with MCP in mind and AnythingLLM can work with any of them.

The Model Context Protocol (MCP) is an open protocol that enables seamless integration between LLM applications and external data sources and tools. Whether you're building an AI-powered IDE, enhancing a chat interface, or creating custom AI workflows, MCP provides a standardized way to connect LLMs with the context they need.

How to use MCP in AnythingLLM

AnythingLLM Docker→

AnythingLLM Desktop→

MCP Servers can be added to AnythingLLM by editing the anythingllm_mcp_servers.json configuration file in your AnythingLLM storage plugins directory.

The structure of the file is the same as the MCP Server Specification (opens in a new tab).

AnythingLLM will automatically detect the MCP Servers and attempt to boot them up as needed - you can also manage your servers directly in the AnythingLLM UI.

AnythingLLM MCP Configuration UI

The MCP Management UI will show you all the MCP Servers that are available to use in AnythingLLM. You can also:

Reload/Restart all MCP Servers from the configuration file (if changes are made)
View the status of the MCP Servers found
View error logs from the MCP Servers
Stop or start the MCP Servers on the fly
View all available tools from the MCP Servers loaded successfully
Delete the MCP Servers (will remove the server from the configuration file)

Example configuration file

this file will be automatically generated in the proper directory if it doesn't exist before it is needed. It will be empty by default.

{
  "mcpServers": {
    "face-generator": {
      "command": "npx",
      "args": [
        "@dasheck0/face-generator"
      ]
    },
    "mcp-youtube": {
      "command": "uvx",
      "args": [
        "mcp-youtube"
      ]
    }
  }
}