Setting up AI Agents

Configure your Agent

By default, your workspace will use the system LLM for agentic chat sessions. You can optionally change the model and provider per workspace if you want to use a different LLM for agentic chat sessions for a given workspace.

Open the workspace settings and go to the agent configuration menu

Configure your available skills

On the Agent Skills page via Settings > Agent Skills, you can granularly choose which skills you want your Agent to be able to use. Some skills are enabled by default. Some skills require additional configuration. You can click on a skill to see more information about it, including the required configuration - if any.

Be sure to click the "Save" button to save your changes.

You can also toggle skills from the prompt input in the chat UI by clicking on the "Tools" button.

Example: Configure your search provider

One of the tools agents can use is Web-Browsing which allows agents to browse the internet.

By default, AnythingLLM will use the DuckDuckGo search engine to browse the internet - this requires no additional configuration. You can change this to use a different search provider by clicking on the "Search Provider" button.

Intelligent Tool Selection

AnythingLLM is pioneering the concept of Intelligent Tool Selection. This allows any model to have access to unlimited tools but without the trade-off bloated token usage and performance bottlenecks saving up to 80% every single chat.

In other providers like OpenWebUI, Claude, or others, every single tool and MCP will be added to the prompt window every chat! This is a major performance bottleneck and can quickly lead to context limits being reached within a few chats as well as decreased performance and increased token usage or costs.

With Intelligent Tool Selection, AnythingLLM will only add the tools and MCPs that are actually useful for the chat to the prompt window.

How to enable Intelligent Tool Selection?

In the Agent Skills page via Settings > Agent Skills, you can enable Intelligent Tool Selection by clicking the settings icon on this page.