AnythingLLM Self-hosted
Overview
AnythingLLM Installation

Installation Overview

AnythingLLM Docker is both a single-user and multi-user application you can install on any webserver using docker and leverage local LLMs, RAG, and Agents with little to zero configuration and full privacy.

Self hosting AnythingLLM via Docker is very popular and can be done locally or on cloud servicers (aws, google cloud, railway etc..).

Docker vs Desktop Version

There are some distinct differences in functionality between each offering. Both are open source.

You want AnythingLLM Docker if...

  • You need an easy setup, but server-based service for AnythingLLM to use local LLMs, RAG, and Agents locally
  • You want to run an AnythingLLM instance that many people can use at the same time
  • You want to be able to share information with our users on your instance you invite
  • You need admin and rule-based access for workspaces and documents.
  • You will publish chat widgets to the public internet
  • You want to access AnythingLLM from the browser

You want AnythingLLM Desktop if...

  • You want a one-click installable app to use local LLMs, RAG, and Agents locally
  • You do not need multi-user support
  • Everything needs to stay only on your device
  • You do not need to "publish" anything to the public internet. Eg: Chat widget for website

The below table is a non-exhaustive list of features supported between platforms.

FeatureAvailable on DesktopAvailable on Docker
Multi-user supportβŒβœ…
Emeddable chat widgetsβŒβœ…
One-click installβœ…βŒ
Private documentsβœ…βœ…
Connect to any vector databaseβœ…βœ…
Use any LLMβœ…βœ…
Built-in embedding providerβœ…βœ…
Built-in LLM providerβœ…βŒ
White-labelingβŒβœ…
Chat logsβœ…βœ…
Agent supportβœ…βœ…
Agent skillsβœ…βœ…
Third-party data connectorsβœ…βœ…
Password protectionβŒβœ…
Invite new users to instanceβŒβœ…
Text splitting configurationβœ…βœ…
Whisper model supportβœ…βœ…
Full developer APIβœ…βœ…
User managementβŒβœ…
Workspace access managementβŒβœ…
Website scrapingβœ…βœ…
οΈπŸ’‘

Tip: AnythingLLM Desktop is the easiest way to use AnythingLLM.


Quick Links