Large Language Models
️💡
Tip: Models that are multi-modal (text-to-text & image-to-text) are supported for System & Workspace models.
AnythingLLM allows you to use a host of LLM providers for chatting and generative AI.
Depending on your selection additional configuration might be required.
Supported Language Model Providers
Local Language Model Providers
Cloud Language Model Providers
OpenAIAzure OpenAIAWS BedrockGoogle Vertex AIAnthropicCohereCerebrasGoogle GeminiGoogle Vertex AITogether AIFireworks AIOpenRouterPerplexity AIMistralGroqLiteLLMDeepSeekAPIPieNovita AIxAINVIDIA NIMPPIOMoonshot AIComet APIFoundryzAIGitee AISambaNovaPrivateMode AIMinimaxOpenAI (generic)
Specialized Providers
The model router is not a provider, but it is a feature that allows you to route your sessions to different LLM providers and models based on rules you define within a chat without having to change the model manually.