Groq LLM

Groq (opens in a new tab) is a model provider popular for pioneering the fastest way to run open-source models.

This provider enables you to get near-instant replies back from your LLM.

If speed is your primary concern - there is no competition.

Connecting to Groq

Like other LLM providers, the Chat Model Selection dropdown will automatically populate when your API key is entered.

All Groq models are currently available for use with AnythingLLM.

You can update your model to a different model at any time in the Settings.