Search docs...

Start typing to search documentation

anythingllm
AnythingLLM

AnythingLLM Integration Guide

Connect UnoRouter to AnythingLLM as a Generic OpenAI provider.

Overview

AnythingLLM treats UnoRouter as a Generic OpenAI provider. Type the model, set the context window, and save.

Quick Config

Drop these values into the client. Your key auto-fills when you are signed in.

text
Base URL: https://api.unorouter.ai/v1
API Key: YOUR_API_KEY

Sign in to auto-fill your API key

Compatibility

Chat CompletionsStreamingTool calling

Step-by-step setup

  1. 1
    Open LLM Preference

    Click Settings in the sidebar, then LLM Preference.

  2. 2
    Pick Generic OpenAI

    Set LLM Provider to Generic OpenAI and fill in the form.

    text
    Base URL: https://api.unorouter.ai/v1
    API Key: YOUR_API_KEY
    Chat Model Name: YOUR_MODEL_ID
    Token context window: 50000

    Sign in to auto-fill your API key

  3. 3
    Save

    Hit save. AnythingLLM uses UnoRouter for chat workspaces.

Recommended models

Free models that work well here. Paste any model id into the client.

allam-2-7bcompoundmistral-mediummistral-medium-c21211-r0-75llama-3.1-8b

Gotchas

  • AnythingLLM does not auto-fetch the catalog for Generic OpenAI. Type the model name and context window manually.
  • The Embedding Preference tab is separate. Leave it on a working embedding provider unless UnoRouter exposes embeddings on your plan.
Generate API KeyModels