AnythingLLM
AnythingLLM Integration Guide
Connect UnoRouter to AnythingLLM as a Generic OpenAI provider.
Overview
AnythingLLM treats UnoRouter as a Generic OpenAI provider. Type the model, set the context window, and save.
Quick Config
Drop these values into the client. Your key auto-fills when you are signed in.
text
Base URL: https://api.unorouter.ai/v1
API Key: YOUR_API_KEYCompatibility
Chat CompletionsStreamingTool calling
Step-by-step setup
- 1Open LLM Preference
Click Settings in the sidebar, then LLM Preference.
- 2Pick Generic OpenAI
Set LLM Provider to Generic OpenAI and fill in the form.
textBase URL: https://api.unorouter.ai/v1 API Key: YOUR_API_KEY Chat Model Name: YOUR_MODEL_ID Token context window: 50000 - 3Save
Hit save. AnythingLLM uses UnoRouter for chat workspaces.
Recommended models
Free models that work well here. Paste any model id into the client.
allam-2-7bcompoundmistral-mediummistral-medium-c21211-r0-75llama-3.1-8b
Gotchas
- AnythingLLM does not auto-fetch the catalog for Generic OpenAI. Type the model name and context window manually.
- The Embedding Preference tab is separate. Leave it on a working embedding provider unless UnoRouter exposes embeddings on your plan.