Available now
Meta
llama-3.1-8b
Meta's latest class of model (Llama 3.1) launched with a variety of sizes & flavors. This 8B instruct-tuned version is fast and efficient. It has demonstrated strong performance compared to...
TextToolsOpen Weights32K
InputFree
OutputFree
Context32K
Endpointsopenai
Capabilities
ToolsStructured
Modalities
Input
text
Output
text
Quick stats
Context window32K
Max output32K
Modechat
TokenizerLlama3
Knowledge cutoff2023
Hugging Facemeta-llama/Meta-Llama-3.1-8B-Instruct
Performance
Loading performance data...
Supported parameters
| Parameter | Always | Default |
|---|---|---|
| frequency_penalty | - | - |
| logit_bias | - | - |
| max_tokens | - | |
| min_p | - | - |
| presence_penalty | - | - |
| repetition_penalty | - | - |
| response_format | - | - |
| seed | - | |
| stop | - | |
| structured_outputs | - | - |
| temperature | - | |
| tool_choice | - | - |
| tools | - | - |
| top_k | - | - |
| top_p | - |
§ 01
Pricing
| Input price | $0.00 · 1M tokens |
| Output price | $0.00 · 1M tokens |
| Context window | 32K tokens |
| Compatible endpoints | openai |
| Vendor | Meta |
§ 02
Call llama-3.1-8b from your code
Point any OpenAI-compatible SDK at UnoRouter and request the model by name. Replace YOUR_API_KEY with a real key from your dashboard.
bash
curl https://api.unorouter.ai/v1/chat/completions \
-H "Authorization: Bearer YOUR_API_KEY" \
-H "Content-Type: application/json" \
-d '{
"model": "llama-3.1-8b",
"messages": [{"role": "user", "content": "Hello!"}]
}'§ 03
Frequently asked questions
How much does llama-3.1-8b cost per 1M tokens?
Input is priced at $0.00 per 1M tokens, output at $0.00 per 1M tokens. Billing is per token, no rounding to batch sizes.
How do I access llama-3.1-8b via API?
Send requests to the UnoRouter /v1/chat/completions endpoint with model=llama-3.1-8b. Any OpenAI-compatible client library works. Authentication uses a standard Bearer token.
What is the context window of llama-3.1-8b?
llama-3.1-8b supports a context window of 32K tokens, shared between your prompt and the model's response.
§ 04