Llama 3.1 8B Instant

Llama 3.1 8B Instant is a Groq model available in Agent Serve. Llama 3.1 8B Instant is a Groq model tracked in Agent Serve. It supports a 131k token context window. Pricing starts at $0.05/1M input tokens and $0.08/1M output tokens. Key capabilities include Temperature 0-2, Tool choice, Structured outputs.

Llama 3.1 8B Instant starts at $0.05/1M input tokens, and $0.08/1M output tokens.

Llama 3.1 8B Instant supports a context window of 131k tokens in Agent Serve. In an agent, this determines how much conversation history, tool outputs, and retrieved documents the model can hold in a single call.

Llama 3.1 8B Instant supports the following capabilities in Agent Serve: Temperature 0-2, Tool choice, Structured outputs, Max output 131k.

Best for cost-sensitive automations, background tasks, and high-volume workloads. When used in an Agent Serve workflow, it can be selected in any Agent block from the model picker.