GPT-4o

GPT-4o is a Azure OpenAI model available in Agent Serve. GPT-4o is a Azure OpenAI model tracked in Agent Serve. It supports a 128k token context window. Pricing starts at $2.5/1M input tokens and $10/1M output tokens. Key capabilities include Temperature 0-2, Tool choice, Structured outputs.

GPT-4o starts at $2.5/1M input tokens, $1.25/1M cached input tokens, and $10/1M output tokens.

GPT-4o supports a context window of 128k tokens in Agent Serve. In an agent, this determines how much conversation history, tool outputs, and retrieved documents the model can hold in a single call.

GPT-4o supports the following capabilities in Agent Serve: Temperature 0-2, Tool choice, Structured outputs, Max output 16k.