Model Router

Model Router is a Azure OpenAI model available in Agent Serve. Model Router is a Azure OpenAI model tracked in Agent Serve. It supports a 200k token context window. Pricing starts at $2/1M input tokens and $8/1M output tokens. Key capabilities include Tool choice, Structured outputs.

Model Router starts at $2/1M input tokens, $0.5/1M cached input tokens, and $8/1M output tokens.

Model Router supports a context window of 200k tokens in Agent Serve. In an agent, this determines how much conversation history, tool outputs, and retrieved documents the model can hold in a single call.

Model Router supports the following capabilities in Agent Serve: Tool choice, Structured outputs.