Structured output and Merge Gateway support
Structured output and Merge Gateway support
Constrain chat model responses to JSON or a JSON Schema with response_format, and use EmpirioLabs models through Merge Gateway.
Structured output
- Structured output with
response_format. Constrain a chat model to return JSON. Send{"type":"json_object"}for any valid JSON object, or{"type":"json_schema", "json_schema": {...}}to force output that matches a schema you provide. It works on/v1/chat/completions,/v1/completions,/v1/messages, and/v1/responses(through the Responsestext.formatfield). - See which models support it. Every model page and
GET /v1/modelsnow shows a Structured output field: JSON Schema (schema enforced), JSON Mode (valid JSON), or Not supported. - In the playground. Chat models that support it now have an Off / JSON mode / JSON schema control, with a box to paste your schema.
Now available on Merge Gateway
- EmpirioLabs is a supported model vendor on Merge Gateway. If your team routes LLM traffic through Merge Gateway, you can now select EmpirioLabs models there and call them alongside your other providers.
