Structured output and Merge Gateway support

Structured output and Merge Gateway support

Constrain chat model responses to JSON or a JSON Schema with response_format, and use EmpirioLabs models through Merge Gateway.

Structured output

  • Structured output with response_format. Constrain a chat model to return JSON. Send {"type":"json_object"} for any valid JSON object, or {"type":"json_schema", "json_schema": {...}} to force output that matches a schema you provide. It works on /v1/chat/completions, /v1/completions, /v1/messages, and /v1/responses (through the Responses text.format field).
  • See which models support it. Every model page and GET /v1/models now shows a Structured output field: JSON Schema (schema enforced), JSON Mode (valid JSON), or Not supported.
  • In the playground. Chat models that support it now have an Off / JSON mode / JSON schema control, with a box to paste your schema.

Now available on Merge Gateway

  • EmpirioLabs is a supported model vendor on Merge Gateway. If your team routes LLM traffic through Merge Gateway, you can now select EmpirioLabs models there and call them alongside your other providers.