Qwen3.8 Omni Flash Realtime

Alibaba Cloud · Audio Generation

WEBSOCKET /v1/realtime

Speech and live video frames in, speech out over one socket, with 56 voices, tool calling during the conversation, and separate text and audio token rates.

At a glance

Pricing

Example request

import asyncio, json, os, websockets
URL = "wss://api.empiriolabs.ai/v1/realtime?model=qwen3-8-omni-flash-realtime"
async def main():
    async with websockets.connect(
        URL,
        additional_headers=[("Authorization", f"Bearer {os.environ['EMPIRIOLABS_API_KEY']}")],
        max_size=None,
    ) as ws:
        print(json.loads(await ws.recv())["type"])  # session.created
        await ws.send(json.dumps({
            "type": "conversation.item.create",
            "item": {"type": "message", "role": "user",
                     "content": [{"type": "input_text", "text": "Say hello."}]},
        }))
        await ws.send(json.dumps({"type": "response.create"}))
        async for raw in ws:
            event = json.loads(raw)
            if event["type"] == "response.done":
                break
asyncio.run(main())

Parameters

Notes

Connecting

Full-duplex voice over a WebSocket at wss://api.empiriolabs.ai/v1/realtime?model=qwen3-8-omni-flash-realtime, authenticated with the ordinary Authorization Bearer header. Configure the session with session.update over the socket: voice, instructions, modalities, and turn detection.

Sending audio and video

• Append microphone audio as input_audio_buffer.append events.
• Append live video frames as input_image_buffer.append events. Frames are not message content, so an image inside a conversation item is rejected.
• Voice activity detection decides when you have stopped speaking, so keep streaming for about a second after the speech ends.

Voices

The voices on this model are not the same set as the Qwen3.5 Omni realtime models. Pick one from the voice list rather than carrying a voice across, or leave it unset and the default is supplied for you.

Billing

Audio and text tokens are priced separately in both directions, and each completed turn is billed on its own from the usage the model reports.

Machine-readable schema: GET https://api.empiriolabs.ai/v1/models/qwen3-8-omni-flash-realtime.