Wireframe

streaming ASR protocol
model nova-3 · linear16 · 16 kHz · mono

Most speech demos show you a transcript. The interesting engineering is one layer down: the socket. This is a streaming recognition endpoint viewed from the protocol side — interim hypotheses arriving and being revised before anything is committed, endpointing deciding where an utterance stopped, per-frame latency measured as percentiles rather than an average, and a decode queue that applies backpressure when a client streams faster than realtime. Switch it to live microphone and the VAD, adaptive noise floor and endpointer run on your actual audio.

Stream

Transcript interim vs final

Word opacity tracks per-word confidence; an amber underline marks anything below 0.93 — the words a downstream consumer should refuse to act on without confirmation. Watch “bill of lading” and the spoken account number, which are exactly where a general-purpose model gets least certain.

Voice activity & endpointing

Per-frame latency distribution

Wire frames newest first