Writing · 4 posts
Notes from building AI systems that have to work in real time.
What I built, what I measured, and what broke. Follow along by RSS.
2 posts tagged tts
2026
Where the latency goes in a local voice agent
A stage-by-stage breakdown of a local voice agent's turn, with measured numbers: speech recognition is cheap, endpointing and the model's first sentence are not.
· 6 min read · voice ai, latency, speech recognition
Swap a hosted model API for a local one without touching the client
A Qwen3 reranker behind a Cohere-compatible /v2/rerank and Kokoro TTS behind OpenAI's /v1/audio/speech: copying an API contract so migration is a base-URL change.
· 5 min read · rag, reranking, tts