Notes from building AI systems that have to work in real time.

Swap a hosted model API for a local one without touching the client

A Qwen3 reranker behind a Cohere-compatible /v2/rerank and Kokoro TTS behind OpenAI's /v1/audio/speech: copying an API contract so migration is a base-URL change.

15 Oct 2026 · 5 min read · rag, reranking, tts