Blog

AI voice agent testing in five layers: unit, audio replay, simulated phone calls, load and production scoring. Failure taxonomy, thresholds and regression.

Deepgram testing for voice agents: measure latency and WER, load test concurrency limits, and get direct answers to 11 common Deepgram questions.

Voice agent regression testing for changes you don't control: pin each layer, run a nightly pinned-vs-latest canary, and use paired stats to detect drops.

Jev scores clean calls well, but it can't abstain. See where Jev accuracy breaks on real calls, how forced answers skew QA metrics, and how to fix it.

Break a 30-minute manual test call session into 16 checks, then automate them in four layers on LiveKit or Pipecat, with cost math and flake control.

Voice agent prompt versioning for LiveKit and Pipecat: pin each call to a release, gate on pass^k, size the canary, and roll back without dropping calls.

Flux or Nova-3 for a phone voice agent? Verified features, pricing at 50k to 500k calls, what each latency number means, and a bake-off you can run.

Record LiveKit and Pipecat calls in stereo: Egress channel routing, AudioBufferProcessor, Twilio dual-channel, clock alignment, storage math, metric code.

LiveKit agent Kubernetes guide: how agent servers decide they're full, cgroup load traps, drain math for live calls, job-based autoscaling, safe canaries.