
We often get asked whether it's possible to build an AI experience with multiple users and one (or more) agents in the loop. This is where good diarization and a fast classifier model come in clutch. The only real prerequisites these days are good orchestration (Pipecat!), good STT (Deepgram!) and a transport and infrastructure that support multiple tracks (Daily!). Here's a one-shot Claude demo. The agent joins a meeting, and the conversation passes through Jev, which decides whether the agent is being addressed. If it isn't sure, it waits 2.5 seconds, and if no one else answers, it offers a response. All of these thresholds can be tuned. Clearly, I haven’t tuned them in this video 😅 For some use-cases, you might prefer a more natural speaking companion that is chatty and joins the conversation, for others (like this demo) you might want something that stays quiet unless spoken to. Jev adds ~100ms of latency to each turn, which is fine. You could also use a tiny classifier like Pipecat Audience (huggingface.co/pipecat-ai/au…) to make the decision on CPU in as little as 15ms.


