11-19 更新 实时
首页/ AI 大模型/ 正文

Fish Audio 发布 Live 3 全双工语音模型,响应 186 毫秒

AI 大模型 来源:MarkTechPost 2026-11-11 12:43 0 阅读 机器翻译

Fish Audio 发布了 Live 3,一款为实时语音智能体打造的全双工语音模型。Fish Audio Live 3 全双工语音模型在说话的同时持续聆听。这让来电者可以停顿、说"嗯嗯",或改变主意,而不会打断通话。对开发者而言,其卖点很简单:轮次切换从手工调校的流水线规则中移出,进入语音模型本身。

Live 3 是 Fish Audio 推出的全双工语音模型,可同时聆听与说话。

核心论点是:速度与时机是两个不同的问题。智能体可以回复得很快,却仍在错误的时刻开口。"你们几点开门?"之后的停顿通常意味着一个轮次结束,而电话号码中间的停顿则不然。

大多数语音智能体把识别、推理、语音生成和轮次切换拆分到各自独立的流水线阶段中。Fish Audio 团队表示,Live 3 把对话时机判断移入语音模型。该模型在真实人类对话上训练,以学会何时应声、等待、回应或停止。

他们把旧方法描述为不断堆叠"更多规则、更多阈值"。Fish Audio 则希望让模型从数据中学习时机。独立的推理层仍然承载智能体的指令与工具。

Fish Audio 团队梳理了 3 种行为:

Fish Audio 表示,Live 3 最快可在 186 ms 内决定作出回应。这一数字涵盖"嗯嗯""好的"和简短确认等短促反应,完整回答则在并行准备中。

这是小型反应的下限,而非完整回复的首个音频输出时间。Fish Audio 并未公布延迟分布。第三方追踪机构 OrcaRouter 也报告称,截至 11 月 11 日,Live 3 尚无 Artificial Analysis 评分。

Live 3 已在 Fish Agent Platform 上线,可通过 Fish Audio API 调用,也面向企业提供本地部署。Agents 平台目前处于公开测试阶段。

Agents 在 /v1/agent/* 下提供 REST 接口。浏览器会话通过 @fishaudio/agent-client 或 @fishaudio/agent-react 运行。智能体可以接听电话号码、通过 WebRTC 连接,或嵌入网站小组件。Live 3 页面列出了 2,000,000+ 个音色库音色,其中包括克隆音色。

一份待合并的文档 pull request 显示,Live 3 通过 voice.engine: "live3" 启用。开启后,语音识别固定为 fish_audio:transcribe-stream-1。Fish Audio 目前的文档称,该模型还会将语音重叠分类为打断或确认。

Live 3 页面标价为每分钟 $0.035,较 $0.07 下调 50%,优惠持续至 2026 年 12 月 31 日。页面称该方案包含 Live 3。定价文档称,$0.07 的标价涵盖 STT、TTS、基础 LLM、知识检索和工具调用。

电话通话每分钟加收 $0.01。一个电话号码每月费用为 $1.20。新账户可获得 $5 试用余额。

ElevenLabs 的得分来自 Artificial Analysis,由 ElevenLabs 引用。OpenAI 和 Google 的数据为自行报告。

需要与我们合作推广你的 GitHub 仓库、Hugging Face 页面、产品发布或网络研讨会等?欢迎与我们联系。

文章《Fish Audio 发布 Live 3:一款 186 毫秒响应的全双工语音模型》首发于 MarkTechPost。

译文由英文原文机器翻译,术语按行业惯例统一,可在文末展开原文核对。

查看英文原文(Fish Audio Releases Live 3, a Full-Duplex Voice Model That Reacts in 186 ms)

Fish Audio has released Live 3, a full-duplex voice model built for real-time voice agents. The Fish Audio Live 3 full-duplex voice model keeps listening while it speaks. That lets a caller pause, say “mm-hmm,” or change their mind without breaking the call. For developers, the pitch is simple. Turn-taking moves out of hand-tuned pipeline rules and into the speech model.

TL;DR

  • Product: A full-duplex voice model built for real-time voice agents
  • Runs on: Hosted Fish Agent Platform and Fish Audio API; on-premises for enterprises.
  • Performance: Fish Audio shows behavior demos, but publishes no benchmark scores.
  • Best: Can decide to respond in as little as 186 ms for short reactions like “mm-hmm.”

What is Fish Audio Live 3?

Live 3 is a full-duplex voice model from Fish Audio that listens and speaks at the same time.

The core argument is that speed and timing are different problems. An agent can reply fast and still speak at the wrong moment. A pause after “What time do you open?” usually ends a turn. A pause in the middle of a phone number does not.

How does Live 3 handle turn-taking?

Most voice agents split recognition, reasoning, speech generation and turn-taking across separate pipeline stages. Fish Audio team states that Live 3 moves conversational timing into the speech model. It was trained on real human conversations to learn when to acknowledge, wait, respond or stop.

They framed the old approach as piling on “more rules and more thresholds.” Fish Audio instead wants the model to learn timing from data. A separate reasoning layer still holds the agent’s instructions and tools.

The Fish Audio team walks through 3 behaviors:

  • Acknowledging without taking over. A caller reads “415… 555… 0132.” Live 3 may say “okay, 415” between chunks, then wait.
  • Telling a backchannel from an interruption. A caller saying “yeah” lets the agent continue. “Wait, actually, I just need Thursday” makes it stop.
  • Waiting through corrections. For “two pizzas… no, three,” Live 3 waits instead of logging the wrong order.

How fast is Live 3?

Fish Audio states Live 3 can decide to respond in as little as 186 ms. That figure covers short reactions such as “mm-hmm,” “okay” and quick confirmations. The full answer is prepared in parallel.

This is a floor for small reactions, not time-to-first-audio for a complete reply. Fish Audio has not published a latency distribution. Third-party tracker OrcaRouter also reports no Artificial Analysis score for Live 3 as of November 11.

How do developers deploy Live 3?

Live 3 is available on the Fish Agent Platform, through the Fish Audio API, and on-premises for enterprises. The Agents platform is in public beta.

Agents expose a REST surface under /v1/agent/*. Browser sessions run through @fishaudio/agent-client or @fishaudio/agent-react. Agents can answer phone numbers, connect over WebRTC, or sit in a website widget. The Live 3 page lists 2,000,000+ library voices, including cloned voices.

A pending docs pull request shows Live 3 enabled with voice.engine: "live3". With it on, speech recognition is fixed to fish_audio:transcribe-stream-1. Fish Audio’s current docs say that model also classifies overlaps as interruptions or acknowledgements.

How much does Live 3 cost?

The Live 3 page lists $0.035 per minute, down 50% from $0.07, until December 31, 2026. It says the plan includes Live 3. The pricing docs say the $0.07 list rate covers STT, TTS, basic LLMs, knowledge retrieval and tool calls.

Phone calls add $0.01 per minute. A number costs $1.20 per month. New accounts get a $5 trial balance.

How does Live 3 compare with other full-duplex voice models?

MetricsFish Audio Live 3OpenAI GPT-Live-1Eleven Realtime v1 MaxGemini 3.8 Live
DesignFull duplex, timing learned in the speech modelFull duplex, delegates reasoning to a backend modelCascaded, tuned end to endLive dialogue model, runs tools in the background
LanguagesEnglish onlyNot disclosed90+97
Published timing186 ms minimum (short reactions)Not disclosed in post text0.57 s avg time to first audioNot disclosed
Turn-taking scoreNot published+30 pp Full Duplex Bench vs GPT-Realtime-2.1 (self-reported)94.1% Full-Duplex-BenchNot disclosed
Reasoning / agent scoreNot published#1 on Tau3 with GPT-6 Astra (medium)98.8% Big Bench Audio; 87.1% tool tasksExtended Thinking: 97.7% Big Bench Audio; 68.6% τ-Voice
Price$0.035/min promo, $0.07 list (incl. STT, basic LLM, TTS)$0.05/min voice layer + backend tokensSession time + tokensNot disclosed in launch post
DeploymentAgent Platform, API, on-premAPI, telephonyElevenAgents, Realtime APIGemini API, AI Studio, Gemini Enterprise (preview)

ElevenLabs scores come from Artificial Analysis, as reported by ElevenLabs. OpenAI and Google figures are self-reported.

Key Takeaways

  • Live 3 is Fish Audio’s full-duplex voice model for phone and web agents.
  • It learns turn-taking from real conversations instead of silence thresholds.
  • Short reactions can start in as little as 186 ms.
  • Agents cost $0.035 per minute until December 31, 2026, then $0.07.
  • English only, with no published benchmark scores yet.


Check out the launch post, try it at fish.audio/live3, and see the Agents docs. Also, feel free to follow us on Twitter and don’t forget to join our 150k+ML SubReddit and Subscribe to our Newsletter. Wait! are you on telegram? now you can join us on telegram as well.

Need to partner with us for promoting your GitHub Repo OR Hugging Face Page OR Product Release OR Webinar etc.? Connect with us

The post Fish Audio Releases Live 3, a Full-Duplex Voice Model That Reacts in 186 ms appeared first on MarkTechPost.

正文保留英文原文,标题与摘要由机器翻译。

本文由采集器自动同步

原文发布于 MarkTechPost(Fish Audio Releases Live 3, a Full-Duplex Voice Model That Reacts in 186 ms),标题、摘要与正文由机器翻译,术语按行业惯例统一,未经人工逐句校订。

阅读原文 ↗