Bland 发布 Tofu-1 全双工语音通话模型
旧金山语音 AI 公司 Bland 发布了 Tofu-1,这是一个处于研究预览阶段的全双工语音到语音模型。Tofu-1 语音到语音模型面向行驶中的汽车、医院病房和弱信号线路中的通话场景。它一边说话一边聆听,一边交谈一边推理。对电话智能体团队而言,现在一个模型就能处理音频输入和音频输出,中间不再需要转写文本。你可以通过我们的 GPULeaderboard.com Chrome 扩展在此查看部署选项和规格。
Tofu-1 是 Bland 推出的全双工语音到语音模型,可在电话通话中听取音频、进行推理并以音频回复。它是 Bland 规划中的语音到语音模型系列的首个发布版本。
大多数语音智能体采用级联架构。它们先把语音转成文本,交给语言模型处理,再把回复转回语音。Tofu-1 直接听取音频,因此语调、犹豫和背景声音都能为模型所用。Bland 并未公开其内部架构。
Bland 在产品页面上列出了 3 项音频能力:
来电者可以在 Tofu-1 说话中途打断或纠正它。在处理请求时,它会保持对话继续进行。只有在工作完成后才报告结果。它绝不会提前宣称任务已完成。
由于 Tofu-1 能对通话的声音建模,它也能生成声音。这包括第二位说话人、其周围的环境声以及线路噪声。
TV Test 只问一个问题:模型能否在跟随来电者的同时忽略另一个场景传来的语音?电视音频通常比来电者的声音更大。Bland 标明其 TV Test 演示说明为示意性质,并非录制的模型输出。
竞争对手的数据来自各家厂商自己的页面。FDB 结果使用了不同的基准测试版本,无法直接比较。
研究预览版访问权限面向数量有限的企业开放。Bland 将银行、医疗、保险和政府列为目标行业。报名表要求填写月度通话量,范围从不足 1,000 次到 50,000 次以上。
欢迎查看 Tofu-1 产品页面、X 上的发布帖以及研究预览版报名入口。你可以通过我们的 GPULeaderboard.com Chrome 扩展程序在此查看部署选项和规格。
需要与我们合作推广你的 GitHub 仓库、Hugging Face 页面、产品发布或网络研讨会等?欢迎与我们联系。
文章《Bland 推出 Tofu-1:面向通话的全双工语音到语音模型》首发于 MarkTechPost。
译文由英文原文机器翻译,术语按行业惯例统一,可在文末展开原文核对。
查看英文原文(Bland Launches Tofu-1, a Full-Duplex Speech-to-Speech Model for Calls)
Bland, the San Francisco voice-AI company, has released Tofu-1, a full-duplex speech-to-speech model in research preview. The Tofu-1 speech-to-speech model targets calls from moving cars, hospital rooms and weak-signal lines. It listens while it speaks and reasons while it talks. For phone-agent teams, one model now handles audio in and audio out, with no transcript between. You can check the deployment options and specs here through our GPULeaderboard.com chrome extension.
What is Tofu-1?
Tofu-1 is a full-duplex speech-to-speech model from Bland that hears, reasons and replies in audio during phone calls. It is the first release in a planned family of Bland speech-to-speech models.
How does Tofu-1 differ from a cascade voice agent?
Most voice agents are cascades. They turn speech into text, pass it to a language model, then turn the reply back into speech. Tofu-1 listens to the audio directly, so tone, hesitation and background sound stay available to the model. Bland has not published the internal architecture.
Audio understanding
Bland lists 3 audio skills on its product page:
- Speaker tracking: tells speakers apart and works out who each one is addressing.
- Noise separation: separates voices from a crying child, a TV, highway traffic, a hospital intercom or keypad tones.
- Paralinguistics: hears hesitation, frustration and urgency.
Full duplex and thinking while talking
Callers can interrupt or correct Tofu-1 mid-sentence. While it works on a request, it keeps the conversation moving. It reports the result only when the work is done. It never claims a task is finished early.
Scene generation
Because Tofu-1 models the sound of a call, it can also produce one. That includes a second speaker, the room around them and line noise.
What is Bland’s ‘TV Test’?
The TV Test asks one question: can the model follow the caller while ignoring speech from another scene? TV audio is often louder than the caller. Bland marks its TV Test walkthrough as illustrative, not recorded model output.
How does Tofu-1 compare with other full-duplex models?
| Feature | Bland Tofu-1 | OpenAI GPT-Live-1 | NVIDIA NemotronLabs VoiceChat 11B | Block Dessa |
|---|---|---|---|---|
| Type | Full-duplex speech-to-speech | Full-duplex voice model | Full-duplex speech-to-speech | Full-duplex speech-to-speech |
| Parameters | Not disclosed | Not disclosed | 11B | Not disclosed |
| Weights | Closed | Closed | Open (OpenMDW 1.1) | Not released |
| Training data | Millions of hours of real conversation | Not disclosed | ~550k hours audio plus text | Human speech only, no text |
| Hardware | Bland-hosted | OpenAI-hosted | A100, H100, H200, B100, B200, RTX-6000 | MacBook Pro M4 Max or better |
| Turn-taking latency | Not disclosed | 0.798 s (FDB v1) | 448 ms (FDB) | Not disclosed |
| Tool use | Keeps talking while it works | Delegates to backend model | Live tool calling, 82.5% tool selection (FDB v3) | Not disclosed |
| Access | Enterprise research preview | API and ChatGPT | Hugging Face checkpoint, NVIDIA container | Research preview for safety researchers |
Competitor figures come from each vendor’s own page. FDB results use different benchmark versions and are not directly comparable.
How can teams access Tofu-1?
Research preview access is open to a limited number of enterprises. Bland names banking, healthcare, insurance and government as target sectors. The sign-up form asks for monthly call volume, from under 1,000 to 50,000+.
Key Takeaways
- Tofu-1 is Bland’s first full-duplex speech-to-speech model, built for noisy calls.
- It hears audio directly: speakers, background noise and caller emotion.
- The only number is self-reported: over 92% could not spot it in screenings.
- No size, latency, pricing or benchmarks yet; rivals publish latency and tool-use scores.
- Access is a closed enterprise preview, with Bland citing January availability.
Check out the Tofu-1 product page, the launch post on X and the research preview sign-up. You can check the deployment options and specs here through our GPULeaderboard.com chrome extension.
Also, feel free to follow us on Twitter and don’t forget to join our 150k+ML SubReddit and Subscribe to our Newsletter. Wait! are you on telegram? now you can join us on telegram as well.
Need to partner with us for promoting your GitHub Repo OR Hugging Face Page OR Product Release OR Webinar etc.? Connect with us
The post Bland Launches Tofu-1, a Full-Duplex Speech-to-Speech Model for Calls appeared first on MarkTechPost.
正文保留英文原文,标题与摘要由机器翻译。
原文发布于 MarkTechPost(Bland Launches Tofu-1, a Full-Duplex Speech-to-Speech Model for Calls),标题、摘要与正文由机器翻译,术语按行业惯例统一,未经人工逐句校订。