AssemblyAI拥有发布 AssemblyAI-TTS-1，它的第一个文本转语音型号，现在普遍可以使用。 AssemblyAI-TTS-1 文本转语音 API针对语音agents在直播电话中运行。 在此设定中，发音和发音决定呼叫者是否留在线上。 每1M字符定价为15美元，没有年度合同，没有货币级可购买。 对于已经使用AssemblyAI 语音转文本的开发者，它会用一个供应商关闭语音回路。
TL; DR 数据
- 大小：这是一个主机API模型。
- 运行在：Assembly Assembly's cloud，在美国(US-East-1)或欧盟(eu-North-1). 没有开放权重或Prem选项。 HTTP或WebSocket工作的任何客户端。
- 性能：关于AssemblyAI测试中实体精度的ElevenLabs v4，低于其价格的1/5。
最佳：在AssemblyAI的API测试(自报)中
- 最糟糕的是：在Cekura的独立基准测试，19个定时型号中的第8位上，有159毫秒的中位流延。
- 底线：
- 最佳：每1M个有无限货币的字符15美元。
- 最糟的是：没有SSML，速度控制，发音词典或情感标记。
什么是Assembly-TTS-1? (英语).
AssemblyAI-TTS-1是一个来自AssemblyAI的流式文本转语音模型，将agent的回音变为现场通话的语音。 它接受了数百万小时的音频培训，包括真实的对话数据。 大多数TTS型号代表音频作为离散符号。 AssemblyAI 称 TTS-1则以连续的音频表示方式运作。 AssemblyAI 声称这个改进了现实主义，削减时间是先讲语音的。
发布包括一个拥有4000+个声音和即时语音克隆的图书馆。 克隆人需要一段简短的录音，并获得发言者的许可。 发布帖中的克隆人使用了24秒的音频。 发布支持六种语言：英语，西班牙语，法语，德语，意大利语和葡萄牙语。
开发者如何整合AssemblyAI-TTS-1?
共有3个接口：一款HTTP API，一款WebSocket API和OpenAI相容的路由。 WebSocket会话保持每次对话一个连接，并接受注销消息进行驳入。 输出为单PCM,mu-law或A-law，以8 kHz至48 kHz. 24 kHz PCM为本地格式；电话堆可以直接请求8 kHz mu-law. 包括文字时间戳。 AssemblyAI还出版了LiveKit和Pipecat参考版agents.
AssemblyAI-TTS-1在基准测试上的表现如何？.
AssemblyAI在4个英语集上对5个型号进行了TTS-1测试，使用了50个匹配的克隆声音。 以下所有数字均自报自2026年10月28日的Eval.
- 实体精度(580个硬目标，如电话号码和代码):93.7%，对ElevenLabs v4 93.6%,Cartesia Sonic 3.6 82.5%,ElevenLabs Flash v2.5 68.0%.
- 词精度：99.0%在种子-TTS和LibriSpeech句子上。
- 预想的MOS:3.85，后入世界TTS-2闪电3.88，先出索尼克3.63.82.
- 中间时间到第一个字节：47毫秒。 Flash v2.5取了119 ms, Sonic 3.6 143 ms, Inworld TTS-2 Flash 244 ms. (原始内容存档于2012-10-12).
- 其他：85.5 TTSDS回声分数和0.64 克隆音频的扬声器相似度。
独立结果比较好坏参半。 在Cekura的27个型号的基准测试上，TTS-1的读取精度为81.5%，自然性为4.50. 它的中位流流纬度从上个字发送时间为159毫秒。 Inworld TTS-2 Flash在那里贴出45ms和93.2%的精度，价格相同为15美元。 校对：Soup 在人工分析的受控语音竞技场
AssemblyAI-TTS-1与ElevenLabs,Cartesia和Inworld的对比如何？.
Cartesia 的幅度将每个计划价格除以其信用值，按每个字符1信用值计算。
AssemblyAI-TTS-1的费用是多少？
定价是每个输入字符，包括空间和平分，每1M有15美元。 每一个声音、克隆、文字时间戳和欧盟的处理都以同样的速度进行。 没有每张发票费、货币费或最低数额。 AssemblyAI称其为语音agents的最低价格前沿TTS模型。 然而，"Inworld TTS-2 Flash"也列出每1M按需15美元，在付费计划中降至7美元。 更尖锐的差别是货币：世界范围内的点播级允许5项同时请求。
关键外卖
- AssemblyAI-TTS-1是AssemblyAI的第一个文本转语音模型，为活口音agents所建。
- 每1M个字符花费15美元，无限额货币，没有合同。
- 自报：实体精度93.7%，第一字节中位数47毫秒。
- Cekura测得159毫秒流线性纬度和81.5%的读取精度。
- 在发布失踪：SSML，速度控制，发音词典和情感标记。
请检查access-date=中的日期值 (帮助) 发布站点，docs，定价，以及LiveKit和Pipecat参考文献 agents. 并加入我们的通讯。 等等，你在电报里吗？现在你也可以加入我们的电报。
需要和我们合作推广您的 GitHub Repo OR Hugging Face Page OR Product Release OR Webinar等吗？联系我们
米哈尔·萨特(Michal Sutter)是一名数据科学专业人员，拥有帕多瓦大学的数据科学硕士。 在统计分析、机器学习和数据工程的坚实基础上，Michal出色地将复杂的数据集转化为可操作的见解。
本文由 AI宝库自动抓取并翻译，版权归原作者所有；如需查看原文请点下方链接。
AssemblyAI has released AssemblyAI-TTS-1, its first text-to-speech model, now generally available. The AssemblyAI-TTS-1 text-to-speech API targets voice agents running on live phone calls. In that setting, latency and pronunciation decide whether a caller stays on the line. Pricing is $15 per 1M characters, with no annual contract and no concurrency tier to buy. For developers already using AssemblyAI speech-to-text, it closes the voice loop with one vendor.
TL;DR
- Size: It is a hosted API model.
- Runs on: AssemblyAI’s cloud only, in the US (us-east-1) or EU (eu-north-1). No open weights or on-prem option. Any client with HTTP or WebSocket works.
- Performance: Ties ElevenLabs v4 on entity accuracy in AssemblyAI’s tests, at under 1/5 of its price.
- Best: 47 ms median time to first byte across 6 models in AssemblyAI’s API test (self-reported).
- Worst: 159 ms median streaming latency on Cekura’s independent benchmark, 8th of 19 timed models.
- Bottom line:
- Best: $15 per 1M characters with unlimited concurrency.
- Worst: no SSML, speed control, pronunciation dictionaries or emotion tags yet.
What is AssemblyAI-TTS-1?
AssemblyAI-TTS-1 is a streaming text-to-speech model from AssemblyAI that turns agent replies into speech for live calls. It was trained on millions of hours of audio, including real conversational data. Most TTS models represent audio as discrete tokens. AssemblyAI says TTS-1 operates on continuous audio representations instead. The AssemblyAI claims this improves realism and cuts time to first spoken audio.
The launch includes a library of 4,000+ voices and instant voice cloning. A clone needs a short recording and a confirmation of the speaker’s permission. The clone in the launch post used 24 seconds of audio. Six languages are supported at launch: English, Spanish, French, German, Italian and Portuguese.
How do developers integrate AssemblyAI-TTS-1?
There are 3 interfaces: an HTTP API, a WebSocket API and an OpenAI-compatible route. The WebSocket session keeps one connection per conversation and accepts a cancel message for barge-in. Output is mono PCM, mu-law or A-law, at 8 kHz to 48 kHz. 24 kHz PCM is the native format; telephony stacks can request 8 kHz mu-law directly. Word timestamps are included. AssemblyAI also published LiveKit and Pipecat reference agents.
How does AssemblyAI-TTS-1 perform on benchmarks?
AssemblyAI tested TTS-1 against 5 models on 4 English sets, using 50 matched cloned voices. All figures below are self-reported, from an eval dated October 28, 2026.
- Entity accuracy (580 hard targets such as phone numbers and codes): 93.7%, vs ElevenLabs v4 93.6%, Cartesia Sonic 3.6 82.5%, ElevenLabs Flash v2.5 68.0%.
- Word accuracy: 99.0% on Seed-TTS and LibriSpeech sentences.
- Predicted MOS: 3.85, behind Inworld TTS-2 Flash at 3.88 and ahead of Sonic 3.6 at 3.82.
- Median time to first byte: 47 ms. Flash v2.5 took 119 ms, Sonic 3.6 143 ms, Inworld TTS-2 Flash 244 ms.
- Other: 85.5 TTSDS prosody score and 0.64 speaker similarity for cloned audio.
Independent results are more mixed. On Cekura’s benchmark of 27 models, TTS-1 scored 81.5% reading accuracy and 4.50 naturalness. Its median streaming latency, timed from the last word sent, was 159 ms. Inworld TTS-2 Flash posted 45 ms and 93.2% accuracy there, at the same $15 price. AssemblyAI also cites a 1.7% word error rate on Coval’s leaderboard. It reports a top-10 debut in Artificial Analysis’ controlled-voice arena.
How does AssemblyAI-TTS-1 compare with ElevenLabs, Cartesia and Inworld?
Cartesia’s range divides each plan price by its credits, at 1 credit per character.
What does AssemblyAI-TTS-1 cost?
Pricing is per input character, including spaces and punctuation, at $15 per 1M. Every voice, cloning, word timestamps and EU processing come at that same rate. There are no per-voice fees, concurrency fees or minimums. AssemblyAI calls it the lowest-priced frontier TTS model for voice agents. However, Inworld TTS-2 Flash also lists $15 per 1M on demand, falling to $7 on paid plans. The sharper difference is concurrency: Inworld’s on-demand tier allows 5 concurrent requests.
Key Takeaways
- AssemblyAI-TTS-1 is AssemblyAI’s first text-to-speech model, built for live voice agents.
- It costs $15 per 1M characters, with unlimited concurrency and no contract.
- Self-reported: 93.7% entity accuracy and 47 ms median time to first byte.
- Cekura measured 159 ms streaming latency and 81.5% reading accuracy.
- Missing at launch: SSML, speed control, pronunciation dictionaries and emotion tags.
Check out the launch post, docs, pricing, and the LiveKit and Pipecat reference agents. Also, feel free to follow us on Twitter and don’t forget to join our 150k+ML SubReddit and Subscribe to our Newsletter. Wait! are you on telegram? now you can join us on telegram as well.
Need to partner with us for promoting your GitHub Repo OR Hugging Face Page OR Product Release OR Webinar etc.? Connect with us
Michal Sutter is a data science professional with a Master of Science in Data Science from the University of Padova. With a solid foundation in statistical analysis, machine learning, and data engineering, Michal excels at transforming complex datasets into actionable insights.
Auto-fetched and translated by AI Gem Box. All rights belong to the original author.