智东西(公众号:zhidxcom)
作者 | 程茜
编辑 | 漠影
如果让你扮演一名刑侦助手,你能从下面数种声源混叠的音频里分析出受害人的所在位置吗?
讯飞最新发布的语音基座大模型SparkAudio 1.0,在几秒内就给出了答案:被拐孩子周围是大型机械设备发出的规律性噪音,可能在火车或地铁上。
模型给出了完整的分析过程,其没有根据孩子提到的“歌声”就默认是人或乐器发出的声音,而是通过嗡鸣声、机械设备的规律性噪音等数种声源,以及孩子提到的“在车上”去分析可能是什么场景发出的声音。不过,我们在音频中还能听到短促的警示音,模型并没有对此进行分析。
接着下一段音频里,孩子描述了自己所处环境。我们在提示词中要求模型不针对语音内容进行推测,需凭各种声音分析推断被拐孩子附近的状况。
可以看到,SparkAudio 1.0分析时会将孩子说话的内容与声音结合分析,其把音频中汽车声音、机械设备、小朋友说话等各种声音,和孩子描述的“汽车在开会”、“圆圆的车”等抽象内容对应,分析出周围可能有大量体积较大的车等。然后在结论中通过声音线索给出孩子所处位置的几项关键特征。
不过,模型上一个问题就分析了被拐孩子可能在乘坐火车或地铁,但模型并没有结合两段音频做一些综合性判断。值得一提的是,虽然刑侦场景对于线索判断的严谨性非常高,但SparkAudio 1.0已经展现出帮助专业人士在音频文件中挖掘更多潜在线索的能力。
语音本身是人类最本能、最低成本的沟通方式之一。过去AI大多只聚焦识别其中的文字内容,而像SparkAudio这样具备声场+人声复杂感知、理解和推理能力的模型,正让语音交互迈入全新阶段。
伴随AI与物理世界的连接日益紧密,在智能座舱、AI眼镜、人形机器人等诸多场景落地,大模型不仅要听清、听懂,还需要在动态复杂环境里同步感知声音、理解意图、协调行动。
在这一背景下,作为语音技术赛道的头部玩家,科大讯飞将沿着“语音交互—多模交互—具身多模交互”持续进阶,以软硬一体的技术和产品创新,推动新一代人机交互走进日常生活。
这条技术路线的最新成果,就是其上周2026年科大讯飞全球1024开发者节期间,发布的依托全国产算力训练的星火语音基座大模型SparkAudio 1.0。基于这一基座模型,科大讯飞在语音识别、语音同传、实时语音交互等专项场景,形成了一套分层落地思路:
先搭建通用语音基座大模型完成统一音频预训练,让模型学习人声、环境声、时序关联、说话人关系等通用音频表征;基座模型提升识别、同传、实时交互等基础能力,拓展音频理解、情绪识别、实时说话人分离和环境声理解能力,再由语音专用任务大模型面向具体任务做极致调优,以此平衡任务效果、任务精度、时延与工程成本。
语音已经成为下一代AI应用落地的核心交互载体。这套依托全国产算力打磨出来的语音基座大模型,正在为人机自然对话、沉浸式交互打下根基,推动大模型真正听懂声音里的场景、关系与意图,支撑下一代智能硬件的交互革命。
一、搞定智能语音不可能三角?语音基座大模型是杀手锏
语音是区别于图文、原生连续的交互方式,因其能解放眼手,并适配移动、具身场景的交互需求,成为智能座舱、AI眼镜、机器人等下一代硬件的核心交互方式。
但随之而来,这些场景也对语音交互各项指标提出更高要求,使得智能语音效果、任务的准确率/时延指标、工程成本三者很难同时拉满。
我们从科大讯飞亮出的最新答卷里,看到一条平衡这三者的可行路径:语音基座大模型+语音专用任务大模型。
这套方案的基座就是新发布的SparkAudio 1.0。该模型支持文本、语音双模态输入以及文本模态输出,可完成语音转写、多语言翻译、多方言识别、环境音识别、说话人分离、情感分析以及复杂音频问答等任务。
根据科大讯飞公开的基准测试结果,相比于业界多款SOTA闭源模型,SparkAudio 1.0的表现更优,在指令跟随方面与其他模型持平。
正如开头案例所示,音频会携带时序、说话人、环境等独有信息,因此对其进行分析时需要面临场景复杂、噪声干扰强、实时性要求高等挑战。而独立语音基座大模型的价值就在于,可以先吃透声学细节、攻克复杂声场难题,再叠加多模态信息互补增效,从而更贴合真实交互场景。
因此,为了补强模型表征能力、压缩端到端时延、降低推理算力开销,科大讯飞采用了三大核心技术:
首先是半监督音频解码器SemiEnc针对的是语音领域表征建模弱的痛点。
在预训练过程中,其将量化器输入从原始的声学特征升级为结合有监督数据构建的语音专用任务大模型提取的强化表征,引入不同维度的信息先验,通过多任务训练显著强化编码器的建模能力,提升了语音识别等任务的鲁棒性,带来了各项任务的效果提升。
其次是动态分段端到端建模S-S2S,进一步降低端到端时延。
其以语音到语音的端到端语音建模技术为基础,依托语音理解与生成融合反馈决策闭环,打通识别、理解、生成模块的时序壁垒,支持增量流式语义驱动提前生成、动态反馈校正,在保证效果的同时压低语音同传、实时语音交互的响应延迟,满足实时语音业务的低时延需求。
最后是双范式协同解码CoDec,能拉低推理算力开销。
音频编码器首先通过非自回归CTC Decoder并行解码,一次性生成结果,然后通过LLM自回归模块通过投机解码判断是否需要介入、以及从何处开始自回归修正,使其兼顾效果,同时降低平均推理时延和计算成本。
二、在基座之上进行语音专用任务大模型迭代,识别、同传等模型立大功
在此之上,科大讯飞依托自研的独立语音基座大模型,将音频感知、理解、推理统一,作为上层所有语音能力的核心底座。
并在SparkAudio 1.0之上孵化出三大语音专用任务大模型:星火语音识别大模型Spark-ASR-2.0、星火语音同传大模型Spark-LiveTranslation和语音交互大模型Spark-Audio-Realtime。
这些模型分工清晰,基座大模型负责听懂音频、语音专用任务大模型负责把单项任务做到工程可用,这套分层思路对应的正是产业侧对通用理解与专项高性能的现实需求。
具体来看,星火语音识别大模型Spark-ASR-2.0能在准确识别的同时,结合上下文逻辑与语境理解,直接输出更连贯的内容,剔除音频中的语气词、重复表达等冗余信息。
以下面几个场景为例,其中多个音频混杂了时间、书名、网页链接、中英文等,而模型最终输出的是完整通顺的文本,且数字、单位、标点符号等内容格式规范。讯飞输入法16.0已接入该模型,提升了通用识别、复杂声学场景识别、上下文识别和文本流畅规范性。
从官方测试结果来看,Spark-ASR-2.0与当前业界最好水平相比,在方言、高噪和小音量上拥有显著优势,主要任务效果均好于业界最优水平。
这背后同样集成了科大讯飞在语音领域的多项技术突破,其构建了非自回归识别与LLM增强自回归识别的专用语音识别架构。
非自回归识别模块继承Spark-Audio-1.0-Preview的音频表征和复杂声学场景建模能力,并通过MoE扩展、增量持续训练,提升大规模真实复杂场景下的识别鲁棒性。LLM增强自回归识别模块可以进一步发挥大语言模型的语言覆盖、上下文理解和推理能力,通过投机解码判断是否需要介入、以及从何处开始自回归修正。
研究人员还进一步针对中英文混合场景的数据匮乏、上下文信息融合等进行了增强,如构建大规模中英文混合文本数据、通过联合文本辅助与相似音素泛化来拟合不规范发音、将多源语境编码为结构化表征并与声学信息深度融合等。
另外一个语音专用任务大模型是星火语音同传模型Spark-LiveTranslation。其实测显示,相较线上系统,Spark-LiveTranslation的MOS评分由4.4提升至4.6,S2S响应时间也明显缩短。
和普通语音交互场景不同,同声传译的语音输入条件复杂多样,覆盖多场景、长时长任务,且在语句长度、发言语速、现场环境、专业术语等方面差异显著。
因此,科大讯飞针对性提升了Spark-LiveTranslation的场景感知、长历史理解、播报长度调空和复杂场景鲁棒性能力。
该模型会在执行任务时区分是长篇演讲、双人对话、多人回忆,然后选择适合当前交流方式的“翻译质量—翻译延迟”策略,调整等待语义信息的程度与译语输出节奏,以适配现场的同传节奏。
同传场景还会存在时间较长的情况,并且同一名词在不同段落有不同说法。模型会将长历史语境纳入当前内容的理解,结合前文建立的实体指向、术语含义和话题线索,提升篇章级翻译一致性。
针对发言人语速习惯、不同语言的表达习惯,Spark-LiveTranslation会将长历史篇章理解与播报状态结合,动态调控译语的表达长度。播报积压时模型会在不丢失主旨、保持意思一致的前提下,保留关键事实与逻辑关系并采用更紧凑的表达。
最后是复杂专业场景,如中文句子中穿插英文术语、产品名称、缩写、方言表达等。模型能结合领域语境理解。以医疗场景为例,“三甲医院”与“三乙医院”,包含不同的等级信息。模型能够准确翻译、保留这种专业含义上的区别。后续,Spark-LiveTranslation将逐渐上线讯飞听见、讯飞AI眼镜,带来更好的同传交流体验。
除此以外,语音交互也是科大讯飞重点布局的方向,星火语音交互大模型Spark-Audio-Realtime正面向多轮对话场景深度优化。
三、应用遍地开花,讯飞正打造整条语音产业链的地基
大模型时代,语音技术的竞争壁垒已经切换,WER(词错误率)等单点指标已不是评判的唯一标尺,竞争核心正朝着音频预训练数据体系、架构选择、算力自主与端云一体化闭环等方向延伸。
放眼当下国内的主流智能语音路线,各家选择各有侧重,有的侧重开源音频模型、有的依托通用多模态模型、有的聚焦端侧轻量的语音场景。而讯飞此次掏出的基于全国产算力训练的语音基座模型,无疑是智能语音赛道里的一个关键变量。
在这之上,讯飞的智能语音技术正遍地开花,推动人机交互持续迭代,让AI从数字世界走向真实物理空间。
最为直观的案例就是,科大讯飞SparkAudio 1.0已全系落地其多款产品,软件端覆盖讯飞输入法、讯飞听见等;硬件端搭载于讯飞翻译机、讯飞AI录音环、讯飞AI眼镜、讯飞办公本、具身智能等各种载体之上。
以讯飞智能办公本和讯飞AI录音环为例,其基于SparkAudio 1.0升级后,能更轻松应对不少复杂的语音交互场景。
讯飞智能办公本的升级主要体现在三大方面,包括支持手写标注说话人姓名,后续发言自动对应;抢话、多人交叠发言时也能准确区分说话人;可在中英混合、专业术语多的场景精准识别。
另外一款主打语音采集的讯飞AI录音环,则在识别、整理分析精度提升之外,进一步用硬件降低高效录音的使用门槛。它可以直接磁吸在手机背面,整机仅35克。
用户只需轻按机身按键,即可随时启动录音。录音结束后,其会通过WiFi 6高速传输,2小时录音约10秒传至手机、2分钟转成文字,还能智能区分说话人、生成AI会议纪要、提炼重点及待办事项,并支持多语种同声转译。
当下,可穿戴设备、智能座舱、人形机器人等各类新硬件、新软件,都对远场复杂音频处理能力提出更高标准,而讯飞这套语音基座模型,已经展现出成为各类多模态硬件通用底层能力组件的潜力。
四、长坡厚雪,久久为功,讯飞已构筑三层语音壁垒
语音技术的重要性不言而喻,但复杂环境下稳定可靠的语音识别与理解能力,绝非一蹴而就,有赖于海量声学数据沉淀、长年工程打磨与持续迭代。
语音领域的探索是一场跨越周期的长跑。
科大讯飞在智能语音赛道的布局可以追溯到三十多年前,从语音合成开始逐渐覆盖识别、机器翻译、交互等多个维度,持续深耕语音技术,也多次获得Blizzard Challenge、CHiME、IWSLT等不同方向的国际权威语音赛事桂冠。
2024年,由科大讯飞作为第一完成单位的“多语种智能语音关键技术及产业化”项目,荣获2023年度国家科学技术进步奖一等奖。这项奖项分量特殊,是深度学习掀起全球AI浪潮之后,近十年AI领域首个国家科技进步一等奖。
时至今日,大模型浪潮,为语音技术打开了更进一步的窗口。
因此,科大讯飞的技术布局提速,将多年语音技术积累和大模型能力深度融合,发力通用基座大模型、语音专用大模型等方向。
从首发自回归语音大模型架构,到陆续推出星火语音同传、识别等大模型、迭代多模态交互方案,到如今落地基于全国产算力的语音基座大模型,讯飞将长期的语音落地经验,与海量软硬件产品沉淀的数据打通复用。
其将在智能语音领域积累数十年的声学认知、场景经验,承载进了新的基座框架里,让语音交互迸发出新的想象力。
在大模型新周期里,科大讯飞已经在智能语音领域构筑起三层核心壁垒:国产算力自主闭环,统一基座搭配语音专用任务大模型的分层技术路线,以及沉淀多年的语音工程能力与端云数据闭环优势,为国产多模态硬件、具身智能、智能座舱、可穿戴生态等,提供自主可控的语音地基。
结语:为国产语音赛道打下自主可控的地基
SparkAudio语音基座大模型及语音专用大模型的创新体系,是讯飞立足多年语音积累交出的大模型时代新答卷,其既能向内支撑科大讯飞自家办公本、录音环、翻译机等终端产品的体验,也能向外输出底层能力,开放给可穿戴、智能座舱、具身机器人等各类硬件。
从其布局也可以看出,科大讯飞已经构建了一套可生长的语音原生底座,持续驱动识别、同传等核心能力迭代,为国产智能语音产业打下自主可控的音频地基。
本文由 AI宝库自动抓取并翻译,版权归原作者所有;如需查看原文请点下方链接。
Intellectual (WeChat Official Account:zhidxcom)
I'm the author.
Edit Queen
If you were to act as a forensic assistant, could you analyze the victim's location from the audio of several of the following sources?
iFlytek's new publish voice base LLMSparkAudio 1.0 gives the answer in seconds: The abducted children were surrounded by regular noise from large-scale mechanical equipment, possibly on trains or subways.
The model gives a complete analytical process, which does not imply the sound of a human or musical instrument, based on the “singing” referred to by the child, but rather analyses the sound of what may be the scene by the sound, the regular noise of the mechanical device, and the “in the car” referred to by the child. However, we also hear short alerts in the audio, which are not analysed in the model.
And then the next audio, the kid describes his environment. In prompt, we asked the model not to speculate on the content of the voice, but to extrapolate the situation around the abducted child on the basis of sound analysis.
As can be seen, SparkAudio 1.0 analyses the content of the child's speech with the sound, which corresponds to the sound of the car in the audio, the mechanical equipment, the talking of the child, and the abstract content of the child's description of “car in a meeting”, “car in a circular car”, which may have a large number of larger cars, etc. Several key features of the child ' s location are then given in the conclusions through sound trails.
However, the previous question of the model analysed the possibility that the abducted child might be on a train or metro, but the model did not make a comprehensive assessment of the two audio segments. It is worth mentioning that, although the forensic scene is highly critical of the clues, SparkAudio 1.0 has demonstrated its ability to help professionals find more potential leads in audio files.
Voice itself is one of the most instinctive and least costly ways of communication for humanity. In the past, AI had mostly focused on identifying the text in it, while models like SparkAudio, which had the capacity for sound field + human sound complexity, understanding and reasoning, were bringing voice interaction into a new phase.
As AI becomes more and more connected to the physical world, LLM not only hears and understands, but also shares sound, understanding intent and coordinating actions in dynamic and complex environments, in many settings, such as smart cabins, Ai glasses and human robots.
In this context, as the head player of the voice technology track, Big iFlytek will continue to follow the “voice-to-mode-to-mode-to-mode” step, with soft and hard technology and product innovation that will drive a new generation of human beings to cross into daily life.
The latest result of this technical route is that last week in 2026, during the Big iFlytek Global Day of Developers, publish relied on a national calculator-trained Starfire Voice Base LLMSparkAudio 1.0. Based on this base model, Big iFlytek has developed a layered approach to specific scenarios such as voice recognition, voice simultaneous transmission and real-time voice interaction:
First, a universal audio pre-training programme was developed to allow models to learn generic audio expressions, such as voice, voice, time-series, voice-to-mouth, and so forth; the base model was developed to enhance basic capabilities such as recognition, homogeneity, real-time interaction, and to expand audio understanding, emotional recognition, real-time voice separation and environmental sound understanding, and LLM, a voice-specific mission, was used to achieve a high level of quality for specific tasks, so as to balance mission effects, mission accuracy, latency and project costs.
Voice has become the core interactive carrier for the next generation of AI applications. This voice base LLM, which depends on the country ' s ability to calculate, is laying the foundation for a natural human-made dialogue, immersional interaction, and promotes LLM ' s real understanding of the scenes, relationships and intentions of the voice, and supports an interactive revolution of the next generation of smart hardware.
I. Cannot triangulate with smart voice? Voice base LLM is a killer.
Voice is a continuous interaction that is different from textual, progeny, because it frees eyes and corresponds to the need to interact with moving, context-specific, and becomes the core of the next generation of hardware, such as smart pods, Ai glasses, robots, etc.
However, these scenes have led to a higher demand for voice interaction indicators, making it difficult to cover both smart voice effects, mission accuracy/latency indicators and project costs.
From the latest responses from Big Z66Z, we see a viable path to balance these three: voice base LLM+ voice task LLM.
The basis of the package is SparkAudio 1.0 of the new publish. The model supports text, voice two-modular input and text-modern output, and performs such tasks as voice transliteration, multilingual translation, multi-verbal recognition, environmental sound recognition, voice separation, emotional analysis and complex audio question and answer.
Based on the results of open baseline tests conducted by Big Z 66Z, SparkAudio 1.0 performed better than the industry ' s multiple SOTA closed source model, and was consistent with other models in terms of command follow-up.
As the first cases show, audio carries unique information, such as time series, talking people, environment, etc., and therefore analyses of them need to face high challenges in terms of complexity of scenes, high noise interference and real-time demands. The value of LLM, the independent voice base, is that it is useful to have first access to acoustic details, to solve complex acoustic challenges, and then to add multimodular information to complementarities, so as to better fit the real interactive scene.
As a result, in order to supplement model representation, compress the end-to-end latency and reduce the cost of reasoning, Grand iFlytek uses three core techniques:
The first is the semi-supervised audio decoder, SemiEnc, which targets the pain points of weak speech-based modelling.
During the pre-training process, it upgraded the quantization device from its original acoustic feature to an enhanced sign taken from LLM, a voice-specific task with supervised data construction, introduced information aforewords of different dimensions, and enhanced the robustness of tasks such as voice recognition through multi-tasking training in the modelling of a significantly enhanced encoder, resulting in increased effectiveness of tasks.
Next is the dynamic end-to-end model S-S2S, which further reduces the end-to-end latency.
It is based on end-to-end voice modelling techniques that rely on sound understanding and the generation of integrated feedback to close the loop for decision-making, access time-series barriers to recognition, understanding and generation of modules, support the incremental flow-driven advance generation, dynamic feedback correction, while ensuring effects, while reducing response delays for voice simultaneous transmission and real-time voice interaction, and meet the low latency requirements of real-time voice operations.
Finally, a two-size-fits-all decode CoDec, which lowers the cost of reasoning.
The audio encoder first produces the results in one-time parallel decoders through non-self-regression of the CTC Decoder, and then the LLM self-regression module uses speculative decoders to determine whether or not to intervene and where to begin self-regression modification to balance the effects, while reducing the average reasoning latency and calculating costs.
ii. Special voice-based mission LLM, recognition, homogeneity.
On this basis, Big iFlytek relies on self-researched independent voice base LLM, which integrates audio perception, understanding and reasoning as the core base of all upper-level speech capabilities.
LLM: Starfire Voice Recognition LLMSpark-ASR-2.0; Starfire Voice Consisting LLMSpark-Live Transport; and Voice Interactive LLMSpark-Audio-Realtime.
These models are clearly divided, with the base LLM, which understands the sound, voice-specific task LLM, which is responsible for the engineering of individual tasks, responding to the real needs of industry for common understanding and dedicated high-performance.
Specifically, the Starfire Voice Recognition LLMSpark-ASR-2.0 allows for more consistent content to be directly exported, along with the logical and linguistic understanding of context, removing redundant messages such as linguistics and repetitive expressions from the audio.
The following are examples of several scenarios, many of which combine time, book names, web links, Chinese and English, etc., while the model ends up with a full and consistent text and is regulated by content formats such as numbers, units, symbols, etc. The iFlytek input method, 16.0 has been integrated into the model, which enhances universal recognition, complex acoustic scene recognition, context recognition and text flow regulation.
According to official test results, Spark-ASR-2.0 has a significant advantage in dialects, high noise and small volume in comparison to the best level of the current industry, with the main tasks performing better than the best level of the industry.
This was also followed by a number of technological breakthroughs in the voice area by Big iFlytek, which built a dedicated voice recognition architecture for non-return recognition and LLM enhancement of self-return recognition.
The non-regression recognition module inherits Spark-Audio-1.0-Preview ' s audio representation and complex acoustic scenario modelling capabilities, and enhances recognition of great, real and complex scenes through MoE expansion and continuous training. LLM enhancement of the self-regression recognition module can further develop the language coverage of the large-language model, the context understanding and reasoning capability, and determine, through speculative decodement, whether or not to intervene and where to begin self-regression correction.
Researchers have further enhanced their response to the lack of data in mixed Chinese-English scenes, the integration of context information, such as the construction of large-scale mixed Chinese-English text data, the preparation of irregular pronunciation through combined text aids and the retrofitting of analogues, the coding of multi-source languages into structured forms and the integration of acoustic information.
Another special voice mission, LLM, is the Starfire Voice Consistency Model Spark-LiveTranslation. In fact, compared to the online system, the MOS rating for Spark-LiveTranslation was raised from 4.4 to 4.6 and the response time for S2S was significantly reduced.
Unlike the normal speech interactive scenes, simultaneous interpretation of voice input conditions are complex and varied, covering multiple scenes and long missions, and vary significantly in terms of length of speech, speed of speech, physical environment, professional terminology, etc.
As a result, Big Z66Z has targeted and enhanced Spark-LiveTranslation ' s scene perception, long-historic understanding, long airing and complex scenery.
The model distinguishes between long speeches, two-person conversations, multiple recollections, and then chooses a “translation quality-translation delay” strategy that is appropriate for the current mode of communication, adjusting the degree of waiting for semantic information to the speed of the translation output to fit the simultaneous rhythm of the site.
There would also be a longer period of time for the same scene, and the same term would differ in different paragraphs. The model will incorporate a long historical context into the understanding of the current content and enhance consistency of translation at the chapter level, taking into account the entity ' s orientation, terminological meaning and subject matter lines established earlier.
In response to speakers ' fast-talking and language-specific expressions, Spark-LiveTranslation combines a long history of understanding and broadcasting, and dynamically regulates the expression of translations. The reporting of the backlog model would preserve the key facts and logic and adopt a more compact expression without losing the subject matter and maintaining consistency of purpose.
Finally, there are complex professional scenarios, such as the insertion of English terminology, product names, abbreviations, dialectic expressions in Chinese sentences. The model combines the field context. In the medical scene, for example, “3A” and “3B” hospitals contain different levels of information. Models can be accurately translated and such professional meaning differences retained. Following this, Spark-LiveTranslation will gradually go on line iFlytek to hear, and iFlytek AI glasses to bring a better experience of peer exchange.
In addition to this, voice interaction is also the direction of the major iFlytek layout of the Big Z, and the starfire voice interaction LLMSpark-Audio-Realtime is aimed at optimizing the depth of multiple rounds of dialogue.
III. Applications to flower all over the world. iFlytek is building the foundation of the entire voice chain.
In the era of LLM, the competitive barriers to voice technology have been changed, and single-point indicators such as WER (the word error rate) are no longer the only yardstick to judge, and the core of the competition is moving in the direction of audio pre-training data systems, structure selection, arithmetical autonomy, and cloud integration closed loops.
In the current country, there is a focus on the main intelligent voice lines, some on open-source audio models, some on a generic multi-modular model, and some on a light voice view on the focus end. And the voice base model that iFlytek pulled out this time, based on a national calculus, is undoubtedly a key variable in the smart voice track.
On top of this, iFlytek's smart voice technology is flourishing, driving humans to interact and to move AI from a digital world to real physical space.
The most intuitive cases are the iFlytekSparkAudio 1.0, which is fully integrated into its multiple products, and the software end covers iFlytek input, iFlytek hearing, etc. The hardware end is on iFlytek Translators, iFlytek AI audio-rings, iFlytek AI glasses, iFlytek office books, smart carriers, etc.
In the case of iFlytek smart office books and iFlytek AI audio sets, based on SparkAudio 1.0 upgrades, it is easier to cope with complex speech interactions.
The upgrading of iFlytek ' s smart officebooks is mainly in three main areas, including support for hand-written names of speakers and automatic matching of subsequent statements; the precise distinction between speech-telling and multi-faceted interventions; and the precise identification of scenarios with mixed Chinese-British and multidisciplinary terminology.
Another iFlytek AI audio-ring, which was collected by voice, further reduced the threshold for the use of efficient recordings by hardware, in addition to the increased accuracy of identification, collation and analysis. It's a direct magnetic suck on the back of the phone, and the whole machine is only 35 grams.
The recorder can be activated at any time if the user presses the body button. After the sounding is completed, it is transmitted via WiFi 6 high-speed, with two hours of recording being sent to a mobile phone for about 10 seconds, two minutes to text, and it is also able to intelligently distinguish between speakers, generate AI minutes, extract priorities and to-dos, and support multilingual simultaneous translation.
At the moment, new hardware, new software, such as wearable equipment, smart cabins, human-shaped robots, etc., all offer a higher standard for apogee complex audio processing capabilities, while the iFlytek voice base model has demonstrated the potential to become a generic bottom-capable component for all types of multimodular hardware.
iv. Long slopes of snow, long and long, iFlytek has built three floors of speech barriers
While the importance of voice technology is self-evident, a stable and reliable voice recognition and understanding capacity in a complex environment is by no means overnight dependent on the deposition of big acoustic data, the grinding of long-term engineering and the continuation of it.
The exploration of the voice field is a long run across the cycle.
The layout of Koda iFlytek in the smart voice track dates back more than 30 years and begins to cover multiple dimensions, such as recognition, machine translation, interaction, and continuous deep tilling of voice, as well as international authoritative voice contests in different directions, such as Blizzard Challenge, Chime and IWSLT.
In 2024, the first completed project, “Multilingual Smart Voice Critical Technology and Industry”, was awarded the National Prize for the Advancement of Science and Technology, 2023. The award is of special importance and is the first prize for scientific and technological progress in the first country in the AI field in the last decade, following the global AI wave of in-depth learning.
To date, the LLM wave has opened a further window for voice technology.
As a result, the technological layout of Kodak iFlytek has been accelerated, combining years of sound technology accumulation with the depth of LLM capability in the general base LLM and the exclusive voice LLM direction.
From the initial LLM structure from the return to voice LLM, to the roll-out of the Starfire Voice Consistency, Identification, LLM, and the iterative Multiple Modular Interactive Program, to the current landing, which is based on the sound base LLM, Z66Z, which is based on the country ' s ability to calculate, to the long-term voice landing experience, to re-use data from the sinking of big soft and hardware products.
It will accumulate decades of acoustic awareness, scenery and experience in the area of intelligent voice, and will be carried into the new frame of the base, allowing voice to interact and generate new imagination.
In the new cycle of LLM, Big Z66Z has built three layers of core barriers in the area of intelligent voice: the autonomous closure of the national production capacity, the consolidation of a tiered technical route of the base with a special voice mission LLM, and the advantages of the closure of voice engineering capabilities and end cloud data that have been deposited for many years, providing an autonomous and controlled voice base for national production of multimodular hardware, intelligence, smart cabins, wearable ecology, etc.
Concluding remarks: An autonomous and controlled foundation for the national speech track
The SparkAudio voice base LLM and the voice-specific LLM innovation system is a new LLM-age iFlytek-based, multi-year voice-accumulation-receiving, LLM-based survey that enables both the experience of end-of-service products such as large iFlytek office books, audio-rings, and translation machines in the Inner Support Section and the export of bottom-level capabilities, and is open to all kinds of hardware, such as wearable, smart cabins and body robots.
As can also be seen from its layout, Big iFlytek has built a set of growthable protometric floors that continue to drive core competencies such as recognition, homogeneity and the creation of an autonomous and controlled audio base for the national intelligent voice industry.
Auto-fetched and translated by AI Gem Box. All rights belong to the original author.