跳到正文
ElevenLabs· @ElevenLabs · X·· 2 小时前AI 评分63
AI 导读

ElevenLabs 发布了全新的强制对齐模型 Cue,可在单次通过中处理任意长度的音频记录,并在基准测试的 29 种语言中表现出优于所有测试开源对齐器的准确率。该模型能在单张 GPU 上以约半秒的时间对齐一小时的音频,目前已应用于 ElevenLabs 的所有语音转文本转录功能,并可通过 Forced Alignment API 独立调用。

正文 · 原文

New from ElevenLabs research: Today we’re sharing more about Cue, our new forced alignment model. It places every character on the audio timeline with more precision than any other aligner we tested. That means the right words show up at the right time.

Forced alignment is the step that turns a transcript into timestamps. It’s how subtitles land on time, how dubbed lines match the speaker, and how clicking a word in a transcript jumps to the moment it was said. Most open-source aligners are built for short, clean clips in a limited set of languages. Cue is one model that handles recordings of any length in a single pass. On real-world audio, it was more accurate than every open-source aligner we tested in all 29 languages of our benchmark. It aligns an hour of audio in about half a second on one GPU.

Cue already powers every Speech to Text transcription on ElevenLabs, and it’s available on its own through the Forced Alignment API.

Read the full post: https://elevenlabs.io/blog/cue-aligner

来源:ElevenLabs · x.com