跳到正文
Rohan Paul· @rohanpaul_ai · X·· 6 天前AI 评分62
AI 导读

HeyGen 的 Professional Voice Clone 依托 30 分钟到 2 小时的录制音频训练,能够还原呼吸、停顿、笑声、口音和元音发音。作者分析认为,两小时的对话数据包含了数百次犹豫、调整、半笑和语速变化,短参考片段无法展现长句前的呼吸或语速加快时的口音特征,这些细微的不规律正是听众判断声音真实与否的关键。

正文 · 原文

Voice cloning has moved past matching timbre. Most of the work now is in what happens between the words.

@HeyGen 's Professional Voice Clone trains on 30 minutes to 2 hours of your recorded audio and is built to keep breaths, pauses, laughs, and accent, along with how your vowels sound.

That data range is the point. Two hours of someone talking contains hundreds of hesitations, recoveries, half-laughs, and changes in pace. A short reference clip can’t show a model how you breathe before a long sentence or where your accent comes through when you speed up.

Those small irregularities are what listeners use to decide whether a voice belongs to a person.

HeyGen says the result is a voice no one can tell apart from yours.

来源:Rohan Paul · x.com