Speech-to-Animation

Speech-to-Animation

Speech-to-Animation

Speech-to-Animation

Speech-to-Animation (STA) is a technology developed exclusively by FaceUnity, which uses voice message to drive avatar to speak with emotions and movements. The technology combines deep learning neural networks with computer graphics to enable computers to understand the content of speech and fine-tune the avatar's lip movements, facial expressions, and body gestures to create realistic avatar animations.

Demo

Virtual Style
Real Style
Animation Style

Person

Background

Action

Emotion

Text Speech

Chinese Input Only

159/60

示例:主播小芯.mp3
上传配音

仅支持上传 30 秒以内的 .mp3 文件

为了保证合成效果,配音请勿添加背景音乐

English demo is only for display,DIY is not available.

OK

视频生成中…
取消

Technical Advantage

  • 实时语音解析

    Real-time Speech Analysis

    Accurately analyze information in the speech.and transform it into the phoneme script that can drive the avatar.

  • 实时语音解析

    Precise Lip Animation

    It defines dozens of basic lip styles and lip coefficients to realize the lip shape transition of word-to-word pronunciation.

  • 丰富表情情绪反馈

    Rich Expression&Emotion Feedback

    Using 55 blendshapes and expression coefficients to show all common expressions of human.

  • 动作姿态驱动

    Limb Movement Animation

    With mature specifications of skeleton and movement production. Models can be driven by audio content, including the head and the body.

  • 多种风格模型绘制

    Multi-style Avatars

    Supporting the rendering and driving of various types of avatars,including cartoon characters, animal style, real human style, and high-rendering simulation style.

Application Scenario