AI avatar generation

ExAvatar is a new 3D full-body dynamic expression model that combines the full-body driving capabilities of SMPL-X and the strong appearance modeling capabilities of 3DGS. It can be created through a simple mobile phone scan and supports animation rendering of various postures and expressions. ExAvatar’s hybrid representation method improves the naturalness of facial expressions, reduces artifacts for new expressions and poses, and makes the model fully compatible with SMPL-X’s facial expression space.

HeyGen Labs provides Expressive Photo Avatar, an online AI video generator that allows users to create avatar videos with expressions and mouth shapes by uploading photos and audio files. This technology uses AI algorithms to simulate the facial expressions and mouth shapes of real people, making video content more vivid and attractive. The product background is to provide users with a simple and fast way to create personalized video content, suitable for a variety of scenarios, such as social media, advertising, education, etc.

V-Express is an avatar video generation model developed by Tencent AI Lab. It balances different control signals through a series of progressive discarding operations, so that the generated video can consider posture, input image and audio at the same time. This model is specifically optimized for situations where the audio signal is weak, solving the challenge of generating avatar videos with varying signal strengths.

AniTalker is an innovative framework capable of generating realistic conversational facial animations from a single portrait. It enhances action expressiveness through two self-supervised learning strategies, while developing an identity encoder through metric learning, effectively reducing the need for labeled data. Not only is AniTalker capable of creating detailed and realistic facial movements, it also highlights its potential for producing dynamic avatars in real-world applications.