Real-time video AI characters point beyond text chat

Mel AI’s demo shows an AI character experience that goes beyond text chat. The character can speak, match lip movement, change facial expressions, and react to what the user’s camera shows.

If the user appears to be on a plane or in a different setting, the character can notice that environment and bring it into the conversation. The main idea is interaction that combines voice, face, video, and camera context instead of a still avatar or chat box.

It is not clear whether the video is fully generated in real time or partly driven by a polished and system. showed that people want entertainment built around AI characters, and the next race may be making those characters feel alive in live video.

Key points

  • Mel AI’s demo shows an AI character using voice, lip sync, facial , and camera context together.
  • The character can react to the user’s visible environment during the conversation.
  • The experience is closer to live video interaction than a normal chatbot or still avatar.
  • It is unclear how much of the video is truly generated in real time versus handled by and .
  • This is relevant to agent design, but it does not show a token or cost-saving method.
Read original