Microsoft's VASA-1 can create realistic talking faces with single photo and audio clip.
VASA-1 can generate lifelike movements for lips and facial expressions that sync perfectly with the speech.
Microsoft has showcased VASA-1 only as a research demonstration.
As artificial intelligence (AI) continues to advance at an astonishing pace, it’s transforming various aspects of our lives in remarkable ways. One of the latest breakthroughs in AI technology comes from Microsoft, with the unveiling of VASA-1.
Imagine being able to bring a still photograph to life, not just with movement, but with realistic facial expressions and speech. That’s precisely what VASA-1 promises to deliver. With just a simple photo and an audio clip, this innovative AI system can generate captivating videos featuring lifelike talking faces.
In this article, we delve into the details of Microsoft’s VASA-1.
Also read: Google vs Microsoft: Both ready to pitch in $100 Billion on AI, here’s why
Microsoft’s VASA-1
Microsoft has unveiled VASA-1, a new technology that can create realistic talking faces. With just one picture and an audio clip, VASA-1 can generate lifelike movements for lips and facial expressions that sync perfectly with the speech.
VASA-1 is capable of not only producing lip-audio synchronisation, but also generating a large spectrum of expressive facial nuances and natural head motions.
It accepts optional signals as condition, such as main eye gaze direction and head distance, and emotion offsets.
It’s worth noting that VASA-1 can also handle artistic photos, singing audios, and non-English speech.
According to Micrososft, this AI can generate video frames of 512×512 size at 45fps in the “offline batch processing mode”, and can support up to 40fps in the “online streaming mode.”
Also read: Microsoft Copilot AI will soon provide text explanations within Notepad: Here’s how
Availability
Microsoft has showcased VASA-1 only as a research demonstration. The tech giant mentioned that it has “no plans to release an online demo, API, product, additional implementation details, or any related offerings until we are certain that the technology will be used responsibly and in accordance with proper regulations.”
Follow Us
Ayushi Jain
Tech news writer by day, BGMI player by night. Combining my passion for tech and gaming to bring you the latest in both worlds. View Full Profile
