March 5, 2024

ai getting more realistic and creepier (sora adds ability to realistically talk and sing)

"/

So, get this – the folks over at Alibaba came up with this cool new AI system called EMO. It takes regular ol’ portrait photos and brings them to life by making them talk or sing in videos that look super realistic. They used a fancy model trained on tons of video footage to make EMO work its magic, turning audio into video frames with all those little facial movements and individual characteristics. EMO is top-notch compared to other methods out there, nailing video quality, preserving identity, and really letting personalities shine through.

It even syncs up mouth movements and expressions perfectly for singing videos. How creepy is that?

source