Using deepfake to create better Lip-Syncing

Now this is a good use of deepfake: correct the mouth and jaw movements of actors in dubbed video to match the new language track. The result is a (nearly) seamless lip-synced experience.

TrueSync is the first AI offering from our neural network film lab. Filmmakers and content owners are now able to visually translate foreign language film into the native language of any audience. The photorealism is at such a level, the lip-sync so seamless, that the idiosyncratic performance of the onscreen actor remains intact in every detail.

Flawless TrueSync →

Better Times

Pretty crazy: a timelapse + lip-sync video all while growing a beard in between:

Timelapse animation music video, with my beard growing through Covid lockdown. Using my face as a stop-motion puppet (a technique called pixilation), I took 2,117 individual photos, every night, over 101 days, and synchronized the actions to the song “Better Days” by Radical Face.

A ton of planning and work went into that video, as talked about in this behind the scenes:

🤯