TikTok has made on-beat dances and movements mainstream. But what if you went offbeat or the video you recorded had some lag to your perfect dance moves. Adobe can fix that for you.
The company showed off an AI-powered experiment at its Adobe Max conference that syncs your off-beat movement to the beat of the music. Researchers used computer vision to follow the body movement of the person in the video. As shown below, the algorithm also analyzes dance moves through popping orange circles to determine the time of movements.
[Read: How Photoshops new Neural Filters harness AI to generate new pixels]
The researchers also mark beats of the music track with orange lines and plot them against the orange dots to determine if dance moves are in sync with the music.
Adobe uses this analysis to match beats of the song with corresponding movements to make a perfectly synced video. The company said that the algorithm can take random videos of people dancing and sync them with a track, making it look like theyre dancing to the same song.
While this is just an experiment, it could be handy for creators to video editors. I wouldnt be surprised if we see such functionality making it to TikTok or Instagram Reels in a few years.
Published October 22, 2020 — 07:04 UTC
More Stories
US star Megan Rapinoe tells BBC Sport about how taking a knee jeopardised her international career, and what the future holds for women’s football.
Australia’s corporate watchdog is in limbo as the Morrison government awaits the Thom review before deciding the fate of both ASIC and its chairman, James Shipton.
Researchers at Columbia Engineering found that alkali metal additives, such as potassium ions, can prevent lit