One of the most annoying features that Google rolled out in recent time on YouTube is auto-dubbing and auto-translations of content. A video that is uploaded in English by its producer may be translated automatically by YouTube so that its title and its audio are provided in a different language.
Google says that this is extending the reach of the video, which means more clicks and eyes on ads. Critics argue that they want to view the original video, not an AI generated version that offers subpar quality more often than not. Especially multi-lingua users are annoyed by the feature, as YouTube does not provide options to block the feature for languages. Extensions like YouTube Anti-Translate deal with that.
Google announced an addition to the feature today on its Made on YouTube event. Called auto-dubbing with lip sync, it aims to make auto translated videos more believable by matching the translation to the lip movement of the speaker.
Currently, YouTube's auto-translate and auto-dub feature does not take this into account. Means, the movement of the lips of a speaker do not match the spoken works and sounds that come out of the mouth.
The feature is rolling out in the coming months. It supports 20 different languages, including English, German, French, and Spanish initially, with more languages coming in the future.
Google writes: "We're making auto dubbing more realistic than ever. With upcoming lip sync technology, translated videos will now visually match the speaker's lips with the newly dubbed language, making your content more accessible and engaging for global audiences. We support dubbing across 20 different languages, and we’ll begin testing this new lip sync feature in the coming months."
A short video demonstrates the new functionality on YouTube:
Closing Words
Automatically dubbed videos will look more realistically once the feature becomes available. It seems that creators may need to enable the feature for now for their videos. Google could use it automatically in the future to make its auto-translated videos more attractive and less disliked.
Now You: What is your take on auto-translated and auto-dubbed videos? Good move to expand the reach of videos, or annoying?
Thank you for being a Ghacks reader. The post YouTube's controversial auto-dubbing feature will use AI for lip syncing appeared first on gHacks Technology News.
0 Commentaires