YouTube is reportedly expanding its AI-powered auto dubbing feature for knowledge and information-based content only. It will allow creators to engage with a larger audience by removing language barriers. The platform is using Google’s in-house AI technology called Aloud for offering dubbed videos in different languages. Here’s everything that you should know about the new feature.
The new feature is accessible to thousands of YouTubers who create informative or educational content and are a part of the YouTube Partner Program. English-language YouTubers will automatically have their videos dubbed into French, German, Hindi, Italian, Japanese, Portuguese, and Spanish. English dubbing is another option for videos produced in these languages. Using a track selector, viewers can choose to listen to the original audio after seeing the auto-dubbed label.
READ: YouTube begins testing multiplayer mini-games to enhance user engagement: All details
Using this feature doesn’t require extra work on the part of YouTubers. The platform will automatically identify the language and translate the video into one of the supported languages when they upload it. They can watch these videos in the Languages section of YouTube Studio. But creators will have control over the dub, and they can even decide which dubs they don’t like and remove them from the list.
The company notes that because it is a relatively new feature, there may be instances in which the translation does not match the original speaker sound or does not live up to the expectations of the dubbed videos. For that, the users can also submit feedback for the feature’s improvement.
The platform hopes to improve the accuracy, expressiveness, and naturalness of speech in dubs with a feature called Expressive Speech, which was teased at the Made on YouTube event in September.