YouTube is making it easier for creators to reach global audiences by expanding its AI-powered auto-dubbing feature to knowledge and information-focused videos. Announced on Tuesday, this tool uses advanced artificial intelligence (AI) technology developed by Aloud, Google's in-house Area 120 incubator.

What is auto-dubbing?

The auto dubbing feature enables YouTube to automatically transcribe and translate videos into multiple languages, thus helping creators break language barriers and connect with viewers worldwide. First unveiled at VidCon last year, the tool has now been extended to hundreds of thousands of channels in the YouTube Partner Program that focus on educational and informational content.

Which languages are supported?

The current tool supports nine languages: English, French, German, Hindi, Indonesian, Italian, Japanese, Portuguese, and Spanish.

If a video is uploaded in English, then the tool dubs it in all the supported languages.

Similarly, videos in any of the above languages are dubbed into English.

How does it work?

YouTube claims the process is seamless for creators. There is no need for additional steps; upload a video, and the platform will automatically detect the language and create dubs in supported languages.

Dubbed videos can be managed in the Languages section of YouTube Studio. Creators can review, unpublish, or delete dubs that do not meet their standards.

These videos will bear the "auto-dubbed" label, and viewers will have the option to change to the original audio using the track selector.

Translation accuracy 

YouTube admits that some translations may, on rare occasions, get off the mark or the dubbed voice doesn't exactly match the speaker in the original. The company encourages the public to give feedback for continuous improvement.

YouTube is taking on new capabilities, for example, "Expressive Speech", as previewed on the occasion of the Made on YouTube event in September. 

It aims to provide better dubs, that feel more natural, expressive, and much more accurate.

YouTube is assisting creators to cross the language barrier and reach a broader global audience by expanding its auto-dubbing tool. This feature can be a game-changer for content focused on knowledge and education, as it makes information more accessible to viewers regardless of their language.

As YouTube continues to refine its AI tools, creators can expect even more accurate and expressive dubs, further enhancing the viewing experience for audiences worldwide.