YouTube is introducing a new AI-powered tool to translate videos in different languages

YouTube is introducing a new AI-powered feature to facilitate video dubbing in different languages. During the VidCon event, the company announced its collaboration with Aloud, an AI dubbing service developed by Google’s Area 120 incubator.

Aloud’s website explains the process: First, the tool transcribes the video, providing a transcription that can be reviewed and edited. Then, it proceeds to translate and generate the dubbed audio. A demonstration video showcasing the details is available.

According to YouTube’s Amjad Hanif, the tool is currently being tested with numerous creators, and Aloud already supports a select number of languages, including English, Spanish, and Portuguese. Additional languages will be added in the future, as confirmed by spokesperson Jessica Gibby.

Despite the current limitations in language availability, Aloud holds promise for content creators who seek to incorporate multi-language dubs in their videos. To experience the results firsthand, you can listen to the Spanish dub track in a video from the Amoeba Sisters channel by accessing the gear icon and selecting “Audio track.”

YouTube has plans to enhance the translated audio tracks further. By 2024, they aim to make them sound more natural, capturing the creator’s voice, emotions, and lip sync, as mentioned by Hanif. Gibby also confirmed that these features are on YouTube’s roadmap for the future.