YouTube is set to implement automatic dubbing for new video uploads, allowing creators to reach broader audiences. The feature will support automatic translation into nine languages: Spanish, Portuguese, German, French, Italian, Hindi, Indonesian, and Japanese. This capability will enable videos uploaded in those languages to be dubbed into English, while English videos will receive dubbed tracks in those languages.
The auto-dubbing feature, first announced in September during the “Made on YouTube” event, seeks to enhance accessibility by utilizing AI to retain the original speaker’s voice while altering the language. Users on X (formerly Twitter) have noted that the technology will facilitate content creation without altering existing videos, as the feature is being introduced for newly crafted content.
I said podcasts but it’s happening on YouTube first:
YouTube will now auto dub videos in English, Spanish, Portuguese, German, French, Italian, Hindi, Indonesian and Japanese
The dubs will use AI to take the original voice but change the language (like @lexfridman‘s podcast… https://t.co/1awdnDF8lk pic.twitter.com/KhelUxtLZL
— @levelsio (@levelsio) November 21, 2024
YouTube introduces automatic AI dubbing for global audiences
In a recent disclosure, a YouTube spokesperson indicated, “In the coming months, we’ll be expanding our AI-powered dubbing tool, formerly known as ‘Aloud,’ to hundreds of thousands of creators.” Once the feature rolls out, videos will be automatically dubbed upon upload, with a choice to opt-out if desired. Current plans do not include existing content, focusing solely on new uploads for the initial phase.
YouTube’s move to introduce automatic dubbing is part of a broader trend in the industry. Spotify previously announced a similar feature aimed at podcasters, designed to produce more natural audio translations. The feature was initially limited to English and Spanish but later expanded to French and German. In comparison, Meta launched its “SeamlessM4T” to support more than 100 languages, enhancing digital experiences across platforms.
The potential impact of these technologies could be significant, as they provide content creators with tools to connect with international audiences more efficiently. However, there are concerns about translation accuracy, as these AI systems could misinterpret content, leading to unintended consequences. The reliability of the translations remains a focus, especially for creators who do not speak the target language and may rely heavily on AI for accurate rendition.
As this feature rolls out, it is still unclear how quickly it will be available to all creators or how it will perform in practice. The content creation landscape may be poised for a shift, enabling a new level of reach for channel owners who produce content in various languages. The actual effectiveness and reception of this tool by users and creators will likely determine its long-term impact.
Until now, the number of videos utilizing this service upon initial launch remains unspecified. As with many technological innovations, the thoroughness of the implementation will require careful monitoring. Further updates from YouTube will clarify these aspects as the system becomes active.
Featured image credit: Racool_studio/freepik