Meta Expands Content Access with AI-Powered Audio Translations for Video

Meta has rolled out AI-powered audio translations for video content, enabling users to view certain content in another spoken language. The tool uses Meta AI's evolving audio translation elements, which can make it look like the people in the video are speaking in a different dialect. Creators can choose to activate audio translations within the Reels composer, with a new toggle to "Translate your voice with Meta AI."

Meta has rolled out AI-powered audio translations for video content, enabling users to view certain content in another spoken language. The tool uses Meta AI's evolving audio translation elements, which can make it look like the people in the video are speaking in a different dialect. Creators can choose to activate audio translations within the Reels composer, with a new toggle to "Translate your voice with Meta AI" [1].

The feature, initially available for English to Spanish translations, is part of Meta's broader strategy to break down language barriers and expand the reach of creators globally. The AI-driven tool analyzes the creator's voice and generates a translated audio track that matches their tone, while also offering an optional lip-syncing feature to align the translated audio with the speaker's mouth movements [2].

Key aspects of the AI translation feature include:
- Voice Dubbing: The AI analyzes the creator's voice and generates a translated audio track that matches their tone.
- Optional Lip-Syncing: Creators can choose to enable lip-syncing, which aligns the translated audio with the speaker's mouth movements.
- Pre-Publication Review: Creators can review and approve the translated version before publishing [2].

The feature is now available to:
- Facebook creators with 1,000 or more followers.
- All public Instagram accounts globally.

However, it's important to note that the tool is only accessible in countries where Meta AI is available, with some notable exceptions including the European Union, United Kingdom, and several other regions [1].

Meta has introduced additional tools to support creators using this feature, such as a Language Performance Tracker to monitor views by language and the ability to upload up to 20 dubbed audio tracks for a single reel [1].

To maintain transparency, viewers will see a notice indicating that the content has been translated using Meta AI. Users also have the option to disable translated reels in specific languages through their settings [1].

Meta has provided guidelines for creators to achieve the best results, including speaking clearly, facing the camera, avoiding covering the mouth while speaking, and minimizing background noise and music [2].

The AI-powered translation feature represents a significant step in Meta's efforts to connect global audiences and support creator growth. Instagram head Adam Mosseri emphasized the potential for creators to reach audiences across cultural and linguistic barriers [1].

As Meta continues to develop this technology, the addition of more languages and potential expansion to other platforms could further revolutionize content creation and consumption in the social media landscape [1].

References:
[1] https://theoutpost.ai/news-story/meta-launches-ai-powered-voice-translation-for-facebook-and-instagram-creators-19264/
[2] https://www.socialmediatoday.com/news/meta-expands-ai-translation-for-video/758080/