Translate audio of videos from YouTube, Vimeo, etc using IA

[FabJuni]

Is it possible to translate audios from YouTube, Vimeo, etc from/to English to other languages?

[Jon]

Thanks for submitting an idea to the Mozilla Connect community! Your idea is now open to votes (aka kudos) and comments.

[Mozilla2048]

@FabJuni Well in my opinion it is not impossible but it is difficult! The feature would involve multiple AI models: extract the voice from the video (AI voice extraction from audio), convert the voice to text (AI speech-to-text), translate the text in the desired language (AI translation), convert the translated text back to voice (AI text-to-speech), and replace the original voice by the translated one without modifying the background audio (AI audio editing), in real-time. Much more complicated than simple text translation, but again not impossible... Maybe translated subtitles on the video would be better.