The capability should be generally available in the following weeks.

There is no doubt that Microsoft Edge has some good translation capabilities: from the live translation of its PDF reader to the more advanced video translation enhancements that effectively allow users to translate audio or subtitles while watching videos in the browser, Microsoft wants to make sure no one feels left behind.

This is most likely why the Redmond-based tech giant is bringing AI-generated voice dub translations to videos, according to the latest post from software enthusiast @Leopeva64.

In other words, you’ll be able to listen to video translations rather than reading them on Microsoft Edge, all due to a new enhancement that uses AI to generate that audio translation.

“After many attempts and multiple crashes I was finally able to make a short recording of Edge’s video translation feature, in the first video you can hear the original audio and in the second you can hear Edge’s AI-powered translation:https://t.co/FIcnSbSZjT pic.twitter.com/ozilW5YMOc— Leopeva64 (@Leopeva64) May 6, 2024“

According to the enthusiast, Microsoft Edge will have AI generate different voices for dubbing the translation based on who’s speaking. For instance, if a man is speaking in the video, AI will generate a male voice, and if a woman is speaking, then a female voice will be generated.

Source: https://windowsreport.com/

Full article: https://windowsreport.com/microsoft-edges-latest-video-translation-capability-will-use-ai-generated-voice-dub/