Microsoft to Offer AI Voice Cloning and Instant Translation in 9 Languages

At Microsoft Ignite 2024, the tech giant unveiled Interpreter in Teams, a groundbreaking tool set to redefine multilingual communication. Starting in early 2025, Microsoft Teams users will be able to use AI voice cloning to replicate their own voices while speaking in up to nine languages, offering a more personal touch to real-time translations during meetings.

How Will Microsoft Interpreter Work?

The Interpreter tool delivers “real-time, speech-to-speech” translation, allowing you to sound like yourself while communicating in English, French, German, Italian, Japanese, Korean, Portuguese, Mandarin Chinese, and Spanish. According to Microsoft, the tool faithfully replicates the user’s message without adding unintended emotions or assumptions.

“Imagine being able to sound just like you in a different language,” said Jared Spataro, Microsoft CMO. To ensure privacy, Microsoft emphasized that AI voice cloner data is not stored or shared. Voice simulation can only be enabled with user consent through a meeting notification or Teams settings.

Potential and Limitations

With features like real-time translation, personalized voice simulation, and privacy-first design, Microsoft’s Interpreter is all set to help you save some time and effort. Competitors such as Meta and ElevenLabs have also been innovating in multilingual speech technology.

However, AI translations still face challenges. They often struggle to convey cultural nuances, colloquialisms, and analogies with the same accuracy as human interpreters. The trade-off might be worth it for businesses looking to save costs, as the natural language processing market is expected to hit $35.1 billion by 2026.

Security and Ethical Concerns

Despite its promise, AI voice clone software like Microsoft’s Interpreter raises concerns about misuse. Deepfake technology has already contributed to significant losses, such as the $25 million wired to cybercriminals after a convincing fake Microsoft Teams meeting earlier this year.

Microsoft assured users that safeguards would be in place, with consent-based activation and tools designed to replicate speech faithfully. Still, concerns remain about bad actors using the tool for fraudulent purposes.

Microsoft Interpreter in a Nutshell

While still in its early stages, Microsoft Interpreter represents a leap forward in AI-driven communication. By combining AI voice cloning with instant translation, the tool has the potential to make cross-language collaboration more natural and engaging. As Microsoft rolls out Interpreter in early 2025, all eyes will be on how effectively it balances innovation with security, ensuring a safe and practical solution for global Teams users.

The post Microsoft to Offer AI Voice Cloning and Instant Translation in 9 Languages appeared first on eWEEK.