Microsoft has created an advanced artificial intelligence (AI) text-to-speech program, VALL-E 2, capable of generating speech that is indistinguishable from a human voice. This significant development, achieving what is termed “human parity,” means the program can produce speech that cannot be differentiated from real human speech. However, due to potential security risks, Microsoft has decided to keep this technology strictly within its research department and not release it to the public.
VALL-E 2 stands out because it can accurately clone voices after analyzing just three seconds of audio. This capability allows it to replicate the voice’s tone, cadence, and inflection with exceptional accuracy, surpassing the performance of previous AI speech systems in terms of naturalness and similarity to the original speaker. Despite these advancements, Microsoft has highlighted several potential dangers associated with the misuse of this technology.
According to Microsoft researchers, the primary concern is the risk of voice spoofing and impersonation. They pointed out that the technology could be exploited for fraudulent activities such as identity theft and phone scams, where a cloned voice could deceive victims into believing they are speaking with a trusted individual.
“There are significant risks associated with the misuse of this model, including spoofing voice identification and impersonating specific speakers,” the researchers stated. Consequently, there are “no plans to incorporate VALL-E 2 into a product or expand access to the public.”
The decision to withhold VALL-E 2 from public use comes amid rising concerns about the misuse of AI technologies, especially in the context of the upcoming presidential election. Earlier this year, fake robocalls using President Joe Biden’s voice surfaced in New Hampshire, demonstrating how AI-generated voices could be used in political disinformation campaigns. Some supporters of President Biden have even suggested using AI to cover up his age-related cognitive issues during the campaign.
While VALL-E 2 represents a remarkable achievement in AI, Microsoft’s cautious approach highlights the importance of addressing ethical and security concerns. The decision to keep this technology under wraps underscores the need for careful consideration of the potential consequences of releasing powerful AI tools to the public. As AI continues to advance, the balance between innovation and security will remain a crucial consideration.
