{"id":29185,"date":"2023-01-11T03:12:29","date_gmt":"2023-01-11T03:12:29","guid":{"rendered":"https:\/\/mailinvest.blog\/index.php\/2023\/01\/11\/microsoft-unveils-vall-e-a-text-to-speech-ai-that-can-mimic-a-voice-from-seconds-of-audio\/"},"modified":"2023-01-11T03:12:29","modified_gmt":"2023-01-11T03:12:29","slug":"microsoft-unveils-vall-e-a-text-to-speech-ai-that-can-mimic-a-voice-from-seconds-of-audio","status":"publish","type":"post","link":"https:\/\/mailinvest.blog\/index.php\/2023\/01\/11\/microsoft-unveils-vall-e-a-text-to-speech-ai-that-can-mimic-a-voice-from-seconds-of-audio\/","title":{"rendered":"Microsoft unveils VALL-E, a text-to-speech AI that can mimic a voice from seconds of audio"},"content":{"rendered":"

<\/a>\n
<\/p>\n

\n

Microsoft Corp. today gave us a peek at a text-to-speech artificial intelligence tool it\u2019s been working on that can apparently simulate a voice after listening to just three seconds of an audio sample.<\/p>\n

The company said that this tool, VALL-E<\/a>, can keep the emotional tone of the speaker for the rest of the message while also simulating the acoustics of the room from which it first heard the voice. Not only can it do this from a short audio sample \u2013 which is unheard of so far \u2013 but Microsoft is saying no other AI model can sound as natural.<\/p>\n

Voice simulation is nothing new. In the past, it\u2019s been used to simulate human voices, but not always for the best of reasons<\/a>. The concern here is that the more such AI improves, the better the audio deepfakes, and then we might have a problem. At the moment, it\u2019s impossible to know just how good VALL-E is since Microsoft has not released the tool to the public, although it has provided samples of the work that\u2019s been done. It\u2019s frankly very impressive,<\/a> if, indeed, that mimicry took only three seconds, and the voice could go on to speak for any length of time.<\/p>\n

If it\u2019s as good as Microsoft says it is and can quickly sound as human as a human, charisma and all, you can see why Microsoft wants to invest heavily<\/a> in the AI that has just taken the world by storm, OpenAI LLC\u2019s ChatGPT. If combined, perhaps people asking questions on the phone at call centers will not be able to distinguish a human from a robot. Maybe the tools together might also be able to create what seems like a podcast, except the guest is not real.<\/p>\n

A powerful tool that can perfectly mimic someone\u2019s voice after just a few seconds is concerning. In the hands of the wrong people, it could be used to spread misinformation, mimicking the voices of politicians, journalists, or celebrities. It seems Microsoft is well aware of the potential misuse.<\/p>\n

\u201cSince VALL-E could synthesize speech that maintains speaker identity, it may carry potential risks in misuse of the model, such as spoofing voice identification or impersonating a specific speaker,\u201d Microsoft said at the conclusion of the paper. \u201cTo mitigate such risks, it is possible to build a detection model to discriminate whether an audio clip was synthesized by VALL-E. We will also put Microsoft AI Principles into practice when further developing the models.\u201d<\/p>\n

Photo: Volodymyr Hryshchenko<\/a>\/Unsplash<\/h5>\n
\n
\n

Show your support for our mission by joining our Cube Club and Cube Event Community of experts. Join the community that includes Amazon Web Services and Amazon.com CEO Andy Jassy, Dell Technologies founder and CEO Michael Dell, Intel CEO Pat Gelsinger and many more luminaries and experts.<\/span><\/h3>\n<\/div><\/div>\n