Meta showed off a new experimental AI toy. His name is Seamless and it is a voice-to-text-to-voice language translator that can handle almost a hundred input languages and 35 output languages. Including Czech! Z8kaldem is AI technology SeamlessM4T.
In simple demon just make a short voice recording (maximum 15 seconds) in natural Czech:
First, we capture a maximum of 15 seconds of spoken word
You can then choose up to three languages to translate the input into:
It then selects up to three target languages for translation
Then Seamless goes to work. It first converts to text and then translates, including the option to play audio in the target language using a synthesizer.
But it is not a transfer of the speaker’s style – so, for example, you will not speak Bengali directly in your voice – but only a generic voice in the target speech.
Seamless will produce translations including audio recordings using a TTS generator. However, the quality of translations sometimes has large gaps
The experiment is fast and works pretty well, but it’s really just a demo, so the quality of the translation matches that. So although Seamless translated my recording flawlessly to: “My favorite animal is a praying mantis,” however, it translated it into English as: “My favorite animal is a puppy” – a puppy.
2023-08-23 17:45:08
#Seamless #Meta #Record #voice #translate #world #languages #works #Czech
