• ThePrompt
  • Posts
  • SeamlessM4T: Better than Whisper in translation

SeamlessM4T: Better than Whisper in translation

PLUS: Anti-hype LLM reading list

Hi folks!👋🏻 This is The Prompt! Put on your AI hiking boots! We're trekking through the wilderness of AI, but don't worry, we've got the map.

Let's get it

FEATURED

SeamlessM4T: On-demand translations

Meta is on a launching roll.

Open-sourcing the best of the best models across the board — text, music, audio, speech, and now one specifically built for translation.

SeamlessM4T is their newest multilingual model that could do it all.

It is a universal language translator, like the fictional Babel Fish in The Hitchhiker’s Guide to the Galaxy.

Their results show that it’s better than Whisper on all translation tasks.

How does it work?

It works with nearly 100 languages for text and 36 for speech.

It's made up of three main parts: one for understanding speech, one for converting that to text, and one for turning text back into speech.

They also pre-trained some parts to make it work better and more stable.

Try the demo, or download the code, model, and data here.

🚨 What else is going on

  • This paper showed that 62% of the generated code with GPT-4 contains API misuses, which would cause unexpected consequences if the code is introduced into real-world software.

  • IBM is working on an analog chip that mimics the human brain and is up to 14 times more efficient than leading GPUs

  • VFX artists show that Hollywood can use AI to create, not exploit

📕 Resources

🧰 Tools of the trade

  • Cody: The AI that knows your whole codebase

  • Jambot: By Figma, the new AI visual chat for design

  • AI analytics: Get your analytics done in minutes

  • Replymind: Get AI to write replies for you on social posts

  • Summate: Summarize all your newsletters

✍🏼 Prompt of the Day

TOOL

Comic Factory

PROMPT

Joe is watching soccer on TV, super excited. Lisa walks in, grabs the remote, and changes the channel. Joe looks shocked. Lisa smiles and hands Joe a second remote. Joe grins, uses the second remote to switch back to soccer.

RESULT

Subscribe to keep reading

This content is free, but you must be subscribed to ThePrompt to continue reading.

Already a subscriber?Sign In.Not now