- ThePrompt
- Posts
- SeamlessM4T: Better than Whisper in translation
SeamlessM4T: Better than Whisper in translation
PLUS: Anti-hype LLM reading list
Hi folks!👋🏻 This is The Prompt! Put on your AI hiking boots! We're trekking through the wilderness of AI, but don't worry, we've got the map.
Let's get it
FEATURED
SeamlessM4T: On-demand translations
Meta is on a launching roll.
Open-sourcing the best of the best models across the board — text, music, audio, speech, and now one specifically built for translation.
SeamlessM4T is their newest multilingual model that could do it all.
It is a universal language translator, like the fictional Babel Fish in The Hitchhiker’s Guide to the Galaxy.
Their results show that it’s better than Whisper on all translation tasks.
How does it work?
It works with nearly 100 languages for text and 36 for speech.
It's made up of three main parts: one for understanding speech, one for converting that to text, and one for turning text back into speech.
They also pre-trained some parts to make it work better and more stable.
🚨 What else is going on
This paper showed that 62% of the generated code with GPT-4 contains API misuses, which would cause unexpected consequences if the code is introduced into real-world software.
IBM is working on an analog chip that mimics the human brain and is up to 14 times more efficient than leading GPUs
VFX artists show that Hollywood can use AI to create, not exploit
📕 Resources
[model and code] Fine-tuned Code Llama model, which is better than GPT-4 in coding tasks
[lots of useful links]Anti-hype LLM reading list
[a must read] Why Agents are the Next AI Killer App after ChatGPT
[Huggingface demo] Try Code Llama for free
🧰 Tools of the trade
Cody: The AI that knows your whole codebase
Jambot: By Figma, the new AI visual chat for design
AI analytics: Get your analytics done in minutes
Replymind: Get AI to write replies for you on social posts
Summate: Summarize all your newsletters
✍🏼 Prompt of the Day
TOOL
Comic Factory
PROMPT
Joe is watching soccer on TV, super excited. Lisa walks in, grabs the remote, and changes the channel. Joe looks shocked. Lisa smiles and hands Joe a second remote. Joe grins, uses the second remote to switch back to soccer.
RESULT