• ThePrompt
  • Posts
  • Build your own multi-modal chat πŸ”₯

Build your own multi-modal chat πŸ”₯

PLUS: AI girlfriends, AI regulation in the EU, and Meta's AI updates

Hi folks!πŸ‘‹πŸ» This is The Prompt! We're always bringing the latest in AI.

Today we talk about multi-modal agents & AI girlfriends.

Let's get it

FEATURED

Build your own Multi-Modal chat with Transformers Agents 😎

HuggingFace(HF) released an experimental API called Transformers Agents that is fully multi-modal.

It lets you use language models like GPT3, to work with tools via prompts.

But what are tools?

HF hasΒ 100,000+ models from speech to text, language models, and image generators to video creation.

All of these are called tools.

The Transformers Agents API is basically a wrapper that lets you control all of these models via text.

Examples?

With this API, you can build something similar to MiniGPT (chat with images), AudioGPT (understand and generate audio in chat).. and many other use cases like

  • extract info from a PDF screenshot

  • image segmentation

  • image captioning

  • and many others.

Is it free?

The best part is that HF is currently allowing you to use open-source models like Open Assistant and BigCode. You can always use OpenAI if you think that you get better results with it.

See how you can use their API here.

WHAT ELSE IS GOING ON

πŸ‹πŸ»β€β™€οΈ Β AI girlfriend for $1 per minute. Yeah, you read that right. This 23-year-old Snapchat influencer created an AI version of herself, to be able to chat with every follower. She made $72K in a week, Okay…

πŸ¦™Β OpenAI is rolling out Web Browsing & Plugins to paid ChatGPT users. If you’re on the ChatGPT plus subscription, you can enable both features by navigating to your Settings tab! Finally!

πŸ‘€Β Meta announced AI tools for advertisers. With AI Sandbox can create alternative copies, and background generation through text prompts and image cropping for Facebook or Instagram ads. I know that this is very useful for ad creation - GJ Meta!

🧱 EU AI Act that will block American companies to provide generative API in the EU. Regulation is coming, and it’s rigid. They want to do third-party assessments of every model that will want to provide API access for every EU country. Wild.

RESOURCES

The best resources we came across lately that will help you become better at writing prompts & building AI apps.

πŸ“šΒ How to code a project like ChatPDFΒ [ very simple tutorial ]

πŸ‘‹πŸ» ChatGPT vs. Bard: A realistic comparison [ useful article ]

πŸŽ₯Β Quick analysis of ChatGPT plugins [ twitter thread ]

πŸ’° A16Z's recent AI investments [resourceful twitter thread]

TOOLBOX

The latest AI tools to use or get inspiration from.

PROMPT OF THE DAY

TOOL

Midjourney

PROMPT

An old car and beautiful woman standing near a balcony with basket, face of woman is clear + detailed + sharp, in the style of davide sorrenti, documentary travel photography, romantic depictions of historical events, cinematic sets, detailed faces, anthony thieme, earthy colors, basil gogos --ar 21:9 --v 5.1 --style raw

RESULT