New AI wave with SAM 🌊

PLUS: 28 AI startups from YC Demo day

Hi folks!πŸ‘‹πŸ» This is The Prompt! We're your go-to source for the latest AI trends!

Today, we feature SAM and the projects that are starting to be built around that model. Maybe you'll get some inspiration!

+ We take a look at some of the most interesting AI startups from Y Combinator's latest demo day.

Let's get it πŸ‘‡

FEATURED

New AI wave with SAM 🌊

SAM (Segment Anything Model) by Meta, which we covered in our last issue is starting a new AI wave.

Folks are combining it with other models to create a bunch of amazing things.

I wanted to highlight two interesting projects that might give you inspiration for your own idea/project/demo to play with!

Grounded SAM model πŸ¦•

SAM is great at segmentation, but it needs prompts to generate masks. Grounding Dino is a model that can generate high-quality masks with texts.

Combine the two and you have a model to detect and segment everything with text.

Add Stable Diffusion in the mix, and you can β€œedit” objects in the photos.

An interesting use case for that:Β Change hairstyles with text.

Edit Anything by SAM

This project aims to Edit and Generate Anything in an image.

It combines ControlNet, BLIP & Stable Diffusion so far.

Blip2 prompt: β€œA black drone flying in the blue skyβ€œ

What can you build?

It looks like the next phases of these projects are: ChatGPT integration, interactive controls & automatic editing, and labeling of photos.

Hopefully, this gave you some inspiration!πŸ™ŒπŸΌ

WHAT ELSE IS GOING ON

πŸ¦™Β NY Times made the AI-generated images Turing test. See if you can find the real photo vs the AI-generated ones.

πŸ‘€Β The theme for the latest YC demo day was β€” you guessed it: AI! And most of the startups said that they launched a few weeks ago and that have already a good ARR. The AI bubble is here.

πŸ‹πŸ»β€β™€οΈ Β Wanna fake a sick day? Well, AI can catch you in the act. Researchers built an AI that can tell if you’re sick just from your voice.

RESOURCES

The best resources we came across lately that will help you become better at writing prompts & building AI apps.

πŸ“šΒ Trend in AI: Models all the way down (Stacking) [ Twitter Thread ]

πŸŽ₯Β The LLaMa effect for open-sourced models [Interesting article]

TOOLBOX - YC EDITION

The most interesting AI tools from the latest YC demo day!

  1. Type – AI-first document editor.

  2. Iliad – Generate game art assets.

  3. Layup – Build workflows across apps with one line command, like onboarding a hire.

  4. Nucleus – AI-powered onboarding orchestration that understands β€œthe true nature of a business.”

  5. Hadrius – SEC-compliance robo-advisor.

  6. Speedybrand – Generated marketing content for SMBs.

  7. Quazel – Language learning with an AI tutor.

  8. Booth.ai – Generative AI β€œphotographer” for e-commerce.

  9. Squack – Natural language accountant tools.

  10. Berri.ai – Creating ChatGPT apps as a service.

  11. Semantic – Financial news insights β€œenriched” by AI.

  12. Credal.ai – ChatGPT-like interface for employees that references company docs but protects business secrets

  13. Defog – Add AI data assistant to your app.

  14. Linkgrep – AI-browser copilot for teams

  15. Sail – Automated sales emails.

  16. Aiflow – Automate market research based on reviews and feedback

  17. Tennr – Turn knowledge base into a custom LLM.

  18. Truewind – AI powered bookkeeping and finance processes.

  19. Flair labs – Collect insights from customer service calls and email

  20. Justpaid – Automate bill pay, catch over-payments to vendors.

  21. Kyber – Automate insurance industry tasks like answering questions and underwriting.

  22. Meru – Platform for training your own LLMs.

  23. Sameday – AI that calls workers like plumbers and roofers to make appointments

  24. Zenfetch – Analyze customer calls live and surface talking points.

  25. Syncly – AI to analyze customer emails.

  26. Pair AI – Video courses generated using AI.

  27. Latent – Automating electronic health records.

  28. Avoca – AI receptionist to answer missed calls at SMBs.

PROMPT OF THE DAY

TOOL

Midjourney V5

PROMPT

A Pixar movie about a demon boy who lives in Hell, his father is Satan, and he finds himself on Earth befriending a human girl.

RESULT

LATEST PAPERS

  • InstantBooth: Personalized Text-to-Image Generation without Test-Time Finetuning

  • Generative Agents: Interactive Simulacra of Human Behavior

  • SparseFormer: Sparse Visual Recognition via Limited Latent Tokens