- ThePrompt
- Posts
- Build your own multi-modal chat ๐ฅ
Build your own multi-modal chat ๐ฅ
PLUS: AI girlfriends, AI regulation in the EU, and Meta's AI updates
Hi folks!๐๐ป This is The Prompt! We're always bringing the latest in AI.
Today we talk about multi-modal agents & AI girlfriends.
Let's get it
FEATURED
Build your own Multi-Modal chat with Transformers Agents ๐
HuggingFace(HF) released an experimental API called Transformers Agents that is fully multi-modal.
It lets you use language models like GPT3, to work with tools via prompts.
But what are tools?
HF has 100,000+ models from speech to text, language models, and image generators to video creation.
All of these are called tools.
The Transformers Agents API is basically a wrapper that lets you control all of these models via text.
Examples?
With this API, you can build something similar to MiniGPT (chat with images), AudioGPT (understand and generate audio in chat).. and many other use cases like
extract info from a PDF screenshot
image segmentation
image captioning
and many others.
Is it free?
The best part is that HF is currently allowing you to use open-source models like Open Assistant and BigCode. You can always use OpenAI if you think that you get better results with it.
See how you can use their API here.
WHAT ELSE IS GOING ON
๐๐ปโโ๏ธ AI girlfriend for $1 per minute. Yeah, you read that right. This 23-year-old Snapchat influencer created an AI version of herself, to be able to chat with every follower. She made $72K in a week, Okayโฆ
๐ฆ OpenAI is rolling out Web Browsing & Plugins to paid ChatGPT users. If youโre on the ChatGPT plus subscription, you can enable both features by navigating to your Settings tab! Finally!
๐ Meta announced AI tools for advertisers. With AI Sandbox can create alternative copies, and background generation through text prompts and image cropping for Facebook or Instagram ads. I know that this is very useful for ad creation - GJ Meta!
๐งฑ EU AI Act that will block American companies to provide generative API in the EU. Regulation is coming, and itโs rigid. They want to do third-party assessments of every model that will want to provide API access for every EU country. Wild.
RESOURCES
The best resources we came across lately that will help you become better at writing prompts & building AI apps.
๐ How to code a project like ChatPDF [ very simple tutorial ]
๐๐ป ChatGPT vs. Bard: A realistic comparison [ useful article ]
๐ฅ Quick analysis of ChatGPT plugins [ twitter thread ]
๐ฐ A16Z's recent AI investments [resourceful twitter thread]
TOOLBOX
The latest AI tools to use or get inspiration from.
DataBerry.ai : Build a ChatGPT plugin in minutes
WPTurbo: Ship WordPress pages faster with AI
AI Carousels: Create social media carousels
DayZero: Convert your ideas into a focused plan
Website Colors: Get the colors of your favorite websites
PaletteBrain: Use ChatGPT across your apps
Lalamu: Create Lip-sync videos
PROMPT OF THE DAY
TOOL
Midjourney
PROMPT
An old car and beautiful woman standing near a balcony with basket, face of woman is clear + detailed + sharp, in the style of davide sorrenti, documentary travel photography, romantic depictions of historical events, cinematic sets, detailed faces, anthony thieme, earthy colors, basil gogos --ar 21:9 --v 5.1 --style raw
RESULT
What'd you think of today's edition? |