OpenAI has since left everyone earlier this week with a new and improved version of ChatGPT, the AI chatbot that has quickly become an essential assistant for 100 million users.
Called GPT-4o (the “o” stands for “omni”), the upgraded bot promises to be the Siri you’ve always dreamed of. It can sing, fake, translate languages instantly, recognize the world in live videos, talk to you (and itself), and much, much more.
At its core, the bot is a better, stronger and faster variation of OpenAI’s flagship AI, GPT-4. Although it has the same brain size as its predecessor, it can do a lot more with it, especially when it comes to its text, audio and video capabilities. Best of all, it will be made available to free and paid ChatGPT users in the coming weeks, with its audio and video features coming later.
When it finally reaches these shores, here are the best things you should try first:
What can you do with GPT-4o?
Here are some of the key use cases for GPT-4o, including those demonstrated by OpenAI during the recent demo event and examples from AI power users online.
A more “human” voice assistant.
ChatGPT can now function as a full-fledged voice assistant. Think of it like Alexa, if it could hold a free conversation based on what it can see and hear. But that’s not all. OpenAI also tried to make the bot more human by allowing it to express different emotions and even recognize how you feel. In demos, the bot sang a bedtime story, detected sarcasm and recited it, accurately guessed that it was talking to an OpenAI employee from the company’s logo on his hoodie, and knew that a person was smiling in a live video.
He was so eager to please, that some netizens even joked that they were developing feelings for the female-voiced bot. In an interview, the head of OpenAI, Sam Altman, suggested that the bot will always be available to help, like Siri, indicating that this is the next generation of digital assistants. Based on your predictions for the AI, you’ll either be in awe or in awe.
Prepare for job interviews using multiple ChatGPTs
ChatGPT users are already seeking career tips and advice on everything from writing a cover letter to improving their CV. In the near future, you’ll be able to take your prep work to the next level by letting the bot give you tips on what to wear to an interview based on your appearance. The AI did just that in a demonstration, advising the OpenAI team to run a hand through his scruffy hair and ditch the bucket hat before the big meeting.
Plus, with OpenAI previewing impressive video and voice-driven interaction between a pair of bots, you might be able to enact a full conversation between two GPTs to get you ready for the big day. Of course, it will probably take a bit of work to set up, including long instructions for both bots, but it might be worth it if it lands you that dream gig.
Host work meetings
It looks like ChatGPT will soon be rolling out in many other places, including Zoom calls with your colleagues. Apparently the bot can keep track of a meeting, identify what everyone is talking about, guide the convo, and summarize the whole thing at the end.
His attention span is likely to be controlled by his context window, which refers to the amount of words he can understand when formulating a response. Notably, the demo for this perk was only two minutes long, so it’s unclear how it will fare during longer encounters.
Now that OpenAI is launching a dedicated Mac app for ChatGPT, it could easily wait for your video calls. The digital assistant was also shown to direct a game of rock music, paper scissors and could theoretically oversee other simple pastimes as well. Don’t tell it to watch your kids about it as some social media users advise.
Take an AI translator on your next vacation
OpenAI wants to make language translation easier than the tools we currently have at our disposal (think of the image recognition power of Google Lens).
In a slick demonstration, GPT-4o monitored a multilingual exchange between two people in Italian and English, translating as it went. With the speakers carefully enunciating their words, the whole thing felt a bit staged, casting doubt on the bot’s real-life capabilities.
For example, will he be able to recognize different Italian dialects such as Sicilian, Neapolitan and Sardinian? However, flashing it like gobbledegook can be a saving grace on a foreign menu.
Ask an AI tutor to help with homework
One of the biggest concerns that has emerged from ChatGPT’s overnight success is its use in education. Some schools have even banned the bot for fear of students using it to cheat on their homework.
So, without ruffling any feathers, OpenAI seems to be focusing more on GPT-4o’s ability to act as a teaching aid rather than a wholesale essay writer. We were shown the bot helping a young boy with his geometry homework on an iPad, going back and forth using its visual and audio benefits to guide him to a solution. In this segment, ChatGPT accurately interprets the boy’s drawings and responds with feedback in his typically positive behavior.
The new feature may scare those who believe AI is out to take our jobs but, as a free learning tool, it’s likely to delight many parents and children.
Web search, file upload, data analysis
GPT-4o is really impressive on the 18th handwriting. I gave him the following letter and asked for a transcription. A few very minor errors…great! pic.twitter.com/3JevZvd5p5
— Genetic History (@HistoryGPT) May 14, 2024
With the launch of GPT-4o, ChatGPT free users will get many of the premium features that were previously limited to monthly subscribers.
For example, the bot will be able to find relevant, up-to-date information from the web using Microsoft’s Bing search engine. It will also have the power to convert your uploaded data into interactive tables and charts. More broadly, you’ll be able to instruct it to edit videos, images, documents and more. OpenAI says these advanced tools will arrive in the coming weeks.
Meanwhile, some users have already shared the new ways they use their skills, including finding ancient handwritten letters.