GPT-4o is OpenAI’s new flagship model that can reason across audio, vision, and text in real time – and there are advanced new features for free users, too!

GPT-4o is OpenAI’s newest flagship model that provides GPT-4-level intelligence but is much faster and improves on its capabilities across text, voice, and vision, with details of the Spring Update, as it is called, at Open AI’s site here.

Here’s the official launch video:

Launched this morning at 10am in the US and 3am on the east coast of Australia, GPT-4o is much better than any existing model at understanding and discussing the images you share, as the company explains.

You can find more examples of how people are using the new GPT-4o model in this X tweet:

The following text is taken from this part of OpenAI’s site explaining the features – and what users can now access free of charge:

For example, you can now take a picture of a menu in a different language and talk o GPT-4o to translate it, learn about the food’s history and significance, and get recommendations. In the future, improvements will allow for more natural, real-time voice conversation and the ability to converse with ChatGPT via real-time video.

For example, you could show ChatGPT a live sports game and ask it to explain the rules to you. We plan to launch a new Voice Mode with these new capabilities in an alpha in the coming weeks, with early access for Plus users as we roll out more broadly.

To make advanced AI more accessible and useful worldwide, GPT-4o’s language capabilities are improved across quality and speed. ChatGPT also now supports more than 50 languages(opens in a new window) across sign-up and login, user settings, and more.

OpenAI is beginning to roll out GPT-4o to ChatGPT Plus and Team users, with availability for Enterprise users coming soon. The company is also starting to roll out to ChatGPT Free with usage limits today. Plus users will have a message limit that is up to 5x greater than free users, and Team and Enterprise users will have even higher limits.

Bringing more intelligence and advanced tools for free

OpenAI says its mission includes making advanced AI tools available to as many people as possible. Every week, more than a hundred million people use ChatGPT. The company is starting to roll out more intelligence and advanced tools to ChatGPT Free users over the coming weeks.

When using GPT-4o, ChatGPT Free users will now have access to features such as:

Oh, and there’s a new desktop app for ChatGPT, too. Go and play!