ChatGPT is now able to “see” images, listen to you in a conversation and speak back in another breakthrough the in rapidly advancing world of artificial intelligence.
OpenAI, the company behind ChatGPT, on Monday laid out these advances, which allow you to speak conversationally when asking a question or show a picture to get more specific responses. The company will introduce these capabilities to ChatGPT Plus and Enterprise customers over the next two weeks, with voice coming to iOS and Android.
The breakthrough illustrates just how quickly AI has advanced in just the last year, with the capabilities of ChatGPT taking the world by storm and driving Big Tech to pour resources into building their own capably smart systems. While AI has long been around, the abilities of the new generation, which include generating whole stories, art and other content historically created by humans, sets it apart.
Since then, AI has been integrated in everything from coding to art, with the technology promising to play a bigger role in all our lives in the future.
OpenAI said that the new capabilities will allow you to engage in a back-and-forth conversation with the assistant, including asking it for “a bedtime story for your family, or settle a dinner debate.”
You can also share a photo with ChatGPT to get a specific question answered. As an example, OpenAI showed how someone shared an image of their bike with the request to help lower the bike seat. ChatGPT responded with a five-step process. The person then uploaded a photo of a specific part of the bike to ask if that was the lever, which ChatGPT responded was actually the bolt, and proceeded to recommend an Allen wrench to loosen.
OpenAI said it is deploying the features gradually, a nod to concerns expressed experts about the rapid development of AI.
“OpenAI’s goal is to build AGI that is safe and beneficial,” the company said. “We believe in making our tools available gradually, which allows us to make improvements and refine risk mitigations over time while also preparing everyone for more powerful systems in the future. “