ChatGPT’s New Voice Models Can ‘Listen’ and ‘Talk’ at the Same Time

Source Domain: www.cnet.com

OpenAI is updating its AI voice technology to match its text-based artificial intelligence. Two new models, GPT-Live-1 and a mini version, are rolling out now to all ChatGPT users.

The new model duo relies on OpenAI’s latest frontier models. You can select from three different levels of intelligence, depending on how in-depth you want the responses to be. But the biggest update should be that the voice sounds more human and is more conversational, Atty Eleti, product lead for ChatGPT voice, told reporters.

One of the biggest changes under the hood is a new process called continuous interaction. This framework allows the AI to simultaneous receive information and produce outputs — so in the case of voice, it can “listen” and “speak” at the same time. This is a change from previous voice modes that could only respond after you finished speaking.

It’s helpful if you want to do live, simultaneous translation: You can speak in English and have ChatGPT translate what you’re saying into Spanish, Hindi or another language with only a short delay.

Part of the new architecture can also delegate or offload tasks to OpenAI’s frontier models. For example, it can answer a question you asked while researching another one.

“When GPT-Live has to think hard for a question, it can delegate its reasoning and complex task to GPT-5.5, which can do things in parallel, and this GPT-Live can still remain in conversation with the user,” said Kundan Kumar, research lead for the GPT-Live model. When it’s done, it “seamlessly weaves” the answer into its response.

“This is exactly how humans interact with each other,” Eleti added. “We keep the conversation going while we think in the background.”

It also uses OpenAI’s newer AI design tech to create some visual answers, when appropriate, “because sometimes the best answer is displayed, not spoken out loud,” Eleti said. Think weather reports, sports scores and other kinds of graphics.

This is an example of a graphic ChatGPT would make…

Source