OpenAI announced Thursday that it has updated its ChatGPT desktop app to add support for ChatGPT Voice, allowing users to speak to the app to control AI agents and perform tasks on their computers.
This new feature takes advantage of a new family of voice models called ChatGPT-Live that OpenAI launched earlier this month.
OpenAI says ChatGPT Voice works with both ChatGPT Work and Codex, and you can also leverage your computer usage skills to search websites and apps. Additionally, on macOS, Appshots allows users to give apps access to on-screen content, including alt text.
When first released, the smartphone version of ChatGPT Voice featured improved interruption handling and smoother conversations, but it wasn’t built to allow you to perform actions on your smartphone.
Thursday’s desktop update brings improvements that will allow users to issue complex commands with many steps and have ChatGPT respond when it requires input.
OpenAI’s demo video shows developers asking ChatGPT to create new threads, create pull requests, and identify the root cause of bugs with a single command.
The company says users can use Codex’s ChatGPT Voice from their iOS app through remote access.
Anthropic has also updated Claude’s voice modes. This lets you tap the company’s Opus, Sonnet, and Haiku models to complete tasks in apps like Gmail, Calendar, Slack, Notion, and Canva.
