OpenAI Event 11: Enhancing ChatGPT Desktop App with New Integrations

2024-12-20

During the recent "12 Days of OpenAI" event, OpenAI gradually unveiled the latest developments in the ChatGPT desktop application. On the 11th day, under the theme "Work with apps," the company announced that the ChatGPT desktop app now supports additional applications such as Apple Notes, Notion, and Quip, along with enhanced integration with various programming environments.

In this update, ChatGPT has added support for multiple integrated development environments (IDEs) including BBEdit, MatLab, Nova, and VS Code, as well as terminal applications like Warp and Prompt. These new integrations, combined with previously supported IDEs such as VS Code, Xcode, and Terminal, form a comprehensive integration network for the ChatGPT desktop app.

Notably, the ChatGPT desktop application is not limited to programming environments; it also includes support for productivity applications such as Apple Notes, Notion, and Quip. These integrations allow ChatGPT to integrate more deeply into users' workflows, providing context-based assistance for their projects.

OpenAI emphasized that all application integrations require user authorization to access data. This measure is designed to protect user privacy and ensure the security of their information.

Kevin Weil, Chief Product Officer at OpenAI, stated during a live stream that the improvements to the desktop application are a significant step towards creating a more intelligent agent-like experience for ChatGPT. He mentioned that as the model's capabilities improve, ChatGPT will be able to perform more tasks beyond simple question-and-answer interactions.

Weil also highlighted the advantages of the desktop application over the web version, such as the ability to access screen content and automate desktop tasks. He revealed that OpenAI will share more information about this transition in 2025.

The update also introduced shortcut keys on MacOS, allowing users to summon ChatGPT with "option + space" and select the desired application, or bring up the current topmost application with "option + shift + 1." These shortcuts enhance efficiency when switching between multiple applications.

Additionally, media outlets noted the discovery of a directory named "AGI_Interface.swift" in an Xcode project, along with a previously exposed "Super Secret AGI" calendar event, suggesting that OpenAI may be actively working on general artificial intelligence (AGI). OpenAI has confirmed that it will release new agents in 2025 and provide more details at that time.

In terms of competition, Google's Project Mariner, Microsoft's Copilot Vision, and Anthropic's Computer Use feature all demonstrate the ability to operate intelligent agents within web browsers or computer environments. In response to these competitive pressures, OpenAI is accelerating its efforts in the agent-based AI domain and is expected to unveil new cutting-edge models on the final day of the "12 Days of OpenAI" event.