Microsoft Launches Preview of Windows 11 Copilot Plus "Recall" Feature

2024-11-25

Microsoft has recently launched a preview version of the "Recall AI" feature for Copilot Plus PCs. After multiple delays, users in the Windows Insider Dev channel can now install the latest version of Windows 11, which includes the "Recall" and "Click to Do" features. Notably, the "Recall" feature is similar in design to Google's "Circle to Search".

The "Recall" feature can capture nearly all user activity screenshots on Copilot Plus PCs and convert them into searchable content, making it easier for users to recall or trace their operation history. Once enabled, users can utilize the "Recall" app to perform natural language queries to find previous work content. Additionally, the feature provides a scrollable timeline that allows users to jump to specific dates to locate the applications or websites used at that time. The search results of "Recall" leverage AI technology to match text and visual elements within the screenshots.

The "Recall" feature is entirely optional and must be manually enabled by users. For those who decide to try this feature in the Dev channel, after installing the latest build, the models for both "Recall" and "Click to Do" will start downloading in the background. The preview version initially supports only Copilot Plus PCs with Qualcomm processors, while support for Intel and AMD processors will be available soon.

Users can manage which screenshots are saved and can easily delete them. Microsoft also offers a method to exclude specific applications and websites from the "Recall" feature. Additionally, the feature is designed to automatically detect sensitive information, such as credit card details, passwords, and personal identification numbers, and will not save screenshots containing this information.

Microsoft does not have access to any "Recall" screenshots, nor are they uploaded to the cloud or used to train Microsoft's AI models. The Microsoft Windows Insider team stated, "We do not send your screenshots from your PC to Microsoft or any third parties, nor do we use them for training purposes. Microsoft cannot access the keys to view your encrypted data, so if you delete Windows Hello, reset your PC, or migrate to a new PC, we cannot recover your screenshots."

Using the "Recall" feature requires users to authenticate their identity via Windows Hello and access the feature. Additionally, BitLocker and Secure Boot must be enabled, which are typically already activated on Copilot Plus PCs.

In this new Windows 11 test build, "Click to Do" is also part of the "Recall" feature. It aims to recognize text and images within "Recall" screenshots, enabling users to perform AI-driven actions such as copying text or saving images from old screenshots.

In the future, "Click to Do" will also function independently from "Recall." Users will simply press the Windows key and left-click the mouse to display an interactive overlay on the screen. This interface allows users to select images or text to perform clickable actions. Additionally, users will be able to use "Click to Do" on items such as YouTube videos, leveraging Bing for visual searches of objects appearing in the videos.

"Recall" represents a significant test of Microsoft's AI ambitions within Windows. This controversial feature was initially slated for release in June alongside Copilot Plus PCs, but due to security concerns, Microsoft had to postpone its launch. Subsequently, Microsoft delayed "Recall" multiple times, choosing to improve its security mechanisms, make it an optional feature, and allow Copilot Plus PC users to completely uninstall it.

Before releasing "Recall" to a wider audience of Copilot Plus PC users, security researchers will conduct a more detailed review of the feature in its preview state.