A flagship feature coming to Microsoft’s new artificial intelligence-powered Copilot+ PCs has sparked privacy concerns – with an AI assistant that constantly takes screenshots of what people are doing.
The idea behind the ‘recall’ feature is that it works like a super powerful browsing history for the entire device, allowing users to search and retrieve information on anything from one place. The recall feature tracks every action taken on the laptop from voice conversations to web browsing, and creates a detailed history stored on the device. Users can then easily search this history to find out what they have been working on.
But the recall of the service has sparked privacy fears, with Elon Musk comparing it to dystopian sci-fi series Black Mirror and the UK’s Information Commissioner’s Office (ICO) vowing to investigate the feature.
The ICO said: “We are making inquiries with Microsoft to understand the safeguards in place to protect user privacy.”
Yahoo News spoke to Simon Pardo, director of technology specialists Computer Care, about what the new feature will mean for British users.
What is happening?
Recall is a feature of Microsoft’s new, powerful PCs called Copilot+ PCs, which offer advanced built-in AI features.
The ability to sharpen AI data directly on the computer allows the inclusion of a feature called Recall. This tracks everything done on the computer, from web browsing to voice conversations, creating a history stored on the computer.
Users can search Recall when they need to remember something they did, even months later.
Pardo said: “Copilot+ Recall takes screenshots of a user’s computer activity and analyzes them with AI to allow users to search through their past activities, including files, photos, emails and browsing history.
“The idea is to provide a kind of photographic memory that helps users quickly find and recall information they’ve looked at before.”
Why are people concerned?
Social media users and privacy experts have expressed concern that such data collection could lead to problems for users.
“The Recall function is a concern, especially from a security perspective. Compiling a user’s entire digital history across Microsoft services creates a single point of failure that can be devastating for businesses,” said Pardo.
“Consolidating all these snapshots into one location creates a high-value target for attackers, and breaching it could expose a great deal of sensitive information.
“This feature also has serious privacy concerns, and could affect all areas of a user’s life. Taking photos every few seconds is redundant.
“Others have asked how Microsoft might use this data in the future, such as targeted advertising or training AI models. The whole system could have a chilling effect on how people use their computers knowing that everything is being recorded.”
What does Microsoft say?
Microsoft emphasized that Recall will be optional, and users can control what CoPilot+ saves to PCs.
Microsoft says the app exists to provide users with a ‘photographic’ memory of everything that happened on their computers.
Microsoft says in a blog post, Recall does not record audio or save continuous video. “You’re always in control of what’s saved as a photo. You can disable GIF saving, temporarily pause, filter apps, and delete your photos at any time. To help maintain your privacy, Recall processes your content locally on the Copilot+ computer and stores it securely on your device.”
How likely is it to happen?
Britain’s ICO has said it is speaking with Microsoft to ensure privacy protections are built into the software.
The ICO said technology companies must ‘rigorously assess and mitigate risks to people’s rights and freedoms’.
Pardo said: “Microsoft may need to provide stronger protections and opt-out options to ensure compliance and user trust.
“Microsoft will need to ensure that Recall complies with data protection regulations such as the UK’s Data Protection Act and the EU’s General Data Protection Regulation (GDPR).
“The Information Commissioner’s Office in the UK is already conducting an inquiry to assess the product’s compliance and safeguards.
“There is also the question of how does consent work for GDPR-compliant web meetings and information? Will people be notified that they will be screen captured during a meeting?”
“The technology is still being developed, so it’s critical for Microsoft to engage with regulators, privacy advocates, and users to get it right. Ultimately, the success of Copilot+ Recall will depend on Microsoft’s ability to deliver a product that respects user privacy and delivers the promised benefits.”