Microsoft is rolling out a significant update to Copilot Vision for Windows Insiders, enabling the AI tool to analyze entire desktop screens. Previously limited to two applications, this enhancement allows Copilot Vision to view “your whole desktop or any specific browser or app window,” according to Microsoft.
Unlike the automatic snapshotting of Recall, Copilot Vision operates similarly to screen sharing, activated by clicking a glasses icon in the Copilot app. Microsoft states it can “help analyze content, provide insights, and answer your questions, coaching you through it aloud.” Potential applications include offering “tips on making improvements to your creative project, help with improving your resume, or guidance while navigating a new game.”
Copilot Vision’s capabilities are expanding, having initially been tested last year for web browsing in Edge and also supporting analysis via mobile phone cameras.
