Copilot on Home windows 11 is testing OS-level integration that may help you share your favorite apps’ display with Copilot.
This characteristic is rolling out to Home windows Insiders in the US, and it would sound like a creepy concept as a result of it principally means Copilot can see what you’re doing in your display—in case you select to share it with the AI app.
Nonetheless, Microsoft says the mixing has some good use circumstances.
For instance, you may wish to share your display with Copilot Imaginative and prescient as a result of it will probably aid you navigate the app in case you’re battling it.

Supply: BleepingComputer
While you share your display with AI, Copilot can then assist analyze, supply insights, reply your questions, and communicate to you in actual time.
When you’re within the Settings app and unable to discover a particular possibility, Copilot Imaginative and prescient can present you the place to find that specific toggle in actual time.
It is unclear how Copilot Imaginative and prescient processes your display information, however keep in mind it is cloud-based, and Microsoft isn’t counting on native AI fashions for this integration.
When you’re a Home windows Insider, you may do that characteristic by clicking the glasses icon within the Copilot app, choosing the browser or app you wish to share the display with, after which asking Copilot that will help you out.
You may cease sharing your display by clicking the Cease button or ‘X’ within the Copilot app.
Copilot’s File Search
The second new characteristic known as “File Search”, which lets you discover a explicit file in your machine and ask questions on its contents.
You need to use on a regular basis language to ask Copilot questions like “Can you discover my resume?” and Copilot will discover the resume.docx for you by scanning your PC’s storage.
In a weblog put up, Microsoft famous that Copilot on Home windows 11 can already learn .docx, .xlsx, .pptx, .txt, .pdf, and .json recordsdata.

Supply: BleepingComputer
In the mean time, Copilot Imaginative and prescient (display share) and File Search options are progressively rolling out within the Home windows Insider Program.
As I discussed on the outset, Microsoft hasn’t clarified how the info is being processed or encrypted, however we’ll seemingly be taught extra concerning the privateness insurance policies when the characteristic exits the testing program.