Microsoft today begins testing its new Copilot Vision feature. Originally revealed in OctoberCopilot Vision lets Microsoft’s AI companion see what you see on an Edge web page you’re browsing. You can then ask it questions about the text, images and content you’re viewing or use it to help you.
“When you choose to enable Copilot Vision, it sees the page you are on, it reads with you, and you can discuss the problem you are facing together,” explains the Copilot team. in a blog post. “Browsing no longer has to be a solitary experience with just you and all your tabs. »
This is a completely optional experience and you must explicitly grant permission for Copilot Vision to be able to read web pages in Microsoft’s Edge browser. Microsoft initially introduced the feature in October by showing how its AI assistant could read images from a collection on OneDrive on the web and even decipher handwritten recipes and offer cooking tips. You can also use this feature when shopping on the web to find product recommendations.
Copilot Vision is currently in limited testing, available only to Copilot Pro subscribers through Microsoft. Copilot Labs Program. It’s clear that Microsoft is taking its time on this particular feature, as it allows AI models to start reading things you see on screen in a web browser, which will naturally generate privacy concerns. I’m sure the security issues around the new Reminder functionwhich ultimately I entered the test last monthplayed a big role in Microsoft’s caution here.
“As we roll this out, Vision will initially only interact with a select set of websites,” the Copilot team explains. “Over time, we will cautiously expand this list. It is important to emphasize that Vision does not capture, store or use any data from publishers to train our models. In short, we prioritize copyrights, creators, and the privacy and security of our users, and we put them all first.
A limited number of Copilot Pro subscribers will be able to access Copilot Vision today in the United States, as Microsoft works to listen to feedback and iterate on Copilot Vision. It plans to expand access to more Pro subscribers and websites “over time.”