Microsoft’s Copilot Vision, an AI tool designed to enhance web browsing, is now available for all Edge users in the U.S. This innovative feature analyzes your screen in real-time, allowing you to ask context-specific questions and receive helpful responses. However, the initial rollout is limited to just nine websites.
The selection of supported websites appears somewhat arbitrary, ranging from e-commerce giants like Amazon and Target to niche platforms like Geoguessr, a geography guessing game where external assistance seems counterintuitive. The complete list of compatible websites includes:
List of websites compatible with Copilot Vision.
- Wikipedia
- Tripadvisor
- Williams Sonoma
- Amazon
- Target
- Wayfair
- Food & Wine
- OpenTable
- Geoguessr
Mustafa Suleyman, CEO of Microsoft AI, announced the release on Bluesky, highlighting key use cases. He emphasized Copilot Vision’s ability to understand on-screen content, eliminating the need for lengthy explanations and simplifying complex inquiries.
Traditionally, interacting with Copilot required users to provide detailed context, which could be cumbersome and time-consuming. Copilot Vision streamlines this process by directly interpreting the visual information on your screen.
Copilot Vision assisting with job searches.
Suleyman illustrated this with examples like searching for “breathable sheets” on Amazon and asking Copilot to identify suitable fabrics among the results. He also demonstrated hands-free cooking assistance on the Food & Wine website, with Copilot answering questions and reading recipe instructions aloud. The primary interaction mode is voice-based, with users speaking to the AI and receiving spoken responses. However, typed input and written replies are also supported, as shown in a video on the Copilot Vision page.
Microsoft is adopting a cautious approach with this rollout, likely to avoid the negative reactions experienced with previous AI features. The limited website compatibility is attributed to copyright concerns. Microsoft emphasizes the opt-in nature of the feature, assuring users that their screens are not recorded, the tool is only active when enabled, and all data is deleted after each session.
Those interested in exploring Copilot Vision can access a tutorial and configure the feature through the Microsoft website.
