Microsoft today launched Copilot Vision for Windows, expanding its artificial intelligence assistant's capabilities to analyze and interact with any application on users' screens. The feature allows the AI to see what users are doing across their Windows 10 and 11 devices and provide real-time guidance and insights.
The launch represents Microsoft's most ambitious integration of AI into its operating system, positioning the company to compete directly with Google's Gemini Live and Apple's upcoming Intelligence features in the race to create proactive, screen-aware digital assistants.
Copilot Vision enables users to share up to two applications simultaneously with the AI, which can then analyze content, answer questions, and provide step-by-step guidance12. The feature includes a new "Highlights" function that visually shows users where to click and what actions to take within applications23.
"[Copilot Vision] acts as your second set of eyes, able to analyze content, help when you're lost, provide insights, and answer your questions as you go," Microsoft said in a blog post4. Users can ask for gaming tips, photo editing advice, or have the AI compare information across different applications35.
The AI can guide users through complex tasks, such as troubleshooting appliance repairs or navigating software interfaces. For instance, users viewing photos in Adobe Photoshop Elements can ask Copilot Vision for lighting improvement advice, and it will explain specific steps to follow35.
The feature launches exclusively in the United States for Windows 10 and 11 users, with Microsoft promising expansion to "more non-European countries soon"12. The cautious geographic rollout reflects ongoing regulatory scrutiny of AI features in Europe.
Users must manually activate Copilot Vision by clicking a glasses icon and selecting which applications to share12. Microsoft emphasizes that only Copilot's responses are logged, while user inputs, images, and page content are not stored3. The data is deleted when sessions end3.
Copilot Vision represents the latest evolution in Microsoft's AI strategy, which began with GitHub Copilot in 2021 and expanded through Bing Chat integration in 202312. The feature previously existed only within Microsoft Edge browser but now extends across the entire Windows ecosystem34.
Microsoft operates Copilot on a freemium model, with basic features available free but requiring a $20 monthly Copilot Pro subscription for extended functionality beyond Microsoft Edge5. The company continues testing additional features through Copilot Labs, an experimental program for early access users6.
