Yazılar

Microsoft enhances Windows 11 with new AI-powered Copilot upgrades

Microsoft has unveiled a wave of artificial intelligence upgrades for Windows 11, aiming to make its Copilot assistant smarter, faster, and more integrated across users’ daily workflows. The update, announced on Thursday, introduces new capabilities that allow users to automate real-world tasks and connect seamlessly with apps and services.

A standout addition is the “Hey Copilot” voice activation feature, which lets users wake the AI assistant hands-free to perform commands or answer questions. The feature is opt-in and will be available across all Windows 11 PCs.

Microsoft is also expanding Copilot Vision — a tool that can analyze what’s on a user’s screen and provide context-aware assistance — to all markets where Copilot is offered. A new text-based version of Vision will also launch for Windows Insiders, enabling users to interact through typing instead of voice alone.

An experimental “Copilot Actions” mode will allow the assistant to take actions directly from the desktop, such as booking restaurant reservations or ordering groceries, with user-granted permissions. The company emphasized that Copilot agents will only access data explicitly approved by users.

In addition, Microsoft debuted “Gaming Copilot”, now built into Xbox Ally consoles, offering players real-time tips and gameplay support through AI integration.

“We’re on the cusp of the next evolution — where AI is not just in chatbots but naturally embedded into hundreds of millions of daily experiences,” said Yusuf Mehdi, Microsoft’s chief marketing officer for consumer products.

Microsoft Rolls Out Copilot Vision to All Users on Edge Browser

Microsoft has officially rolled out Copilot Vision to all users of its Edge browser, marking a significant expansion of its AI-powered capabilities. Initially introduced in December 2024, Copilot Vision was limited to Copilot Pro subscribers. However, as of last week, the feature is now freely available to every Edge user. Designed to work as a real-time assistant, Copilot Vision enables the AI chatbot to interpret and interact with the contents of any webpage, assisting users with tasks such as summarizing content, identifying visual elements, and even guiding them through online research or shopping.

The announcement was made by Mustafa Suleyman, CEO of Microsoft AI, in a post on X (formerly Twitter). He highlighted the feature’s usability and simplicity, saying it will “think out loud with you when you’re browsing online.” Suleyman emphasized that Copilot Vision is meant to reduce the friction of traditional browsing—eliminating the need to constantly copy-paste text or formulate specific search queries. This announcement signals Microsoft’s commitment to making its AI tools more accessible and integrated directly into everyday digital workflows.

Copilot Vision works by using computer vision to “see” the content of a webpage in real time. It then uses that visual context, combined with user prompts, to generate helpful responses. The tool includes a voice mode, allowing users to speak their requests instead of typing them. Microsoft has opted to make this a user-controlled, opt-in feature to address potential privacy concerns. To enable it, users need to open a specific link within Edge and follow the setup instructions. Once activated, a floating bar with a microphone and text field appears, allowing seamless interaction through voice or text.

In terms of practical uses, Copilot Vision is designed to enhance the browsing experience in meaningful ways. For instance, it can quickly summarize multiple product reviews, helping users make informed decisions. It can also identify and describe specific design elements in product photos—such as determining the style of a piece of furniture—and assist users in locating similar items using conversational prompts. By combining visual context with natural language understanding, Copilot Vision turns the Edge browser into a more intelligent and interactive space for users navigating the web.