Microsoft to Test Copilot Actions and Manus in Windows 11

Microsoft (MSFT) is officially sunsetting Windows 10, the operating system launched a decade prior, marking a significant push towards its successor, Windows 11, and its integrated AI capabilities. The move comes as Microsoft aggressively pursues the burgeoning market for AI-enhanced personal computing, aiming to capitalize on the growing demand for devices leveraging generative AI.

The centerpiece of this strategy is the introduction of advanced artificial intelligence features within Windows 11. Microsoft is incentivizing users to upgrade by offering exclusive access to these AI functionalities through its Windows Insider Program and Copilot Labs initiative.

Early adopters will gain access to an enhanced Copilot assistant within Windows 11. This updated Copilot promises to seamlessly integrate with both desktop and web applications, enabling users to automate complex tasks such as photo resizing using locally stored files – all through natural language commands.

Speaking to reporters, Yusuf Mehdi, Microsoft’s consumer marketing chief, illustrated the potential, “Imagine instructing Copilot to compile all available Brian Eno tracks into a Spotify playlist and then automatically initiate playback. That’s the level of intuitive interaction we’re striving for.”

This vision directly aligns with the advancements in “computer-use agents” being pioneered by the likes of Anthropic, Google, and OpenAI. These AI models are designed to interpret user directives and execute multi-step actions involving both typing and clicking, effectively automating tasks previously requiring manual intervention.

Microsoft has already introduced this technology to enterprise users, empowering them to create custom AI agents. Now, through Copilot Actions, the company is democratizing access to this technology for consumers with premium subscriptions. This Windows 11 variant allows everyday users to harness the power of AI-driven automation.

Crucially, Copilot Actions will be deactivated by default, emphasizing user control and transparency. When enabled, it will operate within a sandboxed environment, giving users the ability to monitor the software’s actions in real-time and intervene if necessary. This design prioritizes user oversight, allowing individuals to readily navigate away and complete other tasks on their PCs as the AI operates in the background.

Mehdi acknowledged the nascent nature of the technology in his blog post, stating, “You may see the agent make mistakes or encounter challenges with complex interfaces, which is why real-world testing of this experience is so critical to help us apply learnings to make this experience more capable and streamlined.”

Microsoft’s bet on AI-powered features in Windows 11 is not just about retaining existing users; it’s a strategic move to attract users from rival platforms such as Apple’s macOS and Google’s Chrome OS. Competing in an increasingly competitive operating system landscape, Microsoft reported $4.3 billion in Windows and devices revenue for the second quarter, representing a modest 2.5% year-over-year increase.

Windows 11, launched in 2021, introduced a design overhaul, most notably shifting the Start button and app icons to the center of the taskbar. According to Statcounter, Windows 11 surpassed Windows 10 in popularity in July, signaling growing user adoption. As of September, Microsoft maintains a dominant 72% share of the overall operating system market.

Microsoft is adopting a phased rollout strategy for Copilot Actions, proceeding with caution to ensure stability and user satisfaction. During the preview phase, the feature will be limited to common folders such as desktop, documents, downloads, and pictures, with users needing to grant explicit permission for accessing data in other locations.

A notable feature gaining traction through the Windows Insider Program is the integration of technology from Singaporean startup Manus into the Windows 11 File Explorer. Users will be able to convert files into websites with the right click of the mouse.

Windows Insiders will also be able to ask Copilot to analyze the on screen images, through chat messages. Now people can easily engage with the feature only by talking out loud.

Microsoft also plans to place a shortcut of the Copilot near of the Start button. With the new widget button, users can activate spoken AI or Copilot Vision with one click.