Microsoft expands Windows 11 AI functionality with Copilot plugins, generative erase, and more

Microsoft seems to be setting a record pace for the number of new features it’s building into its new pre-generative artificial intelligence platform Copilot each month and now the team is introducing new plugins, skills, and editing tools for users.

Microsoft’s EVP of Consumer CMO Yusuf Mehdi announced just a little bit ago that Microsoft Copilot would be recieving Windows 11-based improvements in the coming days that include new plugins for additional access to favorite applications and new on-device related skills.

Starting today, plugins from popular apps such as OpenTable, Shopify, and Kayak will be available for use with Microsoft Copilot in Windows 11. Over the next month, Microsoft says it’s working to bring even more apps onboard with plugins for services such as Klama and Instacart.

In addition to plugins, Windows Copilot will also be gaining some new OS-based skills next month.

Beginning in late March, you will see the following new Skills enabled within your Copilot in Windows experience. To use
these skills, simply type in a prompt to Copilot in Windows. For example, type “enable battery saver” or “turn off battery
saver” and Copilot will take the appropriate action and confirm completion.

Yusuf Mehdi, EVP and Consumer CMO

Starting in late March Windows 11 users will be able to use Copilot to adjust some PC settings, gain quick access to tools or device information as well as launch various accessibility experiences. Specifically, Copilot in Windows will be able to respond to the prompts that include the following details:

Settings:
o Turn on/off battery saver
o Show device information
o Show system information
o Show battery information
o Open storage page

  • Accessibility:
    o Launch Live Captions
    o Launch Narrator
    o Launch Screen Magnifier
    o Open Voice Access page
    o Open Text size page
    o Open contrast themes page
    o Launch Voice input
  • Device information
    o Show available Wi-Fi network
    o Display IP Address
    o Show Available Storage Space
  • o Empty Recycle Bin

Further on the accessibility front, Windows 11 users will also be able to make use of Voice Shortcuts to complete task hands free and quicker than before. Starting next month, users will be able to create custom commands for specific tasks that range from media controls to opening specific URLs and managing multiple monitor set ups with single phase implementations.

But that’s not all, Microsoft is also updating its new in-house photo and video editing experiences. Using its pre-generative AI platform, Microsoft will bring Generative Erase functionality to Photos as well as Silence Removal in preview for Clipchamp.

For those looking to make more use of the Photos app when it comes to image editing, Microsoft’s new Generative Erase will now allow users to select and remove objects, blurs, imperfections or unwanted photobombs from images in a more natural editing process.

When it comes to the Silence Removal preview in Clipchamp, starting today users will be able to lean a little less on tools such as Adobe’s Audition or Audacity by utilizing the tool to remove gaps or elongated pauses in audio tracks.

In general, Windows 11 will also get a few other niceties coming its way in the form of improved window management with additional Intelligent Snap suggestions. The connection between Windows 11 and Android phones is about to get closer with tie ins between the two to manage recent photos take on the phone as well utilize phones as high-powered webcams.

The often-maligned Windows 11 widgets panel will get an improved experience with a focused board element allowing users to place widgets into categories such as work or play.

Windows Ink, which hasn’t really been touched since Windows 11 first rolled out, will now get expanded app support in programs such as Photos, Paint, Whatsapp, and Messenger soon.

The expansion of app support continues with 3P app APIs being offered to apps like Snapchat and Instagram and more.

IT admins will also get support with a new unified experience for Windows Update for Business deployment service as well as Autopatch into a single managed solution. The new solution will be called Windows Autopatch and offer admins a single solution to manage updates across Windows PCs, Microsoft 365 apps, Microsoft Edge, and Teams under a uniformed API platform.

All of these features will begin rolling out to consumers starting with releases of Windows 11 version 22H2 and 23H2 between now and late March.

Subscribe

Related articles

Microsoft Steps Back as OpenAI Takes Control of CoreWeave Agreement

Microsoft's decision to pass on the $12 billion CoreWeave agreement and allow OpenAI to take the reins has sparked significant discussion in the tech world. This move, while surprising to some, reflects a strategic shift in how Microsoft is managing its AI investments and partnerships.

Plex fans might not be happy with the latest updates

Plex has announced it will have much to say...

Go fishing this weekend with Free Play Days

This weekend's Free Play Days offers you a chance...

Microsoft Teams Up with Musk, BlackRock, and MGX for a $30B Data Center Gamble

Microsoft’s latest venture—a $30 billion data center project in partnership with Elon Musk’s xAI, BlackRock, and UAE-based MGX—feels like a plot twist straight out of a dystopian novel. On paper, it’s a bold move to dominate the AI infrastructure race. In reality, it’s a tangled web of questionable alliances and potential PR disasters waiting to happen.

The EU Calls Out Apple and Google’s Half-Hearted Compliance with its Digital Markets Act

The European Union has once again donned its superhero cape, swooping in to rescue us from the clutches of Big Tech's monopolistic tendencies. This time, the EU has outlined specific steps for Apple and Google to comply with the Digital Markets Act (DMA), a regulation that was supposed to make digital markets fairer and more competitive. But let’s be honest—Apple and Google have been dragging their feet since the DMA was established, and the EU is finally calling them out.

LEAVE A REPLY

Please enter your comment!
Please enter your name here

WP Twitter Auto Publish Powered By : XYZScripts.com