Microsoft's Windows account on X published several short cryptic messages in the past two days regarding a new announcement that the company wanted to make today.
The first message "Your hands are about to get some PTO. Time to rest those fingers…something big is coming Thursday" suggested that the feature would help users type less.
Today, Microsoft has lifted the veil and announced plans to make "every Windows 11 PC an AI PC" on the official Windows Experience blog on its Windows website.
At the core of the new experience is the Hey Cortana, ups, Hey Copilot phrase that all Windows 11 users may use to interact with the AI using their voice. In addition, Copilot Vision is there to analyze anything that you see on the screen.
Hey Copilot
Hej Copilot is an opt-in feature, which is a refreshing change for a start. You need to activate the feature in the settings before Copilot reacts to you uttering the new command phrase to start a conversation with the AI.
Windows displays a Copilot microphone on the screen, so that you know that the conversation is taking place. To end a conversation, all you need to say is Goodbye, according to Microsoft. You can also click on the x-icon instead, if you prefer using your hands for that.
So, if you prefer to use your voice to interact with the AI, now you can.
Copilot Vision
Copilot Vision, which gives the AI access to what you see on the screen, is now available worldwide in all markets that Copilot is available according to Microsoft.
Microsoft lists the following main features:
- Full desktop and app sharing - Copilot can analyze content that you share to "provide insights and answer your questions".
- You can ask Copilot "show me how" to get guidance in an application or game.
- Copilot Vision has full app content in Word, Excel and PowerPoint. Means, even if you just share a document, it has access.
- Coming soon is a feature that Microsoft calls text-in text-out. This allows you to use text prompts to interact with Copilot Vision.
Last but not least, there is Manus, a general AI agent that can perform "various tasks" on user PCs. Microsoft explains that Manus can create a website from files in File Explorer, all without coding. It is available as a native app on Windows. It is available as a private preview, which means that it may take a while before it lands on Windows 11 PCs for the general public.
Microsoft reveals some information on security regarding AI agents on Windows. It says that users are "always in control of what Copilot Actions can do" and have visibility into what the AI is doing.
A second post reveals details.
- The agents use distinct accounts, which paves the way for agent-specific policies.
- Agents have limited permissions at first according to Microsoft, which can be expanded by the user.
- Agents need to be signed with a trusted source.
- The Microsoft privacy statement and responsible AI standard apply.
Microsoft says that the features are available to all Windows 11 PCs, and not only Copilot+ PCs. Do these have any advantage regarding the features? Microsoft does not say. Clearly, the feature relies on processing that is done on Microsoft servers, at least for PCs without an NPU. That is something to keep in mind, as what you say, show, or do may find its way on to Microsoft servers.
Still, for users who want the Copilot experience but have a non-Copilot+ PC, it marks an opportunity to give it a go.
Thank you for being a Ghacks reader. The post Windows 11: Microsoft expands Copilot Voice and Vision to all PCs appeared first on gHacks Technology News.
0 Commentaires