New functions in Microsoft Copilot allow it to interpret your screen and share responses to your questions. Besides easy tasks, there is no limit to the complexities that Microsoft Copilot can handle while improving your daily experience by resolving difficult equations or browsing for home products.
With Copilot Vision’s launch, the AI can review the content on your screen. This feature can also analyze information from the websites you visit. When you decorate your home or tackle a new task in project management, Copilot acts as your trusted digital helper.
Copilot Vision is the feature that reads your screen
Microsoft’s newest feature is Copilot Vision, which interprets the visual elements on display and engages them immediately. Unlike earlier screen-reading devices, Copilot Vision works with images and text to make browsing the web more smoothly. When browsing a recipe or examining a photo detail, you can quickly receive an answer if you pose the correct query.
This function does not limit itself to responding. It proposes ways to create a less passive communication experience than commonly used screen readers. With Copilot Vision ready to erase data promptly after each chat to protect your personal information from future use, Microsoft ensures it respects privacy. This marks a key development for your peace of mind when using Copilot.
Only users in the U.S. can use Copilot Vision, which has certain limitations. It can’t operate on certain websites with paywalls or private content. Nonetheless, the skill to interpret public data generates interest, and Microsoft anticipates expanding the feature.
Solving more complex problems Think Deeper
The update includes another vital feature, Think Deeper, which focuses on resolving more challenging questions. Microsoft Copilot presents comprehensive approaches, no matter your perspective when comparing options or solving a math question. Unlike tools that usually provide rapid answers, Think Deeper carefully investigates problems.
This feature relies on advanced reasoning models to deliver clearer responses, as per Microsoft. This feature is being evaluated in the U.S., U.K., Canada, and New Zealand so users can experience its advancements. However, Microsoft has remained somewhat vague on the specifics of these reasoning models, simply referring to them as “the latest models from OpenAI.”
Microsoft gains voice with Copilot Voice
Along with its problem-solving and screen-reading talents, Microsoft has introduced conversation with Copilot Voice. This feature lets you interact with Microsoft Copilot and get answers. By utilizing four synthetic voices, Copilot Voice can interact with you in a way that aligns with your conversational preferences.
People in New Zealand, the U.S., the U.K., Canada, and Australia can apply for this service; nonetheless, its availability is subject to time limitations tied to the subscription categories you belong to. Copilot Pro users receive additional minutes varying with demand. Although this voice tool enhances efficiency, it is necessary to oversee your time utilization to forestall limitations.
Image credits: Microsoft
