Google’s new Gemini AI lets you ask questions on any screen. You can get information without interrupting what you’re doing. The feature is being tested and has been made to work well with Android. You can get answers without switching apps.
The update also lets you summarize YouTube videos. Gemini can summarize videos by reading the captions. This is a big deal for people who want to get the gist of a video without watching it all. These changes make it easier to use AI on mobile devices.
Gemini can now answer questions about what’s on your screen
At Google’s I/O event in May, they introduced the “Ask about this screen” feature. This tool lets users ask questions about what’s on their screen without leaving the app. Before, you had to leave the screen to use the AI assistant. Gemini’s floating panels let you access all functions from one place.
You can ask about your screen from the floating Gemini panel. You can ask the assistant to explain something without leaving the news page. This makes your experience smoother and more seamless than before.
This also works on YouTube. Ask questions with the “Ask about this video” button. You can ask questions orally or in writing. Gemini will give you a summary or answer. This works with other video apps, but the results may be different.
YouTube video summaries are easy to create. If you often skip videos on YouTube, this new feature could be useful. AI can summarize YouTube captions, so you can get the main points without watching the whole video. This is great for people who want to skip ads or just need a quick overview.
This feature works during pre-roll ads. Pause the video, get a summary from Gemini, and get the info you want without waiting for the ad to end. This AI makes a frustrating task easier.
This feature works best on YouTube, but not on other video platforms or embedded videos in Chrome. In these cases, the tool goes back to the “Ask about this” screen.
Gemini now works with Google Meet. Gemini can now be used to take notes during meetings. The AI assistant can now summarize important points during Google Meet video calls. Google Workspace users with the right plan can create a Google Doc with key discussion points. They can then share it with attendees or attach it to the calendar.
The note-taking tool focuses on the most relevant points. It is currently only available in English on desktop or laptop computers. Google is integrating AI into its services, and Gemini is a key part of this. It can summarize videos or keep track of meeting notes.
Featured and other images credit: Google Blog
