One of the most incredible and practical features is integrated into Google's Gemini AI
Google's Gemini initiative is unrelenting. Nearly every week, the behemoth Google releases new AI features that let users access premium features for free. The company has just added one of the most incredible, practical, and eagerly awaited features to its catalog, demonstrating that it is not going to sit back and watch as the chatbot has its heyday in the first few months of 2025.
Technology from Project Astra is now available to Gemini. For those who do not know, Google announced this project approximately a year ago, which enables AI to extract multimodal context from video. In other words, a chatbot can now see what you are doing on your phone's screen or comprehend what the camera is capturing and engage with that information.
To put it another way, Gemini now has eyes and can use them instantly to solve issues, give context, or shed light on a circumstance. One of the most innovative, practical, and futuristic AI features available to end users is this technology, which is comparable to one that OpenAI previously announced.
Your screen and camera are now visible to Gemini.
The most straightforward and practical integration of Astra has been made by Gemini. This technology has two new features that let you take advantage of its core capability, which is the ability to analyze video in real time and generate conversations around it.
Real-time screen recording: The Gemini app now features a button to start screen recording so the chatbot can see everything you do on your phone and interact with you in real time. You can ask Gemini questions about the content being shown, play games, watch videos, and browse websites once activated. As you can imagine, the possibilities are endless: it can assist you in solving a problem by guiding you through your mobile interface or helping you better understand a specific topic or image.
- Access camera content: To improve live chat capabilities, Gemini can also access the camera on your youphone. ne. In addition to voice chat, you will soon be able to activate your phone's camera and focus the conversation on what you are currently viewing. In real time, all of it.
Unfortunately, Google One subscribers are the only ones who can take advantage of these features. This implies that video content will not be accessible to free Gemini accounts for the time being. Since this feature requires a lot of resources, it makes sense that Google is currently only allowing paying users to use it.