Google has begun rolling out new AI capabilities for its Gemini Live assistant, allowing it to analyze smartphone screens and camera feeds in real-time.

These features, first previewed under “Project Astra,” are now available to Gemini Advanced Subscribers through the Google One AI Premium plan.

One function lets Gemini interpret on-screen content, while another enables live video analysis.

A Reddit user demonstrated the screen-reading feature on a Xiaomi phone, while Google showcased the live video tool assisting with paint color selection for pottery.

This rollout comes as Amazon and Apple work on similar AI upgrades for Alexa and Siri, highlighting the competitive push for smarter voice assistants.

Recent Google developments