Google has announced new capabilities for AI Mode, an experimental feature within Search that allows users to ask complex questions and follow-ups to delve deeper into a topic. One of the new features, called Canvas, enables users to build study plans and organize information across multiple sessions in a side panel. Users can create a study plan for upcoming tests by clicking the “Create Canvas” button and refining the output with follow-up prompts until it meets their needs.
Additionally, Google is integrating Project Astra capabilities into AI Mode through Search Live, which is linked with Google Lens, the visual search tool. This feature allows users to have real-time conversations with Search in AI Mode using visual context from their camera feed. Search Live with video input is rolling out on mobile this week in the U.S. for users enrolled in the AI Mode Labs experiment.
In the near future, users will also be able to use Lens in AI Mode to inquire about content on their desktop screen. By selecting specific elements on a webpage, users can receive an AI Overview with key information in the side panel and ask follow-up questions through AI Mode. Additionally, AI Mode in the Google app will soon support other file types beyond PDFs and images, such as Google Drive files, to enhance user experience.
