Google has rolled out a new AI update to its search features, introducing a video search function that lets users quickly ask questions about what they’re watching.

This new tool works alongside Google Lens, allowing users to simply hold down the shutter button to record a video while asking a question out loud. The system processes the video and question together to generate an AI Overview, powered by Google’s Gemini AI model, along with web-based resources.

One ‘useful’ example Google shared involved a user filming a school of fish at an aquarium and asking Lens to identify the species using search results. Alongside the video function, users can also take a quick picture to add a voice search to. 

Both Android and iPhone users who have enabled the ‘AI Overview’ experiment can access the new feature.

The company claims that Google Lens, first introduced in 2017, is now used for nearly 20 billion visual searches every month, and promised that the improved AI search capacity will produce ‘dramatically more helpful’ results.

Along with the Lens updates, Google has also rolled out a revision for its Circle to Search function, allowing users to instantly search songs without switching apps, and a fresh search results pages organised with AI, beginning with recipes and meal inspiration.

“We know that people want to go directly to the source for many of their questions. With AI in Search, we’re focused on helping people discover content and perspectives from a wide range of sources across the web,” wrote Liz Reid, head of Google Search, in a blog announcing the new tools.

“With AI, we’re continuing to reimagine how Search can help get you the information you need, fast, and we’re looking forward to bringing these experiences to more people around the world.” 

Google currently faces an AI arms race with other developers, most notably the ChatGPT creator, OpenAI, which launched voice capabilities for its AI last year, and has now followed up with an ‘advanced voice-mode’, which although not having dedicated search functionality can still rival Google’s own offering.

Recommended reading

• Google Wins Appeal in £1.3BN AdSense Court Case
• Google Urges CMA to Act Against Microsoft for Anti-competitiveness
• CMA Holds Google & Apple Cases Pending New Digital Powers

The tech giant also faces a looming threat from another of its rivals, Apple, which is set to launch its Visual Intelligence product with a similar toolset, already in testing but without a firm release date.

As the competition in Silicon Valley heats up, critics will be watching closely to determine if Google’s new AI features are effective, and also safe.

The company drew widespread criticism in May after its AI provided erratic, inaccurate answers to searches, including telling users to use glue to make cheese stick to pizza.