Google Lens will allow asking questions about video content

Google Lens now lets you record videos and ask voice questions about their content. The voice query feature is also available for photos.

The new feature is available starting today on Search Labs for Android and iOS.

Google first previewed the video search feature at the I/O conference in May. In the demo video, Gemini AI was shown answering a question about why the fish in the aquarium were swimming together.

Google’s VP of engineering Rajan Patel says the AI can understand sequential frames in videos and that a special Gemini model was developed for this purpose. Sounds in videos can’t yet be identified, but Patel notes that they are working on this.

Google Lens also adds the ability to ask questions by voice for photo search. To do this, point your camera at the object you want to query and hold down the button. Voice queries have rolled out globally for Android and iOS, but are currently only available in English.