Google has continuously updated Google Search over the years to allow you to ask questions in any method you choose, including by humming a song, using your camera, or typing a query.
Its capacity to help individuals explore more of the web and their surroundings has improved with the tailored Gemini model, which was made possible by the increasing capabilities of AI. Users of AI Overviews utilize Search more frequently and are happier with the outcomes. Additionally, Google Lens is currently utilized for about 20 billion visual searches each month, enabling users to search what they see on screens or through cameras.
With some of its biggest Search enhancements to date, it is taking a giant step ahead today. AI will enable it to significantly increase the range of services Google can provide for you, from helping you discover the exact information you need to answering any questions you may have.
Innovative methods to search what you hear and see
Google Lens, first introduced visual search years ago, and it has since improved the experience with its most recent AI developments. Google added generative AI to Lens earlier this year, so you can point your camera, ask a question, and receive an AI Overview with the details you require and links to more resources. People are already finding this experience to be very beneficial. People used Lens more frequently as a result of this feature because they returned to ask fresh, difficult queries.
Lens-based video comprehension
It demonstrated its ability to comprehend videos during I/O, and as of right now, you can use Google Lens to search by filming a video and posing queries regarding the moving items you observe. Let’s say you’re at the aquarium and you want to know more about an exhibit featuring some fascinating creatures. Asking your inquiry aloud, such as “Why are they swimming together?” while holding down the shutter button will record it when you open Lens in the Google app. Together with useful resources from the internet, Google computers will analyze the video and your query to provide an AI Overview.
For Search Labs users participating in the “AI Overviews and more” experiment, this feature is accessible globally through the Google app (Android and iOS), supporting English queries.
Voice questions in Lens
You may now use your voice to ask a question whenever you take a picture using Lens. Simply point the camera, press the shutter release button, and ask whatever question you have; it works the same way as pointing at something and asking a buddy about it. For English queries, voice input for Google Lens is now accessible worldwide via the Google app for iOS and Android.
Lens improvements to make shopping what you see easier
Lens simplifies the process of shopping in the environment. Google Lens has been a useful tool for finding visually comparable products from different online sellers for years. However, as of this week, you’ll notice a noticeably more useful results page that displays essential details about the product you’re looking for, such as reviews, pricing information across shops, and availability for purchase.
Let’s imagine, for instance, that you wish to buy yourself a backpack after seeing one at the airport. Simply snap a picture, and Google Lens will combine its sophisticated artificial intelligence algorithms with Google’s Shopping Graph which contains data on over 45 billion products to pinpoint the precise item. so that you can start shopping immediately and find out more about anything that captures your attention.
A fresh method for recognizing the tunes you hear
With Googles most recent Circle to Search update, you can instantly search the songs you hear without switching apps whether on a video while you’re browsing social media, in a movie you’re streaming, or on a website you’re visiting. With its most recent Android extension, Circle to Search is now accessible on over 150 million Android smartphones, reaching a wider audience.
AI-organized search results page for you
When it comes to topics that could be open-ended or lack a definitive solution, such as when looking for a vegetarian appetizer to serve at a dinner party, it gave you a sneak peek at how artificial intelligence (AI) can help you explore and find a larger range of answers from the web earlier this year.
In the United States, Google is launching AI-organized search results pages this week, starting with mobile meal ideas and recipes. Now, a full-page experience with results that are tailored specifically for you will appear. All of the information and viewpoints from the internet, including articles, videos, forums, and more, are conveniently accessible in one location.
People have found AI-organized search results pages to be more helpful in their testing. Additionally, it gives users access to a wider variety of content types and websites through AI-organized search results pages, which increases the chances that people will find relevant content.
More links to the top websites on the internet
We are aware that many people prefer to ask their inquiries of the source directly. Its goal with AI in Search is to assist users in finding ideas and information from a variety of online sources.
Google has been testing a new AI Overview design that includes noticeable links to related webpages right in the body of the document. According to its tests, compared to the old design, this better experience has increased traffic to supporting websites and made it simpler for users to access websites that interest them.
Furthermore, as it mentioned during Google Marketing Live, it has been closely examining the advertisements in AI Overviews for pertinent queries. People are finding adverts located immediately within AI Overviews to be helpful, as it allows them to rapidly interact with businesses, goods, and services that are relevant to them and move on. In response to encouraging comments, it is beginning to show advertising in AI Overviews for pertinent questions in the United States. This will allow us to keep matching users with brands and items that will benefit their searches.
It always strives to increase the range of questions you may ask on Google, regardless of whether you are searching with text, audio, voice, or images. It is excited to expand these experiences to more people worldwide as it continue to reinvent how Search can help you get the information you need quickly with AI.
Google Lens offers five more ways to search what you see
You may quickly search what you see and pose enquiries about the environment around you with Lens in the Google app (available on iOS and Android). Here are some of our favourite ways that Google Lens may be useful, whether you’re new to it or simply want to pick up some new skills.
Make a point and pose a query
Do you want to know more about the artwork in front of you, such as a museum piece? Just ask a question while pointing your camera. An AI Overview containing a summary of important details and links to useful websites will be sent to you. Like when you point to something and ask a friend about it, you may also express your inquiry aloud while taking a picture if you’d like.
Get useful background information by using “About this image”
Although “seeing is believing,” it’s best to verify. Lens’s “About this image” feature lets you examine how an image is utilised on other pages for extra context. You can view the viewpoints of other sources, including news and fact-checking websites, in this way.
To search what you see on your desktop, use Chrome’s Lens
Without ever leaving the page you’re in, Lens on Chrome desktop allows you to search and ask questions about anything you see while browsing the web more rapidly than ever before. After choosing the Lens icon in the address bar, you can easily click or drag the cursor to choose whatever catches your eye. on addition to useful findings on the side panel, you can adjust the visual results or add a question.
Instantly obtain product details
By just capturing a photo with your lens when you’re shopping, you can quickly check key product details like price across stores, current specials, product reviews, and where to buy see something you want to buy. When you buy in-store, you can find even more helpful information, such relevant user reviews, whether comparable products are available, and whether a store’s prices are acceptable.
Recap or duplicate text from a picture
If you use Lens to capture text, even handwritten writing, you can ask questions about the topic of the text, write a summary, or transfer the information to your clipboard. Additionally, Lens can annotate the original image according to your query, for example, highlighting vegetarian options on a menu.
