Google introduces a novel method for conducting searches.

Google is introducing a new feature where instead of typing queries, users can simply circle or highlight items on their smartphone screens, and Google will perform an image or text search based on the selection. Initially, this functionality will be available on specific high-end Android phones, including the Galaxy S24 and Pixel 8, before expanding to other smartphone models.

Google has unveiled two new AI tools designed to enhance online searching significantly. These tools are aimed at making online searches much more helpful.

One of these tools, known as “Circle to Search,” will soon allow mobile users on specific Android phones to circle or highlight items on their smartphone screens, leading to more detailed information and the ability to ask complex questions about images or text. Google has been quietly testing these tools to explore how generative AI, the technology behind viral chatbots like ChatGPT, can improve the personalization and intuitiveness of its search function since the previous year.

These features were initially previewed during Samsung’s Unpacked event and are set to be available on the Galaxy S24 smartphone lineup, launching later this month. They will also roll out on a select number of other high-end Android phones, including the Pixel 8 and Pixel 8 Pro, starting on January 3.

The first feature, “Circle to Search,” empowers Android users to circle, tap, highlight, or scribble on images, videos, or text to gain more insights about what they are observing, such as identifying landmarks in the background of someone’s social media page.

Furthermore, starting from Thursday, users will have the ability to use their mobile cameras to ask questions via the Google app, or they can upload photos or screenshots to obtain information. As an example, Google mentioned the scenario of encountering an unfamiliar board game at a yard sale and using the tool to inquire about the game’s rules.

Over the years, Google has introduced changes to its search functionality, such as enabling voice search and the Lens tool, which utilizes image recognition technology via smartphone cameras to provide information about the user’s surroundings.

Google’s move into AI underscores the broader trend in the tech industry, with major tech companies like Microsoft, Amazon, Meta, and others racing to deploy similar AI technologies. According to Google, there is much more potential to explore in this field, as they believe they have only scratched the surface of what’s possible.