AI on-device in Pixel 8 Pro with Gemini Nano

Google unveiled Gemini, our most advanced and adaptable AI model to date. Gemini comes in three sizes: Ultra, Pro, and Nano. It is designed to function on a wide range of devices, including smartphones and data centers. Our most effective model designed for on-device work, Gemini Nano, is now compatible with Pixel 8 Pro. Using the power of Google Tensor G3, the first smartphone designed specifically for the Gemini Nano, it offers two enhanced features: Smart Reply in Gboard and Summarize in Recorder. By design, Gemini Nano operating on Pixel 8 Pro has a number of benefits, including the ability to use functionality without a network connection and assisting in keeping sensitive data on the phone. The larger family of Gemini models will open up more features for the Assistant with Bard experience on Pixel early next year, in addition to Gemini Nano running on-device now.

Pixel devices use additional AI-based features in addition to generative AI models to enable you to achieve more. Updates for productivity and customization, along with these new capabilities, will start to appear on Pixel smartphones, tablets, and smartwatches today.

Summarize is now powered by Gemini Nano, our most efficient model designed for on-device interactions, in the Pixel 8 Pro Recorder app.

Even when there is no network connection, receive an overview of all the recorded talks, interviews, presentations, and more.

Gboard’s Intelligent Response

As a developer preview, Gemini Nano within your Pixel 8 Pro is beginning to power Smart Reply in Gboard. The on-device AI model, which you can test out with WhatsApp right now and will be available for additional apps in the upcoming year, saves you time by recommending superior responses with conversational understanding.

Modern video

You can stop worrying about unsatisfactory or shaky videos. Video Boost on Pixel 8 Pro makes use of the Google Tensor G3’s capabilities to upload your movies to the cloud, where our computational photography models modify the color, lighting, stabilization, and graininess of the footage. When finished, the output is beautiful, lifelike films.

Moreover, Night Sight video on the Pixel 8 Pro is enabled by Video Boost. This feature applies artificial intelligence (AI) to reduce noise in videos taken at night or in low light, allowing you to see rich color and clarity.

Make incredible time-lapse films after dark

Only on the Pixel 8 and Pixel 8 Pro, use Night Sight in Timelapse to capture vivid, detailed timelapse films in low light. Just place your phone on a stable surface, such as a rock or tripod, and allow your Pixel Camera to capture the nighttime scenes. The next time you want to record a night sky video, give it a try.

View everyone more favorably

A new AI model in Google Photos’ enhanced Portrait light makes it possible for Balance light to effortlessly eliminate harsh shadows and enhance both recent and vintage portrait images. Everyone can now appear stunning even in poorly lit environments.5 Picture Unblur receives an update

It can be challenging to take sharp pictures of your animal companions. Even though your pet can’t stay still, Photo Unblur is now more adept in sharpening photos of dogs and cats so you may share a fantastic shot. In just one swipe, it can assist refocus people’s faces and surroundings to produce the ideal shot.

Before you take a picture, show it.

Capturing relatives and friends with your Pixel Fold’s Dual Screen Preview is a breeze. They can preview their image on the outer screen and change their stances for a better shot while you’re putting up the shot on your inner screen.

Superior video calls straight from your PC

The days of using your laptop or desktop’s built-in webcam for shaky video chats are past. Now, you can make vivid, sharp video calls with your Pixel. You can immediately notice a change when you connect your Pixel Fold, Pixel 6, or more recent phones via USB to a laptop or desktop computer.

Improve document scanning by simply swiping

Smudges, stains, and creases can be eliminated from scanned documents with Pixel’s new Clean feature. With a few swipes, you can easily access it through the Camera app and alter your photographs.

A simpler and more secure method of accessing your accounts

With just a few taps, Google Password Manager can now determine which of your accounts accept passkeys and assist you in adding them.10 Trust that your private information is secure while repairs are being made
Whether you are sending your device to a repair shop or taking it in for service, Repair Mode helps to protect and preserve your personal data, giving you peace of mind even when it is out of your hands.

More astute responses in the call screen

You may now effortlessly respond in a way that suits the circumstance by using Google Assistant’s contextual reply suggestions in Call Screen on Pixel Fold, Pixel 6, and newer phones. This eliminates the need for you to answer the phone.
The Pixel Watch now has a Call Screen to help you block unsolicited calls and find out who is calling before you answer.

Easily unlock your phone

A new feature on the Pixel Watch makes it easier to unlock your phone, even while your hands are full or your face is hidden by sunglasses! You may now continue doing what you’re doing without pausing to enter your password, use your fingerprint, or utilize face unlock while your Pixel Watch is close to your Pixel phone.

No more disruptions

When using a Pixel Tablet for video calls, lower background noise and improve your speech quality. Clear Calling provides the highest speech quality possible for video chats on a high-end tablet, made possible with the assistance of Google AI.

Take in the sounds around you

With the addition of spatial audio on the Pixel Tablet, you can now immerse yourself in the action while watching your favorite films and television series. Start by listening to music via your speakers, and then connect your Pixel Buds Pro to enjoy head tracking and spatial audio for a fully immersive audio experience.