If you are an Android user, today is your lucky day; Google has announced a series of new AI features for the entire ecosystem. In general, features make Android devices more accessible, but there’s something for everyone here.
For example, one of the new improvements, Expressive captionsautomatically generates subtitles that attempt to capture the emotion and intensity of what is being said. So, let’s say you’re video chatting with a friend who groans after you crack a lame dad joke. The feature will not only transcribe what they said, but will also include “(groans)” in the transcript. It also works for other subtleties of human speech, like when someone gasps or whispers something, and it’s compatible with Android, including streaming and social media apps. According to Google, expressive captions are available on the latest Pixel 6 and Pixel phones, as well as other “compatible” Android devices.
Separately, Google has improved Android Questions and answers about images in Lookout characteristic. The latest version of the tool uses the company’s Gemini 1.5 Pro model to provide more useful image descriptions. The Image Q&A is primarily designed to assist blind and visually impaired users, but really anyone can use the feature to have Android describe an image in a natural-sounding voice.
Speaking of Gemini, Google is enhancing the AI agent with new extensions that provide better integration with some of the most popular Android apps. For example, a new Spotify plugin lets Gemini play your favorite songs and find playlists that match your current mood. In the future, the company promises tighter integration with Google Maps and even smart home devices connected to your Google account.
Additionally, Gemini now offers the ability to remember things about you so you can provide more personalized responses. For example, you can tell Gemini that you are a vegetarian and the agent will remember you the next time you ask him to recommend a new dinner recipe. Google notes that it’s made it easier to view, edit, and delete any personal information you’ve told Gemini to remember.
Another more practical update comes in the form of a Google Drive feature called automatic improvements. The next time you upload a scanned document to the service, the image will automatically be edited to optimize contrast and adjust white balance, as well as remove any shadows and blurriness.
And if you want to share a file with someone, Google has made that easier too, with an Android improvement Fast sharing functionality. There’s a new feature that lets you transfer photos, videos, and documents by viewing a QR code on your phone. Using this tool, you don’t need to add the recipient as a contact or change quick share settings.
Finally, if you’re a Pixel user, you can expect all of the above features and more. In particular, there are improvements to the Pixel Screenshots app. For one thing, you can now save the things you find Circle to search directly to the software. Google suggests this feature will be useful for holiday gift ideas. Pixel Screenshot will now automatically categorize your snaps and provide suggestions, like invitations and calendar guidance, based on the information you’ve saved.
As with most Android updates, it may take a while for Google to roll out all the new features announced today to all users, so be patient if you don’t see them on your device right away.
