Join the Beta: Chatting with Gemini for Message Drafting and Beyond in Android
Google’s latest update for Android devices brings a plethora of enhancements, including several innovative features driven by generative artificial intelligence (AI), marking a significant stride towards enhancing user productivity. Unveiled on the inaugural day of the Mobile World Congress (MWC) 2024, these nine new features aim to streamline user experience across smartphones, Android Auto, and Wear OS. Among the standout introductions is the integration of Gemini, Google’s cutting-edge AI chatbot, into the Messages app. While currently undergoing beta testing, Gemini’s integration heralds a new era of conversational convenience, empowering users to engage in dialogue, seek assistance, and even draft or revise messages seamlessly.
The announcement, communicated via Google’s Newsroom, underscores the company’s commitment to advancing user productivity through innovation. Gemini’s integration within the Messages app represents a notable expansion of its capabilities, offering users enrolled in Google’s beta testing program early access to its functionality. Through a dedicated chat box within the Messages app, users can engage with Gemini, leveraging its AI prowess to facilitate various tasks, from answering queries to composing or refining messages. This seamless integration positions Gemini as a versatile virtual assistant, poised to enhance communication efficiency and user experience across the Android ecosystem.
As Gemini emerges as a multifaceted AI companion, speculation abounds regarding its future role and potential inclusion in Google’s product offerings beyond the beta phase. While its integration within the Messages app represents a significant milestone, questions linger regarding its availability and feature set once it transitions out of testing. Whether Gemini will be included in Google’s premium offerings, such as the Gemini Advanced plan, remains uncertain. Nonetheless, its integration within the Messages app underscores Google’s commitment to harnessing AI technology to empower users and elevate the Android experience to new heights.
Messages app is not the only place where AI is being added, however. Android Auto is also getting a similar feature where generative AI can summarize long texts or group chats and read it out while the user drives. It will also suggest relevant replies and actions that can be selected via just a single tap.
One accessibility feature is also being added to the Lookout app. The app is designed for visually impaired users and can identify objects, read texts, and more through the smartphone’s camera. It will now automatically create AI-generate captions for images seen online or received through messages and read it out to users. It is rolling out globally in English. In the same vein, Google Maps is also getting an update to Lens in Maps, which was first added in October 2023. Users can now point the phone’s camera at surroundings and the TalkBack feature will read the place’s information out loud, including its business hours, rating or directions on how to get there.
A few non-AI features are also making their debut. The most notable is the handwritten annotation feature for Google Docs on Android. This will allow users to write and draw with either fingers or stylus on documents to create notes for themselves. The second is a tweak to the output switcher for Spotify, which allows users to pick the device where the output of the sound will come from. This can now be done directly from the home screen.
Finally, moving to the Wear OS-based features. Google is now rolling out an update to its Health Connect app that will allow users with wearables such as Fitbit, Oura Ring, and apps such as AllTrails and MyFitnessPal to integrate their data. The app will show detailed view of health and fitness trackers and will provide actionable insights on them. Last two Wear OS features are smaller but can be useful for some users. Google Wallet passes are now available on Wear OS smartwatches and will allow users to access them directly. Google Maps for Wear OS will now show public transit directions to help users catch a bus or a train. The app will show details such as departure times, compass-guided navigation, and option to mirror directions from phone to the smartwatch.