Gboard’s New ‘Scan Text’ Feature: Simplifying Text Insertion from Captured Images – Here’s the Lowdown

Gboard, the popular keyboard application developed by Google for smartphones, is set to receive a significant enhancement that promises to streamline text input processes for users. The latest update introduces a novel “Scan Text” feature, leveraging optical character recognition (OCR) technology to seamlessly integrate text from captured images into text fields. This functionality represents a notable advancement in user convenience, offering a hassle-free solution for inserting text across various applications. Notably, a similar feature is already available on iPhone models running iOS 15.4 or newer iterations, highlighting the growing emphasis on image-to-text capabilities across mobile platforms.

A preview of the “Scan Text” feature, shared on X (formerly Twitter) by Mishaal Rahman, provides insight into its functionality and user interface. By harnessing the power of a smartphone’s rear camera, Gboard empowers users to capture images containing text, whether it be documents, screens, or objects, and effortlessly extract the textual content. Through the application of OCR technology, the extracted text is then seamlessly inserted into the current application, eliminating the need for manual input and streamlining text entry processes. This innovative approach not only enhances user productivity but also underscores Google’s commitment to delivering intuitive and efficient solutions to its global user base.

As the rollout of the “Scan Text” feature progresses, users can look forward to a more fluid and intuitive text input experience on their smartphones. By leveraging the capabilities of Gboard’s OCR technology, users can effortlessly extract and insert text from a variety of sources, thereby enhancing productivity and reducing friction in everyday tasks. With Gboard’s continued evolution and innovation, users can expect further enhancements that prioritize user convenience and elevate the overall typing experience on mobile devices.

In order for the feature to work, you’ll need to update the Gboard app on your Android phone to version 13.9, which is currently in beta. According to Rahman, users have claimed that the feature is now rolling out, but Gadgets 360 staff members were unable to try the feature on multiple Android smartphones — so you might have to wait until it is officially announced by the company.

When the Scan Text feature is available on your smartphone, it should be listed alongside other features like Translate, Sticker, One-handed, and Theme. The keyboard will prompt you to grant it access to the camera permission, after which you can begin to use the feature.

You can point your phone’s camera at some text and tap on the capture button once it is inside the half-screen viewfinder. You can then select the text that is recognised using OCR and insert it in your current app — this image is deleted after the text is inserted. You can also move it to the toolbar that appears on top of the keyboard, if you plan to use it often.

The arrival of the feature on Android comes two years after Apple brought a similar feature to iOS 15.4, allowing users to point their phone at text to add it to the Notes app and text fields in other apps. It lets users automatically select text using their iPhone camera — without capturing an image — and displays the text to be inserted as it updates in real-time.