Android is about to usher in accessibility improvements such as facial gesture control and handwriting recognition

Google is about to launch a large number of Android feature updates this fall, including a series of accessibility improvements, such as facial gesture control designed for people with movement disabilities, and Lookout handwriting recognition.

The latter is designed to use the phone’s camera to help people with low vision or blindness use Google apps. In addition, there are improvements such as Google Assistant, Digital Wellbeing, Nearby Share, and Gboard input method.

The so-called facial posture control is mainly divided into two parts:

  • The first is the Camera Switches that were previously discovered in the Android 12 Beta test version. It is now in the Android accessibility suite, allowing users to activate various commands through gestures such as opening their mouths and raising eyebrows.
  • The second is an independent application called Project Activate, which triggers operations such as audio playback or sending text messages by setting facial gestures. This function can help users communicate.

At the same time, Lookout handwriting recognition will support a Latin-based interface language, accessible in document mode, and the app’s currency mode already supports the Euro (EURO) and Indian Rupee (INR).

In addition to improvements in inaccessibility, the Gboard input method also has some changes.

  • On Android 11 and later systems, the new version of the input method will support Smart Compose intelligent completion of sentences (similar to Google Docs documents / Gmail mail and other services). Previously, this feature was exclusive to Pixel smartphones.
  • Copy and paste function, which can automatically separate individual contacts and detailed information, such as phone numbers and email addresses, when copied into a single text block.
  • In addition, if you switch to the messaging app immediately after taking a screenshot, Gboard will also actively suggest sharing the screenshot.

Then it is to remind users not to look down at the phone’s digital health function (Heads Up) when walking, which is expanding from Pixel to more Android devices. When opening the memo through Google Assistant, it now also provides a one-stop experience for managing and adding all reminders. The Nearby Share feature provides new visibility settings, allowing users to control who can view the device and send files.

Although Google has not announced the exact arrival time of the above feature updates, it is expected that most of them will be gradually rolled out this fall (continuing until early December).

Leave a Comment