What is Google’s Look to Speak app and how does it work?

This page was translated using AI and machine learning.

(Pocket-lint) – Google has an app, called Look to Speak, that lets users communicate using just their eye movements and their phone’s front-facing camera. It was recently promoted with a heartwarming commercial that ran alongside the Oscars.

But how does this application work, who is it for and how do I access it? Let’s find out.

What is Google Look to Speak?

Look to Speak is an app that lets you select from a list of phrases using only your eye movement, the app then speaks those phrases out loud. It is designed to help people with motor function disorders and speech difficulties to communicate more easily.

The app is part of Google’s “Start with One” project on the “Experiments with Google” platform. Start with One is a collection of experiences that begin by working with one person to create something impactful for them and their community. In this case, Google sought to help Sarah Ezekiel, an artist with motor neurone disease.

Google says “The hope is that Look to Speak will be helpful to communities with various types of temporary, permanent, or situational disabilities.”

How to Access Google Look to Speak

Look to Speak is an app available for Android users through the Google Play Store. Its use is free and no connection to the application is required.

How to use Google Look to Speak

Using Look to Speak is fun and simple. When you first open the app, you’ll need to give it permission to access your device’s camera, as it’s needed to track your eye movements.

Once done, you will see on-screen instructions that will guide you through the steps of communicating via Look to Speak.

In short, you are presented with a collection of sentences divided into two columns.

If the sentence you want is in the left column, you look to the left, at the edge of the screen, to select it.

Then all the left sentences are split into two columns and you can repeat the process as before.

This continues until only the chosen phrase remains, then it will be spoken out loud.

At any time, looking above the screen will cancel an action. Looking up can also put the app into snooze mode.

In snooze mode, the app can be unlocked through a sequence of eye movements when you want to continue communicating.

Written by Luke Baker.