Google has announced Look to Speak, it is a new free application that seeks to help people with disabilities, thanks to this project they will be able to speak using their eyes only. It is a project that is part of the “Experiments with Google” program and is reminiscent of the Tallk project by Samsung and Irisbond.
- Google Pixel series are getting new exclusive features with an update
- New Google Maps update improves GPS accuracy on Android
- Google Nearby Share will allow you to share apps too
Look to Speak is a completely free app that can be downloaded on Android, although for now, it is only available in English. The application uses the smartphone camera and a set of predefined phrases to allow people who cannot move to communicate. The user simply has to look at the screen and select a phrase, then the device will pronounce it out loud and allow the person to express their feelings or needs.
Look to Speak will help people with disabilities
As explained by Google, Look to Speak arises from the program “Start with one”, which is a part of “Experiments with Google”. This type of project is born with the idea of creating a collection of experiments that started by working with one person to make something impactful for them and their community.
Sarah Ezekiel, an artist who was diagnosed with a motor neuron disease in 2000, is the first person to try out the project. In 2020, together with Richard Cave, a language therapist, she met a Google team that was investigating how machine learning implemented in small devices could make communication technology more accessible through sight.
This is how “Look to Speak” was born. The application displays a set of predefined phrases, such as “Hello”, “What’s your name” or “How are you?” on each side of the screen. As you look at either side, the list narrows. By repeating the process a couple of times, the list will be reduced to a phrase, then the mobile will say the selected phrase out loud. The user can stick to the predefined list or create custom phrases, something designed to make the communication more personal.
Look to Speak is available only in English on Android for now. Those interested in the app can access a tutorial to learn how to use it and a guide with some tips and tricks. You can download the tutorial from this link.