EMPWR - AR FOR THE VISUALLY IMPAIRED
EMPWR assists the visually impaired by identifying objects, recognizing images, reading signs and any text content. It enables remote video assistance as well.
- AR Object Identification - alerts the user after tracking objects in front of him/her
- Image recognition - EMPWR describes visuals and images via audio to the user
- Reading Assistant - EMPWR reads out printed paper, magazines, posters, packages etc.
- Barcode scanning - EMPWR scans barcodes and reads out the content to the user
- Video Assistant - EMPWR offers video based remote assistance by friends and family
About EMPWR
EMPWR is a Kaalo LLC product designed and developed for Texas School for the Blind and Visually Impaired
EMPWR is an innovative navigational app that employs voice assistance to identify objects, images, text and bar cods in the environment. Simply point your phone in a direction, and the app will verbalize what is in its field of vision. The app, in its first iteration, is the precursor to more sophisticated, augmented reality applications to come. It is an attempt to enhance the lives of people who are blind or who have a visual impairment. We have done extensive field research and have thus planned the app’s default settings with the user who relies on voice assistance in mind. Tight now, EMPWR can …
- Recognize objects, even if that object is “person”, with approximately 70% accuracy. When you point your phone in the direction of a dog, for instance, you will hear “dog” aloud or through your headphones.
- Describe images. EMPWR can discern the images on a monetary bill and tell you the denomination or tell you what text and images are on a traffic sign.
- Read text. Take a photo of the page of a magazine or book, and EMPWR will read you the words.
- Read barcodes. Using AR technology instead of barcode reader tech, the app can find a barcode anywhere on the screen, even if it is crooked or only part of the image, and read it for you.
EMPWR also allows users to video/audio conference with friends: video for the friend, audio for the user.
EMPWR is not 100% accurate. It is a work-in-progress technology that enhances detection and recognition. Users should employ caution and understand total reliance on the app is not advisable. Eventually, EMPWR will be able to help you effectively navigate public spaces with ease and enhance your shopping experience, all through detailed voice guidance.
EMPWR earcam
The earcam verbalizes what it sees in its cone of vision.
The visual in front of the camera is described as an audio output in the ear of the user. The device is connected via Bluetooth to the user’s mobile phone. The mobile phone has the EMPWR app that powers the earcam. The EMPWR app works without the earcam as well. Just pointing the camera of the phone will do the same function as the earcam.
Available in the AppStore
Currently available only in iOS the app is designed for use by the visually impaired.
The app was designed and developed by the guidance of the Texas School for the Blind and Visually Impaired. Several meetings, brainstorm sessions and testing phases were conducted before arriving at the necessary workflow for the EMPWR app. The user interface design was a learning experience for the Kaalo team. You will notice that EMPWR is spelled EMPOWER on the screens. That is because the app reads the text out to the user.
Facial recognition
EMPWR uses AR to recognize faces and other details and informs the user via audio.
Example of what the user hears is as follows “This is Macy. She is formally dressed wearing a gray coat. She is holding a glass of white wine.” It is important to note that EMPWR only recognizes people in the user’s contact list.
Navigation and Shopping Assistance
EMPWR enables users to follow outdoor navigations as well as assists them in their shopping experience.
Unable to navigate indoors, EMPWR only works outdoors assisting users to navigate using google and iOS maps. Audio assistance offers direction, distance, names and route following turn by turn. It also tracks objects and people simultaneously.
For shopping, the user is able to scan barcodes and explore product details including ingredients and price. At the checkout counter, the user is able to pay using Apple Pay and other credit card payment functions. It will maintain a shopping list and manage budget as well.
