Prototype Video
An early animated concept.
Background and Context
“The thumb is the most common single digit loss. The loss of a thumb inhibits the ability to grasp, manipulate or pick up objects grasping ability.” (link)
“It is not possible sometimes for amputees to not use both hands to operate the phone or answer phone call.”
“I use my nose sometimes, I know it looks dumb, but sometimes I have to answer a phone call that way.”
“I have to always have bluetooth earpiece when I am out doing stuff in case I have to answer a call.”
“Apple’s VoiceOver is doesn’t serve this market. It’s for more visual impairment.”
“Thumb prosthetics are expensive and usually silicone based that does not conduct.”
“I also want to be using what other friends are using because I am interested in new technology. But I can’t.”
How Might We…
- Improve the smartphone experience for people living with this disability?
- Explore other ways to navigate a smartphone interface using today's technology?
Everyday Sensors Already Built Into Smartphones
- Gyroscope tilt
- Facial control (eye tracking)
- Not every phone has this technology.
- Ambient sensor
- Microphone (Voice)
- Side buttons
Sketches and Exploration
First Idea: Eye Tracking
Hospitals already rely on eye tracking for patients who cannot speak or move easily.
While it can capture a patient's intended navigation well, it brings several drawbacks that make it impractical for smartphones.
- It needs another able-bodied person to set it up and is not portable at all.
- It is bulky to wear.
- It demands extreme concentration.
- Facial tracking exists only on newer devices, and only a few of those offer retina tracking.
Rapaport, Lisa. “Night Shifts plus Unhealthy Lifestyle May Be Recipe for Diabetes.” Reuters. December 03, 2018. Accessed December 04, 2018. https://www.reuters.com/article/us-health-diabetes-night-shift/night-shifts-plus-unhealthy-lifestyle-may-be-recipe-for-diabetes-idUSKBN1O22IV.
I was Inspired by the levels with bubbles. Gyroscope in the phone will know the orientation of the device in 3D space. Using that data, the bubble will compensate its location to its most center of weight. When you have the device upright, the bubble will hit the top of the screen and perfectly flat will be in the center of the screen careful device by device calibration would be a key to its success
As the device tilts, the digital “bubble” can be steered by that tilt. When the bubble passes over what would have been the ‘touch' target, a physical button can act on it. To scroll, tilt the bubble to “lean” against an edge, or let it rest there longer, and scrolling is triggered.
Example: Tilting the device toward the top-left corner moves the bubble to the bottom-right corner.
Watch the rough prototype video at the top of this page.
Concept Feedback and Areas to Improve
- “There should be a sensitivity setting, because it could feel like a game and become too hard.”
- “Deeper research with the target market is desirable (more than one person).”
- Consider the developer environment (“Apple won't let you access the whole system this way, even though it was just used as a prototype”).
- Could this type of system be used elsewhere to benefit other groups?
- Are there side effects (physical or otherwise) from mainly holding the phone perpendicular to the floor? And what happens when you watch a video or similar? There should be a way to disable the control manually or automatically.
