Q is a wearable captioning device for people with significant hearing loss.*
* Patent Pending
For 14 weeks, we were tasked to redesign the real-time captioning experience for people with moderate to profound hearing loss.
Q is a wearable captioning device that allows users to read text with embedded emotion, feel missing phonetic sounds, and bookmark transcripts in real-time for future use.
Leah Demeter, interaction designer
Daniela Cardona, product designer
Emin Demirci, product designer
Jeff Smith, product designer
- Social inclusion leads to personal and professional development.
- Increasing interpersonal relationships.
- More confident and independent individuals.
- Better control of conversation situations without relying on stenographers.
- Increased eye contact with temporary captioning.
- More meaningful conversations by understanding emotional subtleties.
A graph that displays emotional context of the conversation by showing:
1. Emphasis/Duration: The width of the wave
2. Frequency: The light hue is low pitch while the dark hue is high pitch
3. Volume: The amplitude of the wave
Finger Gesture Commands
INTERACTION GESTURE CONTROLS
Activate four different commands by double tapping with fingers.
Activate Touch Speech
All recorded transcripts and device settings are managed through the Q Assistant app.
Q App Flow
39 million people in the US live with a significant hearing loss.
TYPES OF HEARING LOSS
There are five types of hearing loss: normal, mild, moderate, severe, and profound. Depending on the type of loss a hearing person has, certain sounds may not be heard. An audiogram is a tool used to diagnose hearing loss. The "speech banana" contains all sounds heard in speech.
five types of hearing
Mild: 30 dB
(difficulty hearing a whisper)
Moderate: 60 dB
(difficulty with normal conversation)
Severe: 90 dB
(difficulty hearing a motorcycle)
Profound: 120 dB
(difficulty hearing loud rock music)
Many people with hearing loss rely on captioning to follow conversations. Captioners use stenograph machines to write at 275 words per minute.
Our team conducted six interviews to better understand what it is like living with a hearing loss.
Identifying User Needs
Users want to control the situation without being intrusive.
It is difficult to be mobile with the current captioning equipment.
It is difficult to build personal relationships with the captioners following the user around.
Empower the user's confidence and independence.
Gaining User Empathy:
The Earplug Experiment
Since I am profoundly deaf, most people don't realize how difficult it is to have a hearing loss on a day-to-day basis. My teammates went through an entire day at school wearing earplugs to better understand what it is like to experience social situations with a hearing loss.
My teammates had to ask people to repeat themselves often.
Voice Volume Unawareness
They were unaware of the volume of their own voices.
They felt distant from others because they could not hear people speaking more than a few feet away.
We did all brainstorming, ideation, and prototyping as a team for long hours outside of class. We sketched on large pieces of butcher paper which allowed us to build on each other's ideas.