Real-Time Speech-to-Braille for the Deaf-Blind
About the Project
Our project aims to bridge communication gaps for the deaf-blind community by converting real-time speech into Braille. Inspired by the need for more accessible technology, we sought to develop a solution that enables deaf-blind individuals to receive spoken information through tactile feedback.
Inspiration
We were motivated by the challenge of creating a seamless communication tool that combines speech recognition with Braille technology, ensuring inclusivity and accessibility.
What We Learned
- Speech-to-Text Conversion: Leveraged LLMs to convert speech to text.
- Braille Translation: Developed a method to translate text into Braille characters.
- Tactile Display Technology: Integrated a Braille display to convert text into tactile feedback.
How We Built It
- Speech Recognition: Used the Groq API to capture and convert spoken language into text.
- Tactile Display: Used a Raspberry Pi and servos to make a device to create the braille dots real-time .
Challenges Faced
- Real-Time Processing: Converting speech to text and then converting the text to physical hardware movements in real time. This required multithreading.
- Hardware Integration: Setting up the Raspberry Pi and reducing servo jitter.
We’re excited about the potential impact of our project and hope it brings more accessibility and independence to the deaf-blind community.
Log in or sign up for Devpost to join the conversation.