ENCARES

Login
Main
Novelty
Speech to Text Conversion
Twilio Video Call Integration

Inspiration

To reduce the suffering to help deaf people to make communication in a better way and to create a Speech Recognition app for Deaf / Patients suffering from Hearing Loss. To help the patients with hearing loss to survive in the society without hesitation

What it does

It instantly converts the speech/voice received from the user's microphone to text. It displays the final Transcript for the user which can be found in saved notes . Another add-on features my team and I decided to bring was - the Twilio Programmable Video Call.

How we built it

React-speech-recognition-npm was used in accomplishing the primary object. Also, Frontend was built with React Js and Tailwind CSS. For Integration Twilio, my teammates used Twilio-programmable-video-SDK and Twilio-conversation-SDK.

Challenges we ran into

This was our first time using both React-speech-recognition-npm as well as Twilio-SDKs for video calls. Though the initial deployment was easy the time frame given was not enough for the team to add more features

Accomplishments that we're proud of

A functional cross-platform application running successfully in both Web and Mobile
Instant Speech to Text recognition and conversion
Recognizing the Final Transcripts
Enabled Twilio Video Calls

What we learned

Thanks to Impractical Hack 2 since this was the platform for us to learn about Twilio and its features

Novelty

*Instant Text Conversion *: A Speech Recognition app built that quickly transcribes audio to text from the user's microphone. Simple to use app for dictating text which can be received through Calls, Meetings, etc.
Twilio Video Call: A collaboration application built with Twilio's Programmable Video JS SDK and Twilio's Conversations JS SDK, to keep in touch with your friends, family, and colleagues.
Saved and Final Transcripts: Distinguishing the interim and final transcripts for the user to give a smooth approach to the app. It shows the transcript of the speech picked up from the user's microphone.