Inspiration
Our school has a specialized special education branch, so we see a lot of kid in special education everyday. They are amazing kind people however we feel they are a massively underrepresented group especially in terms of AI advancement.
What it does
BriteSpeech helps coach kids in special education in improving their speaking skills. Using AI we will give specialized feedback and scores on their performance, and students are given a rank based on their scores which they can improve and grow upon as they continue to utilize BriteSpeech. Overtime, students will also receive sentences which incorporate their commonly missed words. Teachers are also able to view the students' most commonly missed words. Teachers can see the current rank of all students, and according to the rank of the students, they can receive a special prize.
How we built it
We used the Django web framework for the website, Whisper by OpenAI for the audio-to-text conversion, and Claude API for the speech analysis. All code was written in Python, HTML, CSS and JavaScript.
Challenges we ran into
We had a difficult time personalizing the feedback and the sentence. The feedback would be either too generic or too complex; the sentences also had a tendency to repeat. We also wanted the scores to be an accurate representation of the students ability into order to give them and the teacher a good outlook on their progress which was also difficult. Through a lot of debugging, all these issues were mitigated.
Accomplishments that we're proud of
We are proud of creating a fully function website that accurately analyzes and improves speech. All the functionality works just as intended, and we are excited to showcase BriteSpeech to our school's special education department.
What we learned
Although we were able to learn more about AI models, such as Whisper, more importantly we learned about the underrepresentation of the special education community. None of us have ever coded in such a small time period, but through perseverance and with a few cookies, we were able to push out a fully functional website.
What's next for BriteSpeech
BriteSpeech would like to add the functionality where teachers can give their students their own sentences to practice through the teacher dashboard. We also hope to implement Brightspeech into our school eduction program.
Log in or sign up for Devpost to join the conversation.