Inspiration
The inspiration behind SmartClicks, emerged from a desire to revolutionize the traditional learning experience. We identified a need for a tool that could provide personalized learning opportunities for elementary school students, taking into account their individual learning habits. The aim was to create a platform that not only records and delivers lectures online but also adapts the content based on each student's unique learning styles.
Research
Our team put in a lot of effort over the hackathon to really understand the challenges faced by students with ADHD or motor problems. We dug into research papers and articles to wrap our heads around issues like problems with attention, focus, or coordination that make learning difficult. That research was key for coming up with SmartClicks - we wanted whatever solution we built to really address the needs highlighted in the latest studies. We weren't just building a piece of tech to build tech - we were aiming to combine research and social good into a practical tool for helping kids who learn differently. That drive came out of both our team's creativity and our commitment to evidence-based solutions that make a genuine difference.
What it does
The SmartClicks solution integrates multiple complex technical components, including cloud-based AI enabled by Cloudflare, user authentication via Auth0, and custom Arduino hardware button systems, into a seamless platform allowing teachers to upload lectures and create interactive virtual classrooms while enabling students – particularly those with learning needs – to more actively engage with academic content. SmartClicks uses AI to intelligently convert a class lecture recording into summaries and multiple choice questions. The physical joystick buttons provide an interactive means of answering the questions, where students are able to visualize their thought and elimination process. This not only alleviates work on the teacher’s part, and provides an engaging at-home practice to concepts learned in class, but also allows the AI to provide personalized questions and summaries specific to how each student learns and what they still need to master in the class.
How we built it
The SmartClicks system is powered by an intricate integration of multiple technologies working in unison. User authentication is handled securely through Auth0 protocols, ensuring only registered teachers and students have access. Video lectures and class content are uploaded by teachers to cloud servers leveraging Cloudflare AI algorithms that can process information in almost no time. This enables advanced features like searchable transcripts and analytics.
One of the most innovative elements is the custom hardware device equipped with large joysticks, intended to develop motor skills and hand eye coordination. The feedback enabled device equipped with buzzers and LEDs make it that much more engaging.
Challenges we ran into
Several challenges were encountered during the development of SmartClicks. Our team dealt with ensuring the accuracy of Speech-to-Text technology, considering the rapid pace at which teachers often speak. The incorporation of new platforms such as Auth0 and MongoDB presented initial challenges due to the complex nature of their integration into our project. However, as our team navigated through these unfamiliar territories step by step, the once intricate concepts gradually became clearer. Despite the initial hurdles, we were able to overcome these challenges.
Accomplishments that we're proud of
This project was our first time integrating Auth0, MongoDB Atlas, Cloudflare, and pipelines, and while we hit many issues integrating these platforms, we were able to solve them and implement all of these into this single project. We were also very proud of having our idea finalized before 8am in the morning (we usually spend so long trying to think of an idea), and we actually got some sleep on the first night! We were also able to successfully implement our ambitious plan for the AI to convert speech to text, then summarize twice, and then generate questions, all very accurately.
What's next for SmartClicks
The future of SmartClicks involves refining the Speech-to-Text accuracy, implementing guidelines for teachers, and finding more ways to make the hardware interaction even more intuitive. We envision expanding the platform's capabilities to include more features that enhance the overall learning experience and its ability to improve education for disadvantaged students. SmartClicks aims to continue unleashing the power of AI for personalized education, click by click.
Built With
- arduino
- cloudflare
- css
- cuda
- flask
- html
- javascript
- json
- mongodb
- pipeline
- python
- pytoch
- transformers
- whisper
Log in or sign up for Devpost to join the conversation.