-
-
Home Page - Users can upload any picture of text they want (screenshot or picture of physical book) and the AI tool will generate a quiz.
-
Physical Photo? No problem - QuickQuizzAI easily reads and asks a quiz question based on US History Textbook.
-
Digital Screenshot? No biggie - QuickQuizzAI understands!
Video Demo
https://www.youtube.com/watch?v=M52GXvyJrJw
Inspiration
The inspiration behind QuickQuizzAI stemmed from a common struggle that many students face: maintaining focus while studying and retaining key concepts from their reading materials. It seems as if though reading a few sentences in a textbook before your mind begins to wander is a universal experience that many students would like to see eliminated. We recognized the need for a flexible, intelligent learning solution that could adapt to various text sources and help students reinforce their understanding. This sparked the idea of combining cutting-edge technologies, including Python, Optical Character Recognition (OCR), large language models like Chat GPT, OpenCV image preprocessing, and the Dario machine learning visualization platform, to create an innovative tool for smarter studying.
What it does
QuickQuizzAI is a groundbreaking project that empowers students to reinforce their reading with intelligently crafted quizzes. It offers an interactive learning experience that allows users to capture essential ideas from their reading materials without the distraction of wandering thoughts. By uploading an image of their textbook, whether through a phone camera or a screenshot, users initiate a seamless process. OpenCV takes charge of preprocessing the image by applying filters such as graying out, resizing, and Gaussian average thresholding. This rigorous preprocessing ensures the highest image quality for character detection and extends the project's adaptability to any text medium, be it physical or online.
The processed image then undergoes Optical Character Recognition using Python's Tesseract tool, which identifies individual sentences from the textbook. Here's where ChatGPT comes into play. The extracted text is sent via an API call to ChatGPT, where a large language model leverages its remarkable learning ability to select key points from the reading. It generates simple yet effective questions to test the user's knowledge. The entire program is hosted on Dario, a Python-based platform that provides users with the ability to visualize machine learning programs, offering a holistic learning experience.
How we built it
Building QuickQuizzAI required a multi-faceted approach. We harnessed Python as the foundation of our project, utilizing its versatility and extensive libraries. OpenCV, a powerful computer vision library, was instrumental in image preprocessing, enabling our system to accommodate images from various sources seamlessly. Optical Character Recognition (OCR) technology, specifically Tesseract, was employed to extract text from images, making educational content accessible.
The integration of ChatGPT, a large language model, was pivotal in generating relevant questions from the extracted text, enhancing the learning experience. Lastly, Dario, a machine learning visualization platform, provided the ideal environment for hosting and presenting our innovative solution.
Challenges we ran into
Throughout the development of QuickQuizzAI, we encountered several challenges. Ensuring robust image preprocessing through OpenCV while maintaining flexibility across text sources was a complex task. A LARGE part of this project is ensuring the user has the choice to upload an image from a physical textbook or a screenshot from an online textbook. These are two different image types, and meticulously calibrating OpenCV image preprocessing grants the user this flexibility when using our product. Additionally, fine-tuning the OCR process to accurately extract sentences posed its own set of challenges. One of the most significant challenges we faced was the meticulous design and fine-tuning required to seamlessly integrate ChatGPT and generate relevant and meaningful questions, which demanded a delicate balance of precision and creativity in our approach.
Accomplishments that we're proud of
Our proudest accomplishment revolves around our willingness to step out of our comfort zones and boldly dive into the realm of multiple AI technologies, threading them together with APIs, even in the face of limited prior knowledge. We were determined to tackle a problem we were passionate about and refused to let our technical boundaries hinder us from creating a solution we ourselves would genuinely utilize. QuickQuizzAI stands as a testament to our commitment to bridging the gap between text-based learning and AI-driven interactivity, successfully harmonizing various technologies to provide students with a comprehensive and adaptable solution. Its exceptional flexibility, thanks to OpenCV image preprocessing, positions it as a versatile and invaluable tool for enhancing the learning experience.
What we learned
Throughout the development of QuickQuizzAI, we learned the power of synergy among diverse technologies. The collaboration of Python, OCR, large language models, computer vision, and machine learning visualization enabled us to create a holistic learning tool. We also gained insights into the challenges and intricacies of each technology, furthering our knowledge in these domains.
We have 100% gained a deeper understand of Python architecture and OOP, as our complicated coding became much easier to read and understand through encapsulation. But first and foremost, the machine learning technologies that we have used have pushed our boundries to learn more about AI, and we are proud to acknowledge we have much more to learn in the field of AI, but are excited to see the impact we can already create with it.
What's next for QuickQuizzAI
The journey doesn't end here. QuickQuizzAI has the potential to evolve further. In the future, we aim to enhance its user interface and expand its compatibility to include additional languages and learning materials. We'll also explore opportunities to integrate more advanced AI capabilities for even smarter and more personalized learning experiences. Furthermore, the integration of this technology into a mobile app would allow the users even more seamlessness from textbook to understanding. The possibilities are endless, and we're excited to continue empowering learners with the intelligence of QuickQuizzAI.
Built With
- api
- chatgpt
- dario
- llm
- machine-learning
- natural-language-processing
- ocr
- opencv
- python
- tesseract
Log in or sign up for Devpost to join the conversation.