Newton-Notes

Inspiration

Introducing Newton Notes, born from the frustration of missed details in fast-paced lectures and the limitations of traditional note-taking. Inspired by the need for accessible and efficient learning tools, Newton Notes utilizes cutting-edge natural language processing to transcribe lectures in real-time, simplifying the note-taking process. With a focus on accessibility, it organizes content for easy review, allowing users to organize their notes from all classes. Say goodbye to missed moments and hello to streamlined note-taking with Newton Notes.

What it does

"Newton Notes" enhances academic performance by transcribing spoken lectures in real-time, ensuring no detail is missed. With sophisticated natural language processing, it structures notes for quick access and review, and features smart summaries for efficient study. Its synchronized platform across devices promotes a seamless learning experience. Designed for inclusivity, Newton Notes supports a range of learning styles, streamlining the path to knowledge.

How we built it

Newton Notes leverages Google Cloud's NLP models through its API to revolutionize note-taking, with an added boost from the GPT API to structure transcribed information into Cornell Notes format. Our system integrates Prisma ORM and MongoDB for optimal data management, while the user interface is developed with Next.js and Shadcn/UI for a seamless, interactive experience. State management is streamlined via Zustand, and data retrieval is facilitated through Axios and useSWR. At the end of each lecture, the GPT API compiles three key points to highlight the most crucial takeaways, ensuring that Newton Notes is not only robust but also highly effective in delivering real-time, structured educational content transcription.

Challenges we ran into

Building "Newton Notes" presented significant challenges, particularly in full-stack development. Our team worked diligently to seamlessly integrate various APIs into our product, ensuring they functioned harmoniously to deliver real-time transcription and note formatting. Additionally, we faced difficulties with our database system, specifically in storing and retrieving the formatted notes efficiently. These challenges required innovative problem-solving and persistent refinements to enhance the functionality and robustness of Newton Notes.

Accomplishments that we're proud of

We are incredibly proud of the accomplishments achieved with Newton Notes. Thanks to the hard work and dedication of our team, we have developed a fully functional product that not only performs exceptionally but also boasts a visually stunning user interface.

What we learned

Prisma MongoDB Next.js (with route handler version) Shadcn/UI Zustand Axios useSWR Natural Language Processing (NLP)

What's next for Newton-Notes

Initially, we embarked on training our own model using the open-source DeepSpeech product. Despite our best efforts, we faced significant challenges, particularly with connectivity issues in the Intel Developer Cloud, which hindered our progress. Moving forward, we are excited about the potential of implementing a new feature that would allow audio files to be directly transcribed. This development would significantly enhance the utility of Newton Notes, making it even more versatile and user-friendly.