TUMinutePapers

• 

  The user can ask specific questions about the paper. An AI generated video will explain the relevant information in context of the question.

• 

  An AI-generated video is generated that shows an avatar, explaining the five most important facts of the treatment study.

What inspired you to create TUMinutePapers?

Academic papers represent the latest discoveries. However, they are usually written in a complicated manner, making them inaccessible to the general public. We, as a team of medical professionals, scientific journalists, and researchers in the medical field have experienced the frustration that comes with the inaccessibility of understanding the newest medical discoveries, especially when it comes to the health of the patients. Therefore, we were inspired to create a tool that summarizes scientific papers in the most accessible and in-trend medium today: short videos.

Sounds cool, what can I do with TUMinutePapers?

Patients can enter medical questions about their diagnosis. From this input, we generate a video that explains new studies about their specific disease. If they enter follow-up questions, they get targeted videos explaining details of the paper (e.g. risks they face because of their age or previous diseases).

Wow, how does this work?

We use a PDF of a study and RetoolAI to generate a short summary with the main key points from the study, in an understandable manner. For each key point of the study, we generate a corresponding image with Dall-E. The key points and images are pushed to creatomate, which automatically generates a video.

After watching a general summary video, the user can enter follow-up questions. By changing the search prompt, the user now gets a targeted video, answering specifically their question.

Phew, that sounds hard. Did you encounter any challenges?

We had problems with prompt optimization, especially for videos in the background. These were often stigmatizing or not serious enough for a patient tool. Another challenge was to merge all content into one video, but we solved the challenge with the tool creatomate. Lastly, due to the very few tools that actually offer meaningful services with the free tier, we were vastly limited in the usage.

No problem! Sounds like you have things to be proud of?

Yes, thank you! We are proud to have first-functioning videos that show an accurate summary of the study! Apart from that, we have a precise customer journey that solves a real problem we face in our daily jobs. We are excited to use this approach not only with the patients, but also for other use cases such as making the scientific journals more interactive, or getting a first overview over our colleague's research area! In general, papers are now much more accessible, both for professionals and the general public :)

What did you learn?

We got a way better overview of how to use AI. It was exciting to see how easy working with AI has become; by working with APIs, it became relatively simple to create first videos without even "touching the AI".

What's next for TUMinutePapers?

We will try to integrate even more aspects into the videos, such as figures from the paper. The targeted search should be even more precise. Our long-term goal is to create a tool that doctors can easily hand out to their patients and empower them. This can improve decision-making and accessibility of medical information. An option would be to integrate it into Hubert Burda Media solutions such as NetDoctor.

Built With

• chatgpt
• creatomate
• dall-e
• javascript
• openai
• retool
• retoolai