SmartLayer

Every find yourself watching some content and don't understand a word/concept from it and pausing the media playing, google search and then comeback. But this player has inbuilt Translation and PALM2.

Comment

Inspiration

I am watching a video and I sometimes find myself not understanding a word and then I have to exit the player and do a google search then comeback and continue my video. Flow breaking right? So, that's why I made this to have on the go info about the content from subtitles. Cool right?

What it does

It is a basic media player with having the functionality to get the info about current content using the subtitles.

  • we can choose the whole sentence as well as particular words
  • we can prompt Google PALM (text generation model) that chosen words/sentence and have the answer.
  • we can also have the basic translation to 50+ languages. ## How we built it
  • Media Player -> Android and related libraries
  • Google PALM -> Using Google cloud.
  • Translate -> Using Google's ML Kit. ## Challenges we ran into
  • Extracting the subtitles
  • Showing them as words and maintaining the forming the new text
  • calling the google palm endpoints ## Accomplishments that we're proud of
  • Inbuilt Contextual ## What we learned
  • Embedding Google Palm ## What's next for SmartLayer
  • We can add Youtube or any other platform for data and have this player as the info layer.

Built With

Share this project:

Updates