Taskpuppy

• 

  [current version] Selecting form input

• 

  [current version] Inputting text into selected form input

• 

  [current version] Selecting sort options clickable button

• 

  [current version] Works on large range of sites!

• 

  [future iteration] Natural language parsing and copilot auto-complete

• 

  [future iteration] Custom, magic actions

• 

  [future iteration] Natural language on-page search

Inspiration

I have ADHD. It’s a frustrating part of my life that I’ve learned how to manage over the years, but it still requires a lot of awareness and regimented medicating to maintain a flow state in my work. I especially struggle with tedious, rote tasks. Doing tasks online is the bane of my work week. Most people are accustomed to it that it doesn’t even seem like a problem, but to me, the fact that every single website has a different layout that I have to scan and analyze in order to understand how to do these basic tasks is INFURIATING.

What it does

Taskpuppy uses AI to turn the inconsistent mass web UIs across the internet into a consistent set of keyboard shortcuts & actions. We use individual webpage context to generate shortcuts and automate their actions in a seamless user flow.

How we built it

First, we pass the website that the user is on into a context-gathering and parsing script that also records the tags of any corresponding input fields or buttons. We then display that to the user and map each action to a keyboard shortcut which can be accessed by opening the shortcut menu [ctrl] and using number keys [1,2, etc]. It’s packed into whatever web browser you use as a browser extension that we built using Typescript, React, and Plasmo (an extension framework). Finally, the action is completed with a browser automation component which relies on the action mapping that was gathered in the first step.

Tools:

1. www.plasmo.com - browser development framework
2. www.groq.com - to make our shortcut generations lightning-fast

Challenges we ran into

1. Streamlined UX: Despite our progress, we see endless possibilities to improve the UX to make web browsing lightning-fast for all users.
2. Speed vs. Capabilities: There's SO much more we could do, whether it's personalizing context or chaining more actions. But how much does that matter vs. just making actions simple and fast? Important design tradeoff... but ultimately we started by prioritizing speed because of users like us (with ADHD).
3. Peanut needed to pee every 45 minutes so we rotated pee break responsibilities 🤣

Accomplishments that we're proud of

Building something that we, as people with ADHD and focus issues, would actually regularly use and benefit from. And also leaving time to prototype future iterations that we would actually even pay for.

What we learned

Our main takeaway was that building successful AI agents requires a seamless workflow between human & AI. We think our project ended up striking a good balance for a 2-day endeavor, but as AI continues to evolve, this relationship will too.

What's next for Taskpuppy

We’re aiming to launch this next week and get our first paid subscribers by end of June.

Built With

• plasmo
• react
• typescript