AWS Pilot

Learn to use AWS tools with the Chrome Extension AI Pilot by your side.

Comment

About the Project — AWS Pilot

Inspiration

We were inspired by the frustration so many students (including us during Dubhacks) and early-stage developers face when using the AWS Console for the first time. Even though AWS is incredibly powerful, it can feel overwhelming: filled with unfamiliar terms, nested menus, and hidden workflows. During DubHacks 2025, we asked ourselves:

“What if AWS had a built-in tutor?”

A tutor that could explain, guide, and teach by doing.
That idea became AWS Pilot: a Chrome extension that helps users navigate AWS step-by-step with AI-powered explanations, visual cues, and interactive feedback. Our goal was to make cloud learning more accessible, interactive, and confidence-building for everyone — especially students learning AWS for the first time.

The domain is "thishurtyougave.select" since: this hurt you gave, this guide we give It was a pain to learn the tools, but now we select and give you this guide.

What It Does

AWS Pilot turns the AWS Console into a guided, intelligent workspace.
It combines natural-language understanding, AI explanations, and live browser navigation to help users complete real AWS tasks. It runs in 3 modes:

  • Explain Mode — Simplifies complex AWS concepts in plain English (e.g., “What is an IAM role?”).
  • Do Mode — Provides step-by-step, clickable instructions for AWS workflows like launching EC2 instances or hosting a static S3 website.
  • Error Whisperer — Detects AWS Console errors and explains how to fix them with context-aware suggestions.

Users can simply say things like “Create a serverless API” or “Host my website”, and AWS Pilot will highlight the right buttons, show visual cues, and walk them through each step — just like a co-pilot inside the console.

How We Built It

We built AWS Pilot as a dual-backend system with a Chrome Extension frontend for seamless browser integration.

Chrome Extension

Built using Manifest V3, content scripts, and service workers, it injects visual guidance elements (like red pulsing borders and floating panels) directly into the AWS Console.

Node.js Lambda Backend

Handles traditional guidance logic — pre-defined workflows, explanations, and error help — using Express.js, Serverless Framework, and AWS Lambda.

Python Bedrock Agent

Provides conversational AI features and element analysis through Amazon Bedrock, powered by Flask and boto3.

Cloudflare Worker Proxy

Used for secure routing and latency reduction between the browser and AWS endpoints.

This hybrid design let us blend structured AWS knowledge with dynamic AI reasoning — bridging the gap between guided learning and intelligent assistance.

Challenges We Faced

  • Cross-system communication: Connecting a Chrome Extension to AWS Bedrock required building a secure backend proxy with token authentication.
  • Dynamic AWS UI detection: The AWS Console uses complex, shifting DOM structures. We implemented 11 different search strategies to consistently find and highlight the right elements.
  • Latency & performance: Balancing real-time AI responses with smooth animations and browser efficiency took careful optimization.
  • Learning Bedrock APIs and using Cloudfare Workers. Authentication took a long time.

Accomplishments We’re Proud Of

  • Built a fully functional, production-ready Chrome extension in under two days.
  • Integrated Amazon Bedrock AI successfully for contextual AWS guidance.
  • Designed a multi-mode interface that blends traditional tutorials with interactive AI help.
  • Made AWS learning visual, conversational, and hands-on.

What We Learned

We learned how to bridge AI, education, and cloud computing into a cohesive user experience.
In particular, we deepened our understanding of:

  • Chrome Extension architecture (content scripts + service workers)
  • AWS Bedrock and serverless backends
  • Prompt engineering for domain-specific tutoring
  • Designing tools that teach users by guiding them through real tasks

Most importantly, we learned that AI doesn’t replace learning — it enhances it.

What’s Next

  • Add voice-based tutoring for accessibility
  • Expand multi-language support (English / 中文 / 日本語)
  • Integrate with AWS Educate for verified learning paths
  • Build a sandbox mode for safe AWS experimentation
  • Launch a beta for students learning cloud infrastructure

Built With

Languages & Frameworks:
JavaScript (ES6+), Python 3.9, Node.js 18, Flask, Express.js

Platforms & Services:
AWS Lambda, Amazon Bedrock, Cloudflare Workers, Chrome Extension (Manifest V3)

APIs & Tools:
boto3, Serverless Framework, AWS SAM, Route53, ACM, S3

Other:
YAML Workflow Recipes, Bedrock Titan API, custom DOM Analyzer, GitHub Actions CI

Share this project:

Updates