AgentIvy - AI-Powered Accessibility & Performance Testing Agent
Inspiration
While developing a DMV CRM system for a client, I encountered a critical requirement that was mentioned later in the project lifecycle: WCAG compliance. This experience highlighted the need for automated accessibility testing early in the development process. Rather than discovering compliance issues late in development, I envisioned a tool that could proactively identify and suggest fixes for accessibility and performance problems throughout the development cycle.
What it does
AgentIvy is an AI-powered code analysis agent that automatically:
- Clones your repository
- Scans the codebase to identify all components and pages
- Executes accessibility and performance tests on each component
- Identifies WCAG compliance issues and performance bottlenecks
- Suggests code fixes with direct references to the affected code
Currently, AgentIvy focuses on identifying issues and providing actionable recommendations to improve your application's accessibility and performance metrics.
How we built it
Technology Stack
Backend:
- Java 17 with Spring Boot 3.x - Leveraged my existing expertise from corporate projects for rapid development
- Google ADK - Agent framework powered by Gemini 3.5 Pro for advanced code generation and analysis capabilities
- JGit - Repository cloning and management
- Playwright - Browser automation for comprehensive accessibility and performance testing
Frontend:
- Angular 17 - Utilized my existing proficiency for efficient UI development
Deployment:
- Firebase - Frontend hosting with CDN distribution
- Google Cloud Run - Dockerized backend deployment with auto-scaling
Challenges we ran into
Testing individual components was difficult because they have dependencies like services, authentication, and routing. Running isolated tests would break these connections.
Solution: I created a dynamic test harness - a smart container that automatically mocks all dependencies and provides a controlled environment. This lets AgentIvy test components as if they're running in a real app, without needing the full application setup.
Accomplishments that we're proud of
- Successfully integrated Gemini 3.5 Pro for intelligent code analysis and context-aware suggestions
- Built an end-to-end automated testing pipeline from repository cloning to issue detection
- Implemented a dynamic test harness solving the component isolation challenge
- Deployed a production-ready application on Google Cloud infrastructure with auto-scaling
- Achieved sub-2-minute analysis time for medium-sized repositories
- Integrated Playwright for comprehensive DOM analysis and performance monitoring
What we learned
Building AgentIvy taught me how to design AI agents for complex code analysis, manage browser automation at scale, and optimize async processing in containerized environments.
Key lesson: Start small and build up. Testing components individually, then pages, then the full app avoids overwhelming complexity while still delivering meaningful results.
What's next for AgentIvy
Phase 1: Enhanced Analysis & Automation
Automated Code Fixes & Pull Requests
- Generate fix commits automatically
- Create PRs with detailed explanations and before/after comparisons
- Support multiple fix strategies per issue (let developers choose)
- Integration with GitHub, GitLab, and Bitbucket
UI Responsiveness Testing
- Viewport testing across devices (mobile, tablet, desktop)
- Responsive design validation at breakpoints: ${320px, 768px, 1024px, 1440px}$
- CSS breakpoint analysis and recommendations
- Touch target size validation for mobile
Batch Component Testing
- Analyze multiple components simultaneously
- Reduce overall analysis time by $\approx 60\%$ through parallel execution
- Intelligent scheduling based on component dependencies
- Progress tracking with estimated completion time
Containerized Execution Environment
- Create isolated Docker container per analysis run
- Destroy containers post-completion for security
- Resource limits: $\text{Memory} \leq 4GB$, $\text{CPU} \leq 2$ cores per container
- Improved resource management and cost optimization
Phase 2: Developer Integration
CLI Tool for CI/CD Pipelines
- Integration with GitHub Actions, GitLab CI, Jenkins
- Pre-commit hooks support
- Exit codes for build failure on critical issues
- JSON/HTML/XML report formats
Code Quality Standards Enforcement
- ESLint rule enforcement with custom rule sets
- Naming convention validation:
- Class names:
PascalCase - Methods:
camelCase - Constants:
UPPER_SNAKE_CASE
- Class names:
- Semantic analysis:
- DOM structure validation
- Action naming patterns
- Model consistency checks
- Integration with existing linters and formatters
VS Code Extension
- Real-time local analysis as you type
- Inline suggestions and quick-fixes in editor
- Accessibility violations highlighted with severity indicators
- Performance metrics in status bar
- Command palette integration:
AgentIvy: Analyze Current File
Phase 3: Complete IDE Solution
Vision: Build a comprehensive IDE that eliminates the need for multiple tools and scripts
Log in or sign up for Devpost to join the conversation.