Inspiration

Creating video ads for e-commerce products is expensive and time-consuming — hiring editors, voice actors, and music producers. Small Shopify merchants can't compete with big brands' ad budgets. Adify produces scroll-stopping short-form video ads from just a source clip and a product listing.

What it does

Adify is an AI-powered video ad generator for Shopify stores. A merchant connects their store, picks a product, uploads source video footage, and Adify produces a professional 15/30/60-second ad — complete with AI narration, generated background music, beat-synced cuts, spatial sound effects, and text overlays. It supports two ad styles: narrated (AI voiceover with sidechain-ducked music) and music-only (beat-snapped cuts with text overlays).

How we built it

We built a multi-stage AI pipeline orchestrated through a Next.js full-stack app:

  1. Video Analysis — Gemini analyzes uploaded video to understand visual content, then generates ad copy, mood, voice selection, and precise cut timings

  2. Voice Synthesis — ElevenLabs generates narration from the AI-written script, with per-sentence speed control matched to segment durations

  3. Music Generation — Google Lyria generates mood-matched music in real-time via a streaming WebSocket session, outputting raw PCM that we manually encode into WAV

  4. Video Composition — FFmpeg orchestrates the final render with a complex filter graph: trimming video segments to match narration timing, applying sidechain compression so music ducks under voice, adding spatially-panned whoosh SFX at cut points, and scaling everything to 1080x1920

The frontend is React 19 with Tailwind CSS, and we use Supabase for product metadata storage.

Built With

Share this project:

Updates