WordToon

• 

  My Comics page

• 

  Giving the story

• 

  Home Page

• 

  Create Comic Page

💡 Inspiration The idea for Word-Toon was born from a simple question:

“What if we could turn a short story or idea into a visual comic page using AI?”

As fans of comic books and storytelling, we were fascinated by how generative AI models are now capable of transforming text prompts into high-quality images. We thought, why not merge storytelling with AI to make comic creation accessible for everyone—even those without drawing skills?

⚙️ How We Built It The app is built using:

Frontend: React + Vite, styled with custom CSS and gradients for a modern, fun look.

Backend: Flask server using 🤗 HuggingFace diffusers library to load Stable Diffusion pipelines.

AI Models: Stable Diffusion for generating comic panels based on text.

Extra Features:

Comic style selection: Anime, Noir, Fantasy, Sci-Fi

Layout chooser for panel designs

Speech bubble editor per panel

Save your comics in a local dashboard ("My Comics")

🔍 Features 🧠 Text-to-Comic: Enter a story prompt and choose a style — the app generates comic panels.

🖼️ Panel Layouts: Select from various layouts (2x2, 1x3, etc.) for the comic page.

💬 Speech Bubbles: Add dialogue or captions to each panel manually.

🗂️ My Comics Dashboard: View previously generated comics (stored locally).

🧠 What We Learned Integrating AI model pipelines with frontend apps via a backend API.

Handling performance issues while loading large models like Stable Diffusion.

Client-side routing with React and deployment best practices (like using _redirects in Netlify).

Managing CORS issues, async data handling, and clean UI/UX with Vite + React.

🚧 Challenges We Faced Model Loading Time: Stable Diffusion takes time and GPU resources; we had to optimize load time and switch between models depending on GPU support.

Client-side Routing on Deployment: React Router didn’t play well with Netlify initially, leading to 404 errors until we configured redirects.

Rendering Issues: We dealt with React errors caused by incorrect hooks usage and mismatched versions.

🚀 What's Next? We plan to:

Add Google/Firebase login for user-specific comic storage.

Add templates for characters and recurring comic themes.

Improve performance with lighter/faster diffusion models.

Export comics as PDFs and share to social media.

What it does

How we built it

Challenges we ran into

Accomplishments that we're proud of

What we learned

What's next for WordToon

Built With

• flask
• huggingface
• python
• react