Claymify

Screenshot of ComfyUI workflow
Samples

Inspiration

I'm a huge fan of animations like "Shaun the Sheep" and "The Nightmare Before Christmas." I’ve seen a lot of Canva apps that do style transfers for avatars and portraits (Pixelify, Anime Style, CyberAvatar, Cartoon Filter, Pixelify, VoxelArt etc). The clay art style, with its handmade charm, really stands out to me, so I wanted to bring that to life in a simple, fun app.

What it does

Claymify is an AI-powered app that turns your photos into claymation-style art. Just upload or pick an image, and with a click, you’ll get vibrant clay art perfect for sharing on social media or using in creative projects.

How we built it

I put together Claymify using ComfyUI to manage the AI workflow. It uses IPAdapter for matching image similarity and InstantID for nailing face recognition. ControlNet Depth handles pose adjustments, and the clay-style LoRA and diffusion models do the heavy lifting for the style transfer.

The GPU is hosted on AWS, with a Cloudflare Worker as a serverless backend, and it hooks right into Canva using their SDK.

Challenges we ran into

One tricky part was making sure the app handled both facial and non-facial images well, especially since getting faces right is crucial for any good AI portrait filter.

Making ComfyUI as smooth API service is new to me, it has too many complex nodes and braches to debug.

Integrating with Canva’s Selection API also had its additional logic, particularly with the precise type declarations during results Uploading.

Accomplishments that we're proud of

I’m proud that I managed to combine interesting AI workflow with an easy-to-use interface, making clay art accessible to anyone. The Canva integration was a big win too, as it makes sharing and enhancing your creations super simple.

What we learned

Balancing tech sophistication with ease of use was a big takeaway. Making sure the app works smoothly for all image types while keeping things user-friendly was key. This was also my first time running a complex ComfyUI setup in production, which taught me a lot, especially about integrating with platforms like Canva.