Inspiration
Mental and physical wellness often require separate tools and apps. We wanted to unify these with the power of AI into a single holistic platform that adapts to the user’s lifestyle — whether they want to eat better, exercise smarter, or just talk.
What it does
Uses AI to create adaptive fitness routines, personalized diet plans, and empathetic mental health conversations — all in a sleek web interface. Supports real-time webcam feedback, markdown-based diet output, and animated 3D avatars with voice/lip-syncing.
How we built it
Backend in Flask (diet plans) and Node.js (therapist) Frontend in React with routing and component design 3D avatar with Three.js + React Three Fiber Used Gemini Pro API for personalized text generation Built posture correction AI using MediaPipe + webcam
Challenges we ran into
Integrating React Three Fiber with traditional React routing CORS issues when combining Flask and Node.js Parsing and beautifying Gemini's long markdown text Real-time posture correction with MediaPipe and multiple camera angles
Accomplishments that we're proud of
Fully working AI dietician and therapist Real-time feedback using the webcam Custom 3D avatar with facial animations and lip sync Professional-grade UI with clear navigation and branding
What we learned
Cross-language backend integration (Flask ↔ Node.js) React Three Fiber for interactive 3D experiences How to build and serve generative AI outputs in production Working in a team and collaborating across different codebases
What's next for Wellthify
Add secure user login + history Allow users to save or edit diet/fitness routines Export to PDF/email integration Therapist mood tracking + journaling Mobile app version with offline support
Built With
- api
- css
- dotenv
- express.js
- fiber
- flask
- flask-cors
- gemini
- google-cloud
- google-web-speech-api
- html
- leva
- mediapipe
- node.js
- react
- render
- router
- speech
- sqlalchemy
- tailwind
- tensorflow
- three
- three.js
- vercel
- vite
- web
Log in or sign up for Devpost to join the conversation.