MenuMax

Menu Max: Eat smart, spend less. Transform any restaurant menu into optimized recommendations using nutritional data and AI analysis, maximizing the value of every purchase.

Comment

MenuMax

Inspiration

We've all been there: standing in line at a trendy café or scrolling through a massive restaurant menu, trying to decode what's healthy, what's affordable, and what won't trigger an allergy. The "paradox of choice" is real, and it's compounded by rising food costs and growing health awareness.

We were inspired to build a tool that cuts through the noise. We wanted to leverage AI not just for individual benefit, but to create a community-powered platform where every user's decision helps everyone else make a smarter choice. MenuMax was born from a simple question: What if your menu could talk back and give you the best possible advice?

What it does

MenuMax takes a restaurant menu—whether uploaded as an image, PDF, or link—and uses OCR and data enrichment to extract prices, nutritional information, and descriptions.

Then, using multi-objective optimization (weighted scoring + Pareto frontier analysis), the app recommends the best items for the user’s criteria:

  • Minimizing cost
  • Maximizing nutrition
  • Finding the healthiest balance

How we built it

We built a full-stack mobile application with a focus on scalability and clean architecture:

  • Frontend: Built with Flutter for a smooth, cross-platform experience and beautiful, adaptive UIs.
  • AI & Vision: Utilized Google’s Gemini Pro Vision API for industry-leading OCR to accurately extract text and prices from any menu format.
  • Data Enrichment: Integrated with Nutritionix and Edamam APIs to fetch rich nutritional data (calories, protein, allergens) for each extracted menu item.
  • Backend & Database: Employed Node.js with a MongoDB Atlas database to store user profiles and our growing community menu database. Implemented hash-based deduplication so identical menus are processed instantly.
  • Authentication: Integrated Auth0 for enterprise-grade, secure user login and profile management.
  • Algorithms: Built a custom multi-objective optimization engine. It performs constraint satisfaction (e.g., must be < $20) and calculates a weighted score or Pareto frontier to find the best trade-offs between cost and health.

Challenges we ran into

  • OCR Accuracy: Menus have complex layouts, fancy fonts, and background images. Getting Gemini to consistently extract item–price pairs required prompt engineering and post-processing logic.
  • Data Enrichment Gaps: Not every menu item (e.g., "Mom's Famous Soup") exists in a nutritional database. We built a fallback system using keyword matching and nutrition estimation from similar items.
  • Real-time Optimization: Running multi-criteria calculations on large menus in real-time required efficient algorithm design to prevent UI lag.
  • State Management: Synchronizing the UI with the multi-step process (upload → processing → optimization → results) was solved with robust state management in Flutter.

Accomplishments that we're proud of

  • The Community Aspect: Successfully building a shared menu database that benefits all users by eliminating duplicate work.
  • Technical Sophistication: Seamlessly integrating multiple APIs (Auth0, Gemini, Nutritionix, MongoDB) into a cohesive, fast, and stable app within the hackathon timeframe.
  • The Algorithm: Delivering an optimization engine that goes beyond simple filtering, providing intelligent recommendations based on Pareto efficiency.

What we learned

  • The Power of Gemini Vision: Improved our skills in prompt engineering for vision models to handle variable real-world documents.
  • Building for Scale: Learned valuable lessons in designing scalable, community-driven platforms.
  • Trade-offs are Everything: A good recommendation isn’t about a single right answer—it’s about presenting the best possible trade-offs so users can make informed choices.

What's next for MenuMax

  • Restaurant Partnerships: Allow restaurants to integrate directly, offering analytics on popular healthy items and showcasing “MenuMax Picks.”
  • Personalized Profiles: Save dietary restrictions and goals for one-tap recommendations.
  • Meal Planning: Expand from single meals to optimizing a full day’s intake across multiple restaurants.
  • Advanced Social Features: Enable users to share optimized orders and explore popular picks in their network.
  • Sustainability Scoring: Add carbon footprint estimates to menu choices.
Share this project:

Updates