TalkTuah

The Glasses
CV
Outputs to Glasses
Lil Gouda Loves TalkTuah

Inspiration

I was at the Columbia hackathon last week when I had the opportunity to see social Stockfish (an AI that predicts conversation flow, like a chess engine for chats) get built next to me. It blew my mind. Shoutout to @eddybuild and @cadenbuild for their work on the chess glasses (the reason I bought the meta ray bands lmao) and social Stockfish---it was a huge spark for me. I wanted to create something similarly badass, a glimpse into the future of AI-powered wearable social intelligence.

So, I jumped into a solo project to challenge myself at one of the biggest stages. The result? TalkTuah---a real-time conversation coach that listens, analyzes, and guides you through any interaction.

What It Does

Real-Time Listening: Captures conversation and transcribes it on the fly.
Engagement & Body Language Tracking: Keeps an eye on how people are reacting.
Smart Suggestions: Provides AI-generated tips and responses right when you need them.
Wearable Output: Whispers prompts through Meta Ray-Bans (yes the glasses---but no official SDK!).

It's perfect for dates, interviews, or just hanging out. TalkTuah subtly nudges you toward your goal without taking over the conversation.

How I Built It

Speechmatics for live transcription.
OpenAI + Grok to generate and refine conversation strategies.
BlackHole 2ch for seamless audio routing (in and out).
ElevenLabs for text-to-speech, whispering cues through the Ray-Bans.
Meta Ray-Bans have no official SDK, so I had to piece together custom workarounds to make it all function in real time.

Challenges

No SDK for Meta Ray-Bans: The biggest headache by far.
Low Latency: Had to make sure everything responded fast enough for real conversation.
Natural Feel: Too many AI interruptions get weird, so timing was everything.

Next Steps

Speed & Smoothness: Optimize real-time performance even more.
Advanced Body Language Detection: Refine how TalkTuah interprets nonverbal cues.
Mobile App Companion: Bring these features to people without the glasses.