SnapChem is an educational AR experience built for Snap Spectacles that helps students learn chemistry by combining physical molecular model kits with real-time AR guidance.

Instead of learning chemistry only through 2D diagrams or formulas, SnapChem allows students to build molecules by hand while seeing interactive overlays, instructions, and challenges in wearable AR.

This project was developed as part of a hackathon prototype focused on XR for education.

Many students struggle with chemistry because they need to understand:

• chemical formulas
• molecular structures
• chemical reactions

all at the same time, while most learning tools only support one of these.

SnapChem bridges this gap by merging:

• Tactile learning (physical molecule kits)
• Visual learning (AR overlays in Spectacles)
• Active learning (real-time challenges)

1. Student puts on Snap Spectacles
2. Launches the SnapChem experience
3. Selects Learn or Challenge mode
4. Sees a molecule prompt in AR
5. Builds the molecule using a physical kit
6. Places the final model inside the AR boundary
7. Submits to check their answer

• Wearable AR UI for guided learning
• Learn mode for step-by-step instruction
• Challenge mode for real-time assessment
• Physical + digital interaction design
• Designed for quick demos and classrooms

• Snap Spectacles
• Lens Studio
• OpenAI API – used for AI-assisted molecule verification and feedback
• Supabase – backend for storing user data and session results
• JavaScript (Lens Studio scripting)
• 3D assets (molecules, UI elements)

SnapChem uses AI to assist with molecule verification:

1. Users build a molecule using a physical kit
2. The system captures the configuration
3. OpenAI helps analyze and verify the structure
4. Results and user progress are stored in Supabase
5. Feedback is returned to the user in AR

This allows SnapChem to provide intelligent, real-time feedback instead of static answers.

I worked as the UI Designer & XR Prototyper, focusing on:

• Designing the AR UI for Snap Spectacles
• Prototyping interaction flows for Learn & Challenge modes
• User experience design for physical + digital interaction
• Rapid iteration for hackathon demos and usability testing

My main responsibility was shaping how users see, interact with, and understand the SnapChem experience in wearable AR.

1. Clone the repo
2. Open the project in Lens Studio
3. Connect Snap Spectacles
4. Open the main scene
5. Press Preview / Deploy to Device

SnapChem is designed for:

• Chemistry students
• STEM educators
• XR learning research
• Hackathon demos
• Portfolio projects

• AI-based molecule recognition
• Multi-user shared sessions
• Cloud-based progress tracking
• More complex reaction simulations
• Voice-based tutoring assistant

(Add screenshots, GIFs, or video link here)

Built as a prototype for an XR hackathon focused on wearable AR, education, and interactive learning.

Isaac Wu
XR Designer & Developer
University of Oregon – OR Lab
LinkedIn: (https://www.linkedin.com/in/isaac-wu-735b0317a/)
Portfolio: (https://isaacwudesign.com/)