🚀 Your Offline-First AI Operating System - Think JARVIS, But Real
RAGS AI (Raghav's AI General System) is a voice-controlled AI assistant that works 100% offline with features like Mac automation, camera vision, web search, and intelligent memory. Think JARVIS from Iron Man, but real and running on your Mac.
| Feature | Status |
|---|---|
| Core AI System | ✅ 100% |
| Voice Control | ✅ 100% |
| Mac Automation | ✅ 100% |
| Camera Vision | ✅ 100% |
| Desktop UI | ✅ 100% |
| Memory System | ✅ 100% |
| Smart Features | ✅ 100% |
| Social Media | |
| Cross-Device Sync | ❌ 0% |
- Always-On Wake Word - Say "Hey RAGS" anytime
- Offline Speech-to-Text - Whisper.cpp (no internet needed)
- Natural Voice - Edge-TTS with Indian accent (Rishi)
- Continuous Listening - Hindi/English/Hinglish support
- Interim Transcription - See text while speaking
- Local AI - Ollama (llama3.2:3b, llava, phi3)
- Context-Aware - Knows what you're doing
- Emotional Responses - Personality engine
- Web Search - Real-time DuckDuckGo integration
- Memory System - Remembers everything locally
- File Operations - Open, create, move files/folders
- App Control - Launch and manage applications
- System Control - Volume, screenshots, notifications
- Browser Automation - Scroll, click, navigate
- AppleScript Integration - Full Mac control
- LLaVA Integration - See and understand images
- Object Recognition - Identify objects in real-time
- Scene Description - Describe what's visible
- Visual Q&A - Answer questions about images
- 3D NeoEyes - Animated AI face with emotions
- Voice Visualizer - Real-time audio visualization
- Command Palette - Quick actions (⌘+K)
- Glassmorphism UI - Modern, beautiful interface
- Multiple Panels - Notes, Reminders, Browser Control, System Monitor
┌─────────────────────────────────────────────────────────────┐
│ Desktop: Tauri (Rust + TypeScript) │
├─────────────────────────────────────────────────────────────┤
│ Frontend: React + Three.js │
├─────────────────────────────────────────────────────────────┤
│ Styling: Tailwind CSS + Framer Motion │
├─────────────────────────────────────────────────────────────┤
│ State: Zustand │
├─────────────────────────────────────────────────────────────┤
│ Backend: Node.js + TypeScript + Express │
├─────────────────────────────────────────────────────────────┤
│ AI: Ollama (Local LLM) │
├─────────────────────────────────────────────────────────────┤
│ STT: Whisper.cpp (Offline) │
├─────────────────────────────────────────────────────────────┤
│ TTS: Edge-TTS (Indian Accent) │
├─────────────────────────────────────────────────────────────┤
│ Wake Word: Picovoice Porcupine │
├─────────────────────────────────────────────────────────────┤
│ Vision: MediaPipe + LLaVA │
├─────────────────────────────────────────────────────────────┤
│ Mobile: React Native + Expo │
└─────────────────────────────────────────────────────────────┘
- macOS 12+ (Mac only)
- Node.js 18+ installed
- Rust toolchain installed
- Ollama installed
# 1. Install Ollama
brew install ollama
ollama serve
# Pull AI models
ollama pull llama3.2:3b
ollama pull llava:latest
# 2. Clone repository
git clone https://github.com/raghavshahhh/RAGS-AI-APP.git
cd RAGS-AI-APP
# 3. Install Backend
cd backend
npm install
cp .env.example .env
# Edit .env with your API keys
# 4. Install Desktop
cd ../desktop
npm install
# 5. Run (2 terminals)
# Terminal 1: Backend
cd backend && npm run dev
# Terminal 2: Desktop
cd desktop && npm run devSay "Hey RAGS" then:
| Command | Action |
|---|---|
| "Search Python on web" | Web search |
| "Remember I like coding" | Save to memory |
| "What do you remember?" | Recall memories |
| "Remind me to call John at 5 PM" | Set reminder |
| "Volume up" | System control |
| "Take a screenshot" | Capture screen |
| "Open folder Desktop" | File operations |
| "What is this?" | Camera vision |
| "Open YouTube" | Browser automation |
RAGS-AI-APP/
├── backend/ # Node.js/TypeScript backend
│ ├── src/
│ │ ├── services/ # 70+ core services
│ │ ├── routes/ # API endpoints
│ │ └── config/ # Configuration
│ └── package.json
├── desktop/ # Tauri desktop app
│ ├── src/
│ │ ├── components/ # 30+ React components
│ │ ├── services/ # API integration
│ │ └── store/ # State management
│ └── src-tauri/ # Rust backend
├── mobile/ # React Native mobile app
└── docs/ # Documentation
- Fork the repository
- Create feature branch:
git checkout -b feature/amazing - Commit changes:
git commit -m 'feat: add amazing feature' - Push to branch:
git push origin feature/amazing - Open Pull Request
Made with ❤️ by Raghav Shah
© 2024-2026 All Rights Reserved