A hands-free accessibility interface that leverages eye gaze, hand gestures, and voice commands to empower users with upper-body mobility challenges.

git clone https://github.com/MatthewTran22/DAVISHACKS.git
cd DAVISHACKS

macOS/Linux

python3 -m venv .venv
source .venv/bin/activate

Windows (PowerShell)

python -m venv .venv
.\.venv\Scripts\Activate

pip install --upgrade pip
pip install -r requirements.txt

Steven.ai requires the following environment variables:

• ELEVENLABS_KEY – Your ElevenLabs API key for text-to-speech synthesis.
• SOUND_THRESHOLD – An integer (e.g., 500) defining the threshold for audio-based triggers (based on your mic).
• GEMINI_API_KEY – Your Google Gemini API key for intent-based command execution.

You can provide these via a .env file at the project root or export them in your shell.

ELEVENLABS_KEY=your_elevenlabs_api_key_here
SOUND_THRESHOLD=0.5
GEMINI_API_KEY=your_gemini_api_key_here

macOS/Linux

export ELEVENLABS_KEY="your_elevenlabs_api_key_here"
export SOUND_THRESHOLD="0.5"
export GEMINI_API_KEY="your_gemini_api_key_here"

Windows (PowerShell)

$env:ELEVENLABS_KEY = "your_elevenlabs_api_key_here"
$env:SOUND_THRESHOLD = "0.5"
$env:GEMINI_API_KEY = "your_gemini_api_key_here"

Run the prototype:

python main_qt.py

This will launch the GUI and load your configuration. Make sure your virtual environment is active so the environment variables are accessible.

• .env not loading: Ensure python-dotenv is installed and your file is named .env in the project root.
• Env vars missing: Verify variable names and that you’re in the activated virtual environment.
• Dependency errors: Re-run pip install -r requirements.txt or update pip.

Ready to explore hands-free computing? Enjoy Steven.ai!