Guiding Rover: An AI-Powered Mobility Solution for the Visually Impaired. Hack the North 2023 Project
- Clone the repository
git clone [email protected]:htn-2023/Guide-Rover.git
cd Guide-Rover
- Create virtual environment
virtualenv venv
source venv/bin/activate
- Install dependencies and set configs
bash setup.sh
- Enter your OpenAI/Cohere API key in
communication/config-sample.pyand rename it toconfig.py
# config.py
OPEN_AI_API = '...'
- RoboMaster set-up
Go to https://github.com/dji-sdk/robomaster-sdk
Download the repo and run the executable file named “VisualCppRedist_AIO_20200707.exe”.
Important! Please keep the executable running in the background while using the RoboMaster.
Go to the (physical) RoboMaster. Turn on the robot by pressing and holding the power button.
Once the RoboMaster is online, ensure the connection method is in “direct connection mode”.
Lastly, connect to the Robot through WiFi connection.
The Wifi name is: “RMEP-21abe4” and the password is “12341234”
- Run the communication models
python3 communication/recorder.py
python3 communication/transcriber.py
python3 communication/decision.py
The folder vision is the main folder for the computer vision model (YOLO). The folder communication is the main folder for the connection between wisper voice model and gpt.