Hands Hear is a ASL to text converter using the Leap Motion. At the moment Hands Hear is a set of python scripts that interpret data streaming from the Leap, improve the signing model and tests the model correctness.
To get started make sure you have the Leap Motion setup on your system and download the Leap Motion SDK. Our entire project is based on Python 2.7 and requires a few python libraries as dependencies. The python dependencies are:
- scikit-learn
- numpy
- matplotlib
Clone the git repository and checkout the release-0.1 branch to use the more stable version of HandsHear.
$ git clone git://github.com/mnaka/HandsHear.git
$ cd HandsHear
$ git checkout release-0.1Download the Leap SDK and drop all of the libraries shipped with it into the lib folder in the repository before you start. Once that libraries are in the lib folder and you've got the python dependencies you're ready to start
##The scripts
All scripts reside in the src folder. Open a terminal there to begin.
Stream.py interprets signs from the Leap in real-time and prints the results to the standard output. To run:
$ python stream.pylearn.py adds to the model by machine learning from the learning database.
>>>python learn.py