EasyPoint

• 

  DOM Density Map

Inspiration

People who are unable to use the mouse due to conditions.

What it does

It allows the user to easily interface with mouse on chrome websites

How I built it

OpenCV connected with a websocket to Chrome Extension. The Chrome Extension provides a guide for the cursor based on the density of the DOM elements on the web page. OpenCV tracks nose position relative to center of the screen to move the cursor.

Challenges I ran into

Position control for cursor is challenging with the realization of absolute vs relative mouse position. Packaging with mouse control and OpenCV. Chrome Extension websocket connection is limited on background tasks. Communication between content-script and background script.

Accomplishments that I'm proud of

Allows the user to interface easily with websites.

What I learned

OpenCV and Chrome Extension.

What's next for EasyPoint

Better movement control based on Deeplearning with TensorFlow.js

Built With

• chrome
• extension
• html
• javascript
• opencv
• python
• websocket