Eyes2Ears

Experience the world through sound with Eyes2Ears. We use AI to provide real-time audio and text descriptions of your surroundings, enhancing everyday experiences for the visually impaired.

Comment

Eyes2Ears

Eyes2Ears is a mobile application designed to assist visually impaired individuals by utilizing advanced AI technologies. The app allows users to capture images using their smartphone camera, which are then processed in real-time to provide audio descriptions of their surroundings. This innovative solution addresses various visual impairments, including color blindness, limited mobility, difficulties in reading or understanding emotions, and extreme near or far-sightedness. Eyes2Ears aims to enhance the quality of life for visually impaired users by providing intuitive and immediate audio feedback.

Features

Real-Time Image Processing

  • Captures images using the smartphone camera.
  • Processes images in real-time to provide immediate feedback.
  • Uses GPT-4's image recognition capabilities for accurate descriptions.
  • Provides audio descriptions of the surroundings based on captured images.

Navigation Assistance

  • Offers guidance and navigation assistance based on the user's surroundings.
  • Supports swipe gestures for easy navigation and control of the app.

Personalized User Experience

  • Enables users to enter their name for a personalized experience.
  • Maintains a history of past scans for users to review later.

Under Development Features

  • Working towards full accessibility for completely blind individuals.
  • Allows users to interact with the app using voice commands for hands-free operation.

Installation

  1. Clone the repository
  2. Install dependencies bash npm i

  3. Create a .env file in the root of your project and add your OpenAI API key and Firebase configuration in the following format:

    OPENAPI_KEY=your_openai_api_key

REACT_APP_FIREBASE_API_KEY=your_firebase_api_key
REACT_APP_FIREBASE_AUTH_DOMAIN=your_firebase_auth_domain
REACT_APP_FIREBASE_PROJECT_ID=your_firebase_project_id
REACT_APP_FIREBASE_STORAGE_BUCKET=your_firebase_storage_bucket
REACT_APP_FIREBASE_MESSAGING_SENDER_ID=your_firebase_messaging_sender_id
REACT_APP_FIREBASE_APP_ID=your_firebase_app_id

  4. Start the project

    npx expo start

Built With

Share this project:

Updates