Inspiration:

The pandemic of 2020 had halted the entire world for months. But with certain changes, life as we know it - continues. The education sector went through a significant change as well. All levels of education, like kindergarten, high-schools, colleges and universities, went completely online to inculcate no physical touch of any sort. But this system takes no consideration of people with severe eye problems who constantly need support of other peoples to even do the daily chores. Therefore, iLearn is an educational platform designed for low-visioned and blind people with android phones.

What it does: iLearn has two sections

1) iLearn-Virtual Assistance: After an one time signup and login with the help of a guide/helper, the following features and functionality can be independently accessed: ● Scan: This is one of the main features of iLearn. It recognises the images that are being scanned. Speaks them out aloud in your preferred language. If the screen is double-tapped, a more precise description of the image is provided. a) Objects: Understand textures, voices of birds and animals, smells, tastes- A way to involve all other senses to recognise objects. b) Text/Language: Text is recognised and spoken out aloud. The algorithm can comprehend a few different languages which include English, French, Chinese, Hindi, Bangla and Korean. c) Mathematics/Chemistry/Physics: The question will be read out aloud. In case of chemistry, the chemical equations will be read. Double-tapping in the above cases, the content will be read out again.Concerning with graphs, the meaning of the graph and on double-tap the equation of the graph will be spoken. d) Organising your money: 1) Denominations: The app recognises a number of currencies and speaks out the denomination. Afterwhich, the user can keep the different denomination money in different pockets of the wallet. 2) Bill (iLearn Pro):The app recognizes the amount in a receipt and speaks the amount so that users can easily identify and pay their bills. ● iLearn Pro: a) Volunteer Support: There would be a volunteer to guide in case of a problem. Volunteers could be called by double-pressing the volume down button. Camera settings need to be enabled and the on-call volunteer helps you identify and place objects, solve mathematical problems or questions related to any subject, medicines, lift buttons, doorknobs, scan barcodes etc. b) With the help of GPS, iLearn will get to know the location of the user and if the user wants to book a transport (uber), the user can let the app know through a short voice message. Google assistant will receive the message and immediately transfer it to the app. The app will book a transport and after the destination is reached, it will send alerts. Moreover, the volunteers can also help if they are called to aid the user with travelling. The volunteers get access to the location of the user automatically through GPS and can book transport for the user at any time of the day. Once, the destination is reached, the app will send alert messages to let the user know. 2) iLearn- Volunteer: The volunteers are individuals fluent in any language or languages. Once a sign up, via email they receive a basic language test to check their command on the language. With the successful completion of the language test, the account gets verified and ready to be signed in. iLearn Volunteer acts as a social-work platform to help out blind and low-visioned people. The volunteers earn social points with each call they answer and are assigned a rank on the leaderboard. a) The volunteers can indicate whether they are available to attend a call by easy tap. b) They can take calls from the comfort of their own homes. c) A basic knowledge of different subjects can be helpful too.

How We built it:

We have used Figma to design the Android application and Inkscape to create the concept art.

Challenges We ran into:

There are very less applications or websites similar to iLearn, so we needed to research more to implement our idea. Moreover, since it is an application for visually impaired people, we really needed to work a lot to figure out the appropriate colour contrast for the app.

Accomplishments that We're proud of:

We are proud of the idea of using Artificial Intelligence for image recognition and the concept of volunteer support for aiding visually impaired people to learn and be self-dependent. We are also proud of the flow of the prototype in our project iLearn.

What We learned:

We learnt about the everyday struggles of visually impaired people and how that prevents them from learning. Thus, we planned to create iLearn so that these visually impaired people can embark on a new journey to gain more knowledge and be self-dependent.

What's next for iLearn:

We are working to expand it to iOS. We'll surely partner with organisations and expand our project by various partnerships. We will find a target market and segment and implement market strategies accordingly to make iLearn more popular.

Built With

Share this project:

Updates