Chat GPT 4 AR

Inspiration

This project was inspired to improve and facilitate the life of a student of the people who use the Chatgpt tool, which means that it was thought about how it would be the fastest way to be able to send tasks and accept chatgpt tasks. It was also inspired by people who have disabilities and cannot perform certain tasks with ease.

What it does

This project is in charge of receiving data through sounds and sending it to chatgpt in a written way and in turn receiving the information in the same way, which means that the result will also arrive in a written and auditory way.

How we built it

The task was divided into parts, the steps that have to do with the virtual reality part were done with unity and flask, the first thing that was done was to make a configuration to obtain the voice input then another code for the client-server then we proceeded to create a code that is responsible for translating the auditory information in a textual way in a virtual text box that is a virtual box where all the information appears in text, with the API we call chatgpt and we return the response to back to the oculus and display the text response, which is being hosted in google cloud, after all the steps carried out we obtained as a result that the program received instructions aurally and automatically the program wrote all the instructions that were specified are received in a text box virtual text in written form.

Challenges we ran into

Connecting google cloud to the API was a nightmare because we had to set up containers that we were very unfamiliar with.
Using wit.ai with the oculus was a steep learning curve
Passthrough also became a nightmare at one point

Accomplishments that we're proud of

The first act that we are proud of is trying our project and reaching the established goal no matter how difficult it looked, we are proud of all the knowledge we gained while trying to carry out this project and the way we worked as a team .

What we learned

In this event we learned to use some tools that are used in programming and some tools that are elementary to save information and send it to our program as goole cloud, and we all learned a little more about how to use programming platforms as it usually happens when practicing In this case they went with unity, flask, chatgpt.

What's next for Team16

The next thing in our team is to apply everything learned and all the experiences already had in our next meetings in events like this and clearly learn more to be able to create future brilliant projects that help the community like the project created in this event.