Holo Asistant

Enhance the scientific and technological image of the company. Let science fiction fans have their own AI assistants.

Comment

Inspiration

AI assistants in movies.All science fiction fans including myself want a holographic assistant.

What it does

Users can create their own guide plan to explain their company/produc/mind/animal. Only LAN environment is needed to update voice files or conduct multi person interaction.

How we built it

First, guess what function he or she should have according to his or her fantasy of holographic assistant. Of course, there will be many ideas. Then consider which of these ideas can be realized by current technology. Then consider what can be achieved in a month. Finally, consider which functions are universal. Determine the scheme and technical route. Purchase the required models, animation and sound resources on the AssetStore. Develop the framework and functions.Design Holo UI. Test and fix serious bugs.

Challenges we ran into

Compared with MRTK2.X, most APIs have changed There are some bugs in MRTK3. Many times, it is difficult for us to check which problems are caused by mrtk3 and which are caused by our own code. For example, speech cannot be recognized, or speech recognaize delay very serious. The most important challenge is that the time is too short. Although we also know that this is the same for all contestants, it is a pity that some functions we want to achieve, such as sceneunderstanding, are too late to join.

Accomplishments that we're proud of

Our multi person interaction framework has been successfully used in this project，the basic functions of Holo assitant were realized before the deadline of the competition.

What we learned

New architecture system in Mrtk3 ，and how to manage projects in a modular way.

What's next for Holo Asistant

Make a complete product.

  1. Optimize performance and fix bugs.
  2. Users can change the display model, video and character model by themselves.
  3. Add the sceneundstanding function, so that the holographic assistant can make some personalized judgments according to the scene.
  4. Distinguish between business assistants and life assistants.

Built With

Share this project:

Updates