In the global gaming sector, 15%, or 300 million, of the nearly 1.9 billion players are deaf or hard of hearing (HOH). However, a crucial feature of an immersive gaming experience is the audio cue, such as a ruffling footstep sound of your enemy creeping on you or a pin-drop sound of a grenade outside of your display frame, and these cues influence a player’s game strategies and performances. VisQ is an innovative mobile app revolutionizing this sector of gaming accessibility for the deaf and HOH. It visualizes audio cues into simple, customizable, and real-time indicators, generated from our audio-to-directional-shapes ML model. Its minimalistic interface prioritizes the simple assistance just enough for the gamer’s peripherals during gameplay. By bridging the accessibility gap with audio cues, VisQ strives for inclusive gaming and ensures that every audio-impaired player can fully engage and immerse in their gaming adventures.
An audio-impaired gamer can download VisQ onto their mobile devices and sign in. The user will navigate through a simple sign-in screen, followed by screens that display their VisQ presets, settings, and option to start the game-mode. When running the game-mode, the app will pick up and analyze the sound of the gameplay and display real-time audio-converted visual cues, or VisQs, based on the user’s selections of the preset that determines what sound each visual cue corresponds to.
Our project is under the Innovation Track (Overlays for: Best Beginner Hack, Best Healthcare Hack). VisQ fits the Tech for Good theme as it empowers the audio-impaired community in the sector of gaming experience, making it a more accessible and inclusive environment, benefiting both the developers and users. It is intentionally ethical because it aims to enhance the gaming experience for audio-impaired gamers. We used Figma and Jitter for full mockup.
Built With
- figma
- jitter
Log in or sign up for Devpost to join the conversation.