PayVo

Inspiration

Money transfers shouldn’t be hard. Yet today, sending or requesting funds means typing, passwords, and multiple app screens. We wanted something faster and easier and could additionally be aimed for people who need accessible tools like the elderly or visually impaired.

What it does

PayVo lets users send, request, and split money with simple voice commands with their contact list. As long as all members of a transaction have PayVo, they are able to effectively and conveniently make monetary payments. After a voice is registered, the program will be able to identity if the speaking voice matches the registered voice through speech recognition. Voice-activated payments also eliminate the need for complex screen navigation. Transactions are effortless for users with physical and motor disabilities.

How we built it

We utilized SwiftUI for the mobile app interface which we constructed on the XCode platform on Mac. In order to develop a hybrid approach to speech recognition, we implemented Google Cloud Speech-to-Text & Web Speech API which, additionally, provided speech recognition capabilities within a web browser. The app executes JavaScript code in the hidden WKWebView to access this API which provided an alternative method for voice recognition alongside Apple's native Speech API. The Capital One Nessie API also was utilized as it acted as a safe and simulated banking environment. Besides these functionalities, we used RESTful endpoints & JSON for transactions and data storage.

Challenges we ran into

We faced difficulty integrating voice commands smoothly with transaction flows. Ultimately, we found it was essential to provide stricter tolerance thresholds for better security. Additionally, working around API limits in a mock banking setup proved to be a challenge because we were limited to “dummy” money and pre-set data.

Accomplishments that we're proud of

We are proud that we built a fully working prototype of a banking app with revolutionary potential. Furthermore, we are proud to have ultimately demonstrated seamless voice-to-transaction flows and are glad to have designed an application with potential to spread accessibility, ensuring usability for a wider audience.

What we learned

One of the biggest takeaways from building PayVo was understanding that accessibility requires thoughtful design, not just features. Accessibility has to be built into the foundation of the product. From the way commands are phrased, to the simplicity of the interface, every design choice impacts how inclusive and user-friendly the app really is. We also saw firsthand how combining APIs for voice recognition and finance can open the door to entirely new user experiences. By merging speech processing with banking functionality, we created a system where financial tasks feel more natural and conversational. This blending of technologies gave us insight into how fintech can evolve beyond screens and buttons.

What's next for PayVo

Looking ahead, we plan to add personalized financial insights powered by data analysis. By tracking spending habits and transaction history, PayVo could deliver proactive tips and smarter money management guidance, turning it into more than just a payments tool. We also aim to strengthen security through voice-based authentication. By combining voice recognition with biometric and multi-factor verification, we can make PayVo both convenient and highly secure, which is critical for financial applications. Finally, our vision is to expand PayVo beyond the phone. Integrating with smart speakers, wearables, and even in-car systems would make voice banking accessible wherever users are. This step moves PayVo from being an app into becoming a true personal finance assistant available anytime, anywhere.