Ruizhao Zhu

I am an applied scientist at AWS working on LLM applications. I obtained my PhD at Boston University, advised by Prof. Venkatesh Saligrama. I also work with Prof. Eshed Ohn-Bar.

My research is mainly about efficient training for deep learning algorithms and its application on computer vision and autonomous driving. Prior to BU, I got my Master's degree at Brown University working with Prof. Benjamin Kimia on vision navigation.

I was fortunate to intern with the Computer Vision team at AWS with Yuting Zhang, Qi Dong and Zhuowen Tu. I also interned at Dataminr, Bosch Research and Duke University.

Ruizhao Zhu

Industry

I am currently an Applied Scientist at Amazon, where I work on Amazon Quick Suite. My work focuses on building pipelines for code generation agent and developing its corresponding chat system. These efforts span a range of LLM application techniques aimed at making AI-assisted automation more effective and intuitive.

Selected Research Papers

Most of publications are from my PhD works. Prior LLM era, I was interested in efficient machine learning and its applications in computer vision and autonomous driving.

Blind Riders
Navigating the Challenges of Remotely Supporting Blind Riders in Ridesharing
Eshed Ohn-Bar, Ruizhao Zhu, Jimuyang Zhang, Lu Zhang
International Journal of Human-Computer Studies, 2025

We study how remote sighted guides can assist blind ridesharing users with vehicle identification, entry, and exit in complex urban settings, addressing gaps left by driver-dependent support and emerging autonomous ride scenarios.

DCL
Deep Companion Learning: Enhancing Generalization Through Historical Consistency
Ruizhao Zhu, Venkatesh Saligrama
ECCV, 2024

Deep Companion Learning (DCL) enhances generalization on training deep neural networks in many settings.

AnyD
Learning to Drive Anywhere
Ruizhao Zhu, Peng Huang, Eshed Ohn-Bar, Venkatesh Saligrama
CoRL, 2023

AnyD learns a unified driving model across the world, solving socially heterogeneous cases like left-hand driving and Pittsburgh left.

DOP
Fine-grained Few-shot Recognition by Deep Object Parsing
Ruizhao Zhu, Pengkai Zhu, Samarth Mishra, Venkatesh Saligrama
CVPRW, 2022. BMVC, 2023.

DOP can automatically parse an object into semantically salient parts. Fine-grained few-shot learning achieves SOTA performance utilizing such representations.

SelfD
SelfD: Self-Learning Large-Scale Driving Policies From the Web
Jimuyang Zhang, Ruizhao Zhu, Eshed Ohn-Bar
CVPR, 2022

SelfD is a new semi-supervised framework learning scalable driving by utilizing large amounts of online monocular images.

MOML
Memory Efficient Online Meta Learning
Durmus Alp Emre Acar, Ruizhao Zhu, Venkatesh Saligrama
ICML, 2021

MOML debiases model updates along training. It outperforms baselines on both seen and unseen tasks without saving historical tasks.

PFL
Debiasing Model Updates for Improving Personalized Federated Training
Durmus Alp Emre Acar, Yue Zhao, Ruizhao Zhu, Ramon Matas Navarro, Matthew Mattina, Paul Whatmough, Venkatesh Saligrama
ICML, 2021

A new problem setting for personalized federated learning.

LDVA
Low Dimensional Visual Attributes: An Interpretable Image Encoding
Pengkai Zhu, Ruizhao Zhu, Samarth Mishra, Venkatesh Saligrama
ICPR workshop, 2021

An interpretable object part parsing representation.

Teaching

Professional Activity

Internship at AWS AI (Summer 2023), Dataminr (2022), Bosch Research (2021), SF Tech (2018), Duke University (2016).

Exchange Student at KAIST (Fall 2015, Spring 2016), UCLA (Summer 2014).

Reviewer for CVPR, ECCV, BMVC, ICLR, ICML, NeurIPS, IJCAI, AISTATS Machine Intelligence Research.

Volunteer for CoRL2023 ICML2021.