Milan Ganai

I am a first-year PhD student in the Computer Science Department at Stanford University. I received my Bachelor of Science (2020-2023) and Master of Science (2023-2024) in Computer Science at UC San Diego, where I was advised by Professor Sicun Gao and collaborated with Professor Sylvia Herbert's Safe Autonomous Systems Lab. My interests are in Robotics, Control, and AI.

Contact: mganai at stanford dot edu

Google Scholar  |  LinkedIn

A journal publication surveying the recent literature on scalable Hamilton-Jacobi reachability estimation in reinforcement learning to provide a foundational basis for research into reliability in high-dimensional systems. We review how this technique has been employed to solve challenging tasks like those with dynamic obstacles and lidar-based or RGB image-based observations.

Hamilton-Jacobi reachability estimation for model-free safe RL in deterministic and stochastic environments with safety guarantees and convergence analysis. Tasks include lidar-based observations, dynamic obstacles, and multiple hard and soft constraints.

Learning Lyapunov-like models offline from observation-only, expert data to solve stabilization control tasks online. Deployed in hardware for robustness testing.

Reinforcement Learning to determine XLA compiler optimization pass ordering to reduce GPT-2, BERT, and ResNet graph sizes.

Building boosted decision trees to classify reconstructed particle tracks as merged in high density particle physics environments.

Original code template