Safe Model Predictive Diffusion with Shielding
T. Kim, K. Majd, B. Hoxha, H. Okamoto, D. Panagou, G. Fainekos
IEEE International Conference on Robotics and Automation (ICRA), 2026.Generating safe, kinodynamically feasible, and optimal trajectories for complex robotic systems is a central challenge in robotics. This paper presents Safe Model Predictive Diffusion (Safe MPD), a training-free diffusion planner that unifies a model-based diffusion framework with a safety shield to generate trajectories that are both kinodynamically feasible and safe by construction. By enforcing feasibility and safety on all samples during the denoising process, our method avoids the common pitfalls of post-processing corrections, such as computational intractability and loss of feasibility. We validate our approach on challenging non-convex planning problems, including kinematic and acceleration-controlled tractor-trailer systems.
GPU-Accelerated Barrier-Rate MPPI Control for Tractor-Trailer Navigation and Collision Avoidance
K. Majd, H. Parwana, B. Hoxha, S. Hong, H. Okamoto, G. Fainekos
IEEE International Conference on Intelligent Transportation Systems (ITSC), 2025.Articulated vehicles such as tractor-trailers, yard trucks, and similar platforms must often reverse and maneuver in cluttered spaces where pedestrians are present. We present how Barrier-Rate guided Model Predictive Path Integral (BR-MPPI) control can solve navigation in such challenging environments. BR-MPPI embeds Control Barrier Function (CBF) constraints directly into the path-integral update. By steering the importance-sampling distribution toward collision-free, dynamically feasible trajectories, BR-MPPI enhances the exploration strength of MPPI and improves robustness of resulting trajectories. The method is evaluated in the high-fidelity CarMaker simulator on a 12m tractor-trailer tasked with reverse and forward parking in a parking lot.
Robot Behavior Adaptation in Physical Human-Robot Interactions Based on Learned Safety Preferences
K. Majd, R. Soltani Zarrin
IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), 2025.Robots that can physically interact with humans in a safe manner have the potential to revolutionize application domains like home assistance and nursing care. However, to become long-term companions, such robots must learn user-specific preferences and adapt their behaviors in real time. We propose a Constrained Partially Observable Markov Decision Process framework for modeling human safety preferences over representative variables like force, velocity, and proximity. These variables are modeled as adaptive linear constraints that are updated from human feedback during interaction.
Repairing Neural Networks for Safety in Robotic Systems using Predictive Models
K. Majd, G. Clark, G. Fainekos, H. Ben Amor
IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), 2024.This paper introduces a new method for safety-aware robot learning, focusing on repairing policies using predictive models. Our method combines behavioral cloning with neural network repair in a two-step supervised learning framework. It first learns a policy from expert demonstrations and then applies repair subject to predictive models to enforce safety constraints. The predictive models can encompass various aspects relevant to robot learning applications, such as proprioceptive states and collision likelihood. Our experimental results demonstrate that the learned policy successfully adheres to a predefined set of safety constraints on two applications: mobile robot navigation, and real-world lower-leg prostheses.
Open X-Embodiment: Robotic Learning Datasets and RT-X Models
Open X-Embodiment Collaboration (incl. K. Majd)
2nd Workshop on Language and Robot Learning: Language as Grounding (CoRL), 2023.Large, high-capacity models trained on diverse datasets have shown remarkable successes on efficiently tackling downstream applications. In domains from NLP to Computer Vision, this has led to a consolidation of pretrained models. Can such a consolidation happen in robotics? In this paper, we provide datasets in standardized data formats and models to explore this possibility in the context of robotic manipulation. We assemble a dataset from 22 different robots collected through a collaboration between 21 institutions, demonstrating 527 skills (160266 tasks). We show that a high-capacity model trained on this data, which we call RT-X, exhibits positive transfer and improves the capabilities of multiple robots by leveraging experience from other platforms.
Safety-aware Expansion for Neural Network Repair
K. Majd, G. Fainekos, H. Ben Amor
IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) - Workshop on Formal Methods Techniques in Robotics Systems, 2023.We present safety-aware expansion, an extension to neural network repair that expands the repaired region while preserving formal safety guarantees. The method iteratively grows the safe operating domain of a repaired policy network, ensuring that the corrected behaviors generalize beyond the initial repair set without violating safety constraints.
Certifiably-correct Control Policies for Safe Learning and Adaptation in Assistive Robotics
Best Paper 2nd Runner-upK. Majd, G. Clark, T. Khandait, S. Zhou, S. Sankaranarayanan, G. Fainekos, H. Ben Amor
Neural Information Processing Systems (NeurIPS) - Robot Learning Workshop, 2022.Guaranteeing safety in human-centric applications is critical in robot learning as the learned policies may demonstrate unsafe behaviors in formerly unseen scenarios. We present a framework to locally repair an erroneous policy network to satisfy a set of formal safety constraints using Mixed Integer Quadratic Programming (MIQP). Our MIQP formulation explicitly imposes the safety constraints to the learned policy while minimizing the original loss function. The policy network is then verified to be locally safe. We demonstrate the application of our framework to derive safe policies for a robotic lower-leg prosthesis.
Safe Robot Learning in Assistive Devices through Neural Network Repair
K. Majd, G. Clark, T. Khandait, S. Zhou, S. Sankaranarayanan, G. Fainekos, H. Ben Amor
Conference on Robot Learning (CoRL), 2022.Assistive robotic devices are a particularly promising field of application for neural networks (NN) due to the need for personalization and hard-to-model human-machine interaction dynamics. However, NN based estimators and controllers may produce potentially unsafe outputs over previously unseen data points. In this paper, we introduce an algorithm for updating NN control policies to satisfy a given set of formal safety constraints, while also optimizing the original loss function. Given a set of mixed-integer linear constraints, we define the NN repair problem as a Mixed Integer Quadratic Program (MIQP). In extensive experiments, we demonstrate the efficacy of our repair method in generating safe policies for a lower-leg prosthesis.
Joint Communication and Motion Planning for Cobots
M. Dadvar, K. Majd, E. Oikonomou, G. Fainekos, and S. Srivastava
IEEE International Conference on Robotics and Automation (ICRA), 2021.This paper presents a joint communication and motion planning framework that selects from an arbitrary input set of robot communication signals while computing robot motion plans, modeling a human co-worker's imperfect perception using a noisy sensor model and facilitating the specification of a variety of social/workplace compliance priorities with a flexible cost function.
Safe Navigation in Human Occupied Environments Using Sampling and Control Barrier Functions
K. Majd, S. Yaghoubi, T. Yamaguchi, B. Hoxha, D. Prokhorov, and G. Fainekos
IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), 2021.We extend time-based RRTs with Control Barrier Functions (CBFs) to generate safe motion plans in dynamic environments with many pedestrians, demonstrated on a high-fidelity model of the Toyota Human Support Robot navigating in narrow corridors.
Local Repair of Neural Networks Using Optimization
K. Majd, S. Zhou, S. Sankaranarayanan, G. Fainekos, H. Ben Amor
arXiv preprint, 2021.We propose a framework to repair a pre-trained feed-forward neural network to satisfy a set of properties, formulated as a Mixed Integer Quadratic Program (MIQP).
Risk-bounded Control using Stochastic Barrier Functions
S. Yaghoubi, K. Majd, G. Fainekos, T. Yamaguchi, D. Prokhorov, and B. Hoxha
IEEE Control Systems Letters.We design real-time controllers that bound the probability of failure in finite-time using stochastic control barrier functions, illustrated using a simulation of a lane-changing scenario in a highway with dense traffic.
A stable analytical solution method for car-like robot trajectory tracking and optimization
K. Majd, M. Razeghi-Jahromi, and A. Homaifar
IEEE/CAA Journal of Automatica Sinica.The car-like robot kinematic model trajectory tracking and control problem is revisited by exploring an optimal analytical solution which guarantees the global exponential stability of the tracking error.
Optimal Kinematic-based Trajectory Planning and Tracking Control of Autonomous Ground Vehicle Using the Variational Approach
K. Majd, M. Razeghi-Jahromi, and A. Homaifar
IEEE Intelligent Vehicles Symposium (IV), 2018.A novel kinematic-based optimal trajectory planning formulation for an autonomous vehicle, minimizing quadratic errors of position, velocity, and acceleration subject to nonlinear kinematic constraints.