My research centers on perception and sensor fusion for autonomous systems,
risk-sensitive locomotion and navigation in unstructured environments, embodied
AI for assistive robots, and collaborative multi-agent systems.
Risk-sensitive locomotion and navigation
In preparation
This work uses distributional reinforcement learning, which models the whole distribution of outcomes rather than just the expected return, to learn navigation and locomotion policies for quadruped agents that account for risk directly.
Spot training in Isaac Lab, progressing through a terrain curriculum from stair pyramids to rough ground.
A quadruped sampling terrain around it in simulation while training with distributional reinforcement learning.
Embodied scene understanding
A robot tidying a home has to answer a question that object recognition alone cannot: where does this object belong? A book could reasonably go on a shelf, a desk, or a nightstand, and what breaks the tie is the inhabitant's routine, which is almost never stated outright. ECHO is a large synthetic dataset for studying this. It pairs dense RGB-D scans of indoor scenes with recordings of an embodied human carrying everyday objects to where they belong, plus a one-sentence description of the routine that implies the destination, and poses contextual object placement as a benchmark task.
Papers
In review2026
ECHO: Embodied Camera Observations of Human Object Carrying
Xuefei Sun, Lorin Achey, Kali Hamilton, Alberto Speranzon, Gregory Grebe, Yonatan Bisk, Christoffer Heckman
3,805 human-annotated object-carrying episodes across 159 floors of 115 HM3D scenes. No single input modality is enough to predict where an object belongs.
Robots normally plan only over geometry they have directly measured, so they stall when they turn a corner or enter a new room. This thread trains diffusion models to predict the geometry that has not been seen yet, fuses those predictions into a live occupancy map without ever overwriting observed space, and uses the result to keep exploring instead of pausing.
Watch
Generative occupancy mapping running live on a Spot robot.
2:41
Papers
IROS2024
SceneSense: Diffusion Models for 3D Occupancy Synthesis from Partial Observation
Multi-agent coordination under communication constraints
When a team of robots explores somewhere the radio does not reach, the hard problem stops being perception and becomes deciding where and when to transmit. This work plans transmission locations from signal strength and payload size, so agents share what they have found without backtracking to meet.
Watch
A sixty-second summary of the multi-agent exploration work.
1:00
Papers
In review2026
RF-Modulated Adaptive Communication Improves Multi-Agent Robotic Exploration
Lorin Achey, Breanne Crockett, Christoffer Heckman, Bradley Hayes
Across 480+ simulated cave environments, cut distance travelled by up to 58% and exploration time by up to 52%.