Mars Rover Ops at NASA JPL

Main view of the web-based OnSight
Main view of web-based OnSight. Normally you would have a 3D environment (like Google Earth) with the rover at the center. This image shows a placeholder picture of Mars taken by a rover.

OnSight was a tool used in daily operations for the Perseverance rover at NASA JPL, where I worked on a lean ~12-person team in the Ops Lab.

OnSight was a partnership between JPL’s Ops Lab and Microsoft that brought a 1:1 recreation of the Martian surface to the HoloLens. Using daily imagery from satellites and rovers, the environment updated each day so scientists were always working with the latest view of Mars.

OnSight UI responding to a selected rover instrument
This picture shows the dynamic UI responding to the selection of a rover instrument.

This mattered because rover planners are usually scientists, often geologists. Before OnSight, they had to interpret still images like panoramas, which distort the terrain through perspective warping and other artifacts. Being able to walk around Mars the way they would a field site on Earth made planning rover operations far more intuitive.

The catch with the HoloLens was that it was a bit unwieldy for the kind of daily use JPL needed for Perseverance. My task was to take an early web app prototype of OnSight and refresh it, improving the overall UX.

OnSight UI responding to a selected rover instrument
This picture shows the dynamic UI responding to the selection of a rover instrument.