/astrobeecd

[IAC 2023, AA 2024] This repository contains the code used in our paper, "AstrobeeCD: Change Detection in Microgravity with Free-Flying Robots." This method is useful for detecting 3D scene changes given a 3D model, a sequence of images, and a sequence of camera poses.

Primary LanguagePython

AstrobeeCD: Change Detection in Microgravity with Free-Flying Robots

Published in Acta Astronautica (ScienceDirect)

This repository contains the code for AstrobeeCD, a system for 3D scene change detection toward near-real-time environmental awareness of space outposts using the Astrobee free-flying robot in microgravity. A set of image and depth data from one time step is used to reconstruct a 3D model of the environment. The 3D model is used as the basis for comparison for free-flyer environment surveys at future time steps, where an image-based change detection algorithm identifies inconsistencies against the 3D model. Change detection is demonstrated using real image and pose data collected by an Astrobee robot in space on the International Space Station and on earth in the NASA Ames Research Center Granite Lab.

Preparing Data From Astrobee

Follow the data processing instructions.

Using Prepared Data

Follow the using FastCD instructions.

Learn More

The supplementary video describes the Astrobee platform, the change detection framework, and visualizes results.

supplementary video

BibTex

@ARTICLE{dinkel2024astrobeecd,
    author = {Dinkel, Holly and Di, Julia and Santos, Jamie and Albee, Keenan and Borges, Paulo V.K. and Gouveia Moreira, Marina and Soussan, Ryan and Alexandrov, Oleg and Coltin, Brian and Smith, Trey},
    title = {AstrobeeCD: Change Detection in Microgravity with Free-Flying Robots},
    journal= {Acta Astronautica},
    volume = {223},
    pages = {98-107},
    year = {2024},
    issn = {0094-5765},
    doi = {https://doi.org/10.1016/j.actaastro.2024.06.037},
}

References

[1] NASA, "Astrobee Robot Software," (2023). [code]

[2] E. Palazzolo and C. Stachniss, "Fast Image-Based Geometric Change Detection Given a 3D Model," in IEEE Int. Conf. Robot. Autom. (ICRA), 2018, pp. 6308–6315. doi: 10.1109/ICRA.2018. 8461019 [paper] [code]