The SAM3D-VPCC project utilizes Meta's Segment Anything Model (SAM) to generate 2D projections of 3D point clouds, which can be used by VPCC during point cloud compression.
In doing so, we can hide visual artifacts created during compression by having them appear in more natural boundaries between segments in the point cloud.
To run the example notebook, sam3d, you will need to install segment_anything alongside its dependencies in your local environment, following the official installation instructions in SAM.
The models used by SAM can be downloaded from the official SAM repository and placed in the models directory.
The point cloud data used, longdress, is provided by 8i Labs at the JPEG Pleno Database.