facebookresearch/home-robot

Split goto(crop) into 2 functions: crop->bbox & goto_bbox

pmcvay opened this issue ยท 2 comments

๐Ÿš€ Feature

Can we split the goto(crop) functionality of the current VLM into two functions

  1. Get bounding box of the crop
  2. Goto the bounding box

Motivation

The new VLM's being trained by cortex will use pointclouds and will output bboxes instead of crops so will end up only using the second function

@cpaxton

Implemented here

in #455

2d (plannable) mask from bounds

 mask = self.voxel_map.mask_from_bounds(instance.bounds)