NVlabs/FoundationPose

Running model-free method in Real-time

misrolox opened this issue · 0 comments

Hello, is it possible to run the model-free method in real-time?

My goal is to do pose estimation of a target object in real-time through a video stream using a realsense camera and provide the mask of the first frame through other means (sam, ...).

I noticed all the demos use a pre-recorded sequence of images. Is it possible to provide the model with an image stream from the camera in real-time?

Also if model-free is not possible, would using bundlesdf first to get a mesh and then running model-based with an image stream from the camera in real-time work?

Thank you.