/DINO_SAM_Zoe

example of piping grounding-segment-anything with ZoeDepth estimation

Primary LanguageJupyter NotebookApache License 2.0Apache-2.0

DINO_SAM_Zoe

example of piping grounding-segment-anything with ZoeDepth estimation Open In Colab colab example use the original repose from https://github.com/IDEA-Research/Grounded-Segment-Anything/tree/main

setup

in your venv

python -m pip install -e .

create folder 'testinput' and 'weights', adding image and models(groundingdino_swint_ogc.pth, sam_vit_h_4b8939.pth,ZoeD_M12NK.pt) then the running the 'segdepth.py' shall showing the masked segmentation with annoattion of confidence level, name and depth( depth in this example is calculated by average of the depth map pixels in the masked region)

Preliminary Works

Preliminary Works

Title Intro Description Links
Segment-Anything Segment-Anything A strong foundation model aims to segment everything in an image, which needs prompts (as boxes/points/text) to generate masks Github
Page
Demo
Grounding DINO Grounding DINO A strong zero-shot detector which is capable of generating high-quality boxes and labels with free-form text. Github
Demo
ZoeDepth ZoeDepth ZoeDepth: Zero-shot Transfer by Combining Relative and Metric Depth Demo
MiDas MiDas Towards Robust Monocular Depth Estimation: Mixing Datasets for Zero-shot Cross-dataset Transfer -