XetHub hosted fork of EfficientSAM using the GitHub plugin.
EfficientSAM: Leveraged Masked Image Pretraining for Efficient Segment Anything
[Dec.5 2023] We release the torchscript version of EfficientSAM and share the Google colab notebook.
Online demo and examples can be found in the project page.
![Screenshot 2023-12-06 at 1 16 13 PM](https://private-user-images.githubusercontent.com/801507/288508772-6a4586e6-94cc-4eea-94e7-e78a6f57dcfe.png?jwt=eyJhbGciOiJIUzI1NiIsInR5cCI6IkpXVCJ9.eyJpc3MiOiJnaXRodWIuY29tIiwiYXVkIjoicmF3LmdpdGh1YnVzZXJjb250ZW50LmNvbSIsImtleSI6ImtleTUiLCJleHAiOjE3MjE3Mzg1NjYsIm5iZiI6MTcyMTczODI2NiwicGF0aCI6Ii84MDE1MDcvMjg4NTA4NzcyLTZhNDU4NmU2LTk0Y2MtNGVlYS05NGU3LWU3OGE2ZjU3ZGNmZS5wbmc_WC1BbXotQWxnb3JpdGhtPUFXUzQtSE1BQy1TSEEyNTYmWC1BbXotQ3JlZGVudGlhbD1BS0lBVkNPRFlMU0E1M1BRSzRaQSUyRjIwMjQwNzIzJTJGdXMtZWFzdC0xJTJGczMlMkZhd3M0X3JlcXVlc3QmWC1BbXotRGF0ZT0yMDI0MDcyM1QxMjM3NDZaJlgtQW16LUV4cGlyZXM9MzAwJlgtQW16LVNpZ25hdHVyZT1hNjIyYWMwZjQ4YmVlZTIzZDdjNzQ5NDAxNTY2MjRmYjFmZDk0OTY1NmZkM2NiZmE3MDZiNWJjYmU5MWEyY2I1JlgtQW16LVNpZ25lZEhlYWRlcnM9aG9zdCZhY3Rvcl9pZD0wJmtleV9pZD0wJnJlcG9faWQ9MCJ9.icgkI6tSo2EbtG77rLcOGZybuKe714BC_VvhUIevL9c)
The model files live in this repo itself:
- EfficientSAM-S:models/efficientsam_s_gpu.jit
- EfficientSAM-Ti: models/efficientsam_ti_gpu.jit
![Screenshot 2023-12-06 at 1 19 26 PM](https://private-user-images.githubusercontent.com/801507/288508791-72374016-2b6f-4617-881a-9b7b45059a35.png?jwt=eyJhbGciOiJIUzI1NiIsInR5cCI6IkpXVCJ9.eyJpc3MiOiJnaXRodWIuY29tIiwiYXVkIjoicmF3LmdpdGh1YnVzZXJjb250ZW50LmNvbSIsImtleSI6ImtleTUiLCJleHAiOjE3MjE3Mzg1NjYsIm5iZiI6MTcyMTczODI2NiwicGF0aCI6Ii84MDE1MDcvMjg4NTA4NzkxLTcyMzc0MDE2LTJiNmYtNDYxNy04ODFhLTliN2I0NTA1OWEzNS5wbmc_WC1BbXotQWxnb3JpdGhtPUFXUzQtSE1BQy1TSEEyNTYmWC1BbXotQ3JlZGVudGlhbD1BS0lBVkNPRFlMU0E1M1BRSzRaQSUyRjIwMjQwNzIzJTJGdXMtZWFzdC0xJTJGczMlMkZhd3M0X3JlcXVlc3QmWC1BbXotRGF0ZT0yMDI0MDcyM1QxMjM3NDZaJlgtQW16LUV4cGlyZXM9MzAwJlgtQW16LVNpZ25hdHVyZT1lNjU4Yzk5MjIzZWIwMjEwNTAwMzU5YzBlYzM4YjNhMGJjOGY0ZWZjMTk5NjNlOWE3MGU0ODZjYjUyOTRjNGRkJlgtQW16LVNpZ25lZEhlYWRlcnM9aG9zdCZhY3Rvcl9pZD0wJmtleV9pZD0wJnJlcG9faWQ9MCJ9.aa0lZDpErCEaL39lEN9e6uvS3XSL7oClr3T1odnl6SE)
Instructions
-
Install the git-xet extension.
-
Clone the repo:
# Using SSH
git clone git@github.com:xetdata/EfficientSAM.git
cd EfficientSAM/
- Activate your Python virtual environment and install the requirements:
pip install -r requirements.txt
- Start Jupyter Notebook:
# jupyter lab
jupyter lab
# jupyter notebook
jupyter notebook
- You can directly use EfficientSAM:
import torch
efficientsam = torch.jit.load(models/efficientsam_s_gpu.jit)
You can also use this Google Colab notebook
If you're using EfficientSAM in your research or applications, please cite using this BibTeX:
@article{xiong2023efficientsam,
title={EfficientSAM: Leveraged Masked Image Pretraining for Efficient Segment Anything},
author={Yunyang Xiong, Bala Varadarajan, Lemeng Wu, Xiaoyu Xiang, Fanyi Xiao, Chenchen Zhu, Xiaoliang Dai, Dilin Wang, Fei Sun, Forrest Iandola, Raghuraman Krishnamoorthi, Vikas Chandra},
journal={arXiv:2312.00863},
year={2023}
}