AI for everyone! Neural networks, tools and Python SDK we use with Supervisely.
Introduction • Agent • Neural Networks • Import Plugins • Python SDK • Data Transformations • Resources
Supervisely is a web platform where you can find everything you need to build Deep Learning solutions within a single environment.
We learn a lot from our awesome community and want to give something back. Here you can find the Python SDK we use to implement neural network models, import plugins for custom data formats, and tools like the Data Transformation Language. You can also find the source code for the agent to turn your PC into a worker node to deploy your neural nets.
Supervisely Agent is a simple open-source task manager available as a Docker image.
The Agent runs on a worker node. It connects to the Supervisely WEB instance and listens for the tasks (like neural net training request) to run. It handles downloading and uploading data to the web instance, sets up proper environments for the specific tasks to run, and keeps track of progress, successes and failures of individual tasks. By deploying the agent on worker machine you bring up a virtual computing claster that your team can run their tasks on from the Supervisely web instance.
Check out explanation on how agent works and documentation on how to deploy a new agent.
We have ported and implemented a number of popular neural network (NN) architectures to be available as Supervisely plugins. Each plugin is a separate Docker image. We continue to work on porting more NN architectures to Supervisely. We also have a detailed guide on how to make your own neural net plugin, so you do not have to depend on anyone else to be able to use your favorite architecture.
Here are the neural network architectures available out of the box today:
- CNN-LSTM-CTC (OCR)
- DeepLab v3 Plus (segmentation)
- EAST (text detection)
- ICNet (segmentation)
- Mask RCNN (detection and segmentation)
- ResNet (classification)
- Models from TensorFlow Object Detection (detection)
- U-Net (segmentation)
- YOLO v3 (detection)
Read here how to run training or inference with this models.
For all source implementations of NNs the original authors are retaining all their original rights.
We provide import plugins for over 30 popular dataset formats out of the box. You can also leverage our Python SDK to implement a new plugin for your custom format.
We have organized most of the common functionality for processing data in Supervisely format and for training and inference with neural networks into the Python SDK. Our stock plugins rely on the SDK extensively, and we believe the SDK will be also valuable to the community.
Installation:
git clone https://github.com/supervisely/supervisely.git && \
pip install -e ./supervisely
The SDK not only wraps all the low-level details of handling the data and communicating with the Supervisely web instance, but also provides convenience helpers for the common tasks that we found useful in our own work of developing Supervisely plugins, such as neural network architectures and custom dataset imports.
Key features:
- Read, modify and write Supervisely projects on disk.
- Work with labeling data: geometric objects and tags.
- Common functionality for developing Supervisely plugins, so that you only need to focus on the core of your custom logic, and not on low level interactions with the platform.
Data Transformation Language allows to automate complicated pipelines of data transformation. Different actions determined by DTL layers may be applied to images and annotations. In details it is described here.
- Supervise.ly - Website
- Medium - Our technical blog. Regular updates on how to use state of the art models and solve practical data science problems with Supervisely.
- Tutorials and Cookbooks in this repository.