/mmyolo

OpenMMLab YOLO series toolbox and benchmark. Implemented RTMDet, RTMDet-Rotated,YOLOv5, YOLOv6, YOLOv7, YOLOv8,YOLOX, PPYOLOE, etc.

Primary LanguagePythonGNU General Public License v3.0GPL-3.0

 
OpenMMLab website HOT      OpenMMLab platform TRY IT OUT
 

PyPI docs deploy codecov license open issues issue resolution

๐Ÿ“˜Documentation | ๐Ÿ› ๏ธInstallation | ๐Ÿ‘€Model Zoo | ๐Ÿ†•Update News | ๐Ÿค”Reporting Issues

English | ็ฎ€ไฝ“ไธญๆ–‡

๐Ÿ“„ Table of Contents

๐Ÿฅณ ๐Ÿš€ What's New ๐Ÿ”

๐Ÿ’Ž v0.5.0 was released on 2/3/2023:

  1. Support RTMDet-R rotated object detection
  2. Support for using mask annotation to improve YOLOv8 object detection performance
  3. Support MMRazor searchable NAS sub-network as the backbone of YOLO series algorithm
  4. Support calling MMRazor to distill the knowledge of RTMDet
  5. MMYOLO document structure optimization, comprehensive content upgrade
  6. Improve YOLOX mAP and training speed based on RTMDet training hyperparameters
  7. Support calculation of model parameters and FLOPs, provide GPU latency data on T4 devices, and update Model Zoo
  8. Support test-time augmentation (TTA)
  9. Support RTMDet, YOLOv8 and YOLOv7 assigner visualization

For release history and update details, please refer to changelog.

โœจ Highlight ๐Ÿ”

We are excited to announce our latest work on real-time object recognition tasks, RTMDet, a family of fully convolutional single-stage detectors. RTMDet not only achieves the best parameter-accuracy trade-off on object detection from tiny to extra-large model sizes but also obtains new state-of-the-art performance on instance segmentation and rotated object detection tasks. Details can be found in the technical report. Pre-trained models are here.

PWC PWC PWC

Task Dataset AP FPS(TRT FP16 BS1 3090)
Object Detection COCO 52.8 322
Instance Segmentation COCO 44.6 188
Rotated Object Detection DOTA 78.9(single-scale)/81.3(multi-scale) 121

MMYOLO currently implements the object detection and rotated object detection algorithm, but it has a significant training acceleration compared to the MMDeteciton version. The training speed is 2.6 times faster than the previous version.

๐Ÿ“– Introduction ๐Ÿ”

MMYOLO is an open source toolbox for YOLO series algorithms based on PyTorch and MMDetection. It is a part of the OpenMMLab project.

The master branch works with PyTorch 1.6+.

Major features
  • ๐Ÿ•น๏ธ Unified and convenient benchmark

    MMYOLO unifies the implementation of modules in various YOLO algorithms and provides a unified benchmark. Users can compare and analyze in a fair and convenient way.

  • ๐Ÿ“š Rich and detailed documentation

    MMYOLO provides rich documentation for getting started, model deployment, advanced usages, and algorithm analysis, making it easy for users at different levels to get started and make extensions quickly.

  • ๐Ÿงฉ Modular Design

    MMYOLO decomposes the framework into different components where users can easily customize a model by combining different modules with various training and testing strategies.

BaseModule-P5 The figure above is contributed by RangeKing@GitHub, thank you very much!

And the figure of P6 model is in model_design.md.

๐Ÿ› ๏ธ Installation ๐Ÿ”

MMYOLO relies on PyTorch, MMCV, MMEngine, and MMDetection. Below are quick steps for installation. Please refer to the Install Guide for more detailed instructions.

conda create -n mmyolo python=3.8 pytorch==1.10.1 torchvision==0.11.2 cudatoolkit=11.3 -c pytorch -y
conda activate mmyolo
pip install openmim
mim install "mmengine>=0.6.0"
mim install "mmcv>=2.0.0rc4,<2.1.0"
mim install "mmdet>=3.0.0rc6,<3.1.0"
git clone https://github.com/open-mmlab/mmyolo.git
cd mmyolo
# Install albumentations
pip install -r requirements/albu.txt
# Install MMYOLO
mim install -v -e .

๐Ÿ‘จโ€๐Ÿซ Tutorial ๐Ÿ”

MMYOLO is based on MMDetection and adopts the same code structure and design approach. To get better use of this, please read MMDetection Overview for the first understanding of MMDetection.

The usage of MMYOLO is almost identical to MMDetection and all tutorials are straightforward to use, you can also learn about MMDetection User Guide and Advanced Guide.

For different parts from MMDetection, we have also prepared user guides and advanced guides, please read our documentation.

Get Started
Recommended Topics
Common Usage
Useful Tools
Basic Tutorials
Advanced Tutorials
Descriptions

๐Ÿ“Š Overview of Benchmark and Model Zoo ๐Ÿ”

Results and models are available in the model zoo.

Supported Tasks
  • Object detection
  • Rotated object detection
Supported Algorithms
Supported Datasets
  • COCO Dataset
  • VOC Dataset
  • CrowdHuman Dataset
  • DOTA 1.0 Dataset
Module Components
Backbones Necks Loss Common
  • YOLOv5CSPDarknet
  • YOLOv8CSPDarknet
  • YOLOXCSPDarknet
  • EfficientRep
  • CSPNeXt
  • YOLOv7Backbone
  • PPYOLOECSPResNet
  • mmdet backbone
  • mmcls backbone
  • timm
  • YOLOv5PAFPN
  • YOLOv8PAFPN
  • YOLOv6RepPAFPN
  • YOLOXPAFPN
  • CSPNeXtPAFPN
  • YOLOv7PAFPN
  • PPYOLOECSPPAFPN
  • IoULoss
  • mmdet loss

โ“ FAQ ๐Ÿ”

Please refer to the FAQ for frequently asked questions.

๐Ÿ™Œ Contributing ๐Ÿ”

We appreciate all contributions to improving MMYOLO. Ongoing projects can be found in our GitHub Projects. Welcome community users to participate in these projects. Please refer to CONTRIBUTING.md for the contributing guideline.

๐Ÿค Acknowledgement ๐Ÿ”

MMYOLO is an open source project that is contributed by researchers and engineers from various colleges and companies. We appreciate all the contributors who implement their methods or add new features, as well as users who give valuable feedback. We wish that the toolbox and benchmark could serve the growing research community by providing a flexible toolkit to re-implement existing methods and develop their own new detectors.

๐Ÿ–Š๏ธ Citation ๐Ÿ”

If you find this project useful in your research, please consider citing:

@misc{mmyolo2022,
    title={{MMYOLO: OpenMMLab YOLO} series toolbox and benchmark},
    author={MMYOLO Contributors},
    howpublished = {\url{https://github.com/open-mmlab/mmyolo}},
    year={2022}
}

๐ŸŽซ License ๐Ÿ”

This project is released under the GPL 3.0 license.

๐Ÿ—๏ธ Projects in OpenMMLab ๐Ÿ”

  • MMEngine: OpenMMLab foundational library for training deep learning models.
  • MMCV: OpenMMLab foundational library for computer vision.
  • MIM: MIM installs OpenMMLab packages.
  • MMClassification: OpenMMLab image classification toolbox and benchmark.
  • MMDetection: OpenMMLab detection toolbox and benchmark.
  • MMDetection3D: OpenMMLab's next-generation platform for general 3D object detection.
  • MMRotate: OpenMMLab rotated object detection toolbox and benchmark.
  • MMYOLO: OpenMMLab YOLO series toolbox and benchmark.
  • MMSegmentation: OpenMMLab semantic segmentation toolbox and benchmark.
  • MMOCR: OpenMMLab text detection, recognition, and understanding toolbox.
  • MMPose: OpenMMLab pose estimation toolbox and benchmark.
  • MMHuman3D: OpenMMLab 3D human parametric model toolbox and benchmark.
  • MMSelfSup: OpenMMLab self-supervised learning toolbox and benchmark.
  • MMRazor: OpenMMLab model compression toolbox and benchmark.
  • MMFewShot: OpenMMLab fewshot learning toolbox and benchmark.
  • MMAction2: OpenMMLab's next-generation action understanding toolbox and benchmark.
  • MMTracking: OpenMMLab video perception toolbox and benchmark.
  • MMFlow: OpenMMLab optical flow toolbox and benchmark.
  • MMEditing: OpenMMLab image and video editing toolbox.
  • MMGeneration: OpenMMLab image and video generative models toolbox.
  • MMDeploy: OpenMMLab model deployment framework.
  • MMEval: OpenMMLab machine learning evaluation library.