- Added LeYOLO in Google colab [](https://colab.research.google.com/github/LilianHollard/LeYOLO/blob/main/minimal.ipynb) Abstract Paper (pr…
- Added LeYOLO in Google colab [](https://colab.research.google.com/github/LilianHollard/LeYOLO/blob/main/minimal.ipynb) Abstract Paper (pr…
Paper (preprint!): https://arxiv.org/abs/2406.14239
Computational efficiency in deep neural networks is critical for object detection, especially as newer models prioritize speed over efficient computation (FLOP). This evolution has somewhat left behind embedded and mobile-oriented AI object detection applications. In this paper, we focus on design choices of neural network architectures for efficient object detection computation based on FLOP and propose several optimizations to enhance the efficiency of YOLO-based models.
Firstly, we introduce an efficient backbone scaling inspired by inverted bottlenecks and theoretical insights from the Information Bottleneck principle. Secondly, we present the Fast Pyramidal Architecture Network (FPAN), designed to facilitate fast multiscale feature sharing while reducing computational resources. Lastly, we propose a Decoupled Network-in-Network (DNiN) detection head engineered to deliver rapid yet lightweight computations for classification and regression tasks.
Building upon these optimizations and leveraging more efficient backbones, this paper contributes to a new scaling paradigm for object detection and YOLO-centric models called LeYOLO. Our contribution consistently outperforms existing models in various resource constraints, achieving unprecedented accuracy and flop ratio. Notably, LeYOLO-Small achieves a competitive mAP score of 38.2% on the COCO val with just 4.5 FLOP(G), representing a 42% reduction in computational load compared to the latest state-of-the-art YOLOv9-Tiny model while achieving similar accuracy. Our novel model family achieves a FLOP-to-accuracy ratio previously unattained, offering scalability that spans from ultra-low neural network configurations ( 4 GFLOPs) with 25.2, 31.3, 35.2, 38.2, 39.3 and 41 mAP for 0.66, 1.47, 2.53, 4.51, 5.8 and 8.4 FLOP(G).
LeYOLO family model results on MSCOCO val dataset. Find pre-trained weights in the weights folder.
| Models | mAP | Image Size | FLOP (G) |
|---|---|---|---|
| LeYOLONano | 25.2 | 320 | 0.66 |
| LeYOLONano | 31.3 | 480 | 1.47 |
| LeYOLOSmall | 35.2 | 480 | 2.53 |
| LeYOLOSmall | 38.2 | 640 | 4.51 |
| LeYOLOMedium | 39.3 | 640 | 5.80 |
| LeYOLOLarge | 41.0 | 768 | 8.40 |
Reproduce LeYOLO results by using a cfg file. We did not use expansive or fancy training methods, just classic and default Ultralytics training recipes. We enable non-computer scientist to perform fast training reproducibility for their research with effortless training methods!
You can find the LeNeck combination with various backbones directly hard-coded within the Ultralytics environment. However, if you have your own backbone and training loop and want to understand/use the versatile object detectors, you can find the detailed code in the LeNeck/nn.py file. Using MobileNetv3 as an example, it explains how we join a backbone with LeYOLO.
python3 -m pip install --upgrade pippip install -e .Use CLI or python interface to use LeYOLO / YOLOv8
from ultralytics import YOLO
#Load LeYOLO model
model = YOLO("weights/LeYOLOSmall.pt")
#Use Ultralytics grounding computer vision methods
model.train(data="coco8.yaml", epochs=3)
model.val()
model.export(format="onnx")We could only have accomplished this with the excellent work from the Ultralytics team since YOLOv5. LeYOLO fully integrates with Ultralytics, and their support and documentation comprehensively guide training, inference, validation, and export mechanisms.
For more details, refer to the Ultralytics documentation: https://www.ultralytics.com.
Any questions or remarks? Contact [email protected]
Université de Reims Champagne-Ardenne - CEA, LRC DIGIT, LICIIS
UFR Sciences Exactes et Naturelles - Campus Moulin de la Housse BP 1039 - 51687 Reims Cedex 2 - Bat 2/3 - France https://www.univ-reims.fr
No open issues yet, or sync has not completed.