cv-ip / lightweight-neural-architecture-search Goto Github PK

Introduction

English | 简体中文

Lightweight Neural Architecture Search (Light-NAS) is an open source zero-short NAS toolbox for backbone search based on PyTorch. The master branch works with PyTorch 1.4+ and OpenMPI 4.0+.

License

This project is developed by Alibaba and licensed under the Apache 2.0 license.

This product contains third-party components under other open source licenses.

See the NOTICE file for more information.

Changelog

1.0.0 was released in 24/03/2022:

• Support entropy score for zero-shot search.
• Support latency prediction for hardware device.
• Support Classification and Detection tasks.

Please refer to changelog.md for details and release history.

Installation

Prerequisites

• Linux
• GCC 7+
• OpenMPI 4.0+
• Python 3.6+
• PyTorch 1.4+
• CUDA 10.0+

Prepare environment

1. Compile the OpenMPI 4.0+ Downloads.

   cd path
   tar -xzvf openmpi-4.0.1.tar.gz
   cd openmpi-4.0.1
   ./configure --prefix=/your_path/openmpi
   make && make install

   add the commands into your ~/.bashrc

   export PATH=/your_path/openmpi/bin:$PATH
   export LD_LIBRARYPATH=/your_path/openmpi/lib:$LD_LIBRARY_PATH

2. Create a conda virtual environment and activate it.

   conda create -n light-nas python=3.6 -y
   conda activate light-nas

3. Install torch and torchvision with the following command or offcial instruction.

   pip install torch==1.4.0+cu100 torchvision==0.5.0+cu100 -f https://download.pytorch.org/whl/torch_stable.html

   if meet "Not be found for jpeg", please install the libjpeg for the system.

   sudo yum install libjpeg # for centos
   sudo apt install libjpeg-dev # for ubuntu

4. Install other packages with the following command.

   pip install -r requirements.txt

Easy to use

• Search with examples

  cd scripts/classification
  sh example_xxxx.sh

Results

Results for Classification, Details are here.

Note: If you find this useful, please support us by citing it.

@inproceedings{zennas,
	title     = {Zen-NAS: A Zero-Shot NAS for High-Performance Deep Image Recognition},
	author    = {Ming Lin, Pichao Wang, Zhenhong Sun, Hesen Chen, Xiuyu Sun, Qi Qian, Hao Li and Rong Jin},
	booktitle = {2021 IEEE/CVF International Conference on Computer Vision},  
	year      = {2021},
}

Results for Object Detection, Details are here.

Note: If you find this useful, please support us by citing it.

@inproceedings{maedet,
  title={MAE-DET: Revisiting Maximum Entropy Principle in Zero-Shot NAS for Efficient Object Detection},
  author={Zhenhong Sun, Ming Lin, Xiuyu Sun, Zhiyu Tan, Hao Li and Rong Jin},
  booktitle={International Conference on Machine Learning},
  year={2022},
  organization={PMLR}
}

Main Contributors

Zhenhong Sun, Ming Lin, Xiuyu Sun.