Awesome NAS

A curated list of neural architecture search and related resources. Inspired by awesome-deep-vision, awesome-adversarial-machine-learning, awesome-deep-learning-papers, and awesome-architecture-search.

Please feel free to pull requests or open an issue to add papers.

Table of Contents

• Awesome Blogs

• Neural Architecture Search

  • 2020 Venues
  • 2019 Venues
  • 2018 Venues
  • 2017 Venues
  • Previous Venues
  • arXiv

Awesome Blogs

• AutoML info and AutoML Freiburg-Hannover
• What’s the deal with Neural Architecture Search?
• Google Could AutoML and PocketFlow
• AutoML Challenge and AutoDL Challenge

Neural Architecture Search (NAS)

Type	G	RL	EA	PD	Other
Explanation	gradient-based	reinforcement learning	evaluationary algorithm	performance prediction	other types

2020

Title	Venue	Type	Code
NAS-BENCH-201: Extending the Scope of Reproducible Neural Architecture Search	ICLR	-	Github
Understanding Architectures Learnt by Cell-based Neural Architecture Search	ICLR	G	GitHub
Evaluating The Search Phase of Neural Architecture Search	ICLR	-
AtomNAS: Fine-Grained End-to-End Neural Architecture Search	ICLR		GitHub
Fast Neural Network Adaptation via Parameter Remapping and Architecture Search	ICLR	-	GitHub
Once for All: Train One Network and Specialize it for Efficient Deployment	ICLR	G
Efficient Transformer for Mobile Applications	ICLR	-	-
PC-DARTS: Partial Channel Connections for Memory-Efficient Architecture Search	ICLR	G	GitHub
Adversarial AutoAugment	ICLR	-	-
NAS evaluation is frustratingly hard	ICLR	-	-
FasterSeg: Searching for Faster Real-time Semantic Segmentation	ICLR	G	GitHub
Computation Reallocation for Object Detection	ICLR	-	-
Towards Fast Adaptation of Neural Architectures with Meta Learning	ICLR	-	-
AssembleNet: Searching for Multi-Stream Neural Connectivity in Video Architectures	ICLR	EA	-
How to Own the NAS in Your Spare Time	ICLR	-	-

2019

Title	Venue	Type	Code
DATA: Differentiable ArchiTecture Approximation	NeurIPS	-	-
Random Search and Reproducibility for Neural Architecture Search	UAI	G	GitHub
Improved Differentiable Architecture Search for Language Modeling and Named Entity Recognition	EMNLP	G	-
Continual and Multi-Task Architecture Search	ACL	RL	-
Progressive Differentiable Architecture Search: Bridging the Depth Gap Between Search and Evaluation	ICCV	-	-
Multinomial Distribution Learning for Effective Neural Architecture Search	ICCV	-	-
Searching for MobileNetV3	ICCV	EA	-
Multinomial Distribution Learning for Effective Neural Architecture Search	ICCV	-	GitHub
Fast and Practical Neural Architecture Search	ICCV
Teacher Guided Architecture Search	ICCV		-
AutoDispNet: Improving Disparity Estimation With AutoML	ICCV	G	-
Resource Constrained Neural Network Architecture Search: Will a Submodularity Assumption Help?	ICCV	EA	-
One-Shot Neural Architecture Search via Self-Evaluated Template Network	ICCV	G	Github
Evolving Space-Time Neural Architectures for Videos	ICCV	EA	GitHub
AutoGAN: Neural Architecture Search for Generative Adversarial Networks	ICCV	RL	github
Discovering Neural Wirings	NeurIPS	G	Github
Towards modular and programmable architecture search	NeurIPS	Other	Github
Network Pruning via Transformable Architecture Search	NeurIPS	G	Github
Deep Active Learning with a NeuralArchitecture Search	NeurIPS	-	-
DetNAS: Backbone Search for ObjectDetection	NeurIPS	-	-
SpArSe: Sparse Architecture Search for CNNs on Resource-Constrained Microcontrollers	NeurIPS	-	-
Efficient Forward Architecture Search	NeurIPS	G	Github
Efficient Neural ArchitectureTransformation Search in Channel-Level for Object Detection	NeurIPS	G	-
XNAS: Neural Architecture Search with Expert Advice	NeurIPS	G	-
Neural architecture search: A survey	JMLR	Survey	-
DARTS: Differentiable Architecture Search	ICLR	G	github
ProxylessNAS: Direct Neural Architecture Search on Target Task and Hardware	ICLR	RL/G	github
Graph HyperNetworks for Neural Architecture Search	ICLR	G	-
Learnable Embedding Space for Efficient Neural Architecture Compression	ICLR	Other	github
Efficient Multi-Objective Neural Architecture Search via Lamarckian Evolution	ICLR	EA	-
SNAS: stochastic neural architecture search	ICLR	G	-
Searching for A Robust Neural Architecture in Four GPU Hours	CVPR	G	Github
ChamNet: Towards Efficient Network Design through Platform-Aware Model Adaptation	CVPR	-	-
Partial Order Pruning: for Best Speed/Accuracy Trade-off in Neural Architecture Search	CVPR	EA	github
FBNet: Hardware-Aware Efficient ConvNet Design via Differentiable Neural Architecture Search	CVPR	G	-
RENAS: Reinforced Evolutionary Neural Architecture Search	CVPR	G	-
Auto-DeepLab: Hierarchical Neural Architecture Search for Semantic Image Segmentation	CVPR	G	GitHub
MnasNet: Platform-Aware Neural Architecture Search for Mobile	CVPR	RL	Github
MFAS: Multimodal Fusion Architecture Search	CVPR	EA	-
A Neurobiological Evaluation Metric for Neural Network Model Search	CVPR	Other	-
Fast Neural Architecture Search of Compact Semantic Segmentation Models via Auxiliary Cells	CVPR	RL	-
Customizable Architecture Search for Semantic Segmentation	CVPR	-	-
Regularized Evolution for Image Classifier Architecture Search	AAAI	EA	-
AutoAugment: Learning Augmentation Policies from Data	CVPR	RL	-
Population Based Augmentation: Efficient Learning of Augmentation Policy Schedules	ICML	EA	-
The Evolved Transformer	ICML	EA	Github
EfficientNet: Rethinking Model Scaling for Convolutional Neural Networks	ICML	RL	-
NAS-Bench-101: Towards Reproducible Neural Architecture Search	ICML	Other	Github

2018

Title	Venue	Type	Code
Towards Automatically-Tuned Deep Neural Networks	BOOK	-	GitHub
Efficient Architecture Search by Network Transformation	AAAI	RL	github
Learning Transferable Architectures for Scalable Image Recognition	CVPR	RL	github
N2N learning: Network to Network Compression via Policy Gradient Reinforcement Learning	ICLR	RL	-
A Flexible Approach to Automated RNN Architecture Generation	ICLR	RL/PD	-
Practical Block-wise Neural Network Architecture Generation	CVPR	RL	-
Path-Level Network Transformation for Efficient Architecture Search	ICML	RL	github
Hierarchical Representations for Efficient Architecture Search	ICLR	EA	-
Understanding and Simplifying One-Shot Architecture Search	ICML	G	-
SMASH: One-Shot Model Architecture Search through HyperNetworks	ICLR	G	github
Neural Architecture Optimization	NeurIPS	G	github
Searching for efficient multi-scale architectures for dense image prediction	NeurIPS	Other	-
Progressive Neural Architecture Search	ECCV	PD	github
Neural Architecture Search with Bayesian Optimisation and Optimal Transport	NeurIPS	Other	github
Differentiable Neural Network Architecture Search	ICLR-W	G	-
Accelerating Neural Architecture Search using Performance Prediction	ICLR-W	PD	-

2017

Title	Venue	Type	Code
Neural Architecture Search with Reinforcement Learning	ICLR	RL	-
Designing Neural Network Architectures using Reinforcement Learning	ICLR	RL	-
Neural Optimizer Search with Reinforcement Learning	ICML	RL	-
Learning Curve Prediction with Bayesian Neural Networks	ICLR	PD	-
Hyperband: A Novel Bandit-Based Approach to Hyperparameter Optimization	ICLR	PD	-
Hyperparameter Optimization: A Spectral Approach	NeurIPS-W	Other	github
Learning to Compose Domain-Specific Transformations for Data Augmentation	NeurIPS	-	-

2012-2016

Title	Venue	Type	Code
Speeding up Automatic Hyperparameter Optimization of Deep Neural Networksby Extrapolation of Learning Curves	IJCAI	PD	github

arXiv

Title	Date	Type	Code
Population Based Training of Neural Networks	2017.11	EA	-
NSGA-NET: A Multi-Objective Genetic Algorithm for Neural Architecture Search	2018.10	EA	-
Training Frankenstein’s Creature to Stack: HyperTree Architecture Search	2018.10	G	-
Fast, Accurate and Lightweight Super-Resolution with Neural Architecture Search	2019.01	G	github