Unsupervised/Self-Supervised-Visual-Representation-Learning

无监督/自监督视觉表示学习

[ Updating ...... ]

Unsupervised visual representation learning (UVRL) aims at learning generic representations for the initialization of downstream tasks. As stated in MoCo, self-supervised learning is a form of unsupervised learning and their distinction is informal in the existing literature. Therefore, it is more inclined to be called UVRL here. So, which one do you prefer?

We list related papers from conferences and journals such as CVPR, ICCV, ECCV, ICLR, ICML, NeurIPS, AAAI, IJCAI, TPAMI, TIP, TNNLS, TCSVT, TMM etc.

Note that only image-level representation learning methods are listed in this repository. Video-level self-supervision and multi-modal self-supervision are to be sorted out.

Key words: Unsupervised learning, self-supervised learning, representation learning, pre-training, transfer learning, contrastive learning, pretext task

关键词： 无监督学习，自监督学习，表示学习，预训练，迁移学习，对比学习，借口（代理）任务

2023

---

• Layer Grafted Pre-training: Bridging Contrastive Learning And Masked Image Modeling For Label-Efficient Representations (**** - ICLR23 ) [paper]
  More Info

  · · Author(s): Ziyu Jiang, Yinpeng Chen, Mengchen Liu, Dongdong Chen, Xiyang Dai, Lu Yuan, Zicheng Liu, Zhangyang Wang
  · · Organization(s): Texas A&M University; Microsoft; University of Texas at Austin
  · · Description:
  · · Tags: CL, MIM

---

• Patch-Level Contrasting without Patch Correspondence for Accurate and Dense Contrastive Representation Learning (ADCLR - ICLR23 ) [paper]
  More Info

  · · Author(s): Shaofeng Zhang, Feng Zhu, Rui Zhao, Junchi Yan
  · · Organization(s): Shanghai Jiao Tong University; SenseTime Group Limited
  · · Description:
  · · Tags: Dense

---

• Soft Neighbors are Positive Supporters in Contrastive Visual Representation Learning (SNCLR - ICLR23 ) [paper]
  More Info

  · · Author(s): Chongjian GE, Jiangliu Wang, Zhan Tong, Shoufa Chen, Yibing Song, Ping Luo
  · · Organization(s): HongKong University and so on
  · · Description:
  · · Tags: Soft neighbor

---

• Energy-Inspired Self-Supervised Pretraining for Vision Models (**** - ICLR23 Spotlight ) [paper]
  More Info

  · · Author(s): Ze Wang, Jiang Wang, Zicheng Liu, Qiang Qiu
  · · Organization(s): Purdue University; Microsoft Corporation
  · · Description:
  · · Tags: Energy

---

• EquiMod: An Equivariance Module to Improve Self-Supervised Learning (EquiMod - ICLR23 ) [paper]
  More Info

  · · Author(s): Alexandre DEVILLERS, Mathieu Lefort
  · · Organization(s): Université Claude Bernard
  · · Description:
  · · Tags: Equivariance

---

• Mosaic Representation Learning for Self-supervised Visual Pre-training (MosRep - ICLR23 Spotlight ) [paper] [code]
  More Info

  · · Author(s): Zhaoqing Wang, Ziyu Chen, Yaqian Li, Yandong Guo, Jun Yu, Mingming Gong, Tongliang Liu
  · · Organization(s): The University of Sydney
  · · Description:
  · · Tags:

---

• Temperature Schedules for self-supervised contrastive methods on long-tail data (**** - ICLR23 ) [paper]
  More Info

  · · Author(s): Anna Kukleva, Moritz Böhle, Bernt Schiele, Hilde Kuehne, Christian Rupprecht
  · · Organization(s): Saarland Informatics Campus, Max-Planck Institute
  · · Description:
  · · Tags: Long-tail

2022

---

• LPCL: Localized prominence contrastive learning for self-supervised dense visual pre-training (LPCL - PR22) [paper]
  More Info

  · · Author(s): Zihan Chen, Hongyuan Zhu, Hao Cheng, Siya Mi, Yu Zhang, Xin Geng
  · · Organization(s): Southeast University; A*STAR; Purple Mountain Laboratories
  · · Description:
  · · Tags: Dense

---

• Self-supervised Learning is More Robust to Dataset Imbalance (**** - ICLR22 Spotlight) [paper]
  More Info

  · · Author(s): Hong Liu, Jeff Z. HaoChen, Adrien Gaidon, Tengyu Ma
  · · Organization(s): Stanford University; Toyota Research Institute
  · · Description:
  · · Tags: Analysis, Imbalance data

---

• Chaos is a Ladder: A New Theoretical Understanding of Contrastive Learning via Augmentation Overlap (**** - ICLR22) [paper] [code]
  More Info

  · · Author(s): Yifei Wang, Qi Zhang, Yisen Wang, Jiansheng Yang, Zhouchen Lin
  · · Organization(s): Peking University; Sun Yat-sen University; Peng Cheng Laboratory
  · · Description:
  · · Tags: Analysis

---

• How Does SimSiam Avoid Collapse Without Negative Samples? A Unified Understanding with Self-supervised Contrastive Learning (**** - ICLR22) [paper]
  More Info

  · · Author(s): Chaoning Zhang, Kang Zhang, Chenshuang Zhang, Trung X. Pham, Chang D. Yoo, In So Kweon
  · · Organization(s): KAIST
  · · Description:
  · · Tags: Analysis

---

• Fine-Tuning can Distort Pretrained Features and Underperform Out-of-Distribution (LP-FT - ICLR22 Oral) [paper]
  More Info

  · · Author(s): Ananya Kumar, Aditi Raghunathan, Robbie Matthew Jones, Tengyu Ma, Percy Liang
  · · Organization(s): Stanford University
  · · Description:
  · · Tags: Analysis

---

• Scarf: Self-Supervised Contrastive Learning using Random Feature Corruption (Scarf - ICLR22 Spotlight) [paper]
  More Info

  · · Author(s): Dara Bahri, Heinrich Jiang, Yi Tay, Donald Metzler
  · · Organization(s): Google Research
  · · Description:
  · · Tags: Tabular domain

---

• Measuring the Interpretability of Unsupervised Representations via Quantized Reversed Probing (QRP - ICLR22) [paper] [code]
  More Info

  · · Author(s): Iro Laina, Yuki M Asano, Andrea Vedaldi
  · · Organization(s): University of Oxford; University of Amsterdam
  · · Description:
  · · Tags: Interpretability

---

• Equivariant Contrastive Learning (Equivariant Self-Supervised Learning: Encouraging Equivariance in Representations) (E-SSL - ICLR22) [paper] [code]
  More Info

  · · Author(s): Rumen Dangovski, Li Jing, Charlotte Loh, Seungwook Han, Akash Srivastava, Brian Cheung, Pulkit Agrawal, Marin Soljacic
  · · Organization(s): MIT; FAIR
  · · Description:
  · · Tags: Equivariant

---

• Divergence-aware Federated Self-Supervised Learning (FedSSL - ICLR22) [paper]
  More Info

  · · Author(s): Weiming Zhuang, Yonggang Wen, Shuai Zhang
  · · Organization(s): NTU; SenseTime Research
  · · Description:
  · · Tags: Federal

---

• Bag of Instances Aggregation Boosts Self-supervised Distillation (BINGO - ICLR22) [paper] [code]
  More Info

  · · Author(s): Haohang Xu, Jiemin Fang, XIAOPENG ZHANG, Lingxi Xie, Xinggang Wang, Wenrui Dai, Hongkai Xiong, Qi Tian
  · · Organization(s): Shanghai Jiao Tong University; Huawei Inc.; Huazhong University of Science & Technology
  · · Description:
  · · Tags: Self-supervised distillation

---

• VICReg: Variance-Invariance-Covariance Regularization for Self-Supervised Learning (VICReg - ICLR22) [paper]
  More Info

  · · Author(s): Adrien Bardes, Jean Ponce, Yann LeCun
  · · Organization(s): Facebook AI Research; Inria; New York University
  · · Description:
  · · Tags:

---

• Zero-CL: Instance and Feature decorrelation for negative-free symmetric contrastive learning (Zero-CL - ICLR22) [paper]
  More Info

  · · Author(s): Shaofeng Zhang, Feng Zhu, Junchi Yan, Rui Zhao, Xiaokang Yang
  · · Organization(s): Shanghai Jiao Tong University; SenseTime Research
  · · Description:
  · · Tags:

---

• BEiT: BERT Pre-Training of Image Transformers (BEiT - ICLR22 Oral) [paper] [code]
  More Info

  · · Author(s): Hangbo Bao, Li Dong, Songhao Piao, Furu Wei
  · · Organization(s): Harbin Institute of Technology; Microsoft Research
  · · Description:
  · · Tags: Transformer

---

• Efficient Self-supervised Vision Transformers for Representation Learning (EsViT - ICLR22) [paper] [code]
  More Info

  · · Author(s): Hangbo Chunyuan Li, Jianwei Yang, Pengchuan Zhang, Mei Gao, Bin Xiao, Xiyang Dai, Lu Yuan, Jianfeng Gao
  · · Organization(s): Microsoft Research at Redmond; Microsoft Cloud + AI
  · · Description:
  · · Tags: Transformer

---

• iBOT：Image BERT Pre-Training with Online Tokenizer (iBOT - ICLR22) [paper] [code]
  More Info

  · · Author(s): Jinghao Zhou, Chen Wei, Huiyu Wang, Wei Shen, Cihang Xie, Alan Yuille, Tao Kong
  · · Organization(s): ByteDance; Johns Hopkins University; Shanghai Jiao Tong University; UC Santa Cruz
  · · Description:
  · · Tags: Transformer

---

• Understanding Dimensional Collapse in Contrastive Self-supervised Learning (**** - ICLR22) [paper]
  More Info

  · · Author(s): Li Jing, Pascal Vincent, Yann LeCun, Yuandong Tian
  · · Organization(s): Facebook AI Research
  · · Description:
  · · Tags: Analysis

---

• Incremental False Negative Detection for Contrastive Learning (IFND - ICLR22) [paper] [code]
  More Info

  · · Author(s): Tsai-Shien Chen, Wei-Chih Hung, Hung-Yu Tseng, Shao-Yi Chien, Ming-Hsuan Yang
  · · Organization(s): National Taiwan University; Waymo LLC; University of California, Merced; Yonsei University; Google Research
  · · Description:
  · · Tags: False negative

---

• Self-Supervised Learning via Maximum Entropy Coding (MEC - NeurIPS22) [paper] [code]
  More Info

  · · Author(s): Xin Liu, Zhongdao Wang, Yali Li, Shengjin Wang
  · · Organization(s): Tsinghua University
  · · Description:
  · · Tags:

---

• Self-Supervised Learning Through Efference Copies (S-TEC - NeurIPS22) [paper]
  More Info

  · · Author(s): Franz Scherr, Qinghai Guo, Timoleon Moraitis
  · · Organization(s): Huawei Technologies
  · · Description:
  · · Tags:

---

• VICRegL: Self-Supervised Learning of Local Visual Features (VICRegL - NeurIPS22) [paper] [code]
  More Info

  · · Author(s): Adrien Bardes, Jean Ponce, Yann LeCun
  · · Organization(s): Meta, FAIR; Inria, École normale supérieure, CNRS, PSL Research University; New York University
  · · Description:
  · · Tags: local feature

---

• An Empirical Study on Disentanglement of Negative-free Contrastive Learning (**** - NeurIPS22) [paper] [code]
  More Info

  · · Author(s): Jinkun Cao, Ruiqian Nai, Qing Yang, Jialei Huang, Yang Gao
  · · Organization(s): Carnegie Mellon University; Tsinghua University; Shanghai Jiao Tong University; Shanghai Qi-Zhi Institute
  · · Description:
  · · Tags: Analysis

---

• Contrastive and Non-Contrastive Self-Supervised Learning Recover Global and Local Spectral Embedding Methods (**** - NeurIPS22) [paper]
  More Info

  · · Author(s): Randall Balestriero, Yann LeCun
  · · Organization(s): Meta AI Research; NYU
  · · Description:
  · · Tags: Analysis

---

• The Mechanism of Prediction Head in Non-contrastive Self-supervised Learning (**** - NeurIPS22) [paper]
  More Info

  · · Author(s): RZixin Wen, Yuanzhi Li
  · · Organization(s): Carnegie Mellon University
  · · Description:
  · · Tags: Analysis

---

• Improving Self-Supervised Learning by Characterizing Idealized Representations (**** - NeurIPS22) [paper]
  More Info

  · · Author(s): Yann Dubois, Tatsunori Hashimoto, Stefano Ermon, Percy Liang
  · · Organization(s): Stanford University
  · · Description:
  · · Tags:

---

• MSR: Making Self-supervised learning Robust to Aggressive Augmentations (MSR - NeurIPS22) [paper]
  More Info

  · · Author(s): Yingbin Bai, Erkun Yang, Zhaoqing Wang, Yuxuan Du, Bo Han, Cheng Deng, Dadong Wang, Tongliang Liu
  · · Organization(s): TML Lab, The University of Sydney; Xidian University; JD Explore Academy; Hong Kong Baptist University; CSIRO
  · · Description:
  · · Tags:

---

• RényiCL: Contrastive Representation Learning with Skew Rényi Divergence (RényiCL - NeurIPS22) [paper]
  More Info

  · · Author(s): Kyungmin Lee, Jinwoo Shin
  · · Organization(s): Korea Advanced Institute of Science and Technology (KAIST)
  · · Description:
  · · Tags:

---

• Unsupervised Learning of Group Invariant and Equivariant Representations (**** - NeurIPS22) [paper]
  More Info

  · · Author(s): Robin Winter, Marco Bertolini, Tuan Le, Frank Noé, Djork-Arné Clevert
  · · Organization(s): Bayer AG; Freie Universität Berlin; Microsoft Research
  · · Description:
  · · Tags:

---

• Energy-Based Contrastive Learning of Visual Representations (**** - NeurIPS22) [paper]
  More Info

  · · Author(s): Beomsu Kim, Jong Chul Ye
  · · Organization(s): KAIST
  · · Description:
  · · Tags:

---

• Self-Supervised Visual Representation Learning with Semantic Grouping (SlotCon - NeurIPS22) [paper]
  More Info

  · · Author(s): Xin Wen, Bingchen Zhao, Anlin Zheng, Xiangyu Zhang, Xiaojuan Qi
  · · Organization(s): The University of Hong Kong; Tongji University; LunarAI; MEGVII Technology
  · · Description:
  · · Tags: Dense

---

• ConvMAE: Masked Convolution Meets Masked Autoencoders (ConvMAE - NeurIPS22) [paper] [code]
  More Info

  · · Author(s): Peng Gao, Teli Ma, Hongsheng Li, Ziyi Lin, Jifeng Dai, Yu Qiao
  · · Organization(s): Shanghai AI Laboratory; MMLab, CUHK; SenseTime Research
  · · Description:
  · · Tags:

---

• Green Hierarchical Vision Transformer for Masked Image Modeling (GreenMIM - NeurIPS22) [paper] [code]
  More Info

  · · Author(s): Lang Huang, Shan You, Mingkai Zheng, Fei Wang, Chen Qian, Toshihiko Yamasaki
  · · Organization(s): The University of Tokyo; SenseTime Research; The University of Sydney
  · · Description:
  · · Tags: Transformer

---

• SemMAE: Semantic-Guided Masking for Learning Masked Autoencoders (SemMAE - NeurIPS22) [paper]
  More Info

  · · Author(s): Gang Li, Heliang Zheng, Daqing Liu, Chaoyue Wang, Bing Su, Changwen Zheng
  · · Organization(s): Institute of Software, Chinese Academy of Sciences; University of Chinese Academy of Sciences; JD Explore Academy; Renmin University of China
  · · Description:
  · · Tags: Transformer

---

• Test-Time Training with Masked Autoencoders (TTT-MAE - NeurIPS22) [paper]
  More Info

  · · Author(s): Yossi Gandelsman, Yu Sun, Xinlei Chen, Alexei A. Efros
  · · Organization(s): UC Berkeley; Meta AI
  · · Description:
  · · Tags: Transformer

---

• Constrained Mean Shift Using Distant Yet Related Neighbors for Representation Learning (CMSF - ECCV22) [paper] [code]
  More Info

  · · Author(s): K L Navaneet, Soroush Abbasi Koohpayegani, Ajinkya Tejankar, Kossar Pourahmadi, Akshayvarun Subramanya, Hamed Pirsiavash
  · · Organization(s): University of California, Davis; University of Maryland
  · · Description:
  · · Tags: NN

---

• Relative Contrastive Loss for Unsupervised Representation Learning (RCL - ECCV22) [paper]
  More Info

  · · Author(s): Shixiang Tang, Feng Zhu, Lei Bai, Rui Zhao, and Wanli Ouyang
  · · Organization(s): University of Sydney et.al.
  · · Description:
  · · Tags: soft, clustering

---

• Improving Self-Supervised Lightweight Model Learning via Hard-Aware Metric Distillation (SMD - ECCV22 Oral) [paper] [code]
  More Info

  · · Author(s): Hao Liu, Mang Ye
  · · Organization(s): Wuhan University; Beijing Institute of Technology
  · · Description:
  · · Tags: distillation

---

• Revisiting the Critical Factors of Augmentation-Invariant Representation Learning (**** - ECCV22) [paper] [code]
  More Info

  · · Author(s): Junqiang Huang, Xiangwen Kong, Xiangyu Zhang
  · · Organization(s): MEGVII Technology
  · · Description:
  · · Tags: Analysis

---

• Towards Efficient and Effective Self-Supervised Learning of Visual Representations (EffSSL - ECCV22) [paper] [code]
  More Info

  · · Author(s): Sravanti Addepalli, Kaushal Bhogale, Priyam Dey, R.Venkatesh Babu
  · · Organization(s): Indian Institute of Science
  · · Description:
  · · Tags:

---

• Understanding Collapse in Non-Contrastive Siamese Representation Learning (**** - ECCV22) [paper]
  More Info

  · · Author(s): Alexander C. Li, Alexei A. Efros, Deepak Pathakn
  · · Organization(s): CMU; UCB
  · · Description:
  · · Tags:

---

• Masked Siamese Networks for Label-Efficient Learning (MSN - ECCV22) [paper] [code]
  More Info

  · · Author(s): Mahmoud Assran, Mathilde Caron, Ishan Misra, Piotr Bojanowski, Florian Bordes, Pascal Vincent, Armand Joulin, Michael Rabbat, Nicolas Ballas
  · · Organization(s): Facebook AI Research; Mila – Quebec AI Institute; Inria, Univ. Grenoble Alpes; Universite de Montreal; McGill University
  · · Description:
  · · Tags:

---

• Decoupled Contrastive Learning (DCL - ECCV22) [paper]
  More Info

  · · Author(s): Chun-Hsiao Yeh, Cheng-Yao Hong, Yen-Chi Hsu, Tyng-Luh Liu, Yubei Chen, Yann LeCun
  · · Organization(s): IIS, Academia Sinica; UC Berkeley; National Taiwan University; Meta AI Research; New York University
  · · Description:
  · · Tags:

---

• Equivariance and Invariance Inductive Bias for Learning from Insufficient Data (EqInv - ECCV22) [paper] [code]
  More Info

  · · Author(s): Tan Wang, Qianru Sun, Sugiri Pranata, Karlekar Jayashree, Hanwang Zhang
  · · Organization(s): Nanyang Technological University; Singapore Management University; Panasonic R&D Center Singapore
  · · Description:
  · · Tags:

---

• Fast-MoCo: Boost Momentum-based Contrastive Learning with Combinatorial Patches (Fast-MoCo - ECCV22) [paper]
  More Info

  · · Author(s): Yuanzheng Ci, Chen Lin, Lei Bai, Wanli Ouyang
  · · Organization(s): The University of Sydney; University of Oxford; Shanghai AI Laboratory
  · · Description:
  · · Tags:

---

• Unsupervised Visual Representation Learning by Synchronous Momentum Grouping (SMoG - ECCV22) [paper]
  More Info

  · · Author(s): Bo Pang, Yifan Zhang, Yaoyi Li, Jia Cai, Cewu Lu
  · · Organization(s): Shanghai Jiao Tong University; HuaWei
  · · Description:
  · · Tags: Clustering, Contrastive Learning

---

• Self-Supervision Can Be a Good Few-Shot Learner (UniSiam - ECCV22) [paper]
  More Info

  · · Author(s): Yuning Lu, Liangjian Wen, Jianzhuang Liu, Yajing Liu, Xinmei Tian
  · · Organization(s): University of Science and Technology of China; Huawei Noah’s Ark Lab; Hefei Comprehensive National Science Center
  · · Description:
  · · Tags: few-shot

---

• ConCL: Concept Contrastive Learning for Dense Prediction Pre-training in Pathology Images (ConCL - ECCV22) [paper]
  More Info

  · · Author(s): Jiawei Yang, Hanbo Chen, Yuan Liang, Junzhou Huang, Lei He, Jianhua Yao
  · · Organization(s): Tencent AI Lab; UCLA; University of Texas at Arlington
  · · Description:
  · · Tags: dense, medical

---

• Dense Siamese Network for Dense Unsupervised Learning (DenseSiam - ECCV22) [paper] [code]
  More Info

  · · Author(s): Wenwei Zhang, Jiangmiao Pang, Kai Chen, Chen Change Loy
  · · Organization(s): Nanyang Technological University; Shanghai AI Laboratory; SenseTime Research
  · · Description:
  · · Tags: dense

---

• Bootstrapped Masked Autoencoders for Vision BERT Pretraining (BootMAE - ECCV22) [paper] [code]
  More Info

  · · Author(s): Xiaoyi Dong, Jianmin Bao, Ting Zhang, Dongdong Chen, Weiming Zhang, Lu Yuan, Dong Chen, Fang Wen, Nenghai Yu
  · · Organization(s): University of Science and Technology of China; Microsoft Research Asia; Microsoft Cloud + AI
  · · Description:
  · · Tags: transformer

---

• SdAE: Self-distillated Masked Autoencoder (SdAE - ECCV22) [paper] [code]
  More Info

  · · Author(s): Yabo Chen, Yuchen Liu, Dongsheng Jiang, Xiaopeng Zhang, Wenrui Dai, Hongkai Xiong, Qi Tian
  · · Organization(s): Shanghai Jiao Tong University; Huawei Cloud EI
  · · Description:
  · · Tags: transformer

---

• Contrastive Vision-Language Pre-training with Limited Resources (ZeroVL - ECCV22) [paper] [code]
  More Info

  · · Author(s): Quan Cui, Boyan Zhou, Yu Guo, Weidong Yin, Hao Wu, Osamu Yoshie, Yubo Chen
  · · Organization(s): ByteDance; Waseda University
  · · Description:
  · · Tags: VL

---

• Tailoring Self-Supervision for Supervised Learning (LoRot - ECCV22) [paper] [code]
  More Info

  · · Author(s): WonJun Moon, Ji-Hwan Kim, Jae-Pil Heo
  · · Organization(s): Sungkyunkwan University
  · · Description:
  · · Tags: supervised

---

• DisCo: Remedy Self-supervised Learning on Lightweight Models with Distilled Contrastive Learning (DisCo - ECCV22 Oral) [paper] [code]
  More Info

  · · Author(s): Yuting Gao, Jia-Xin Zhuang, Shaohui Lin, Hao Cheng, Xing Sun, Ke Li, Chunhua Shen
  · · Organization(s): Tencent Youtu Lab; Hong Kong University of Science and Technology; East China Normal University; Zhejiang University
  · · Description:
  · · Tags: Self-supervised Distillation

---

• Object discovery and representation networks (Odin - ECCV22) [paper]
  More Info

  · · Author(s): Olivier J. Hénaff, Skanda Koppula, Evan Shelhamer, Daniel Zoran, Andrew Jaegle, Andrew Zisserman, João Carreira, Relja Arandjelović
  · · Organization(s): TDeepMind
  · · Description:
  · · Tags: Dense

---

• Position Prediction as an Effective Pretraining Strategy (MP3 - ICML22) [paper]
  More Info

  · · Author(s): Shuangfei Zhai, Navdeep Jaitly, Jason Ramapuram, Dan Busbridge, Tatiana Likhomanenko, Joseph Y Cheng, Walter Talbott, Chen Huang, Hanlin Goh, Joshua M Susskind
  · · Organization(s): Apple Inc.
  · · Description:
  · · Tags: Transformer

---

• Boosting Contrastive Learning with Relation Knowledge Distillation (ReKD - AAAI22) [paper]
  More Info

  · · Author(s): Kai Zheng, Yuanjiang Wang, Ye Yuan
  · · Organization(s): Megvii Technology
  · · Description:
  · · Tags: distill

---

• Masked Autoencoders Are Scalable Vision Learners (MAE - CVPR22 Oral) [paper] [code] [supp]
  More Info

  · · Author(s): Kaiming He, Xinlei Chen, Saining Xie, Yanghao Li, Piotr Dollár, Ross Girshick
  · · Organization(s): Facebook AI Research (FAIR)
  · · Description:
  · · Tags: Transformer

---

• SimMIM: A Simple Framework for Masked Image Modeling (SimMIM - CVPR22) [paper] [code] [supp]
  More Info

  · · Author(s): Zhenda Xie, Zheng Zhang, Yue Cao, Yutong Lin, Jianmin Bao, Zhuliang Yao, Qi Dai, Han Hu
  · · Organization(s): Microsoft Research Asia
  · · Description:
  · · Tags: Transformer

---

• Crafting Better Contrastive Views for Siamese Representation Learning (ContrastiveCrop - CVPR22 Oral) [paper] [code]
  More Info

  · · Author(s): Xiangyu Peng, Kai Wang, Zheng Zhu, Mang Wang, Yang You
  · · Organization(s): National University of Singapore; Tsinghua University; Alibaba Group
  · · Description:
  · · Tags:

---

• A Simple Data Mixing Prior for Improving Self-Supervised Learning (SDMP - CVPR22) [paper] [code]
  More Info

  · · Author(s): Sucheng Ren, Huiyu Wang, Zhengqi Gao, Shengfeng He, Alan Yuille, Yuyin Zhou, Cihang Xie
  · · Organization(s): South China University of Technology; Johns Hopkins University; Massachusetts Institute of Technology; UC Santa Cruz
  · · Description:
  · · Tags: Interpolation

---

• On the Importance of Asymmetry for Siamese Representation Learning (asym-siam - CVPR22) [paper] [code] [supp]
  More Info

  · · Author(s): Xiao Wang, Haoqi Fan, Yuandong Tian, Daisuke Kihara, Xinlei Chen
  · · Organization(s): Facebook AI Research (FAIR); Purdue University
  · · Description:
  · · Tags:

---

• HCSC: Hierarchical Contrastive Selective Coding (HCSC - CVPR22) [paper] [code] [supp]
  More Info

  · · Author(s): Yuanfan Guo, Minghao Xu, Jiawen Li, Bingbing Ni, Xuanyu Zhu, Zhenbang Sun, Yi Xu
  · · Organization(s): MoE Key Lab of Artificial Intelligence, AI Institute, Shanghai Jiao Tong University; 2Mila - Qu´ebec AI Institute, University of Montr´eal; ByteDance
  · · Description:
  · · Tags: Clustering

---

• Unsupervised Representation Learning for Binary Networks by Joint Classifier Learning (BURN - CVPR22) [paper] [code] [supp]
  More Info

  · · Author(s): Dahyun Kim, Jonghyun Choi
  · · Organization(s): Upstage AI Research; NAVER AI Lab.; Yonsei University
  · · Description:
  · · Tags:

---

• Unleashing Potential of Unsupervised Pre-Training with Intra-Identity Regularization for Person Re-Identification (UP-ReID - CVPR22) [paper] [code] [supp]
  More Info

  · · Author(s): Zizheng Yang, Xin Jin, Kecheng Zheng, Feng Zhao
  · · Organization(s): University of Science and Technology of China
  · · Description:
  · · Tags:

---

• UniVIP: A Unified Framework for Self-Supervised Visual Pre-training (UniVIP - CVPR22) [paper] [No code]
  More Info

  · · Author(s): Zhaowen Li, Yousong Zhu, Fan Yang, Wei Li, Chaoyang Zhao, Yingying Chen, Zhiyang Chen, Jiahao Xie, Liwei Wu, Rui Zhao, Ming Tang, Jinqiao Wang
  · · Organization(s): National Laboratory of Pattern Recognition, Institute of Automation, CAS; School of Artificial Intelligence, University of Chinese Academy of Sciences; SenseTime Research; etc.
  · · Description:
  · · Tags:

---

• Semantic-Aware Auto-Encoders for Self-supervised Representation Learning (**** - CVPR22) [paper] [code]
  More Info

  · · Author(s): Guangrun Wang, Yansong Tang, Liang Lin, Philip H.S. Torr
  · · Organization(s): University of Oxford; Tsinghua-Berkeley Shenzhen Institute, Tsinghua University; Sun Yat-sen University
  · · Description:
  · · Tags:

---

• Rethinking the Augmentation Module in Contrastive Learning: Learning Hierarchical Augmentation Invariance with Expanded Views (**** - CVPR22) [paper] [No code]
  More Info

  · · Author(s): Junbo Zhang, Kaisheng Ma
  · · Organization(s): Tsinghua University
  · · Description:
  · · Tags:

---

• Leverage Your Local and Global Representations: A New Self-Supervised Learning Strategy (LoGo - CVPR22) [paper] [code] [supp]
  More Info

  · · Author(s): Tong Zhang, Congpei Qiu, Wei Ke, Sabine Süsstrunk, Mathieu Salzmann
  · · Organization(s): School of Computer and Communication Sciences, EPFL; Xi’an Jiaotong University
  · · Description:
  · · Tags:

---

• Learning Where to Learn in Cross-View Self-Supervised Learning (LEWEL - CVPR22) [paper] [code] [supp]
  More Info

  · · Author(s): Lang Huang, Shan You, Mingkai Zheng, Fei Wang, Chen Qian, Toshihiko Yamasaki
  · · Organization(s): The University of Tokyo; SenseTime Research; The University of Sydney
  · · Description:
  · · Tags:

---

• Exploring the Equivalence of Siamese Self-Supervised Learning via A Unified Gradient Framework (**** - CVPR22) [paper] [No code] [supp]
  More Info

  · · Author(s): Chenxin Tao, Honghui Wang, Xizhou Zhu, Jiahua Dong, Shiji Song, Gao Huang, Jifeng Dai
  · · Organization(s): Tsinghua University; SenseTime Research; Zhejiang University; Beijing Academy of Artificial Intelligence
  · · Description:
  · · Tags:

---

• Dual Temperature Helps Contrastive Learning Without Many Negative Samples: Towards Understanding and Simplifying MoCo (DT - CVPR22) [paper] [code] [supp]
  More Info

  · · Author(s): Chaoning Zhang, Kang Zhang, Trung X. Pham, Axi Niu, Zhinan Qiao, Chang D. Yoo, In So Kweon
  · · Organization(s): KAIST; Northwestern Polytechnical University; University of North Texas
  · · Description:
  · · Tags:

---

• Directional Self-supervised Learning for Heavy Image Augmentations (DSSL - CVPR22) [paper] [code] [supp]
  More Info

  · · Author(s): Yalong Bai, Yifan Yang, Wei Zhang, Tao Mei
  · · Organization(s): JD AI Research; Peking University
  · · Description:
  · · Tags:

---

• Unsupervised Visual Representation Learning by Online Constrained K-Means (CoKe - CVPR22) [paper] [code] [supp]
  More Info

  · · Author(s): Qi Qian, Yuanhong Xu, Juhua Hu, Hao Li, Rong Jin
  · · Organization(s): Alibaba Group, Bellevue; Alibaba Group, Hangzhou; University of Washington
  · · Description:
  · · Tags:

---

• Align Representations with Base: A New Approach to Self-Supervised Learning (ARB - CVPR22) [paper] [code]
  More Info

  · · Author(s): Shaofeng Zhang, Lyn Qiu, Feng Zhu, Junchi Yan, Hengrui Zhang, Rui Zhao, Hongyang Li, Xiaokang Yang
  · · Organization(s): Shanghai Jiao Tong University; SenseTime Research
  · · Description:
  · · Tags:

---

• Exploring Set Similarity for Dense Self-supervised Representation Learning (SetSim - CVPR22) [paper] [No code]
  More Info

  · · Author(s): Shaofeng Zhang, Lyn Qiu, Feng Zhu, Junchi Yan, Hengrui Zhang, Rui Zhao, Hongyang Li, Xiaokang Yang
  · · Organization(s): University of Sydney; Kuaishou Technology; Xidian University; University of Melbourne
  · · Description:
  · · Tags: Local representation

---

• Patch-level Representation Learning for Self-supervised Vision Transformers (SelfPatch - CVPR22) [paper] [code] [supp]
  More Info

  · · Author(s): Sukmin Yun, Hankook Lee, Jaehyung Kim, Jinwoo Shin
  · · Organization(s): Korea Advanced Institute of Science and Technology (KAIST)
  · · Description:
  · · Tags: Local representation

---

• Self-Supervised Learning of Object Parts for Semantic Segmentation (Leopart - CVPR22) [paper] [No code] [supp]
  More Info

  · · Author(s): Adrian Ziegler, Yuki M. Asano
  · · Organization(s): Technical University of Munich; QUVA Lab, University of Amsterdam
  · · Description:
  · · Tags: Local representation

---

• Point-Level Region Contrast for Object Detection Pre-Training (**** - CVPR22 Oral) [paper] [No code] [supp]
  More Info

  · · Author(s): Yutong Bai, Xinlei Chen, Alexander Kirillov, Alan Yuille, Alexander C. Berg
  · · Organization(s): Facebook AI Research (FAIR); Johns Hopkins University
  · · Description:
  · · Tags: Local representation

---

• Use All The Labels: A Hierarchical Multi-Label Contrastive Learning (**** - CVPR22) [paper] [code] [supp]
  More Info

  · · Author(s): Shu Zhang, Ran Xu, Caiming Xiong, Chetan Ramaiah
  · · Organization(s): Salesforce Research
  · · Description:
  · · Tags: Label supervision

---

• Revisiting the Transferability of Supervised Pretraining: an MLP Perspective (**** - CVPR22) [paper] [No code] [supp]
  More Info

  · · Author(s): Yizhou Wang, Shixiang Tang, Feng Zhu, Lei Bai, Rui Zhao, Donglian Qi, Wanli Ouyang
  · · Organization(s): Zhejiang University; The University of Sydney; SenseTime Research; Shanghai Jiao Tong University
  · · Description:
  · · Tags: Label supervision

---

• Does Robustness on ImageNet Transfer to Downstream Tasks? (**** - CVPR22) [paper] [No code] [supp]
  More Info

  · · Author(s): Yutaro Yamada, Mayu Otani
  · · Organization(s): Yale University; CyberAgent, Inc.
  · · Description:
  · · Tags: Analysis

---

• When Does Contrastive Visual Representation Learning Work? (**** - CVPR22) [paper] [No code]
  More Info

  · · Author(s): Elijah Cole, Xuan Yang, Kimberly Wilber, Oisin Mac Aodha, Serge Belongie
  · · Organization(s): Caltech; Google; University of Edinburgh; Alan Turing Institute; University of Copenhagen
  · · Description:
  · · Tags: Analysis

---

• Rethinking Minimal Sufficient Representation in Contrastive Learning (**** - CVPR22) [paper] [code] [supp]
  More Info

  · · Author(s): Haoqing Wang, Xun Guo, Zhi-Hong Deng, Yan Lu
  · · Organization(s): Peking University; Microsoft Research Asia
  · · Description:
  · · Tags: Analysis

---

• Beyond Supervised vs. Unsupervised: Representative Benchmarking and Analysis of Image Representation Learning (**** - CVPR22) [paper] [No code] [supp]
  More Info

  · · Author(s): Matthew Gwilliam, Abhinav Shrivastava
  · · Organization(s): University of Maryland, College Park
  · · Description:
  · · Tags: Analysis

---

• DETReg: Unsupervised Pretraining with Region Priors for Object Detection (DETReg - CVPR22) [paper] [code] [supp]
  More Info

  · · Author(s): Amir Bar, Xin Wang, Vadim Kantorov, Colorado J. Reed, Roei Herzig, Gal Chechik, Anna Rohrbach, Trevor Darrell, Amir Globerson
  · · Organization(s): Tel-Aviv University; Berkeley AI Research; NVIDIA; Bar-Ilan University; Microsoft Research
  · · Description:
  · · Tags: Transformer

---

• Masked Feature Prediction for Self-Supervised Visual Pre-Training (MaskFeat - CVPR22) [paper] [No code] [supp]
  More Info

  · · Author(s): Chen Wei, Haoqi Fan, Saining Xie, Chao-Yuan Wu, Alan Yuille, Christoph Feichtenhofer
  · · Organization(s): Facebook AI Research; Johns Hopkins University
  · · Description:
  · · Tags: Transformer

---

• Self-Taught Metric Learning without Labels (STML - CVPR22) [paper] [code] [supp]
  More Info

  · · Author(s): Sungyeon Kim, Dongwon Kim, Minsu Cho, Suha Kwak
  · · Organization(s): FDept. of CSE, POSTECH; Graduate School of AI, POSTECH
  · · Description:
  · · Tags:

---

• CoDo: Contrastive Learning with Downstream Background Invariance for Detection (CoDo - CVPRW22) [paper] [No code]
  More Info

  · · Author(s): Bing Zhao, Jun Li, Hong Zhu
  · · Organization(s): Department of AI and HPC Inspur Electronic Information Industry Co., Ltd
  · · Description:
  · · Tags: Local representation

---

• What Should Be Equivariant In Self-Supervised Learning (**** - CVPRW22) [paper] [No code]
  More Info

  · · Author(s): Yuyang Xie, Jianhong Wen, Kin Wai Lau, Yasar Abbas Ur Rehman, Jiajun Shen
  · · Organization(s): TCL AI Lab; Fuzhou University; City University of Hong Kong
  · · Description:
  · · Tags: Analysis

---

• Where are my Neighbors? Exploiting Patches Relations in Self-Supervised Vision Transformer (**** - CVPRW22?) [paper] [code]
  More Info

  · · Author(s): Guglielmo Camporese, Elena Izzo, Lamberto Ballan
  · · Organization(s): University of Padova, Italy
  · · Description:
  · · Tags:

---

• Deeply Unsupervised Patch Re-Identification for Pre-training Object Detectors (DUPR - TPAMI22) [paper] [No code]
  More Info

  · · Author(s): Jian Ding, Enze Xie, Hang Xu, Chenhan Jiang, Zhenguo Li, Ping Luo, Guidong Xia
  · · Organization(s): Wuhan University; Huawei Noah’s Ark Lab; University of Hong Kong
  · · Description:
  · · Tags:

---

• Learning Generalized Transformation Equivariant Representations Via AutoEncoding Transformations (**** - TPAMI22) [paper] [No code]
  More Info

  · · Author(s): Guo-Jun Qi, Liheng Zhang, Feng Lin, Xiao Wang
  · · Organization(s): Futurewei Seattle Cloud Lab; University of Central Florida; University of Science and Technology of China; Purdue University
  · · Description:
  · · Tags:

2021

---

• Improving Transformation Invariance in Contrastive Representation Learning (InvCLR - ICLR21) [paper] [code]
  More Info

  · · Author(s): Adam Foster, Rattana Pukdee, Tom Rainforth
  · · Organization(s): University of Oxford
  · · Description:
  · · Tags:

---

• Contrastive Learning with Hard Negative Samples (HCL - ICLR21) [paper] [code]
  More Info

  · · Author(s): Joshua David Robinson, Ching-Yao Chuang, Suvrit Sra, Stefanie Jegelka
  · · Organization(s): Massachusetts Institute of Technology
  · · Description:
  · · Tags: Hard negative

---

• Representation Learning via Invariant Causal Mechanisms (ReLIC - ICLR21) [paper]
  More Info

  · · Author(s): Jovana Mitrovic, Brian McWilliams, Jacob C Walker, Lars Holger Buesing, Charles Blundell
  · · Organization(s): DeepMind
  · · Description:
  · · Tags: Analysis, Distribution

---

• i-Mix: A Domain-Agnostic Strategy for Contrastive Representation Learning (i-Mix - ICLR21) [paper] [code]
  More Info

  · · Author(s): Kibok Lee, Yian Zhu, Kihyuk Sohn, Chun-Liang Li, Jinwoo Shin, Honglak Lee
  · · Organization(s): University of Michigan; Amazon Web Services; Google Cloud AI; KAIST; LG AI Research
  · · Description:
  · · Tags: Interpolation

---

• What Should Not Be Contrastive in Contrastive Learning (LooC - ICLR21) [paper]
  More Info

  · · Author(s): Tete Xiao, Xiaolong Wang, Alexei A Efros, Trevor Darrell
  · · Organization(s): UC Berkeley; UC San Diego
  · · Description:
  · · Tags:

---

• CO2: Consistent Contrast for Unsupervised Visual Representation Learning (CO2 - ICLR21) [paper]
  More Info

  · · Author(s): Chen Wei, Huiyu Wang, Wei Shen, Alan Yuille
  · · Organization(s): Johns Hopkins University
  · · Description:
  · · Tags: Distribution

---

• What Makes Instance Discrimination Good for Transfer Learning? (**** - ICLR21) [paper]
  More Info

  · · Author(s): Nanxuan Zhao, Zhirong Wu, Rynson W. H. Lau, Stephen Lin
  · · Organization(s): City University of Hong Kong; Microsoft Research Asia
  · · Description:
  · · Tags: Transfer

---

• SEED: Self-supervised Distillation For Visual Representation (SEED - ICLR21) [paper]
  More Info

  · · Author(s): Zhiyuan Fang, Jianfeng Wang, Lijuan Wang, Lei Zhang, Yezhou Yang, Zicheng Liu
  · · Organization(s): Arizona State University; Microsoft Corporation
  · · Description:
  · · Tags: Self-supervised distillation

---

• Prototypical Contrastive Learning of Unsupervised Representations (PCL - ICLR21) [paper] [code]
  More Info

  · · Author(s): Junnan Li, Pan Zhou, Caiming Xiong, Steven Hoi
  · · Organization(s): Salesforce Research
  · · Description:
  · · Tags: Clustering

---

• Unsupervised Representation Transfer for Small Networks: I Believe I Can Distill On-the-Fly (OSS - NeurIPS21) [paper]
  More Info

  · · Author(s): Hee Min Choi, Hyoa Kang, Dokwan Oh
  · · Organization(s): Samsung Advanced Institute of Technology
  · · Description:
  · · Tags: distill

---

• Aligning Pretraining for Detection via Object-Level Contrastive Learning (SoCo - NeurIPS21) [paper] [code]
  More Info

  · · Author(s): Fangyun Wei, Yue Gao, Zhirong Wu, Han Hu, Stephen Lin
  · · Organization(s): Microsoft Research Asia
  · · Description:
  · · Tags: local

---

• Unsupervised Object-Level Representation Learning from Scene Images (ORL - NeurIPS21) [paper] [code]
  More Info

  · · Author(s): Jiahao Xie, Xiaohang Zhan, Ziwei Liu, Yew Soon Ong, Chen Change Loy
  · · Organization(s): Nanyang Technological University; The Chinese University of Hong Kong
  · · Description:
  · · Tags: local

---

• Object-aware Contrastive Learning for Debiased Scene Representation (ContraCAM - NeurIPS21) [paper] [code]
  More Info

  · · Author(s): Sangwoo Mo, Hyunwoo Kang, Kihyuk Sohn, Chun-Liang Li, Jinwoo Shin
  · · Organization(s): KAIST; Google Cloud AI
  · · Description:
  · · Tags: contextual bias

---

• Intriguing Properties of Contrastive Losses (**** - NeurIPS21) [paper] [code]
  More Info

  · · Author(s): Ting Chen, Calvin Luo, Lala Li
  · · Organization(s): Google Research
  · · Description:
  · · Tags:

---

• ReSSL: Relational Self-Supervised Learning with Weak Augmentation (ReSSL - NeurIPS21) [paper] [code]
  More Info

  · · Author(s): Mingkai Zheng, Shan You, Fei Wang, Chen Qian, Changshui Zhang, Xiaogang Wang, Chang Xu
  · · Organization(s): SenseTime Research; Tsinghua University; The Chinese University of Hong Kong; The University of Sydney
  · · Description:
  · · Tags:

---

• Revitalizing CNN Attention via Transformers in Self-Supervised Visual Representation Learning (CARE - NeurIPS21) [paper] [code]
  More Info

  · · Author(s): Chongjian GE, Youwei Liang, YIBING SONG, Jianbo Jiao, Jue Wang, Ping Luo
  · · Organization(s): The University of Hong Kong; Tencent AI Lab; University of Oxford
  · · Description:
  · · Tags:

---

• Provable Guarantees for Self-Supervised Deep Learning with Spectral Contrastive Loss (**** - NeurIPS21) [paper]
  More Info

  · · Author(s): Jeff Z. HaoChen, Colin Wei, Adrien Gaidon, Tengyu Ma
  · · Organization(s): Stanford University; Toyota Research Institute
  · · Description:
  · · Tags:

---

• Improving Self-supervised Learning with Automated Unsupervised Outlier Arbitration (UOTA - NeurIPS21) [paper]
  More Info

  · · Author(s): Yu Wang, Jingyang Lin, Jingjing Zou, Yingwei Pan, Ting Yao, Tao Mei
  · · Organization(s): JD AI Research; Sun Yat-sen University; University of California, San Diego
  · · Description:
  · · Tags:

---

• Compressive Visual Representations (**** - NeurIPS21) [paper]
  More Info

  · · Author(s): Kuang-Huei Lee, Anurag Arnab, Sergio Guadarrama, John Canny, Ian Fischer
  · · Organization(s): Google Research
  · · Description:
  · · Tags: Compress

---

• MST: Masked Self-Supervised Transformer for Visual Representation (MST - NeurIPS21) [paper] [supp]
  More Info

  · · Author(s): Zhaowen Li, Zhiyang Chen, Fan Yang, Wei Li, Yousong Zhu, Chaoyang Zhao, Rui Deng, Liwei Wu, Rui Zhao, Ming Tang, Jinqiao Wang
  · · Organization(s): Institute of Automation, CAS; UCAS; SenseTime Research; UCLA
  · · Description:
  · · Tags: Transformer, MIM

---

• Exploring Simple Siamese Representation Learning (SimSiam - CVPR21 Oral) [paper] [code] [supp]
  More Info

  · · Author(s): Xinlei Chen, Kaiming He
  · · Organization(s): Facebook AI Research (FAIR)
  · · Description:
  · · Tags: Siamese architecture

---

• Jigsaw Clustering for Unsupervised Visual Representation Learning (JigClu - CVPR21 Oral) [paper] [code] [supp]
  More Info

  · · Author(s): Pengguang Chen, Shu Liu, Jiaya Jia
  · · Organization(s): The Chinese University of Hong Kong; SmartMore
  · · Description:
  · · Tags: Single branch

---

• OBoW: Online Bag-of-Visual-Words Generation for Self-Supervised Learning (OBoW - CVPR21) [paper] [code] [supp]
  More Info

  · · Author(s): Spyros Gidaris, Andrei Bursuc, Gilles Puy, Nikos Komodakis, Matthieu Cord, Patrick Perez
  · · Organization(s): valeo.ai; University of Crete; Sorbonne Université
  · · Description:
  · · Tags:

---

• Spatial Assembly Networks for Image Representation Learning (SAN - CVPR21) [paper] [No code] [supp]
  More Info

  · · Author(s): Yang Li, Shichao Kan, Jianhe Yuan, Wenming Cao, Zhihai He
  · · Organization(s): University of Missouri, MO; Beijing Jiaotong University; Shenzhen University
  · · Description:
  · · Tags:

---

• SelfAugment: Automatic Augmentation Policies for Self-Supervised Learning (SelfAugment - CVPR21) [paper] [code] [supp]
  More Info

  · · Author(s): Colorado J Reed, Sean Metzger, Aravind Srinivas, Trevor Darrell, Kurt Keutzer
  · · Organization(s): BAIR, Department of Computer Science, UC Berkeley; Graduate Group in Bioengineering (Berkeley/UCSF), Weill Neurosciences Institute & UCSF Neurological Surgery
  · · Description:
  · · Tags:

---

• Progressive Stage-wise Learning for Unsupervised Feature Representation Enhancement (PSL - CVPR21) [paper] [No code]
  More Info

  · · Author(s): Zefan Li, Chenxi Liu, Alan Yuille, Bingbing Ni, Wenjun Zhang, Wen Gao
  · · Organization(s): Shanghai Jiao Tong University; Johns Hopkins University; Peking University; MoE Key Lab of Artificial Intelligence, AI Institute, Shanghai Jiao Tong University
  · · Description:
  · · Tags:

---

• Unsupervised Pre-training for Person Re-identification (**** - CVPR21) [paper]
  More Info

  · · Author(s): Dengpan Fu, Dongdong Chen, Jianmin Bao, Hao Yang, Lu Yuan, Lei Zhang, Houqiang Li, Dong Chen
  · · Organization(s): University of Science and Technology of China; Microsoft Research
  · · Description:
  · · Tags: Dataset

---

• Propagate Yourself: Exploring Pixel-Level Consistency for Unsupervised Visual Representation Learning (PixPro - CVPR21) [paper] [code]
  More Info

  · · Author(s): Zhenda Xie, Yutong Lin, Zheng Zhang, Yue Cao, Stephen Lin, Han Hu
  · · Organization(s): Tsinghua University; Xi’an Jiaotong University; Microsoft Research Asia
  · · Description:
  · · Tags: Local representation

---

• How Well Do Self-Supervised Models Transfer? (**** - CVPR21) [paper] [code] [supp]
  More Info

  · · Author(s): Linus Ericsson, Henry Gouk, Timothy M. Hospedales
  · · Organization(s): University of Edinburgh; Samsung AI Research, Cambridge
  · · Description:
  · · Tags: Analysis

---

• Exponential Moving Average Normalization for Self-supervised and Semi-supervised Learning (EMAN - CVPR21) [paper] [code] [supp]
  More Info

  · · Author(s): Zhaowei Cai, Avinash Ravichandran, Subhransu Maji, Charless Fowlkes, Zhuowen Tu, Stefano Soatto
  · · Organization(s): Amazon Web Services
  · · Description:
  · · Tags:

---

• Dense Contrastive Learning for Self-Supervised Visual Pre-Training (DenseCL - CVPR21 Oral) [paper] [code] [supp]
  More Info

  · · Author(s): Xinlong Wang, Rufeng Zhang, Chunhua Shen, Tao Kong, Lei Li
  · · Organization(s): The University of Adelaide; Tongji University; ByteDance AI Lab
  · · Description:
  · · Tags: Local representation

---

• Unsupervised Feature Learning by Cross-Level Instance-Group Discrimination (CLD - CVPR21) [paper] [code] [supp]
  More Info

  · · Author(s): Xudong Wang, Ziwei Liu, Stella X. Yu
  · · Organization(s): UC Berkeley / ICSI; S-Lab, NTU
  · · Description:
  · · Tags:

---

• AdCo: Adversarial Contrast for Efficient Learning of Unsupervised Representations from Self-Trained Negative Adversaries (AdCo - CVPR21) [paper] [code] [supp]
  More Info

  · · Author(s): Qianjiang Hu, Xiao Wang, Wei Hu, Guo-Jun Qi
  · · Organization(s): Peking University; Purdue University; Laboratory for MAchine Perception and LEarning (MAPLE)
  · · Description:
  · · Tags:

---

• CASTing Your Model: Learning to Localize Improves Self-Supervised Representations (CAST - CVPR21) [paper] [code] [supp]
  More Info

  · · Author(s): Ramprasaath R. Selvaraju, Karan Desai, Justin Johnson, Nikhil Naik
  · · Organization(s): Salesforce Research; University of Michigan
  · · Description:
  · · Tags:

---

• Instance Localization for Self-supervised Detection Pretraining (InsLoc - CVPR21) [paper] [code]
  More Info

  · · Author(s): Ceyuan Yang, Zhirong Wu, Bolei Zhou, Stephen Lin
  · · Organization(s): Chinese University of Hong Kong; Microsoft Research Asia
  · · Description:
  · · Tags:

---

• PiCIE: Unsupervised Semantic Segmentation using Invariance and Equivariance in Clustering (PiCIE - CVPR21) [paper] [code] [supp]
  More Info

  · · Author(s): Jang Hyun Cho, Utkarsh Mall, Kavita Bala, Bharath Hariharan
  · · Organization(s): University of Texas at Austin; Cornell University
  · · Description:
  · · Tags: Unsupervised semantic segmentation

---

• Self-supervised Augmentation Consistency for Adapting Semantic Segmentation (SAC - CVPR21) [paper] [code] [supp]
  More Info

  · · Author(s): Nikita Araslanov, Stefan Roth
  · · Organization(s): Department of Computer Science, TU Darmstadt; hessian.AI
  · · Description:
  · · Tags: Domain adaptation

---

• Spatially Consistent Representation Learning (SCRL - CVPR21) [paper] [code] [supp]
  More Info

  · · Author(s): Byungseok Roh, Wuhyun Shin, Ildoo Kim, Sungwoong Kim
  · · Organization(s): Kakao Brain
  · · Description:
  · · Tags: Local representation

---

• UP-DETR: Unsupervised Pre-training for Object Detection with Transformers (UP-DETR - CVPR21) [paper] [code] [supp]
  More Info

  · · Author(s): Zhigang Dai, Bolun Cai, Yugeng Lin, Junying Chen
  · · Organization(s): School of Software Engineering, South China University of Technology; Tencent Wechat AI; Key Laboratory of Big Data and Intelligent Robot
  · · Description:
  · · Tags:

---

• Understanding the Behaviour of Contrastive Loss (**** - CVPR21) [paper] [No code] [supp]
  More Info

  · · Author(s): Feng Wang, Huaping Liu
  · · Organization(s): Beijing National Research Center for Information Science and Technology(BNRist), Department of Computer Science and Technology, Tsinghua University
  · · Description:
  · · Tags: Analysis

---

• Unsupervised Hyperbolic Metric Learning (**** - CVPR21) [paper] [code]
  More Info

  · · Author(s): Jiexi Yan, Lei Luo, Cheng Deng, Heng Huang
  · · Organization(s): Xidian University; University of Pittsburgh; JD Finance America Corporation, Mountain View
  · · Description:
  · · Tags: Metric Learning

---

• Relative Order Analysis and Optimization for Unsupervised Deep Metric Learning (ROUL - CVPR21) [paper] [No code] [supp]
  More Info

  · · Author(s): Shichao Kan, Yigang Cen, Yang Li, Vladimir Mladenovic, Zhihai He
  · · Organization(s): Beijing Jiaotong University; Beijing Key Laboratory of Advanced Information Science and Network Technology; University of Missouri; Faculty of Technical Sciences University of Kragujevac
  · · Description:
  · · Tags: Metric Learning

---

• Distill on the Go: Online Knowledge Distillation in Self-Supervised Learning (DoGo - CVPRW21) [paper]
  More Info

  · · Author(s): Prashant Bhat, Elahe Arani, Bahram Zonooz
  · · Organization(s): Advanced Research Lab, NavInfo Europe, Eindhoven, The Netherlands
  · · Description:
  · · Tags: distill

---

• DetCo: Unsupervised Contrastive Learning for Object Detection (DetCo - ICCV21) [paper] [code] [supp]
  More Info

  · · Author(s): Enze Xie, Jian Ding, Wenhai Wang, Xiaohang Zhan, Hang Xu, Peize Sun, Zhenguo Li, Ping Luo
  · · Organization(s): The University of Hong Kong; Huawei Noah’s Ark Lab; Wuhan University; Nanjing University; Chinese University of Hong Kong
  · · Description:
  · · Tags:

---

• Divide and Contrast: Self-supervised Learning from Uncurated Data (DnC - ICCV21) [paper] [No code] [supp]
  More Info

  · · Author(s): Yonglong Tian, Olivier J. Hénaff, Aäron van den Oord
  · · Organization(s): MIT; DeepMind
  · · Description:
  · · Tags: Uncurated data

---

• Improve Unsupervised Pretraining for Few-label Transfer (**** - ICCV21) [paper] [No code]
  More Info

  · · Author(s): Suichan Li, Dongdong Chen, Yinpeng Chen, Lu Yuan, Lei Zhang, Qi Chu, Bin Liu, Nenghai Yu
  · · Organization(s): University of Science and Technology of China; Microsoft Research
  · · Description:
  · · Tags:

---

• Self-Supervised Visual Representations Learning by Contrastive Mask Prediction (MaskCo - ICCV21) [paper] [No code] [supp]
  More Info

  · · Author(s): Yucheng Zhao, Guangting Wang, Chong Luo, Wenjun Zeng, Zheng-Jun Zha
  · · Organization(s): University of Science and Technology of China; Microsoft Research Asia
  · · Description:
  · · Tags: Local representation

---

• Mean Shift for Self-Supervised Learning (MSF - ICCV21) [paper] [code] [supp]
  More Info

  · · Author(s): Soroush Abbasi Koohpayegani, Ajinkya Tejankar, Hamed Pirsiavash
  · · Organization(s): University of Maryland, Baltimore County; University of California, Davis
  · · Description:
  · · Tags: Positive discovery

---

• On Compositions of Transformations in Contrastive Self-Supervised Learning (GDT - ICCV21) [paper] [code] [supp]
  More Info

  · · Author(s): Mandela Patrick, Yuki M. Asano, Polina Kuznetsova, Ruth Fong, João F. Henriques, Geoffrey Zweig, Andrea Vedaldi
  · · Organization(s): Facebook AI Research; Visual Geometry Group, University of Oxford
  · · Description:
  · · Tags:

---

• On Feature Decorrelation in Self-Supervised Learning (Shuffled-DBN - ICCV21) [paper] [No code]
  More Info

  · · Author(s): Tianyu Hua, Wenxiao Wang, Zihui Xue, Sucheng Ren, Yue Wang, Hang Zhao
  · · Organization(s): Tsinghua University; Shanghai Qi Zhi Institute; UT Austin; MIT; South China University of Technology
  · · Description:
  · · Tags:

---

• Self-supervised Product Quantization for Deep Unsupervised Image Retrieval (SPQ - ICCV21) [paper] [code]
  More Info

  · · Author(s): Young Kyun Jang, Nam Ik Cho
  · · Organization(s): Department of ECE, INMC, Seoul National University
  · · Description:
  · · Tags:

---

• With a Little Help from My Friends: Nearest-Neighbor Contrastive Learning of Visual Representations (NNCLR - ICCV21) [paper] [No code] [supp]
  More Info

  · · Author(s): Debidatta Dwibedi, Yusuf Aytar, Jonathan Tompson, Pierre Sermanet, Andrew Zisserman
  · · Organization(s): Google Research; DeepMind
  · · Description:
  · · Tags:

---

• Contrasting Contrastive Self-Supervised Representation Learning Pipelines (ViRB - ICCV21) [paper] [code] [supp]
  More Info

  · · Author(s): Klemen Kotar, Gabriel Ilharco, Ludwig Schmidt, Kiana Ehsani, Roozbeh Mottaghi
  · · Organization(s): PRIOR @ Allen Institute for AI; University of Washington
  · · Description:
  · · Tags: Analysis

---

• ISD: Self-Supervised Learning by Iterative Similarity Distillation (ISD - ICCV21) [paper] [code] [supp]
  More Info

  · · Author(s): Ajinkya Tejankar, Soroush Abbasi Koohpayegani, Vipin Pillai, Paolo Favaro, Hamed Pirsiavash
  · · Organization(s): University of Maryland, Baltimore County; University of Bern; University of California, Davis
  · · Description:
  · · Tags:

---

• CDS: Cross-Domain Self-supervised Pre-training (CDS - ICCV21) [paper] [code] [supp]
  More Info

  · · Author(s): Donghyun Kim, Kuniaki Saito, Tae-Hyun Oh, Bryan A. Plummer, Stan Sclaroff, Kate Saenko
  · · Organization(s): Boston University; POSTECH; MIT-IBM Watson AI Lab
  · · Description:
  · · Tags:

---

• Collaborative Unsupervised Visual Representation Learning from Decentralized Data (FedU - ICCV21) [paper] [No code] [supp]
  More Info

  · · Author(s): Weiming Zhuang, Xin Gan, Yonggang Wen, Shuai Zhang, Shuai Yi
  · · Organization(s): S-Lab, Nanyang Technological University; Nanyang Technological University; SenseTime Research
  · · Description:
  · · Tags:

---

• Weakly Supervised Contrastive Learning (WCL - ICCV21) [paper] [code]
  More Info

  · · Author(s): Mingkai Zheng, Fei Wang, Shan You, Chen Qian, Changshui Zhang, Xiaogang Wang, Chang Xu
  · · Organization(s): SenseTime Research; University of Science and Technology of China; Tsinghua University; The Chinese University of Hong Kong; The University of Sydney
  · · Description:
  · · Tags:

---

• Self-Supervised Representation Learning from Flow Equivariance (FlowE - ICCV21) [paper] [No code] [supp]
  More Info

  · · Author(s): Yuwen Xiong, Mengye Ren, Wenyuan Zeng, Raquel Urtasun
  · · Organization(s): Waabi; University of Toronto
  · · Description:
  · · Tags:

---

• Vi2CLR: Video and Image for Visual Contrastive Learning of Representation (Vi2CLR - ICCV21) [paper] [No code]
  More Info

  · · Author(s): Ali Diba, Vivek Sharma, Reza Safdari, Dariush Lotfi, Saquib Sarfraz, Rainer Stiefelhagen, Luc Van Gool
  · · Organization(s): KU Leuven; Sensifai; Karlsruhe Institute of Technology; Daimler TSS; Massachusetts Institute of Technology; Harvard Medical School; ETH Zurich
  · · Description:
  · · Tags:

---

• Solving Inefficiency of Self-supervised Representation Learning (truncated triplet - ICCV21) [paper] [code]
  More Info

  · · Author(s): Guangrun Wang, Keze Wang, Guangcong Wang, Philip H.S. Torr, Liang Lin
  · · Organization(s): Sun Yat-sen University; University of Oxford; Nanyang Technological University; DarkMatter AI Research
  · · Description:
  · · Tags:

---

• Instance Similarity Learning for Unsupervised Feature Representation (ISL - ICCV21) [paper] [code] [supp]
  More Info

  · · Author(s): Ziwei Wang, Yunsong Wang, Ziyi Wu, Jiwen Lu, Jie Zhou
  · · Organization(s): Tsinghua University; State Key Lab of Intelligent Technologies and Systems; Beijing National Research Center for Information Science and Technology
  · · Description:
  · · Tags:

---

• Improving Contrastive Learning by Visualizing Feature Transformation (**** - ICCV21 Oral) [paper] [code] [supp]
  More Info

  · · Author(s): Rui Zhu, Bingchen Zhao, Jingen Liu, Zhenglong Sun, Chang Wen Chen
  · · Organization(s): The Chinese University of HongKong, Shenzhen; JD AI Research; Tongji University; The Hong Kong Polytechnic University
  · · Description:
  · · Tags:

---

• Temporal Knowledge Consistency for Unsupervised Visual Representation Learning (TKC - ICCV21 Oral) [paper] [No code] [supp]
  More Info

  · · Author(s): Weixin Feng, Yuanjiang Wang, Lihua Ma, Ye Yuan, Chi Zhang
  · · Organization(s): Beijing University of Posts and Telecommunications; Megvii Technology
  · · Description:
  · · Tags:

---

• MultiSiam: Self-supervised Multi-instance Siamese Representation Learning for Autonomous Driving (MultiSiam - ICCV21) [paper] [code] [supp]
  More Info

  · · Author(s): Kai Chen, Lanqing Hong, Hang Xu, Zhenguo Li, Dit-Yan Yeung
  · · Organization(s): Hong Kong University of Science and Technology; Huawei Noah’s Ark Lab
  · · Description:
  · · Tags: Local representation

---

• Region Similarity Representation Learning(ReSim - ICCV21) [paper] [code] [supp]
  More Info

  · · Author(s): Tete Xiao, Colorado J Reed, Xiaolong Wang, Kurt Keutzer, Trevor Darrell
  · · Organization(s): UC Berkeley; UC San Diego
  · · Description:
  · · Tags:

---

• Efficient Visual Pretraining With Contrastive Detection(DetCon - ICCV21) [paper] [supp]
  More Info

  · · Author(s): Olivier J. Hénaff, Skanda Koppula, Jean-Baptiste Alayrac, Aaron van den Oord, Oriol Vinyals, João Carreira
  · · Organization(s): DeepMind
  · · Description:
  · · Tags: Dense

---

• An Empirical Study of Training Self-Supervised Vision Transformers(MoCo-v3 - ICCV21) [paper] [unofficial code] [supp]
  More Info

  · · Author(s): Xinlei Chen, Saining Xie, Kaiming He
  · · Organization(s): Facebook AI Research (FAIR)
  · · Description:
  · · Tags:

---

• Emerging Properties in Self-Supervised Vision Transformers(DINO - ICCV21) [paper] [code] [supp]
  More Info

  · · Author(s): Mathilde Caron, Hugo Touvron, Ishan Misra, Hervé Jégou, Julien Mairal, Piotr Bojanowski, Armand Joulin
  · · Organization(s): Facebook AI Research; Inria∗; Sorbonne University
  · · Description:
  · · Tags:

---

• A Broad Study on the Transferability of Visual Representations with Contrastive Learning (**** - ICCV21) [paper] [code] [supp]
  More Info

  · · Author(s): Ashraful Islam, Chun-Fu (Richard) Chen, Rameswar Panda, Leonid Karlinsky, Richard Radke, Rogerio Feris
  · · Organization(s): Rensselaer Polytechnic Institute; MIT-IBM Watson AI Lab; IBM Research
  · · Description:
  · · Tags:

---

• Concept Generalization in Visual Representation Learning (CoG - ICCV21) [paper] [code] [supp]
  More Info

  · · Author(s): Mert Bulent Sariyildiz, Yannis Kalantidis, Diane Larlus, Karteek Alahari
  · · Organization(s): NAVER LABS Europe; Inria
  · · Description:
  · · Tags:

---

• Concurrent Discrimination and Alignment for Self-Supervised Feature Learning (CODIAL - ICCVW21) [paper] [code]
  More Info

  · · Author(s): Anjan Dutta, Massimiliano Mancini, Zeynep Akata
  · · Organization(s): University of Exeter; University of T¨ubingen
  · · Description:
  · · Tags:

2020

---

• A critical analysis of self-supervision, or what we can learn from a single image (**** - ICLR20 ) [paper]
  More Info

  · · Author(s): Asano YM., Rupprecht C., Vedaldi A.
  · · Organization(s): VGG, University of Oxford
  · · Description:
  · · Tags: Analysis

---

• On Mutual Information Maximization for Representation Learning (**** - ICLR20 ) [paper]
  More Info

  · · Author(s): Michael Tschannen, Josip Djolonga, Paul K. Rubenstein, Sylvain Gelly, Mario Lucic
  · · Organization(s): Google Research
  · · Description:
  · · Tags: Analysis

---

• Self-labelling via simultaneous clustering and representation learning (SeLa - ICLR20 Spotlight) [paper] [code]
  More Info

  · · Author(s): Asano YM., Rupprecht C., Vedaldi A.
  · · Organization(s): VGG, University of Oxford
  · · Description:
  · · Tags: Clustering

---

• Unsupervised Learning of Dense Visual Representations (VADeR - NeurIPS20) [paper]
  More Info

  · · Author(s): Pedro O. O. Pinheiro, Amjad Almahairi, Ryan Benmalek, Florian Golemo, Aaron C. Courville
  · · Organization(s): Element AI; Cornell University; Mila, Université de Montréal; CIFAR Fellow
  · · Description:
  · · Tags: Dense

---

• CompRess: Self-Supervised Learning by Compressing Representations (CompRess - NeurIPS20) [paper] [code]
  More Info

  · · Author(s): Soroush Abbasi Koohpayegani, Ajinkya Tejankar, Hamed Pirsiavash
  · · Organization(s): University of Maryland
  · · Description:
  · · Tags: self-supervised distillation

---

• Unsupervised Representation Learning by Invariance Propagation (InvPro - NeurIPS20) [paper] [code]
  More Info

  · · Author(s): Feng Wang, Huaping Liu, Di Guo, Sun Fuchun
  · · Organization(s): Tsinghua University
  · · Description:
  · · Tags:

---

• Joint Contrastive Learning with Infinite Possibilities (JCL - NeurIPS20) [paper] [code]
  More Info

  · · Author(s): Qi Cai, Yu Wang, Yingwei Pan, Ting Yao, Tao Mei
  · · Organization(s): University of Science and Technology of China; JD AI Research
  · · Description:
  · · Tags:

---

• Unsupervised Learning of Visual Features by Contrasting Cluster Assignments (SwAV - NeurIPS20) [paper] [code]
  More Info

  · · Author(s): Mathilde Caron, Ishan Misra, Julien Mairal, Priya Goyal, Piotr Bojanowski, Armand Joulin
  · · Organization(s): Inria; Facebook AI Research
  · · Description:
  · · Tags:

---

• Self-Supervised Visual Representation Learning from Hierarchical Grouping (**** - NeurIPS20) [paper]
  More Info

  · · Author(s): Xiao Zhang, Michael Maire
  · · Organization(s): University of Chicago
  · · Description:
  · · Tags: Pixel, Local

---

• Parametric Instance Classification for Unsupervised Visual Feature learning (PIC - NeurIPS20) [paper]
  More Info

  · · Author(s): Yue Cao, Zhenda Xie, Bin Liu, Yutong Lin, Zheng Zhang, Han Hu
  · · Organization(s): Microsoft Research Asia; Tsinghua University; Xi’an Jiaotong University
  · · Description:
  · · Tags:

---

• Hard Negative Mixing for Contrastive Learning (MoCHi - NeurIPS20) [paper] [code]
  More Info

  · · Author(s): Yannis Kalantidis, Mert Bulent Sariyildiz, Noe Pion, Philippe Weinzaepfel, Diane Larlus
  · · Organization(s): NAVER LABS Europe
  · · Description:
  · · Tags:

---

• What Makes for Good Views for Contrastive Learning? (InfoMin - NeurIPS20) [paper] [code]
  More Info

  · · Author(s): Yonglong Tian, Chen Sun, Ben Poole, Dilip Krishnan, Cordelia Schmid, Phillip Isola
  · · Organization(s): MIT; Google Research
  · · Description:
  · · Tags:

---

• Debiased Contrastive Learning (DCL - NeurIPS20) [paper] [code]
  More Info

  · · Author(s): Ching-Yao Chuang, Joshua Robinson, Yen-Chen Lin, Antonio Torralba, Stefanie Jegelka
  · · Organization(s): Massachusetts Institute of Technology
  · · Description:
  · · Tags: False negative

---

• Bootstrap Your Own Latent - A New Approach to Self-Supervised Learning (BYOL - NeurIPS20) [paper] [code]
  More Info

  · · Author(s): Jean-Bastien Grill, Florian Strub, Florent Altché, Corentin Tallec, Pierre Richemond, Elena Buchatskaya, Carl Doersch, Bernardo Avila Pires, Zhaohan Guo, Mohammad Gheshlaghi Azar, Bilal Piot, koray kavukcuoglu, Remi Munos, Michal Valko
  · · Organization(s): DeepMind; Imperial College
  · · Description:
  · · Tags: Siamese architecture

---

• MixCo: Mix-up Contrastive Learning for Visual Representation (MixCo - NeurIPSW20) [paper] [code]
  More Info

  · · Author(s): Sungnyun Kim, Gihun Lee, Sangmin Bae, Se-Young Yun
  · · Organization(s): KAIST
  · · Description:
  · · Tags:

---

• Improved Baselines with Momentum Contrastive Learning (MoCo v2 - arXiv20) [paper] [code]
  More Info

  · · Author(s): Xinlei Chen, Haoqi Fan, Ross Girshick, Kaiming He
  · · Organization(s): Facebook AI Research (FAIR)
  · · Description:
  · · Tags: InfoNCE loss, siamese architecture

---

• Momentum Contrast for Unsupervised Visual Representation Learning (MoCo - CVPR20 Oral) [paper] [code] [supp]
  More Info

  · · Author(s): Kaiming He, Haoqi Fan, Yuxin Wu, Saining Xie, Ross Girshick
  · · Organization(s): Facebook AI Research (FAIR)
  · · Description: Building a dynamic dictionary with a queue and a moving-averaged encoder
  · · Tags: InfoNCE loss, siamese architecture

---

• Online Deep Clustering for Unsupervised Representation Learning (ODC - CVPR20 Oral) [paper] [code]
  More Info

  · · Author(s): Xiaohang Zhan, Jiahao Xie, Ziwei Liu, Yew-Soon Ong, Chen Change Loy
  · · Organization(s): CUHK - SenseTime Joint Lab, The Chinese University of Hong Kong; Nanyang Technological University; AI3, A*STAR
  · · Description:
  · · Tags:

---

• Steering Self-Supervised Feature Learning Beyond Local Pixel Statistics (LCI - CVPR20) [paper] [code] [supp]
  More Info

  · · Author(s): Simon Jenni, Hailin Jin, Paolo Favaro
  · · Organization(s): University of Bern; Adobe Research
  · · Description:
  · · Tags:

---

• Learning Representations by Predicting Bags of Visual Words (BoWNet - CVPR20) [paper] [code] [supp]
  More Info

  · · Author(s): Spyros Gidaris, Andrei Bursuc, Nikos Komodakis, Patrick Perez, Matthieu Cord
  · · Organization(s): Valeo.ai; University of Crete
  · · Description:
  · · Tags:

---

• Probabilistic Structural Latent Representation for Unsupervised Embedding (PSLR - CVPR20) [paper] [code]
  More Info

  · · Author(s): Mang Ye, Jianbing Shen
  · · Organization(s): Inception Institute of Artificial Intelligence
  · · Description:
  · · Tags:

---

• Self-Supervised Learning of Pretext-Invariant Representations (PIRL - CVPR20) [paper] [unofficial code]
  More Info

  · · Author(s): Ishan Misra, Laurens van der Maaten
  · · Organization(s): Facebook AI Research
  · · Description:
  · · Tags:

---

• How Useful is Self-Supervised Pretraining for Visual Tasks? (**** - CVPR20) [paper] [code] [supp]
  More Info

  · · Author(s): Alejandro Newell, Jia Deng
  · · Organization(s): Princeton University
  · · Description:
  · · Tags: Analysis

---

• SCAN: Learning to Classify Images without Labels (SCAN - ECCV20) [paper] [code] [arxiv]
  More Info

  · · Author(s): Wouter Van Gansbeke, Simon Vandenhende, Stamatios Georgoulis, Marc Proesmans, Luc Van Gool
  · · Organization(s): KU Leuven/ESAT-PSI; ETH Zurich/CVL, TRACE
  · · Description:
  · · Tags:

---

• Contrastive Multiview Coding (CMC - ECCV20) [paper] [code] [arxiv]
  More Info

  · · Author(s): Yonglong Tian, Dilip Krishnan, Phillip Isola
  · · Organization(s): MIT CSAIL; Google Research
  · · Description:
  · · Tags:

---

• Mitigating Embedding and Class Assignment Mismatch in Unsupervised Image Classification (**** - ECCV20) [paper] [code] [No arxiv]
  More Info

  · · Author(s): Sungwon Han, Sungwon Park, Sungkyu Park, Sundong Kim, Meeyoung Cha
  · · Organization(s): Korea Advanced Institute of Science and Technology; Data Science Group, Institute for Basic Science
  · · Description:
  · · Tags:

---

• Unsupervised Deep Metric Learning with Transformed Attention Consistency and Contrastive Clustering Loss (**** - ECCV20) [paper] [No code]
  More Info

  · · Author(s): Yang Li, Shichao Kan, Zhihai He
  · · Organization(s): University of Missouri; Beijing Jiaotong University
  · · Description:
  · · Tags:

---

• Unsupervised Image Classification for Deep Representation Learning (**** - ECCVW20) [paper] [No code] [arxiv]
  More Info

  · · Author(s): Weijie Chen, Shiliang Pu, Di Xie, Shicai Yang, Yilu Guo, Luojun Lin
  · · Organization(s): Hikvision Research Institute; School of Electronic and Information Engineering, South China University of Technology
  · · Description:
  · · Tags:

2019

---

• Learning deep representations by mutual information estimation and maximization (DIM - ICLR19 Oral) [paper]
  More Info

  · · Author(s): R Devon Hjelm, Alex Fedorov, Samuel Lavoie-Marchildon, Karan Grewal, Phil Bachman, Adam Trischler, Yoshua Bengio
  · · Organization(s): MSR Montreal; MILA; UdeM; IVADO; UNM; U Toronto
  · · Description:
  · · Tags:

---

• Learning Representations by Maximizing Mutual Information Across Views (AMDIM - NeurIPS19) [paper] [code]
  More Info
  · · Author(s): Philip Bachman, R Devon Hjelm, William Buchwalte
  · · Organization(s): Microsoft Research
  · · Description:
  · · Tags:

---

• Large Scale Adversarial Representation Learning (BigBiGAN - NeurIPS19) [paper]
  More Info
  · · Author(s): Jeff Donahue, Karen Simonyan
  · · Organization(s): DeepMind
  · · Description:
  · · Tags: Generative

---

• Unsupervised Embedding Learning via Invariant and Spreading Instance Feature (ISIF - CVPR19) [paper] [code]
  More Info

  · · Author(s): Mang Ye, Xu Zhang, Pong C. Yuen, Shih-Fu Chang
  · · Organization(s): Hong Kong Baptist University; Columbia University
  · · Description: Learning augmentation invariant and instance spread-out features
  · · Tags: Siamese architecture

---

• Self-Supervised Representation Learning by Rotation Feature Decoupling (FeatureDecoupling - CVPR19) [paper] [code] [supp]
  More Info

  · · Author(s): Zeyu Feng, Chang Xu, Dacheng Tao
  · · Organization(s): UBTECH Sydney AI Centre, School of Computer Science; University of Sydney
  · · Description:
  · · Tags:

---

• Iterative Reorganization with Weak Spatial Constraints: Solving Arbitrary Jigsaw Puzzles for Unsupervised Representation Learning (**** - CVPR19) [paper] [No code]
  More Info

  · · Author(s): Chen Wei, Lingxi Xie, Xutong Ren, Yingda Xia, Chi Su, Jiaying Liu, Qi Tian, Alan L. Yuille
  · · Organization(s): Peking University; The Johns Hopkins University; Kingsoft; Huawei Noah’s Ark Lab
  · · Description:
  · · Tags:

---

• Self-Supervised GANs via Auxiliary Rotation Loss (SS-GAN - CVPR19) [paper] [code] [supp]
  More Info

  · · Author(s): Ting Chen, Xiaohua Zhai, Marvin Ritter, Mario Lucic, Neil Houlsby
  · · Organization(s): University of California, Los Angeles; Google Brain
  · · Description:
  · · Tags: GAN

---

• AET vs. AED: Unsupervised Representation Learning by Auto-Encoding Transformations rather than Data (AET - CVPR19) [paper] [code]
  More Info

  · · Author(s): Liheng Zhang, Guo-Jun Qi, Liqiang Wang, Jiebo Luo
  · · Organization(s): Huawei Cloud; University of Central Florida; University of Rochester
  · · Description:
  · · Tags:

---

• Revisiting Self-Supervised Visual Representation Learning (**** - CVPR19) [paper] [code] [supp]
  More Info

  · · Author(s): Alexander Kolesnikov, Xiaohua Zhai, Lucas Beyer
  · · Organization(s): Google Brain
  · · Description:
  · · Tags: Revisiting

---

• Local Aggregation for Unsupervised Learning of Visual Embeddings (LA - ICCV19 Oral) [paper] [code] [supp]
  More Info

  · · Author(s): Chengxu Zhuang, Alex Lin Zhai, Daniel Yamins
  · · Organization(s): Stanford University
  · · Description:
  · · Tags: Clustering

---

• S4L: Self-Supervised Semi-Supervised Learning (S4L - ICCV19) [paper] [code] [supp]
  More Info

  · · Author(s): Xiaohua Zhai, Avital Oliver, Alexander Kolesnikov, Lucas Beyer
  · · Organization(s): Google Research, Brain Team
  · · Description:
  · · Tags:

---

• AVT: Unsupervised Learning of Transformation Equivariant Representations by Autoencoding Variational Transformations (AVT - ICCV19) [paper] [code] [supp]
  More Info

  · · Author(s): Guo-Jun Qi, Liheng Zhang, Chang Wen Chen, Qi Tian
  · · Organization(s): G1Laboratory for MAchine Perception and LEarning (MAPLE); Huawei Cloud; Huawei Noah’s Ark Lab; The Chinese University of Hong Kong at Shenzhen and Peng Cheng Laboratory
  · · Description:
  · · Tags:

---

• Self-Supervised Representation Learning via Neighborhood-Relational Encoding (NRE - ICCV19) [paper] [No code]
  More Info

  · · Author(s): Mohammad Sabokrou, Mohammad Khalooei, Ehsan Adeli
  · · Organization(s): Institute for Research in Fundamental Sciences; Amirkabir University of Tech.; Stanford University
  · · Description:
  · · Tags:

---

• Unsupervised Pre-Training of Image Features on Non-Curated Data (DeeperCluster - ICCV19) [paper] [code] [supp]
  More Info

  · · Author(s): Mathilde Caron, Piotr Bojanowski, Julien Mairal, Armand Joulin
  · · Organization(s): Facebook AI Research; Univ. Grenoble Alpes, Inria, CNRS, Grenoble INP, LJK
  · · Description:
  · · Tags: Clustering

---

• Scaling and Benchmarking Self-Supervised Visual Representation Learning (**** - ICCV19) [paper] [code]
  More Info

  · · Author(s): Priya Goyal, Dhruv Mahajan, Abhinav Gupta, Ishan Misra
  · · Organization(s): Facebook AI Research
  · · Description:
  · · Tags:

2018

---

• Unsupervised Representation Learning by Predicting Image Rotations (RotNet - ICLR18) [paper] [code]
  More Info

  · · Author(s): Spyros Gidaris, Praveer Singh, Nikos Komodakis
  · · Organization(s): University Paris-Est; Ecole des Ponts ParisTech
  · · Description:
  · · Tags:

---

• Unsupervised Feature Learning via Non-Parametric Instance Discrimination ( InsDis - CVPR18 Spotlight) [paper] [code]
  More Info

  · · Author(s): Zhirong Wu, Yuanjun Xiong, Stella X. Yu, Dahua Lin
  · · Organization(s): UC Berkeley/ICSI; Chinese University of Hong Kong; Amazon Rekognition
  · · Description:
  · · Tags: Contrastive learning, single branch

---

• Improvements to context based self-supervised learning ( **** - CVPR18) [paper] [code] [supp]
  More Info

  · · Author(s): T. Nathan Mundhenk, Daniel Ho, Barry Y. Chen
  · · Organization(s): Lawrence Livermore National Laboratory; University of California, Berkeley
  · · Description:
  · · Tags:

---

• Self-Supervised Feature Learning by Learning to Spot Artifacts ( **** - CVPR18) [paper] [code]
  More Info

  · · Author(s): Simon Jenni, Paolo Favaro
  · · Organization(s): University of Bern
  · · Description:
  · · Tags:

---

• Boosting Self-Supervised Learning via Knowledge Transfer ( **** - CVPR18) [paper] [No code]
  More Info

  · · Author(s): Mehdi Noroozi, Ananth Vinjimoor, Paolo Favaro, Hamed Pirsiavash
  · · Organization(s): University of Bern; University of Maryland, Baltimore County
  · · Description:
  · · Tags: Self-supervised Distillation

---

• Deep Clustering for Unsupervised Learning of Visual Features ( DeepCluster - ECCV18) [paper] [code]
  More Info

  · · Author(s): Caron, Mathilde and Bojanowski, Piotr and Joulin, Armand and Douze, Matthijs
  · · Organization(s): Facebook AI Research
  · · Description:
  · · Tags:

2017

---

• Adversarial Feature Learning (BiGANs - ICLR18) [paper]
  More Info

  · · Author(s): Jeff Donahue, Philipp Krähenbühl, Trevor Darrell
  · · Organization(s): University of California, Berkeley; University of Texas, Austin
  · · Description:
  · · Tags:

---

• Split-Brain Autoencoders: Unsupervised Learning by Cross-Channel Prediction (Split-Brain Auto - CVPR17 ) [paper] [code]
  More Info

  · · Author(s): Richard Zhang, Phillip Isola, Alexei A. Efros
  · · Organization(s): Berkeley AI Research (BAIR) Laboratory, University of California, Berkeley
  · · Description:
  · · Tags: Pretext task

---

• Representation Learning by Learning to Count (**** - ICCV17 ) [paper] [unofficial code]
  More Info

  · · Author(s): Mehdi Noroozi, Hamed Pirsiavash, Paolo Favaro
  · · Organization(s): University of Bern; University of Maryland, Baltimore County
  · · Description:
  · · Tags: Pretext task

---

• Transitive Invariance for Self-supervised Visual Representation Learning (**** - ICCV17 ) [paper] [No code]
  More Info

  · · Author(s): Xiaolong Wang, Kaiming He, Abhinav Gupta
  · · Organization(s): Carnegie Mellon University; Facebook AI Research
  · · Description:
  · · Tags:

---

• Multi-task Self-Supervised Visual Learning (**** - ICCV17 ) [paper] [code]
  More Info

  · · Author(s): Carl Doersch, Andrew Zisserman
  · · Organization(s): DeepMind; VGG, Department of Engineering Science, University of Oxford
  · · Description:
  · · Tags:

2016

---

• Discriminative Unsupervised Feature Learning with Exemplar Convolutional Neural Networks (ExemplarCNN - TPAMI16 ) [paper]
  More Info

  · · Author(s): Alexey Dosovitskiy, Philipp Fischer, Jost Tobias Springenberg, Martin Riedmiller, Thomas Brox
  · · Organization(s): Computer Science Department, University of Freiburg
  · · Description:
  · · Tags: Pretext task, Instance Discrimination

---

• Context Encoders: Feature Learning by Inpainting (Inpainting - CVPR16 ) [paper] [unofficial code]
  More Info

  · · Author(s): Deepak Pathak, Philipp Krahenbuhl, Jeff Donahue, Trevor Darrell, Alexei A. Efros
  · · Organization(s): University of California, Berkeley
  · · Description:
  · · Tags: Pretext task

---

• Unsupervised Learning of Discriminative Attributes and Visual Representations (**** - CVPR16 ) [paper] [No code]
  More Info

  · · Author(s): Chen Huang, Chen Change Loy, Xiaoou Tang
  · · Organization(s): The Chinese University of Hong Kong; SenseTime Group Limited; Shenzhen Institutes of Advanced Technology, Chinese Academy of Sciences
  · · Description:
  · · Tags:

---

• Unsupervised Learning of Visual Representations by Solving Jigsaw Puzzles (Jigsaw - ECCV16 ) [paper] [unofficial code] [arxiv]
  More Info

  · · Author(s): Mehdi Noroozi, Paolo Favaro
  · · Organization(s): Institute for Informatiks, University of Bern
  · · Description:
  · · Tags: Pretext task

---

• Unsupervised Visual Representation Learning by Graph-based Consistent Constraints (**** - ECCV16 ) [paper] [No code]
  More Info

  · · Author(s): Dong Li, Wei-Chih Hung, Jia-Bin Huang, Shengjin Wang, Narendra Ahuja; Ming-Hsuan Yang
  · · Organization(s): Tsinghua University; University of California, Merced; University of Illinois, Urbana-Champaign
  · · Description:
  · · Tags:

---

• Colorful Image Colorization (**** - ECCV16 ) [paper] [code]
  More Info

  · · Author(s): Richard Zhang, Phillip Isola, Alexei A. Efros
  · · Organization(s): University of California, Berkeley
  · · Description:
  · · Tags:

2015

---

• Unsupervised Visual Representation Learning by Context Prediction (Context - ICCV15 ) [paper] [code]
  More Info

  · · Author(s): Carl Doersch, Abhinav Gupta, Alexei A. Efros
  · · Organization(s): Institute for Informatiks, University of Bern
  · · Description:
  · · Tags: Pretext task

---

• Learning to See by Moving (**** - ICCV15 ) [paper] [code]
  More Info

  · · Author(s): Pulkit Agrawal, Joao Carreira, Jitendra Malik
  · · Organization(s): UC Berkeley
  · · Description:
  · · Tags:

---

• Unsupervised Learning of Visual Representations using Videos (**** - ICCV15 ) [paper] [unofficial code]
  More Info

  · · Author(s): Xiaolong Wang, Abhinav Gupta
  · · Organization(s): Robotics Institute, Carnegie Mellon University
  · · Description:
  · · Tags:

2014

---

• Discriminative Unsupervised Feature Learning with Convolutional Neural Networks (ExemplarCNN - NeurIPS14 ) [paper] [unofficial code] [supp]
  More Info

  · · Author(s): Alexey Dosovitskiy, Jost Tobias Springenberg, Martin A. Riedmiller, Thomas Brox
  · · Organization(s): Computer Science Department, University of Freiburg
  · · Description:
  · · Tags: Pretext task, Instance Discrimination

---

UVRL is also closely related to some other research directions, such as Unsupervised Person (Object or Vehicle) Re-Identification, Unsupervised Semantic Segmentation, Unsupervised Domain Adaptation, Knowledge Distillation, Deep Clustering, Unsupervised Metric (Embedding) Learning, Semi-supervised Learning, Novel Categories (Classes) Discovery, etc.

Some Influential Repositories

---

• awesome-self-supervised-learning (star 5.6k) [link]

• Awesome-Knowledge-Distillation (star 2.2k) [link]

• DeepClustering (star 2.4k) [link]

• awesome-metric-learning [link]

• Awesome-Unsupervised-Person-Re-identification [link]

• Awesome-Novel-Class-Discovery [link]

Thanks for the support of Prof. Yu Zhou.