Awesome-Unsupervised-Semantic-Segmentation

This is a summary of recent unsupervised semantic segmentation methods.

PaperWithCode

Unsupervised Semantic Segmentation

Large-Scale Unsupervised Semantic Segmentation

Datasets

ImageNet-S

Dataset	category	train	val	test
ImageNet-S 50	50	64431	752	1682
ImageNet-S 300	300	384862	4097	9088
ImageNet-S	919	1183322	12419	27423

2023

Leveraging Hidden Positives for Unsupervised Semantic Segmentation

Title	Abbreviation	Published	Dataset	CODE	PDF
Leveraging Hidden Positives for Unsupervised Semantic Segmentation	HP	CVPR2023	COCO, Cityscapes, Potsdam	pytorch	paper
ACSeg: Adaptive Conceptualization for Unsupervised Semantic Segmentation	ACSeg	CVPR2023	VOC, COCO		paper
Unsupervised Semantic Segmentation with Self-supervised Object-centric Representation	COMUS	ICLR2023	VOC, COCO		paper

2022

Title	Abbreviation	Published	Dataset	CODE	PDF
Large-scale Unsupervised Semantic Segmentation	PASS	TPAMI2022	ImageNet-S	pytorch | jittor	paper
Discovering Object Masks with Transformers for Unsupervised Semantic Segmentation	MaskDistill	arxiv	VOC, COCO		paper
Self-Supervised Learning of Object Parts for Semantic Segmentation	Leopart	CVPR2022	VOC, COCO, ImageNet-100	pytorch	paper
Deep Spectral Methods: A Surprisingly Strong Baseline for Unsupervised Semantic Segmentation and Localization	-	CVPR2022	VOC, COCO	pytorch	paper
Unsupervised Hierarchical Semantic Segmentation with Multiview Cosegmentation and Clustering Transformer	HSG	CVPR2022	VOC, COCO, Cityscapes, Potsdam, KITTI-STEP	pytorch	paper
TransFGU: A Top-down Approach to Fine-Grained Unsupervised Semantic Segmentation	TransFGU	ECCV2022	VOC, COCO, Cityscapes, LIP	pytorch	paper
Unsupervised Semantic Segmentation by Distilling Feature Correspondences	STEGO	ICLR2022	COCO, Cityscapes	pytorch	paper
Unsupervised Image Semantic Segmentation through Superpixels and Graph Neural Networks	SGSeg	arxiv	COCO, Potsdam		paper
Rethinking Alignment and Uniformity in Unsupervised Image Semantic Segmentation	SAN	arxiv	COCO, Cityscapes, Potsdam		paper
Fully Self-Supervised Learning for Semantic Segmentation	FS4	arxiv	COCO		paper

2021

Title	Abbreviation	Published	Dataset	CODE	PDF
Unsupervised Semantic Segmentation by Contrasting Object Mask Proposals	MaskContrast	ICCV2021	VOC	pytorch	paper
PiCIE: Unsupervised Semantic Segmentation using Invariance and Equivariance in Clustering	PICIE	CVPR2021	COCO, Cityscapes	pytorch	paper
InfoSeg: Unsupervised Semantic Image Segmentation with Mutual Information Maximization	InfoSeg	GCPR2021	COCO, Potsdam		paper
Unsupervised Image Segmentation by Mutual Information Maximization and Adversarial Regularization	InMARS	RA-L2021	COCO, Potsdam		paper

2020

Title	Abbreviation	Published	Dataset	CODE	PDF
Self-Supervised Visual Representation Learning from Hierarchical Grouping	-	NIPS2020	VOC, COCO		paper
Autoregressive Unsupervised Image Segmentation	AC	ECCV2020	COCO, Potsdam	pytorch	paper

2019

Title	Abbreviation	Published	Dataset	CODE	PDF
Invariant Information Clustering for Unsupervised Image Classification and Segmentation	IIC	ICCV2019	COCO, Potsdam	pytorch	paper
SegSort: Segmentation by Discriminative Sorting of Segments	SegSort	ICCV2019	VOC	tensorflow	paper