Single Image Test-Time Adaptation for Segmentation

Klara Janouskova, Tamir Shor, Chaim Baskin, Jiri Matas

Research output: Contribution to journalArticlepeer-review

Abstract

Test-Time Adaptation (TTA) methods improve domain shift robustness of deep neural networks. We explore the adaptation of segmentation models to a single unlabelled image with no other data available at test time. This allows individual sample performance analysis while excluding orthogonal factors such as weight restart strategies. We propose two new segmentation TTA methods and compare them to established baselines and recent stateof-the-art. The methods are first validated on synthetic domain shifts and then tested on real-world datasets. The analysis highlights that simple modifications such as the choice of the loss function can greatly improve the performance of standard baselines. and that di erent methods and hyper-parameters are optimal for di erent kinds of domain shift, hindering the development of fully general methods applicable in situations where no prior knowledge about the domain shift is assumed. Code and data: https://klarajanouskova.github.io/sitta-seg/.

Original languageEnglish
JournalTransactions on Machine Learning Research
Volume2024
StatePublished - 1 Jan 2024
Externally publishedYes

ASJC Scopus subject areas

  • Artificial Intelligence
  • Computer Vision and Pattern Recognition

Fingerprint

Dive into the research topics of 'Single Image Test-Time Adaptation for Segmentation'. Together they form a unique fingerprint.

Cite this