SITTA: Single Image Texture Translation for Data Augmentation

Research output: Chapter in Book/Report/Conference proceedingArticle in proceedingsResearchpeer-review

Documents

  • Fulltext

    Submitted manuscript, 6.65 MB, PDF document

Recent advances in data augmentation enable one to translate images by learning the mapping between a source domain and a target domain. Existing methods tend to learn the distributions by training a model on a variety of datasets, with results evaluated largely in a subjective manner. Relatively few works in this area, however, study the potential use of image synthesis methods for recognition tasks. In this paper, we propose and explore the problem of image translation for data augmentation. We first propose a lightweight yet efficient model for translating texture to augment images based on a single input of source texture, allowing for fast training and testing, referred to as Single Image Texture Translation for data Augmentation (SITTA). Then we explore the use of augmented data in long-tailed and few-shot image classification tasks. We find the proposed augmentation method and workflow is capable of translating the texture of input data into a target domain, leading to consistently improved image recognition performance. Finally, we examine how SITTA and related image translation methods can provide a basis for a data-efficient, “augmentation engineering” approach to model training.

Original languageEnglish
Title of host publicationComputer Vision – ECCV 2022 Workshops, Proceedings : Tel Aviv, Israel, October 23–27, 2022, Proceedings, Part II
EditorsLeonid Karlinsky, Tomer Michaeli, Ko Nishino
Number of pages18
PublisherSpringer
Publication date2023
Pages3-20
ISBN (Print)9783031250620
DOIs
Publication statusPublished - 2023
Event17th European Conference on Computer Vision, ECCV 2022 - Tel Aviv, Israel
Duration: 23 Oct 202227 Oct 2022

Conference

Conference17th European Conference on Computer Vision, ECCV 2022
LandIsrael
ByTel Aviv
Periode23/10/202227/10/2022
SeriesLecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
Volume13802 LNCS
ISSN0302-9743

Bibliographical note

Funding Information:
Acknowledgement. This work was supported in part by the Pioneer Centre for AI, DNRF grant number P1.

Publisher Copyright:
© 2023, The Author(s), under exclusive license to Springer Nature Switzerland AG.

ID: 389598422