StFT: Style loss and Fourier transformation for domain gap reduction
2022
This work explores the usage of Fourier Transform in conjunction with Triplet loss applied on image styles, for reduction of the domain gap between the Source (e.g. Product Images in natural setting) and Target domain (e.g. Product Images on Ecommerce store pages) towards solving the Domain Adaptation problem. Most Unsupervised Domain Adaptation (UDA) algorithms reduce the domain gap between labelled Source domain and the unlabelled Target domain by matching their marginal distribution. UDA is of special interest for several ecommerce applications. An example of this can be identification of live item image captured by a customer. Such identification can help in display of relevant selections available with the ecommerce stores. UDA algorithm performances degrade when the domain shift between the Source and Target domain is substantial. To improve the predictive performance of the existing single source single target UDA algorithms the proposed method StFT attempts to reduce the domain gap between the Source and Target domain via low-frequency component swapping and target style enforcement in the feature space upon training image via triplet loss. The proposed technique can be added on top of existing UDA methods. This leads to improvement in their performance without much increase in computational cost. We have evaluated the proposed method for Office-31 data set with the Amazon domain acting as either source or target domain.
Research areas