Product image representation learning on large scale noisy datasets

2023
Download Copy BibTeX
Copy BibTeX
Learning product similarity using distance metric learning from real world catalog needs to take care of large number of product categories and noisy labels. On one hand, large number of product categories makes online hard mining (OHM) less effective as hard triplets become sparse and thus difficult to find. On the other hand, the validity of the hard-triplets themselves is less certain in the case of noisy labelled training data. In this paper, we address the problem of large-scale product representation learning in the presence of noisy training data. To address these challenges, we propose a novel co-teaching based label correction scheme for distance metric learning, that is motivated by the inconsistencies of variations relationships in the product catalog. To validate our approach, we conducted experiments on 20 different product categories, where we achieve up to 4% improvement in PR-AUC compared to the SOTA baseline and conclude by discussing the durable learnings we gained from these experiments and directions for future research.
Research areas

Latest news

GB, MLN, Edinburgh
We’re looking for a Machine Learning Scientist in the Personalization team for our Edinburgh office experienced in generative AI and large models. You will be responsible for developing and disseminating customer-facing personalized recommendation models. This is a hands-on role with global impact working with a team of world-class engineers and scientists across the Edinburgh offices and wider organization. You will lead the design of machine learning models that scale to very large quantities of data, and serve high-scale low-latency recommendations to all customers worldwide. You will embody scientific rigor, designing and executing experiments to demonstrate the technical efficacy and business value of your methods. You will work alongside aRead more