Skip to content

A New Similarity Space Tailored for Supervised Deep Metric Learning

Pedro Barros, Fabiane Queiroz, Flávio Figueiredo, Jefersson A. Dos Santos, Heitor Ramos.

ACM Transactions on Intelligent Systems and Technology, v.14, issue 1, article 16, pp. 1–25, 2022.

https://dl.acm.org/doi/10.1145/3559766

Abstract

We propose a novel deep metric learning method. Differently from many works in this area, we define a novel latent space obtained through an autoencoder. The new space, namely S-space, is divided into different regions describing positions where pairs of objects are similar/dissimilar. We locate makers to identify these regions and estimate the similarities between objects through a kernel-based Cauchy distribution to measure the markers’ distance and the new data representation. In our approach, we simultaneously estimate the markers’ position in the S-space and represent the objects in the same space. Moreover, we propose a new regularization function to prevent similar markers from collapsing altogether. Our method emphasizes the group property (separability) while preserving instance representativity. We present evidence that our proposal can represent complex spaces, for instance, when groups of similar objects are located in disjoint regions. We compare our proposal to nine different distance metric learning approaches (four of them are based on deep learning) on 28 real-world heterogeneous datasets. According to the four quantitative metrics used, our method overcomes all of the nine strategies from the literature.

Fig. 1. Comparison between the canonical model of Deep Metric Learning (DMeL) and the model used in this work. (a) Canonical scheme of DMeL. (b) Our scheme of DMeL with S-space.