Unsupervised Embedding Learning via Invariant and Spreading Instance Feature
Hong Kong Baptist University · Columbia University
Abstract
This paper studies the unsupervised embedding learning problem, which requires an effective similarity measurement between samples in low-dimensional embedding space. Motivated by the positive concentrated and negative separated properties observed from category-wise supervised learning, we propose to utilize the instance-wise supervision to approximate these properties, which aims at learning data augmentation invariant and instance spread-out features. To achieve this goal, we propose a novel instance based softmax embedding method, which directly optimizes the `real' instance features on top of the softmax function. It achieves significantly faster learning speed and higher accuracy than all existing…
Citation impact
- FWCI
- 47.30
- Percentile
- 100%
- References
- 79
Authors
4Topics & keywords
- Softmax function
- Embedding
- Artificial intelligence
- Computer science
- Pattern recognition (psychology)
- Similarity (geometry)
- Unsupervised learning
- Feature learning