Skip to Main content Skip to Navigation
Journal articles

Unsupervised Adversarial Instance-level Image Retrieval

Abstract : With the wide use of visual sensors in the Internet of Things (IoT) in the past decade, huge amount of images are captured in people's daily lives, which makes the traditional deep learning-based image retrieval frameworks meeting some challenges. For one, most of them need a large amount of annotated training data, which is expensive. Moreover, machines still lack human intelligence, as illustrated by the fact that they pay less attention to the interesting regions that humans generally focus on when search images. Hence, this paper proposes a novel unsupervised framework that focuses on the instance object in the image, and integrates human intelligence into the deep learningbased image retrieval. This framework is called adversarial instance-level image retrieval (AILIR). We incorporate adversarial training and an attention mechanism into this framework that consider human intelligence with artificial intelligence. The generator and discriminator are redesigned to guarantee that the generator retrieves similar images while the discriminator selects unmatched images and creates an adversarial reward for the generator. A minimax game is conducted by the adversarial reward retrieval mechanism until the discriminator is unable to judge whether the image sequence retrieved matches the query. Comparison and ablation experiments on four benchmark datasets prove that the proposed adversarial training framework indeed improves instance retrieval and outperforms the state-ofthe-art methods focused on instance retrieval.
Complete list of metadata

https://hal.archives-ouvertes.fr/hal-03195862
Contributor : Laurent Jonchère Connect in order to contact the contributor
Submitted on : Wednesday, June 30, 2021 - 10:01:39 AM
Last modification on : Tuesday, October 19, 2021 - 10:36:38 PM
Long-term archiving on: : Friday, October 1, 2021 - 6:15:05 PM

File

Bai et al-2021-Unsupervised Ad...
Files produced by the author(s)

Identifiers

`

Citation

C. Bai, H. Li, J. Zhang, L. Huang, Lu Zhang. Unsupervised Adversarial Instance-level Image Retrieval. IEEE Transactions on Multimedia, Institute of Electrical and Electronics Engineers, In press, ⟨10.1109/TMM.2021.3065578⟩. ⟨hal-03195862⟩

Share

Metrics

Record views

55

Files downloads

196