Source-linked AI summary
Adaptation and Re-Identification Network: An Unsupervised Deep Transfer Learning Approach to Person Re-Identification
Yu-Jhe Li, Fu-En Yang, Yen-Cheng Liu, Yu-Ying Yeh, Xiaofei Du, Yu-Chiang Frank Wang
TL;DR
Re-ID across cameras requires matching people despite changes in appearance and camera settings, while target-domain labels may be unavailable. ARN adapts discriminative information from labeled source data to learn domain-invariant features for target matching. The authors report favorable performance against state-of-the-art unsupervised approaches and superiority to a number of supervised baselines.
Problem
Re-ID models can perform unsatisfactorily when query appearance or camera settings differ from training data, creating a domain-shift challenge.
Source: §1 · p. 1Method
ARN jointly uses labeled source data and an unlabeled target dataset, adapting discriminative information to learn domain-invariant features for cross-domain Re-ID.
Source: §1 · p. 2Results
ARN performs favorably against state-of-the-art unsupervised Re-ID approaches and outperforms a number of supervised Re-ID baselines.
Source: §1 · p. 2Takeaways & Limitations
The experiments on Market-1501 and DukeMTMC-reID support performing target-domain Re-ID without target label information during training.
Source: §5 · p. 6Style-transfer adaptation may not preserve identity when no corresponding identities appear in both datasets.
Source: §1 · p. 2
Abstract
from arXiv · showhide
Person re-identification (Re-ID) aims at recognizing the same person from images taken across different cameras. To address this task, one typically requires a large amount labeled data for training an effective Re-ID model, which might not be practical for real-world applications. To alleviate this limitation, we choose to exploit a sufficient amount of pre-existing labeled data from a different (auxiliary) dataset. By jointly considering such an auxiliary dataset and the dataset of interest (but without label information), our proposed adaptation and re-identification network (ARN) performs unsupervised domain adaptation, which leverages information across datasets and derives domain-invariant features for Re-ID purposes. In our experiments, we verify that our network performs favorably against state-of-the-art unsupervised Re-ID approaches, and even outperforms a number of baseline Re-ID methods which require fully supervised data for training.
1. Introduction
Cross-dataset Re-ID faces domain shift when target images differ in appearance or camera settings from training data, while target labels may be unavailable. ARN adapts discriminative information from a labeled source domain to learn domain-invariant features for target-domain matching without target labels.
- Target-domain Re-ID is needed when query appearance or camera settings differ from training data, a domain-shift problem requiring adaptation.Source: §1 · p. 1
- Style-transfer adaptation may fail to preserve identity when the two datasets contain no corresponding identities.Source: §1 · pp. 1–2
- The method learns domain-invariant features by adapting discriminative information from a labeled source domain to an unlabeled target domain.It decomposes cross-domain features into domain-invariant and domain-specific components, then matches images in the shared latent space.Source: §1 · p. 2
- The paper frames ARN as unsupervised Re-ID using an auxiliary labeled dataset, with no label information required for the domain of interest.Source: §1 · p. 2
- ARN performs favorably against state-of-the-art unsupervised Re-ID approaches and outperforms a number of supervised Re-ID baselines.Source: §1 · p. 2
2. Related Works
Related work covers supervised and unsupervised Re-ID, cross-domain transfer, and domain-invariant feature learning. The cited approaches use labeled data, unlabeled-data techniques, transfer or translation, and feature-learning methods for cross-domain tasks.
2.1. Person Re-Identification (Re-ID)
- Supervised Re-ID uses labeled cross-camera images for metric or representation learning, while unsupervised methods use clustering, instance selection, fine-tuning, or kernel-based cross-view learning.The cited unsupervised approaches typically do not match supervised performance because they lack cross-camera labels.Source: §2.1 · p. 2
2.2. Cross-Domain Re-ID
- Cross-domain Re-ID work transfers source representations to an unlabeled target or uses image translation and similarity constraints to address dataset or camera-style differences.Examples include deep classification-plus-verification, multi-task dictionary learning, CycleGAN with similarity constraints, and camera-style transfer.Source: §2.2 · p. 2
2.3. Domain-Invariant Feature Learning
- Domain-invariant feature methods learn representations for cross-domain classification or image translation, and the paper applies this idea to describe human identity across domains.Source: §2.3 · p. 2
3. Proposed Method
ARN adapts discriminative information learned from a labeled source dataset to an unlabeled target dataset for cross-dataset person re-identification. It learns shared and dataset-specific features, reconstructs source and target features, and uses the shared representation for matching.
3. Proposed Method
- ARN frames cross-dataset Re-ID as adapting discriminative ability learned from labeled source images to an unlabeled target dataset.The proposed network is designed to learn domain-invariant features while requiring no labels from the dataset of interest.Source: §3 · pp. 2–3
3.1. Supervised Learning for Person Re-ID
- Source-image classification and contrastive losses train features to distinguish identity classes, with the contrastive margin limiting penalties to dissimilar pairs within its radius.The classification loss minimizes negative log-likelihood of source ground-truth labels; dissimilar pairs contribute only when their distance falls within margin m around Ec(xi).Source: §3.1 · p. 3
3.2. Unsupervised Domain Adaptation for Cross-Dataset Re-ID
- Shared and private encoders decompose source and target feature maps; reconstruction and difference losses aim to preserve information and encourage orthogonality between the feature types.The decoder reconstructs source and target maps from compact features, while the difference loss addresses the possibility that shared and dataset-specific features are not mutually exclusive or independent.Source: §3.2 · pp. 3–4
3.3. Learning and Performing Re-ID
- ARN minimizes a weighted total of classification, contrastive, reconstruction, and difference losses end-to-end, then matches query and gallery images by cosine similarity.At inference, only EI and EC are required; the method uses the shared latent feature for similarity ranking.Source: §3.3 · p. 4, Figure 3 · p. 4
4. Experiments
The experiments evaluate ARN on Market-1501 and DukeMTMC-reID, test its components, and compare it with supervised and unsupervised methods. ARN outperforms the reported unsupervised methods on both datasets and is close to some supervised deep models.
4.1. Datasets
- Market-1501 has 32,668 images from 1,501 identities across six cameras; DukeMTMC-reID has 36,411 images from 1,404 identities across eight cameras.The experiments use both source-target directions and evaluate rank-1 accuracy and mAP.Source: §4.1 · p. 4
4.2. Implementation Details
- ARN uses an ImageNet-pretrained ResNet-50 encoder, private and shared latent branches, and a reconstruction decoder; evaluation ranks query-gallery features by cosine distance using CMC and mAP.Source: §4.2 · pp. 4–5
4.3. Ablation Studies
- The full model reaches 70.3% and 60.2% Rank-1 accuracy, and 39.4% and 33.4% mAP, on Market-1501 and DukeMTMC-reID, respectively.Removing Lrec, Lctrs and Lclass, or private modules ET and ES reduced Rank-1 accuracy by 25.8% and 29%, 18.1% and 21.4%, or 9.8% and 11.8%, respectively, across the two datasets. The reconstruction-only model still achieved 44.5% and 31.2% Rank-1 accuracy.Source: §4.3 · p. 5
4.4. Comparison with State-of-the-art Methods
- 13.6% Rank-1 accuracy and 12.7% mAP separate ARN from the second-best method on Market-1501, where it outperforms the compared unsupervised methods across all reported metrics.ARN’s performance is also reported as close to supervised deep models including SVDNET, TriNet, CamStyle, and DuATM.Source: Table 3 · p. 6, §4.4 · p. 6
- 60.2% Rank-1 accuracy and 33.4% mAP are ARN’s DukeMTMC-reID results; it exceeds the second-best method by 13.8% in Rank-1 accuracy and 7.2% in mAP.ARN also outperforms the supervised BOW and LOMO methods on this dataset.Source: Table 4 · p. 6, §4.4 · p. 6
5. Conclusions
ARN jointly uses a labeled source dataset and an unlabeled target dataset to learn domain-invariant and discriminative features for cross-domain Re-ID. Experiments on Market-1501 and DukeMTMC-reID support its effectiveness in this unsupervised setting and favorable performance against a number of supervised baselines.
5. Conclusions
- ARN jointly exploits a pre-collected supervised source dataset and an unlabeled target dataset by learning domain-invariant and discriminative features.The target-domain Re-ID task can be performed without label information during training.Source: §5 · p. 6
- Experiments on Market-1501 and DukeMTMC-reID confirmed ARN's effectiveness in the unsupervised learning setting.Source: §5 · p. 6
- ARN performed favorably against a number of baseline supervised Re-ID approaches.Source: §5 · p. 6