Adaptive Siamese Tracking With a Compact Latent Network
- PMID: 37015606
- DOI: 10.1109/TPAMI.2022.3230064
Adaptive Siamese Tracking With a Compact Latent Network
Abstract
In this article, we provide an intuitive viewing to simplify the Siamese-based trackers by converting the tracking task to a classification. Under this viewing, we perform an in-depth analysis for them through visual simulations and real tracking examples, and find that the failure cases in some challenging situations can be regarded as the issue of missing decisive samples in offline training. Since the samples in the initial (first) frame contain rich sequence-specific information, we can regard them as the decisive samples to represent the whole sequence. To quickly adapt the base model to new scenes, a compact latent network is presented via fully using these decisive samples. Specifically, we present a statistics-based compact latent feature for fast adjustment by efficiently extracting the sequence-specific information. Furthermore, a new diverse sample mining strategy is designed for training to further improve the discrimination ability of the proposed compact latent network. Finally, a conditional updating strategy is proposed to efficiently update the basic models to handle scene variation during the tracking phase. To evaluate the generalization ability and effectiveness and of our method, we apply it to adjust three classical Siamese-based trackers, namely SiamRPN++, SiamFC, and SiamBAN. Extensive experimental results on six recent datasets demonstrate that all three adjusted trackers obtain the superior performance in terms of the accuracy, while having high running speed.
Similar articles
-
Improved Fully Convolutional Siamese Networks for Visual Object Tracking Based on Response Behaviour Analysis.Sensors (Basel). 2022 Aug 30;22(17):6550. doi: 10.3390/s22176550. Sensors (Basel). 2022. PMID: 36081007 Free PMC article.
-
Robust Template Adjustment Siamese Network for Object Visual Tracking.Sensors (Basel). 2021 Feb 20;21(4):1466. doi: 10.3390/s21041466. Sensors (Basel). 2021. PMID: 33672468 Free PMC article.
-
Distilled Siamese Networks for Visual Tracking.IEEE Trans Pattern Anal Mach Intell. 2022 Dec;44(12):8896-8909. doi: 10.1109/TPAMI.2021.3127492. Epub 2022 Nov 7. IEEE Trans Pattern Anal Mach Intell. 2022. PMID: 34762585
-
Benchmarking Deep Trackers on Aerial Videos.Sensors (Basel). 2020 Jan 19;20(2):547. doi: 10.3390/s20020547. Sensors (Basel). 2020. PMID: 31963879 Free PMC article. Review.
-
Aerial Video Trackers Review.Entropy (Basel). 2020 Nov 30;22(12):1358. doi: 10.3390/e22121358. Entropy (Basel). 2020. PMID: 33266268 Free PMC article. Review.
LinkOut - more resources
Full Text Sources