EN FR
EN FR
STARS - 2014
Overall Objectives
New Software and Platforms
New Results
Bilateral Contracts and Grants with Industry
Bibliography
Overall Objectives
New Software and Platforms
New Results
Bilateral Contracts and Grants with Industry
Bibliography


Section: New Results

Global Tracker : An Online Evaluation Framework to Improve Tracking Quality

Participants : Julien Badie, Slawomir Bak, Duc Phu Chau, François Brémond, Monique Thonnat.

keywords: online quality estimation, re-identification, tracking results improvements

This work addresses the problem of estimating the reliability of a tracking algorithm during runtime and correcting the anomalies found. Evaluating and tuning a tracking algorithm generally requires multiple runs and ground truth. The proposed framework called global tracker overcomes these limitations by combining an online evaluation algorithm and a recovering post-process.

Designing an evaluation framework that does not require ground truth has many different applications. One of them is to provide feedback to the tracking algorithm that can tune its own parameters to improve the results on the next frame. Another convenient application is to filter the reliable information from the tracking algorithm that can be used by the next processing step such as event recognition or re-identification.

Figure 24. Integration of the global tracker, combining online evaluation and re-identification
IMG/badie-overview.png

The proposed online evaluation framework is based on control features. It means that several representative values or characteristics (the features) are chosen to monitor what is happening. Control features are the features that the online evaluation framework uses to monitor the status of the tracked objects. The framework is divided into two steps :

  • computing the control features related to each tracked object of the scene on the current frame

  • detecting the possible anomalies and then classifing them into two categories : anomalies due to tracking errors or benign anomalies (when a person leaves the scene or cross an obstacle for example).

This approach has been tested on two datasets (PETS 2009 and Caviar) with two different tracking algorithms (a multi-feature tracker and a tracker based on graph partitioning). The results show that the global tracker, even associated with a tracking algorithm that does not have good results, can perform as well as the state of the art.

Table 4. Tracking results on sequence S2.L1.View1 of the PETS2009 dataset using CLEAR metrics
Methods MOTA MOTP
Heili et al. [72] 0.89 0.66
Zamir et al. [96] 0.90 0.69
Milan et al. [77] 0.90 0.74
Tracker 1 0.62 0.63
Tracker 1 + global tracker 0.85 0.71
Tracker 2 0.85 0.74
Tracker 2 + global tracker 0.90 0.74
Table 5. Tracking results on the Caviar dataset using Mostly Tracked (MT), Partially Tracked (PT) and Mostly Lost (ML) metrics
Method MT (%) PT (%) ML (%)
Li et al. [76] 84.6 14.0 1.4
Kuo et al. [74] 84.6 14.7 0.7
Tracker 1 78.3 16.0 5.7
Tracker 1 + global tracker 86.4 8.3 5.3

This approach has been published in AVSS 2014 [33] which details the differences between real errors and benign anomalies.