Evaluating Multiple Object Tracking Performance: The CLEAR MOT Metrics
Simultaneous tracking of multiple persons in real-world environments is an active research field and several approaches have been proposed, based on a variety of features and algorithms. Recently, there has been a growing interest in organizing systematic evaluations to compare the various technique...
| Main Authors: | , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
SpringerOpen
2008-06-01
|
| Series: | EURASIP Journal on Image and Video Processing |
| Online Access: | http://dx.doi.org/10.1155/2008/246309 |
| _version_ | 1811340886302261248 |
|---|---|
| author | Rainer Stiefelhagen Keni Bernardin |
| author_facet | Rainer Stiefelhagen Keni Bernardin |
| author_sort | Rainer Stiefelhagen |
| collection | DOAJ |
| description | Simultaneous tracking of multiple persons in real-world environments is an active research field and several approaches have been proposed, based on a variety of features and algorithms. Recently, there has been a growing interest in organizing systematic evaluations to compare the various techniques. Unfortunately, the lack of common metrics for measuring the performance of multiple object trackers still makes it hard to compare their results. In this work, we introduce two intuitive and general metrics to allow for objective comparison of tracker characteristics, focusing on their precision in estimating object locations, their accuracy in recognizing object configurations and their ability to consistently label objects over time. These metrics have been extensively used in two large-scale international evaluations, the 2006 and 2007 CLEAR evaluations, to measure and compare the performance of multiple object trackers for a wide variety of tracking tasks. Selected performance results are presented and the advantages and drawbacks of the presented metrics are discussed based on the experience gained during the evaluations. |
| first_indexed | 2024-04-13T18:48:34Z |
| format | Article |
| id | doaj.art-e123b0ee2a7b41089c2404fdec50f84e |
| institution | Directory Open Access Journal |
| issn | 1687-5176 1687-5281 |
| language | English |
| last_indexed | 2024-04-13T18:48:34Z |
| publishDate | 2008-06-01 |
| publisher | SpringerOpen |
| record_format | Article |
| series | EURASIP Journal on Image and Video Processing |
| spelling | doaj.art-e123b0ee2a7b41089c2404fdec50f84e2022-12-22T02:34:31ZengSpringerOpenEURASIP Journal on Image and Video Processing1687-51761687-52812008-06-01200810.1155/2008/246309Evaluating Multiple Object Tracking Performance: The CLEAR MOT MetricsRainer StiefelhagenKeni BernardinSimultaneous tracking of multiple persons in real-world environments is an active research field and several approaches have been proposed, based on a variety of features and algorithms. Recently, there has been a growing interest in organizing systematic evaluations to compare the various techniques. Unfortunately, the lack of common metrics for measuring the performance of multiple object trackers still makes it hard to compare their results. In this work, we introduce two intuitive and general metrics to allow for objective comparison of tracker characteristics, focusing on their precision in estimating object locations, their accuracy in recognizing object configurations and their ability to consistently label objects over time. These metrics have been extensively used in two large-scale international evaluations, the 2006 and 2007 CLEAR evaluations, to measure and compare the performance of multiple object trackers for a wide variety of tracking tasks. Selected performance results are presented and the advantages and drawbacks of the presented metrics are discussed based on the experience gained during the evaluations.http://dx.doi.org/10.1155/2008/246309 |
| spellingShingle | Rainer Stiefelhagen Keni Bernardin Evaluating Multiple Object Tracking Performance: The CLEAR MOT Metrics EURASIP Journal on Image and Video Processing |
| title | Evaluating Multiple Object Tracking Performance: The CLEAR MOT Metrics |
| title_full | Evaluating Multiple Object Tracking Performance: The CLEAR MOT Metrics |
| title_fullStr | Evaluating Multiple Object Tracking Performance: The CLEAR MOT Metrics |
| title_full_unstemmed | Evaluating Multiple Object Tracking Performance: The CLEAR MOT Metrics |
| title_short | Evaluating Multiple Object Tracking Performance: The CLEAR MOT Metrics |
| title_sort | evaluating multiple object tracking performance the clear mot metrics |
| url | http://dx.doi.org/10.1155/2008/246309 |
| work_keys_str_mv | AT rainerstiefelhagen evaluatingmultipleobjecttrackingperformancetheclearmotmetrics AT kenibernardin evaluatingmultipleobjecttrackingperformancetheclearmotmetrics |