University of Surrey :: Centre for Vision, Speech and Signal Processing :: Karel Lebeda :: 3DCars benchmark ::
download data / submit results / view leader-board / synthetic data and results
⇈ Download data
The copyright of the 3DCars dataset is owned by The Centre for Vision, Speech and Signal Processing, University of Surrey, UK. Permission is hereby granted to use the 3DCars dataset or its part for academic purposes only, provided that it is referenced in publications related to its use as follows:
K. Lebeda, S. Hadfield, R. Bowden. 2D Or Not 2D: Bridging the Gap Between Tracking and Structure from Motion. In Proceedings of the Asian Conference on Computer Vision, 2015.
Download
Videos (75 MB), Ground truth, Evaluation script (including GT and example results).
⇈ Submit results
Submission address: K.Lebeda@Surrey (in case of any problems, try my personal address).
To be placed on the leader-board, please email us your results as returned by the evaluation script. Please copy&paste the results from your Matlab window into the email body and/or attach the created result file. In case you don't get a response within a few days, feel free to urge us.
If you want to have your submission marked as "confirmed", please send us the source code or binary of your implementation for a check. Your implementation will be used solely for the purpose of validating your benchmark entry; should you wish to discuss this issue, please reach us on the aforementioned address.
⇈ Leader Board
The following table shows quantitative results on the 3DCars dataset, given the ground truth. The tabulated values (for every tracker and sequence combination) are localisation error (distance of bounding box centres, in pixels) and overlap (of bounding boxes, in percent points).
| Conf. | Tracker | 2D / 3D | Doughnut | Rally-Audi | Rally-Lancer | Rally-Opel | Rally-OTS | Rally-VW | TopGear 1 | TopGear 2 | Average | ||||||||||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| YES | LGT | 2D | 131.0 | / | 35 | 71.0 | / | 37 | 145.8 | / | 19 | 97.7 | / | 17 | 28.7 | / | 22 | 91.3 | / | 21 | 16.3 | / | 49 | 84.3 | / | 37 | 83.3 | / | 30 |
| YES | TLD | 2D | 63.9 | / | 56 | 18.21) | / | 3 | 333.5 | / | 13 | 226.6 | / | 43 | 89.9 | / | 25 | 152.5 | / | 48 | 65.1 | / | 34 | 104.3 | / | 21 | 131.7 | / | 30 |
| YES | FoT | 2D | 181.7 | / | 44 | 212.4 | / | 33 | 734.5 | / | 13 | 165.9 | / | 38 | 116.2 | / | 29 | 196.9 | / | 39 | 80.4 | / | 41 | 117.9 | / | 29 | 225.7 | / | 33 |
| YES | TMAGIC | 3D | 87.9 | / | 57 | 110.2 | / | 48 | 94.3 | / | 53 | 44.0 | / | 52 | 48.9 | / | 59 | 47.6 | / | 62 | 40.0 | / | 56 | 34.7 | / | 59 | 63.5 | / | 56 |
1)TLD on Rally-Audi reported loss of tracking after only 3 frames.