Detection is one of the classical computer vision problems, where axis parallel bounding boxs needs to be identified over each of the objects in an image, from a given set of labels. There could be multiple instances of the object, in which case separate bounding boxes needs to be identified for each instance. This is a well studied problem for common objects with many datasets available (cite Imagenet, MSCOCO cite{MSCOCO}).
Detection for autonomous naviation is also an active area of reasearch. Previous challenges like KITTI, Cityscapses are based on western conditions. Autorikshaws is not part of their label set.
The full dataset consists of 1000 images from indian roads, with arbitrary perspectives. The participants will be given 800 images with bounding box annotations of autorickshaws for training/validation. 200 images will be test images.
Please register for getting a sample dataset of 350 training images here : register
The dataset details have been mailed to the participants. Baseline scores will be sent to the participants soon.
We will be using the same metric as the PASCAL VOC 2012 Object Detection challenge. Detections are considered true or false based on the area of overlap with the ground truth boxes. Assuming the prediction is $B_{p}$ and ground truth is $B_{gt}$, we compute the area of overlap using the $IOU(B_{p}, B_{gt})$ and mark the box as correct if the threshold of 0.5 is exceeded. Multiple detections of the same object in an image are considered false detections. Then, we compute the Average Precision (AP) by computing the precision-recall curve which is our quantitative metric. See PASCAL VOC devkit for more information.
The score on the test dataset will be considered for ranking the participants of the challenge.
The 200 test images given without any annotations will be used for calculating the scores on which the participants will be ranked. The participants will be be asked to upload the outputs of their algorithms in a standard format and the scores will be calculated using the ground truths available with the organization team. The winning teams will also be required to run their binaries against the test data at the time of the workshop, in presence of the organizers
October 6th : Final relase of the 800 training images with annotations
November 1st : Relase of the 200 testing images