This repository implements object detection and tracking using state-of-the-art algorithms, that are, YOLOv3 and DeepSORT in street view imagery. All the computation required will be performed using Google Colab. Mainly, the process will involve two main steps:

• Follow my YOLOv3 object detection repository to train custom object detector https://github.com/Ahsanr312/Object-Detection-in-Satellite-Imagery-Using-YOLOv3-
• In this repository our target of interest would be detection and tracking of cars in tough weather conditions using a sub-dataset from AAU RainSnow Traffic Surveillance Dataset is available at https://www.kaggle.com/aalborguniversity/aau-rainsnow.
• Training dataset: Contains 240 images and 2634 ground truth labels. Available at: https://drive.google.com/drive/folders/1HG1nZ1y32cs9phHE7AKicuiFAGUQlTYx?usp=sharing
• Test Videos: The system is tested on 10 videos. Available at: https://drive.google.com/drive/folders/15SP16IkZtwkukuwddvgVOLPYA-kMxG3J?usp=sharing

• Set up google drive:
  • Log in to your google account and go to google drive.
  • Create a folder, by naming it "Object Tracking" and upload this repository to newly created Object Tracking folder.
• Set up google colab:
  • In the Object Tracking folder in google drive, right click on "Object_Tracking.ipynb" file and select open with -> Google Colaboratory. The file will open in the colab.
  • Next, we need to choose GPU for our training. To do so, click on "Edit" and select "Notebook settings" and then choose "GPU" under Hardware accelerator option.
  • Press "save" and you are good to go.
  • This notebook is created for testing object tracking in colab.
  • Step 1: Place trained YOLOv3 weights in the weights folder at your google drive. Available at: https://drive.google.com/drive/folders/1SfZFt1ch95o9TU-hLbMDuQyCB9xTqwuu?usp=sharing
  • Step 2: Run first cell in the Object_Tracking.ipynb notebook to check which GPU is assigned to you.
  • Step 3: Run second cell to install all the requirements needed for this repository.
  • Step 4: Run third cell to setup NVIDIA driver for GPU
  • Step 5: Run fourth cell that basically converts YOLOv3 weights (darknet) to tensorflow format.
  • Step 6: Run fifth cell that detects and tracks target objects using converted YOLOv3 weights and DeepSORT.

• Make sure you place exact same .names file in your data/labels/ folder for which you trained YOLOv3.
• Place test video files in data/video/
• Make sure you replace exact same classes in coco_classes.txt at model_data/ folder for which YOLOv3 is trained.
• Make sure you replace and use same anchor values in yolo_anchors.txt on which YOLOv3 is trained.
• Make sure you replace/edit yolo_anchors array in models.py file at yolov3_tf2/ folder with same anchor values used for training YOLOv3. Moreover, the array is divided by the network resolution value that maybe 416, 608, or any value used while training YOLOv3.

• The results for experiments done is available at: https://drive.google.com/drive/folders/1zwKdQ654J-hYk3R7WVqpUAJ5TgfdHIx-?usp=sharing
• The weights used in this experiment are trained for 3000 epoches. To improve results further, you should first increase training dataset and secondly train for more epoches.

• The Flow can be re-implemented by using other detection algorithms such as YOLOv4, YOLOv5, EfficientDet
• Use other state-of-the-art object tracking algorithms.