/ADCF_2019

Adaptive Target Tracking Algorithm with Dynamic Weighted Hierarchical Convolutional Neural Network Feature (http://xwxt.sict.ac.cn/CN/abstract/abstract5795.shtml)

Primary LanguagePython

ADCF_2019

code for Adaptive Target Tracking Algorithm with Dynamic Weighted Hierarchical Convolutional Neural Network Feature.

1. Intro

  • This project includes source code for first experience in our paper based on PyTorch and usage of CNN features.
  • For models, inlcuding mainstream models from torchvision (PyTorch) in CNNFeat. Models from tensorflow or caffe should perform better on visual tracking, such as (pretrained-models) or (matconvnet).

2. Install

numpy==1.14.5 torch==0.4.0 torchvision==0.4.0 scipy==1.0.0 opencv_python==3.4.2 matplotlib==2.1.2 numba==0.43.1 pillow==6.1.0

3. Usage

  • Download seqs (Visual BenchMark) and save to Sequence. Change file path before running KCF with CNN features. Choose to run different CNN of single conv-layer or coarse-to-fine features in run.py.

    python run.py
    
  • Visualize different CNN feature maps in CNNfeat. Downloads MobileNet_v3 models in (mobilenetv3).

    from PIL import Image
    from CNN_feat.LightWeight_cnn_feat import LightWeight_feat,LightCNN
    net = LightWeight_feat(LightCNN.SqueezeNet.value,'1_1', 1)
    # visualize SqueezeNet-1_1 conv1
    img = Image.open('Seq/boy/img/0001.jpg')
    feat = net.get_cnn_feat(img,True,False,False)
    
  • Test old vision of KCF with hog features in 2015-KCF-DSST. Install 'numba' before if using hog features.

    python run.py