hiredd/VideoFrameSampler

Salient Video Frames Sampling Technique Using the Mean of Deep Features

VideoFrameSampler

Salient Video Frames Sampler for Efficient Model Training Using the Mean of Deep Features

Summary

This code's purpose is to find meaningful frames in both trimmed and untrimmed video datasets. And this Sampler working only with UCF101, HMDB51, ActivityNet datasets.
We only provides video frame sampler codes(returns the JSON file), however, we will be published training codes which utilize this sampler results in another repository later!!.

Requirements

• opencv-python
• ffmpeg-python
• torch
• pillow-simd(optional)

Usage(UCF101)

Clone this repository

git clone https://github.com/titania7777/VideoFrameSampler.git

Download the dataset

cd ./VideoFrameSampler/Data/UCF101/
./download.sh

Run an Index Sampler

cd ../../
python sampler_run.py --dataset-name UCF101 --split-id 1

Loading Test

python sampler_test.py --dataset-name UCF101 --split-id 1 --sequence-length 16

Sampled Annotations

We provide our sampler results here

Download UCF101 Sampled Annotations

Download HMDB51 Sampled Annotations

Download ActivityNet Sampled Annotations

Examples on ActivityNet

Kayaking(Uniform)

Kayaking(Our)

Laying Tile(Uniform)

Laying Tile(Our)