/tracking-annotator

A tool to annotate videos for person tracking

Primary LanguageSvelte

Tracking Annotator (Live Demo)

Screenshot

Instructions

You can use the tool without installing it locally by using the (Live Demo).

Because this tool is a web application the videos need to be served over a webserver. The easiest way to do this it to run a static server. See ./serve_videos.sh as an example. This script mounts a remote drive and starts a server using node (Note: python -m http.server has issues with some videos!). The server hosting the videos must enable cross-origin resource sharing (CORS) e.g., npx http-server --cors.

Any video format supported by your web browser can be used, MP4 is probably the best choice.

Shortcuts

  • Space: Pause/play
  • Backspace: Remove annotation
  • Left click: Start annotation
  • Right click: Remove annotaion
  • q: increase speed
  • a: decrease speed
  • left arrow: -1s
  • right arrow: +1s
  • middle click: Add optical flow point to automatically track

Development

npm run dev

Deployment

./deploy.sh

Citation

If you find this tool useful for your research please cite the following paper:

@inproceedings{Deadman2020,
  author={Jack Deadman and Jon Barker},
  title={{Simulating Realistically-Spatialised Simultaneous Speech Using Video-Driven Speaker Detection and the CHiME-5 Dataset}},
  year=2020,
  booktitle={Proc. Interspeech 2020},
  pages={349--353},
  doi={10.21437/Interspeech.2020-2807},
  url={http://dx.doi.org/10.21437/Interspeech.2020-2807}
}