/Consolidated-Eulerian-Video-Magnification-and-Interpolation

Official implementation of the consolidated Eulerian video magnification and interpolation.

Primary LanguageMATLABGNU General Public License v3.0GPL-3.0

Consolidated-Eulerian-Video-Magnification-and-Interpolation

Official implementation of the consolidated Eulerian video magnification and interpolation (ACM TOMM19, IEEE FG 2018).

-- run "main.m" to get the magnified vedio

Codes and sample vedio "face.mp4" are obtained on the project web page: http://people.csail.mit.edu/mrub/vidmag/

See the demo of temporal interpolation model in "./TIM/": https://github.com/Vision-Intelligence-and-Robots-Group/Consolidated-Eulerian-Video-Magnification-and-Interpolation/tree/main/TIM

Citation

-- Please cite the following papers if you use our code.

Hong, X., Peng, W., Harandi, M., Zhou, Z., Pietikäinen, M. and Zhao, G., 2019. Characterizing subtle facial movements via Riemannian manifold. ACM Transactions on Multimedia Computing, Communications, and Applications (TOMM), 15(3s), pp.1-24.

Peng, W., Hong, X., Xu, Y. and Zhao, G., 2019, May. A boost in revealing subtle facial expressions: A consolidated eulerian framework. In 2019 14th IEEE International Conference on Automatic Face & Gesture Recognition (FG 2019) (pp. 1-5). IEEE.

Zhou, Z., Hong, X., Zhao, G., & Pietikainen, M., 2014. A Compact Representation of Visual Speech Data Using Latent Variables. IEEE Transactions on Pattern Analysis & Machine Intelligence (TPAMI), 36(01), 1-1.

Reference

[1] Wu, H.Y., Rubinstein, M., Shih, E., Guttag, J., Durand, F. and Freeman, W., 2012. Eulerian video magnification for revealing subtle changes in the world. ACM transactions on graphics (TOG), 31(4), pp.1-8.

[2] Zhou, Z., Zhao, G., & Pietikäinen, M., 2011, June. Towards a practical lipreading system. In CVPR 2011 (pp. 137-144). IEEE.