/awesome-360video-search

A curated list of awesome 360-degree video resources

Awesome Architecture Search Awesome

A curated list of awesome 360-degree video papers and related resources. Inspired by awesome-architecture-search, awesome-deep-vision, awesome-adversarial-machine-learning and awesome-deep-learning-papers.

Over the past years, Virtual Reality (VR) products, such as Head-Mounted Displays (HMDs), become widely available. With the growing popularity of commercial VR products, more viewers are able to watch 360-degree videos with HMDs. Majority of present global Internet traffic is due to video data (Global Internet Phenomena). Streaming 360-degree videos further increases the Internet traffic amount, and becomes a hot research topic. Hence, I collected some awesome papers and resources here!

Table of Contents

Surveys

  • R. Krevelen and R. Poelman, "A Survey of Augmented Reality Technologies, Applications and Limitations," International Journal of Virtual Reality, vol. 9, no. 2, pp. 1-20, June 2010. [pdf]

  • A. Abbasi and U. Baroudi, "Immersive Environment: An Emerging Future of Telecommunications," IEEE MultiMedia, vol. 19, no. 1, pp. 80-80, January 2012. [pdf]

  • J. Apostolopoulos and P. Chou and B. Culbertson and T. Kalker and M. Trott and S. Wee, "The Road to Immersive Communication," Proceedings of the IEEE, vol. 100, no. 4, pp. 974-990, February 2012. [pdf]

  • C. Lee, A. Tabatabai, and K. Tashiro, "Free viewpoint video (FVV) survey and future research direction," APSIPA Transactions on Signal and Information Processing, vol. 5, no. 15, pp. 1–10, October 2015. [pdf]

  • D. Chatzopoulos and C. Bermejo and Z. Huang and P. Hui, "Mobile Augmented Reality Survey: From Where We Are to Where We Go," IEEE Access, vol. 5, pp. 6917-6950, April 2017. [pdf]

  • M. Domański, O. Stankiewicz, K. Wegner and T. Grajek, "Immersive visual media — MPEG-I: 360 video, virtual navigation and beyond," in Proc. of International Conference on Systems, Signals and Image Processing (IWSSIP'17), Poznan, Poland, May 2017, pp. 1-9. [pdf]

Systems

  • B. Petry and J. Huber, "Towards effective interaction with omnidirectional videos using immersive virtual reality headsets," in Proc. of the 6th Augmented Human International Conference (AH'15), Singapore, Singapore, March 2015, pp. 217-218. [pdf]

  • P. Alface and M. Aerts and D. Tytgat and S. Lievens and C. Stevens and N. Verzijp and J. Macq, "16K Cinematic VR Streaming," in Proc. of the 2017 ACM on Multimedia Conference (MM'17), Mountain View, CA, October 2017, pp. 1105-1112. [pdf]

  • R. Anderson and D. Gallup and J. Barron and J. Kontkanen and N. Snavely and C. Hern{'a}ndez and S. Agarwal and S. Seitz, "Jump: virtual reality video," ACM Transactions on Graphics, vol. 35, no. 6, pp. 198-211. [pdf]

  • A. Ferworn, B. Waismark and M. Scanlan, "CAT 360 — Canine augmented technology 360-degree video system," in Proc. of the 2015 IEEE International Symposium on Safety, Security, and Rescue Robotics (SSRR'15), West Lafayette, IN, October 2015, pp. 1-4. [pdf]

  • L. Gaemperle, K. Seyid, V. Popovic and Y. Leblebici, "An Immersive Telepresence System Using a Real-Time Omnidirectional Camera and a Virtual Reality Head-Mounted Display," in Proc. of the 2014 IEEE International Symposium on Multimedia (ISM'14), Taichung, Taiwan, December 2014, pp. 175-178. [pdf]

  • E. Canessa and L. Tenze, "FishEyA: live broadcasting around 360 degrees," in Proc. of the 20th ACM Symposium on Virtual Reality Software and Technology (VRST '14), Edinburgh, Scotland, November 2014, pp. 227-228. [pdf]

  • K. Choi and K. Jun, "Real-time panorama video system using networked multiple cameras," Journal of Systems Architecture: the EUROMICRO Journal, vol. 64, no. C, pp. 110-121, March 2016. [pdf]

  • N. Jiang, V. Swaminathan, and S. Wei, "Power Evaluation of 360 VR Video Streaming on Head Mounted Display Devices," in Proc. of the 27th Workshop on Network and Operating Systems Support for Digital Audio and Video (NOSSDAV'17), Taipei, Taiwan, June 2017, pp. 55-60. [pdf]

  • D. Ochi, Y. Kunita, K. Fujii, A. Kojima, S. Iwaki, and J. Hirose, "HMD Viewing Spherical Video Streaming System," in Proc. of the 22nd ACM international conference on Multimedia (MM '14), Orlando, FL, November 2014, pp. 763-764. [pdf]

  • D. Ochi, Y. Kunita, A. Kameda, A. Kojima and S. Iwaki, "Live streaming system for omnidirectional video," in Proc. of the 2015 IEEE Virtual Reality (VR'15), Arles, France, March 2015, pp. 349-350. [pdf]

  • F. Qian, L. Ji, B. Han, and V. Gopalakrishnan, "Optimizing 360 Video Delivery over Cellular Networks," in Proc. of Workshop on All Things Cellular Operations, Applications and Challenges (ATC’16), New York City, NY, October 2016, pp. 1–6. [pdf]

  • X. Xie and X. Zhang, "POI360: Panoramic Mobile Video Telephony over LTE Cellular Networks," in Proc. of International Conference on Emerging Networking EXperiments and Technologies (CoNEXT’17), Incheon, Republic of Korea, December 2017, pp. 336–349. [pdf]

  • X. Corbillon, G. Simon, A. Devlic and J. Chakareski, "Viewport-adaptive navigable 360-degree video delivery," in Proc. of the 2017 IEEE International Conference on Communications (ICC'17), Paris, France, May 2017, pp. 1-7. [pdf] [software]

  • R. Schäfer, P. Kauff, R. Skupin, Y. Sánchez and C. weißig, "Interactive Steaming of Panoramas and VR Worlds," SMPTE Motion Imaging Journal, vol. 126, no. 1, pp. 35-42, February 2017. [pdf]

Datasets

  • C. Wu and Z. Tan and Z. Wang and S. Yang, "A Dataset for Exploring User Behaviors in VR Spherical Video Streaming," in Proc. of the 8th ACM on Multimedia Systems Conference (MMSys'17), Taipei, Taiwan, June 2017, pp. 193-198. [pdf]

  • X. Corbillon and F. Simone and G. Simon, "360Degreee Video Head Movement Dataset," in Proc. of the 8th ACM on Multimedia Systems Conference (MMSys'17), Taipei, Taiwan, June 2017, pp. 199-204. [pdf] [software]

  • Y. Rai and J. Guti{'e}rrez and P. Callet, "A Dataset of Head and Eye Movements for 360 Degree Images," in Proc. of the 8th ACM on Multimedia Systems Conference (MMSys'17), Taipei, Taiwan, June 2017, pp. 205-210. [pdf]

  • W. Lo and C. Fan and J. Lee and C. Huang and K. Chen and C. Hsu, "360-degree Video Viewing Dataset in Head-Mounted Virtual Reality," in Proc. of the 8th ACM on Multimedia Systems Conference (MMSys'17), Taipei, Taiwan, June 2017, pp. 211-216. [pdf] [dataset]

Open Software

Codec

  • M. Viitanen, A. Koivula, A. Lemmetti, A. Ylä-Outinen, J. Vanne, and T. Hämäläinen, "Kvazaar: Open-Source HEVC/H.265 Ensoftwarer," in Proc.of the 2016 ACM on Multimedia Conference (MM'16), Amsterdam, The Netherlands, October 2016, pp. 1179-1182. [pdf] [software]

  • High Efficiency Video Coding (HEVC) Test Model. [web] [software]

  • HEVC Scalability Extension (SHVC) Test Model. [web] [software]

Projection

  • 360Lib [web]

  • Facebook/Surround360 [software]

  • Samsung/360tools [software]

  • X. Corbillon, F. Simone, and G. Simon, "360-Degree Video Head Movement Dataset," in Proc. of the 8th ACM on Multimedia Systems Conference (MMSys'17), Taipei, Taiwan, June 2017, pp. 199-204. [pdf] [software]

Packager

Player

Tracker

Others

Optimization

Acquisition

Encoding

Transmission

Display

Quality Assessments

Applications

Others

Contributing

We Need You!

Please help contribute this list by contacting me or add pull request

Markdown format:

(Conference paper)
- Author 1, Author 2 and Author 3, "Paper Name," 
in *Proc. of Conference Name (Series'Year)*, City, Nation, Month Year, pp. xxx-xxx.
[[pdf]](link) [[software]](link)
(Journal paper)
- Auther 1, Auther 2 and Author 3, "Paper Name," 
*Journal Name*, vol. xxx, no. xxx, pp. xxx-xxx, Month Year. 
[[pdf]](link) [[software]](link)
(webpage)
- Name
[[web]](link) [[software]](link)

License

PDM

To the extent possible under law, Wen-Chih Lo has waived all copyright and related or neighboring rights to this work.