From NYU Video Lab

HomePage: 360-degree Video Streaming

In recent years, Virtual Reality (VR) technologies have been rapidly commercialized. A variety of applications have been developed continuously to meet the market demands and consumer expectations, such as immersive cinema, gaming, education, telepresence, social media, and healthcare, etc. Therefore, the delivery of ultra high quality 360 degree video has become important for the wide adoption of VR.

Some preliminary 360 video services are now available on several major video platforms, such as YouTube, Facebook, etc. However, the current delivery solutions treat 360 videos as regular videos and stream the entire 360 degree view scope to users regardless of their view directions. Compared with the traditional video streaming, 360 degree video streaming confronts unique new challenges. Firstly, to deliver an immersive VR experience, 360 video has much higher bandwidth requirement. For example, a premium quality 360 video with 60 frames per second, 8K resolution can consume bandwidth up to multiple Gigabits-per-second (Gbps). Secondly, user view direction dynamics is a new dimension of freedom in 360 degree video streaming. A user may freely change or navigate her viewing direction and expect to see the scene in the new viewing direction immediately.

In this project, we are collaborating with Huawei researchers and NYU Networking Lab and exploring the efficient solutions to deliver 360 videos or VR contents. A multi-tier multi-path system framework is proposed to simultaneously address the dynamics in both network throughput variation and user viewing direction changes. We have already accomplished the following milestones: (1) Two-tier 360-degree Video Streaming System with Prioritized Buffer Control and (2) Multi-path Multi-tier 360-degree Video Streaming System in 5G Networks.

We are currently prototyping and implementing the end-to-end systems, including:

(1) Single-Tier 360-degree Video Streaming System with pre-Bit-allocation via DASH

(2) Two-tier 360-degree Video Streaming System with Prioritized Buffer Control. (Under Development)

Related Publications:

[C1] L. Sun, F. Duanmu, Y. Ye, H. Shi, D. Dai, Y. Wang, and Y. Liu, “Multi-path Multi-tier 360-degree Video Streaming in 5G Networks,” in ACM Multimedia System Conference (MMSys), Amsterdam, Netherland, 2018 (Accepted).

[C2] F. Duanmu, E. Kurdoglu, A. Hosseini, Y. Liu and Y. Wang, “Prioritized Buffer Control in Two-Tier 360 Video Streaming,” in Proc. of ACM SigComm Workshop (ACM SigComm’17 VR/AR Network), pp. 13-18, Los Angeles, California, USA, 2017.

[C3] F. Duanmu, E. Kurdoglu, Y. Liu and Y. Wang, “View Direction and Bandwidth Adaptive 360 Degree Video Streaming using a Two-Tier System”, in Proc. of IEEE International Symposium on Circuits and Systems (ISCAS), pp. 1-4, Baltimore, Maryland, USA, 2017.

Last Update by Fanyi Duanmu, 02/14/2018

Retrieved from
Page last modified on March 19, 2018, at 09:12 AM EST