NTW Logo (Black)

About IEEE

IEEE Membership

Products and Services


IEEE Organizations


IEEE Nav Bar







IEEE Signal Processing Society Santa Clara Valley Chapter





Click here for see the full list of upcoming events.

Tuesday, May 16, 2017

A Universal Low-latency Real-time Optical Flow based Stereoscopic Panoramic Video Communication System for AR/VR

This event is hosted/sponsored by IEEE SPS Chapter and co-sponsorted by IEEE CES/IT/SSCS Chapters & Intel Latino Network.

Speakers :

Dr. Jiangtao Wen, Tsinghua University, China.



Intel SC12 Auditorium, 3600 Juliette Ln, Santa Clara, CA 95054 (Google Maps)



6:30pm: Check-in/Networking

7:00pm: Announcements

7:05pm: Presentation

8:15pm: Adjourn



Introduce an optimized system for real time, low latency stereoscopic panoramic video communications that is camera agnostic. After intelligent camera calibration, the system is capable of stitching inputs from different cameras using a real time, low latency optical flow based algorithm that intelligently learns input video features over time to improve stitch quality. Depth information is also extracted in the process. The resulted stereoscopic panoramic video is then encoded with content-adaptive temporal and/or spatial resolution to achieve low bitrate while maintaining good video quality. Various aspects of the system including the optimized stitching algorithm, parallelization and task scheduling, as well as encoding will be introduced with demos with conventional (non-panoramic) professional and consumer grade cameras as well as integrated panoramic cameras.


Jiangtao Wen received the BS, MS and Ph.D. degrees with honors from Tsinghua University, Beijing, China, in 1992, 1994 and 1996 respectively, all in Electrical Engineering.

From 1996 to 1998, he conducted research on multimedia coding and communications at UCLA, where many of his inventions were later adopted by international standards such as H.263, MPEG and H.264. He worked at a number of venture funded technologies companies in San Diego and the Silicon Valley in the next decade, where he played a key technology leadership role. Since 2009, Dr. Wen has held a Professorship at the Department of Computer Science and Technology of Tsinghua University. He was a Visiting Professor at Princeton University in 2010 and 2011.

Dr. Wen's research focuses on multimedia communication and computational photography. He has authored many widely referenced papers in related fields. Products deploying technologies that Dr. Wen developed are currently widely used worldwide. Dr. Wen holds over 40 patents with numerous others pending. Dr. Wen was an Associate Editor for IEEE Transactions Circuits and Systems for Video Technologies (CSVT) and served on the committee of a number of IEEE conferences. He is a recipient of the 2010 IEEE Trans. CSVT Best Paper Award and a nominee for the 2016 IEEE Trans CSVT Best Paper Award. His work on optimized video coding for panoramic video is a finalist for the 1st 10k Best Paper Award at the 2017 IEEE ICME. Technology and software that his lab developed have been deployed by China Mobile and Huawei and received the 2016 Frost & Sullivan Global Technology Leadership Award.

Dr. Wen was elected a Fellow of the IEEE in 2011. He is the Director of the Research Institute of the Internet of Things of Tsinghua University, and a Co-Director of the Ministry of Education Tsinghua-Microsoft Joint Lab of Multimedia and Networking.

Besides teaching and conducting research, Dr. Wen also invests in high technology companies as an angel investor.

Slides (PDF)

Subscribe to future announcements: link