A motion compensated lifting wavelet codec for 3D video coding

A motion compensated lifting (MCLIFT) framework for the 3D wavelet video coding is proposed in this paper. By using bi-directional motion compensation in each lifting step of the temporal direction, the video frames are effectively de-correlated. With the proper entropy coding and bit-stream packaging schemes, the MCLIFT wavelet video coder is scalable at frame rate and quality level. Experimental results show that the MCLIFT video coder outperforms the 3D wavelet video coder without motion by an average of 0.9–1.3dB, and outperforms MPEG-4 coder by an average of 0.2–0.6dB. This work was performed when the author was with Microsoft Research Asia. LUO Lin received the B.E. and M.E. degrees from University of Science and Technology of China (USTC) in 1998 and 2000, respectively. She is currently pursuing the Ph.D. degree in electronic engineering at USTC. Her research interests are high-dimensional wavelet coding for video and some graphic medias. Dr. Luo was awarded Microsoft Fellowship from Microsoft Research China in 2000. She is a co-recipient of the Best Student Paper Award of SPIE/IEEE Visual Communications and Image Processing in 2000. LI Jin received the M.S. and Ph.D. degrees in electrical engineering from Tsinghua University in 1991 and 1994, respectively. He was a research associate at the University of Southern California, Los Angeles, from 1994 to 1996, and a member of technical staff at Sharp Laboratories of America, Camas, WA, from 1996 to 1999. He joined Microsoft Research in 1999, and was a researcher/project leader at Microsoft Research China, Beijing, from 1999 to 2000, and moved to Microsoft Research, Redmond, WA, in 2001. Since 2000, he has also served as an adjunct professor with the Electrical Engineering Department, Tsinghua University. He is an active contributor for the ISO JPEG 2000/MPEG4 Project, and has published over 50 technical papers in various journals and conferences relating to multimedia compression and communication. He is an Area Editor for the Journal of Visual Communication and Image Representation. He was the recipient of the 1994 Ph.D. Dissertation Award from Tsinghua University and the 1998 Young Investigator Award from SPIE Visual Communication and Image Processing. LI ShiPeng received his B.E. and M.E. degrees both in electrical engineering from the University of Science and Technology of China (USTC) in 1988 and 1991, respectively. He received his Ph.D. degree in electrical engineering from Lehigh University, Bethlehem, PA, in 1996. From Oct. 1996 to May 1999, Dr. Li was with Multimedia Technology Laboratory at Sarnoff Corporation in Princeton, NJ (formerly David Sarnoff Research Center, and RCA Laboratories) as a member of technical staff. He joined Microsoft Research Asia in May 1999. He is currently the research manager of Internet media group. His research interests include scalable media coding and streaming, wireless video Communication, application level networking, object-based image and video coding, video object tracking and extraction, digital right management, etc. He has been actively involved in research and development of digital television, MPEG, JPEG, image/video compression, next generation multimedia standards and applications, consumer electronics. He has authored and co-authored over 70 technical publications and over 20 granted and pending US patents in image/video compression and communications, digital television, multimedia and wireless communication. Dr. Li is a member of Visual Signal Processing and Communications Committee of IEEE Circuits and Systems Society. Dr. Li was the first recipient of dual Sarnoff technical achievement awards in ten years. ZHUANG ZhenQuan received the Ph.D. degree in electrical engineering from Zhejiang University, China in 1960. Dr. Zhuang is a professor of the Department of Electronic Science and Technology, University of Science and Technology of China (USTC). He is the director of the Intelligent Information Processing Institute of USTC. His research interest is bio-informatics. video and image processing. He has published over 60 technical papers in various journals and conferences in genetic algorithm, neural networks, VLSI, and data mining, etc.