Adaptive Multiview Video Coding Scheme Based on Spatiotemporal Correlation Analyses, ETRI Journal, vol.31, no.2, Apr. 2009, pp.151-161.

Adaptive Multiview Video Coding Scheme Based on Spatiotemporal Correlation Analyses

Yun Zhang, Gang Yi Jiang, Mei Yu, and Yo Sung Ho

Abstract :

In this paper, we propose an adaptive multiview video coding scheme based on spatiotemporal correlation analyses using hierarchical B picture (AMVC-HBP) for the integrative encoding performances, including high compression efficiency, low complexity, fast random access, and view scalability, by integrating multiple prediction structures. We also propose an in-coding mode-switching algorithm that enables AMVC-HBP to adaptively select a better prediction structure in the encoding process without any additional complexity. Experimental results show that AMVC-HBP outperforms the previous multiview video coding scheme based on H.264/MPEG-4 AVC using the hierarchical B picture (MVC-HBP) on low complexity for 21.5%, on fast random access for about 20%, and on view scalability for 11% to 15% on average. In addition, distinct coding gain can be achieved by AMVC-HBP for dense and fast-moving sequences compared with MVC-HBP.

Key word :

Multiview video coding, correlation analyses, random access, view scalability, in-coding mode switching.

DOI :

http://dx.doi.org/10.4218/etrij.09.0108.0350

Cite this :

Yun Zhang, Gang Yi Jiang, Mei Yu, and Yo Sung Ho, "Adaptive Multiview Video Coding Scheme Based on Spatiotemporal Correlation Analyses," ETRI Journal, vol. 31, no. 2, Apr. 2009, pp. 151-161.
http://dx.doi.org/10.4218/etrij.09.0108.0350

References :

1. M. Tanimoto et al., "Proposal on Requirements for FTV," ISO/IEC MPEG & ITU-T VCEG, JVT-W127, California, USA, Apr. 2007.

2. Survey of Algorithms Used for MVC, ISO/IEC JTC1/SC29/ WG11, N6909, Hong Kong, China, Jan. 2005.

3. Y.S. Ho and K.J. Oh, "Overview of Multi-view Video Coding," 14th Int’l Workshop Syst., Signals and Image Processing (IWSSIP), Maribo, Slovenia, June 2007, pp. 5-12.

4. R. Koenen, "Overview of the MPEG-4 Standard," ISO/IEC JTC1/SC29/WG11, N4030, Singapore, Mar. 2001.

5. J.-W. Kang et al., "Graph Theoretical Optimization of Prediction Structure in Multiview Video Coding," Proc. of IEEE Int’l Conf. Image Proc (ICIP), vol. 6, San Antonio, Sept. 2007, pp. 429-432.

6. S. Oka, T. Endo, and T. Fujii, "Dynamic Ray-Space Coding Using Multi-directional Picture," IEICE Technical Report, Dec. 2004, pp. 15-20.

7. K. Yamamoto et al., "Multiview Video Coding Using View Interpolation and Color Correction," IEEE Trans. Circuits Syst. Video Technol., vol. 17, no. 11, Nov. 2007. pp. 1436-1449.

8. M. Kitahara et al., "Multi-view Video Coding Using View Interpolation and Reference Picture Selection," Proc. IEEE Int’l Conf. Multimedia & Expo, Toronto, Canada, July 2006, pp. 97-100.

9. P. Merkle et al., "Efficient Prediction Structures for Multiview Video Coding," IEEE Trans. Circuits Syst. Video Technol., vol. 17, no. 11, Nov. 2007. pp. 1461-1473.

10. Description of Core Experiments in MVC, ISO/IEC JTC1/SC29/ WG11, w8019, Montreux, Switzerland, Apr. 2006.

11. H. Schwarz, M. Wien, and J. Vieron, JSVM Software Manual, Joint Video Team, ISO/IEC MPEG & ITU-T VCEG, JVT-S070, Geneva, Switzerland, Apr. 2006.

12. H. Schwarz, M. Wien, and J. Vieron, JSVM Software Manual, Joint Video Team, ISO/IEC MPEG & ITU-T VCEG, JVT-S070, Geneva, Switzerland, Apr. 2006.

13. M. Yu et al., "Bandwidth Distortion Model for MVC in Interactive System," ISO/IEC MPEG & ITU-T VCEG, JVTY027, Shenzhen, China, Oct. 2007.

14. S. Shimizu et al., "View Scalable Multiview Video Coding Using 3-D Warping with Depth Map," IEEE Trans. Circuits and Syst. for Video Technol., vol. 17, no. 11, Nov. 2007, pp. 1485-1495.

15. Y. Liu et al., "Low-Delay View Random Access for Multi-view Video Coding," Proc. IEEE Int’l Symp. on Circuits and Syst. (ISCAS), New Orleans, USA, May 2007, pp. 997-1000.

16. R. Kawada, "KDDI Multiview Video Sequences for MPEG 3DAV," ISO/IEC JTC1/SC29/WG11, M10533, Munich, Germany, Mar. 2004.

17. A. Vetro et al., "Multiview Video Test Sequences from MERL for the MPEG Multiview Working Group," ISO/IEC JTC1/SC29/WG11, M12077, Busan, Korea, Apr. 2005.

18. Y. Zhang et al., "An Approach to Multi-modal Multi-view Video Coding," Proc. of Int’l Conf. Signal Processing (ICSP), vol. 2, Guilin China, Nov. 2006. pp. 1405-1408.

19. U. Fecker and A. Kaup, "Statistical Analysis of Multi-Reference Block Matching for Dynamic Light Field Coding," Proc. Vision, Modeling and Visual. (VMV), Erlangen, Germany, Nov. 2005, pp. 445-452.

20. K. Sohn et al., "Results on CE1 for Multi-view Video Coding," ISO/IEC MPEG & ITU-T VCEG, JVT-T102, Klagenfurt, Austria, July 2006.

21. H. Schwarz, D. Marpe, and T. Wiegand, "Hierarchical B Pictures," ISO/IEC MPEG & ITU-T VCEG, JVT-P014, Poznan, Poland, July 2005.

22. Y. Zhang, M. Yu, and G.Y. Jiang, "Evaluation of Typical Prediction Structures for Multi-view Video Coding," ISAST Trans. Electronics and Signal Processing, vol. 2, no. 1, 2008, pp. 7-15.

Reader
Evaluation :

Important Innovative Insightful Useful

This article has been downloaded 3,248 times.

Regular Papers

	Curved Projection Integral Imaging Using an Additional Large-Aperture Convex Lens for Viewing Angle Improvement
	Joobong Hyun, Dong-Choon Hwang, Dong-Hak Shin, Byung-Gook Lee, and Eun-Soo Kim ETRI Journal, vol.31, no.2, Apr. 2009, pp.105-110 http://dx.doi.org/10.4218/etrij.09.0108.0306

	Mapping and Scheduling for Circuit-Switched Network-on-Chip Architecture
	Chia-Ming Wu, Hsin-Chou Chi, and Ruay-Shiung Chang ETRI Journal, vol.31, no.2, Apr. 2009, pp.111-120 http://dx.doi.org/10.4218/etrij.09.0108.0608

	Fast Training of Structured SVM Using Fixed-Threshold Sequential Minimal Optimization
	Changki Lee, and Myung-Gil Jang ETRI Journal, vol.31, no.2, Apr. 2009, pp.121-128 http://dx.doi.org/10.4218/etrij.09.0108.0276

	Efficient Computation of Eta Pairing over Binary Field with Vandermonde Matrix
	Masaaki Shirase, Tsuyoshi Takagi, Dooho Choi, DongGuk Han, and Howon Kim ETRI Journal, vol.31, no.2, Apr. 2009, pp.129-139 http://dx.doi.org/10.4218/etrij.09.0108.0317

	Statistical Investigation on Class Mutation Operators
	Yu-Seung Ma, Yong Rae Kwon, and Sang-Woon Kim ETRI Journal, vol.31, no.2, Apr. 2009, pp.140-150 http://dx.doi.org/10.4218/etrij.09.0108.0356

	Adaptive Multiview Video Coding Scheme Based on Spatiotemporal Correlation Analyses
	Yun Zhang, Gang Yi Jiang, Mei Yu, and Yo Sung Ho ETRI Journal, vol.31, no.2, Apr. 2009, pp.151-161 http://dx.doi.org/10.4218/etrij.09.0108.0350

	Blind MMSE Equalization of FIR/IIR Channels Using Oversampling and Multichannel Linear Prediction
	Fangjiong Chen, Sam Kwong, and Chi-Wah Kok ETRI Journal, vol.31, no.2, Apr. 2009, pp.162-172 http://dx.doi.org/10.4218/etrij.09.0108.0147

	Estimation-Based Load-Balancing with Admission Control for Cluster Web Servers
	Saeed Sharifian, Seyed Ahmad Motamedi, and Mohammad Kazem Akbari ETRI Journal, vol.31, no.2, Apr. 2009, pp.173-181 http://dx.doi.org/10.4218/etrij.09.0108.0168

	Application of ANFIS Power Control for Downlink CDMA-Based LMDS Systems
	Ze-Shin Lee, Mu-King Tsay, and Chien-Hsing Liao ETRI Journal, vol.31, no.2, Apr. 2009, pp.182-192 http://dx.doi.org/10.4218/etrij.09.0108.0296

	Blind Adaptive Multiuser Detection for the MC-CDMA Systems Using Orthogonalized Subspace Tracking
	Imran Ali, Doug Nyun Kim, and Jong Soo Lim ETRI Journal, vol.31, no.2, Apr. 2009, pp.193-200 http://dx.doi.org/10.4218/etrij.09.0108.0278

	Bandwidth Enhancement for SSN Suppression Using a Spiral-Shaped Power Island and a Modified EBG Structure for a λ/4 Open Stub
	Bobae Kim, and Dong-Wook Kim ETRI Journal, vol.31, no.2, Apr. 2009, pp.201-208 http://dx.doi.org/10.4218/etrij.09.0108.0264

	Test-Generation-Based Fault Detection in Analog VLSI Circuits Using Neural Networks
	Palanisamy Kalpana, and Kandasamy Gunavathi ETRI Journal, vol.31, no.2, Apr. 2009, pp.209-214 http://dx.doi.org/10.4218/etrij.09.0108.0383

	How a Convergence Product Affects Related Markets: The Case of the Mobile Phone
	Misuk Lee, Jongsu Lee, and Youngsang Cho ETRI Journal, vol.31, no.2, Apr. 2009, pp.215-224 http://dx.doi.org/10.4218/etrij.09.0108.0574

Letters

	Novel Planar Metamaterial with a Negative Refractive Index
	Dongho Kim, and Jaeick Choi ETRI Journal, vol.31, no.2, Apr. 2009, pp.225-227 http://dx.doi.org/10.4218/etrij.09.0208.0337

	InP-Based Polarization-Insensitive Planar Waveguide Concave Grating Demultiplexer with Flattened Spectral Response
	Oh Kee Kwon, Chul Wook Lee, Dong Hun Lee, Eun Deok Sim, Jong Hoi Kim, and Yong Soon Baek ETRI Journal, vol.31, no.2, Apr. 2009, pp.228-230 http://dx.doi.org/10.4218/etrij.09.0208.0223

	Channel Enlargement of PON System Using Nonreciprocal Multiplexing Filter Based on CWDM
	Bong Kyu Kim, Bin Young Yoon, and Yool Kwon ETRI Journal, vol.31, no.2, Apr. 2009, pp.231-233 http://dx.doi.org/10.4218/etrij.09.0208.0346

	Switched-Capacitor Variable Gain Amplifier with Operational Amplifier Preset Technique
	Young-Kyun Cho, Young-Deuk Jeon, and Jong-Kee Kwon ETRI Journal, vol.31, no.2, Apr. 2009, pp.234-236 http://dx.doi.org/10.4218/etrij.09.0208.0288

	Development of 7-Year-Old Korean Child Model for Computational Dosimetry
	Ae-Kyoung Lee, Jin-Kyu Byun, Jin Seo Park, Hyung-Do Choi, and Jaehoon Yun ETRI Journal, vol.31, no.2, Apr. 2009, pp.237-239 http://dx.doi.org/10.4218/etrij.09.0208.0342

	Fast Implementation of the Progressive Edge-Growth Algorithm
	Lin Chen, and Da-Zheng Feng ETRI Journal, vol.31, no.2, Apr. 2009, pp.240-242 http://dx.doi.org/10.4218/etrij.09.0208.0358

	Ultra-Low-Power Differential ISFET/REFET Readout Circuit
	Apinunt Thanachayanont, and Silar Sirimasakul ETRI Journal, vol.31, no.2, Apr. 2009, pp.243-245 http://dx.doi.org/10.4218/etrij.09.0208.0368