Abstract
Multi-view video is a new multimedia service which provides immersion and realism using the multiple view channels. However, as the number of cameras increases, the enormous data volume generated by them inevitably calls for better video compression and processing algorithms. However, the multiple images taken at any certain time instants always have inconsistency among the views in their intensity, color, sharpness, and so on. It not only degrades the compression efficiency greatly but also causes subjective quality loss such as dizziness and unnaturalness in random view access. To solve this problem, in this paper, we propose a new multi-view compensation method which uses the Kalman filter. It estimates the illumination discrepancy parameters autonomously both in encoder and decoder. Therefore, our method needs not transmit any additional data for illumination discrepancy information.
Chapter PDF
Similar content being viewed by others
References
Smolic, A., Kauff, P.: Interactive 3D Video Representation and Coding Technologies. Proceedings of the IEEE, Special Issue on Advances in Video Coding and Delivery 93(1), 98–110 (2005)
Requirements on Multi-view Video Coding, vol. 4, Poznan, Poland (July 2005) ISO/IEC JTC1/SC29/WG11 N7282
Survey of Algorithms used for Multi-view Video Coding, Hong Kong (January 2005) ISO/IEC JTC1/SC29/WG11 N6909
Matusik, W., Pfister, H.: 3D TV: A Scalable System for Real-Time Acquisition, Transmission, and Autostereoscopic Display of Dynamic Scenes. ACM Transactions on Graphics (TOG) SIGGRAPH 23, 814–824 (2004)
Brown, M., Majumder, A., Yang, R.: Camera-Based Calibration Techniques for Seamless Multiprojector Displays. IEEE Transactions on Visualization and Computer Graphics 11, 193–206 (2005)
Shum, H.-Y., He, S.B., Chan, S.-C.: Survey of lmage-Based Representations and Compression Techniques. IEEE Trans. CSVT 13(11), 1020–1037 (2003)
Ohm, J.R.: Encoding and reconstruction of multiview video objects: Looking at data compression in the context of the MPEG-4 multimedia standard. IEEE Signal Processing Mag. 16, 47–54 (1999)
Lim, J., Ngan, K., Yang, W., Sohn, K.: A Multiview Sequence CODEC with View Scalability. Signal Processing: Image Communication 19(3), 239–256 (2004)
Guo, X., Lu, Y., Gao, W., Huang, Q.: Viewpoint switching in multiview video streaming. In: Circuits and Systems, 2005. ISCAS 2005. IEEE International Symposium, vol. 4, pp. 3471–3474 (May 2005)
Jeon, Y., Jeon, B.: Intensity Compensation for Efficient Stereo Image Compression. Journal of the Institute of Electronics Engineers of Korea, 101–112 (2005) 2005-42SP-2-11
Mancini, A.: Disparity Estimation and Intermediate View Reconstruction for Novel Applications in Stereoscopic Video, Master Thesis, McGill University (February 1998)
Kamikura, K., Watanabe, H., Kobayashi, N., Ichinose, S., Yasuda, H.: Video Coding Using Global Motion and Brightness-Variation Compensation with Complexity Reduction. Electronics and Communications in Japan 86(2), 80–93 (2002)
Boyce, J.: Weighted prediction in the H.264/MPEG4 AVC video coding standard. IEEE International Symposium on Circuits and Systems (ISCAS), pp. 789–792 (May 2004)
Yin, P., Tourapis, M.A., Boyce, J.: Localized weighted prediction for video coding. In: IEEE International Symposium on Circuits and Systems (ISCAS), vol. 5, pp. 4365–4368 (May 23-26, 2005)
Illumination compensation for multi-view video coding, Montreux, Switzerland (April 2006) ISO/IEC JTC1/SC29/WG11 m13150
Joint Video Team (JVT) of ISO/IEC MPEG & ITU-T VCEG JVT-U052, CE11 : Illumination Compensation, 21st Meeting: Hangzhou, China (October 20-27, 2006)
Joint Video Team (JVT) of ISO/IEC MPEG & ITU-T VCEG JVT-T114, Results on CE2 using IBDE for multi-view video coding, 20th Meeting: Klagenfurt, Austria (July 15-21, 2006)
Muller, K.: Multi-View Coding Software, http://iphome.hhi.de/mueller/MVC_SW.htm
Healey, G., Kondepudy, R.: Radiometric CCD camera calibration and noise estimation. IEEE, Pattern Analysis and Machine Intelligence(PAMI) 16(3), 267–276 (1994)
Tsin, Y., Ramesh, V., Kanade, T.: Statistical calibration of CCD Imaging Process. In: IEEE International Conference on Computer Vision (ICCV 2001) (July 2001)
Gelb, A.: Applied Optimal Estimation. MIT Press, Cambridge (1974)
Author information
Authors and Affiliations
Editor information
Rights and permissions
Copyright information
© 2007 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Park, J., Jeon, B. (2007). Integrated Multi-view Compensation for Real Sense Video Interfaces. In: Smith, M.J., Salvendy, G. (eds) Human Interface and the Management of Information. Interacting in Information Environments. Human Interface 2007. Lecture Notes in Computer Science, vol 4558. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-540-73354-6_67
Download citation
DOI: https://doi.org/10.1007/978-3-540-73354-6_67
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-73353-9
Online ISBN: 978-3-540-73354-6
eBook Packages: Computer ScienceComputer Science (R0)