Abstract
This paper presents an image blending approach which combines optimal seam finding and transition smoothing for merging a set of aligned source images into a composite panoramic image seamlessly. In this approach, graph cut optimization is used for finding optimal seams in overlapping areas of the source images to create a composite image. If the seams in the composite image are still visible, a gradient domain transition smoothing operation is used to reduce color differences between the source images to make them invisible. In the transition smoothing operation, a new gradient vector field is created using the gradients of source images and the seam information. A new composite image can be recovered from the new gradient vector field by solving a Poisson equation with boundary conditions.
Our approach presents several advantages. The use of graph cut optimization over the source images guarantees that optimal seams are found. The gradient domain transition smoothing operation allows smoothing out color differences globally and further improves image quality after merging with graph cut optimization. The final composite image is a global optimal solution. The approach is implemented in two ways called sequential image blending and global image blending. Sequential image blending allows us to use little memory in the whole blending process, which is very important for mobile devices. Global image blending guarantees a globally optimal solution. Experimental and application results in creating mobile image mosaics and mobile panorama are also given.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
Similar content being viewed by others
References
Chen, W.C., Xiong, Y., Gao, J., Gelfand, N., Grzeszczuk, R.: Efficient extraction of robust image features on mobile devices. In: ISMAR 2007: Proceedings of the 2007 6th IEEE and ACM International Symposium on Mixed and Augmented Reality, Washington, DC, USA, pp. 1–2. IEEE Computer Society, Los Alamitos (2007)
Takacs, G., Chandrasekhar, V., Gelfand, N., Xiong, Y., Chen, W.C., Bismpigiannis, T., Grzeszczuk, R., Pulli, K., Girod, B.: Outdoors augmented reality on mobile phone using loxel-based visual feature organization. In: MIR 2008: Proceeding of the 1st ACM international conference on Multimedia information retrieval, pp. 427–434. ACM, New York (2008)
Chen, D., Tsai, S.S., Chandrasekhar, V., Takacs, G., Singh, J., Girod, B.: Robust image retrieval using multiview scalable vocabulary trees. In: Rabbani, M., Stevenson, R.L. (eds.) Visual Communications and Image Processing 2009. SPIE, vol. 7257, 72570V (2009)
Gracias, N., Mahoor, M., Negahdaripour, S., Gleason, A.: Fast image blending using watersheds and graph cuts. Image Vision Comput. 27, 597–607 (2009)
Levin, A., Zomet, A., Peleg, S., Weiss, Y.: Seamless image stitching in the gradient domain. In: Pajdla, T., Matas, J.G. (eds.) ECCV 2004. LNCS, vol. 3024, pp. 377–389. Springer, Heidelberg (2004)
Milgram, D.L.: Computer methods for creating photomosaics. IEEE Trans. Comput. 24, 1113–1119 (1975)
Efros, A.A., Freeman, W.T.: Image quilting for texture synthesis and transfer. In: SIGGRAPH 2001: Proceedings of the 28th annual conference on Computer graphics and interactive techniques, pp. 341–346. ACM, New York (2001)
Davis, J.: Mosaics of scenes with moving objects. In: CVPR 1998: Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition, Washington, DC, USA, p. 354. IEEE Computer Society, Los Alamitos (1998)
Agarwala, A., Dontcheva, M., Agrawala, M., Drucker, S., Colburn, A., Curless, B., Salesin, D., Cohen, M.: Interactive digital photomontage. ACM Trans. Graph. 23, 294–302 (2004)
Uyttendaele, M., Eden, A., Szeliski, R.: Eliminating ghosting and exposure artifacts in image mosaics. In: Computer Vision and Pattern Recognition (CVPR 2001), pp. 509–516. IEEE Computer Society, Los Alamitos (2001)
Burt, P.J., Adelson, E.H.: A multiresolution spline with application to image mosaics. ACM Trans. Graph. 2, 217–236 (1983)
Szeliski, R., Uyttendaele, M., Steedly, D.: Fast poisson blending using multi-splines. Technical Report MSR-TR-2008-58, Microsoft Research (2008)
Kazhdan, M., Hoppe, H.: Streaming multigrid for gradient-domain operations on large images. ACM Trans. Graph. 27, 1–10 (2008)
Fattal, R., Lischinski, D., Werman, M.: Gradient domain high dynamic range compression. In: SIGGRAPH 2002: Proceedings of the 29th annual conference on Computer graphics and interactive techniques, pp. 249–256. ACM, New York (2002)
Pérez, P., Gangnet, M., Blake, A.: Poisson image editing. ACM Trans. Graph. 22, 313–318 (2003)
Jia, J., Sun, J., Tang, C.K., Shum, H.Y.: Drag-and-drop pasting. In: SIGGRAPH 2006: ACM SIGGRAPH 2006 Papers, pp. 631–637. ACM, New York (2006)
Kolmogorov, V., Zabih, R.: What energy functions can be minimized via graph cuts. IEEE Transactions on Pattern Analysis and Machine Intelligence 26, 65–81 (2004)
Briggs, W.L., Henson, V.E., McCormick, S.F.: A Multigrid Tutorial. The Society for Industrial and Applied Mathematics, New York (2001)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2010 ICST Institute for Computer Science, Social Informatics and Telecommunications Engineering
About this paper
Cite this paper
Xiong, Y., Pulli, K. (2010). Gradient Domain Image Blending and Implementation on Mobile Devices. In: Phan, T., Montanari, R., Zerfos, P. (eds) Mobile Computing, Applications, and Services. MobiCASE 2009. Lecture Notes of the Institute for Computer Sciences, Social Informatics and Telecommunications Engineering, vol 35. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-12607-9_19
Download citation
DOI: https://doi.org/10.1007/978-3-642-12607-9_19
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-12606-2
Online ISBN: 978-3-642-12607-9
eBook Packages: Computer ScienceComputer Science (R0)