{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2024,11,19]],"date-time":"2024-11-19T17:39:59Z","timestamp":1732037999232},"reference-count":59,"publisher":"Association for Computing Machinery (ACM)","issue":"6","license":[{"start":{"date-parts":[[2018,12,4]],"date-time":"2018-12-04T00:00:00Z","timestamp":1543881600000},"content-version":"vor","delay-in-days":0,"URL":"http:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"funder":[{"name":"Alibaba IDEA Lab"},{"DOI":"10.13039\/501100012226","name":"Fundamental research fund for the central universities","doi-asserted-by":"crossref","award":["2017YFB1002600"],"id":[{"id":"10.13039\/501100012226","id-type":"DOI","asserted-by":"crossref"}]},{"name":"NVIDIA Corporation"},{"name":"Young Elite Scientists Sponsorship Program by CAST","award":["2017QNRC001"]},{"DOI":"10.13039\/501100001809","name":"National Natural Science Foundation of China","doi-asserted-by":"crossref","award":["61872440, 61828204, 61502453, 61772499, 61732016"],"id":[{"id":"10.13039\/501100001809","id-type":"DOI","asserted-by":"crossref"}]},{"name":"CCF-Tencent Open Fund"},{"name":"Royal Society-Newton Mobility Grant","award":["IE150731"]}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["ACM Trans. Graph."],"published-print":{"date-parts":[[2018,12,31]]},"abstract":"Transferring deformation from a source shape to a target shape is a very useful technique in computer graphics. State-of-the-art deformation transfer methods require either point-wise correspondences between source and target shapes, or pairs of deformed source and target shapes with corresponding deformations. However, in most cases, such correspondences are not available and cannot be reliably established using an automatic algorithm. Therefore, substantial user effort is needed to label the correspondences or to obtain and specify such shape sets. In this work, we propose a novel approach to automatic deformation transfer between two unpaired shape sets without correspondences. 3D deformation is represented in a high-dimensional space. To obtain a more compact and effective representation, two convolutional variational autoencoders are learned to encode source and target shapes to their latent spaces. We exploit a Generative Adversarial Network (GAN) to map deformed source shapes to deformed target shapes, both in the latent spaces, which ensures the obtained shapes from the mapping are indistinguishable from the target shapes. This is still an under-constrained problem, so we further utilize a reverse mapping from target shapes to source shapes and incorporate cycle consistency loss, i.e. applying both mappings should reverse to the input shape. This VAE-Cycle GAN (VC-GAN) architecture is used to build a reliable mapping between shape spaces. Finally, a similarity constraint is employed to ensure the mapping is consistent with visual similarity, achieved by learning a similarity neural network that takes the embedding vectors from the source and target latent spaces and predicts the light field distance between the corresponding shapes. Experimental results show that our fully automatic method is able to obtain high-quality deformation transfer results with unpaired data sets, comparable or better than existing methods where strict correspondences are required.<\/jats:p>","DOI":"10.1145\/3272127.3275028","type":"journal-article","created":{"date-parts":[[2018,11,28]],"date-time":"2018-11-28T19:16:10Z","timestamp":1543432570000},"page":"1-15","update-policy":"http:\/\/dx.doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":52,"title":["Automatic unpaired shape deformation transfer"],"prefix":"10.1145","volume":"37","author":[{"given":"Lin","family":"Gao","sequence":"first","affiliation":[{"name":"Chinese Academy of Sciences"}]},{"given":"Jie","family":"Yang","sequence":"additional","affiliation":[{"name":"Chinese Academy of Sciences and University of Chinese Academy of Sciences"}]},{"given":"Yi-Ling","family":"Qiao","sequence":"additional","affiliation":[{"name":"CAS and University of Chinese Academy of Sciences"}]},{"given":"Yu-Kun","family":"Lai","sequence":"additional","affiliation":[{"name":"Cardiff University"}]},{"given":"Paul L.","family":"Rosin","sequence":"additional","affiliation":[{"name":"Cardiff University"}]},{"given":"Weiwei","family":"Xu","sequence":"additional","affiliation":[{"name":"Zhejiang University"}]},{"given":"Shihong","family":"Xia","sequence":"additional","affiliation":[{"name":"Chinese Academy of Sciences"}]}],"member":"320","published-online":{"date-parts":[[2018,12,4]]},"reference":[{"key":"e_1_2_2_1_1","doi-asserted-by":"publisher","DOI":"10.1145\/1073204.1073207"},{"key":"e_1_2_2_2_1","doi-asserted-by":"publisher","DOI":"10.1145\/1531326.1531342"},{"key":"e_1_2_2_3_1","doi-asserted-by":"publisher","DOI":"10.1145\/1599470.1599479"},{"key":"e_1_2_2_4_1","unstructured":"Davide Boscaini Jonathan Masci Emanuele Rodol\u00e0 and Michael Bronstein. 2016a. Learning shape correspondence with anisotropic convolutional neural networks. In Advances in Neural Information Processing Systems (NIPS). 3189--3197. Davide Boscaini Jonathan Masci Emanuele Rodol\u00e0 and Michael Bronstein. 2016a. Learning shape correspondence with anisotropic convolutional neural networks. In Advances in Neural Information Processing Systems (NIPS). 3189--3197."},{"key":"e_1_2_2_5_1","doi-asserted-by":"publisher","DOI":"10.1111\/cgf.12844"},{"key":"e_1_2_2_6_1","volume-title":"International Conference on Learning Representations (ICLR).","author":"Bruna Joan","year":"2014","unstructured":"Joan Bruna , Wojciech Zaremba , Arthur Szlam , and Yann LeCun . 2014 . Spectral networks and locally connected networks on graphs . In International Conference on Learning Representations (ICLR). Joan Bruna, Wojciech Zaremba, Arthur Szlam, and Yann LeCun. 2014. Spectral networks and locally connected networks on graphs. In International Conference on Learning Representations (ICLR)."},{"key":"e_1_2_2_7_1","doi-asserted-by":"publisher","DOI":"10.1111\/1467-8659.00669"},{"key":"e_1_2_2_8_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.cag.2010.01.003"},{"key":"e_1_2_2_9_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-319-46484-8_38"},{"key":"e_1_2_2_10_1","first-page":"379","article-title":"Example-based Deformation Transfer for 3D Polygon Models","volume":"26","author":"Chu Hung-Kuo","year":"2010","unstructured":"Hung-Kuo Chu and Chao-Hung Lin . 2010 . Example-based Deformation Transfer for 3D Polygon Models . J. Inf. Sci. Eng. 26 , 2 (2010), 379 -- 391 . Hung-Kuo Chu and Chao-Hung Lin. 2010. Example-based Deformation Transfer for 3D Polygon Models. J. Inf. Sci. Eng. 26, 2 (2010), 379--391.","journal-title":"J. Inf. Sci. Eng."},{"key":"e_1_2_2_11_1","doi-asserted-by":"publisher","DOI":"10.1145\/2999535"},{"key":"e_1_2_2_12_1","doi-asserted-by":"publisher","DOI":"10.1049\/iet-cvi:20070041"},{"key":"e_1_2_2_13_1","unstructured":"Micha\u00ebl Defferrard Xavier Bresson and Pierre Vandergheynst. 2016. Convolutional neural networks on graphs with fast localized spectral filtering. In Advances in Neural Information Processing Systems (NIPS). 3844--3852. Micha\u00ebl Defferrard Xavier Bresson and Pierre Vandergheynst. 2016. Convolutional neural networks on graphs with fast localized spectral filtering. In Advances in Neural Information Processing Systems (NIPS). 3844--3852."},{"key":"e_1_2_2_14_1","volume-title":"Adams","author":"Duvenaud David K.","year":"2015","unstructured":"David K. Duvenaud , Dougal Maclaurin , Jorge Iparraguirre , Rafael Bombarell , Timothy Hirzel , Al\u00e1n Aspuru-Guzik , and Ryan P . Adams . 2015 . Convolutional networks on graphs for learning molecular fingerprints. In Advances in Neural Information Processing Systems (NIPS) . 2224--2232. David K. Duvenaud, Dougal Maclaurin, Jorge Iparraguirre, Rafael Bombarell, Timothy Hirzel, Al\u00e1n Aspuru-Guzik, and Ryan P. Adams. 2015. Convolutional networks on graphs for learning molecular fingerprints. In Advances in Neural Information Processing Systems (NIPS). 2224--2232."},{"key":"e_1_2_2_15_1","volume-title":"IEEE Conf. on Computer Vision and Pattern Recognition (CVPR). 605--613","author":"Fan Haoqiang","unstructured":"Haoqiang Fan , Hao Su , and Leonidas J. Guibas . 2017. A Point Set Generation Network for 3D Object Reconstruction from a Single Image . In IEEE Conf. on Computer Vision and Pattern Recognition (CVPR). 605--613 . Haoqiang Fan, Hao Su, and Leonidas J. Guibas. 2017. A Point Set Generation Network for 3D Object Reconstruction from a Single Image. In IEEE Conf. on Computer Vision and Pattern Recognition (CVPR). 605--613."},{"key":"e_1_2_2_16_1","doi-asserted-by":"publisher","DOI":"10.1145\/1409625.1409629"},{"key":"e_1_2_2_17_1","volume-title":"Sparse Data Driven Mesh Deformation. arXiv:1709.01250","author":"Gao Lin","year":"2017","unstructured":"Lin Gao , Yu-Kun Lai , Jie Yang , Ling-Xiao Zhang , Leif Kobbelt , and Shihong Xia . 2017. Sparse Data Driven Mesh Deformation. arXiv:1709.01250 ( 2017 ). Lin Gao, Yu-Kun Lai, Jie Yang, Ling-Xiao Zhang, Leif Kobbelt, and Shihong Xia. 2017. Sparse Data Driven Mesh Deformation. arXiv:1709.01250 (2017)."},{"key":"e_1_2_2_18_1","doi-asserted-by":"publisher","DOI":"10.1145\/2908736"},{"key":"e_1_2_2_19_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-319-46466-4_29"},{"key":"e_1_2_2_20_1","doi-asserted-by":"publisher","DOI":"10.1145\/3072959.3073629"},{"key":"e_1_2_2_21_1","volume-title":"Deep convolutional networks on graph-structured data. arXiv:1506.05163","author":"Henaff Mikael","year":"2015","unstructured":"Mikael Henaff , Joan Bruna , and Yann LeCun . 2015. Deep convolutional networks on graph-structured data. arXiv:1506.05163 ( 2015 ). Mikael Henaff, Joan Bruna, and Yann LeCun. 2015. Deep convolutional networks on graph-structured data. arXiv:1506.05163 (2015)."},{"key":"e_1_2_2_22_1","volume-title":"Deep Metric Learning Using Triplet Network. In International Workshop on Similarity-Based Pattern Recognition. 84--92","author":"Hoffer Elad","year":"2014","unstructured":"Elad Hoffer and Nir Ailon . 2014 . Deep Metric Learning Using Triplet Network. In International Workshop on Similarity-Based Pattern Recognition. 84--92 . Elad Hoffer and Nir Ailon. 2014. Deep Metric Learning Using Triplet Network. In International Workshop on Similarity-Based Pattern Recognition. 84--92."},{"key":"e_1_2_2_23_1","doi-asserted-by":"publisher","DOI":"10.1145\/3137609"},{"key":"e_1_2_2_24_1","volume-title":"Image-to-Image Translation with Conditional Adversarial Networks. In IEEE Conf. on Computer Vision and Pattern Recognition (CVPR). 1125--1134","author":"Isola Phillip","unstructured":"Phillip Isola , Jun-Yan Zhu , Tinghui Zhou , and Alexei A. Efros . 2017 . Image-to-Image Translation with Conditional Adversarial Networks. In IEEE Conf. on Computer Vision and Pattern Recognition (CVPR). 1125--1134 . Phillip Isola, Jun-Yan Zhu, Tinghui Zhou, and Alexei A. Efros. 2017. Image-to-Image Translation with Conditional Adversarial Networks. In IEEE Conf. on Computer Vision and Pattern Recognition (CVPR). 1125--1134."},{"key":"e_1_2_2_25_1","doi-asserted-by":"publisher","DOI":"10.1145\/1015706.1015815"},{"key":"e_1_2_2_26_1","volume-title":"Adam: A Method for Stochastic Optimization. In International Conference on Learning Representations (ICLR).","author":"Diederik","unstructured":"Diederik P. Kingma and Jimmy Ba. 2015 . Adam: A Method for Stochastic Optimization. In International Conference on Learning Representations (ICLR). Diederik P. Kingma and Jimmy Ba. 2015. Adam: A Method for Stochastic Optimization. In International Conference on Learning Representations (ICLR)."},{"key":"e_1_2_2_27_1","doi-asserted-by":"publisher","DOI":"10.1145\/3072959.3073637"},{"key":"e_1_2_2_28_1","doi-asserted-by":"publisher","DOI":"10.1145\/2816795.2818071"},{"key":"e_1_2_2_29_1","volume-title":"Deformable Shape Completion with Graph Convolutional Autoencoders. arXiv:1712.00268","author":"Litany Or","year":"2017","unstructured":"Or Litany , Alex Bronstein , Michael Bronstein , and Ameesh Makadia . 2017. Deformable Shape Completion with Graph Convolutional Autoencoders. arXiv:1712.00268 ( 2017 ). Or Litany, Alex Bronstein, Michael Bronstein, and Ameesh Makadia. 2017. Deformable Shape Completion with Graph Convolutional Autoencoders. arXiv:1712.00268 (2017)."},{"key":"e_1_2_2_30_1","doi-asserted-by":"publisher","DOI":"10.1109\/3DV.2017.00024"},{"key":"e_1_2_2_31_1","doi-asserted-by":"publisher","DOI":"10.1145\/3072959.3073616"},{"key":"e_1_2_2_32_1","doi-asserted-by":"publisher","DOI":"10.1109\/IROS.2015.7353481"},{"key":"e_1_2_2_33_1","volume-title":"Barr","author":"Meyer Mark","year":"2003","unstructured":"Mark Meyer , Mathieu Desbrun , Peter Schr\u00f6der , and Alan H . Barr . 2003 . Discrete differential-geometry operators for triangulated 2-manifolds. In Visualization and mathematics III. 35--57. Mark Meyer, Mathieu Desbrun, Peter Schr\u00f6der, and Alan H. Barr. 2003. Discrete differential-geometry operators for triangulated 2-manifolds. In Visualization and mathematics III. 35--57."},{"key":"e_1_2_2_34_1","doi-asserted-by":"publisher","DOI":"10.1111\/cgf.13240"},{"key":"e_1_2_2_35_1","volume-title":"International conference on machine learning (ICML). 2014--2023","author":"Niepert Mathias","year":"2016","unstructured":"Mathias Niepert , Mohamed Ahmed , and Konstantin Kutzkov . 2016 . Learning convolutional neural networks for graphs . In International conference on machine learning (ICML). 2014--2023 . Mathias Niepert, Mohamed Ahmed, and Konstantin Kutzkov. 2016. Learning convolutional neural networks for graphs. In International conference on machine learning (ICML). 2014--2023."},{"key":"e_1_2_2_36_1","doi-asserted-by":"publisher","DOI":"10.1145\/2766993"},{"key":"e_1_2_2_37_1","doi-asserted-by":"publisher","DOI":"10.1145\/2461912.2461959"},{"key":"e_1_2_2_38_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-319-49409-8_20"},{"key":"e_1_2_2_39_1","doi-asserted-by":"publisher","DOI":"10.1109\/LSP.2015.2480802"},{"key":"e_1_2_2_40_1","doi-asserted-by":"publisher","DOI":"10.5555\/998687.1007045"},{"key":"e_1_2_2_41_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2017.91"},{"key":"e_1_2_2_42_1","doi-asserted-by":"publisher","DOI":"10.1145\/1015706.1015736"},{"key":"e_1_2_2_43_1","doi-asserted-by":"publisher","DOI":"10.1145\/3130800.3130821"},{"key":"e_1_2_2_44_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2018.00612"},{"key":"e_1_2_2_45_1","volume-title":"Mesh-based Autoencoders for Localized Deformation Component Analysis. In AAAI Conference on Artificial Intelligence (AAAI). 2452--2459","author":"Tan Qingyang","year":"2018","unstructured":"Qingyang Tan , Lin Gao , Yu-Kun Lai , Jie Yang , and Shihong Xia . 2018 b. Mesh-based Autoencoders for Localized Deformation Component Analysis. In AAAI Conference on Artificial Intelligence (AAAI). 2452--2459 . Qingyang Tan, Lin Gao, Yu-Kun Lai, Jie Yang, and Shihong Xia. 2018b. Mesh-based Autoencoders for Localized Deformation Component Analysis. In AAAI Conference on Artificial Intelligence (AAAI). 2452--2459."},{"key":"e_1_2_2_46_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2017.160"},{"key":"e_1_2_2_47_1","doi-asserted-by":"publisher","DOI":"10.1145\/1360612.1360696"},{"key":"e_1_2_2_48_1","doi-asserted-by":"publisher","DOI":"10.1145\/3072959.3073608"},{"key":"e_1_2_2_49_1","volume-title":"High-Resolution Image Synthesis and Semantic Manipulation with Conditional GANs. In IEEE Conf. on Computer Vision and Pattern Recognition (CVPR). 6721--6729","author":"Wang Ting-Chun","year":"2017","unstructured":"Ting-Chun Wang , Ming-Yu Liu , Jun-Yan Zhu , Andrew Tao , Jan Kautz , and Bryan Catanzaro . 2017 b. High-Resolution Image Synthesis and Semantic Manipulation with Conditional GANs. In IEEE Conf. on Computer Vision and Pattern Recognition (CVPR). 6721--6729 . Ting-Chun Wang, Ming-Yu Liu, Jun-Yan Zhu, Andrew Tao, Jan Kautz, and Bryan Catanzaro. 2017b. High-Resolution Image Synthesis and Semantic Manipulation with Conditional GANs. In IEEE Conf. on Computer Vision and Pattern Recognition (CVPR). 6721--6729."},{"key":"e_1_2_2_50_1","doi-asserted-by":"publisher","DOI":"10.1145\/1276377.1276420"},{"key":"e_1_2_2_51_1","volume-title":"Tenenbaum","author":"Wu Jiajun","year":"2016","unstructured":"Jiajun Wu , Chengkai Zhang , Tianfan Xue , William T. Freeman , and Joshua B . Tenenbaum . 2016 . Learning a probabilistic latent space of object shapes via 3D generative-adversarial modeling. In Advances in Neural Information Processing Systems (NIPS) . 82--90. Jiajun Wu, Chengkai Zhang, Tianfan Xue, William T. Freeman, and Joshua B. Tenenbaum. 2016. Learning a probabilistic latent space of object shapes via 3D generative-adversarial modeling. In Advances in Neural Information Processing Systems (NIPS). 82--90."},{"key":"e_1_2_2_52_1","volume-title":"IEEE Conf. on Computer Vision and Pattern Recognition (CVPR). 1912--1920","author":"Wu Zhirong","year":"2015","unstructured":"Zhirong Wu , Shuran Song , Aditya Khosla , Fisher Yu , Linguang Zhang , Xiaoou Tang , and Jianxiong Xiao . 2015 . 3D ShapeNets: A deep representation for volumetric shapes . In IEEE Conf. on Computer Vision and Pattern Recognition (CVPR). 1912--1920 . Zhirong Wu, Shuran Song, Aditya Khosla, Fisher Yu, Linguang Zhang, Xiaoou Tang, and Jianxiong Xiao. 2015. 3D ShapeNets: A deep representation for volumetric shapes. In IEEE Conf. on Computer Vision and Pattern Recognition (CVPR). 1912--1920."},{"key":"e_1_2_2_53_1","doi-asserted-by":"publisher","DOI":"10.1145\/1531326.1531341"},{"key":"e_1_2_2_54_1","unstructured":"Xinchen Yan Jimei Yang Ersin Yumer Yijie Guo and Honglak Lee. 2016. Perspective Transformer Nets: Learning Single-View 3D Object Reconstruction without 3D Supervision. In Advances in Neural Information Processing Systems (NIPS). 1696--1704. Xinchen Yan Jimei Yang Ersin Yumer Yijie Guo and Honglak Lee. 2016. Perspective Transformer Nets: Learning Single-View 3D Object Reconstruction without 3D Supervision. In Advances in Neural Information Processing Systems (NIPS). 1696--1704."},{"key":"e_1_2_2_55_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.gmod.2018.05.003"},{"key":"e_1_2_2_56_1","volume-title":"IEEE Conf. on Computer Vision and Pattern Recognition (CVPR). 6584--6592","author":"Yi Li","unstructured":"Li Yi , Hao Su , Xingwen Guo , and Leonidas J. Guibas . 2017a. SyncSpecCNN: Synchronized Spectral CNN for 3D Shape Segmentation .. In IEEE Conf. on Computer Vision and Pattern Recognition (CVPR). 6584--6592 . Li Yi, Hao Su, Xingwen Guo, and Leonidas J. Guibas. 2017a. SyncSpecCNN: Synchronized Spectral CNN for 3D Shape Segmentation.. In IEEE Conf. on Computer Vision and Pattern Recognition (CVPR). 6584--6592."},{"key":"e_1_2_2_57_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICCV.2017.310"},{"key":"e_1_2_2_58_1","doi-asserted-by":"publisher","DOI":"10.1111\/j.1467-8659.2009.01601.x"},{"key":"e_1_2_2_59_1","volume-title":"IEEE International Conference on Computer Vision (ICCV). 2223--2232","author":"Zhu Jun-Yan","unstructured":"Jun-Yan Zhu , Taesung Park , Phillip Isola , and Alexei A. Efros . 2017. Unpaired Image-to-Image Translation using Cycle-Consistent Adversarial Networks . In IEEE International Conference on Computer Vision (ICCV). 2223--2232 . Jun-Yan Zhu, Taesung Park, Phillip Isola, and Alexei A. Efros. 2017. Unpaired Image-to-Image Translation using Cycle-Consistent Adversarial Networks. In IEEE International Conference on Computer Vision (ICCV). 2223--2232."}],"container-title":["ACM Transactions on Graphics"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3272127.3275028","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2023,8,24]],"date-time":"2023-08-24T15:38:59Z","timestamp":1692891539000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3272127.3275028"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2018,12,4]]},"references-count":59,"journal-issue":{"issue":"6","published-print":{"date-parts":[[2018,12,31]]}},"alternative-id":["10.1145\/3272127.3275028"],"URL":"https:\/\/doi.org\/10.1145\/3272127.3275028","relation":{},"ISSN":["0730-0301","1557-7368"],"issn-type":[{"value":"0730-0301","type":"print"},{"value":"1557-7368","type":"electronic"}],"subject":[],"published":{"date-parts":[[2018,12,4]]},"assertion":[{"value":"2018-12-04","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}