Abstract
The effectiveness of object detection largely depends on the availability of large annotated datasets to train the deep network successfully; however, obtaining a large-scale dataset is expensive and remains a challenge. In this work, we explore two different GAN-based approaches for data augmentation of agricultural images in a camouflaged environment. Camouflage is the property of an object which makes it hard to detect because of its similarity to its environment. We leverage paired and unpaired image-to-image translation to create synthetic images based on custom segmentation masks. We evaluate the quality of synthetic images by applying these to the object detection task as additional training samples. The experiments demonstrate that adversarial-based data augmentation significantly improves the accuracy of region-based convolutional neural network for object detection. Our findings show that when evaluated on the testing dataset, data augmentation achieves detection performance improvement of 3.97%. Given the difficulty of object detection task in camouflaged images, the result suggests that combining adversarial-based data augmentation with the original data can theoretically be synergistic in enhancing deep neural network efficiency to address the open problem of detecting objects in camouflaged environments.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Similar content being viewed by others
References
Barth, R., IJsselmuiden, J., Hemming, J., Van Henten, E.J.: Optimising realism of synthetic agricultural images using cycle generative adversarial networks. In: Proceedings of the IEEE IROS Workshop on Agricultural Robotics, pp. 18–22 (2017)
Zhu, J.Y., Park, T., Isola, P., Efros, A.A.: Unpaired image-to-image translation using cycle-consistent adversarial networks. In: Proceedings of the IEEE International Conference on Computer Vision, pp. 2223–2232 (2017)
Isola, P., Zhu, J.Y., Zhou, T., Efros, A.A.: Image-to-image translation with conditional adversarial networks. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 1125–1134 (2017)
Park, T., Liu, M.Y., Wang, T.C., Zhu, J.Y.: Semantic image synthesis with spatially-adaptive normalization. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 2337–2346 (2019)
Nazki, H., Lee, J., Yoon, S., Park, D.S.: Image-to-image translation with GAN for synthetic data augmentation in plant disease datasets. Smart Media J. 8(2), 46–57 (2019)
Goodfellow, I., et al.: Generative adversarial nets. In: Advances in Neural Information Processing Systems, pp. 2672–2680 (2014)
Nazki, H., Yoon, S., Fuentes, A., Park, D.S.: Unsupervised image translation using adversarial networks for improved plant disease recognition. Comput. Electron. Agric. 1(168), 105–117 (2020)
Zhu, Y., Aoun, M., Krijn, M., Vanschoren, J., HT Campus: Data augmentation using conditional generative adversarial networks for leaf counting in Arabidopsis plants. In: British Machine Vision Conference, pp. 3–24 (2018)
Ren, S., He, K., Girshick, R., Sun, J.: Faster R-CNN: towards real-time object detection with region proposal networks. In: Advances in Neural Information Processing Systems, pp. 91–99 (2015)
Lu, C.Y., Rustia, D.J., Lin, T.T.: Generative adversarial network based image augmentation for insect pest classification enhancement. IFAC-PapersOnLine 52(30), 1–5 (2019)
Tian, Y., Yang, G., Wang, Z., Li, E., Liang, Z.: Detection of apple lesions in orchards based on deep learning methods of CycleGAN and YOLOV3-Dense. J. Sens. 2019, 1–13 (2019)
Arsenovic, M., Karanovic, M., Sladojevic, S., Anderla, A., Stefanovic, D.: Solving current limitations of deep learning based approaches for plant disease detection. Symmetry 11(7), 9–39 (2019)
Zhu, M.: Recall, Precision and Average Precision. Department of Statistics and Actuarial Science, University of Waterloo (2004)
Gu, C., Lim, JJ., Arbeláez, P., Malik, J.: Recognition using regions. In: 2009 IEEE Conference on Computer Vision and Pattern Recognition, pp. 1030–1037. IEEE (2009)
Stevens, M., Merilaita, S.: Animal Camouflage: Mechanisms and Function. Cambridge University Press, Cambridge (2011)
Le, T.N., Nguyen, T.V., Nie, Z., Tran, M.-T., Sugimoto, A.: Anabranch network for camouflaged object segmentation. Comput. Vis. Image Underst. 184, 45–56 (2019)
Author information
Authors and Affiliations
Corresponding authors
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2020 Springer Nature Switzerland AG
About this paper
Cite this paper
Marcelo, J.G., Azcarraga, A.P. (2020). Generative Adversarial Networks for Improving Object Detection in Camouflaged Images. In: Yang, H., Pasupa, K., Leung, A.CS., Kwok, J.T., Chan, J.H., King, I. (eds) Neural Information Processing. ICONIP 2020. Communications in Computer and Information Science, vol 1332. Springer, Cham. https://doi.org/10.1007/978-3-030-63820-7_49
Download citation
DOI: https://doi.org/10.1007/978-3-030-63820-7_49
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-030-63819-1
Online ISBN: 978-3-030-63820-7
eBook Packages: Computer ScienceComputer Science (R0)