{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2024,9,7]],"date-time":"2024-09-07T06:40:34Z","timestamp":1725691234455},"reference-count":22,"publisher":"MDPI AG","issue":"17","license":[{"start":{"date-parts":[[2023,8,23]],"date-time":"2023-08-23T00:00:00Z","timestamp":1692748800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Remote Sensing"],"abstract":"Optical satellite images of Earth frequently contain cloud cover and shadows. This requires processing pipelines to recognize the presence, location, and features of the cloud-affected regions. Models that make predictions about the ground behind the clouds face the challenge of lacking ground truth information, i.e., the exact state of Earth\u2019s surface. Currently, the solution to that is to either (i) create pairs from samples acquired at different times or (ii) simulate cloudy data based on a clear acquisition. This work follows the second approach and proposes an open-source simulation tool capable of generating a diverse and unlimited number of high-quality simulated pair data with controllable parameters to adjust cloud appearance, with no annotation cost. The tool is available as open-source. An indication of the quality and utility of the generated clouds is demonstrated by the models for cloud detection and cloud removal trained exclusively on simulated data, which approach the performance of their equivalents trained on real data.<\/jats:p>","DOI":"10.3390\/rs15174138","type":"journal-article","created":{"date-parts":[[2023,8,24]],"date-time":"2023-08-24T14:23:40Z","timestamp":1692887020000},"page":"4138","source":"Crossref","is-referenced-by-count":4,"title":["SatelliteCloudGenerator: Controllable Cloud and Shadow Synthesis for Multi-Spectral Optical Satellite Images"],"prefix":"10.3390","volume":"15","author":[{"ORCID":"http:\/\/orcid.org\/0000-0002-0927-0416","authenticated-orcid":false,"given":"Mikolaj","family":"Czerkawski","sequence":"first","affiliation":[{"name":"Department of Electronic and Electrical Engineering, University of Strathclyde, Glasgow G1 1XW, UK"}]},{"ORCID":"http:\/\/orcid.org\/0000-0002-6206-2229","authenticated-orcid":false,"given":"Robert","family":"Atkinson","sequence":"additional","affiliation":[{"name":"Department of Electronic and Electrical Engineering, University of Strathclyde, Glasgow G1 1XW, UK"}]},{"ORCID":"http:\/\/orcid.org\/0000-0001-5132-4572","authenticated-orcid":false,"given":"Craig","family":"Michie","sequence":"additional","affiliation":[{"name":"Department of Electronic and Electrical Engineering, University of Strathclyde, Glasgow G1 1XW, UK"}]},{"ORCID":"http:\/\/orcid.org\/0000-0001-9150-6805","authenticated-orcid":false,"given":"Christos","family":"Tachtatzis","sequence":"additional","affiliation":[{"name":"Department of Electronic and Electrical Engineering, University of Strathclyde, Glasgow G1 1XW, UK"}]}],"member":"1968","published-online":{"date-parts":[[2023,8,23]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"3826","DOI":"10.1109\/TGRS.2012.2227333","article-title":"Spatial and temporal distribution of clouds observed by MODIS onboard the terra and aqua satellites","volume":"51","author":"King","year":"2013","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_2","doi-asserted-by":"crossref","unstructured":"Li, W., Li, Y., Chen, D., and Chan, J.C.W. (August, January 28). Thin Cloud Removal with Residual Symmetrical Concatenation Network. Proceedings of the IGARSS 2019\u20142019 IEEE International Geoscience and Remote Sensing Symposium, Yokohama, Japan.","DOI":"10.1109\/IGARSS.2019.8899894"},{"key":"ref_3","unstructured":"Lin, D., Xu, G., Wang, X., Wang, Y., Sun, X., and Fu, K. (2019). A Remote Sensing Image Dataset for Cloud Removal. arXiv."},{"key":"ref_4","doi-asserted-by":"crossref","unstructured":"Sarukkai, V., Jain, A., Uzkent, B., and Ermon, S. (2020, January 1\u20135). Cloud removal in satellite images using spatiotemporal generative networks. Proceedings of the 2020 IEEE Winter Conference on Applications of Computer Vision, WACV 2020, Snowmass Village, CO, USA.","DOI":"10.1109\/WACV45572.2020.9093564"},{"key":"ref_5","doi-asserted-by":"crossref","unstructured":"Li, J., Wu, Z., Hu, Z., Li, Z., Wang, Y., and Molinier, M. (2021). Deep learning based thin cloud removal fusing vegetation red edge and short wave infrared spectral information for sentinel-2A imagery. Remote Sens., 13.","DOI":"10.3390\/rs13010157"},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"5866","DOI":"10.1109\/TGRS.2020.3024744","article-title":"Multisensor Data Fusion for Cloud Removal in Global and All-Season Sentinel-2 Imagery","volume":"59","author":"Ebel","year":"2021","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1109\/TGRS.2022.3146246","article-title":"SEN12MS-CR-TS: A Remote Sensing Data Set for Multi-modal Multi-temporal Cloud Removal","volume":"60","author":"Ebel","year":"2022","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"782","DOI":"10.1038\/s41597-022-01878-2","article-title":"CloudSEN12\u2014A global dataset for semantic understanding of cloud and cloud shadow in satellite imagery","volume":"9","author":"Aybar","year":"2022","journal-title":"Sci. Data"},{"key":"ref_9","first-page":"1","article-title":"Cloudy Image Arithmetic: A Cloudy Scene Synthesis Paradigm with an Application to Deep-Learning-Based Thin Cloud Removal","volume":"60","author":"Xu","year":"2022","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"287","DOI":"10.1145\/325165.325247","article-title":"Image Synthesizer","volume":"19","author":"Perlin","year":"1985","journal-title":"ACM Siggraph Comput. Graph."},{"key":"ref_11","doi-asserted-by":"crossref","unstructured":"Dong, W., Zhang, X., and Zhang, C. (2010, January 7\u20138). Generation of cloud image based on Perlin noise. Proceedings of the 2010 International Conference on Multimedia Communications, Mediacom 2010, Hong Kong, China.","DOI":"10.1109\/MEDIACOM.2010.77"},{"key":"ref_12","doi-asserted-by":"crossref","unstructured":"Enomoto, K., Sakurada, K., Wang, W., Fukui, H., Matsuoka, M., Nakamura, R., and Kawaguchi, N. (2017, January 21\u201326). Filmy Cloud Removal on Satellite Imagery with Multispectral Conditional Generative Adversarial Nets. Proceedings of the 2017 IEEE Conference on Computer Vision and Pattern Recognition Workshops (CVPRW), Honolulu, HI, USA.","DOI":"10.1109\/CVPRW.2017.197"},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"373","DOI":"10.1016\/j.isprsjprs.2020.06.021","article-title":"Thin cloud removal in optical remote sensing images based on generative adversarial networks and physical model of cloud distortion","volume":"166","author":"Li","year":"2020","journal-title":"ISPRS J. Photogramm. Remote Sens."},{"key":"ref_14","doi-asserted-by":"crossref","unstructured":"Lee, K.Y., and Sim, J.Y. (2019, January 22\u201325). Cloud Removal of Satellite Images Using Convolutional Neural Network with Reliable Cloudy Image Synthesis Model. Proceedings of the 2019 IEEE International Conference on Image Processing (ICIP), Taipei, Taiwan.","DOI":"10.1109\/ICIP.2019.8803666"},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"1855","DOI":"10.1109\/LGRS.2016.2614890","article-title":"No-Reference Assessment on Haze for Remote-Sensing Images","volume":"13","author":"Pan","year":"2016","journal-title":"IEEE Geosci. Remote Sens. Lett."},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"1645","DOI":"10.1109\/JSTARS.2018.2812726","article-title":"Dehazing for Multispectral Remote Sensing Images Based on a Convolutional Neural Network with the Residual Architecture","volume":"11","author":"Qin","year":"2018","journal-title":"IEEE J. Sel. Top. Appl. Earth Obs. Remote Sens."},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"3811","DOI":"10.1109\/JSTARS.2021.3068166","article-title":"Thin Cloud Removal for Multispectral Remote Sensing Images Using Convolutional Neural Networks Combined with an Imaging Model","volume":"14","author":"Zi","year":"2021","journal-title":"IEEE J. Sel. Top. Appl. Earth Obs. Remote Sens."},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"5895","DOI":"10.1109\/TGRS.2013.2293662","article-title":"Haze Detection and Removal in Remotely Sensed Multispectral Imagery","volume":"52","author":"Makarau","year":"2013","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_19","unstructured":"Sentinel Hub Team (2023, August 22). Sentinel Hub\u2019s Cloud Detector for Sentinel-2 Imagery. Available online: https:\/\/github.com\/sentinel-hub\/sentinel2-cloud-detector."},{"key":"ref_20","doi-asserted-by":"crossref","unstructured":"Sandler, M., Howard, A., Zhu, M., Zhmoginov, A., and Chen, L.C. (2018, January 18\u201323). MobileNetV2: Inverted Residuals and Linear Bottlenecks. Proceedings of the 2018 IEEE\/CVF Conference on Computer Vision and Pattern Recognition, Salt Lake City, UT, USA.","DOI":"10.1109\/CVPR.2018.00474"},{"key":"ref_21","unstructured":"Loshchilov, I., and Hutter, F. (2019, January 6\u20139). Decoupled weight decay regularization. Proceedings of the 7th International Conference on Learning Representations, ICLR 2019, New Orleans, LA, USA."},{"key":"ref_22","unstructured":"(2023). S2 MPC: Level-1 Algorithm Theoretical Bases Document, European Space Agency. Ref. S2-PDGS-MPC-ATBD-L1."}],"container-title":["Remote Sensing"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2072-4292\/15\/17\/4138\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2023,8,24]],"date-time":"2023-08-24T14:40:46Z","timestamp":1692888046000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2072-4292\/15\/17\/4138"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,8,23]]},"references-count":22,"journal-issue":{"issue":"17","published-online":{"date-parts":[[2023,9]]}},"alternative-id":["rs15174138"],"URL":"https:\/\/doi.org\/10.3390\/rs15174138","relation":{},"ISSN":["2072-4292"],"issn-type":[{"value":"2072-4292","type":"electronic"}],"subject":[],"published":{"date-parts":[[2023,8,23]]}}}