{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2024,7,19]],"date-time":"2024-07-19T10:34:30Z","timestamp":1721385270357},"reference-count":32,"publisher":"MDPI AG","issue":"21","license":[{"start":{"date-parts":[[2023,10,31]],"date-time":"2023-10-31T00:00:00Z","timestamp":1698710400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100001691","name":"Japan Society for the Promotion of Science (JSPS) KAKENHI","doi-asserted-by":"publisher","award":["20H04201"],"id":[{"id":"10.13039\/501100001691","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"JPEG is the international standard for still image encoding and is the most widely used compression algorithm because of its simple encoding process and low computational complexity. Recently, many methods have been developed to improve the quality of JPEG images by using deep learning. However, these methods require the use of high-performance devices since they need to perform neural network computation for decoding images. In this paper, we propose a method to generate high-quality images using deep learning without changing the decoding algorithm. The key idea is to reduce and smooth colors and gradient regions in the original images before JPEG compression. The reduction and smoothing can suppress red block noise and pseudo-contour in the compressed images. Furthermore, high-performance devices are unnecessary for decoding. The proposed method consists of two components: a color transformation network using deep learning and a pseudo-contour suppression model using signal processing. The experimental results showed that the proposed method outperforms standard JPEG in quality measurements correlated with human perception.<\/jats:p>","DOI":"10.3390\/s23218861","type":"journal-article","created":{"date-parts":[[2023,10,31]],"date-time":"2023-10-31T16:53:32Z","timestamp":1698771212000},"page":"8861","source":"Crossref","is-referenced-by-count":1,"title":["JPEG Image Enhancement with Pre-Processing of Color Reduction and Smoothing"],"prefix":"10.3390","volume":"23","author":[{"given":"Akane","family":"Shoda","sequence":"first","affiliation":[{"name":"Graduate School of Engineering, Tohoku University, Sendai 9808579, Japan"}]},{"ORCID":"http:\/\/orcid.org\/0000-0001-5205-0542","authenticated-orcid":false,"given":"Tomo","family":"Miyazaki","sequence":"additional","affiliation":[{"name":"Graduate School of Engineering, Tohoku University, Sendai 9808579, Japan"}]},{"ORCID":"http:\/\/orcid.org\/0000-0001-7706-9995","authenticated-orcid":false,"given":"Shinichiro","family":"Omachi","sequence":"additional","affiliation":[{"name":"Graduate School of Engineering, Tohoku University, Sendai 9808579, Japan"}]}],"member":"1968","published-online":{"date-parts":[[2023,10,31]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"xviii","DOI":"10.1109\/30.125072","article-title":"The JPEG still picture compression standard","volume":"38","author":"Wallace","year":"1992","journal-title":"IEEE Trans. Consum. Electron."},{"key":"ref_2","doi-asserted-by":"crossref","unstructured":"Dong, C., Deng, Y., Loy, C.C., and Tang, X. (2015, January 13\u201316). Compression Artifacts Reduction by a Deep Convolutional Network. Proceedings of the 2015 IEEE International Conference on Computer Vision (ICCV), Santiago, Chile.","DOI":"10.1109\/ICCV.2015.73"},{"key":"ref_3","doi-asserted-by":"crossref","unstructured":"Fu, X., Zha, Z.J., Wu, F., Ding, X., and Paisley, J. (November, January 27). JPEG Artifacts Reduction via Deep Convolutional Sparse Coding. Proceedings of the 2019 IEEE\/CVF International Conference on Computer Vision (ICCV), Seoul, Republic of Korea.","DOI":"10.1109\/ICCV.2019.00259"},{"key":"ref_4","doi-asserted-by":"crossref","unstructured":"Leibe, B., Matas, J., Sebe, N., and Welling, M. (2016, January 8\u201316). Building Dual-Domain Representations for Compression Artifacts Reduction. Proceedings of the Computer Vision\u2014ECCV 2016, Amsterdam, The Netherlands.","DOI":"10.1007\/978-3-319-46454-1"},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"20160","DOI":"10.1109\/ACCESS.2020.2968944","article-title":"AGARNet: Adaptively Gated JPEG Compression Artifacts Removal Network for a Wide Range Quality Factor","volume":"8","author":"Kim","year":"2020","journal-title":"IEEE Access"},{"key":"ref_6","doi-asserted-by":"crossref","unstructured":"Zhang, X., Yang, W., Hu, Y., and Liu, J. (2018, January 7\u201310). Dmcnn: Dual-Domain Multi-Scale Convolutional Neural Network for Compression Artifacts Removal. Proceedings of the 2018 25th IEEE International Conference on Image Processing (ICIP), Athens, Greece.","DOI":"10.1109\/ICIP.2018.8451694"},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"3982","DOI":"10.1109\/TCSVT.2019.2931045","article-title":"Implicit Dual-Domain Convolutional Network for Robust Color Image Compression Artifact Reduction","volume":"30","author":"Zheng","year":"2020","journal-title":"IEEE Trans. Circuits Syst. Video Technol."},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"027003","DOI":"10.1117\/1.1849242","article-title":"Artifact reduction with diffusion preprocessing for image compression","volume":"44","author":"Kopilovic","year":"2005","journal-title":"Opt. Eng."},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"4798","DOI":"10.1109\/TIP.2018.2845125","article-title":"Optimized Pre-Compensating Compression","volume":"27","author":"Dar","year":"2018","journal-title":"IEEE Trans. Image Process."},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"6673","DOI":"10.1109\/TIP.2021.3096085","article-title":"Better Compression With Deep Pre-Editing","volume":"30","author":"Talebi","year":"2021","journal-title":"IEEE Trans. Image Process."},{"key":"ref_11","doi-asserted-by":"crossref","unstructured":"Bartoli, A., and Fusiello, A. (2020, January 23\u201328). Learning to Improve Image Compression Without Changing the Standard Decoder. Proceedings of the Computer Vision\u2014ECCV 2020 Workshops, Glasgow, UK.","DOI":"10.1007\/978-3-030-65414-6"},{"key":"ref_12","unstructured":"Bilgin, A., Marcellin, M., Serra-Sagrista, J., and Storer, J. (2022, January 22\u201324). Neural JPEG: End-to-End Image Compression Leveraging a Standard JPEG Encoder-Decoder. Proceedings of the 2022 Data Compression Conference (DCC), Snowbird, UT, USA."},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"295","DOI":"10.1109\/TPAMI.2015.2439281","article-title":"Image Super-Resolution Using Deep Convolutional Networks","volume":"38","author":"Dong","year":"2016","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"3142","DOI":"10.1109\/TIP.2017.2662206","article-title":"Beyond a Gaussian Denoiser: Residual Learning of Deep CNN for Image Denoising","volume":"26","author":"Zhang","year":"2017","journal-title":"IEEE Trans. Image Process."},{"key":"ref_15","unstructured":"Ioffe, S., and Szegedy, C. (2015, January 6\u201311). Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shift. Proceedings of the 32nd International Conference on International Conference on Machine Learning, ICML\u201915, Lille, France."},{"key":"ref_16","doi-asserted-by":"crossref","unstructured":"He, K., Zhang, X., Ren, S., and Sun, J. (July, January 26). Deep Residual Learning for Image Recognition. Proceedings of the 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Las Vegas, NV, USA.","DOI":"10.1109\/CVPR.2016.90"},{"key":"ref_17","doi-asserted-by":"crossref","unstructured":"Vedaldi, A., Bischof, H., Brox, T., and Frahm, J.M. (2020, January 23\u201328). Quantization Guided JPEG Artifact Correction. Proceedings of the Computer Vision\u2014ECCV 2020, Glasgow, UK.","DOI":"10.1007\/978-3-030-58565-5"},{"key":"ref_18","doi-asserted-by":"crossref","unstructured":"Jiang, J., Zhang, K., and Timofte, R. (2021, January 11\u201317). Towards Flexible Blind JPEG Artifacts Removal. Proceedings of the 2021 IEEE\/CVF International Conference on Computer Vision (ICCV), Montreal, BC, Canada.","DOI":"10.1109\/ICCV48922.2021.00495"},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"397","DOI":"10.1111\/cgf.13577","article-title":"Decomposing Images into Layers with Advanced Color Blending","volume":"37","author":"Koyama","year":"2018","journal-title":"Comput. Graph. Forum"},{"key":"ref_20","doi-asserted-by":"crossref","unstructured":"Akimoto, N., Zhu, H., Jin, Y., and Aoki, Y. (2020, January 14\u201319). Fast Soft Color Segmentation. Proceedings of the 2020 IEEE\/CVF Conference on Computer Vision and Pattern Recognition (CVPR), Seattle, WA, USA.","DOI":"10.1109\/CVPR42600.2020.00830"},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"262","DOI":"10.1145\/3272127.3275054","article-title":"Efficient Palette-Based Decomposition and Recoloring of Images via RGBXY-Space Geometry","volume":"37","author":"Tan","year":"2018","journal-title":"ACM Trans. Graph."},{"key":"ref_22","doi-asserted-by":"crossref","unstructured":"Navab, N., Hornegger, J., Wells, W.M., and Frangi, A.F. (2015, January 5\u20139). U-Net: Convolutional Networks for Biomedical Image Segmentation. Proceedings of the Medical Image Computing and Computer-Assisted Intervention\u2014MICCAI 2015, Munich, Germany.","DOI":"10.1007\/978-3-319-24553-9"},{"key":"ref_23","unstructured":"Wang, Z., Simoncelli, E., and Bovik, A. (2003, January 9\u201312). Multiscale structural similarity for image quality assessment. Proceedings of the Thrity-Seventh Asilomar Conference on Signals, Systems & Computers, Pacific Grove, CA, USA."},{"key":"ref_24","unstructured":"Simonyan, K., and Zisserman, A. (2014). Very Deep Convolutional Networks for Large-Scale Image Recognition. arXiv."},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"47","DOI":"10.1109\/TCI.2016.2644865","article-title":"Loss Functions for Image Restoration with Neural Networks","volume":"3","author":"Zhao","year":"2017","journal-title":"IEEE Trans. Comput. Imaging"},{"key":"ref_26","unstructured":"Kingma, D.P., and Ba, J. (2014). Adam: A Method for Stochastic Optimization. arXiv."},{"key":"ref_27","unstructured":"Richard Shin, D.S. (2017, January 4\u20139). JPEG-resistant Adversarial Images. Proceedings of the Machine Learning and Computer Security Workshop at NeurIPS 2017, Long Beach, CA, USA."},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"679","DOI":"10.1109\/TPAMI.1986.4767851","article-title":"A Computational Approach to Edge Detection","volume":"PAMI-8","author":"Canny","year":"1986","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_29","doi-asserted-by":"crossref","first-page":"1397","DOI":"10.1109\/TPAMI.2012.213","article-title":"Guided Image Filtering","volume":"35","author":"He","year":"2013","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_30","doi-asserted-by":"crossref","first-page":"4695","DOI":"10.1109\/TIP.2012.2214050","article-title":"No-Reference Image Quality Assessment in the Spatial Domain","volume":"21","author":"Mittal","year":"2012","journal-title":"IEEE Trans. Image Process."},{"key":"ref_31","doi-asserted-by":"crossref","unstructured":"Zhang, R., Isola, P., Efros, A.A., Shechtman, E., and Wang, O. (2018, January 18\u201322). The Unreasonable Effectiveness of Deep Features as a Perceptual Metric. Proceedings of the 2018 IEEE\/CVF Conference on Computer Vision and Pattern Recognition (CVPR), Salt Lake City, UT, USA.","DOI":"10.1109\/CVPR.2018.00068"},{"key":"ref_32","doi-asserted-by":"crossref","unstructured":"Zhang, W., Zhai, G., Wei, Y., Yang, X., and Ma, K. (2023, January 18\u201322). Blind Image Quality Assessment via Vision-Language Correspondence: A Multitask Learning Perspective. Proceedings of the 2023 IEEE\/CVF Conference on Computer Vision and Pattern Recognition (CVPR), Vancouver, BC, Canada.","DOI":"10.1109\/CVPR52729.2023.01352"}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/23\/21\/8861\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2023,10,31]],"date-time":"2023-10-31T17:14:45Z","timestamp":1698772485000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/23\/21\/8861"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,10,31]]},"references-count":32,"journal-issue":{"issue":"21","published-online":{"date-parts":[[2023,11]]}},"alternative-id":["s23218861"],"URL":"https:\/\/doi.org\/10.3390\/s23218861","relation":{},"ISSN":["1424-8220"],"issn-type":[{"value":"1424-8220","type":"electronic"}],"subject":[],"published":{"date-parts":[[2023,10,31]]}}}