Multi-scale enhancement and aggregation network for single-image deraining
), Graphical Abstract
Abstract
Rain streaks in an image appear in different sizes and orientations, resulting in severe blurring and visual quality degradation. Previous CNN-based algorithms have achieved encouraging deraining results although there are certain limitations in the description of rain streaks and the restoration of scene structures in different environments. In this paper, we propose an efficient multi-scale enhancement and aggregation network (MEAN) to solve the single-image deraining problem. Considering the importance of large receptive fields and multi-scale features, we introduce a multi-scale enhanced unit (MEU) to capture long-range dependencies and exploit features at different scales to depict rain. Simultaneously, an attentive aggregation unit (AAU) is designed to utilize the informative features in spatial and channel dimensions, thereby aggregating effective information to eliminate redundant features for rich scenario details. To improve the deraining performance of the encoder--decoder network, we utilized an AAU to filter the information in the encoder network and concatenated the useful features to the decoder network, which is conducive to predicting high-quality clean images. Experimental results on synthetic datasets and real-world samples show that the proposed method achieves a significant deraining performance compared to state-of-the-art approaches.
References
Kang, L. W.; Lin, C. W.; Fu, Y. H. Automatic single-image-based rain streaks removal via image decomposition. IEEE Transactions on Image Processing Vol. 21, No. 4, 1742–1755, 2012.
Ren, D.; Shang, W.; Zhu, P.; Hu, Q.; Meng, D.; Zuo, W. Single image deraining using bilateral recurrent network. IEEE Transactions on Image Processing Vol. 29, 6852–6863, 2020.
Hu, X.; Zhu, L.; Wang, T.; Fu, C. W.; Heng, P. A. Single-image real-time rain removal based on depth-guided non-local features. IEEE Transactions on Image Processing Vol. 30, 1759–1770, 2021.
Guo, Q.; Sun, J.; Juefei-Xu, F.; Ma, L.; Xie, X.; Feng, W.; Liu, Y.; Zhao, J. EfficientDeRain: Learning pixel-wise dilation filtering for high-efficiency single-image deraining. Proceedings of the AAAI Conference on Artificial Intelligence Vol. 35, No. 2, 1487–1495, 2021.
Hu, J.; Shen, L.; Albanie, S.; Sun, G.; Wu, E. Squeeze-and-excitation networks. IEEE Transactions on Pattern Analysis and Machine Intelligence Vol. 42, No. 8, 2011–2023, 2020.
Fu, X.; Qi, Q.; Zha, Z. J.; Zhu, Y.; Ding, X. Rain streak removal via dual graph convolutional network. Proceedings of the AAAI Conference on Artificial Intelligence Vol. 35, No. 2, 1352–1360, 2021.
Deng, L.; Huang, T.; Zhao, X.; Jiang, T. A directional global sparse model for single image rain removal. Applied Mathematical Modelling Vol. 59, 662–679, 2018.
Wang, Z.; Bovik, A. C.; Sheikh, H. R.; Simoncelli, E. P. Image quality assessment: From error visibility to structural similarity. IEEE Transactions on Image Processing Vol. 13, No. 4, 600–612, 2004.
京公网安备11010802044758号