基于低秩矩阵补全的单幅图像去雨算法

doi:10.12052/gdutxb.200023

Abstract

Abstract: A single image de-raining algorithm based on low rank matrix completion is proposed. The algorithm adopts the three-stage strategy of detection, repair and optimization. In the rain detection stage, the rain intensity information is used as a prior to build a detection model. In the repair stage, a similar patch matching algorithm is first used to construct a similar patch matrix, and then the problem of de-raining is transformed into the task of low-rank matrix completion based on its low-rank attribute. In the optimization stage, a correction strategy is adopted to further improve the de-raining effect and objective measurements. The algorithm is verified on synthetic rain images and real rain images. Experimental results show that the algorithm shows a good rain removal effect, and the processing of heavy rain images is also satisfactory. Compared with other methods, it has certain advantages in both objective metrics and subjective visual quality.

Key words: single image de-raining, rain marker bitmap, low-rank matrix, similar patch matching

CLC Number:

TP391

Zhu Jian, Liu Pei-yu, Chen Bing-feng, Cai Rui-chu. Single Image De-raining Based on Low-rank Matrix Completion[J].Journal of Guangdong University of Technology, 2020, 37(04): 1-8.

References

[1] KIM J H, SIM J Y, KIM C S. Video deraining and desnowing using temporal correlation and low-rank matrix completion [J]. IEEE Transactions on Image Processing, 2015, 24(9): 2658-2670
[2] JIANG T X, HUANG T Z, ZHAO X L, et al. A novel tensor-based video rain streaks removal approach via utilizing discriminatively intrinsic priors[C]//Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. Hawaii: IEEE, 2017: 4057-4066.
[3] LI M, XIE Q, ZHAO Q, et al. Video rain streak removal by multiscale convolutional sparse coding[C]//Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. Salt Lake City: IEEE, 2018: 6644-6653.
[4] CHEN J, TAN C H, HOU J, et al. Robust video content alignment and compensation for rain removal in a cnn framework[C]//Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. Salt Lake City: IEEE, 2018: 6286-6295.
[5] XU J, ZHAO W, LIU P, et al. Removing rain and snow in a single image using guided filter[C]// Proceedings of the IEEE International Conference on Computer Science and Automation Engineering (CSAE). Zhangjiajie: IEEE, 2012, 2: 304-307.
[6] ZHENG X, LIAO Y, GUO W, et al. Single-image-based rain and snow removal using multi-guided filter[C]//Proceedings of the International Conference on Neural Information Processing. Berlin: Springer, 2013: 258-265.
[7] KANG L W, LIN C W, FU Y H. Automatic single-image-based rain streaks removal via image decomposition [J]. IEEE Transactions on Image Processing, 2011, 21(4): 1742-1755
[8] LI Y, TAN R T, GUO X, et al. Rain streak removal using layer priors[C]//Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. Las Vegas: IEEE, 2016: 2736-2744.
[9] LUO Y, XU Y, JI H. Removing rain from a single image via discriminative sparse coding[C]//Proceedings of the IEEE International Conference on Computer Vision. Santiago: IEEE, 2015: 3397-3405.
[10] ZHU L, FU C W, LISCHINSKI D, et al. Joint bi-layer optimization for single-image rain streak removal[C]//Proceedings of the IEEE International Conference on Computer Vision. Venice: IEEE, 2017: 2526-2534.
[11] LIU R, JIANG Z, FAN X, et al. Knowledge-driven deep unrolling for robust image layer separation [J]. IEEE Transactions on Neural Networks and Learning Systems, 2020, 31(5): 1653-1666
[12] FU X, HUANG J, DING X, et al. Clearing the skies: A deep network architecture for single-image rain removal [J]. IEEE Transactions on Image Processing, 2017, 26(6): 2944-2956
[13] FU X, HUANG J, ZENG D, et al. Removing rain from single images via a deep detail network[C]//Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. Hawaii: IEEE, 2017: 3855-3863.
[14] XIANG P, WANG L, WU F, et al. Single-image de-raining with feature-supervised generative adversarial network [J]. IEEE Signal Processing Letters, 2019, 26(5): 650-654
[15] YANG W, TAN R T, FENG J, et al. Joint rain detection and removal from a single image with contextualized deep networks [J]. IEEE Transactions on Pattern Analysis and Machine Intelligence, 2019
[16] ZHANG H, PATEL V M. Density-aware single image de-raining using a multi-stream dense network[C]//Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. Salt Lake City: IEEE, 2018: 695-704.
[17] 傅雪阳, 孙琦, 黄悦, 等. 基于深度邻近连接网络的单幅图像去雨方法[J]. 计算机科学, 2020, 47(2): 106-111
FU X Y, SUN Q, HUANG Y, et al. Method for single image de-raining based on deep adjacently connected networks [J]. Computer Science, 2020, 47(2): 106-111
[18] 史加荣, 郑秀云, 魏宗田等. 低秩矩阵恢复算法综述[J]. 计算机应用研究, 2013, 30(6): 1601-1605
SHI J R, ZHENG X Y, WEI Z T, et al. Survey on algorithms of low-rank matrix recovery [J]. Application Research of Computers, 2013, 30(6): 1601-1605
[19] LU C, LIN Z, YAN S. Smoothed low rank and sparse matrix recovery by iteratively reweighted least squares minimization [J]. IEEE Transactions on Image Processing, 2014, 24(2): 646-654
[20] MA S, GOLDFARB D, CHEN L. Fixed point and Bregman iterative methods for matrix rank minimization [J]. Mathematical Programming, 2011, 128(1-2): 321-353
[21] LU C, TANG J, YAN S, et al. Generalized nonconvex nonsmooth low-rank minimization[C]//Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. Columbus: IEEE, 2014: 4130-4137.
[22] DONG W, SHI G, LI X. Nonlocal image restoration with bilateral variance estimation: a low-rank approach [J]. IEEE Transactions on Image Processing, 2012, 22(2): 700-711
[23] JI H, LIU C, SHEN Z, et al. Robust video denoising using low rank matrix completion[C]//Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition. San Francisco: IEEE, 2010: 1791-1798.
[24] WEN F, CHU L, LIU P, et al. A survey on nonconvex regularization-based sparse and low-rank recovery in signal processing, statistics, and machine learning [J]. IEEE Access, 2018, 6: 69883-69906
[25] WANG Y, HUANG T Z. A tensor-based low-rank model for single-image rain streaks Removal [J]. IEEE Access, 2019, 7: 83437-83448
[26] ABDEL-HAKIM A E. A novel approach for rain removal from videos using low-rank recovery[C]//20145th International Conference on Intelligent Systems, Modelling and Simulation. Langkawi: IEEE, 2014: 351-356.
[27] ZHANG H, PATEL V M. Convolutional sparse and low-rank coding-based rain streak removal[C]//2017 IEEE Winter Conference on Applications of Computer Vision (WACV). Santa Rosa: IEEE, 2017: 1259-1267.
[28] CANDES E J, PLAN Y. Matrix completion with noise [J]. Proceedings of the IEEE, 2010, 98(6): 925-936
[29] HORE A, ZIOU D. Image quality metrics: PSNR vs. SSIM[C]//201020th International Conference on Pattern Recognition. Istanbul: IEEE, 2010: 2366-2369.
[30] 李红蕾, 凌捷, 徐少强. 关于图象质量评价指标PSNR的注记[J]. 广东工业大学学报, 2004, 21(3): 74-78
LI H L, LING J, XU S Q. The exegesis of the quality assessment PSNR of images [J]. Journal of Guangdong University of Technology, 2004, 21(3): 74-78
[31] YANG W, TAN R T, FENG J, et al. Deep joint rain detection and removal from a single image[C]//Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. Hawaii: IEEE, 2017: 1357-1366.

Related Articles 15

[1]	Xie Guo-bo, Lin Li, Lin Zhi-yi, He Di-xuan, Wen Gang. An Insulator Burst Defect Detection Method Based on YOLOv4-MP [J]. Journal of Guangdong University of Technology, 2023, 40(02): 15-21.
[2]	Chen Jing-yu, Lyu Yi. Frost Detection Method of Cold Chain Refrigerating Machine Based on Spiking Neural Network [J]. Journal of Guangdong University of Technology, 2023, 40(01): 29-38.
[3]	Ye Wen-quan, Li Si, Ling Jie. Sparse-view SPECT Image Reconstruction Based on Multilevel-residual U-Net [J]. Journal of Guangdong University of Technology, 2023, 40(01): 61-67.
[4]	Zou Heng, Gao Jun-li, Zhang Shu-wen, Song Hai-tao. Design and Implementation of a Dropping Guidance Device for Go Robot [J]. Journal of Guangdong University of Technology, 2023, 40(01): 77-82,91.
[5]	Xie Guang-qiang, Xu Hao-ran, Li Yang, Chen Guang-fu. Consensus Opinion Enhancement in Social Network with Multi-agent Reinforcement Learning [J]. Journal of Guangdong University of Technology, 2022, 39(06): 36-43.
[6]	Liu Xin-hong, Su Cheng-yue, Chen Jing, Xu Sheng, Luo Wen-jun, Li Yi-hong, Liu Ba. Real Time Detection of High Resolution Bridge Crack Image [J]. Journal of Guangdong University of Technology, 2022, 39(06): 73-79.
[7]	Xiong Wu, Liu Yi. Application of Particle Filter Algorithm in Static Deformation Monitoring of BDS High-Speed Rail [J]. Journal of Guangdong University of Technology, 2022, 39(04): 66-72.
[8]	Yi Min-qi, Liu Hong-wei, Gao Hong-ming. Research on the Factors Influencing the Co-purchase Network of Products on E-commerce Platforms [J]. Journal of Guangdong University of Technology, 2022, 39(03): 16-24.
[9]	Qiu Zhan-chun, Fei Lun-ke, Teng Shao-hua, Zhang Wei. Palmprint Recognition Based on Cosine Similarity [J]. Journal of Guangdong University of Technology, 2022, 39(03): 55-62.
[10]	Zheng Jia-bi, Yang Zhen-guo, Liu Wen-yin. Marketing-Effect Estimation Based on Fine-grained Confounder Balancing [J]. Journal of Guangdong University of Technology, 2022, 39(02): 55-61.
[11]	Gary Yen, Li Bo, Xie Sheng-li. An Evolutionary Optimization of LSTM for Model Recovery of Geophysical Fluid Dynamics [J]. Journal of Guangdong University of Technology, 2021, 38(06): 1-8.
[12]	Li Guang-cheng, Zhao Qing-lin, Xie Kan. A Design of Decentralized Data Processing Scheme [J]. Journal of Guangdong University of Technology, 2021, 38(06): 77-83.
[13]	Xie Guang-qiang, Zhao Jun-wei, Li Yang, Xu Hao-ran. Cooperative Lane-changing Based on Multi-cluster System [J]. Journal of Guangdong University of Technology, 2021, 38(05): 1-9.
[14]	Zhang Wei, Zhang Zhen-bin. Joint Graph Embedding and Feature Weighting for Unsupervised Feature Selection [J]. Journal of Guangdong University of Technology, 2021, 38(05): 16-23.
[15]	Deng Jie-hang, Yuan Zhong-ming, Lin Hao-run, Gu Guo-sheng. Superpixel and Visual Saliency Synergetic Image Quality Assessment [J]. Journal of Guangdong University of Technology, 2021, 38(05): 33-39.

Metrics

Viewed

Full text

Abstract

Cited

Shared

Discussed

Comments

Recommended 0

No Suggested Reading articles found!

Single Image De-raining Based on Low-rank Matrix Completion

HTML

PDF (PC)

Abstract

Cite this article

share this article

References

Related Articles 15

Metrics

Comments

Recommended 0