Username   Password       Forgot your password?  Forgot your username? 


Removing Streak Interference from a Single Image based on Joint Priors

Volume 14, Number 11, November 2018, pp. 2897-2904
DOI: 10.23940/ijpe.18.11.p35.28972904

Ao Lia, Xin Liua, Deyun Chena, Kezheng Lina, Guanglu Suna, and Qidi Wub

aSchool of Computer Science and Technology, Harbin University of Science and Technology, Harbin, 150080, China
bCollege of Information and Communication Engineering, Harbin Engineering University, Harbin, 150001, China

(Submitted on August 17, 2018; Revised on September 5, 2018; Accepted on October 23, 2018)


Streaks due to weather, such as rain or snow, degrade image quality and affect the performance of subsequential high-level vision tasks by the generated undesired artifacts. Hence, removing streak interference is an ongoing and challenging issue for many applications in real-time mobile surveillance systems. In this paper, streak interference removal from a single image is the focus. To sufficiently extract streak interference from an observed image, the image was firstly filtered with the nonsubsampled contourlet transform. Then, the residual part between the original and filtered image was decomposed into the streak component and detail component of background. Based on the additive layer model, we designed two specific priors that constrain the detail and streak interference respectively and established a model with joint priors for residual image decomposition. As a result, the resulting image can be synthesized with the filtered image and detail component. Experimental results show that our proposed method outperforms existing methods both qualitatively and quantitatively.


References: 21

                  1. O. Ludwig, D. Delgado, V. Goncalves, and U. Nunes, “Trainable Classifiers-Fusion Schemes: An Application to Pedestrian Detection,” in Proceedings of the 12th International IEEE Conference on Intelligent Transportation Systems, St. Louis, MO, pp. 1-6, 2009
                  2. M. S. Shehata, J. Cai, W. M. Badawy, T. W. Burr, M. S. Pervez, R. J. Johannesson, et al., “Radmanesh, Video-based Automatic Incident Detection for Smart Roads: The Outdoor Environmental Challenges Regarding False Alarms,” IEEE Transactions on Intelligent Transportation Systems, No. 9, pp. 349-360, 2008
                  3. L. Itti, C. Koch, and E. Niebur, “A Model of Saliency-based Visual Attention for Rapid Scene Analysis,” IEEE Transactions on Pattern Analysis and Machine Intelligence, No. 20, pp. 1254-1259, 1998
                  4. S. Liu, X. Cheng, W. Fu, Y. P. Zhou, and Q. Z. Li, “Numeric Characteristics of Generalized M Set with its Asymptote,” Applied Mathematics and Computation, Vol. 243, pp. 767-774, 2014
                  5. S. Liu, W. Fu, L. He, J. T. Zhou, and M. Ma, “Distribution of Primary Additional Errors in Fractal Encoding Method,” Multimedia Tools and Applications, No. 76, No. 4, pp. 5787-5802, 2017
                  6. U. Z. Pan, W. Fu, and X. Cheng, “Fractal Generation Method based on Asymptote Family of Generalized Mandelbrot Set and its Application,” Journal of Nonlinear Science and Applications, No. 10, pp. 1148-1161, 2017
                  7. K. Garg and S. K. Nayar, “Detection and Removal of Rain from Videos,” in Proceedings of the 2004 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, pp. 528-535, 2004
                  8. X. Zhang, H. Li, Y. Qi, W. K. Leow, and T. K. Ng, “Rain Removal in Video by Combining Temporal and Chromatic Properties,” in Proceedings of IEEE International Conference on Multimedia and Expo, Toronto, ON, Canada, pp. 461-464, July 2006
                  9. P. C. Barnum, S. Narasimhan, and T. Kanade, “Analysis of Rain and Snow in Frequency Space,” International Journal of Computer Vision, No. 86, pp. 256-274, January 2010
                  10. J. Bossu, N. Hautière, and J. P. Tarel, “Rain or Snow Detection in Image Sequences Through Use of a Histogram of Orientation of Streaks,” International Journal of Computer Vision, No. 93, pp. 348-367, 2011
                  11. L. W. Kang, C. W. Lin, and Y. H. Fu, “Automatic Single-Image-based Rain Streaks Removal via Image Decomposition,” IEEE Transactions on Image Processing, No. 21, pp. 1742-1755, 2012
                  12. D. A. Huang, L. W. Kang, M. C. Yang, C. W. Lin, and Y. C. F. Wang, “Context-Aware Single Image Rain Removal,” in Proceedings of IEEE Conference on Multimedia and Expo, pp. 164-169, 2012
                  13. Y. Luo, Y. Xu, and H. Ji, “Removing Rain from a Single Image via Discriminative Sparse Coding,” in Proceedings of IEEE International Conference on Computer Vision, pp. 3399-3405, 2015
                  14. Y. L. Chen and C. T. Hsu, “A Generalized Low-Rank Appearance Model for Spatio-Temporally Correlated Rain Streaks,” in Proceedings of IEEE International Conference on Computer Vision, pp. 1968-1975, 2013
                  15. Y. L. Robby, T. Tan, X. J. Guo, J. Lu, and M. S. Brown, “Rain Streak Removal Using Layer Priors,” in Proceedings of IEEE Conference on Computer Vision and Pattern Recognition, pp. 2736-2744, 2016
                  16. N. Eslahi and A. Aghagolzadeh, “Compressive Sensing Image Restoration Using Adaptive Curvelet Thresholding and Nonlocal Sparse Regularization,” IEEE Transactions on Image Processing, No. 25, pp. 3126-3140, 2016
                  17. K. P. Upla, M. V. Joshi, and P. P. Gajjar, “An Edge Preserving Multiresolution Fusion: Use of Contourlet Transform and MRF Prior,” IEEE Transactions on Geoscience and Remote Sensing, No. 53, pp. 3210-3220, 2015
                  18. A. L. Cunha, J. Zhou, and M. N. Do, “The Nonsubsampled Contourlet Transform: Theory, Design, and Applications,” IEEE Transactions on Image Processing, No. 15, pp. 3089-3101, 2006
                  19. M. Aharon, M. Elad, and A. M. Bruckstein, “The K-SVD: An Algorithm for Designing of Overcomplete Dictionaries for Sparse Representation,” IEEE Transactions on Signal Processing, No. 54, pp. 4311-4322, 2006
                  20. D. Zoran and Y. Weiss, “From Learning Models of Natural Image Patches to Whole Image Restoration,” in Proceedings of IEEE International Conference on Computer Vision, pp. 479-486, 2011
                  21. J. A. Tropp and A. C. Gilbert, “Signal Recovery from Random Measurements via Orthogonal Matching Pursuit,” IEEE Transactions on Information Theory, No. 53, pp. 4655-4666, 2007


                                  Please note : You will need Adobe Acrobat viewer to view the full articles.Get Free Adobe Reader

                                  This site uses encryption for transmitting your passwords.