Natural Image Classification based on Multi-Parameter Optimization in Deep Convolutional Neural Network

doi:10.23940/ijpe.19.09.p25.25152521

Int J Performability Eng ›› 2019, Vol. 15 ›› Issue (9): 2515-2521.doi: 10.23940/ijpe.19.09.p25.25152521

Previous Articles Next Articles

Natural Image Classification based on Multi-Parameter Optimization in Deep Convolutional Neural Network

Lei Wang^a,b,c,*, Yanning Zhang^a,b, Runping Xi^a,b, and Lu Ling^c

^aSchool of Computer Northwestern Polytechnical University, Xi'an, 710072, China;
^bNational Engineering Laboratory for Integrated Aero-Space-Ground-Ocean Big Data Application Technology, Xi'an, 710072, China;
^cJiangxi Engineering Technology Research Center of Nuclear Geoscience Data Science and System, East China University of Technology, Nanchang, 330013, China

Submitted on ; Revised on ; Accepted on
Contact: *. Lei Wang is currently a PhD student at Northwestern Polytechnic University. She received her MSc degree in earth exploration and information processing from East China University of Technology. She is an associate professor in the School of Information Engineering at East China University of Technology. Her current research interests include computer vision, 3D data analysis, and deep learning. E-mail address: wlei598@163.com

Abstract

Abstract: Traditional machine learning algorithms cannot adequately train the parameters of networks using massive data. A deep convolutional neural network based on multi-parameter optimization by the TensorFlow deep learning framework is designed in this paper. In order to improve the training speed and prevent over-fitting, we improve and optimize the multi-parameters, including the batch value, dropout, and momentum in the network structure. The experiment involves training and testing on the standard natural image data sets in cifar-10 and cifar-100. The experimental results show that the method achieve better classification accuracy in less time compared with other algorithms, such as Conv-KN, ImageNet-2010, SVM, LR, and Boosting.

Key words: deep convolutional neural network, multi-parameter optimization, batch normalization, dropout, momentum

Lei Wang, Yanning Zhang, Runping Xi, and Lu Ling. Natural Image Classification based on Multi-Parameter Optimization in Deep Convolutional Neural Network [J]. Int J Performability Eng, 2019, 15(9): 2515-2521.

Add to citation manager EndNote|Reference Manager|ProCite|BibTeX|RefWorks

References

1. J. Sun and J. Ponce, “Learning Discriminative Part Detectors for Image Classification and Co-Segmentation,” inProceedings of the IEEE International Conference on Computer Vision (ICCV), pp. 3400-3407, Sydney, Australia, December 2013
2. A. Krizhevsky, I. Sutskever,G. E. Hinton, “Imagenet: Classification with Deep Convolutional Neural Networks,” in Proceedings of the 25^th International Conference on Neural Information Processing Systems, Vol. 1, pp. 1097-1105, December 2012
3. J. Redmon, S. Divvala, R. Girshick,A. Farhadi, “You Only Look Once: Unified, Real-Time Object Detection,” inProceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp. 779-788, Las Vegas, Nevada, USA, June 2016
4. C. Szegedy, W. Liu, Y. Jia, P. Sermanet, S. Reed, D. Anguelov, et al., “Going Deeper with Convolutions,” inProceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp. 1-9, Bodston, USA, June 2015
5. J. Wang, J. Yang, K. Yu, F. Lv, T. Huang,Y. Gong, “Locality-Constrained Linear Coding for Image Classification,” inProceedings of the IEEE International Conference on Computer Vision and Pattern Recognition (CVPR), pp. 3360-3367, San Francisco, USA, June 2010
6. O. Boiman, E. Shechtman,M. Irani, “In Defense of Nearest-Neighbor based Image Classification,” inProceedings of the IEEE International Conference on Computer Vision and Pattern Recognition (CVPR), pp. 1-8, Anchorage, USA, June 2008
7. H. Zhang, A. C. Berg, M. Maire,J. Malik, “SVM-KNN: Discriminative Nearest Neighbor Classification for Visual Category Recognition,” inProceedings of the IEEE International Conference on Computer Vision and Pattern Recognition (CVPR), pp. 109-188, New York, USA, June 2006
8. D. Ciresan, U. Meier, J. Masci,J. Schmidhuber, “A Committee of Neural Networks for Traffic Sign Classification,” inProceedings of the International Joint Conference on Neural Networks, pp. 1918-1921, San Jose, USA, August 2011
9. H. Bay, T. Tuytelaars,L. V. Gool, “Surf: Speeded up Robust Features,” inProceedings of the European Conference on Computer Vision (ECCV), pp. 404-417, Graz, Austria, May 2006
10. The CIFAR-10 Dataset, (https://www.cs.toronto.edu/~kriz/cifar.html, accessed 2009)
11. T. F. Yang, “Research on Image Retrieval and Classification based on Spatial Relationships,” ShanDong University, ShanDong, 2013
12. S. H. Jia, X. Y. Li, L. L. Ma,X. Q. Jiang, “Image Classification and Retrieval based on Correlation,” Microcomputer Information, Vol. 25, No. 3, pp. 294-296, May 2009
13. J. Deng, W. Dong,R. Socher, “A Large-Scale Hierarchical Image Database,” inProceedings of the IEEE International Conference on Computer Vision and Pattern Recognition (CVPR), pp. 109-188, Miami, USA, June 2009
14. J. T.Springenberg and M. Riedmiller, “Improving Deep Neural Networks with Probabilistic Maxout Units,” arXiv: 1312.6116v2, December 2013
15. D. Erhan, C. Szegedy,T. Alexander, “Scalable Object Detection using Deep Neural Networks,” inProceedings of the IEEE International Conference on Computer Vision and Pattern Recognition (CVPR), pp. 3360-3367, Columbus, USA, June 2014
16. R. Girshick, J. Donahue, T. Darrell,J. Malik, “Rich Feature Hierarchies for Accurate Object Detection and Semantic Segmentation,” in Proceedings of the IEEE International Conference on Computer Vision and Pattern Recognition (CVPR), Columbus, USA, June 2014
17. C. Szegedy, W. Liu,Y. Jia, “Going Deeper with Convolutions,” inProceedings of the IEEE International Conference on Computer Vision and Pattern Recognition (CVPR), pp. 1409-4842, Columbus, USA, June 2014
18. O. Shamir and T. Zhang, “Stochastic Gradient Descent for Non-Smooth Optimization: Convergence Results and Optimal Averaging Schemes,”ICML, pp. 530-597, Atlanta, USA, June 2013
19. D. Ciresan, J. Schmidhuber,U. Meier, “Multi-Column Deep Neural Networks for Image Classification,”CVPR, pp. 656-732, USA, June 2012
20. M. Lin, Q. Chen,S. Yan, “Network in Network,”ICLR, pp. 207-312, Banff, Canada, April 2014
21. K. P.Bennctt and E. J. Brodenstcincr, “Duality and Geometry in SVM Classifiers,” inProceedings of the 17th International Conference on Machine Learning (ICML), pp. 57-64, Stanford, USA, June 2000
22. M. D. Zeiler and R. Fergus, “Stochastic Pooling for Regularization of Deep Convolutional Neural Networks,” arXiv:1301.3557, 2013
23. M. C.Greg and M. Rajat. “Advances in Neural Information Processing Systems,” Neurocomputing, Vol. 71, No. 16-18, pp. 1232-1240, October 2012

[1]	Neha Kohli and Tapas Kumar. Envisaging Alzheimer’s Disease Stage through Fuzzy Rank-Based Ensemble of Transfer Learning Models [J]. Int J Performability Eng, 2023, 19(6): 397-406.
[2]	Roop Preet Kaur, Anshu Sharma, Inderpal Singh, and Rahul Malhotra. Deep Learning-Based Pneumonia Recognition from Chest X-Ray Images [J]. Int J Performability Eng, 2022, 18(5): 380-386.
[3]	Lingling Wang, Wenyin Gong, and Xiang Li. Deep Convolutional Neural Network and Its Application in Image Recognition of Road Safety Projects [J]. Int J Performability Eng, 2019, 15(8): 2182-2189.

Natural Image Classification based on Multi-Parameter Optimization in Deep Convolutional Neural Network

PDF

Knowledge

Abstract

Cite this article

share this article

References

Related Articles 3

Recommended 0