APPLICATION OF A CONVOLUTIONAL NEURAL NETWORKS FOR IMAGES RECOGNITION

Authors

Avazjon Rakhimovich Marakhimov, Doctor of Technical Sciences, Professor National University of Uzbekistan named after Mirzo Ulugbek, Tashkent sity, Republic of UzbekistanFollow
Lyudmila Petrovna Varlamova, Ph.D., Associate Professor, Tashkent University of Information Technologies named after Muhammad al Kwarazmi, Tashkent sity, Republic of Uzbekistan, phone (93)5535563.Follow

Abstract

In the problems of image recognition, various approaches used when the image is noisy and there is a small sample of observations. The paper discusses nonparametric recognition methods and methods based on deep neural networks. This neural network allows you to collapse images, to perform downsampling as many times as necessary. Moreover, the image recognition speed is quite high, and the data dimension is reduced by using convolutional layers. One of the most important elements of the application of convolutional neural networks is training. The article gives the results of work on the application of convolutional neural networks. The work was carried out in several stages. In the first stage was carried out the modeling of the convolutional neural network and was developed its architecture. In the second stage, the neural network was trained. The third phase produced Python software. The software health check and video processing speed were then performed.

First Page

69

Last Page

81

References

1. R.Duda, P.Hart, “Pattern recognition and scene analysis”, Moskow: MIR” Publishing House 1976, 509 p.
2. V.V.Mokeev, S.V.Tomilov, “On the solution of the problem of small sample size when using linear discriminant analysis in face recognition problems” Business Informatics, no. 1(23), pp. 37-43, 2013.
3. A.V.Lapko, S.V.Chencov, V.A.Lapko, “Non-parametric patterns of pattern recognition in small samples”, Autometry, no. 6, pp. 105-113, 1999.
4. Authorized translation from the English language edition, entitled DIGITAL IMAGE PROCESSING: International Version 3rd Edition; ISBN 0132345633, by GONZALEZ, RAFAEL C; WOODS, RICHARD E., published by Pearson Education, Inc,publishing as Prentice Hall. Copyright ©2008 by Pearson Education, Inc.
5. V.V.Voronin, V.I.Marchuk, “Methods and algorithms of image recovery in conditions of incomplete a priori information: monograph”, Shakhts: VPO "JURGUES, 2010, 89 p.
6. X.Tan, S.Chen, Z.H.Zhou, F.Zhang, “Face recognition from a single image per person: a survey”, Pattern Recognition, vol. 39, Issue 9, pp. 1725-1745. – DOI: 10.1016/j.patcog. 2006.03.013.
7. L Bertinetto, J.F.Henriques, J.Valmadre, P.Torr, A.Vedaldi, “Learning feed-forward one-shot learners” Advances in Neural Information Processing Systems 29: Annual Conference on Neural Information Processing Systems, 2016, pp. 523-531.
8. O.M.Parkhi, A.Vedaldi, A.Zisserman, “Deep face recognition” Proceedings of the British Machine Vision, pp. 6-17, 2015.
9. O.Russakovsky, J.Deng, H.Su, J.Krause, S.Satheesh, MaS, Z.Huang, A.Karpathy, A.Khosla, M.Bernstein, A.C.Berg, FF.Li, “Imagenet large scale visual recognition challenge”, International Journal of Computer Vision, no. 115(3), pp. 211-252, 2015. DOI: 10.1007/s11263-015-0816-y.
10. V Lempitsky, “Convolutional neural network” Available at: https://postnauka.ru/ video/66872.
11. K.Fukushima, “Neocognitron: a self-organizing neural network model for a mechanism of pattern recognition unaffected by shift in position” Biol Cybern, vol. 36, pp. 193-202, 1980. doi: 10.1007/BF00344251. [CrossRef] [Google Scholar].
12. D.H.Hubel, T.N.Wiesel, “Receptive fields and functional architecture of monkey striate cortex”. J Physiol, no. 195, pp. 215-243, 1968. doi: 10.1113/jphysiol.1968.sp008455. [CrossRef] [Google Scholar].
13. Russell Stewart, Norvig Peter, “Artificial Intelligence: A Modern Approach”, Mascow: Williams Publishing House, 2006, 1408 p.
14. N.Qian, “On the momentum term in gradient descent learning algorithms”, Neural Netw, no. 12, pp. 145-151, 1999. doi: 10.1016/S0893-6080(98)00116-6. [PubMed] [CrossRef] [Google Scholar].
15. D.P.Kingma, J.Ba, “Adam: a method for stochastic optimization”, arxiv, Available online at, https://arxiv.org/pdf/1412.6980.pdf. Accessed 23 Jan 2018.
16. S.Ruder, “An overview of gradient descent optimization algorithms”, arXiv. Available online at, https://arxiv.org/pdf/1609.04747.pdf. Accessed 23 Jan 2018.
17. Yoshua Bengio, Y.Le.Cun, and D.Henderson, “Globally trained handwritten word recognizer using spatial representation, space displacement neural networks and hidden Markov models”, In Advances in Neural Information Processing Systems 6, San Mateo CA, 1994.
18. Rikiya Yamashita, Mizuho Nishio, Richard Kinh, Gian Do, Kaori Togashi, “Convolutional neural networks: an overview and application in radiology”, Insights Imaging, no. 9(4), pp. 611-629, 2018. Published online 2018 Jun 22. doi: 10.1007/s13244-018-0639-9. Available online at: https://www.ncbi.nlm.nih.gov/pmc/articles/PMC6108980/.
19. K.Clark, B.Vendt, K.Smith, et al., “The Cancer Imaging Archive (TCIA): maintaining and operating a public information repository” J Digit Imaging, no. 26, pp. 1045-1057, 2013. doi: 10.1007/s10278-013-9622-7. [PMC free article] [PubMed] [CrossRef] [Google Scholar].
20. X.Wang, Y.Peng, L.Lu, Z.Lu, M.Bagheri, RM.Summers (2017) “ChestX-ray8: hospital-scale chest X-ray database and benchmarks on weakly-supervised classification and localization of common thorax diseases”, In: Proceedings of the 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2017, pp 3462–3471.
21. Y.LeCun, Y.Bengio, G.Hinton, “Deep learning Nature”, no. 521, pp. 436-444, 2015. doi: 10.1038/nature14539. [PubMed] [CrossRef] [Google Scholar].
22. Avazjon Marakhimov, and Kabul Khudaybergenov, “Convergence analysis of feedforward neural networks with backpropagation”, Bulletin of National University of Uzbekistan: Mathematics and Natural Sciences: Vol. 2 : Iss. 2, Article 1. Available at, https://uzjournals.edu.uz/mns_nuu/vol2/iss2/1.
23. C.Tomasi, R.Manduchi, “Bilateral filtering for gray and color images”, Proc. IEEE Int. Conf. Computer Vision, 1998, pp. 839-846.
24. K.Overton, T.Weymouth, “A noise reducing preprocessing algorithm” Proc. IEEE Computer Science Conf. Pattern Recognition and Image Processing, Chicago, IL, pp. 498-507,1979.
25. C.Chui and Chen Guanrong, “Kalman Filtering with Real-Time Applications. Fifth edition (e-Book). Springer Series in Information Sciences”. 2017, 245 p.
26. A.R.Marakhimov, L.P.Varlamova, “Block Form of Kalman Filter in Processing Images with Low Resolution”, Chemical Technology. Control and Management, no. 3, pp. 57-72, 2019.
27. Avazjon Marakhimov and Kabul Khudaybergenov, “Neuro-fuzzy identification of nonlinear dependencies”, Bulletin of National University of Uzbekistan: Mathematics and Natural Sciences, vol. 1, Iss. 3, Article 1, 2018. Available at: https://uzjournals.edu. uz/mns_nuu/vol1/iss3/1.
28. L.P.Varlamova, K.N.Salakhova, R.S.Tillakhodzhaeva, “Neural network approach in the task of data processing”, Young scientist, no. 202, part 1, pp. 99-101, 2018.
29. A.R.Marakhimov, K.K.Khudaybergenov, “A fuzzy MLP approach for identification of nonlinear systems”, Contemporary problems in mathematics and physics, CMFD, 65, no. 1, pp 44–53,2019.
30. Jason Brownlee, AGentle, “Introduction to Transfer Learning for Deep Learning”, Available at: [https://machinelearningmastery.com/transfer-learning-for-deep-learning/].
31. D.H.Lee, “Pseudo-label: the simple and efficient semi-supervised learning method for deep neural networks”, In: Proceedings of the ICML 2013 Workshop: Challenges in Representation Learning, Available online at: http://deeplearning.net/wp-content/uploads/ 2013/ 03/pseudo_label_final.pdf. Accessed 23 Jan 2018.
32. https://pythonhosted.org/nolearn/lasagne.html.
33. K.He, X.Zhang, S.Ren, J.Sun, Deep residual learning for image recognition” In: Proceedings of the 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR). 10.1109/CVPR.2016.90.
34. C.Szegedy, W.Liu, Y.Jia, et al., “Going deeper with convolutions”, In: Proceedings of the 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR). 10.1109/CVPR.2015.7298594.
35. G.Huang, Z.Liu, van der L.Maaten, K.Q.Weinberger, “Densely connected convolutional networks”, In: Proceedings of the 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR). 10.1109/CVPR.2017.243.
36. M.D.Zeiler, R.Fergus, “Visualizing and understanding convolutional networks”, In: Proceedings of Computer Vision – ECCV, 2014, vol 8689. pp 818–833.
37. J.Yosinski, J.Clune, Y.Bengio, H.Lipson, “How transferable are features in deep neural networks?” arXiv. Available online at: https://arxiv.org/pdf/1411.1792.pdf. Accessed 25 Jan 2018.

Recommended Citation

Marakhimov, Avazjon Rakhimovich and Varlamova, Lyudmila Petrovna (2020) "APPLICATION OF A CONVOLUTIONAL NEURAL NETWORKS FOR IMAGES RECOGNITION," Chemical Technology, Control and Management: Vol. 2020: Iss. 2, Article 11.
DOI: https://doi.org/10.34920/2020.2.69-81