Performance Comparison of Convolutional Neural Network-based model using Gradient Descent Optimization algorithms for the Classification of Low Quality Underwater Images
DOI:
https://doi.org/10.46243/jst.2020.v5.i5.pp227-236Keywords:
Underwater Image, eep Learning, Image Classification, Convolutional Neural Network (CNN), Fish Species Classification, SGD, Adagrad, RMSprop, Adadelta, Adam, NadamAbstract
Underwater imagery and analysis plays a major role in fisheries management and fisheries science helping developing efficient and automated tools for cumbersome tasks such as fish species identification, stock assessment and abundance estimation. Majority of the existing tools for analysis still leverage conventional statistical algorithms and handcrafted image processing techniques which demand human interventions and are inefficient and prone to human errors. Computer vision based automated algorithms need a better generalisation capability and should be made efficient to address the ambiguities present in the underwater scenarios, and can be achieved through learning based algorithms based on artificial neural networks. This paper research about utilising the Convolutional Neural Network (CNN) based models for under water image classification for fish species identification. This paper also analyses and evaluates the performance of the proposed CNN models with different optimizers such as the Stochastic Gradient Descent (SGD),Adagrad, RMSprop, Adadelta, Adam and Nadam on classifying ten classes of images from the Fish4Knowledge(F4K) database.
References
A P. X. Huang, B. J. Boom, R. B. Fisher, "Hierarchical Classification for Live Fish Recognition", BMVC student workshop paper, September 2012
B. J. Boom, P. X. Huang, C. Spampinato, S. Palazzo, J. He, C. Beyan, E. Beauxis-Aussalet, J. van Ossenbruggen, G. Nadarajan, J. Y. Chen-Burger, D. Giordano, L. Hardman, F.-P. Lin, R. B. Fisher, "Long-term underwater camera surveillance for monitoring and analysis of fish populations", Proc. Int. Workshop on Visual observation and Analysis of Animal and Insect Behavior (VAIB), in conjunction with ICPR 2012, Tsukuba, Japan, 2012
B. J. Boom, P. X. Huang, J. He, R. B. Fisher, "Supporting Ground-Truth annotation of image datasets using clustering", 21st Int. Conf. on Pattern Recognition (ICPR), 2012
Villon S., Chaumont M., Subsol G., Villéger S., Claverie T., Mouillot D. “Coral Reef Fish Detection and Recognition in Underwater Videos by Supervised Machine Learning: Comparison Between Deep Learning and HOG+SVM Methods” International Conference on Advanced Concepts for Intelligent Vision Systems, pp.160--171, 2016
A. Salman, A. Jalal, F. Shafait, A. Mian, M. Shortis, J. Seager and E. Harvey, “Fish species classification in unconstrained underwater environments based on deep learning,” Limnology and Oceanography: Methods, vol. 14, p. 570–585, 2016
S.A. Siddiqui, A. Salman, M.I. Malik, F. Shafait, A. Mian, M.R. Shortis, E.S. Harvey. “Automatic fish species classification in underwater videos: exploiting pre-trained deep neural network models to compensate for limited labelled data”.ICES Journal of Marine Science,Vol.75,No.1, pp.374-389.2018
Salman A, Siddiqui SA, Shafait F, Mian A, Shortis MR, Khurshid K, Ulges A, Schwanecke U, “Automatic fish detection in underwater videos by a deep neural network-based hybrid motion learning system”. ICES Journal of Marine Science,vol.77, No.4,pp.1295-1307,2020
Khalifa, N.E.M.; Taha, M.H.N.; Hassanien, A.E. “Aquarium Family Fish Species Identification System Using Deep Neural Networks”. In International Conference on Advanced Intelligent Systems and Informatics; Springer: Cham, Switzerland, pp. 347–356,2018
D. Rathi, S. Jain and S. Indu, "Underwater Fish Species Classification using Convolutional Neural Network and Deep Learning," 2017 Ninth International Conference on Advances in Pattern Recognition (ICAPR), Bangalore, 2017, pp. 1-6,2017
Jalal A, Salman A, Mian A, Shortis M, Shafait F (2020), “Fish detection and species classification in underwater environments using deep learning with temporal information”,. Ecological Informatics,Vol.57, pp.101088,2020
Kratzert, F., Mader, H. “Fish species classification in underwater video monitoring using Convolutional Neural Networks”, OpenKratzert, Frederik, and Helmut Mader. Fish Species Classification in Underwater Video Monitoring Using Convolutional Neural Networks. EarthArXiv, vol. 15, 2018
Suxia Cui and Yu Zhou. “Fish Detection In Deep Learning”. Hindawi Applied Computational Intelligence and Soft Computing, Vol.2020
Dmitry A. Konovalov et al. “Underwater Fish Detection with Weak Multi-Domain Supervision” International Joint Conference on Neural Networks (IJCNN),pp.1-8, 2019
Fukushima, Kunihiko and Miyake, Sei, “Neocognitron: A self-organizing neural network model for a mechanism of visual pattern recognition”, Competition and cooperation in neural nets, Springer, pp.267-285,1982
Yann LeCun, Léon Bottou, YoshuaBengio, and Patrick Haffner. “Gradient-based learning applied to document recognition”. Proceedings of the IEEE, 86(11):2278–2324, 1998
Ruder, Sebastian, “An overview of gradient descent optimization algorithms”, arXiv preprint arXiv:1609.04747, 2016
John Duchi, EladHazan, and Yoram Singer., “Adaptive Subgradient Methods for Online Learning and Stochastic Optimization”,. Journal of Machine Learning Research, Vol.12,No.7,pp.2121–2159, 2011
Matthew D. Zeiler. ADADELTA: An Adaptive Learning Rate Method. arXiv preprint arXiv:1212.5701, 2012
Hinton, Geoffrey and Srivastava, Nitish and Swersky, Kevin, “Neural networks for machine learning lecture 6a overview of mini-batch gradient descent”, cs.toronto.edu, 2012
Diederik P. Kingma and Jimmy Lei Ba. “Adam: a method for Stochastic Optimization”, International Conference on Learning Representations, pages 1–13, 2015
Timothy Dozat. “Incorporating Nesterov Momentum into Adam”. ICLR Workshop, pp.1-4, 2016
YuriiNesterov. “A method for unconstrained convex minimization problem with the rate of convergence o(1/k2)”. Doklady ANSSSR, vol 269, pp.543–547, 1983
Published
How to Cite
Issue
Section
