Please use this identifier to cite or link to this item: http://repository.futminna.edu.ng:8080/jspui/handle/123456789/17072
Title: On the Relative Impact of Optimizers on Convolutional Neural Networks with Varying Depth and Width for Image Classification
Authors: Dogo, E. M.
Afolabi, O. J.
Twala, B.
Keywords: optimization algorithms
neural network
network size
performance analysis
image classification
Issue Date: 23-Nov-2022
Publisher: MDPI Applied Sciences
Series/Report no.: 12;11976
Abstract: The continued increase in computing resources is one key factor that is allowing deep learning researchers to scale, design and train new and complex convolutional neural network (CNN) architectures in terms of varying width, depth, or both width and depth to improve performance for a variety of problems. The contributions of this study include an uncovering of how different optimization algorithms impact CNN architectural setups with variations in width, depth, and both width/depth. Specifically in this study, three different CNN architectural setups in combination with nine different optimization algorithms—namely SGD vanilla, with momentum, and with Nesterov momentum, RMSProp, ADAM, ADAGrad, ADADelta, ADAMax, and NADAM—are trained and evaluated using three publicly available benchmark image classification datasets. Through extensive experimentation, we analyze the output predictions of the different optimizers with the CNN architectures using accuracy, convergence speed, and loss function as performance metrics. Findings based on the overall results obtained across the three image classification datasets show that ADAM and NADAM achieved superior performances with wider and deeper/wider setups, respectively, while ADADelta was the worst performer, especially with the deeper CNN architectural setup.
Description: Section: Computing and Artificial Intelligence; Special Issue: Deep Learning Architectures for Computer Vision
URI: http://repository.futminna.edu.ng:8080/jspui/handle/123456789/17072
Appears in Collections:Computer Engineering



Items in DSpace are protected by copyright, with all rights reserved, unless otherwise indicated.