Optimising Convolutional Neural Networks using a Hybrid Statistically-driven Coral Reef Optimisation algorithm
Víctor Manuel Vargas-Yun 
Pedro Antonio Gutiérrez 
César Hervás-Martínez Applied Soft Computing
COMPUTER SCIENCE, INTERDISCIPLINARY APPLICATIONS
Abstract
Convolutional Neural Networks stands at the front of many solutions which deal with computer vision related tasks. The use and the applications of these models are growing unceasingly, as well as the complexity required to deal with bigger and highly complex problems. However, hitting the most suitable model for solving a specific task is not trivial. A very manually intensive and time consuming trial-and-error experimentation is needed in order to find an architecture, hyperparameters and parameters which reach a certain level of performance. Moreover, this process leads to oversized models, diminishing their generalisation capacity. In this paper, we leverage a metaheuristic and a hybridisation process to optimise the reasoning block of CNN models, composed by fully connected and dropout layers, conducting a full reconstruction that leads to lighter models with better performance. Our approach is architecture-independent and operates at the topology, hyperparameters and parameters (connection weights) levels. For that purpose, we have implemented the Hybrid Statistically-driven Coral Reef Optimisation (HSCRO) algorithm as an extension of SCRO, a metaheuristic which does not require to adjust any parameter since they are automatically and dynamically chosen based on the statistical characteristics of the evolution. In addition, a hybridisation process employs the backpropagation algorithm to make a final fine-grained weights adjustment. In the experiments, the VGG-16 model is successfully optimised in two different scenarios (the CIFAR-10 and the CINIC-10 datasets), resulting in a lighter architecture, with an 88
Keywords
BibTex Citation
@article{Martin2020Optimising,
author = {Mart{\' i}n, Alejandro and Vargas-Yun, V{\' i}ctor Manuel and Guti{\' e}rrez, Pedro Antonio and Camacho, David and Herv{\' a}s-Mart{\' i}nez, C{\' e}sar},
journal = {Applied Soft Computing},
doi = {10.1016/j.asoc.2020.106144},
year = {2020},
pages = {106144},
title = {Optimising {Convolutional} {Neural} {Networks} using a {Hybrid} {Statistically}-driven {Coral} {Reef} {Optimisation} algorithm},
url = {https://doi.org/10.1016/j.asoc.2020.106144},
howpublished = {https://doi.org/10.1016/j.asoc.2020.106144},
volume = {90},
}
BibTex Unicode Citation
@article{Martin2020Optimising,
author = {Martín, Alejandro and Vargas-Yun, Víctor Manuel and Gutiérrez, Pedro Antonio and Camacho, David and Hervás-Martínez, César},
journal = {Applied Soft Computing},
doi = {10.1016/j.asoc.2020.106144},
year = {2020},
pages = {106144},
title = {Optimising {Convolutional} {Neural} {Networks} using a {Hybrid} {Statistically}-driven {Coral} {Reef} {Optimisation} algorithm},
url = {https://doi.org/10.1016/j.asoc.2020.106144},
howpublished = {https://doi.org/10.1016/j.asoc.2020.106144},
volume = {90},
}
APA Citation
Martín, A., Vargas-Yun, V. M., Gutiérrez, P. A., Camacho, D., & Hervás-Martínez, C. (2020). Optimising Convolutional Neural Networks using a Hybrid Statistically-driven Coral Reef Optimisation algorithm. Applied Soft Computing, 90, 106144. https://doi.org/10.1016/j.asoc.2020.106144
RIS Citation
TY - JOUR
AU - Martín, Alejandro
AU - Vargas-Yun, Víctor Manuel
AU - Gutiérrez, Pedro Antonio
AU - Camacho, David
AU - Hervás-Martínez, César
DA - 2020///
PY - 2020
DO - 10.1016/j.asoc.2020.106144
ID - temp_id_047639886687
SP - 106144
T2 - Applied Soft Computing
TI - Optimising Convolutional Neural Networks using a Hybrid Statistically-
driven Coral Reef Optimisation algorithm
UR - https://doi.org/10.1016/j.asoc.2020.106144
VL - 90
ER -
CV Citation
A. Martín, V.M. Vargas-Yun, P.A. Gutiérrez, D. Camacho (CA), C. Hervás-Martínez (2/5). "Optimising Convolutional Neural Networks using a Hybrid Statistically-driven Coral Reef Optimisation algorithm". Applied Soft Computing, Vol. 90, pp. 106144, 2020. (Q1D1, IF: 6.7).