Skip to main content

Multi-Objective Hyperparameter Optimization for Spiking Neural Network Neuroevolution...

Publication Type
Conference Paper
Book Title
2021 IEEE Congress on Evolutionary Computation (CEC)
Publication Date
Page Numbers
1225 to 1232
Conference Name
IEEE Conference on Evolutionary Computation (CEC)
Conference Location
Virtual, Poland
Conference Sponsor
Conference Date

Neuroevolution has had significant success over recent years, but there has been relatively little work applying neuroevolution approaches to spiking neural networks (SNNs). SNNs are a type of neural network that includes temporal processing component, are not easily trained using other methods, and can be deployed into energy-efficient neuromorphic hardware. In this work, we investigate two evolutionary approaches for training SNNs. We explore the impact of the hyperparameters of the evolutionary approaches, including tournament size, population size, and representation type, on the performance of the algorithms. We present a multi-objective Bayesian-based hyperparameter optimization approach to tune the hyperparameters to produce the most accurate and smallest SNNs. We show that the hyperparameters can significantly affect the performance of these algorithms. We also perform sensitivity analysis and demonstrate that every hyperparameter value has the potential to perform well, assuming other hyperparameter values are set correctly.