Neuroevolution at work
Webpage: https://newk-gecco.github.io/
Description
In the last years, inspired by the fact that natural brains themselves are the products of an evolutionary process, the quest for evolving and optimizing artificial neural networks through evolutionary computation has enabled researchers to successfully apply neuroevolution to many domains such as strategy games, robotics, big data, and so on. The reason behind this success lies in important capabilities that are typically unavailable to traditional approaches, including evolving neural network building blocks, hyperparameters, architectures, and even the algorithms for learning themselves (meta-learning).
Although promising, the use of neuroevolution poses important problems and challenges for its future development.
Firstly, many of its paradigms suffer from a lack of parameter-space diversity, meaning a failure to provide diversity in the behaviors generated by the different networks.
Moreover, harnessing neuroevolution to optimize deep neural networks requires noticeable computational power and, consequently, investigating new trends in enhancing computational performance.
A closely related and rapidly growing field is Neural Architecture Search (NAS), which aims to automatically design high-performing neural network architectures by employing techniques from evolutionary computation and reinforcement learning. NAS methods strictly rely on neuroevolution principles to explore the vast space of possible neural network configurations and discover novel, efficient architectures. The tight coupling between neuroevolution and NAS highlights their synergistic relationship, with advancements in one field enabling progress in the other.
Although promising, the use of neuroevolution and NAS poses important problems and challenges for their future development.
Firstly, many of their paradigms suffer from a lack of parameter-space diversity, meaning a failure to provide diversity in the behaviours generated by the different networks.
Moreover, harnessing neuroevolution and NAS to optimize deep neural networks requires noticeable computational power and, consequently, the investigation of new trends in enhancing computational performance.
This workshop aims:
- to bring together researchers working in the fields of deep learning, evolutionary computation, and optimization to exchange new ideas about potential directions for future research;
- to create a forum of excellence on neuroevolution that will help interested researchers from various areas, ranging from computer scientists and engineers on the one hand to application-devoted researchers on the other hand, to gain a high-level view of the current state of the art.archers on the other hand, to gain a high-level view about the current state of the art.
Since an increasing trend to neuroevolution and NAS in the next few years seems likely to be observed, not only will a workshop on this topic be of immediate relevance to get insight into future trends, but it will also provide a common ground to encourage novel paradigms and applications. Therefore, researchers emphasizing neuroevolution and NAS issues in their work are encouraged to submit their work. This event is also ideal for informal contacts, exchanging ideas, and discussions with fellow researchers.
The scope of the workshop is to receive high-quality contributions on topics related to neuroevolution and neural architecture search, ranging from theoretical works to innovative applications in the context of (but not limited to):
• theoretical and experimental studies involving neuroevolution and NAS on machine learning in general, and deep and reinforcement learning in particular
• development of innovative neuroevolution and NAS paradigms
• parallel and distributed neuroevolution and NAS methods
• new search operators for neuroevolution and NAS
• hybrid methods for neuroevolution and NAS
• surrogate models for fitness estimation in neuroevolution and NAS
• adopt evolutionary multi-objective and many-objective optimisation techniques in neuroevolution and NAS
• propose new benchmark problems for neuroevolution and NAS
• applications of neuroevolution and NAS to Artificial Intelligence agents and to real-world problems.
Organizers
Antonio Della Cioppa received the Laurea degree in Physics and the Ph.D. degree in Computer Science, both from University of Naples “Federico II,” Naples, Italy, in 1993 and 1999, respectively. From 1999 to 2003, he was a Postdoctoral Fellow at the Department of Computer Science and Electrical Engineering, University of Salerno, Salerno, Italy. In 2004, he joined the Department of Information Engineering, Electrical Engineering and Mathematical Applications, University of Salerno, where he is currently Associate Professor of Computer Science and Artificial Intelligence. His main fields of interest are in the Computational Intelligence area, with particular attention to Evolutionary Computation, Swarm Intelligence and Neural Networks, Machine Learning, Parallel Computing, and their application to real-world problems. Prof. Della Cioppa is a member of the Association for Computing Machinery (ACM), the ACM Special Interest Group on Genetic and Evolutionary Computation, the IEEE Computational Intelligence Society and the IEEE Computational Intelligence Society Task Force on Evolutionary Computer Vision and Image Processing. He serves as Associate Editor for the Applied Soft Computing journal (Elsevier), Evolutionary Intelligence (Elsevier), Algorithms (MDPI). He has been part of the Organizing or Scientific Committees for tens of international conferences or workshops, and has authored or co-authored about 100 papers in international journals, books, and conference proceedings.
Prof Mengjie Zhang is a Fellow of Royal Society of New Zealand, a Fellow of Engineering New Zealand, a Fellow of IEEE, an IEEE Distinguished Lecturer, currently Professor of Computer Science at Victoria University of Wellington, where he heads the interdisciplinary Evolutionary Computation and Machine Learning Research Group. He is the Director of the Centre for Data Science and Artificial Intelligence at the University.
His research is mainly focused on AI, machine learning and big data, particularly in evolutionary learning and optimisation, feature selection/construction and big dimensionality reduction, computer vision and image analysis, scheduling and combinatorial optimisation, classification with unbalanced data and missing data, and evolutionary deep learning and transfer learning. Prof Zhang has published over 900 research papers in refereed international journals and conferences. He has been serving as an associated editor for over ten international journals including IEEE Transactions on Evolutionary Computation, IEEE Transactions on Cybernetics, the Evolutionary Computation Journal (MIT Press), and involving many major AI and EC conferences as a chair. He received the “EvoStar/SPECIES Award for Outstanding Contribution to Evolutionary Computation in Europe” in 2023. Since 2007, he has been listed as a top five (currently No. 3) world genetic programming researchers by the GP bibliography (http://www.cs.bham.ac.uk/~wbl/biblio/gp-html/index.html). He is also a Clarivate Highly Cited Researcher in the field of Computer Science — 2023.
He is the Tutorial Chair for GECCO 2014, 2023 and 2024, an AIS-BIO Track Chair for GECCO 2016, an EML Track Chair for GECCO 2017, and a GP Track Chair for GECCO 2020 and 2021.
Prof Zhang is currently the Chair for IEEE CIS Awards Committee. He is also a past Chair of the IEEE CIS Intelligent Systems Applications Technical Committee, the Emergent Technologies Technical Committee and the Evolutionary Computation Technical Committee, a past Chair for IEEE CIS PubsCom Strategic Planning subcommittee, and the founding chair of the IEEE Computational Intelligence Chapter in New Zealand.