Loading...
 

Neuroevolution at work

Webpage: https://newk-gecco.github.io/

Description

In the last years, inspired by the fact that natural brains themselves are the products of an evolutionary process, the quest for evolving and optimizing artificial neural networks through evolutionary computation has enabled researchers to successfully apply neuroevolution to many domains such as strategy games, robotics, big data, and so on. The reason behind this success lies in important capabilities that are typically unavailable to traditional approaches, including evolving neural network building blocks, hyperparameters, architectures, and even the algorithms for learning themselves (meta-learning).
Although promising, the use of neuroevolution poses important problems and challenges for its future development.
Firstly, many of its paradigms suffer from a lack of parameter-space diversity, meaning a failure to provide diversity in the behaviors generated by the different networks.
Moreover, harnessing neuroevolution to optimize deep neural networks requires noticeable computational power and, consequently, investigating new trends in enhancing computational performance.

A closely related and rapidly growing field is Neural Architecture Search (NAS), which aims to automatically design high-performing neural network architectures by employing techniques from evolutionary computation and reinforcement learning. NAS methods strictly rely on neuroevolution principles to explore the vast space of possible neural network configurations and discover novel, efficient architectures. The tight coupling between neuroevolution and NAS highlights their synergistic relationship, with advancements in one field enabling progress in the other.
Although promising, the use of neuroevolution and NAS poses important problems and challenges for their future development.
Firstly, many of their paradigms suffer from a lack of parameter-space diversity, meaning a failure to provide diversity in the behaviours generated by the different networks.
Moreover, harnessing neuroevolution and NAS to optimize deep neural networks requires noticeable computational power and, consequently, the investigation of new trends in enhancing computational performance.
This workshop aims:
- to bring together researchers working in the fields of deep learning, evolutionary computation, and optimization to exchange new ideas about potential directions for future research;
- to create a forum of excellence on neuroevolution that will help interested researchers from various areas, ranging from computer scientists and engineers on the one hand to application-devoted researchers on the other hand, to gain a high-level view of the current state of the art.archers on the other hand, to gain a high-level view about the current state of the art.

Since an increasing trend to neuroevolution and NAS in the next few years seems likely to be observed, not only will a workshop on this topic be of immediate relevance to get insight into future trends, but it will also provide a common ground to encourage novel paradigms and applications. Therefore, researchers emphasizing neuroevolution and NAS issues in their work are encouraged to submit their work. This event is also ideal for informal contacts, exchanging ideas, and discussions with fellow researchers.
The scope of the workshop is to receive high-quality contributions on topics related to neuroevolution and neural architecture search, ranging from theoretical works to innovative applications in the context of (but not limited to):
• theoretical and experimental studies involving neuroevolution and NAS on machine learning in general, and deep and reinforcement learning in particular
• development of innovative neuroevolution and NAS paradigms
• parallel and distributed neuroevolution and NAS methods
• new search operators for neuroevolution and NAS
• hybrid methods for neuroevolution and NAS
• surrogate models for fitness estimation in neuroevolution and NAS
• adopt evolutionary multi-objective and many-objective optimisation techniques in neuroevolution and NAS
• propose new benchmark problems for neuroevolution and NAS
• applications of neuroevolution and NAS to Artificial Intelligence agents and to real-world problems.


Organizers

Ernesto Tarantino
Ernesto Tarantino was born in S. Angelo a Cupolo, Italy, in 1961. He received the Laurea degree in Electrical Engineering in 1988 from University of Naples, Italy. He is currently a researcher at National Research Council of Italy. After completing his studies, he conducted research in parallel and distributed computing. During the past decade his research interests have been in the fields of theory and application of evolutionary techniques and related areas of computational intelligence. He is author of more than 100 scientific papers in international journal, book and conferences. He has served as referee and organizer for several international conferences in the area of evolutionary computation.


De Falco Ivanoe
Ivanoe De Falco received his degree in Electrical Engineering “cum laude” from the University of Naples “Federico II”, Naples, Italy, in 1987. He is currently a senior researcher at the Institute for High-Performance Computing and Networking (ICAR) of the National Research Council of Italy (CNR), where he is the Responsible of the Innovative Models for Machine Learning (IMML) research group. His main fields of interest include Computational Intelligence, with particular attention to Evolutionary Computation, Swarm Intelligence and Neural Networks, Machine Learning, Parallel Computing, and their application to real-world problems, especially in the medical domain. He is a member of the World Federation on Soft Computing (WFSC), the IEEE SMC Technical Committee on Soft Computing, the IEEE ComSoc Special Interest Research Group on Big Data for e-Health, the IEEE Computational Intelligence Society Task Force on Evolutionary Computer Vision and Image Processing, and is an Associate Editor of Applied Soft Computing Journal (Elsevier). He is the author of more than 120 papers in international journals and in the proceedings of international conferences.


Antonio Della Cioppa

Antonio Della Cioppa received the Laurea degree in Physics and the Ph.D. degree in Computer Science, both from University of Naples “Federico II,” Naples, Italy, in 1993 and 1999, respectively. From 1999 to 2003, he was a Postdoctoral Fellow at the Department of Computer Science and Electrical Engineering, University of Salerno, Salerno, Italy. In 2004, he joined the Department of Information Engineering, Electrical Engineering and Mathematical Applications, University of Salerno, where he is currently Associate Professor of Computer Science and Artificial Intelligence. His main fields of interest are in the Computational Intelligence area, with particular attention to Evolutionary Computation, Swarm Intelligence and Neural Networks, Machine Learning, Parallel Computing, and their application to real-world problems. Prof. Della Cioppa is a member of the Association for Computing Machinery (ACM), the ACM Special Interest Group on Genetic and Evolutionary Computation, the IEEE Computational Intelligence Society and the IEEE Computational Intelligence Society Task Force on Evolutionary Computer Vision and Image Processing. He serves as Associate Editor for the Applied Soft Computing journal (Elsevier), Evolutionary Intelligence (Elsevier), Algorithms (MDPI). He has been part of the Organizing or Scientific Committees for tens of international conferences or workshops, and has authored or co-authored about 100 papers in international journals, books, and conference proceedings.


 
Edgar Galvan
Edgar Galvan is a Senior Researcher in the Department of Computer Science, Maynooth University. He is the Artificial Intelligence and Machine Learning Cluster Leader at the Innovation Value Institute and at the Naturally Inspired Computation Research Group. Prior to this, he held multiple research positions in Essex University, University College Dublin, Trinity College Dublin and INRIA Paris-Saclay. He is an expert in the properties of encodings, such as neutrality and locality, in Genetic Programming as well as a pioneer in the study of Semantic-based Genetic Programming. His research interests also include applications to combinatorial optimisation, games, software engineering and deep neural networks. Dr. Edgar Galvan has independently ranked as one of the all-time top 1% researchers in Genetic Programming, according to University College London. He has published in excess of nearly 70 peer-reviewed publications. Edgar has over 2,300 citations and a H-index of 27.


Mengjie Zhang

Prof Mengjie Zhang is a Fellow of Royal Society of New Zealand, a Fellow of Engineering New Zealand, a Fellow of IEEE, an IEEE Distinguished Lecturer, currently Professor of Computer Science at Victoria University of Wellington, where he heads the interdisciplinary Evolutionary Computation and Machine Learning Research Group. He is the Director of the Centre for Data Science and Artificial Intelligence at the University.

His research is mainly focused on AI, machine learning and big data, particularly in evolutionary learning and optimisation, feature selection/construction and big dimensionality reduction, computer vision and image analysis, scheduling and combinatorial optimisation, classification with unbalanced data and missing data, and evolutionary deep learning and transfer learning. Prof Zhang has published over 900 research papers in refereed international journals and conferences. He has been serving as an associated editor for over ten international journals including IEEE Transactions on Evolutionary Computation, IEEE Transactions on Cybernetics, the Evolutionary Computation Journal (MIT Press), and involving many major AI and EC conferences as a chair. He received the “EvoStar/SPECIES Award for Outstanding Contribution to Evolutionary Computation in Europe” in 2023. Since 2007, he has been listed as a top five (currently No. 3) world genetic programming researchers by the GP bibliography (http://www.cs.bham.ac.uk/~wbl/biblio/gp-html/index.html). He is also a Clarivate Highly Cited Researcher in the field of Computer Science — 2023.

He is the Tutorial Chair for GECCO 2014, 2023 and 2024, an AIS-BIO Track Chair for GECCO 2016, an EML Track Chair for GECCO 2017, and a GP Track Chair for GECCO 2020 and 2021.

Prof Zhang is currently the Chair for IEEE CIS Awards Committee. He is also a past Chair of the IEEE CIS Intelligent Systems Applications Technical Committee, the Emergent Technologies Technical Committee and the Evolutionary Computation Technical Committee, a past Chair for IEEE CIS PubsCom Strategic Planning subcommittee, and the founding chair of the IEEE Computational Intelligence Chapter in New Zealand.