Intelligent Evolution Optimization: Guided from Deep Learning to Large Language Model
Description
The rapid development of machine learning has significantly influenced the field of evolutionary optimization. Traditional evolutionary optimization approaches often suffer from cold starts and inefficient solution searches. Learning-based evolutionary optimization, combining machine learning and evolutionary algorithms, has emerged as a promising research area (e.g., learning for EC appeared for the first time as a new track at GECCO2024). These methods enable the discovery of effective feature representations, prediction of near-optimal solutions, dimensionality reduction, and extraction of knowledge from training data to guide the search process. Despite these advancements, learning-based methods typically require large amounts of training data and often lack generalizability across different problem domains. The recent rise of large language models (LLMs) introduces a new paradigm, as these models are pre-trained on vast amounts of data and can be fine-tuned with a minimal number of examples to generate effective heuristic algorithms and solutions for evolutionary optimization.
This tutorial will provide an overview of the latest research development in intelligent evolutionary optimization, focusing on the transition from traditional machine learning to deep learning, and then to business optimization and evolutionary optimization guided by large language models.
Organizers
Hua Xu is a tenured associate professor in the Department of Computer Science at Tsinghua University. His research focuses on intelligent optimization and human-machine interaction in AI. He has published over 80 papers in top international conferences and high-impact journals, accumulating more than 8000 Google Scholar citations and 2000 SCI citations. Dr. Xu has authored several influential books, including Intelligent Evolutionary Optimization (Elsevier, 2024), and holds 36 granted patents and 26 software copyrights. His contributions have earned him prestigious awards, such as the National Science and Technology Progress Award (Second Class) and the Beijing Science and Technology Award (First Class). He serves as the editor-in-chief of Intelligent Systems with Applications and associate editor-in-chief of Expert Systems with Applications, and is actively involved in several national AI research initiatives.
Xiaodong Li received his B.Sc. degree from Xidian University, Xi'an, China, and Ph.D. degree in Artificial Intelligence from University of Otago, Dunedin, New Zealand, respectively. He is a Professor with the School of Computing Technologies, RMIT University, Melbourne, Australia. His research interests include machine learning, evolutionary computation, neural networks, deep learning, data analytics, multiobjective optimization, operational research, and swarm intelligence. He served as an Associate Editor of the IEEE Transactions on Evolutionary Computation, Swarm Intelligence (Springer), and International Journal of Swarm Intelligence Research. He is a founding member of IEEE CIS Task Force on Swarm Intelligence, a former vice-chair of IEEE Task Force on Multi-modal Optimization, and a former chair of IEEE CIS Task Force on Large Scale Global Optimization. He is the recipient of 2013 ACM SIGEVO Impact Award and 2017 IEEE CIS IEEE Transactions on Evolutionary Computation Outstanding Paper Award. He is an IEEE Fellow.
Yuan Sun is a Lecturer in Business Analytics and Artificial Intelligence at La Trobe University, Australia. He received his BSc in Applied Mathematics from Peking University, China, and his PhD in Computer Science from The University of Melbourne, Australia. His research interests include artificial intelligence, machine learning, operations research, and evolutionary computation. His research has contributed significantly to the emerging area of leveraging machine learning for combinatorial optimisation. He is the vice-chair of the IEEE task force on large-scale global optimisation and has organised special sessions and workshops, and delivered tutorials at the GECCO, PPSN, and CEC conferences.
Huigen Ye is a Ph.D. student at Tsinghua University, focusing on applying machine learning to accelerate large-scale optimization, particularly in mixed-integer programming. He has published papers in top conferences such as ICML, ICLR and AAAI. He is actively involved in academic service, serving as a reviewer for conferences like AISTATS, NeurIPS and ICLR.