Transfer, Multitask, and Lifelong Machine Learning
Problems rarely come alone. A factory faces many related scheduling scenarios; a logistics company solves new variants of routing every day. Instead of learning each from scratch, my research reuses knowledge — through transfer learning, multitask learning and lifelong learning — so that solvers learn faster and generalise further.
Introduction
Three ways to reuse knowledge
Transfer learning reuses what was learned on a source task to speed up a target task. Multitask learning solves several related tasks together so they help each other. Lifelong learning faces a stream of tasks and must keep improving without forgetting earlier ones.
My Contributions
With my students and collaborators, I have made the following contributions. The papers shown are selected automatically: award-winning papers, papers with 100+ citations, and papers in top venues. Click a title to read the paper, or list entry to see it in my publication list.
1 Knowledge transfer in genetic programming
We transfer useful sub-trees, individuals and search distributions between GP runs on related routing problems, and studied how reusable evolved rules are.
- Knowledge Transfer in Genetic Programming Hyper-heuristicsAutomated Design of Machine Learning and Search Algorithms, 2021 · list entry Book chapter
- Knowledge Transfer Genetic Programming with Auxiliary Population for Solving Uncertain Capacitated Arc Routing ProblemIEEE Transactions on Evolutionary Computation, 2023 · list entry
- Genetic Programming with Knowledge Transfer and Guided Search for Uncertain Capacitated Arc Routing ProblemIEEE Transactions on Evolutionary Computation, 2022 · list entry
2 Evolutionary multitask learning
Multitask GP learns heuristics for several scenarios simultaneously, deciding which tasks are related and what to share.
- An Investigation of Multitask Linear Genetic Programming for Dynamic Job Shop SchedulingEuropean Conference on Genetic Programming (EuroGP), 2022 · list entry Best Paper Award, EuroGP 2022
- Surrogate-Assisted Evolutionary Multitasking Genetic Programming for Dynamic Flexible Job Shop SchedulingIEEE Transactions on Evolutionary Computation, 2021 · list entry 230+ citations
- Multitask Genetic Programming Based Generative Hyper-heuristics: A Case Study in Dynamic SchedulingIEEE Transactions on Cybernetics, 2022 · list entry 120+ citations
- Multitask Multiobjective Genetic Programming for Automated Scheduling Heuristic Learning in Dynamic Flexible Job Shop SchedulingIEEE Transactions on Cybernetics, 2023 · list entry 110+ citations
- Multi-objective Dynamic Flexible Job Shop Scheduling with Biased Objectives via Multitask Genetic ProgrammingIEEE Transactions on Artificial Intelligence, 2024 · list entry
- Multitask Linear Genetic Programming with Shared Individuals and its Application to Dynamic Job Shop SchedulingIEEE Transactions on Evolutionary Computation, 2024 · list entry
- Task Relatedness Based Multitask Genetic Programming for Dynamic Flexible Job Shop SchedulingIEEE Transactions on Evolutionary Computation, 2023 · list entry
- A Novel Multi-Task Genetic Programming Approach to Uncertain Capacitated Arc Routing ProblemACM Genetic and Evolutionary Computation Conference (GECCO), 2021 · list entry
3 Lifelong learning for optimisation
When new problem variants keep arriving, a learner must adapt without forgetting. We consolidate past behaviour to keep performance on earlier tasks while learning new ones.
- Learning from Offline and Online Experiences: A Hybrid Adaptive Operator Selection FrameworkACM Genetic and Evolutionary Computation Conference (GECCO), 2024 · list entry L4EC Track Best Paper Nomination, GECCO 2024
- Lifelong Learning with Behavior Consolidation for Vehicle RoutingInternational Conference on Learning Representations (ICLR), 2026 · list entry
- LiBOG: Lifelong Learning for Black-Box Optimizer GenerationInternational Joint Conference on Artificial Intelligence (IJCAI), 2025 · list entry
4 Generalising across problems
We improve how learned solvers and heuristics generalise to new sizes, variants and objectives, with parameter sharing, attention reshaping and curriculum learning.
- Adaptive Curriculum Learning in Genetic Programming–Guided Local Search for Large-Scale Vehicle Routing ProblemsInternational Conference on the Applications of Evolutionary Computation (EvoApps), 2026 · list entry Best Student Paper Award, EvoApps 2026
- Distance-aware Attention Reshaping for Enhancing Generalization of Neural SolversIEEE Transactions on Neural Networks and Learning Systems, 2025 · list entry
- Soft Parameter Sharing Model for Cross-Problem Generalization in Vehicle Routing ProblemsIEEE Transactions on Artificial Intelligence, 2025 · list entry
