Journal of Guangdong University of Technology ›› 2023, Vol. 40 ›› Issue (03): 38-45.doi: 10.12052/gdutxb.210131

Previous Articles     Next Articles

A Multi-factor Evolutionary Algorithm Using Maximum Mean Difference Method

Lai Yu-fang, Wang Zhen-you   

  1. School of Mathematics and Statistics, Guangdong University of Technology, Guangzhou 510520, China
  • Received:2021-09-06 Online:2023-05-25 Published:2023-06-08

HTML

PDF (PC)

1008

Abstract: The multi-factor evolutionary algorithm (MFEA) is mainly studied and improved. The mixed probability distribution of the offspring population optimized by the maximum mean difference method (MMD) is used as the metric criterion of the algorithm. MFEA-MMD is improved on the basis of the Random Mating Probability matrix (RMP) of MFEA-II algorithm to avoid the influence of negative transfer most common in multi-factor evolutionary algorithms to the greatest extent. The convergence rate of the MFEA-MMD is faster than that of MFEA-II. The operation speed of the algorithm is 29% higher than that of MFEA-II, and the degree of knowledge transfer between tasks is 35% higher than that of MFEA-II.

Key words: multi-factor evolutionary algorithm, maximum mean discrepancy, negative transfer, knowledge transfer

CLC Number: 

  • TP301
[1] THRUN S. Is learning the n-th thing any easier than learning the first?[J]. Advances in Neural Information Processing Systems, 1996(8) : 640-646.
[2] PAN S J, QIANG Y. A Survey on transfer learning [J]. IEEE Transactions on Knowledge and Data Engineering, 2010, 22(10): 1345-1359.
[3] IQBAL M, BROWNE W N, ZHANG M. Reusing building blocks of extracted knowledge to solve complex, large-scale boolean problems [J]. IEEE Transactions on Evolutionary Computation, 2014, 18(4): 465-480.
[4] IQBAL M, BING X, AL-SAH AF H, et al. Cross domain reuse of extracted knowledge in genetic programming for image classification [J]. IEEE Transactions on Evolutionary Computation, 2017, 21(4): 569-587.
[5] RICH, CARUANA. Multitask learning [J]. Machine Learning, 1997, 28(1): 41-75.
[6] DA B, ONG Y S, FENG L, et al. Evolutionary multitasking for single-objective continuous optimization: benchmark problems, performance metric, and baseline results [J]. Computer Science, 2017, 1(3): 1-11.
[7] BON E V, CHAI K, WILL C. Multi-task gaussian process prediction[C]// Advances in Neural Information Processing Systems 20. New York: MIT Press, 2008: 153-160.
[8] BALL K K, ONG Y S, GUPTA A, et al. Multifactorial evolutionary algorithm with online transfer parameter estimation: MFEA-II [J]. IEEE Transactions on Evolutionary Computation, 2020, 24(1): 69-81.
[9] PEL M. Bayesian optimization algorithm[M]. Berlin: Springer Berlin Heidelberg, 2005.
[10] GUPTA A, ONG Y S, FENG L, et al. Multiobjective multifactorial optimization in evolutionary multitasking [J]. IEEE Transactions on Cybernetics, 2017, 47(7): 1652-1665.
[11] DEB K, PRATAP A, AGARWAL S, et al. A fast and elitist multiobjective genetic algorithm: NSGA-II [J]. IEEE Transactions on Evolutionary Computation, 2002, 6(2): 182-197.
[12] ZHANG Q F, HUI L. MOEA/D: a multiobjective evolutionary algorithm based on decomposition [J]. IEEE Transactions on Evolutionary Computation, 2008, 11(6): 712-731.
[13] SEADA H, DEB K. U-NSGA-III: a unified evolutionary optimization procedure for single, multiple, and many objectives: proof-of-principle results[C]// Evolutionary Multi-Criterion Optimization. Heidelberg: Springer International Publishing, 2015: 34-49.
[14] ZHANG H P, YAO O Y, WANG Z. Note on “generalized rough sets based on reflexive and transitive relations” [J]. Information Sciences, 2009, 179(4): 471-473.
[15] RICE J, ClONINGER C R, REICH T. Multifactorial inheritance with cultural transmission and assortative mating. I. description and basic properties of the unitary models [J]. The American Journal of Human Genetics, 1978, 30(6): 618-643.
[16] RICE J, ClONINGER C R, REICH T. Multifactorial inheritance with cultural transmission and assortative mating. II. a general model of combined poly-genic and cultural inheritance [J]. American Journal of Human Genetics, 1979, 31(2): 176.
[17] GUPTA A, J M, ONG Y S. Evolutionary multitasking in bi-level optimization [J]. Complex & Intelligent Systems, 2015, 1(1/4): 83-95.
[18] 徐庆征, 杨恒, 王娜, 等. 多因子进化算法研究进展[J]. 计算机工程与应用, 2018, 54(11): 15-20.
XU Q Z, YANG H, WNAG N, et al. Recent advances in multifactorial evolutionary algorithm [J]. Computer Engineering and Applications, 2018, 54(11): 15-20.
[19] CHEN Q, MA X, SUN Y, et al. Adaptive memetic algorithm based evolutionary multi-tasking single-objective optimization[C]// Asia-pacific Conference on Simulated Evolution and Learning. Heidelberg: Springer International Publishing, 2017: 462-472.
[20] LIAW R T, TING C K. Evolutionary many-tasking based on biocoenosis through symbiosis: a framework and benchmark problems[C]// Evolutionary Computation. Vancouver, BC: IEEE, 2017: 2266-2273.
[21] WEN Y W, TING C K, Parting ways and reallocating resources in evolutionary multitasking[C]// Evolutionary Computation. Toronto: IEEE, 2017: 2404-2411.
[22] WEN Y W, TING C K, et al. Learning ensemble of decision trees through multifactorial genetic programming[C]// IEEE Transactions on Evolutionary Computation. Toronto: IEEE, 2016: 5293-5299.
[23] CHANDRA R, GUPTA A, ONG Y S, et al, Evolutionary multitask learning for modular knowledge representation in neural networks[C]// Neural Process. Toronto: IEEE, 2017, 47(3) : 993-1009.
[24] GUPTA A, ONG Y S, DA B, et al. Measuring complementarity between function landscapes in evolutionary multitasking[C]// Evolutionary Computation. Toronto: IEEE, 2016: 879-892.
[25] BALI K K, GUPTA A, LIANG F, et al. Linearized domain adaptation in evolutionary multitasking[C]// 2017 IEEE Congress on Evolutionary Computation (CEC). Toronto: IEEE, 2017: 1295-1302.
[26] ABHISHEK, GUPTA A, ONG Y S, et al. Insights on transfer optimization: because experience is the best teacher [J]. IEEE Transactions on Emerging Topics in Computational Intelligence, 2017, 2(1): 51-64.
[27] LARRAAGA P, LOZANO J A. Estimation of distribution algorithms a new tool for evolutionary computation [J]. Springer-Verlag, 2002(2134): 454-469.
[28] SASTRY K, GOLDBERG D E, PELIKAN M. Limits of scalability of multiobjective estimation of distribution algorithms[J]. 2005 IEEE Congress on Evolutionary Computation, 2005(3) : 2217-2224.
[1] Hu Ying-cheng, Xing Ma-li, Wu Yuan-qing. Similarity Measure for String Sequences in Weighted Petri Net [J]. Journal of Guangdong University of Technology, 0, (): 0-10.
[2] Zhang Yu, Liu Bo. Research on Inductive Transfer Learning Model Based on Self-paced Learning Strategy [J]. Journal of Guangdong University of Technology, 2023, 40(04): 31-36.
[3] Zhang Rui, Lyu Jun. Single-channel Speech Separation Based on Separated SI-SNR Regression Estimation and Adaptive Frequency Modulation Network [J]. Journal of Guangdong University of Technology, 2023, 40(02): 45-54.
[4] Liu Dong-ning, Wang Zi-qi, Zeng Yan-jiao, Wen Fu-yan, Wang Yang. Prediction Method of Gene Methylation Sites Based on LSTM with Compound Coding Characteristics [J]. Journal of Guangdong University of Technology, 2023, 40(01): 1-9.
[5] Xu Wei-feng, Cai Shu-ting, Xiong Xiao-ming. Visual Inertial Odometry Based on Deep Features [J]. Journal of Guangdong University of Technology, 2023, 40(01): 56-60,76.
[6] Liu Dong-ning, Zheng Chu-chu. Task Allocation under Cool Down Time Constraints via the Many to Many Assignment [J]. Journal of Guangdong University of Technology, 2021, 38(05): 10-15.
[7] Zhang Wei, Tong Ru, Wu Shi-jue, Wang Zi-qi, Teng Shao-hua. Group Role Assignment Based on KD45 Closure [J]. Journal of Guangdong University of Technology, 2021, 38(04): 26-34.
[8] Lyu Shu-yuan, Liu Fu-chun, Zhao Rui, Deng Xiu-qin, Cui Hong-gang. A Research on Patterns Fault Prediction of Decentralized Discrete Event Systems [J]. Journal of Guangdong University of Technology, 2021, 38(01): 54-63.
[9] Hao Zhi-feng, Li Yi-ting, Cai Rui-chu, Zeng Yan, Qiao Jie. A Research on Users’ Shopping Behaviors in Social Network Based on Causal Model [J]. Journal of Guangdong University of Technology, 2020, 37(03): 1-8.
[10] Hong Ying-han, Hao Zhi-feng, Mai Gui-zhen, Chen Ping-hua. Learning Causal Skeleton by Using Lower Order Conditional Independent Tests [J]. Journal of Guangdong University of Technology, 2019, 36(05): 14-19.
[11] Chen He-feng, Wu Nai-qi. Maximally Permissive Supervisor Design Based on Reachablity and Structural Analysis of Petri Net [J]. Journal of Guangdong University of Technology, 2019, 36(04): 1-9.
[12] Lei Rui-sheng, Ling Bingo Wing-Kuen. A Heart Rate Variability Analysis via Modified Multi-time Scale Permutation Entropy [J]. Journal of Guangdong University of Technology, 2019, 36(03): 32-38.
[13] Shi Cong-cong, Liu Fu-chun. A Pattern-Based Failure Diagnosis of Fuzzy Discrete-Event Systems [J]. Journal of Guangdong University of Technology, 2019, 36(01): 35-41.
[14] Huang Tian-an, Cheng Liang-lun, Huang Si-meng. A Research of Fluctuation Analysis Method on Process Flow of Production Process Based on Internet of Manufacturing Things [J]. Journal of Guangdong University of Technology, 2019, 36(01): 57-62.
[15] Liu Dong-ning, Liu Tong-wu, Song Jing-jing, Hou Yan. Multiple Assignment in Task Allocation of Communication Base Stations [J]. Journal of Guangdong University of Technology, 2018, 35(06): 69-76.
Viewed
Full text


Abstract

Cited
  Shared   
  Discussed   
No Suggested Reading articles found!
Copyright © 2017 Journal of Guangdong University of Technology
Add：729 East Dongfeng RD., Guangzhou PRC. Postcode: 510090
Tel：020-37626653,020-37626139,020-37626396
Email：xbzrb@gdut.edu.cn
Supported:Beijing Magtech