Journal of Guangdong University of Technology ›› 2022, Vol. 39 ›› Issue (06): 36-43.doi: 10.12052/gdutxb.220042

• Comprehensive Studies • Previous Articles     Next Articles

Consensus Opinion Enhancement in Social Network with Multi-agent Reinforcement Learning

Xie Guang-qiang, Xu Hao-ran, Li Yang, Chen Guang-fu   

  1. School of Computer Science and Technology, Guangdong University of Technology, Guangzhou 510006, China
  • Received:2022-03-06 Online:2022-11-10 Published:2022-11-25

HTML

PDF (PC)

1605

Abstract: Aiming at the problem of consensus enhancement in opinion dynamics of social network, a consensus opinion enhancement with intelligent perception (COEIP) model based on multi-agent reinforcement learning is proposed. In the Markov decision-making process in opinion dynamics, firstly, the decision-making model of agent is designed through bidirectional recurrent neural network to solve the problem of uncertain-length perception. Then, through the idea of difference reward, an effective reward function is designed for the three objectives of convergence efficiency, connectivity and communication cost. Finally, in order to optimize COEIP model, a multi-agent exploration and collaborative update algorithm based on policy gradient is designed, which can enable agents to adaptively learn the neighborhood selection strategy with multi-objective trade-off ability through the reward value in the process of interaction with each other. A large number of simulations verify that COEIP can effectively reconcile the contradictions between agents and reduce the number of clusters when the system is stable in the scenario of opinion dynamics of social network, thus enhancing the consensus opinion of the system. This model provides a new solution for improving the unity of people's opinions under large-scale social networks, which has important theoretical guiding significance.

Key words: multi-agent systems, social network, opinion dynamics, consensus enhancement

CLC Number: 

  • TP391
[1] DONG Y C, ZHA Q B, ZHANG H J, et al. Consensus reaching in social network group decision making: research paradigms and challenges [J]. Knowledge-Based Systems, 2018, 162: 3-13.
[2] ZHANG Z, GAO Y, LI Z L. Consensus reaching for social network group decision making by considering leadership and bounded confidence [J]. Knowledge-Based Systems, 2020, 204: 106240.
[3] SCOTT J, CARRINGTON P J. The SAGE handbook of social network analysis[M]. California: SAGE Publications, 2011.
[4] LI Y H, KOU G, LI G X, et al. Multi-attribute group decision making with opinion dynamics based on social trust network [J]. Information Fusion, 2021, 75: 102-115.
[5] LI T Y, ZHU H M. Effect of the media on the opinion dynamics in online social networks [J]. Physica A:Statistical Mechanics and its Applications, 2020, 551: 124117.
[6] JIAO Y R, LI Y L. An active opinion dynamics model: the gap between the voting result and group opinion [J]. Information Fusion, 2021, 65: 128-146.
[7] DOUVEN I, HEGSELMANN R. Mis-and disinformation in a bounded confidence model [J]. Artificial Intelligence, 2021, 291: 103415.
[8] BISWAS K, BISWAS S, SEN P. Block size dependence of coarse graining in discrete opinion dynamics model: application to the US presidential elections [J]. Physica A:Statistical Mechanics and its Applications, 2021, 566: 125639.
[9] ZHU L X, HE Y L, ZHOU D Y. Neural opinion dynamics model for the prediction of user-level stance dynamics [J]. Information Processing & Management, 2020, 57(2): 102031.
[10] BRAVO-MARQUEZ F, GAYO-AVELLO D, MENDOZA M, et al. Opinion dynamics of elections in Twitter[C]//2012 Eighth Latin American Web Congress. Colombia: IEEE, 2012: 32-39.
[11] ZHA Q B, KOU G, ZHANG H J, et al. Opinion dynamics in finance and business: a literature review and research opportunities [J]. Financial Innovation, 2020, 6(1): 1-22.
[12] DONG Y C, ZHAN M, KOU G, et al. A survey on the fusion process in opinion dynamics [J]. Information Fusion, 2018, 43: 57-65.
[13] SÎRBU A, LORETO V, SERVEDIO V D P, et al. Opinion dynamics: models, extensions and external effects[M]//Participatory sensing, opinions and collective awareness. Berlin: Springer, 2017: 363-401.
[14] URENA R, CHICLANA F, MELANCON G, et al. A social network based approach for consensus achievement in multiperson decision making [J]. Information Fusion, 2019, 47: 72-87.
[15] CABRERIZO F J, AL-HMOUZ R, MORFEQ A, et al. Soft consensus measures in group decision making using unbalanced fuzzy linguistic information [J]. Soft Computing, 2017, 21(11): 3037-3050.
[16] LI G X, KOU G, PENG Y. Heterogeneous large-scale group decision making using fuzzy cluster analysis and its application to emergency response plan selection [J]. IEEE Transactions on Systems, Man, and Cybernetics:Systems, 2021, 52(6): 3391-3403.
[17] XU S, WANG P, LYU J. Iterative neighbour-information gathering for ranking nodes in complex networks [J]. Scientific reports, 2017, 7(1): 1-13.
[18] NEDIĆ A, OLSHEVSKY A, RABBAT M G. Network topology and communication-computation tradeoffs in decentralized optimization [J]. Proceedings of the IEEE, 2018, 106(5): 953-976.
[19] ZHANG K Q, YANG Z R, BAŞAR T. Multi-agent reinforcement learning: a selective overview of theories and algorithms [J]. Handbook of Reinforcement Learning and Control, 2021: 321-384.
[20] 郑思远, 崔苗, 张广驰. 基于强化学习的无人机安全通信轨迹在线优化策略[J]. 广东工业大学学报, 2021, 38(04): 59-64.
ZHENG S Y, CUI M, ZHANG G C. Reinforcement learning-based online trajectory optimization for secure UAV communications [J]. Journal of Guangdong University of Technology, 2021, 38(04): 59-64.
[21] SHOU Z Y, DI X. Reward design for driver repositioning using multi-agent reinforcement learning [J]. Transportation research part C:emerging technologies, 2020, 119: 102738.
[22] SUN X Z, QIU J. Two-stage volt/var control in active distribution networks with multi-agent deep reinforcement learning method [J]. IEEE Transactions on Smart Grid, 2021, 12(4): 2903-2912.
[23] ZHANG K Q, YANG Z R, LIU H, et al. Fully decentralized multi-agent reinforcement learning with networked agents[C]//International Conference on Machine Learning. Sweden: IMLS, 2018: 5872-5881.
[24] DEY R, SALEM F M. Gate-variants of gated recurrent unit (GRU) neural networks[C]//2017 IEEE 60th international midwest symposium on circuits and systems. Michigan: IEEE, 2017: 1597-1600.
[25] SILVER D, SINGH S, PRECUP D, et al. Reward is enough [J]. Artificial Intelligence, 2021, 299: 103535.
[26] SUTTON R S, BARTO A G. Reinforcement learning: an introduction[M]. Massachusetts: MIT press, 2018.
[27] FOERSTER J, FARQUHAR G, AFOURAS T, et al. Counterfactual multi-agent policy gradients[C]//Proceedings of the AAAI conference on artificial intelligence. Louisiana: AAAI Press, 2018, 32(1) : 2974-2982.
[28] AGOGINO A, TURNER K. Multi-agent reward analysis for learning in noisy domains[C]//Proceedings of the fourth international joint conference on Autonomous agents and multiagent systems. Utrecht: IFAAMAS, 2005: 81-88.
[29] BARRAT A, BARTHELEMY M, PASTOR-SATORRAS R, et al. The architecture of complex weighted networks [J]. Proceedings of the national academy of sciences, 2004, 101(11): 3747-3752.
[30] SILVER D, LEVER G, HEESS N, et al. Deterministic policy gradient algorithms[C]//International conference on machine learning. Beijing: IMLS, 2014: 387-395.
[31] BLONDEL V D, HENDRICKX J M, TSITSIKLIS J N. On Krause's multi-agent consensus model with state-dependent connectivity [J]. IEEE transactions on Automatic Control, 2009, 54(11): 2586-2597.
[32] WU C W. Algebraic connectivity of directed graphs [J]. Linear and multilinear algebra, 2005, 53(3): 203-223.
[33] ESFAHANIAN A H. Connectivity algorithms[M]//Topics in structural graph theory. Cambridge: Cambridge University Press, 2013: 268-281.
[34] WANG H J, SHANG L H. Opinion dynamics in networks with common-neighbors-based connections [J]. Physica A:Statistical Mechanics and its Applications, 2015, 421: 180-186.
[35] CHENG C, YU C B. Opinion dynamics with bounded confidence and group pressure [J]. Physica A:Statistical Mechanics and its Applications, 2019, 532: 121900.
[1] Gu Zhi-hua, Peng Shi-guo, Huang Yu-jia, Feng Wan-dian, Zeng Zi-xian. Leader-following Consensus of Nonlinear Multi-agent Systems with ROUs and RONs via Event-triggered Impulsive Control [J]. Journal of Guangdong University of Technology, 2023, 40(01): 50-55.
[2] Qu Shen, Che Wei-wei. Distributed Model-Free Adaptive Control for Nonlinear Multi-Agent Systems with FDI Attacks [J]. Journal of Guangdong University of Technology, 2022, 39(05): 75-82.
[3] Hu Xin-miao, Lin Sui, Jiang Wen-chao, Xiong Meng, He Zhong-tang. A Path Adaptation-based Subgraph Matching Algorithm for Large-scale RDF Graph Data [J]. Journal of Guangdong University of Technology, 2022, 39(01): 50-55.
[4] Zeng Zi-xian, Peng Shi-guo, Huang Yu-jia, Gu Zhi-hua, Feng Wan-dian. Mean Square Quasi-consensus of Stochastic Multi-agent Systems Under Two Different Impulsive Deception Attacks [J]. Journal of Guangdong University of Technology, 2022, 39(01): 71-77.
[5] Du Helen S., Luo Zi-chan, Chen Yang-sen. Value Co-creation Based on Social Network Analysis and Counterfactual Analysis: Taking Xiaomi Virtual Community as an Example [J]. Journal of Guangdong University of Technology, 2020, 37(02): 11-21.
[6] Peng Jia-en, Deng Xiu-qin, Liu Tai-heng, Liu Fu-chun, Li Wen-zhou. A Recommendation Algorithm of Latent Factor Model Fused with the Social and Tag Information [J]. Journal of Guangdong University of Technology, 2018, 35(04): 45-50.
[7] Rao Dong-ning, Wang Jun-xing, Wei lai, Wang Ya-li. Parallel Minimal Cut Set Algorithm and Its Application in Financial Social Networks [J]. Journal of Guangdong University of Technology, 2018, 35(02): 46-50.
[8] Zhang Zhen-hua, Peng Shi-guo. Leader-Following Consensus of Second-Order Multi-Agent Systems with Switching Topology [J]. Journal of Guangdong University of Technology, 2018, 35(02): 75-80.
[9] Luo He-fu, Peng Shi-guo. Distributed Formation Control of Multi-agent Systems with Coupling Time-varying Delays [J]. Journal of Guangdong University of Technology, 2017, 34(04): 89-96.
[10] Rao Dong-ning, Wen Yuan-li, Wei lai, Wang Ya-li. A Weighted Centrality Algorithm for Social Networks Based on Spark Platform in Different Cultural Environments [J]. Journal of Guangdong University of Technology, 2017, 34(03): 15-20.
[11] WANG Xiao-Tong. An Evaluation of Microblog Users’ Influence Based on PageRank [J]. Journal of Guangdong University of Technology, 2016, 33(03): 49-54.
[12] YANG Chun-Yan, LI Zhi-Ming. Extenics Based Social Network Structure [J]. Journal of Guangdong University of Technology, 2014, 31(1): 1-6.
Viewed
Full text


Abstract

Cited
  Shared   
  Discussed   
No Suggested Reading articles found!
Copyright © 2017 Journal of Guangdong University of Technology
Add：729 East Dongfeng RD., Guangzhou PRC. Postcode: 510090
Tel：020-37626653,020-37626139,020-37626396
Email：xbzrb@gdut.edu.cn
Supported:Beijing Magtech