AI Chat Paper
Note: Please note that the following content is generated by AMiner AI. SciOpen does not take any responsibility related to this content.
{{lang === 'zh_CN' ? '文章概述' : 'Summary'}}
{{lang === 'en_US' ? '中' : 'Eng'}}
Chat more with AI
Article Link
Collect
Show Outline
Outline
Show full outline
Hide outline
Outline
Show full outline
Hide outline
Full Length Article | Open Access

Distributed dynamic task allocation for unmanned aerial vehicle swarm systems: A networked evolutionary game-theoretic approach

Zhe ZHANGaJu JIANGa( )Haiyan XUbWen-An ZHANGc
College of Automation Engineering, Nanjing University of Aeronautics and Astronautics, Nanjing 211106, China
College of Economics and Management, Nanjing University of Aeronautics and Astronautics, Nanjing 211106, China
College of Information Engineering, Zhejiang University of Technology, Hangzhou 310023, China
Show Author Information

Abstract

Task allocation is a key aspect of Unmanned Aerial Vehicle (UAV) swarm collaborative operations. With an continuous increase of UAVs’ scale and the complexity and uncertainty of tasks, existing methods have poor performance in computing efficiency, robustness, and real-time allocation, and there is a lack of theoretical analysis on the convergence and optimality of the solution. This paper presents a novel intelligent framework for distributed decision-making based on the evolutionary game theory to address task allocation for a UAV swarm system in uncertain scenarios. A task allocation model is designed with the local utility of an individual and the global utility of the system. Then, the paper analytically derives a potential function in the networked evolutionary potential game and proves that the optimal solution of the task allocation problem is a pure strategy Nash equilibrium of a finite strategy game. Additionally, a PayOff-based Time-Variant Log-linear Learning Algorithm (POTVLLA) is proposed, which includes a novel learning strategy based on payoffs for an individual and a time-dependent Boltzmann parameter. The former aims to reduce the system’s computational burden and enhance the individual’s effectiveness, while the latter can ensure that the POTVLLA converges to the optimal Nash equilibrium with a probability of one. Numerical simulation results show that the approach is optimal, robust, scalable, and fast adaptable to environmental changes, even in some realistic situations where some UAVs or tasks are likely to be lost and increased, further validating the effectiveness and superiority of the proposed framework and algorithm.

References

1

Luo C, Li X, Dai QH. Biology’s drones: new and improved. Science 2014;344(6190):1351.

2

Tahir A, Böling J, Haghbayan MH, et al. Swarms of unmanned aerial vehicles—a survey. J Ind Inf Integr 2019;16:100106.

3

Darvishpoor S, Roshanian J, Raissi A, et al. Configurations, flight mechanisms, and applications of unmanned aerial systems: A review. Prog Aerosp Sci 2020;121:100694.

4

Khan MA, Kumar N, Mohsan SAH, et al. Swarm of UAVs for network management in 6G: A technical review. IEEE Trans Netw Serv Manag 2023;20(1):741–61.

5

Tang J, Duan HB, Lao SY. Swarm intelligence algorithms for multiple unmanned aerial vehicles collaboration: A comprehensive review. Artif Intell Rev 2023;56(5):4295–327.

6

Zhao J, Sun JM, Cai ZH, et al. Distributed coordinated control scheme of UAV swarm based on heterogeneous roles. Chin J Aeronaut 2022;35(1):81–97.

7

Li K, Ni W, Wang X, et al. Energy-efficient cooperative relaying for unmanned aerial vehicles. IEEE Trans Mob Comput 2016;15(6):1377–86.

8

Qiu HX, Duan HB. A multi-objective pigeon-inspired optimization approach to UAV distributed flocking among obstacles. Inf Sci 2020;509:515–29.

9

Shang BD, Bentley ES, Liu LJ. UAV swarm-enabled aerial reconfigurable intelligent surface: Modeling, analysis, and optimization. IEEE Trans Commun 2023;71(6):3621–36.

10

Xia ZY, Du J, Wang JJ, et al. Multi-agent reinforcement learning aided intelligent UAV swarm for target tracking. IEEE Trans Veh Technol 2022;71(1):931–45.

11

Zhang J, Xing JH. Cooperative task assignment of multi-UAV system. Chin J Aeronaut 2020;33(11):2825–7.

12

Qu GN, Brown D, Li N. Distributed greedy algorithm for multi-agent task assignment problem with submodular utility functions. Automatica 2019;105:206–15.

13

Lee DH, Zaheer SA, Kim JH. A resource-oriented, decentralized auction algorithm for multirobot task allocation. IEEE Trans Autom Sci Eng 2015;12(4):1469–81.

14

Zhang CY, Li QY, Zhu YY, et al. Dynamics of task allocation based on game theory in multi-agent systems. IEEE Trans Circuits Syst Ⅱ 2019;66(6):1068–72.

15

Martin JG, García RA, Camacho EF. Event-MILP-based task allocation for heterogeneous robotic sensor network for thermosolar plants. J Intell Rob Syst 2021;102(1):1–13.

16

Li TP, Li Y, Qian YL. Improved Hungarian algorithm for assignment problems of serial-parallel systems. J Syst Eng Electron 2016;27(4):858–70.

17

Coutinho WP, do Nascimento RQ, Pessoa AA, et al. A branch-and-bound algorithm for the close-enough traveling salesman problem. Inf J Comput 2016;28(4):752–65.

18

Murugappan E, Subramanian N, Rahman S, et al. Performance analysis of clustering methods for balanced multi-robot task allocations. Int J Prod Res 2022;60(14):4576–91.

19

Shao SK, Peng Y, He CL, et al. Efficient path planning for UAV formation via comprehensively improved particle swarm optimization. ISA Trans 2020;97:415–30.

20

Dorling K, Heinrichs J, Messier GG, et al. Vehicle routing problems for drone delivery. IEEE Trans Syst Man Cybern 2017;47(1):70–85.

21

Wang Z, Liu L, Long T, et al. Multi-UAV reconnaissance task allocation for heterogeneous targets using an opposition-based genetic algorithm with double-chromosome encoding. Chin J Aeronaut 2018;31(2):339–50.

22

Gao GQ, Mei Y, Jia YH, et al. Adaptive coordination ant colony optimization for multipoint dynamic aggregation. IEEE Trans Cybern 2022;52(8):7362–76.

23

Zhang Z, Jiang J, Wu J, et al. Efficient and optimal penetration path planning for stealth unmanned aerial vehicle using minimal radar cross-section tactics and modified A-Star algorithm. ISA Trans 2023;134:42–57.

24

Wei TY, Wang SB, Zhong JH, et al. A review on evolutionary multitask optimization: trends and challenges. IEEE Trans Evol Comput 2022;26(5):941–60.

25

Zhen ZY, Wen LD, Wang BL, et al. Improved contract network protocol algorithm based cooperative target allocation of heterogeneous UAV swarm. Aerosp Sci Technol 2021;119:107054.

26

Bai XS, Fielbaum A, Kronmüller M, et al. Group-based distributed auction algorithms for multi-robot task assignment. IEEE Trans Autom Sci Eng 2023;20(2):1292–303.

27

Schranz M, Di Caro GA, Schmickl T, et al. Swarm Intelligence and cyber-physical systems: Concepts, challenges and future trends. Swarm Evol Comput 2021;60:100762.

28

Duan HB, Zhao JX, Deng YM, et al. Dynamic discrete pigeon-inspired optimization for multi-UAV cooperative search-attack mission planning. IEEE Trans Aerosp Electron Syst 2021;57(1):706–20.

29

Wang ZH, Zhang JL. A task allocation algorithm for a swarm of unmanned aerial vehicles based on bionic wolf pack method. Knowl Based Syst 2022;250:109072.

30

Albert P, Nanjappan M. An efficient kernel FCM and artificial fish swarm optimization-based optimal resource allocation in cloud. J Circuits Syst Comput 2020;29(16):2050253.

31

Wang KP, Li XY, Gao L, et al. A discrete artificial bee colony algorithm for multiobjective disassembly line balancing of end-of-life products. IEEE Trans Cybern 2022;52(8):7415–26.

32

Jang I, Shin HS, Tsourdos A. Anonymous hedonic game for task allocation in a large-scale multiple agent system. IEEE Trans Robot 2018;34(6):1534–48.

33

Chen JX, Wu QH, Xu YH, et al. Joint task assignment and spectrum allocation in heterogeneous UAV communication networks: A coalition formation game-theoretic approach. IEEE Trans Wirel Commun 2021;20(1):440–52.

34

Li P, Duan HB. A potential game approach to multiple UAV cooperative search and surveillance. Aerosp Sci Technol 2017;68:403–15.

35
Chapman AC, Micillo RA, Kota R, et al. Decentralised dynamic task allocation: A practical game: Theoretic approach. Proceedings of The 8th international conference on autonomous agents and multiagent systems 2. New York: ACM; 2009. p. 915–22.
36

Sun CH, Wang XC, Qiu HX, et al. Game theoretic self-organization in multi-satellite distributed task allocation. Aerosp Sci Technol 2021;112:106650.

37

Sun CH, Wang XH, Qiu HX, et al. Toward refined Nash equilibria for the SET K-COVER problem via a memorial mixed-response algorithm. IEEE Trans Syst Man Cybern A Syst 2021;52(4):2313–23.

38

Martin JG, Muros FJ, Maestre JM, et al. Multi-robot task allocation clustering based on game theory. Robot Auton Syst 2023;161:104314.

39

Su Z, Dai MH, Qi QF, et al. Task allocation scheme for cyber physical social systems. IEEE Trans Netw Sci Eng 2020;7(2):832–42.

40

Mayya S, D’antonio DS, Saldaña D, et al. Resilient task allocation in heterogeneous multi-robot systems. IEEE Robot Autom Lett 2021;6(2):1327–34.

41

Notomista G, Mayya S, Emam Y, et al. A resilient and energy-aware task allocation framework for heterogeneous multirobot systems. IEEE Trans Robot 2022;38(1):159–79.

42

Seid AM, Boateng GO, Mareri B, et al. Multi-agent DRL for task offloading and resource allocation in multi-UAV enabled IoT edge network. IEEE Trans Netw Serv Manag 2021;18(4):4531–47.

43

Gong MG, Tang ZD, Li H, et al. Evolutionary multitasking with dynamic resource allocating strategy. IEEE Trans Evol Comput 2019;23(5):858–69.

44

Chai Y, Luo JJ, Wang MM, et al. Receding task allocation method for modular robots during on-orbit assembly. Adv Space Res 2022;70(3):780–91.

45

Hilbe C, Šimsa Š, Chatterjee K, et al. Evolution of cooperation in stochastic games. Nature 2018;559(7713):246–9.

46

Douc R, Moulines E, Priouret P, et al. Markov chains. Switzerland: Springer International Publishing; 2018. p. 385–94.

47

Hajnal J, Bartlett MS. Weak ergodicity in non-homogeneous Markov chains. Math Proc Camb Philos Soc 1958;54(2):233–46.

48

Cox DR, Miller HD. The theory of stochastic processes. Boca Raton: CRC Press; 1977. p. 272–86.

49

Kim MH, Baik H, Lee S. Response threshold model based UAV search planning and task allocation. J Intell Robot Syst 2014;75(3):625–40.

50

Li K, Jiu B, Pu WQ, et al. Neural fictitious self-play for radar antijamming dynamic game with imperfect information. IEEE Trans Aerosp Electron Syst 2022;58(6):5533–47.

51

Blume LE. The statistical mechanics of strategic interaction. Games Econ Behav 1993;5(3):387–424.

52
Tatarenko T. Log-linear learning: Convergence in discrete and continuous strategy potential games. 2014 IEEE conference on decision and control. Piscataway: IEEE Press; 2014. p. 426–32.
53

Namvar Gharehshiran O, Krishnamurthy V, Yin G. Adaptive search algorithms for discrete stochastic optimization: A smooth best-response approach. IEEE Trans Autom Contr 2017;62(1):161–76.

54

Tatarenko T, Shi W, Nedić A. Geometric convergence of gradient play algorithms for distributed Nash equilibrium seeking. IEEE Trans Autom Contr 2021;66(11):5342–53.

55

Marden JR, Arslan G, Shamma JS. Cooperative control and potential games. IEEE Trans Syst Man Cybern B Cybern 2009;39(6):1393–407.

56

Marden JR. State based potential games. Automatica 2012;48(12):3075–88.

57

Marden JR, Shamma JS. Revisiting log-linear learning: Asynchrony, completeness and payoff-based implementation. Games Econ Behav 2012;75(2):788–808.

58

Tatarenko T. Stochastic learning in multi-agent optimization: communication and payoff-based approaches. Automatica 2019;99:1–12.

59

Xin B, Chen J, Peng ZH, et al. An efficient rule-based constructive heuristic to solve dynamic weapon-target assignment problem. IEEE Trans Syst Man Cybern A Syst 2010;41(3):598–606.

60

Wu H, Shang HL. Potential game for dynamic task allocation in multi-agent system. ISA Trans 2020;102:208–20.

61

Tatarenko T. Game-theoretic learning and distributed optimization in memoryless multi-agent systems. Cham: Springer International Publishing; 2017.

62

Sun CH. A time variant log-linear learning approach to the SET K-COVER problem in wireless sensor networks. IEEE Trans Cybern 2018;48(4):1316–25.

63
Tatarenko T. Proving convergence of log-linear learning in potential games. 2014 American control conference. Piscataway: IEEE Press; 2014. p. 972–7.
64

Jiang W, Lyu YX, Li YF, et al. UAV path planning and collision avoidance in 3D environments based on POMPD and improved grey wolf optimizer. Aerosp Sci Technol 2022;121:107314.

65

Wu WN, Xu J, Sun YM. Integrate assignment of multiple heterogeneous unmanned aerial vehicles performing dynamic disaster inspection and validation task with dubins path. IEEE Trans Aerosp Electron Syst 2023;59(4):4018–32.

Chinese Journal of Aeronautics
Pages 182-204
Cite this article:
ZHANG Z, JIANG J, XU H, et al. Distributed dynamic task allocation for unmanned aerial vehicle swarm systems: A networked evolutionary game-theoretic approach. Chinese Journal of Aeronautics, 2024, 37(6): 182-204. https://doi.org/10.1016/j.cja.2023.12.027

93

Views

2

Crossref

1

Web of Science

1

Scopus

Altmetrics

Received: 27 April 2023
Revised: 05 June 2023
Accepted: 14 August 2023
Published: 26 December 2023
© 2023 Chinese Society of Aeronautics and Astronautics.

This is an open access article under the CC BY-NC-ND license (http://creativecommons.org/licenses/by-nc-nd/4.0/).

Return