Iterative shepherding control for agents with heterogeneous responsivity

Ryoto Himo; Masaki Ogura; Naoki Wakamiya; Ryoto Himo; Masaki Ogura; Naoki Wakamiya

doi:10.3934/mbe.2022162

Mathematical Biosciences and Engineering

2022, Volume 19, Issue 4: 3509-3525. doi: 10.3934/mbe.2022162

Previous Article Next Article

Research article Special Issues

Iterative shepherding control for agents with heterogeneous responsivity

Graduate School of Information Science and Technology, Osaka University, 1–5 Yamadaoka, Suita, Osaka 565–0871, Japan

Received: 05 October 2021 Revised: 26 December 2021 Accepted: 17 January 2022 Published: 27 January 2022

In the context of the theory of multi-agent systems, the shepherding problem refers to designing the dynamics of a herding agent, called a sheepdog, so that a given flock of agents, called sheep, is guided into a goal region. Although several effective methodologies and algorithms have been proposed in the last decade for the shepherding problem under various formulations, little research has been directed to the practically important case in which the flock contains sheep agents unresponsive to the sheepdog agent. To fill in this gap, we propose a sheepdog algorithm for guiding unresponsive sheep in this paper. In the algorithm, the sheepdog iteratively applies an existing shepherding algorithm, the farthest-agent targeting algorithm, while dynamically switching its destination. This procedure achieves the incremental growth of a controllable flock, which finally enables the sheepdog to guide the entire flock into the goal region. Furthermore, we illustrate by numerical simulations that the proposed algorithm can outperform the farthest-agent targeting algorithm.
- shepherding,
- heterogeneity,
- farthest-agent targeting,
- multi-agent systems
Citation: Ryoto Himo, Masaki Ogura, Naoki Wakamiya. Iterative shepherding control for agents with heterogeneous responsivity[J]. Mathematical Biosciences and Engineering, 2022, 19(4): 3509-3525. doi: 10.3934/mbe.2022162

Related Papers:

Abstract

In the context of the theory of multi-agent systems, the shepherding problem refers to designing the dynamics of a herding agent, called a sheepdog, so that a given flock of agents, called sheep, is guided into a goal region. Although several effective methodologies and algorithms have been proposed in the last decade for the shepherding problem under various formulations, little research has been directed to the practically important case in which the flock contains sheep agents unresponsive to the sheepdog agent. To fill in this gap, we propose a sheepdog algorithm for guiding unresponsive sheep in this paper. In the algorithm, the sheepdog iteratively applies an existing shepherding algorithm, the farthest-agent targeting algorithm, while dynamically switching its destination. This procedure achieves the incremental growth of a controllable flock, which finally enables the sheepdog to guide the entire flock into the goal region. Furthermore, we illustrate by numerical simulations that the proposed algorithm can outperform the farthest-agent targeting algorithm.

References

[1]	T. Samad, A. M. Annaswamy, The Impact of Control Technology, IEEE Control Systems Society, 2011.
[2]	A. Sciarretta, L. Guzzella, Control of hybrid electric vehicles, IEEE Control Systems, 27 (2007), 60–70. https://doi.org/10.1109/MCS.2007.338280 doi: 10.1109/MCS.2007.338280
[3]	k B. Bequette, Process Control: Modeling, Design, and Simulation, Pearson, 2002.
[4]	Z. Wang, Q. Zhang, X. Li, Markovian switching for near-optimal control of a stochastic SIV epidemic model, Math. Biosci. Eng., 16 (2019), 1348–1375. https://doi.org/10.3934/mbe.2019066 doi: 10.3934/mbe.2019066
[5]	Z. Shi, H. Cheng, Y. Liu, Y. Wang, Optimization of an integrated feedback control for a pest management predator-prey model, Math. Biosci. Eng., 16 (2019), 7963–7981. https://doi.org/10.3934/mbe.2019401 doi: 10.3934/mbe.2019401
[6]	B. B. Erdene, O. E. Mandakh, Shepherding algorithm of multi-mobile robot system, in 2017 First IEEE International Conference on Robotic Computing, (2017), 358–361. https://doi.org/10.1109/IRC.2017.51
[7]	A. Garrell, A. Sanfeliu, F. Moreno-Noguer, Discrete time motion model for guiding people in urban areas using multiple robots, in 2009 IEEE/RSJ International Conference on Intelligent Robots and Systems, (2009), 486–491. https://doi.org/10.1109/IROS.2009.5354740
[8]	C. Vo, J. F. Harrison, J. M. Lien, Behavior-based motion planning for group control, in 2009 IEEE/RSJ International Conference on Intelligent Robots and Systems, (2009), 3768–3773.
[9]	S. Gade, A. A. Paranjape, S. J. Chung, Herding a flock of birds approaching an airport using an unmanned aerial vehicle, in AIAA Guidance, Navigation, and Control Conference, (2015), 1540. https://doi.org/10.2514/6.2015-1540
[10]	E. M. H. Zahugi, M. M. Shanta, T. V. Prasad, Oil spill cleaning up using swarm of robots, in Advances in Computing and Information Technology (eds. N. Meghanathan, D. Nagamalai, N. Chaki), Springer, (2013), 215–224. https://doi.org/10.1007/978-3-642-31600-5_22
[11]	F. L. Lewis, H. Zhang, K. Hengster-Movric, A. Das, Cooperative Control of Multi-Agent Systems, Springer, 2014. https://doi.org/10.1007/978-1-4471-5574-4
[12]	A. Belhadi, Y. Djenouri, G. Srivastava, J. C. W. Lin, Reinforcement learning multi-agent system for faults diagnosis of mircoservices in industrial settings, Computer Communications, 177 (2021), 213–219. https://doi.org/10.1016/j.comcom.2021.07.010 doi: 10.1016/j.comcom.2021.07.010
[13]	N. K. Long, K. Sammut, D. Sgarioto, M. Garratt, H. A. Abbass, A comprehensive review of shepherding as a bio-Inspired swarm-robotics guidance approach, IEEE Trans. Emerg. Top. Comput. Intel., 4 (2020), 523–537. https://doi.org/10.1109/TETCI.2020.2992778 doi: 10.1109/TETCI.2020.2992778
[14]	G. M. Werner, M. G. Dyer, Evolution of herding behavior in artificial animals, in Second International Conference on From Animals to Animats 2: Simulation of Adaptive Behavior, (1993), 393–399.
[15]	A. C. Schultz, J. J. Grefenstette, W. Adams, Robo-shepherd: Learning complex robotic behaviors, in International Symposium on Robotics and Automation, (1996), 763–768.
[16]	R. Pfeifer, B. Blumberg, J. A. Meyer, S. W. Wilson, Robot Sheepdog Project achieves automatic flock control, in Fifth International Conference on Simulation of Adaptive Behavior, (1998), 489–493.
[17]	D. Strömbom, R. P. Mann, A. M. Wilson, S. Hailes, A. J. Morton, D. J. T. Sumpter, et al., Solving the shepherding problem: heuristics for herding autonomous, interacting agents, J. R. Soc. Interface, 11 (2014), 20140719. https://doi.org/10.1098/rsif.2014.0719 doi: 10.1098/rsif.2014.0719
[18]	Y. Tsunoda, Y. Sueoka, Y. Sato, K. Osuka, Analysis of local-camera-based shepherding navigation, Adv. Robotics, 32 (2018), 1217–1228. https://doi.org/10.1080/01691864.2018.1539410 doi: 10.1080/01691864.2018.1539410
[19]	K. J. Yaxley, K. F. Joiner, H. Abbass, Drone approach parameters leading to lower stress sheep flocking and movement: sky shepherding, Sci. Rep., 11 (2021), 7803. https://doi.org/10.1038/s41598-021-87453-y doi: 10.1038/s41598-021-87453-y
[20]	H. E. Fiqi, B. Campbell, S. Elsayed, A. Perry, H. K. Singh, R. Hunjet, et al., A preliminary study towards an improved shepherding model, in Proceedings of the 2020 Genetic and Evolutionary Computation Conference Companion, USA, (2020), 75–76. https://doi.org/10.1145/3377929.3390067
[21]	E. O. Rivas, A. Rodriguez-Liñan, L. Torres-Treviño, Flock of robots with self-cooperation for prey-predator task, J. Intell. Robotic Syst. Theory Appl., 101 (2021), 39. https://doi.org/10.1007/s10846-020-01283-0 doi: 10.1007/s10846-020-01283-0
[22]	H. Song, A. Varava, O. Kravchenko, D. Kragic, M. Y. Wang, F. T. Pokorny, et al., Herding by caging: a formation-based motion planning framework for guiding mobile agents, Auton. Robot., 45 (2021), 613–631. https://doi.org/10.1007/s10514-021-09975-8 doi: 10.1007/s10514-021-09975-8
[23]	D. Ko, E. Zuazua, Asymptotic behavior and control of a guidance by repulsion model, Math. Mod. Meth. Appl. Sci., 30 (2020), 765–804. https://doi.org/10.1142/S0218202520400047 doi: 10.1142/S0218202520400047
[24]	T. Nguyen, J. Liu, H. Nguyen, K. Kasmarik, S. Anavatti, M. Garratt, et al., Perceptron-learning for scalable and transparent dynamic formation in swarm-on-swarm shepherding, in Proceedings of the International Joint Conference on Neural Networks, (2020), 1–8.
[25]	R. Goel, J. Lewis, M. Goodrich, P. Sujit, Leader and predator based swarm steering for multiple tasks, in 2019 IEEE International Conference on Systems, Man and Cybernetics, (2019), 3791–3798. https://doi.org/10.1109/SMC.2019.8913942
[26]	B. Campbell, H. E. Fiqi, R. Hunjet, H. Abbass, Distributed multi-agent shepherding with consensus, in 12th International Conference on Swarm Intelligence, (2021), 168–181. https://doi.org/10.1007/978-3-030-78811-7_17
[27]	A. Fujita, C. Feliciani, D. Yanagisawa, K. Nishinari, Traffic flow in a crowd of pedestrians walking at different speeds, Phys. Rev. E, 99 (2019), 062307. https://doi.org/10.1103/PhysRevE.99.062307 doi: 10.1103/PhysRevE.99.062307
[28]	M. Scatà, A. Di Stefano, P. Liò, A. La Corte, The impact of heterogeneity and awareness in modeling epidemic spreading on multiplex networks, Sci. Rep., 6 (2016), 37105. https://doi.org/10.1038/srep37105 doi: 10.1038/srep37105
[29]	T. Kamegawa, T. Akiyama, S. Sakai, K. Fujii, K. Une, E. Ou, et al., Development of a separable search-and-rescue robot composed of a mobile robot and a snake robot, Adv. Rob., 34 (2020), 132–139. https://doi.org/10.1080/01691864.2019.1691941 doi: 10.1080/01691864.2019.1691941
[30]	D. Helbing, A. Johansson, H. Z. Al-Abideen, Dynamics of crowd disasters: An empirical study, Phys. Rev. E, 75 (2007), 046109. https://doi.org/10.1103/PhysRevE.75.046109 doi: 10.1103/PhysRevE.75.046109

Reader Comments

Your name:*

Email:*
© 2022 the Author(s), licensee AIMS Press. This is an open access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/4.0)