•  
  •  
 

Abstract

This article addresses the problem of managing multi-agent robotic systems using artificial intelligence technologies. A hybrid model combining the Vision-Language-Action (VLA) architecture with the Multi-Agent Deep Deterministic Policy Gradient (MADDPG) algorithm is proposed for the synergetic control of a group of robots. The model is built on the Centralized Training with Decentralized Execution (CTDE) principle, with a Social-Force component incorporated into the reward function to automatically maintain a safe distance between agents. Experiments were conducted in the NVIDIA Isaac Sim environment using a dataset of over 10,000 trajectories and scenarios involving 4 to 16 agents. The results show a 90% task success rate, a 0.5% collision probability, and 89% energy efficiency, along with a significant reduction in communication load compared to a rule-based method and standard MADDPG. These findings confirm that integrating VLA models with multi-agent reinforcement learning improves the adaptability, fault tolerance, and collective decision-making capability of robotic swarms, opening prospects for application in agriculture, logistics, and smart-city infrastructure.

First Page

51

Last Page

57

References

1.    Nazarov, Kh.N. (2019). Intellectual multi-coordinate mechatronic module robotic engineering system. Tashkent: Mashkhur-Press, 246 p.

2.    Murphy, R.R. (2019). Introduction to AI Robotics. 2nd ed. Cambridge, MA: MIT Press, 656 p.

3.    Zakirov, A.A. (2021). Principles of synergetic control in multi-agent robotics systems. Science and Technologies, 3, 45–58.

4.    Hernandez-Leal, P., Kartal, B., Taylor, M.E. (2019). A Survey and Critique of Multiagent Deep Reinforcement Learning. Autonomous Agents and Multi-Agent Systems, 33(6), 750–797. https://doi.org/10.1007/s10458-019-09421-1

5.    Siciliano, B., Khatib, O. (Eds.). (2016). Springer Handbook of Robotics. 2nd ed. Berlin: Springer International Publishing, 2227 p. https://doi.org/10.1007/978-3-319-32552-1

6.    Sutton, R.S., Barto, A.G. (2018). Reinforcement Learning: An Introduction. 2nd ed. Cambridge, MA: MIT Press, 552 p.

7.    Goodfellow, I., Bengio, Y., Courville, A. (2016). Deep Learning. Cambridge, MA: MIT Press, 800 p.

8.    Brohan, A., Brown, N., Carbajal, J., et al. (2023). RT-2: Vision-Language-Action Models Transfer Web Knowledge to Robotic Control. arXiv preprint arXiv:2307.15818, 27 p.

9.    Kim, M.J., Pertsch, K., Karamcheti, S., et al. (2024). OpenVLA: An Open-Source Vision-Language-Action Model. arXiv preprint arXiv:2406.09246, 30 p.

10. Stone, P., Veloso, M. (2000). Multiagent Systems: A Survey from a Machine Learning Perspective. Autonomous Robots, 8(3), 345–383. https://doi.org/10.1023/A:1008942012299

11. Zhao, W., Queralta, J.P., Westerlund, T. (2020). Sim-to-Real Transfer in Deep Reinforcement Learning for Robotics: A Survey. 2020 IEEE Symposium Series on Computational Intelligence (SSCI), Canberra, Australia: IEEE, 737–744. https://doi.org/10.1109/SSCI47803.2020.9308468

12. Lowe, R., Wu, Y., Tamar, A., Harb, J., Abbeel, P., Mordatch, I. (2017). Multi-Agent Actor-Critic for Mixed Cooperative-Competitive Environments. Advances in Neural Information Processing Systems (NeurIPS), 30, 6379–6390.

13. Foerster, J., Farquhar, G., Afouras, T., Nardelli, N., Whiteson, S. (2018). Counterfactual Multi-Agent Policy Gradients. Proceedings of the AAAI Conference on Artificial Intelligence, 32(1), 2974–2982.

14. Macenski, S., Foote, T., Gerkey, B., Lalancette, C., Woodall, W. (2022). Robot Operating System 2: Design, Architecture, and Uses in the Wild. Science Robotics, 7(66), eabm6074. https://doi.org/10.1126/scirobotics.abm6074

15. Lillicrap, T.P., Hunt, J.J., Pritzel, A., et al. (2016). Continuous Control with Deep Reinforcement Learning. International Conference on Learning Representations (ICLR), San Juan, 14 p.

16. Helbing, D., Molnár, P. (1995). Social Force Model for Pedestrian Dynamics. Physical Review E, 51(5), 4282–4286. https://doi.org/10.1103/PhysRevE.51.4282

17. NVIDIA Corporation. (2026). Isaac Sim: Robotics Simulation and Synthetic Data Generation [Electronic resource]. Available at: https://developer.nvidia.com/isaac/sim (accessed: 23.06.2026).

18. Schaul, T., Quan, J., Antonoglou, I., Silver, D. (2016). Prioritized Experience Replay. International Conference on Learning Representations (ICLR), San Juan, 21 p.

19. Rabinowitz, N., Perbet, F., Song, F., et al. (2018). Machine Theory of Mind. Proceedings of the 35th International Conference on Machine Learning (ICML), 80, 4218–4227.

20. Queralta, J.P., Taipalmaa, J., Pullinen, B.C., et al. (2020). Collaborative Multi-Robot Search and Rescue: Planning, Coordination, Perception, and Active Vision. IEEE Access, 8, 191617–191643. https://doi.org/10.1109/ACCESS.2020.3030190

21. Brambilla, M., Ferrante, E., Birattari, M., Dorigo, M. (2013). Swarm Robotics: A Review from the Swarm Engineering Perspective. Swarm Intelligence, 7(1), 1–41. https://doi.org/10.1007/s11721-012-0075-2

22. Shi, W., Cao, J., Zhang, Q., Li, Y., Xu, L. (2016). Edge Computing: Vision and Challenges. IEEE Internet of Things Journal, 3(5), 637–646. https://doi.org/10.1109/JIOT.2016.2579198

23. Ferrer, E.C. (2018). The Blockchain: A New Framework for Robotic Swarm Systems. Proceedings of the Future Technologies Conference (FTC). Cham: Springer, 1037–1058. https://doi.org/10.1007/978-3-030-02683-7_77

24. Tabrez, A., Luebbers, M.B., Hayes, B. (2020). A Survey of Mental Modeling Techniques in Human-Robot Teaming. Current Robotics Reports, 1(4), 259–267. https://doi.org/10.1007/s43154-020-00019-0

25. Ahn, M., Brohan, A., Brown, N., et al. (2022). Do As I Can, Not As I Say: Grounding Language in Robotic Affordances. arXiv preprint arXiv:2204.01691, 36 p.

26. Yusupbekov, N.R., Marakhimov, A.R., Igamberdiev, H.Z., Umarov, Sh.X. (2016). An Adaptive Fuzzy-Logic Traffic Control System in Conditions of Saturated Transport Stream. The Scientific World Journal, 2016, Article ID 6719459, 8 p. https://doi.org/10.1155/2016/6719459

27. Hamiyev, A.T. (2026). Control of Multi-Agent Robotic Systems Using AI Technologies: Advancements in Decentralized Learning and Coordination. American Journal of Technology and Applied Sciences, 47, 1–7.

Included in

Engineering Commons

Share

COinS
 
 

To view the content in your browser, please download Adobe Reader or, alternately,
you may Download the file to your hard drive.

NOTE: The latest versions of Adobe Reader do not support viewing PDF files within Firefox on Mac OS and if you are using a modern (Intel) Mac, there is no official plugin for viewing PDF files within the browser window.