Collaborative Research: CISE Core Small: RI: Toward Trustworthy and Resilient Intelligence for Multi-Agent System Coordination

University Of California-Riverside, Riverside CA

Investigators

Abstract

In the future, autonomous systems will increasingly rely on large networks of intelligent agents, such as drones, vehicles, robots, and smart infrastructures. These agents will need to work together and coordinate their actions. Achieving trustworthy and resilient coordination among collaborating agents is challenging, particularly when they may malfunction, act in opposition, or vary in capabilities and objectives. This project aims to revolutionize multi-agent systems (MAS) that exhibit resilient, adaptive, and trustworthy behavior by creating intelligent coordination mechanisms capable of maintaining performance and safety even in the presence of uncertainty, failure, or conflict. The expected outcomes of this research will lay the groundwork for building autonomous systems that can be confidently deployed in complex, real-world scenarios. The research will advance foundational knowledge through three key efforts: (1) designing algorithms to detect and mitigate abnormal behaviors in cooperating agents; (2) managing adversarial or non-cooperative agents using game-theoretic and adversarial machine learning methods; and (3) enabling resilient coordination among diverse agents through robust distributed control frameworks. The proposed work will support high-impact applications in transportation, disaster response, and smart infrastructure, where reliable MAS coordination is critical for public safety and operational efficiency. It will inform best practices and ethical guidelines for integrating AI and multi-agent systems into critical infrastructure, ensuring fairness, transparency, and reliability in their deployment, and ultimately foster public trust in AI technologies and contribute to sustainability, safety, and social good. This research will also strengthen research capacity by expanding interdisciplinary collaborations, developing new curricula and workshops, and offering hands-on research opportunities for students from a wide range of backgrounds. This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.