Collaborative Research: Robots that Influence Human Behavior across Long-Term Interaction

Virginia Polytechnic Institute And State University, Blacksburg VA

Investigators

Abstract

Whenever robots work next to humans, influence is inevitable. Yet while current approaches can influence humans in the short-term, new approaches are needed to understand and control such influence over the long-term. This work is motivated by the observation that human-robot interaction is bi-directional and evolving: as humans adapt to robots, robot actions that previously influenced the human may no longer have the intended effect once the human learns the robot’s patterns, capabilities, and objectives. Over longer time frames, human/robot interactions may become adversarial, where humans may learn to take advantage of autonomous system behaviors, highlighting an explicit tradeoff between influential actions and transparency. This award supports research that will build new understanding of human cognition and decision-making, resulting not only in new models that capture how people adapt to influential robot behaviors over time, but also in novel control strategies that influence humans towards desired behaviors while maintaining safety and incentives. Overall, this award has the potential to improve societal well-being by improving understanding of human/robot interaction over time and in safety-critical situations. To inspire and train K-12 students for future careers in engineering, the team will host live demonstrations at university open houses where students directly interact with robots that apply our influencing algorithms. To support these impacts, this research introduces a modeling and controls formalism for multi-agent systems that enables robots to influence humans over the long-term. The key insight is that — instead of assuming humans always respond to robot behaviors in the same way — robots should model humans as dynamic, adaptive agents that learn by observing the robot’s actions. In doing so, the researchers explicitly address tradeoffs between transparent behavior and influential actions, mitigating the chance that humans will exploit the autonomous system’s policy and increasing the capability of the robots to maintain the ability to influence agent behavior. Foundational work by this multidisciplinary team of investigators will (i) build theory and mathematical models that explain human/robot adaptation in adversarial settings over the longer-term, (ii) control robots to maintain influence even as the human co-adapts alongside the robot and (iii) formalize an optimization framework to ensure the resulting behaviors are safe in the short-term, and do not have unintended consequences in the long-term. This combination of human modeling with game-theoretic controllers will provide novel, unified insights into how robots can make decisions while accounting for their effects on humans. This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.