Source-linked AI summary
Efficient and Trustworthy Social Navigation Via Explicit and Implicit Robot-Human Communication
Yuhang Che, Allison M. Okamura, Dorsa Sadigh
TL;DR
Robot motion alone does not capture every aspect of social interaction, motivating navigation that uses both motion and explicit communication. The paper models human movement and behavior modes in response to robot actions, then plans communicative actions; in a user study, the planner better expressed intent, reduced user effort, and increased trust compared with collision avoidance.
Problem
Robot motion alone does not capture all aspects of social interaction, motivating richer communication schemes for social navigation.
Source: §I · p. 1Method
The paper develops a probabilistic model of human movements and behavior modes under implicit and explicit communication, then uses it to plan robot motion and communication.
Source: §I · p. 2, §IV · p. 4, B. Modeling Behavior Modes of a Human · p. 5Results
In simulation and a user study with a physical robot, the planner better expressed intent, reduced users’ effort, and increased trust compared with collision avoidance with and without a user-prediction model.
Source: §VIII · p. 14Takeaways & Limitations
The user-study results support combining implicit and explicit communication for social navigation in the relatively simple scenario explored.
Source: §VIII · p. 14The evaluation explored only a relatively simple scenario.
Source: §VIII · p. 14
Abstract
from arXiv · showhide
In this paper, we present a planning framework that uses a combination of implicit (robot motion) and explicit (visual/audio/haptic feedback) communication during mobile robot navigation. First, we developed a model that approximates both continuous movements and discrete behavior modes in human navigation, considering the effects of implicit and explicit communication on human decision making. The model approximates the human as an optimal agent, with a reward function obtained through inverse reinforcement learning. Second, a planner uses this model to generate communicative actions that maximize the robot's transparency and efficiency. We implemented the planner on a mobile robot, using a wearable haptic device for explicit communication. In a user study of an indoor human-robot pair of orthogonal crossing situation, the robot was able to actively communicate its intent to users in order to avoid collisions and facilitate efficient trajectories. Results showed that the planner generated plans that were easier to understand, reduced users' effort, and increased users' trust of the robot, compared to simply performing collision avoidance. The key contribution of this work is the integration and analysis of explicit communication (together with implicit communication) for social navigation.
I. INTRODUCTION
Social navigation requires robots to account for people’s reactions and communicate intent, since robot motion alone does not capture every aspect of interaction. This work combines implicit motion cues with explicit signals and develops a planner and human behavior model for that setting.
I. INTRODUCTION
- Robot motion alone cannot capture all social interaction: people may need to resolve conflicts through communication, such as coordinating who passes first.The introduction motivates combining communication with motion for social navigation.Source: §I · p. 1
- Implicit communication is information inferred from context and common ground, while explicit communication deliberately conveys information unambiguously.Source: §I · p. 1
- Robot motion can communicate intent implicitly, and the proposed algorithm aims to produce legible motions that express that intent.The paper relates this notion to legibility.Source: §I · p. 1
- The paper uses haptic feedback for explicit communication because it is immediate and targeted, while noting that the approach can also apply to other explicit signals.Visual and audio signals are among the possible alternatives when their meanings are established beforehand.Source: §I · pp. 1–2
- The work models continuous human movement and discrete behavior modes in response to robot actions, then plans robot motion and haptic communication.It assumes cooperative users, wearable haptic interfaces, and one human interacting with one robot.Source: §I · p. 2
A. Social Navigation
- Reaction-based approaches such as the Social Force Model – and ORCA are computationally efficient but can be less accurate for individual trajectories and omit behavioral stochasticity.Source: A. Social Navigation · p. 2
- Prior probabilistic and inverse-reinforcement-learning approaches model human behavior, while this work jointly models the effects of explicit communication and robot motion.The paper also contrasts its data-efficient, explainable modeling approach with deep-learning methods, whose naturalness and transparency may be unclear and whose training data can be costly,.Source: A. Social Navigation · p. 2
B. Expressive Motion in Robotics
- Earlier expressive-motion work includes legible robot motions, active influence over human behavior, and methods for guiding choices in collaboration,.Here, robot motion is treated as implicit communication because people infer intent from context.Source: B. Expressive Motion in Robotics · pp. 2–3
C. Non-Verbal Explicit Communication Methods
The paper treats deliberately unambiguous signals, including haptic feedback, as explicit communication and robot motion as implicit communication. Its framework plans continuous robot movements and discrete messages together to coordinate a robot-human crossing interaction.
C. Non-Verbal Explicit Communication Methods
- Explicit communication is information conveyed deliberately and unambiguously; non-verbal examples include pointing, head nods, and visual displays.Source: C. Non-Verbal Explicit Communication… · p. 3
- Haptic feedback conveys the robot’s discrete intent during navigation collision avoidance, complementing earlier uses of haptics for trajectory guidance and robot-team status.The paper’s examples include signals to slow down or turn, and feedback about whether a robot team is stable or in transition.Source: C. Non-Verbal Explicit Communication… · p. 3
FOR SOCIALLY-AWARE ROBOT NAVIGATION
- The framework plans a robot’s continuous motion and finite discrete signals, such as an intended left- or right-side pass, for one-human, one-robot coordination.The robot’s movement also serves as implicit communication.Source: FOR SOCIALLY-AWARE ROBOT NAVIGATION · p. 3
- The robot plans motion and communication to maximize expected reward over predicted human-robot trajectories, with efficiency and safety among the encoded properties.The framework uses model predictive control and executes the first action before replanning; explicit communication is restricted to the beginning of each planning horizon.Source: FOR SOCIALLY-AWARE ROBOT NAVIGATION · pp. 3–4
- Because the framework models stochastic human behavior and communication’s influence on actions, the robot can proactively signal intent to reduce the chance of a potential collision.Source: FOR SOCIALLY-AWARE ROBOT NAVIGATION · pp. 3–4
IV. HYBRID MODEL OF HUMAN NAVIGATION
The hybrid human-navigation model represents continuous trajectories alongside discrete behavior modes that reflect intent. It predicts human responses to robot motion and explicit communication, using reward-based behavior models and assumptions to make prediction tractable.
- The model approximates how people react to robot movement and explicit communication because exactly modeling the human trajectory distribution is challenging and may be computationally expensive.Source: §IV · p. 4
- Human navigation is represented by a mixture of continuous trajectories conditioned on discrete behavior modes, with mode probabilities affected by implicit robot motion and explicit communication.Each mode reflects an underlying human intent.Source: §IV · p. 4, Figure 3 · p. 5
- Behavior modes correspond to underlying reward functions rather than requiring each mode to occupy a distinct homotopy class.The model assigns high probability to trajectories consistent with a mode and lower, nonzero probability to other homotopy classes; reward differences can distinguish behaviors such as tailgating versus keeping a safe distance.Source: §IV · p. 4
- To resolve interactive prediction’s infinite regress, the model treats the human as a Stackelberg follower who can access the robot’s future trajectory over a short planning horizon.The environment and goals are assumed known and fixed; the model also assumes behavior modes depend only on past information and that only the most recent explicit communication affects the mode.Source: §IV · pp. 4–5
A. Modeling Continuous Navigation Actions of a Human
The paper models continuous human navigation actions with maximum-entropy inverse reinforcement learning, fitting reward-based action distributions to demonstrations for each discrete behavior mode.
- Maximum-entropy inverse reinforcement learning learns a distribution of human actions that matches provided demonstrations in expectation, assuming people approximately optimize a reward for each behavior mode.Source: A. Modeling Continuous Navigation… · p. 5
- Under the model, an action sequence’s probability is proportional to the exponential of its total reward.Source: A. Modeling Continuous Navigation… · p. 5
- The reward is a weighted combination of navigation features, with mode-specific weights learned by maximizing the likelihood of demonstrations.Features can include distance to other agents, heading, and velocity.Source: A. Modeling Continuous Navigation… · p. 5
B. Modeling Behavior Modes of a Human
The model links inferred robot intent to the human’s behavior-mode probabilities, accounting for both robot motion and explicit communication. Explicit cues initially inform intent inference, but their influence decays over time.
B. Modeling Behavior Modes of a Human
- The model sets the probability of a human behavior mode equal to the human’s belief about the robot’s intent.For example, an 80% belief that the robot will yield maps to an 80% probability of human priority mode.Source: B. Modeling Behavior Modes of a Human · p. 5
- Human intent inference combines robot trajectory and explicit communication, with a factorization that assumes these are conditionally independent.The robot-intent prior is uniform in the implementation.Source: B. Modeling Behavior Modes of a Human · p. 5
- For implicit communication, the human is modeled as expecting the robot to act rationally according to an intent-dependent reward function.The model uses a second-order Taylor series to approximate the integration in the probability calculation.Source: B. Modeling Behavior Modes of a Human · pp. 5–6
- Explicit communication initially makes the robot’s intent highly inferable, but its influence decays as the communicated intent may become outdated.In the binary example, belief in the communicated intent eventually becomes uniform at 0.5.Source: B. Modeling Behavior Modes of a Human · p. 6
V. PLANNING FOR COMMUNICATION
The planning framework optimizes a robot reward composed of efficiency, human comfort, safety, and explicit-communication terms. These terms encode progress toward the robot’s goal, reduced human effort, collision avoidance, and a cost for communicating.
A. Robot Reward Function
- The robot reward combines four objectives: robot efficiency, human comfort, safety, and explicit communication.The components are combined linearly with weights.Source: A. Robot Reward Function · p. 6
- Robot efficiency balances effort against reaching the goal, shaping how quickly the robot approaches it.The efficiency term uses the robot’s position and goal position.Source: A. Robot Reward Function · p. 6
- The human-comfort term favors reducing the effort the human expends to reach her goal.Its weight balances goal-reaching against human effort.Source: A. Robot Reward Function · p. 6
- The safety term rewards avoiding collisions, while each explicit communication action receives a constant reward to account for possible distraction or annoyance.The stated motivation for limiting communication is that too much may distract or annoy the human.Source: A. Robot Reward Function · p. 6
B. Human-Aware Planning
The planner evaluates robot actions against predicted human responses and searches over explicit communication choices. At each time step, it updates the human behavior-mode belief, optimizes candidate plans, and executes the best communication and motion actions.
B. Human-Aware Planning
- The planner predicts the most likely human trajectory for each possible human intent when computing expected robot reward.The human behavior-mode distribution comes from the intent-inference model.Source: B. Human-Aware Planning · pp. 6–7
- For each explicit communication choice, the planner solves a separate optimization, and the candidate optimizations can run in parallel.The choices include no communication.Source: B. Human-Aware Planning · p. 7
- At each time step, the algorithm retrieves current and predicted states, updates the human behavior-mode belief, generates an initial human-state guess, and optimizes candidate actions.It reuses the previous plan as the initial guess when available; otherwise it generates initial guesses from robot and human policies.Source: B. Human-Aware Planning · p. 7
- The selected explicit communication and robot movement are executed, using a six-step planning horizon with 0.5-second time steps in the implementation.The implementation uses gradient-based optimization.Source: B. Human-Aware Planning · p. 7
VI. SIMULATION RESULTS
The simulation-results section describes collecting human demonstrations and conducting a simulation experiment to validate the behavior model and planning framework. The supplied passages outline the validation process but do not report simulation outcomes.
VI. SIMULATION RESULTS
- The authors collected human demonstrations and conducted a simulation experiment to validate the proposed modeling and planning framework.The section covers the experiment scenario, human-model validation, and simulation results.Source: §VI · p. 7
- The planning algorithm’s outlined loop retrieves states, updates the hybrid model, finds optimal actions, and executes them.The algorithm outline labels these as the loop’s four stages.Source: §VI · p. 7
- The algorithm takes a set of explicit communicative actions as input.The outline identifies this set as Uc.Source: §VI · p. 7
A. Social Navigation Scenario
The evaluation centers on an approximately orthogonal human–robot crossing, where they must coordinate who passes first. The model uses behavior-specific rewards and navigation features to represent how humans respond to robot intent.
A. Social Navigation Scenario
- The study uses an approximately orthogonal crossing without the strong right-passing norm of a face-to-face encounter, focusing evaluation on communication.The robot can signal that it will yield priority to the human or keep priority.Source: A. Social Navigation Scenario · p. 7
- The human-navigation features represent velocity, acceleration, goal progress, static-obstacle avoidance, robot collision avoidance, and avoiding the robot’s front side.The front-side feature reflects the observed tendency not to cut in front of the robot, especially when people think it has priority.Source: A. Social Navigation Scenario · pp. 7–8
- The feature visualization indicates that the demonstrated human trajectory avoids low-reward regions and navigates toward high-reward regions.Warm colors denote high reward and cool colors denote low reward; the human path is black and the robot path is red.Source: A. Social Navigation Scenario · p. 8, Figure 5 · p. 8
- The human-priority reward discourages moving directly toward or too close to the human, while the robot-priority reward favors the robot’s desired velocity regardless of the human’s state.The reward is scaled by distance because robot actions convey less information about intent when the robot is far from the user.Source: Rewards for the Behavior Mode Model · p. 8
B. Human Model Evaluation
The authors evaluate learned reward functions and behavior-mode predictions using demonstrations from four users in human-priority and robot-priority crossing scenarios. The model outperforms a social force model in this scenario, while its behavior-mode predictions are assessed through test scenarios because human belief cannot be measured directly.
B. Human Model Evaluation
- Four users each contributed 64 trials per scenario, with 80% of the data used for training and 20% for testing.The scenarios represented human priority and robot priority; users were told the robot’s intent and given a number-memory and arithmetic task.Source: B. Human Model Evaluation · p. 8
- When early predictions choose different sides of an obstacle, they can still be reasonable because either route behind the robot has little effect on reward; predictions improved after two seconds.Once the human begins moving toward one side, the model can use that motion to predict more accurately.Source: B. Human Model Evaluation · p. 9, Figure 6 · p. 9
- The learned-reward model performed better than the social force model in the crossing scenario, with prediction errors improving as humans approached their goals.Initial prediction error was much smaller when the predicted and measured paths began in the same homotopy class; both cases became more accurate over time.Source: B. Human Model Evaluation · p. 9, Figure 6 · p. 9
- Human belief about robot intent could not be measured experimentally, so behavior-mode predictions were assessed for reasonableness in test scenarios.Source: B. Human Model Evaluation · p. 9
- In test scenarios, predicted belief responds to both explicit priority signals and observed robot motion, including rising toward human priority when the robot slows to yield despite signaling robot priority.The authors describe this as matching their intuition about how users infer intent from movement.Source: B. Human Model Evaluation · p. 9
C. Case Study in Simulation
Simulation shows the planner combining robot motion and explicit communication, using the human behavior model to decide when to communicate. Its choices depend on predicted right-of-way and reward priorities.
C. Case Study in Simulation
- The simulated human follows a predefined trajectory regardless of robot actions, so this simulation tests planner behavior rather than realistic human responses.The authors describe this setup as unrealistic and say they will further validate the plan in real-world user studies.Source: C. Case Study in Simulation · pp. 9–10
- When the robot approaches the intersection, predicted human trajectories diverge; with ch ≫ cr, the planner communicates human priority to reduce the chance the user yields.In the illustrated case, the robot slows down and communicates its intent while allowing the user to pass first.Source: C. Case Study in Simulation · p. 10, Figure 8 · p. 10
- Explicit communication is used only in a band of starting positions where it is ambiguous who should pass first; nearer or farther positions prompt predicted right-of-way instead.The planner predicts the user will let the robot pass when the robot starts close to the intersection, and that the user will pass first when it starts too far away.Source: C. Case Study in Simulation · pp. 10–11
- Reward coefficients shape yielding behavior: ch ≫ cr favors yielding to the user, ch ≪ cr produces aggressive behavior, and the tested ratios were 1:5 and 2:1.The 1:5 ratio was the robot-prioritized scenario and 2:1 was the human-prioritized scenario.Source: C. Case Study in Simulation · p. 11
VII. EXPERIMENTAL RESULTS
The section describes a physical-robot user study comparing collision avoidance, implicit communication, and combined implicit and explicit communication. It specifies the setup, measures, and hypotheses; the supplied passages do not report the study outcomes.
A. Experimental Setup
- The physical setup uses a TurtleBot2 with laser-based localization and pedestrian tracking, while a wearable vibration motor signals robot or human priority.Robot priority is encoded as one long vibration and human priority as three short pulses; participants are trained to recognize the cues before the experiment.Source: A. Experimental Setup · p. 11
B. Experimental Design
- The study compares baseline collision avoidance, implicit-only planning, and explicit-plus-implicit planning, measuring passing behavior, path length, and trust.It uses a 3×1 within-subject design with 12 participants; each communication mode has 20 trials, with the first 10 treated as training.Source: B. Experimental Design · pp. 11–12
- The study evaluates three measures across conditions: front-passing percentage, average path length, and reported trust, with significance brackets shown in Fig. 10.The path-length display subtracts a 6.2 m base length for visualization.Source: Figure 10 · p. 12, B. Experimental Design · p. 12
C. Analysis and Results
Across the crossing study, communication-aware planning improved intent understanding, path efficiency, and trust compared with collision avoidance. The authors also identify limits in the behavioral model, computational cost, and the simplicity of the tested scenario.
C. Analysis and Results
- Communication mode significantly affected intent understanding, path length, and trust, with post-hoc differences depending on task priority.Source: C. Analysis and Results · p. 13
D. Effect of Communication
- With implicit + explicit communication, users passed in front 92% of human-priority trials and 9% of robot-priority trials; baseline users were the most confused.Source: D. Effect of Communication · p. 13
- Early robot slowing conveyed yield intent, while varied user strategies made implicit-only behavior less consistent.The planner could omit explicit cues when collision risk was very low because explicit communication carried a negative reward.Source: D. Effect of Communication · pp. 13–14
- Communication planning significantly shortened user paths versus baseline in human-priority combined-mode trials and robot-priority implicit-only or combined-mode trials.Users generally received feedback early in the implicit + explicit mode; implicit-only path-length results were not statistically significant and showed high behavioral variance.Source: D. Effect of Communication · pp. 13–14
- Users trusted the robot most with implicit and explicit communication, but trust evidence was exploratory because the survey measured only overall trust.Source: D. Effect of Communication · p. 14
VIII. CONCLUSION AND FUTURE WORK
- The proposed planner generated proactive communicative actions that expressed robot intent better, reduced users’ effort, and increased trust versus collision avoidance with or without user-motion prediction.Source: §VIII · p. 14
- The authors identify a relatively simple tested scenario, behavioral-model assumptions including a stationary-human case, and computational expense as limitations.Source: §VIII · p. 14