Source-linked AI summary

Intent Communication between Autonomous Vehicles and Pedestrians

Milecia Matthews, Girish Chowdhary, Emily Kieson

arXiv:1708.07123v1cs.HCcs.RO

TL;DR

Pedestrians need a way to understand an autonomous vehicle’s intent when no human driver can signal them, and unclear intent can leave both pedestrian and vehicle waiting. This paper develops an ICS using psychological considerations and evaluates it with real-world testing and simulations. The reported experiments associate ICS enablement and prior knowledge with greater trust and shorter interaction times.

  • Problem

    Autonomous vehicles lack the human signals that acknowledge pedestrians, creating a need to communicate vehicle intent and avoid deadlock.

    Source: §I · p. 1
  • Method

    The paper designs an ICS informed by pedestrian psychology and evaluates it through real-world testing and simulations, including a Dec-MDP simulation model.

    Source: §I · p. 1, D. Dec-MDP Definition · p. 7
  • Results

    33 percent and 24 percent higher trust in the golf car were reported for groups with ICS enabled versus groups without it, and those with prior knowledge or ICS enabled had shorter interaction times.

    Source: §V · p. 12
  • Takeaways & Limitations

    Participants with more knowledge of how the ICS worked were more likely to trust the vehicle than those who had not seen the ICS or vehicle.

    Source: §V · p. 12

Abstract

from arXiv · show

When pedestrians encounter vehicles, they typically stop and wait for a signal from the driver to either cross or wait. What happens when the car is autonomous and there isn't a human driver to signal them? This paper seeks to address this issue with an intent communication system (ICS) that acts in place of a human driver. This intent system has been developed to take into account the psychology behind what pedestrians are familiar with and what they expect from machines. The system integrates those expectations into the design of physical systems and mathematical algorithms. The goal of the system is to ensure that communication is simple, yet effective without leaving pedestrians with a sense of distrust in autonomous vehicles. To validate the ICS, two types of experiments have been run: field tests with an autonomous vehicle to determine how humans actually interact with the ICS and simulations to account for multiple potential behaviors.The results from both experiments show that humans react positively and more predictably when the intent of the vehicle is communicated compared to when the intent of the vehicle is unknown. In particular, the results from the simulation specifically showed a 142 percent difference between the pedestrian's trust in the vehicle's actions when the ICS is enabled and the pedestrian has prior knowledge of the vehicle than when the ICS is not enabled and the pedestrian having no prior knowledge of the vehicle.

I. INTRODUCTION

Autonomous vehicles lack the human signals pedestrians use to know they have been acknowledged, raising the challenge of communicating vehicle intent without deadlock. The paper develops and evaluates an intent communication system (ICS), drawing on human-machine interaction research and pedestrian psychology.

I. INTRODUCTION

  • The paper addresses a gap in quantitative experiments analyzing ICS utility in real vehicle-pedestrian interactions.It also examines how pedestrians perceive autonomous vehicles and what they expect from machines.Source: §I · pp. 1–2
  • The paper contributes an ICS designed to diffuse vehicle-pedestrian deadlock, a mathematical model of how vehicle decisions affect pedestrian trust, and evaluation through experiments.The authors describe the evaluation as real-world testing and simulations.Source: §I · pp. 1–2

II. RELATED WORK

  • The authors argue that careful human-feedback evaluation matters for usable intent communication, noting that Google’s patent discussion did not reveal testing, robustness, or cost effectiveness,.They call for further research on pedestrian psychology, receptivity, trust, and safety.Source: §II · p. 2
  • Prior human-machine interaction work reports greater receptivity to robotic instructions when dialogue is present, while this paper adds quantitative trust measurement in pedestrian-vehicle encounters.The paper uses post-surveys to measure perceived effects on trust.Source: §II · p. 2
  • The related work discusses trust modeling with MDP variants, including Dec-MDPs, to account for stochastic human actions,,.This paper uses the Dec-MDP framework for simulations.Source: §II · p. 2
  • Prior approaches include gesture and audio interfaces, but gestures can be difficult for machines to interpret and audio cues depend on context,,,,.The paper presents its approach as combining trust with implicit and explicit communication for people without prior machine interaction.Source: §II · p. 2

III. REAL-WORLD TESTING

The ICS combines vehicle-mounted hardware and software, with its design guided by pedestrian perception and familiar road communication cues. Its messages use simple instructions informed by how people communicate in urgent situations.

A. Intent Communication System Description

  • The ICS combines hardware and software, using strobes to attract attention and an LED word display and speakers to communicate what the golf car wants pedestrians to do.A camera detects pedestrians, and software signals the display, speakers, and lights.Source: A. Intent Communication System… · p. 3
  • The design aims to avoid intimidating pedestrians and accounts for durability, cost, and operation in varied environments.The authors cite concern that more human-like machines can unsettle people.Source: A. Intent Communication System… · p. 3

B. Intent Communication Psychology

  • The authors prioritize how people perceive the ICS, using familiar road cues such as words, flashing lights, and sounds rather than complicated communication.They report that initial user feedback shaped this design consideration.Source: B. Intent Communication Psychology · p. 3
  • Drawing on human dialogue and trust, the ICS uses short instructions such as “please cross” to leave little room for misinterpretation.The authors argue that simple statements can guide action without in-depth conversation.Source: B. Intent Communication Psychology · pp. 3–4

C. Real World Experiment

The real-world experiment compared encounters with the ICS enabled or disabled and with or without participants’ prior knowledge of the system. Researchers used a remotely controlled golf car, surveys, and video to assess participants’ perceptions and interactions.

C. Real World Experiment

  • The golf car was driven manually by transmitter for safety, while participants were unaware of the manual control and the operator could intervene.The authors state this preserved unbiased results regarding perceived autonomy.Source: C. Real World Experiment · p. 4
  • The 26 real-world testing participants were divided among four groups varying ICS enablement and prior knowledge; prior-knowledge participants were introduced to the system before testing.The full study included 76 participants, including 50 in a pre-survey, with nine involved in both sets.Source: C. Real World Experiment · p. 4
  • The study varied whether the ICS was enabled and whether participants had prior knowledge, and none knew whether a human was inside the vehicle.Prior-knowledge participants were shown how the vehicle’s lidar, ICS, and other technology worked.Source: C. Real World Experiment · p. 4
  • Surveys asked whether the car met expectations, whether participants behaved as expected, whether the ICS created trust, and whether participants felt safe and found communication effective.Surveys and interaction video were used to assess perceptions and effects on trust in the vehicle’s decision-making.Source: C. Real World Experiment · p. 4

D. Real World Results

In the real-world tests, groups with the intent communication system (ICS) had higher overall trust than groups without it, while interaction times varied with both ICS and prior knowledge. Participants with the ICS generally appeared more comfortable around the golf car, though responses differed across groups.

D. Real World Results

  • Group 1 had the highest trust ratings before and after testing, and all participants said their behavior matched their expectations.Responses were approximately split on whether the car was trying to work with people or replace humans.Source: 1) Group 1: With ICS and Prior… · pp. 4–5
  • Group 2 found the car’s actions predictable and had relatively high trust, but did not trust it more than a human driver compared with groups without ICS.About 80 percent felt the car was trying to work with people rather than replace them.Source: 2) Group 2: With ICS and no Prior… · p. 5
  • In Group 3, participants had prior knowledge but tested the golf car without ICS; about 60 percent found it completely unpredictable and felt somewhat unsafe, while trust was higher after the experiment.Source: 3) Group 3: Without ICS and Prior… · p. 5
  • Group 4 had the lowest trust before and after testing, and about 80 percent said they behaved differently than expected.Participants also reported feeling unsafe around the car.Source: 4) Group 4: Without ICS and no Prior… · p. 5
  • Groups 1 and 2, both tested with ICS, had higher overall trust than Groups 3 and 4 without ICS.Table I reports post-test survey scores scaled to a maximum of 30 points per group.Source: Table I · p. 5, 4) Group 4: Without ICS and no Prior… · p. 5
  • Interaction times were 0.24 seconds for Group 1, 0.61 for Group 2, 0.39 for Group 3, and 1.01 for Group 4.Groups 1 and 3 had prior knowledge; Groups 2 and 4 did not. Groups 1 and 2 had ICS enabled.Source: 4) Group 4: Without ICS and no Prior… · p. 5, Figure 5

IV. SIMULATION TESTING

The simulation tests used a Dec-MDP model to study pedestrian–vehicle encounters without exposing real participants to safety risks. They modeled a single vehicle and pedestrian, with pedestrian actions informed by surveys and trust updated from post-survey results.

A. Simulation Setup

  • Simulations used the same scenarios as the real-world experiment and included one vehicle and one pedestrian at a time.The paper treats pedestrian groups as one pedestrian because groups typically exhibit group behavior.Source: A. Simulation Setup · pp. 5–6
  • The car’s actions included moving forward, stopping, and turning; pedestrian actions also included waiting, entering the car, and not noticing it.The pedestrian action set was derived from pre-survey responses; “wait” could continue indefinitely, whereas “stop” was temporary.Source: A. Simulation Setup · p. 6
  • Pre-survey responses supplied psychological factors for pedestrian decisions, while post-survey results updated the simulated pedestrian model.The authors chose surveys to represent a broader range of possible actions without testing them by driving the car around people.Source: A. Simulation Setup · p. 6
  • Trust, defined as pedestrian confidence in the vehicle, was the link between the real-world experiments, simulations, and mathematical formulation.The simulation focused on vehicle–pedestrian interaction, while also accounting for independent movement when considering trust.Source: A. Simulation Setup · p. 6

B. Simulation Methodology

The simulation methodology models uncertain pedestrian behavior and changing trust, using survey responses to define plausible actions and their probabilities. The pedestrian survey elicited actions in response to an open-ended driverless-car scenario, then used those responses to inform the model.

B. Simulation Methodology

  • The simulation model was designed to represent stochastic pedestrian actions, changing trust, and the effectiveness of vehicle communication.The survey approach was selected instead of observing reactions by driving the autonomous vehicle because of safety concerns.Source: B. Simulation Methodology · p. 6, C. Pedestrian Surveys · p. 6

C. Pedestrian Surveys

  • Fifty unaffiliated respondents supplied potential pedestrian actions and probabilities for encounters with a golf car that might have no visible operator.The survey aimed to narrow the action set and inform communication-system design.Source: C. Pedestrian Surveys · p. 6
  • Respondents named actions without being shown a list, and the resulting action categories included stopping, waiting, crossing, entering the car, and not noticing it.The survey also asked how respondents would feel and what would make them more comfortable around a driverless car.Source: C. Pedestrian Surveys · p. 6

D. Dec-MDP Definition

The paper uses a Dec-MDP to model vehicle–pedestrian encounters with stochastic pedestrian behavior and observable physical states. The ICS communicates vehicle intent, supporting action prediction and trust modeling while allowing the vehicle to plan over a finite interval.

D. Dec-MDP Definition

  • The model treats pedestrian intent as uncertain and uses a Dec-MDP rather than a POMDP, whose decentralized form is described as computationally intractable.The model assumes both agents can observe each other’s current physical state, although their internal states are not fully known to one another.Source: D. Dec-MDP Definition · pp. 6–7
  • When ICS communicates vehicle intent, the authors propose treating the partially observable interaction as a Dec-MDP because pedestrian actions can then be reasonably predicted.The paper presents this as a way to make the solution implementable on real-world robots.Source: D. Dec-MDP Definition · p. 7
  • The model assumes joint full observability: the agents’ paired observations together determine the current state.The ICS communicates the vehicle’s internal state to the pedestrian, narrowing the pedestrian’s possible actions.Source: D. Dec-MDP Definition · pp. 7, 9
  • The model lets agents move independently and consider one another when they interact, with deterministic vehicle behavior and stochastic pedestrian behavior.The car is assumed controllable, and interactions are modeled over a finite horizon.Source: D. Dec-MDP Definition · pp. 7, 9
  • The simulations track trust over an encounter and allow varied action sets, including potentially unsafe or abnormal pedestrian behavior.The authors describe the model as reducing computational overhead while retaining flexibility for changing scenarios.Source: D. Dec-MDP Definition · pp. 7, 9, 10
  • The trust reward draws on real-world experiment results and weights interaction according to agent actions, transition probabilities, and proximity.Pedestrian transition probabilities use pre-survey action probabilities and post-survey confidence; the proximity range was set to 6 for the gridworld simulations.Source: D. Dec-MDP Definition · pp. 7–9
  • The simulated pedestrian action probabilities were adjusted using survey-derived trust, with higher weights assigned to actions that were initially less likely.The example for ICS with prior knowledge reports an overall trust rating of 27 out of 30 and a 90 percent weighting.Source: D. Dec-MDP Definition · p. 9
  • The finite-interval Dec-MDP lets the vehicle adapt before a pedestrian reaches sensor range, unlike a reactive strategy that may leave too little time to maneuver.The model also updates actions when pedestrian behavior is unexpected and uses proximity to set when the vehicle begins accommodating that behavior.Source: D. Dec-MDP Definition · pp. 9–10

E. Simulation Results

The simulations use a gridworld with one vehicle and one pedestrian, varying pedestrian behavior and trust parameters by scenario. Trust is modeled from real-world post-survey results, while vehicle behavior remains constant.

  • Each scenario uses a gridworld with one vehicle and one pedestrian, with pedestrian trust distance, action probabilities, and likelihood of following vehicle directions adjusted to match the scenario.Source: E. Simulation Results · p. 10
  • Pedestrian action probabilities and following likelihood reflect real-world experiments, while trust is modeled from participant post-survey results and vehicle parameters remain unchanged.Source: E. Simulation Results · p. 10
  • Pedestrians move through the gridworld as particles, moving immediately in the chosen direction rather than turning to face it.Source: E. Simulation Results · p. 10

1) With ICS and Prior Knowledge:

With ICS and prior knowledge, trust fluctuated during interactions and was lower at closer proximity; the pedestrian also took risky actions.

1) With ICS and Prior Knowledge:

2) With ICS and No Prior Knowledge:

With ICS but no prior knowledge, trust dropped when the vehicle began moving, and the pedestrian sometimes took bold actions or failed to notice it.

2) With ICS and No Prior Knowledge:

3) Without ICS and Prior Knowledge:

Without ICS but with prior knowledge, pedestrian trust was inconsistent across vehicle encounters; the scenario retained the one-unit distance used when pedestrians expected vehicle commands.

3) Without ICS and Prior Knowledge:

4) Without ICS and Prior Knowledge:

In the simulations, trust remained negative across scenarios, though its variance and interaction times differed with confidence and prior knowledge. The confidence-level plots compare scenarios at five levels, while the reported results highlight prior knowledge’s relationship to trust and time.

4) Without ICS and Prior Knowledge:

  • As pedestrian confidence increased, trust values showed less variance from baseline; variance was largest with ICS and no prior knowledge and smallest without ICS and with prior knowledge.The plots group four scenarios at confidence levels of 20%, 40%, 60%, 80%, and 99%.Source: 4) Without ICS and Prior Knowledge · p. 11, Figure 9 · p. 11, Figure 10 · p. 11
  • Trust remained negative in every simulated scenario, with trust gains varying across scenarios and trust changing little over 10 iterations.Each scenario averaged 2,000 runs; 10 iterations represented the time for either the vehicle or pedestrian to reach its goal.Source: 4) Without ICS and Prior Knowledge · pp. 10–11
  • Prior knowledge was reported as more important than enabling the ICS, and simulations found that prior knowledge increased trust while prior knowledge or an enabled ICS was associated with shorter interaction times.The simulation’s no-prior-knowledge scenario used a maximum distance of six unit spaces.Source: 4) Without ICS and Prior Knowledge · pp. 10–12

V. CONCLUSION

The authors report that the ICS helped resolve deadlocks and that trust was associated with comfort, prior knowledge, and distance. Experiments and simulations found higher trust with prior exposure or an enabled system, while simulations also showed trust staying negative; the authors identify several areas for further study.

V. CONCLUSION

  • The authors report that experimentation showed the ICS could help resolve potentially dangerous and inefficient deadlock situations by 38 percent.Both real-world testing and simulations evaluated trust when pedestrians encountered an autonomous vehicle.Source: §V · p. 12
  • Trust was associated with comfort around the vehicle, prior knowledge, and vehicle distance; participants more familiar with the ICS were more likely to trust it.The authors describe this as among the first autonomous-vehicle tests to confirm these factors in vehicle-human interaction.Source: §V · p. 12
  • Simulations based on real-world data safely tested riskier behaviors, but trust fluctuated without leaving the negative region.Examples included pedestrians getting into the vehicle or not noticing it.Source: §V · p. 12
  • Groups with prior ICS knowledge had approximately 10% and 6% higher trust than their respective comparison groups, while ICS-enabled groups had 33% and 24% higher trust than groups without ICS.Both real-world experiments and simulations also found shorter interaction times for groups with prior knowledge or an enabled ICS.Source: §V · p. 12
  • In the real-world study, ICS-enabled groups were more likely to trust the vehicle but hesitated slightly before crossing; ICS-disabled groups showed less trust and considerably more hesitation.Participants sometimes viewed the ICS as a threat because they saw it as replacing human drivers.Source: §V · p. 12
  • The authors identify further work on increasing trust, testing multiple pedestrians at once, and studying expectations to inform system design.Source: §V · p. 12
Loading 1708.07123v1…