Source-linked AI summary

Kernel-Based Metrics Learning for Uncertain Opponent Vehicle Trajectory Prediction in Autonomous Racing

Hojin Lee, Youngim Nam, Sanghun Lee, Cheolhyeon Kwon

arXiv:2609.17147v1cs.ROcs.AIcs.LG

TL;DR

Autonomous racing must safely overtake opponents whose trajectories are uncertain because their driving policies are unknown and diverse. The paper learns heterogeneous kernel metrics for DKL from observed interactions to predict probabilistic trajectories and integrate them into EV planning. Experiments report improved prediction accuracy and uncertainty calibration, including for unseen policies.

  • Problem

    Unknown and diverse opponent driving policies make it challenging to predict trajectories for safe overtaking, while existing methods face policy, computation, or data limitations.

    Source: §I · p. 1
  • Method

    The method learns heterogeneous kernel metrics for DKL from EV–OV interactions to align similar policies, predict probabilistic trajectories, and supply their distributions to EV MPC.

    Source: §I · pp. 1–2
  • Results

    The authors report improved prediction accuracy and uncertainty calibration, including lower NLL than DKL for an unseen OV policy.

    Source: §VI · p. 8, D. Ablation study for unseen driving… · p. 8
  • Takeaways & Limitations

    On a 1/10th-scale racecar platform, the integrated prediction and planning framework was validated for safe and agile overtaking against diverse OV policies.

    Source: §I · p. 2, §VI · p. 8

Abstract

from arXiv · show

Autonomous racing confronts significant challenges in safely overtaking Opponent Vehicles (OVs) that exhibit uncertain trajectories, stemming from unknown driving policies. To address these challenges, this study proposes heterogeneous kernel metrics for Deep Kernel Learning (DKL), designed to robustly capture the diverse driving policies of OVs, and carry out precise trajectory predictions along with the associated uncertainties. A key virtue of the proposed kernel metrics lies in their ability to align similar driving policies and disjoin dissimilar ones in an unsupervised manner, given the observed interactions between the Ego Vehicle (EV) and OVs. The efficacy of the proposed method is substantiated through experimental studies on a 1/10th scale racecar platform, demonstrating improved prediction accuracy and thereby safely overtaking against OVs. Furthermore, our method is computationally efficient for onboard computing units, affirming its viability in fast-paced racing environments. The video and source code can be found at https://github.com/HMCL-UNIST/OpponentPredictionWithKMDKL.git.

I. INTRODUCTION

Safely overtaking requires predicting opponent vehicles’ (OVs’) trajectories despite diverse, often unknown driving policies. The paper learns policy-aware probabilistic predictions from ego–opponent interactions and integrates their distributions into planning; experiments on a 1/10th-scale racecar demonstrate effectiveness against existing algorithms.

  • Diverse OV policies challenge existing predictors: physics-based methods struggle with long-term interactions, planning-based methods are computationally intensive, and learning-based methods face data scarcity and policy mismatch.Source: §I · p. 1
  • The proposed DKL model uses heterogeneous kernel metrics to align similar driving policies and separate dissimilar ones across latent-policy and predicted-state spaces.The alignment is learned from observed EV–OV interactions in an unsupervised manner.Source: §I · pp. 1–2
  • The model predicts probabilistic OV trajectories, whose distributions are integrated into EV MPC as dynamic-obstacle constraints for safe and agile overtaking.One-step predictions are recursively sampled to construct multi-step distributions.Source: §I · p. 2
  • Experiments with a 1/10th-scale racecar demonstrate the algorithm’s effectiveness quantitatively and qualitatively against existing algorithms.Source: §I · p. 2

II. RELATED WORK

The related work describes limitations of physics-, planning-, and learning-based trajectory prediction, then introduces vehicle dynamics and the EV’s racing-planning formulation. The EV plans over a horizon while accounting for predicted OV distributions as dynamic obstacles.

A. Physics and planning-based trajectory predictions

  • Physics-based predictors struggle with long-term forecasting when they do not account for EV–OV interactions; planning-based predictors rely on assumed OV objectives and can be computationally demanding.Source: A. Physics and planning-based… · p. 2

B. Learning-based trajectory prediction

  • Learning-based prediction can generalize poorly in racing because datasets are limited or imbalanced, OV policies vary, and encountered policies may differ from training data.Distance metrics influence representations, but selecting an optimal similarity metric remains unresolved.Source: B. Learning-based trajectory prediction · p. 2

C. Trajectory prediction with uncertainty

  • Gaussian processes quantify prediction uncertainty, but stationary kernels can calibrate poorly for non-stationary processes; DKL maps inputs to latent features, though learning complex kernels remains challenging.Source: C. Trajectory prediction with… · p. 2

A. Vehicle dynamics

  • The racing vehicles use a dynamic bicycle model with a six-component state for Cartesian position, heading, longitudinal and lateral velocity, and yaw rate.The model is discretized with fourth-order Runge–Kutta, and vehicle pose is also expressed in track-relative Frenet coordinates.Source: A. Vehicle dynamics · p. 3

B. EV trajectory planning problem for racing

  • The EV’s MPCC plans over a finite horizon, maximizes race progress while penalizing centerline deviation and control variation, and incorporates the predicted OV trajectory into dynamic-obstacle constraints.The OV safety ellipse scales with predicted-state variance to represent uncertainty in collision avoidance.Source: B. EV trajectory planning problem for… · p. 3

C. GP and DKL for OV trajectory prediction

The paper uses Gaussian process regression (GPR) to predict OV states from EV–OV interactions. Deep Kernel Learning (DKL) applies a neural transformation before the kernel, while learning that transformation for diverse policies remains challenging.

  • GPR models OV trajectory prediction from EV–OV interaction patterns as non-parametric Bayesian regression with a GP mean and covariance function.Its posterior distribution provides a mean and covariance calculated from training data.Source: C. GP and DKL for OV trajectory… · p. 3
  • The adopted Matérn kernel is stationary and may not capture complex trajectories from diverse OV policies; DKL instead applies the stationary kernel after a nonlinear input transformation.Source: C. GP and DKL for OV trajectory… · p. 3
  • Learning the neural feature transformation in DKL without supervision is challenging because EV–OV interactions produce diverse driving policies.Source: C. GP and DKL for OV trajectory… · p. 3

IV. ALGORITHM DEVELOPMENT

The algorithm trains a one-step OV state prediction model with kernel-based metrics learning for DKL, then uses sampling to form a multi-step trajectory distribution for EV planning.

A. Algorithm overview

  • The one-step OV state model uses DKL with kernel metrics to address diverse OV driving policies.Source: A. Algorithm overview · p. 3
  • Fig. 2 depicts model training in panel (a) and an EV racing algorithm that plans from the predicted OV trajectory distribution in panel (b).Source: Figure 2 · p. 4
  • Repeated one-step predictions are sampled to produce a multi-step predicted OV trajectory distribution.Source: A. Algorithm overview · p. 4

B. One-step OV state prediction using DKL

The one-step DKL model encodes past EV–OV interactions, including track context, as a latent driving-policy representation and predicts the OV’s next state probabilistically.

B. One-step OV state prediction using DKL

C. Kernel-based metrics learning for DKL

The proposed DKL training framework aligns latent driving-policy features with output-space similarities, using complementary distance-matching and kernel-sensitivity regularization.

C. Kernel-based metrics learning for DKL

D. Sampling-based multi-step OV trajectory prediction

The multi-step method recursively applies the trained one-step model using sampled OV states and predicted EV states, then summarizes the samples as a trajectory distribution for collision-avoidance planning.

D. Sampling-based multi-step OV trajectory prediction

A. Experiment setup

The experiments use 1/10th-scale racecars with onboard computing and shared state estimates to support real-time control and trajectory prediction.

A. Experiment setup

  • The EV and OV use Jetson AGX Orin and Jetson Orin NX computers, respectively, with control at 20 Hz and multi-step prediction at 10 Hz.Both vehicles run ROS Noetic, exchange state estimates via ROS topics, and use a customized GTSAM-based estimator.Source: A. Experiment setup · p. 6

B. Diverse driving policies of opponent vehicles

The experiments compare passive and aggressive opponent driving policies and evaluate trajectory prediction and overtaking performance in head-to-head races.

B. Diverse driving policies of opponent vehicles

  • Aggressive OVs block by minimizing lateral distance to the EV, whereas passive OVs omit blocking weights and collision-avoidance constraints.The baseline MPCC uses a planning horizon of N = 12 and a sample time of Ts = 0.1 s; EV and OV speed constraints are 1.9 m/s and 1.6 m/s, respectively.Source: B. Diverse driving policies of… · p. 6
  • The training, validation, and test samples are randomly pooled from aggressive and passive interaction datasets without annotations.The prediction model uses an 11-dimensional latent driving policy, 10-step interaction sequences, and 25 trajectory samples.Source: B. Diverse driving policies of… · p. 6

C. Racing results and discussion

  • The comparison includes NMPC (GT), CAV, DNN, GPR, DKL, and KM-DKL, with deterministic CAV and NMPC predictions assigned fixed circular uncertainty boundaries.Twenty races are run per baseline, split evenly between passive and aggressive OV policies.Source: C. Racing results and discussion · pp. 6–7
  • KM-DKL surpasses all baselines in lateral prediction accuracy, while NMPC (GT) achieves the lowest longitudinal mean error.The reported racing statistics are for OVs with diverse driving policies.Source: Table I · p. 7, C. Racing results and discussion · p. 7
  • KM-DKL facilitates agile, safe overtaking without major collisions and meets the 10 Hz real-time requirement despite requiring more computation than the baselines.The paper reports higher collision rates for DKL and DNN than for KM-DKL.Source: C. Racing results and discussion · p. 7

D. Ablation study for unseen driving policy

In races against an unseen cooperative driving policy, KM-DKL has lower prediction NLL than DKL; the study concludes with future directions for adapting and scaling the method.

D. Ablation study for unseen driving policy

  • The unseen cooperative policy is created by reversing the aggressive policy’s blocking weight, encouraging the OV to move away from the EV’s anticipated path.The comparison evaluates DKL and KM-DKL under this out-of-training-distribution policy.Source: D. Ablation study for unseen driving… · pp. 7–8
  • KM-DKL achieves lower NLL than DKL for races against OVs with unseen driving policies.The evaluation uses NLL at the last prediction step, where lower values indicate more accurate uncertainty calibration to unseen data.Source: Figure 7 · p. 8, D. Ablation study for unseen driving… · p. 8

VI. CONCLUSIONS

  • The authors identify online learning from streaming interactions and scaling to full-size vehicles as future work, including perception errors and multi-vehicle interactions.The study reports validation on a 1/10th-scale racecar platform.Source: §VI · p. 8
Loading 2609.17147v1…