Source-linked AI summary
Correlating sparse sensing for large-scale traffic speed estimation: A Laplacian-enhanced low-rank tensor kriging approach
Tong Nie, Guoyang Qin, Yunpeng Wang, Jian Sun
TL;DR
Sparse and noisy measurements leave traffic speeds incomplete, while transportation applications rely on network-wide speed information. The paper proposes LETC, which combines low-rank tensor completion with graph-Laplacian models of temporal and spatial correlations. It reports state-of-the-art kriging performance at low observation rates and more than half the computing time saved versus baseline methods.
Problem
Sparse sensor coverage and corrupted measurements leave traffic-speed data incomplete, while applications rely on network-wide speeds.
Source: §1 · pp. 1–2Method
LETC combines low-rank tensor completion with graph-Laplacian models of temporal continuity, temporal periodicity, and spatial proximity.
Source: §1 · p. 2, §6 · p. 25Results
LETC achieves state-of-the-art kriging performance even at low observation rates and saves more than half the computing time compared with baseline methods.
Source: §1 · p. 3, §6 · p. 25Takeaways & Limitations
The results provide insights into spatiotemporal traffic-data modeling and network-level kriging.
Source: §1 · p. 3, §6 · p. 25Performance depends on the adjacency matrix, which uses a Gaussian kernel; the distance-based adjacency assumption may not work for trajectory-based speed or traffic volume.
Source: §6 · p. 25
Abstract
from arXiv · showhide
Traffic speed is central to characterizing the fluidity of the road network. Many transportation applications rely on it, such as real-time navigation, dynamic route planning, and congestion management. Rapid advances in sensing and communication techniques make traffic speed detection easier than ever. However, due to sparse deployment of static sensors or low penetration of mobile sensors, speeds detected are incomplete and far from network-wide use. In addition, sensors are prone to error or missing data due to various kinds of reasons, speeds from these sensors can become highly noisy. These drawbacks call for effective techniques to recover credible estimates from the incomplete data. In this work, we first identify the issue as a spatiotemporal kriging problem and propose a Laplacian enhanced low-rank tensor completion (LETC) framework featuring both lowrankness and multi-dimensional correlations for large-scale traffic speed kriging under limited observations. To be specific, three types of speed correlation including temporal continuity, temporal periodicity, and spatial proximity are carefully chosen and simultaneously modeled by three different forms of graph Laplacian, named temporal graph Fourier transform, generalized temporal consistency regularization, and diffusion graph regularization. We then design an efficient solution algorithm via several effective numeric techniques to scale up the proposed model to network-wide kriging. By performing experiments on two public million-level traffic speed datasets, we finally draw the conclusion and find our proposed LETC achieves the state-of-the-art kriging performance even under low observation rates, while at the same time saving more than half computing time compared with baseline methods. Some insights into spatiotemporal traffic data modeling and kriging at the network level are provided as well.
1. Introduction
Sparse, noisy traffic-speed measurements leave many links and time intervals unobserved, limiting network-wide use. The paper frames estimation for undetected links as spatiotemporal kriging and proposes LETC to combine low-rank structure with three speed correlations.
1. Introduction
- Sparse static-sensor coverage, low mobile-sensor penetration, and sensor errors or missing data leave traffic speeds incomplete and potentially noisy.The paper notes that network-wide coverage would require dense static deployments or high mobile-sensor penetration.Source: §1 · p. 1
- Undetected links have no historical speed record, so kriging estimates them from measurements on detected links rather than forecasting their future states.The paper identifies effective use of correlations between undetected and sparsely detected roads as its core research question.Source: §1 · p. 2
- Entirely missing rows or columns remain undetermined under low-rankness alone, motivating additional regularization for traffic-speed kriging.The paper also identifies the need to model temporal and graph-based spatial correlations and to scale kriging to network-level data.Source: §1 · p. 2
- LETC combines low-rank tensor completion with graph-Laplacian models of temporal continuity, temporal periodicity, and spatial proximity for network-wide kriging.The framework uses three forms of graph Laplacian to capture these correlations.Source: §1 · p. 2
- LETC achieves state-of-the-art kriging performance, including at low observation rates, while saving more than half the computing time compared with baseline methods.The experiments use two public million-level traffic speed datasets.Source: §1 · pp. 2–3
2. Related work
Related work spans graph-regularized completion, probabilistic matrix factorization, graph neural networks, and Hankelization. The paper describes trade-offs in scalability, temporal modeling, and the use of spatial information.
2. Related work
- Kriging is framed as spatial prediction without historical data for the target location, distinct from forecasting based on that location’s history.The section reviews approaches to this problem from geostatistics and machine learning.Source: §2 · p. 3
2.1. Graph regularized low-rank matrix and tensor completion based methods
- Graph-regularized completion methods model spatial dependency, but most are developed for other data sources and cannot directly transfer traffic-speed characteristics.Prior transportation work applies graph regularization in space-time or graph spectral domains; Bahadori et al. (2014) proposed tensor learning for spatiotemporal co-kriging.Source: §2.1 · p. 3
2.2. Bayesian/probabilistic matrix factorization based method
- Bayesian kernelized matrix factorization can learn graph-kernel hyperparameters through resampling, but its sampling procedure is time-consuming.The paper characterizes this as a trade-off between scalability and flexibility.Source: §2.2 · p. 3
2.3. Graph neural network based method
- Graph neural kriging methods model spatial dependencies, while methods that add temporal consistency or attention can incur high training costs and may require GPU acceleration.The reviewed methods include K-nearest-neighbor graph convolution, inductive GCNs, and a GCN with external attention and temporal convolution.Source: §2.3 · p. 4
2.4. Multi-way delay embedding (Hankelization) based methods
- Hankelization exploits shift-invariant temporal patterns, but without external spatial information it may produce erroneous kriging results for traffic data.The passage notes that shift-invariant patterns occur in the time dimension but are not distinctive in the space dimension.Source: §2.4 · p. 4
3. Preliminaries and problem definitions
The paper formulates traffic-speed kriging as graph-regularized tensor learning over observations indexed by time and location. Its model combines a tensor-rank penalty with spatial and temporal regularization to estimate missing rows and columns.
3.1. Notation and basic concepts
- Tensor notation distinguishes matrices, vectors, scalars, third-order tensors, slices, and tubal fibers used in the paper’s operations.A tubal fiber fixes the first two tensor indices and varies the third.Source: §3.1 · p. 4
- An invertible linear transform along the tensor’s third dimension enables tensor operations in the transform domain, including the t-product and t-SVD.The transform is applied to each tube fiber; the t-product corresponds to matrix multiplication of transformed frontal slices.Source: §3.1 · p. 5
- Transform-based tensor completion can split into matrix-completion problems for frontal slices, which can be solved in parallel and recombined by inverse transform.The passage illustrates this mechanism with the discrete Fourier transform.Source: §3.1 · p. 5
3.2. Graph-regularized low-rank tensor learning for traffic speed kriging
- Kriging is posed as estimating missing time rows and location columns from observed speeds and temporal and spatial graph information.The observation matrix indexes uniformly spaced time points by locations; tensorization stacks days into a time-of-day × locations × days tensor.Source: §3.2 · pp. 5–6
- The model combines a tensor norm that encourages global low-rankness with spatial and temporal regularizers that encode local side information.The passage says low-rankness alone is insufficient for entirely missing tensor slices, while the regularizers favor a globally low-rank and locally smooth solution.Source: §3.2 · p. 6
4. Methodology
LETC combines tensor completion with temporal graph structure to model day-level periodicity and time-of-day continuity. Its methodology uses TGFT and GTCR to encode these complementary temporal relationships.
4. Methodology
- LETC combines temporal graph Fourier transform (TGFT), generalized temporal consistency regularization (GTCR), and diffusion graph regularization with tensor completion, solved using ADMM, r-tSVT, and conjugate gradient.The integrated model is designed for traffic speed kriging.Source: §4 · p. 6
4.1. Embedding temporal periodicity and low rankness with temporal graph Fourier transform
- TGFT embeds day-to-day and day-of-week periodicity in a graph spectral transform, complementing tensor low-rankness and enabling separate optimization of daily subproblems.When sensor count greatly exceeds the time and day dimensions, TGFT yields K subproblems rather than J under location-mode GFT.Source: §4.1 · pp. 7–8
- The transform-based tensor nuclear norm preserves traffic-data low-rankness while reducing computational cost by computing SVDs on transformed frontal slices.It is motivated as a convex envelope of tensor tubal rank.Source: §4.1 · p. 8
4.2. Modeling time series continuity with generalized temporal consistency regularization
- GTCR imposes smoothness on consecutive time points within a chosen window, capturing temporal dependencies without assuming cyclicity.A larger kernel size gives a longer temporal receptive field.Source: §4.2 · pp. 9–10
4.3. Modeling spatial proximity with diffusion graph regularization
Diffusion graph regularization (DGR) models spatial dependence on directed sensor graphs rather than symmetrizing traffic-flow directions. Its diffusion-based formulation supports graph-aware smoothing and propagation from observed to unobserved nodes.
4.3. Modeling spatial proximity with diffusion graph regularization
- DGR retains directed traffic-flow structure, addressing the information loss that can arise when asymmetric sensor connections are symmetrized.The spatial graph's edges represent traffic-flow direction.Source: §4.3 · p. 10
- DGR can use diffusion functions such as personalized PageRank or heat diffusion to explore high-order and hierarchical graph structure.The paper also discusses manifold-learning and graph-diffusion-equation interpretations of DGR.Source: §4.3 · p. 11
- Repeated diffusion steps with observed values refilled allow data to propagate from measured nodes to unobserved nodes and among unknown nodes.The paper describes this as a bounded heat-diffusion process with finite steps on the graph.Source: §4.3 · p. 12
- DGR uses random-walk diffusion on directed graphs to aggregate neighborhood information and impose local smoothness on node values.The regularization can be interpreted as a low-pass filter that encourages low-frequency graph signals.Source: §4.3 · pp. 10–12
4.4. Low-rank tensor learning with Laplacian enhancement
The model combines low-rank tensor learning with spatial and temporal Laplacian regularization. It keeps day-mode periodic structure implicit in the t-TNN while expressing location and time-of-day Laplacians explicitly.
4.4. Low-rank tensor learning with Laplacian enhancement
- The unified model combines t-TNN low-rank optimization with spatial and temporal regularization.The tensorization operator connects tensor and matrix forms, allowing row and column regularization alongside low-rankness in the graph spectral domain.Source: §4.4 · p. 12
- Location and time-of-day Laplacians appear explicitly, while the day-mode Laplacian remains implicit in the t-TNN.Day-to-day and day-of-week patterns are treated as global features complementary to low-rankness.Source: §4.4 · p. 12
- The day-mode Laplacian preserves traffic periodic structure across locations; applying Laplacian regularization to all three unfoldings could add computation and risk over-smoothing.Source: §4.4 · p. 12
4.5. Scalable solution with ADMM
The scalable solution uses ADMM to separate low-rank tensor and local-consistency updates, then accelerates each subproblem with tailored numerical methods. Randomized SVD supports the X update, while conjugate gradient solves the structured linear system for Z.
4.5. Scalable solution with ADMM
- ADMM alternates updates to the target variables and dual variable, while random projection and subspace iterations accelerate the computational bottlenecks.The added Toeplitz and graph-Laplacian smoothing operators increase computation, motivating the subproblem-specific acceleration.Source: §4.5 · p. 13
4.5.1. Solving X subproblem with random projection
- The X subproblem reduces to independent daily matrix SVT problems in the transformed domain, preserving temporal periodicity and enabling parallel computation.Randomized SVD approximates the partial SVD needed for thresholding, reducing work by applying SVT to a smaller matrix.Source: §4.5.1 · p. 14
4.5.2. Solving Z subproblem with conjugate gradient
- The Z subproblem applies conjugate gradient to a symmetric positive definite structured linear system, approximating its solution in a small number of iterations.The matrix form follows from tensorization, which makes spatial-proximity and temporal-continuity regularization easier to apply.Source: §4.5.2 · p. 15
4.5.3. Solution algorithm
- The complete LETC algorithm alternates X, Z, and dual-variable updates, increasing the penalty parameter and target rank during iteration.Its two subproblems use scalable routines, and the regularization parameters balance t-TNN minimization against the local-consistency penalty.Source: §4.5.3 · p. 16
4.6. Overall computational complexity analysis
The complexity discussion identifies the CG matrix-vector product as LETC's main computational bottleneck, while describing the implementation as efficient for large-scale applications.
4.6. Overall computational complexity analysis
- The CG matrix-vector product is LETC's main computational bottleneck, although the implementation is described as efficient for large-scale applications.Table 1 summarizes Algorithm 2's time complexity; the text identifies t-SVT and CG as the algorithm's main costs.Source: §4.6 · p. 16, Table 1 · p. 17
5. Case study
The case study evaluates LETC for network-wide traffic speed kriging on two large datasets, comparing baseline methods and examining ablations, graph partitioning, and hyper-parameter sensitivity. It also finds that sensitivity to λ1 and λ2 decreases with data scale, suggesting settings tuned on a small subset can transfer to whole-network kriging.
5.1.1. Spatiotemporal traffic speed datasets
- PeMS-4W contains about 90 million observations from 11,160 sensors, while Portland contains about 10 million from 1,057 sensors; both datasets have many locations relative to time-of-day points.Their large location dimensions make them suitable for testing kriging models’ extendability.Source: §5.1.1 · p. 17
5.1.2. Competing models and experiment settings
- Experiments compare LETC with tensor-, matrix-, and machine-learning-based baselines under six combinations of 30%, 50%, or 70% missing locations and 20% or 50% missing time intervals, plus 20% random element-wise missingness.Performance is evaluated using MAE and RMSE; some candidate methods were excluded because their training or sampling costs were unsuitable for large-scale problems.Source: §5.1.2 · pp. 17–18
5.2. Network-wide kriging results analysis and model comparison
- LETC achieves the best kriging results across all test scenarios and state-of-the-art performance across evaluated tasks, with the least computational burden.The authors also report that LETC saves nearly half the running time of WDG-CP, the most scalable baseline, and that holistic modeling outperforms separate imputation and kriging.Source: §5.2 · pp. 18–19, Table 3 · p. 19, Table 4 · p. 19
- LETC captures global traffic-speed distributions and local changes from morning-peak congestion; estimated and true speeds fit well, with over 90% of road segments having residuals below 5.Larger errors occur where neighbor sensors are few or absent and in congestion districts with drastic traffic-speed changes. Estimates are relatively smoother and more denoised than raw data.Source: §5.2 · pp. 19–20
5.3.1. Ablation studies
- Ablations indicate that CG and randomized SVD reduce computational burden without harming precision, while more CG iterations do not improve accuracy; symmetric spatial regularization performs worst.TGFT balances accuracy and efficiency: FFT is faster but less accurate, GFT is worse in precision and time, and SVD transforms are competitive but more costly; SNN is less accurate and more computationally demanding than TNN.Source: Table 5 · p. 22, §5.3.1 · pp. 22–23
5.3.2. Influence of graph partitioning
- LETC and TGMF accuracy both decline as graph partitions increase, with best accuracy without partitioning; LETC is fastest without partitioning, whereas TGMF is slowest in that condition.The authors attribute the accuracy pattern to low-rank completion benefiting from larger data and larger graphs providing more informative spatial neighborhoods.Source: §5.3.2 · pp. 23–24, Figure 11 · p. 23, Figure 12 · p. 23
5.3.3. Sensitivity analysis of hyper-parameter
- The sensitivity analysis varies λ2/λ1 across six values while fixing λ1 at 0.1, testing Portland data at the graph partitions used in the partitioning study.It examines data-scale effects and notes that similar results can be obtained by fixing λ2 and varying λ1.Source: §5.3.3 · p. 24
- As data scale grows, LETC’s hyperparameter sensitivity (IQR) drops sharply, making λ1 and λ2 marginal for whole-network kriging and allowing settings tuned on a small subset to transfer.The authors suggest tuning on a small target-data subset with cross-validation or grid search, then transferring the settings to the whole network.Source: Figure 13 · p. 24, §5.3.3 · p. 24
6. Conclusion and future directions
LETC combines low-rank tensor completion with three graph-Laplacian models of traffic-speed correlations. The authors report state-of-the-art kriging performance at low observation rates, faster computation than baselines, and limitations tied to adjacency construction and the traffic-speed setting.
Conclusion
- LETC models temporal continuity, temporal periodicity, and spatial proximity with GTCR, TGFT, and DGR, respectively.Conjugate gradient and randomized tensor singular value thresholding are used to reduce computational complexity.Source: §6 · p. 25
- LETC achieves state-of-the-art kriging performance even at low observation rates while saving more than half the computing time versus baseline methods.The authors also report more realistic temporal and spatial speed patterns than competing models.Source: §6 · p. 25
Future directions
- The model depends on its adjacency matrix, and distance-based adjacency may not work for trajectory-based speed or traffic volume.The authors identify learning an adaptive adjacency matrix and accurate traffic-volume kriging as directions for further work.Source: §6 · p. 25
Appendix A.
The appendix specifies convergence, regularization, rank, and graph-construction settings for LETC and the baseline models.
Appendix A
- The convergence threshold is 10^-3 for all models; LETC initializes μ at 10^-3, updates it by min{1.5 × μ, 10^4}, and uses cross-validated λ1 = 0.01 and λ2 = 0.1.For PeMS and Portland, τ is set to 1, 2, and 3, with results reported for each.Source: Appendix A · p. 25
- LSTM-GRMF, TGMF, and KPMF use ranks 60 for Portland and 200 for PeMS, while WDG-CP uses ranks 20 and 60, respectively.FMDT-Tucker uses dataset-specific delay parameters and an initial rank of 10.Source: Appendix A · p. 25
- The spatial adjacency matrix uses travel distance for PeMS and coordinate-position distance for Portland, with a symmetric version prepared for baselines.The appendix also specifies graph regularization settings for GLOSS and WDG-CP.Source: Appendix A · p. 25
Appendix B.
Supplementary PeMS kriging results are shown for two time slots.
Appendix B
- The paper provides supplementary figures showing kriging results on PeMS networks for time slots that differ from those presented in Fig. 9, without specifying the particular slots here.Source: Appendix B · p. 25
Appendix C.
The appendix examines sensitivity to the Gaussian-kernel parameter and the randomized-SVD rank initialization. It reports reduced performance fluctuation with fewer graph partitions and recommends a small initial rank followed by larger increments.
Appendix C
- Figure 15 presents sensitivity results for different settings and data scales, with the number above each box indicating its IQR.Source: Figure 15 · p. 26
- Reducing the number of graph partitions drastically decreases the IQR of performance variation across Gaussian-kernel δ settings.The authors conclude that hyper-parameter learning may offer less benefit on large-scale data.Source: Appendix C · pp. 25–26
- For rSVD, rank k mainly affects convergence speed and has minor impact on solving accuracy; the authors recommend a small initial value and large increments.The rank value usually converges when the LETC algorithm converges.Source: Appendix C · p. 26
Appendix D.
Appendix D derives a closed-form solution to problem (25) under a fully observed setting and a symmetric graph assumption. It also presents model performances across different rSVD rank settings.
- The derivation assumes fully observed data and a symmetric graph, with similar conclusions noted for other settings.Source: Appendix D · p. 26
- The rearranged objective includes a trace term involving the graph Laplacian and the transformed variable.Source: Appendix D · p. 26
- Figure 16 presents model performances under different rSVD rank settings.Source: Figure 16 · p. 27
- The next derivation step sets the gradient with respect to the transformed variable to zero.Source: Appendix D · p. 27