ArticlePDF Available

Vehicle trajectory reconstruction for intersections: an integrated wavelet transform and Savitzky-Golay filter approach

Authors:

Abstract and Figures

Reconstructing vehicle trajectories is an essential step in obtaining high-precision vehicle trajectory data owing to observation errors. Although considerable efforts have been made to reconstruct trajectories on road segments, it is still challenging to reconstruct two-dimensional vehicle trajectories at intersections. In this study, a three-step vehicle trajectory reconstruction method for intersections was proposed to correct abnormal velocities and direction angles in raw trajectories. First, outliers were identified by wavelet transform. They were then filtered out and interpolated using Gaussian kernel-based locally weighted linear regression. Finally, the trajectories were smoothed using a Savitzky-Golay filter. The proposed method was validated using empirical trajectory data collected at 15 intersections in Shanghai, China. The results demonstrate that the proposed trajectory reconstruction method performs well in terms of trajectory rationality and consistency. The mean outlier rate and root mean square error of the reconstructed trajectories are 3% and 0.821 m, respectively.
Content may be subject to copyright.
Full Terms & Conditions of access and use can be found at
https://www.tandfonline.com/action/journalInformation?journalCode=ttra21
Transportmetrica A: Transport Science
ISSN: (Print) (Online) Journal homepage: https://www.tandfonline.com/loi/ttra21
Vehicle trajectory reconstruction for intersections:
an integrated wavelet transform and Savitzky-
Golay filter approach
Jing Zhao, Xiaoliang Yang & Cheng Zhang
To cite this article: Jing Zhao, Xiaoliang Yang & Cheng Zhang (2023): Vehicle trajectory
reconstruction for intersections: an integrated wavelet transform and Savitzky-Golay filter approach,
Transportmetrica A: Transport Science, DOI: 10.1080/23249935.2022.2163207
To link to this article: https://doi.org/10.1080/23249935.2022.2163207
Published online: 04 Jan 2023.
Submit your article to this journal
View related articles
View Crossmark data
TRANSPORTMETRICA A: TRANSPORT SCIENCE
https://doi.org/10.1080/23249935.2022.2163207
Vehicle trajectory reconstruction for intersections: an
integrated wavelet transform and Savitzky-Golay filter
approach
Jing Zhao , Xiaoliang Yang and Cheng Zhang
Department of Traffic Engineering, University of Shanghai for Science and Technology, Shanghai, People’s
Republic of China
ABSTRACT
Reconstructing vehicle trajectories is an essential step in obtaining
high-precision vehicle trajectory data owing to observation errors.
Although considerable efforts have been made to reconstruct tra-
jectories on road segments, it is still challenging to reconstruct
two-dimensional vehicle trajectories at intersections. In this study, a
three-step vehicle trajectory reconstruction method for intersections
was proposed to correct abnormal velocities and direction angles in
raw trajectories. First, outliers were identified by wavelet transform.
They were then filtered out and interpolated using Gaussian kernel-
based locally weighted linear regression. Finally, the trajectories were
smoothed using a Savitzky-Golay filter. The proposed method was
validated using empirical trajectory data collected at 15 intersections
in Shanghai, China. The results demonstrate that the proposed tra-
jectory reconstruction method performs well in terms of trajectory
rationality and consistency. The mean outlier rate and root mean
square error of the reconstructed trajectories are 3% and 0.821 m,
respectively.
ARTICLE HISTORY
Received 3 July 2022
Accepted 22 December 2022
KEYWORDS
Two-dimensional trajectory
reconstruction; wavelet
transform; locally weighted
regression; Savitzky-Golay
filter
1. Introduction
Vehicle trajectories with high spatial and temporal resolutions provide rich data for under-
standing driving behaviour and developing microscopic traffic-flow models. Accurate vehi-
cle trajectories can help reproduce traffic flow evolution and analyse the spatio-temporal
characteristics of urban traffic. It has wide application prospects in traffic accident detection
(Wang, Xu, and Dai 2019;Yangetal.2021;NohandYeo2022), signal control optimisation
(Ma, An, and Lo 2016;Wuetal.2019), traffic state estimation (Chen et al. 2019; Ma and Qian
2020;Tangetal.2020), driving behaviour modelling (Park, Kim, and Yeo 2020; Pan et al.
2021; Zhang et al. 2022), and autonomous vehicle control (Yu et al. 2018; Liu and Fan 2021;
Wu et al. 2022).
There are several methods for obtaining vehicle trajectory data, such as an unmanned
aerial vehicle (UAV) video extraction (Xie et al. 2019; Shi et al. 2021), vehicle-mounted
radar, and global positioning systems (Punzo and Simonelli 2005;Fuetal.2020). Among
CONTACT Cheng Zhang chengzhang@usst.edu.cn
© 2023 Hong Kong Society for Transportation Studies Limited
2J. ZHAO ET AL.
Figure 1. The distribution of the kinetic properties of the trajectory data.
them, with the development of UAV technology and computer technology in vehicle detec-
tion and tracking, UAV traffic data collection technology equipped with a high-resolution
camera has become a popular means of traffic monitoring and data collection due to its
advantages of good flexibility and low cost (Zhang, Jordan, and Livshits 2016;Krajewski
et al. 2018; Barmpounakis and Geroliminis 2020). The locations of all vehicles in each frame
were extracted from the UAV video data, and continuous locations with timestamps from
vehicle trajectories.
However, extracting high-fidelity vehicle trajectories from UAV video is a challenging
task. The UAV video-based vehicle trajectory data usually contain several sources of errors:
(i) instable UAV video camera because of strong wind; (ii) sub-pixel movement of the vehi-
cles (the vehicle movements within the same pixel cannot be detected due to limited
resolutions of videos); and (iii) the jump of the bounding box during vehicle detection and
tracking. Since the time step is small (1/24 s), such error sources cause large errors in calcu-
lating acceleration and curvature with the use of raw vehicle trajectories. As illustrated in
Figure 1, acceleration and curvature distribution demonstrate a large and unrealistic vari-
ance (e.g. the maximum acceleration reaches 300 m/s2). It is thus apparent that the raw
trajectory data from UAV videos contain large errors. The direct use of the raw trajectory
data for deriving the properties of vehicle kinematics and dynamics (e.g. velocity, accelera-
tion, direction angle, and curvature) would lead to unrealistic results and misinterpretation
of traffic dynamics.
Therefore, vehicle trajectory reconstruction in microscopic levels has become a critical
research topic during the last decade. For example, Thiemann, Treiber, and Kesting (2008)
proposed a smoothing kernel based algorithm to deal with the unrealistic situation that
a driver switches between hard acceleration and hard deceleration several times within
one second. Montanino and Punzo (2015) damped out the random noise in the trajectory
by means of traditional low-pass digital filter. Similar efforts to improve trajectory quality
have been made by Zhou, Qu, and Li (2017), Saifuzzaman et al. (2017), Ahn, Vadlamani, and
Laval (2013), Dong et al. (2021), (van Beinum et al. 2018), and Krajewski et al. (2018). Most
TRANSPORTMETRICA A: TRANSPORT SCIENCE 3
of these studies use smoothing methods, including filtering and averaging, as data denois-
ing techniques. Although not the main focus of their studies, different strategies have been
proposed for noise reduction in these papers.
However, the aforementioned studies mainly focused on vehicle following, merging,
overtaking, or lane changing on freeways. Very few studies reconstructed vehicle trajec-
tory data inside intersections. Recently, Venthuruthiyil and Chunchu (2020) proposed a
three-stage trajectory reconstruction framework based on a recursion ensembled low-pass
filter to process the noise in the two-dimensional trajectory of experimental vehicles. An
extended variational solution network was established and Kalman Filtering was applied to
capture and reproduce the stochastic properties of queue boundary curves for signalised
intersections (Chen et al. 2021). Nonetheless, they did not explicitly consider the reconstruc-
tion of two-dimensional direction angles, which are critical to driving behaviours of turning
at intersections.
To address this challenge, a three-step trajectory reconstruction method is proposed
in this study to reduce the noise of vehicle velocity and direction in a two-dimensional
intersection plane. The proposed three-step method includes outlier recognition, data
interpolation, and local smoothing to reconstruct two-dimensional vehicle trajectories at
intersections. Wavelet transforms (WT) and S-G filters are integrated to reduce the noise of
the velocity and direction angle in the raw trajectories. It is worth noting that the proposed
method selects different wavelet bases for each vehicle according to its characteristics
regarding velocity and direction angle, instead of using the same wavelet base as existing
methods did. In addition, the proposed method assigns different smoothing parameters for
acceleration and curvature according to the trajectory rationality of physical kinematics.
The remainder of this paper is organised as follows. Section 2 describes the data sources
used in the study. Section 3introduces the proposed method for reconstructing the vehicle
trajectories at intersections. The effectiveness and reliability of the proposed method are
evaluated in Section 4. The paper is concluded in Section 5.
2. Data source
Raw video data were collected by UAVs at 15 intersections in Shanghai, China, as shown
in Figure 2. The UAV videos had a resolution of 3840 ×2160 pixels and good visibility.
The frame rate of the video was 24 fps. Videos were collected during morning peak hours
(7:00–9:00) and off-peak hours (15:00–17:00) on weekdays in September 2019.
2140 vehicle trajectories in total were extracted from raw video data using a well-
developed video recognition software, in which each vehicle at each frame can be detected
by a bounding box. The centroid of the bounding box is used to represent the detected
vehicle, so that a vehicle is reduced to a pixel and the corresponding X,Y coordinates rep-
resent the vehicle location (Zhang et al. 2022). As shown in Table 1, each vehicle trajectory
data record contains the following information: timestamp, vehicle ID, X coordinate, and Y
coordinate.
3. Methodology
An example of the motion dynamics (velocity, acceleration, and direction angle) of a raw
vehicle trajectory is shown in Figure 3. It was found that there were unreasonable velocities
4J. ZHAO ET AL.
Figure 2. Real-world video images captured by UAVs.
Tab le 1. Extracted information from video.
Attribute Unit Note
Timestamp second 24 frames per second (1/24 s for each time frame)
Vehicle ID / A random ID assigned to the vehicle
X-coordinate pixel The X-coordinate of the centroid of the vehicle
Y-coordinate pixel The Y-coordinate of the centroid of the vehicle
and accelerations in the trajectory data, as well as abnormalities in the direction angle. For
example, the raw velocity suddenly increases and then decreases, as illustrated by the red
circles in Figure 3(b). The raw direction angle and acceleration also exhibited significant
fluctuations and abnormal ranges.
To improve the quality of trajectory data, in this study, we propose a three-step trajectory
reconstruction framework in the two-dimensional plane of intersections that are influenced
by both the velocity magnitude and direction, as shown in Figure 4. The steps are described
in the following sub-sections.
TRANSPORTMETRICA A: TRANSPORT SCIENCE 5
Figure 3. Example of raw vehicle trajectory.
3.1. Step1: identication of outliers using dierent wavelet transforms
In Step 1, the WT is used to identify abnormal data that does not conform to the physical lim-
its of the trajectory data. Considering that the driving characteristics of the raw trajectory
will be lost if filtering or smoothing techniques are directly applied to the raw trajectory,
this step can ensure that the subsequent filtering steps are not influenced by outliers. In
recent years, much research has been conducted on local identification and correction
mechanisms for noise. Generally, low-pass filters based on Fourier transform are applied
to eliminate high and medium-frequency noise. However, the Fourier transform only pro-
vides information related to the frequency of the trajectory and not the position properties.
In other words, although these methods provide accessibility to frequency information,
they do not control the temporal propagation of the signal (Fard, Mohaymany, and Shahri
2017). This may lead to inefficient noise filtering and unsuitable vehicle trajectory recon-
structions. To overcome this limitation, the WT was used in this study to identify trajectory
outliers.
3.1.1. Construction of wavelet transform
WT enables the multiscale decomposition of signals (in this study, velocity or direction
angle profiles) (Fard, Mohaymany, and Shahri 2017). Such a multi-scale feature of the WT
6J. ZHAO ET AL.
Figure 4. Flowchart of trajectory reconstruction method.
TRANSPORTMETRICA A: TRANSPORT SCIENCE 7
allows the decomposition of a signal into multiple scales, with each scale representing a
particular coarseness of the signal under study. At any level, the signal was decomposed
into approximation and detailed components. The approximation component is further
decomposed into approximation and detail components and this process goes on to level j.
Trajectory longitudinal velocity v(t)and direction angle θ(t)can be described by Equations
(1) and (2), respectively.
v(t)=vAj(t)+
jJ
vDj(t);(1)
θ(t)=θAj(t)+
jJ
θDj(t);(2)
where v(t)represents the longitudinal velocity at time t (in m/s); Jis the number of levels of
discrete wavelet; vAj(t)and vDj (t)are the approximation and detail components at level j,
which can be determined by Equations (3) and (4), respectively; θ(t)represents the direction
angle at time t(in rad); θAj(t)andθDj (t)are the approximation and detail components at level
j, which can be determined by Equations (5) and (6), respectively.
vAj(t)=
kZ
cvjkϕvjk (t)(3)
vDj(t)=
kZ
dvjkψvjk (t)(4)
θAj(t)=
kZ
cθjkϕθjk (t)(5)
θDj(t)=
kZ
dθjkψθjk (t)(6)
where cvjk denotes the wavelet coefficient of the approximation component, which is
obtained through the dot product of signal v(t)and scale function ϕvjk at j-th level with
translation equal to k, as shown in Equation (7); dvjk is the wavelet coefficient of the detail
component, which is the dot product of signal v(t)and wavelet function ψvjk at j-th level
with translation equal to k, as shown in Equation (8); cθjk denotes the wavelet coefficient
of the approximation component, which is obtained through the dot product of signal
θ(t)and scale function ϕθjk at j-th level with translation equal to k, as shown in Equation (9);
dθjk is the wavelet coefficient of the detail component, which is the dot product of signal
θ(t)and wavelet function ψθjk at j-th level with translation equal to k, as shown in Equation
(10).
cvjk =(v(t),ϕvjk(t)) (7)
dvjk =(v(t),ψvjk(t)) (8)
cθjk =(t),ϕθjk(t)) (9)
dθjk =(t),ψθjk(t)) (10)
To determine the exact location of the wavelet coefficients with highly concentrated sig-
nal energy, the wavelet coefficient of the detail component was compared with a threshold
8J. ZHAO ET AL.
Sz
j. In this study, Sz
jis defined according to Equation (11).
Sz
j=μj±z×σj(11)
where μjand σjare the mean and standard deviation, respectively, of the wavelet coeffi-
cients at level j;zvalue is 1.96 for 95% of the level of confidence (Fard, Mohaymany, and
Shahri 2017).
3.1.2. Selection of wavelet base
The effect of the wavelet transform depends mainly on the choice of wavelet base. There-
fore, for the studied vehicle trajectory signal, an appropriate wavelet transform should
effectively filter out abnormal data from the trajectory and reconstruct trajectory data with
good velocity and acceleration indicators. Since the error patterns for each vehicle in the
longitudinal and lateral directions are different (Venthuruthiyil and Chunchu 2020), the pro-
posed method selects different wavelet bases for each vehicle. From the perspective of
wavelet characteristics, the commonly used methods for selecting an appropriate wavelet
base include maximum energy and minimum entropy criteria, similarity-based criteria, and
their combination (Mallat 1989).
The general characteristics of the signal wave and the physical meaning of the vehicle
trajectory were combined to select the wavelet base. For wavelet base selection for velocity,
we used “the ratio of energy to Shannon entropy and acceleration range” as the criteria. For
wavelet base selection for direction angle, we used “the ratio of energy to Shannon entropy
and curvature range” as the criteria.
The higher the ratio of energy to Shannon entropy the better, which can be calculated
using Equation (12) (Mallat 1989).
radio(j)=E(j)
Sentropy(j)(12)
where radio(j)represents the ratio of energy to Shannon entropy at the j-th level decom-
position; E(j)represents the energy at the j-th level decomposition, which is determined by
Equation (13); Sentropy(j)represents Shannon entropy at the j-th level decomposition, which
is determined by Equation (14).
E(j)=
K
k=1
|wt(j,k)|2(13)
where, wt(j,k)represents the k-th wavelet coefficient of level j;Kis the total number of
wavelet coefficients.
Sentropy(j)=−
K
k=1
pklog2(pk)(14)
where pkrepresents energy distribution of wavelet coefficient, defined as pk=|wt(j,k)|2
E(j).
For the acceleration range, it has been reported that vehicle accelerations are in the
rangeof–5to5m/s
2and curvature is used as a measure of steering stability and safety
(Bichiou and Rakha 2018).
TRANSPORTMETRICA A: TRANSPORT SCIENCE 9
Tab le 2. The wavelet bases selection for vehicle No. 1105 to identify
outliers (a) velocities and (b) direction angles.
(a)
Wavelet Ratio of energy to Shannon entropy Acceleration range (m/s2)
Haar 13.69 [4.87, 3.87]
Db2 12.72 [5.13, 4.11]
Db4 11.74 [11.02, 36.98]
Db6 11.19 [51.02, 68.22]
Sym2 12.71 [6.52, 6.45]
Sym4 12.64 [7.63, 7.95]
Sym6 12.46 [7.56, 8.34]
Coif1 12.33 [7.33, 10.91]
Coif3 12.02 [8.21, 11.96]
Coif5 12.00 [14.30, 20.96]
Bior1.3 11.86 [50.22, 124.68]
Bior2.8 11.43 [33.09, 50.53]
Bior3.1 11.64 [25.21, 28.28]
(b)
Wavelet Ratio of energy to Shannon entropy Curvature range (m1)
Haar 364.17 [1.07, 1.08]
Db2 333.90 [0.99, 1.60]
Db4 354.31 [0.11, 0.58]
Db6 430.14 [0.08, 0.21]
Sym2 333.90 [0.99, 1.60]
Sym4 365.77 [0.09, 0.56]
Sym6 359.20 [0.08, 0.51]
Coif1 360.86 [0.24, 0.66]
Coif3 483.76 [0.08, 0.23]
Coif5 441.12 [0.17, 0.33]
Bior1.3 343.98 [1.06, 9.51]
Bior2.8 535.66 [0.07, 0.19]
Bior3.1 474.94 [0.88, 1.44]
The curvature of the vehicle path is bounded by the minimum turning radius. Accord-
ing to the road design code (MOHURD 2012), the minimum turning radius is 5 m, and the
corresponding curvature range standard ranges from 0.2 to 0.2 m1.
The following five wavelet bases were considered: Haar, Daubechies (db), Symlets (Sym),
Coiflets (Coif), and Biorthogonal (Bior) wavelets. The velocity and direction angle curves
were reconstructed after first-level decomposition and zeroing of the high-frequency com-
ponents. The results of vehicle No.1105, including the ratio of energy to Shannon entropy
and the acceleration/curvature range, are shown in Table 2.
As shown in Table 2(a), the Haar wavelet was selected as the velocity wavelet bases for
vehicle No.1105, that is, the maximum ratio of energy to Shannon entropy and the most
appropriate acceleration range. As shown in Table 2(b), the best results were obtained by
applying the Bior2.8 wavelet, that is, the maximum ratio of energy to Shannon entropy and
the minimum range of curvature.
The selection of velocity and direction angle wavelet bases of all vehicles are shown
in Figure 5. Different vehicle trajectories select different wavelet bases to obtain optimal
identification of outliers in velocity and direction angle curves.
10 J. ZHAO ET AL.
Figure 5. Distributions of wavelet bases selections for all 2140 vehicles.
3.1.3. Results of identification
Figure 6shows the velocity and direction angle of a trajectory processed by the WT. Outliers
in the velocity and direction angle signals can be identified, as shown in Figure 6(a) and 6(b)
based on the WT analysis of the signal detail coefficients in Figure 6(c) and 6(d).
3.2. Step2: data interpolation using locally weighted regression
In Step 2, a Gaussian kernel-based locally weighted regression (LWR) was used to interpo-
late the removed outliers. After identifying outliers through WT, the missing values of the
trajectory data after removing the outliers must be interpolated to facilitate subsequent fil-
tering and smoothing. In this study, the fitted values of the missing points were obtained
using LWR fitting, which is a non-parametric regression technique that fits simple regres-
sion models to local velocities or direction angles. Samples near the predicted sample were
assigned more weights for regression fitting. This method performs better in fitting more
complex and variable data than the traditional linear and polynomial regressions.
TRANSPORTMETRICA A: TRANSPORT SCIENCE 11
Figure 6. Example of outliers identification results using WT.
3.2.1. Locally weighted regression
The general form of LWR is defined in Equation (15). The LWR model must tune two param-
eters: the neighbourhood weights and the number of polynomial functions (Venthuruthiyil
and Chunchu 2018). The weights were generated from the kernel function shown in Section
3.2.2.
f(x0,ψ) =
k
i=1
ixi)d(15)
where kis the number of nearest neighbours; ψis the weight vector; ψiis the weight
assigned to each nearest instance which can be obtained from the kernel function K(xi,x0);
xiis the velocity or direction angle of the i-th locus point; x0is the velocity or direction angle
to be fitted; dis the degree of the polynomial, which influences the bias-variance trade-off.
The lower degree polynomials do not always fit the data well. On the other hand, the higher
degree polynomials follow the data more closely but often fit poorly at the extremes points.
During training, the weights of the training examples were updated (ψ) using Equation
(16).
ψ=
n
i=1
L(yi,f(x0,ψ))K(xi,x0)(16)
where L(yi,f(x0,ψ)) =(yixT
iψ)2is the square loss function; yiis the actual output of the
velocity of the direction angle value of the i-th locus point; K(xi,x0)is the kernel function.
12 J. ZHAO ET AL.
Figure 7. Example of data interpolation results using locally weighted regression.
3.2.2. Selection of kernel
As described in the previous section, LWR methods require kernel smoothing functions to
generate the most appropriate weights for neighbouring points of the target data point.
The most used kernel is the Gaussian kernel (radial basis function). Its basic form is given by
Equation (17).
K(xi,x0)=exp ||xix0||2
2h2(17)
whereKis a diagonal weight matrix and the value of K(xi,x0)represents the weight of the
i-th velocity or direction angle when fitting the predicted velocity or direction angle; his
the bandwidth of the Gaussian kernel. By adjusting the value of h, the function can be
adjusted to make it more suitable for this method. It is used to control the “local range”
of local weighting. Overfitting will occur if his too small.
According to the study of Alqasrawi, Azzeh, and Elsheikh (2022), LWR polynomial degree
d=3 (in Equation 15) and kernel bandwidth h=0.2 (in Equation 17) are suggested for
most kernels. This set of recommended values is adopted in this study to interpolate using
locally weighted regression.
3.2.3. Results of interpolation
Replace the outliers identified in the example trajectory of Step 1 with interpolation values
obtained by the Gaussian kernel weighted regression of the vehicle trajectory, as shown in
Figure 7.
3.3. Step3: smoothing using Savitzky-Golay lter
In Step 3, the S-G filter for local smoothing was used to remove noise from the trajectory
data, and the velocity and direction angle change curves were processed simultaneously
to ensure that the trajectory was spatially consistent. After filling in the missing values, out-
liers in the trajectory data were removed and interpolated with reasonable values. However,
TRANSPORTMETRICA A: TRANSPORT SCIENCE 13
Figure 8. Example of smoothing results using S-G filter.
there were still some significant unreasonable fluctuations in the vehicle trajectories. There-
fore, in this step, we used an S-G filter to smooth the trajectory data to remove some of the
small-amplitude noise.
Filtering is a data processing technique used to remove noise and restore real data. The
S-G filter was proposed by Savitzky and Golay (1964), and is based on the least square fitting
of the local polynomial in the time domain. The advantage of the S-G filter is that it can keep
the shape and width of the signal unchanged while filtering out the noise. The S-G filtering
is shown in Equation (18).
Yj=i=m
i=−mCiYj+1
N(18)
where Yjis the velocity or direction angle fitting value; Yj+1is the raw velocity or direction
angle value; Ciis the i-th coefficient of the filter, which can be calculated by a polynomial
with order o;mis the half-filter length; Nis the filter length, which is equal to (2m+1).
Two parameters must be determined when the filter is applied to velocity or direction
angle sequence smoothing. The first is the order oof the smoothing polynomial. Smaller
values of oproduce smoother results but may introduce biases. A higher value of oreduces
the bias of the filter, but may overfit the data and produce greater noise. The second is half-
filter length m.Largervaluesofmproduce smoother results but reduce the peak flatness.
The values of oand mcan be determined by prior experiences or trial-and-error methods.
Rahman, Rashid, and Ahmad (2019) suggested order o=3 and half-filter length m=10
(i.e. filter length N=2m+1=21) are the best combination for the SG filter. Here, we use
the recommended values of oand m. Then, taking the sample trajectory used in Step 2,
comparisons of the velocity and direction angle before and after smoothing are shown in
Figure 8.
4. Model validation
We ran the reconstruction programme on an Intel Core i5-10600 CPU processor and
recorded the time required to execute it. It took 403 s to complete the entire reconstruction
process for 2140 trajectories. The reconstruction time for each trajectory was 183 ms, and
the reconstruction time per data point was less than 0.5 ms.
14 J. ZHAO ET AL.
The performance of the proposed method is validated in this section based on the
empirical data collected by UAVs. First, we analyse the reconstructed trajectory of a vehi-
cle to illustrate in detail how the proposed method works. Subsequently, all reconstructed
trajectories were analysed to validate the rationality of the proposed method. Finally,
the reconstructed trajectories were compared with the raw trajectories to validate their
consistency.
4.1. Detailed analysis of one vehicle trajectory
Taking one vehicle as an example, the reconstructed vehicle trajectories after applying each
step were analysed first to validate the availability of the method. Subsequently, the ratio-
nality of the reconstructed trajectory and the consistency between the reconstructed and
raw trajectories for the example vehicle are discussed.
4.1.1. Availability validation
Taking one vehicle as an example, the raw and reconstructed trajectories after each step
are shown in Figure 9. The results of each step are presented in each column.
In Figure 9, significant fluctuations can be found in the raw trajectory (More details are
shown in Figure 10). After the wavelet transform of the velocity and direction angle simul-
taneously, the outliers identified by the detail coefficient are shown in the subfigures in the
second and third rows of the first column in Figure 9, respectively. After the interpolation of
the recognised velocity and direction outliers in Step 2, the results are shown in the second
and third row of the second column in Figure 9. The interpolation values are represented
by red and yellow hexagons. In Step 3, the S-G filter was applied to eliminate the residual
high-frequency noise in the data, which was expressed in the velocity and direction angle
curves, as shown in the last column.
The reconstructed velocity and direction angle no longer exhibit rapid oscillations, while
the overall structure of the raw data is preserved. Such processing solves most of the high
velocities and curvatures that are not within the range of human operation. Therefore,
the proposed method can smoothen the vehicle trajectory without altering the overall
trajectory of the observed vehicle.
4.1.2. Rationality validation
We validated the rationality of the reconstructed trajectory of the example vehicle by check-
ing whether the acceleration and curvature follow kinematic laws. The acceleration outlier
rate and curvature outlier rate were used as the evaluation indicators. The acceleration out-
lier rate is defined as the number of trajectory points where the acceleration values are
outside the range of 5 to 5 m/s2(Bichiou and Rakha 2018) divided by the total number
of trajectory points. The curvature outlier rate is defined as the number of trajectory points
where the curvature values are outside the range from 0.2 to 0.2 m1(MOHURD 2012)
divided by the total number of trajectory points.
The acceleration distributions of the raw and reconstructed trajectories are shown in
Figure 11. The raw acceleration was distributed in an unrealistic range from 196 to
198 m/s2. The acceleration outlier rate is 85%. After applying Steps 1 and 2, the range
of acceleration was reduced by 92%, from 16 to 14 m/s2. The acceleration outlier rate
TRANSPORTMETRICA A: TRANSPORT SCIENCE 15
Figure 9. Reconstructed trajectories of the example vehicle.
decreased to 78%. After applying Step 3, the range of the acceleration was reduced by 80%,
from 2 to 4 m/s2. The acceleration outlier rate decreases to 2.8%.
The curvature distributions of the raw and reconstructed trajectories are shown in Figure
12. The raw curvature ranges from 23 to 8 m1, and the curvature outlier rate reached
60.4%. The curvature range of the reconstructed trajectory was reduced by 92.1% from
0.156 to 0.191 m1. The curvature outlier rate decreased to 0%, implying that the curva-
ture of the reconstructed trajectory fully met the criteria range. This demonstrates that the
proposed trajectory reconstruction method can effectively eliminate noise in the trajectory.
16 J. ZHAO ET AL.
Figure 10. Outliers with anomaly direction and velocity for the example vehicle.
Figure 11. Acceleration rationality analysis of the example vehicle.
Figure 12. Curvature rationality analysis of the example vehicle.
TRANSPORTMETRICA A: TRANSPORT SCIENCE 17
Figure 13. Acceleration rationality comparison of the example vehicle.
Figure 14. Curvature rationality comparison of the example vehicle.
The proposed method was compared with moving average (MA) and S-G methods,
which were widely used in trajectory reconstruction, to demonstrate its advantage. The
comparison results for the acceleration rationality are shown in Figure 13. The accelera-
tion outlier rates were 11% and 5% for MA and S-G, respectively, which are much higher
than those of the proposed method (0%). A comparison of the results of curvature ratio-
nality is shown in Figure 14. The curvature outlier rates were 6% and 13% for MA and S-G,
respectively, which were also much higher than those of the proposed method (0%). The
comparison analysis results indicate that the proposed trajectory reconstruction method
outperforms the MA-only and S-G-only methods in eliminating the noise in the example
vehicle trajectory.
4.1.3. Consistency validation
In this section, we validate the consistency between the reconstructed and raw trajectories
for an example vehicle. To validate the velocity consistency, we compared the velocities of
the raw and reconstructed trajectories, as shown in Table 3. The mean difference between
the reconstructed velocity and raw velocity is 0.18 m/s, which is quite small compared to the
18 J. ZHAO ET AL.
Tab le 3. Velocity consistency analysis of the example vehicle.
Trajectory velocity Maximum (m/s) Minimum (m/s) Mean (m/s) Standard deviation (m/s)
Raw trajectory 21.84 1.68 5.95 2.60
Reconstructed trajectory 7.01 4.53 5.77 0.76
Tab le 4. Paired-sample T-test for path consistency analysis of the example vehicle.
Difference 95% confidence interval
Indicator Mean Standard deviation T statistics Pvalues Upper limit Lower limit
x coordinate difference (m) 0.24 0.32 11.12 0.001 0.28 0.20
y coordinate difference (m) 0.18 0.21 13.00 0.001 0.16 0.21
mean velocity of 5.95 m/s. The standard deviation decreased by 70.8% because the outliers
were filtered out by the proposed method.
A paired-sample T-test of the coordinates between the reconstructed and raw trajecto-
ries was applied for path consistency validation. The results are presented in Table 4.This
shows that there is no significant difference in the coordinates between the reconstructed
and raw trajectories for the example vehicle, which indicates that the proposed method can
maintain the overall trajectory of the raw data.
4.2. Overall analysis of all vehicle trajectories
We validated the effectiveness of the proposed method by applying it to all the extracted
trajectory data (2140 vehicle trajectories). The validation was conducted in two parts:
rationality and consistency validations.
4.2.1. Rationality validation
The rationality of all the reconstructed trajectories was validated by calculating the accel-
eration and curvature outlier rates. The acceleration distributions of the reconstructed
trajectories are shown in Figure 15. The raw acceleration was distributed in an unreal-
istic range from 400 to 400 m/s2. The acceleration outlier rate for all the trajectories
reached 77.2%. Using the proposed method, the acceleration of all reconstructed trajec-
tories ranged from 6 to 5 m/s2. The acceleration outlier rate decreased to 3.5%. In total,
96.5% of the acceleration outliers was eliminated. In comparison, the acceleration outlier
rates of the MA and S-G-only methods were 11.2% and 16.8%, respectively. Therefore,
the proposed method outperforms the MA-only and S-G-only methods in reducing the
acceleration outlier rate, and can effectively eliminate velocity noise.
The curvature distributions of the reconstructed trajectories are shown in Figure 16.
The raw curvature ranged from 25 to 30 m1, and the curvature outlier rate was 80.6%.
The curvature range of the trajectories reconstructed by the proposed method was 0.19
to 0.30 m1. The curvature outlier rate was 2.7%, which indicates that the reconstructed
trajectories of 97.3% of the vehicles can fully satisfy the criterion range of the curvature.
In comparison, the curvature outlier rates of the MA and S-G-only methods were 6.6%
and 11.4%, respectively. Therefore, the proposed method outperforms the MA and S-G
methods in reducing the curvature outlier rate, and can effectively eliminate curvature
noise.
TRANSPORTMETRICA A: TRANSPORT SCIENCE 19
Figure 15. Acceleration rationality analysis of all vehicles.
Figure 16. Curvature rationality analysis of all vehicles.
4.2.2. Consistency validation
To validate the consistency between the reconstructed and raw trajectories, the root mean
square error (RMSE) and the mean absolute percentage error (MAPE) of the trajectory at
all time frames was used as indicators. The trajectory error at each time frame (1/24 s)
was defined as the Euclidean distance between the reconstructed and raw trajectories
(Zhao, Knoop, and Wang 2020). Subsequently, the RMSE and MAPE of one vehicle can be
calculated using Equations (19) and (20), respectively.
RMSEi=
Ti
t=1
((xi(t)x
i(t))2+(yi(t)y
i(t))2)(19)
MAPEi=1
Ti
Ti
t=1
(
xi(t)x
i(t)
x
i(t)
+
yi(t)y
i(t)
y
i(t)
)(20)
where RMSEiand MAPEirepresent the RMSE and MAPE values of vehicle irespectively; xi(t)
and yi(t)are the coordinates of the reconstructed trajectory of vehicle iat time t, in meters;
20 J. ZHAO ET AL.
Tab le 5. RMSE and MAPE comparisons of all vehicle trajectories.
Maximum Minimum Mean Standard deviation
Method RMSE(m) MAPE(%) RMSE(m) MAPE(%) RMSE(m) MAPE(%) RMSE(m) MAPE(%)
Proposed method 0.921 20.678 0.127 1.627 0.821 5.872 1.257 3.152
MA method 2.132 48.888 1.153 4.900 1.775 8.154 2.396 4.350
SG method 2.055 31.320 1.241 2.646 1.826 9.444 2.878 6.807
x
i(t)and y
i(t)represent the coordinates of the raw trajectory of vehicle iat time t, in meters;
Tirepresents the number of sampling points for vehicle i.
The RMSE and MAPE of all vehicles can be calculated using Equations (21) and (22),
respectively.
RMSEA=1
N
N
i=1
RMSEi(21)
MAPEA=1
N
N
i=1
MAPEi(22)
where RMSEAis the average RMSE value for all trajectories; MAPEAis the average MAPE value
for all trajectories; Nindicates the number of vehicles.
The maximum, minimum, mean, and standard deviation of the RMSE and the MAPE of
the trajectories reconstructed using the proposed method are listed in Table 5. Compared
with the MA and S-G methods, the RMSE of the proposed method ranged from 0.127 to
0.921 m, with a mean value of 0.821 m and a standard deviation of 1.257 m, which were
smaller than those of the MA and S-G methods. The MAPE of the proposed method ranged
from 1.627% to 20.678%, with a mean value of 5.872% and a standard deviation of 3.152%.
The average RMSE values were reduced by 53.7% and 55.1%, respectively, compared to
those of the MA and S-G methods. The standard deviations of the RMSE were reduced by
47.5% and 56.3%, respectively. The average MAPE values were reduced by 30% and 37.8%,
respectively, compared to those of the MA and S-G methods. The standard deviations of the
MAPE were reduced by 27.5% and 53.7%, respectively. This indicates that the trajectories
reconstructed by the proposed method are more consistent with the raw data than those
reconstructed by the MA and S-G methods.
A paired-sample T-test was used to compare whether there were significant differences
in the paths before and after reconstruction, and the results are shown in Table 6. A total of
95.9% (2053 out of 2140) of the reconstructed trajectories of the proposed method showed
no significant difference from the raw trajectories at a confidence level of 95%. This pro-
portion is 39.6% and 29.8% higher than that of the MA and S-G methods, respectively.
This indicates that the proposed method performs better in maintaining the overall raw
trajectory.
5. Conclusions
In this study, a three-step trajectory reconstruction method for the two-dimensional move-
ment of vehicles inside intersections is proposed. The wavelet transform, locally weighted
regression, and S-G filter were used to deal with outlier identification, data interpolation,
TRANSPORTMETRICA A: TRANSPORT SCIENCE 21
Tab le 6. Paired-sample T-test for path consistency analysis of all vehicle trajectories.
Method Sample size
Number of vehicle trajectories
with no significant difference
Proportion of vehicle trajectories
with no significant difference
Proposed method 2140 2053 95.90%
MA method 2140 1204 56.30%
S-G method 2140 1415 66.10%
and trajectory smoothing, respectively. Different wavelet bases were selected for outlier
identification of the velocity and direction angle for each vehicle according to the trajectory
rationality of physical kinematics. The rationality and consistency analysis were conducted
using empirical trajectory data by comparing it with the MA-only and S-G-only methods.
The quality of the reconstructed trajectory, including its rationality and consistency, was
confirmed. The following findings were drawn from this study:
(1) The proposed method is promising for reconstructing two-dimensional vehicle trajec-
tories. It can eliminate acceleration and curvature noises while maintaining consistency
with the raw trajectory. The large variance and range of errors in the trajectory data can
be effectively addressed by the proposed method.
(2) In terms of rationality, 96.5% and 97.3% of the trajectory acceleration and curvature
outliers, respectively, can be eliminated. The acceleration and curvature outlier rates of
the reconstructed trajectories are 3.5% and 2.7%, respectively.
(3) In terms of consistency, 95.9% of the reconstructed trajectories were not significantly
different from the raw trajectories. The reconstructed trajectory resulted from the
proposed method only have 0.82 m of RMSE (5.9% of MAPE) compared to the raw
trajectories.
This study provided a promising method for reconstructing video-based vehicle trajecto-
ries at intersections with the aim of correcting abnormal velocities and direction angles in
raw trajectories. The reconstructed vehicle trajectories resulted from the proposed method
outperforms those from existing approaches regarding rationality of accelerations and cur-
vatures. However, trajectories of each vehicle are processed individually. Further studies
are required to add the constraint conditions of the interaction between vehicles to make
the reconstructed vehicle trajectories more consistent with the reality (Zhao, Knoop, and
Wang 2022). The driving behaviour of various vehicle types and interactions between vehi-
cles at intersections are worth to be further investigated (Zhang et al. 2022). Additionally,
in this study, videos were collected by stable UAV cameras under low wind speed condi-
tions. Further research should be conducted to address instable UAV videos due to strong
wind. Moreover, some intersections are partly occluded by trees and highways from the
top views; therefore, videos with different views should be fused for vehicle trajectory
reconstruction.
Acknowledgements
Thank Dr. Jan-Dirk Schmoecker from Kyoto University for providing us with insightful suggestions
during the study.
22 J. ZHAO ET AL.
Disclosure statement
No potential conflict of interest was reported by the author(s).
Funding
This work was supported by the National Natural Science Foundation of China under Grants
52122215, 71971140 and 52202401; the Natural Science Foundation of Shanghai under Grant
20ZR1439300; and China Postdoctoral Science Foundation under Grant 2022M712139.
ORCID
Jing Zhao http://orcid.org/0000-0003-0741-4911
Xiaoliang Yang http://orcid.org/0000-0002-2461-8222
Cheng Zhang http://orcid.org/0000-0002-6529-2468
References
Ahn, S., S. Vadlamani, and J. Laval. 2013. “A Method to Account for Non-Steady State Conditions in
Measuring Traffic Hysteresis.” Transportation Research Part C: Emerging Technologies 34: 138–147.
doi:10.1016/j.trc.2011.05.020.
Alqasrawi, Y., M. Azzeh, and Y. Elsheikh. 2022. “Locally Weighted Regression with Different
Kernel Smoothers for Software Effort Estimation.” Science of Computer Programming 214.
doi:10.1016/j.scico.2021.102744.
Barmpounakis, Emmanouil, and Nikolas Geroliminis. 2020. “On the new era of Urban Traffic Monitor-
ing with Massive Drone Data: The pNEUMA Large-Scale Field Experiment.” Transportation Research
Part C: Emerging Technologies 111: 50–71. doi:10.1016/j.trc.2019.11.023.
Bichiou, Youssef, and Hesham A Rakha. 2018. “Developing an Optimal Intersection Control System
for Automated Connected Vehicles.” IEEE Transactions on Intelligent Transportation Systems 20 (5):
1908–1916. doi:10.1109/TITS.2018.2850335
Chen, B., Y. Wang, D. Wang, and W. H. K. Lam. 2019. “Understanding Travel Time Uncertainty Impacts
on the Equity of Individual Accessibility.” Transportation Research Part D: Transport and Environment
75: 156–169. doi:10.1016/j.trd.2019.08.027.
Chen, P., L. Wei, F. Meng, and N. Zheng. 2021. “Vehicle Trajectory Reconstruction for Signalized Inter-
sections: A Hybrid Approach Integrating Kalman Filtering and Variational Theory.” Transportmetrica
B: Transport Dynamics 9 (1): 22–41. doi:10.1080/21680566.2020.1781707.
Dong, S., Y. Zhou, T. Chen, S. Li, Q. Gao, and B. Ran. 2021. “An Integrated Empirical Mode Decomposi-
tion and Butterworth Filter Based Vehicle Trajectory Reconstruction Method.” Physica A: Statistical
Mechanics and its Applications 583: 126295. doi:10.1016/j.physa.2021.126295.
Fard, M. R., A. S. Mohaymany, and M. Shahri. 2017. “A new Methodology for Vehicle Trajectory Recon-
struction Based on Wavelet Analysis.” Transportation Research Part C: Emerging Technologies 74:
150–167. doi:10.1016/j.trc.2016.11.010.
Fu, H., Y. Wang, X. Tang, N. Zheng, and N. Geroliminis. 2020. “Empirical Analysis of Large-Scale Multi-
modal Traffic with Multi-Sensor Data.” Transportation Research Part C: Emerging Technologies 118:
102725. doi:10.1016/j.trc.2020.102725.
Krajewski, R., J. Bock, L. Kloeker, and L. Eckstein. 2018. The highD Dataset: A Drone Dataset of Natural-
istic Vehicle Trajectories on German Highways for Validation of Highly Automated Driving Systems.
Paper presented at the 2018 21st International Conference on Intelligent Transportation Systems
(ITSC), Maui, HI, USA, 4-7 Nov. 2018.
Liu, P., and W. D. Fan. 2021. “Exploring the Impact of Connected and Autonomous Vehicles on
Mobility and Environment at Signalized Intersections Through Vehicle-to-Infrastructure (V2I) and
Infrastructure-to-vehicle (I2V) Communications.” Transportation Planning and Technology 44 (2):
129–138. doi:10.1080/03081060.2020.1868088.
TRANSPORTMETRICA A: TRANSPORT SCIENCE 23
Ma, W., K. An, and H. K. Lo. 2016. “Multi-stage Stochastic Program to Optimize Signal Timings Under
Coordinated Adaptive Control.” Transportation Research Part C: Emerging Technologies 72: 342–359.
doi:10.1016/j.trc.2016.10.002.
Ma, W., and S. Qian. 2020. “Measuring and Reducing the Disequilibrium Levels of Dynamic Net-
works with Ride-Sourcing Vehicle Data.” Transportation Research Part C: Emerging Technologies 110:
222–246. doi:10.1016/j.trc.2019.11.001.
Mallat, S. G. 1989. “A Theory for Multiresolution Signal Decomposition: The Wavelet Representation.”
IEEE Transactions on Pattern Analysis & Machine Intelligence 11 (4): 674–693. doi:10.1109/34.192463
MOHURD. 2012.Code for Design of Urban Road Engineering. Beijing: Ministry of Housing and Urban-
Rural Development of the People’s Republic of China. MOHURD.
Montanino, M., and V. Punzo. 2015. “Trajectory Data Reconstruction and Simulation-Based Validation
Against Macroscopic Traffic Patterns.” Transportation Research Part B: Methodological 80: 82–106.
doi:10.1016/j.trb.2015.06.010.
Noh, B., and H. Yeo. 2022. “A Novel Method of Predictive Collision Risk Area Estimation for Proac-
tive Pedestrian Accident Prevention System in Urban Surveillance Infrastructure.” Transportation
Research Part C: Emerging Technologies 137: 103570. doi:10.1016/j.trc.2022.103570.
Pan, T., W. H. K. Lam, A. Sumalee, and R. Zhong. 2021. “Multiclass Multilane Model for Freeway Traffic
Mixed with Connected Automated Vehicles and Regular Human-Piloted Vehicles.” Transportmet-
rica A: Transport Science 17 (1): 5–33. doi:10.1080/23249935.2019.1573858.
Park, M., Y. Kim, and H. Yeo. 2020. “Development of an Asymmetric Car-Following Model and
Simulation Validation.” Ieee Transactions on Intelligent Transportation Systems 21 (8): 3513–3524.
doi:10.1109/Tits.2019.2930320.
Punzo, V., and F. Simonelli. 2005. “Analysis and Comparison of Microscopic Traffic Flow Mod-
els with Real Traffic Microscopic Data.” Transportation Research Record 1934 (1): 53– 63.
doi:10.1177/0361198105193400106
Rahman, M. A., M. A. Rashid, and M. Ahmad. 2019. “Selecting the Optimal Conditions of
Savitzky-Golay Filter for fNIRS Signal.” Biocybernetics and Biomedical Engineering 39 (3): 624–637.
doi:10.1016/j.bbe.2019.06.004.
Saifuzzaman, M., Z. Zheng, M. M. Haque, and S. Washington. 2017. “Understanding the Mecha-
nism of Traffic Hysteresis and Traffic Oscillations Through the Change in Task Difficulty Level.”
Transportation Research Part B: Methodological 105: 523–538. doi:10.1016/j.trb.2017.09.023.
Savitzky, Abraham, and Mje Golay. 1964. “Smoothing and Differentiation of Data by Simplified Least
Squares Procedures.” Analytical Chemistry 36 (8): 1627–1639. doi:10.1021/ac60214a047
Shi, X., D. Zhao, H. Yao, X. Li, D. K. Hale, and A. Ghiasi. 2021. “Video-Based Trajectory Extraction
with Deep Learning for High-Granularity Highway Simulation (HIGH-SIM).” Communications in
Transportation Research 1 (1): 100014. doi:10.1016/j.commtr.2021.100014
Tang, K., C. Tan, Y. Cao, J. Yao, and J. Sun. 2020. “A Tensor Decomposition Method for Cycle-Based
Traffic Volume Estimation Using Sampled Vehicle Trajectories.” Transportation Research Part C:
Emerging Technologies 118: 102739. doi:10.1016/j.trc.2020.102739.
Thiemann, C., M. Treiber, and A. Kesting. 2008. “Estimating Acceleration and Lane-Changing Dynam-
ics from Next Generation Simulation Trajectory Data.” Transportation Research Record 2088 (1):
90–101. doi:10.3141/2088-10.
van Beinum, A., H. Farah, F. Wegman, and S. Hoogendoorn. 2018. “Driving Behaviour at Motorway
Ramps and Weaving Segments Based on Empirical Trajectory Data.” Transportation Research Part
C-Emerging Technologies 92: 426–441. doi:10.1016/j.trc.2018.05.018.
Venthuruthiyil, S. P., and M. Chunchu. 2018. “Trajectory Reconstruction Using Locally Weighted
Regression: A New Methodology to Identify the Optimum Window Size and Polynomial Order.”
Transportmetrica A: Transport Science 14 (10): 881–900. doi:10.1080/23249935.2018.1449032.
Venthuruthiyil, S. P., and M. Chunchu. 2020. “Vehicle Path Reconstruction Using Recursively Ensem-
bled Low-Pass Filter (RELP) and Adaptive tri-Cubic Kernel Smoother.” Transportation Research Part
C: Emerging Technologies 120: 102847. doi:10.1016/j.trc.2020.102847.
Wang, C., C. Xu, and Y. Dai. 2019. “A Crash Prediction Method Based on Bivariate Extreme Value
Theory and Video-Based Vehicle Trajectory Data.” Accident Analysis and Prevention 123: 365–373.
doi:10.1016/j.aap.2018.12.013.
24 J. ZHAO ET AL.
Wu, W., Y. Liu, W. Hao, G. A. Giannopoulos, and Y. J. Byon. 2022. “Autonomous Intersection Man-
agement with Pedestrians Crossing.” Transportation Research Part C: Emerging Technologies 135:
103521. doi:10.1016/j.trc.2021.103521.
Wu, W., Y. Liu, W. Liu, F. Zhang, D. Rey, and V. Dixit. 2019. “An Integrated Approach for Optimizing
Left-Turn Forbiddance Decisions at Multiple Intersections.” Transportmetrica B: Transport Dynamics
7 (1): 1481–1504. doi:10.1080/21680566.2019.1631901.
Xie, K., K. Ozbay, H. Yan, and C. Li. 2019. “Mining Automatically Extracted Vehicle Trajectory Data
for Proactive Safety Analytics.” Transportation Research Part C: Emerging Technologies 106: 61–72.
doi:10.1016/j.trc.2019.07.004.
Yang, D., Y. Wu, F. Sun, J. Chen, D. Zhai, and C. Fu. 2021. “Freeway Accident Detection and Classification
Based on the Multi-Vehicle Trajectory Data and Deep Learning Model.” Transportation Research Part
C: Emerging Technologies 130: 103303. doi:10.1016/j.trc.2021.103303.
Yu, C., Y. Feng, H. Liu, W. Ma, and X. Yang. 2018. “Integrated Optimization of Traffic Signals and Vehicle
Trajectories at Isolated Urban Intersections.” Transportation Research Part B: Methodological 112:
89–112. doi:10.1016/j.trb.2018.04.007.
Zhang, C., B. Chen, W. H. K. Lam, H. W. Ho, X. Shi, X. Yang, W. Ma, S. C. Wong, and A. H. F.
Chow. 2022. “Vehicle re-Identification for Lane-Level Travel Time Estimations on Congested Urban
Road Networks Using Video Images.” IEEE Transactions on Intelligent Transportation Systems, 1–17.
doi:10.1109/tits.2021.3118206.
Zhang, Cheng, H. W. Ho, William H. K. Lam, Wei Ma, S. C. Wong, and Andy H. F. Chow.
2022. “Lane-based Estimation of Travel Time Distributions by Vehicle Type via Vehicle re-
Identification Using Low-Resolution Video Images.” Journal of Intelligent Transportation Systems,
1–20. doi:10.1080/15472450.2022.2027767.
Zhang, W., G. Jordan, and V. Livshits. 2016. “Generating a Vehicle Trajectory Database from Time-Lapse
Aerial Photography.” Transportation Research Record 2594 (1): 148–158. doi:10.3141/2594-18.
Zhang, Y., Y. Zou, J. Tang, and J. Liang. 2022. “Long-Term Prediction for High-Resolution Lane-
Changing Data Using Temporal Convolution Network.” Transportmetrica B: Transport Dynamics 10
(1): 849–863. doi:10.1080/21680566.2021.1950072.
Zhao, Jing, Victor L. Knoop, and Meng Wang. 2020. “Two-dimensional Vehicular Movement Mod-
elling at Intersections Based on Optimal Control.” Transportation Research Part B: Methodological
138: 1–22. doi:10.1016/j.trb.2020.04.001
Zhao, Jing, Victor L. Knoop, and Meng Wang. 2022. “Microscopic Traffic Modeling Inside Intersections:
Interactions Between Drivers.” Transportation Science, doi:10.1287/trsc.2022.1163.
Zhou, M., X. Qu, and X. Li. 2017. “A Recurrent Neural Network Based Microscopic Car Following Model
to Predict Traffic Oscillation.” Transportation Research Part C: Emerging Technologies 84: 245–264.
doi:10.1016/j.trc.2017.08.027.
... In subsequent studies, Chen et al. (2021) and Hu et al. (2022) respectively employed wavelet transform to denoise the longitudinal position and velocity of trajectories. Zhao et al. (2023b) combined wavelet transform with Savolay filtering and adopted a three-step approach for denoising two-dimensional vehicle trajectories within intersections. Similar to other filtering methods, parameter settings including choice of wavelet basis functions and thresholds are necessary for wavelet transform. ...
... We selected a third-order fitting polynomial for the Savitzky-Golay filter and set the filter length to 21 points with a sampling rate of 24 Hz, according to the recommendation from Rahman et al. (2019). For the integration of wavelet transform and S-G filtering methods, in consideration of signal wave characteristics and vehicle track significance, different wavelet bases are chosen for each vehicle based on the maximum energy criteria while a smoothing order of 3 and a filter length of 21 points is kept constant for S-G filtering (Zhao et al., 2023b). ...
... Compared to other algorithms, the Savitzky-Golay flter has the advantage of preserving data features and allowing for fexible parameter adjustment. Moreover, it has been found efective for optimizing vehicle trajectory data [65]. Te Savitzky-Golay flter is given in the following equation: ...
Article
Full-text available
Understanding the sideslip risks of various trajectory patterns, as well as the impact of rainfall on them, is critical for improving road safety. However, the lack of precise classification indicators hampers systematic analysis of the variations in vehicle trajectory patterns. To address this, this study proposes a parameterized classification method for trajectories on curved segments, employing the radius and offset of the trajectory as the primary classification features and dividing the trajectories into nine patterns. These patterns represent variations from smaller to larger radii and inside to outside lane offsets, reflecting different driving behaviors and vehicle stability during vehicle cornering. Concurrently, the friction coefficient utilization rate is used to effectively compare vehicles’ sideslip risk under different weather conditions. Based on this, we construct a framework using computer vision technology for automatically identifying trajectory patterns and measuring sideslip risk. We conducted an empirical study on a highway-curved segment with high sideslip risk in China and collected two datasets under clear and rainy conditions for analysis. The classification results show that the proposed method can effectively classify trajectories according to nine trajectory patterns. Comparative analysis reveals that vehicle trajectories in both the inside and outside lanes are notably more affected by rainfall compared to the middle lane. Meanwhile, trucks demonstrate a higher susceptibility to rainfall than cars. In addition, the analysis of the sideslip risk for different trajectory patterns discovers several high-risk patterns. This study provides an effective approach for monitoring and analyzing the sideslip risk on curved segments, thereby contributing to the enhancement of road design and traffic safety management.
... Zhao et al. proposed a three-step vehicle trajectory reconstruction method with the wavelet transform, Gaussian kernel and Savitzky-Golay filter to reconstruct the trajectory data from 15 intersections. The framework used Gaussian-kernel-based locally weighted linear regression to interpolate the data after outliers were removed [25]. ...
Article
Full-text available
Vehicle trajectory usually suffers from a large number of outliers and observation noises. This paper proposes a novel framework for reconstructing vehicle trajectories. The framework integrates the wavelet transform, Lagrange interpolation and Kalman filtering. The wavelet transform based on waveform decomposition in the time and frequency domain is used to identify the abnormal frequency of a trajectory. Lagrange interpolation is used to estimate the value of data points after outliers are removed. This framework improves computation efficiency in data segmentation. The Kalman filter uses normal and predicted data to obtain reasonable results, and the algorithm makes an optimal estimation that has a better denoising effect. The proposed framework is compared with a baseline framework on the trajectory data in the NGSIM dataset. The experimental results showed that the proposed framework can achieve a 45.76% lower root mean square error, 26.43% higher signal-to-noise ratio and 25.58% higher Pearson correlation coefficient.
... An extended variational solution network was created and Kalman filtering was applied to capture and reproduce the stochastic properties of queue edge curves for signalized intersections (Chen et al., 2021). However, they did not explicitly consider the reconstruction of two-dimensional driving behavior and mixed traffic flow, which are critical to the driving behavior of interaction at intersections (Zhao et al., 2023). ...
Article
Full-text available
High-resolution trajectory data from the intersection shared space (ISS) is an ideal resource for testing autonomous driving and studying microscopic traffic flow theory in urban road traffic environments. It is common to use computer vision (CV) technologies to extract trajectory data from camera recordings at the ISS. However, it is challenging to accurately extract non-motorized(NONM)trajectories due to vehicle occlusion and mutual interference, which cause trajectory noise and missing. This study proposed a novel NONM trajectory reconstruction method, which integrates the social force model with the particle filter to reduce trajectory noise. The approach was tested on trajectories extracted from two advanced CV algorithms (ie, Yolov7 and MASK RCNN), and its performance was compared with seven SOTA methods. The results show that the proposed method achieved a much better RMSE (0.6 meters) than both the baseline (unprocessed CV trajectories, the RMSE is 1.16 meters) and selected SOTA methods (the best RMSE is 0.78 meters). The contribution of the study is to enhance the classical noise reduction algorithm by introducing the driving interaction model; ablation experiments and sensitivity analysis further demonstrate the importance of the driving interaction model in reducing trajectory noise and the stability of the method. The approach also includes an LSTM-Hungarian part to make up the missing trajectory. The proposed method is expected to serve as a useful post-processing tool for current CV algorithms.
Article
Autonomous vehicles (AVs) hold great potential to improve traffic safety. However, urban streets present a dynamic environment where unforeseen and complex scenarios can arise. The establishment of a systematic framework to extract a variety of vehicle driving scenarios could empower AVs to learn from and effectively navigate various situations. This study introduces a driving anomaly scenario extraction (DAnoScenE) framework tailored for AVs operating in urban street settings. The Waymo Open Motion Dataset (WOMD) is used to showcase the framework’s capability to capture an extensive range of realistic driving anomaly scenarios. The central process involves the detection and labeling of driving anomalies. To avoid the erroneous detected and labeled driving anomalies arising from issues such as outliers and noise within vehicle track data, a two-step approach is introduced to analyze and rectify vehicle movement parameters in raw data. To comprehend these driving anomalies and their associated scenarios, manual labeling identifies causative factors of scenarios such as traffic signals and behaviors of other agents, forming three scenario groups: Signal Interaction, Agent Interaction, and Other. A multimodal model is developed to classify scenario groups, complemented by a segmentation process that further divides groups into specific scenarios based on simple conditions. The results show that recognition accuracy for driving anomaly scenario groups achieved 98.4%, and the scenario segmentation method achieved 100% accuracy by simple conditions. The proposed framework provides valuable support for the advancement of autonomous driving algorithms and comprehensive AV testing, with a specific emphasis on navigating abnormal driving environments.
Article
Full-text available
As a new type of public transportation, demand responsive transit has gradually attracted attention for its flexibility and efficiency. In order to solve the problems such as single-vehicle type and fixed stop, and improve its operation efficiency, a collaborative scheduling method combining multi-occupancy vehicle type with non-fixed stop is proposed. Different from the previous studies in scheduling problems of demand responsive transit which only focus on stop mode such as fixed or non-fixed stop or vehicle types containing single-occupancy or multi-occupancy, this paper also studies the vehicle scheduling of demand responsive transit from the perspective of combination of non-fixed stop and multi-vehicle type. In addition, carbon emission cost is innovatively added into the scheduling model, and an improved genetic algorithm with multiple crossovers within individuals is designed to accelerate the convergence speed of the algorithm and improve the solution efficiency. Finally, taking Shijiazhuang downtown regional road network as an example, the validity of the proposed scheduling method is verified. The results show that compared with the single-occupancy vehicle scheduling methods, the operating costs of multi- occupancy vehicle scheduling method can be reduced by up to 25.0%, and the average passenger in-vehicle time is decreased by up to 8.8%, which could significantly reduce the system operating costs on the premise of ensuring shorter total passenger travel time. Compared with the mode of fixed stops, the average full load ratio of mode with non-fixed stops increased by 21.7%. Besides, the convergence speed and solving speed of the proposed improved genetic algorithm are increased by 31.7% and 4.8%, compared with the traditional genetic algorithm.
Article
Reinforcement learning-based techniques, empowered by deep-structured neural nets, have demonstrated superiority over rule-based methods in terms of making high-level behavioral decisions due to qualities related to handling large state spaces. Nonetheless, their training time, sample efficiency and the feasibility of the learnt behaviors remain key concerns. In this paper, we propose a novel hierarchical reinforcement learning-based decision-making architecture for learning left turn policies at unsignalized intersections with feasibility guarantees. The proposed technique is comprised of two layers; a highlevel learning-based behavioral planning layer which adopts soft actor-critic (SAC) principles to learn high-level, non-conservative yet safe, driving behaviors, and a low-level motion planning layer that uses Model Predictive Control (MPC) framework to ensure feasibility of the two-dimensional left-turn maneuver. The high-level layer generates reference signals of velocity and yaw angles for the ego vehicle taking into account safety and collision avoidance with the intersection vehicles, whereas the low-level motion planning layer solves an optimization problem to track these reference commands taking into account several vehicle dynamic constraints and ride comfort. While training the behavioral SAC-based planning layer,We develop an adaptive entropy regularization technique that results in faster convergence, higher mean rewards, and lower collision rates. We validate the proposed decision-making scheme in simulated environments and compare with other model free Reinforcement Learning (RL) baselines. The results demonstrate that the proposed integrated framework possesses better training and navigation capabilities.
Article
Full-text available
Microscopic traffic flow models enable predictions of traffic operations, which allows traffic engineers to assess the efficiency and safety effects of roadway designs. Modeling vehicle trajectories inside intersections is challenging because there is an infinite number of possible paths in a two-dimensional space, and drivers can simultaneously adapt their speeds as well. To date, human driver models for simultaneous longitudinal and lateral vehicle control based on the infrastructure characteristics and interactions with other drivers inside an intersection are still lacking. The contribution of this paper is threefold. First, it proposes an integrated microscopic traffic flow model to describe human-driven vehicle maneuvers under interactions. Drivers plan their heading and acceleration in the predicted future to minimize costs representing undesirable situations. The model works with a joint optimization for an interaction cost term. The weights associated with the interaction cost reflect how selfish or altruistic drivers are. Second, the proposed model endogenously gives the order of vehicles in case of crossing paths. Third, the paper develops a clustered validation method for microscopic traffic flow models with interacting vehicles, which account for interdriver variations. Results show that the model can accurately describe vehicle passing orders of interacting maneuvers, paths, and speeds against empirical data. The model can be applied to assess various intersection designs. Funding: This work was supported by the National Natural Science Foundation of China [Grants 71971140 and 52122215] and the Natural Science Foundation of Shanghai [Grant 20ZR1439300].
Article
Full-text available
Travel time estimation plays an essential role in the high-granular traffic control and management of urban roads with distinct lane-changing conditions among lanes. However, little attention has been given to the estimation of distributions of travel times among different lanes and different vehicle types in addition to their expected values. This paper proposes a new method for estimating lane-based travel time distributions with consideration of different vehicle types through matching low-resolution vehicle video images taken by conventional traffic surveillance cameras. The vehicle type classification is based on vehicle sizes and deep learning features extracted by densely connected convolutional neural networks, and the vehicle re-identification is conducted through a lane-based bipartite graph matching technique. A case study is carried out on a congested urban road in Hong Kong. Results show that the proposed method performs well in estimating the lane-level travel time distributions by vehicle type which can be very helpful for various lane-based and vehicle type-specific traffic management schemes.
Article
Full-text available
Estimating software effort has been a largely unsolved problem for decades. One of the main reasons that hinders building accurate estimation models is the often heterogeneous nature of software data with a complex structure. Typically, building effort estimation models from local data tends to be more accurate than using the entire data. Previous studies have focused on the use of clustering techniques and decision trees to generate local and coherent data that can help in building local prediction models. However, these approaches may fall short in some aspect due to limitations in finding optimal clusters and processing noisy data. In this paper we used a more sophisticated locality approach that can mitigate these shortcomings that is Locally Weighted Regression (LWR). This method provides an efficient solution to learn from local data by building an estimation model that combines multiple local regression models in k-nearest-neighbor based model. The main factor affecting the accuracy of this method is the choice of the kernel function used to derive the weights for local regression models. This paper investigates the effects of choosing different kernels on the performance of Locally Weighted Regression of a software effort estimation problem. After comprehensive experiments with 7 datasets, 10 kernels, 3 polynomial degrees and 4 bandwidth values with a total of 840 Locally Weighted Regression variants, we found that: 1) Uniform kernel functions cannot outperform non-uniform kernel functions, and 2) kernel type, polynomial degrees and bandwidth parameters have no specific effect on the estimation accuracy. In other words, no change in bandwidth or degree values occurred with a significant difference in kernel rankings. In short, Locally Weighted Regression methods with Triweight or Triangle kernel can perform better than more complex kernels. Hence, we encourage non-uniform kernel methods as smoother function with wide bandwidth and small polynomial degree.
Article
Full-text available
The provision of lane-level travel time information can enable accurate traffic control and route guidance in urban roads with distinctive traffic conditions among lanes. However, few studies in the literature have been conducted to estimate lane-level travel time distributions. This study proposes a new vehicle re-identification (V-ReID) method for estimating lane-level travel time distributions using video images from widely deployed surveillance cameras. In the proposed method, a lane-based bipartite graph matching is introduced to obtain optimal matches between upstream and downstream vehicles by considering lane-level traffic conditions and vehicles' lane changing behaviors and visual features. A lane-based travel time estimation technique is introduced to real-time estimate full spectrum of lane-level distribution parameters, including not only the mean but also the standard deviation and the distribution type. A comprehensive case study is carried out on a congested urban road in Hong Kong. Results of case study show that the proposed method outperforms the state-of-the-art link-based V-ReID method and is capable for providing accurate lane-level travel time distribution information on congested urban roads. Index Terms-Vehicle re-identification, lane-level travel time distributions, lane-changing behaviors, video images.
Article
Lane-changing is an important driving behaviour and unreasonable lane changes can potentially result in traffic accidents. Currently, the lane-changing data are often recorded with high resolution, which are not appropriate for some common deep learning approaches. To capture the stochastic time series of high-resolution lane-changing behaviour, this study introduces a temporal convolutional network (TCN) to predict the long-term lane-changing trajectory and behaviour. The lane-changing dataset was collected by the driving simulator at the frequency of 60 Hz. Prediction results show that the TCN can accurately predict the long-term lane-changing trajectory and driving behaviour with shorter computational time compared with two benchmark models including the convolutional neural network (CNN) and long short-term memory neural network (LSTM). The advantages of the TCN are rapid response and accurate long-term prediction, which are important for lane-changing assistance in the advanced driver assistance system.
Article
Road traffic accidents, especially vehicle–pedestrian collisions in crosswalk, globally pose a severe threat to human lives and have become a leading cause of premature deaths. In order to protect such vulnerable road users from collisions, it is necessary to handle possible conflict in advance and warn road users, not post-facto. A breakthrough for proactively preventing pedestrian collisions is to recognize pedestrian’s potential risks based on vision sensors such as CCTVs. In this study, we propose a predictive collision risk area estimation system at unsignalized crosswalks. The proposed system applied trajectories of vehicles and pedestrians from video footage after preprocessing, and then predicted their trajectories by using deep LSTM networks. With use of predicted trajectories, this system can infer collision risk areas statistically, further severity of levels is divided as danger, warning, and caution. In order to validate the feasibility and applicability of the proposed system, we applied it and assessed the severity of potential risks in two unsignalized spots with different mobility environment in Osan City, Republic of Korea. As a result, the ratio of dangerous scenes is higher in Spot A (0.115) than in Spot B (0.077) when applying the best performance model in each spot, and we found that the risk situation varies depending on the mobility environment.
Article
This paper is among the first to address the problem of pedestrians’ crossing at an autonomous intersection without traffic lights. To guarantee pedestrians’ safety, all the pedestrians who intend to cross the street should firstly board into a fully enclosed automated transport unit, which is referred to as an “automated pedestrian shuttle” (APS) in this paper, then the APS carries the pedestrians across the street. Because APSs can shuttle back and forth through the intersection, the routing problem for APSs is modeled first. Then a Mixed Integer Linear Program (MILP) based AIM model is proposed to simultaneously optimize for the time of APSs and upcoming vehicles to enter the intersection. A numerical analysis is conducted to examine the performance and effectiveness of the proposed methods.
Article
High-granularity vehicle trajectory data can help researchers develop traffic simulation models, understand traffic flow characteristics, and thus propose insightful strategies for road traffic management. This paper proposes a novel vehicle trajectory extraction method that can extract high-granularity vehicle trajectories from aerial videos. The proposed method includes video calibration, vehicle detection and tracking, lane marking identification, and vehicle motion characteristics calculation. In particular, the authors propose a Monte-Carlo-based lane marking identification approach to identify each vehicle's lane. This is a challenging problem for vehicle trajectory extraction, especially when the aerial videos are taken from a high altitude. The authors applied the proposed method to extract vehicle trajectories from several high-resolution aerial videos recorded from helicopters. The extracted dataset is named by the High-Granularity Highway Simulation (HIGH-SIM) vehicle trajectory dataset. To demonstrate the effectiveness of the proposed method and understand the quality of the HIGH-SIM dataset, we compared the HIGH-SIM dataset with a well-known dataset, the NGSIM US-101 dataset, regarding the accuracy and consistency aspects. The comparison results showed that the HIGH-SIM dataset has more reasonable speed and acceleration distributions than the NGSIM US-101 dataset. Also, the internal and platoon consistencies of the HIGH-SIM dataset give lower errors compared to the NGSIM US-101 dataset. To benefit future research, the authors have published the HIGH-SIM dataset online for public use.
Article
The freeway accident detection and classification have attracted much attention of researchers in the past decades. With the popularity of Global Navigation Satellite System (GNSS) on mobile phones and onboard equipment, increasing amounts of real-time vehicle trajectory data can be obtained more and more easily, which provides a potential way to use the multi-vehicle trajectory data to detect and classify an accident on freeways. The data has the advantages of low cost, high penetration, high real-time performance, and being robust to the outdoor environment. Therefore, this paper proposes a new method for accident detection and classification based on the multi-vehicle trajectory data. Different from the existing methods using GNSS positioning data, the proposed method not only uses the position information of the related vehicles but also tries to capture the development tendencies of the trajectories of accident vehicles over a period of time. A Deep Convolutional Neural Network model is developed to recognize an accident from the normal driving of vehicles and also identify the type of the accident, and the six types of traffic accidents are considered in this study. To train and test the proposed model, the simulated trajectory data is generated based on PC-Crash, including the normal driving trajectories and the trajectories before, in, and after an accident. The results indicate that the detection accuracy of the proposed method can reach up to 100%, and the classification accuracy can reach up to 95%, which both outperform the existing methods using other data. In addition, to ensure the robustness of the detection accuracy, at least 1 s of duration and 5 Hz of frequency for the trajectory data should be adopted in practice. The study will help to accurately and fastly detect an accident, recognize the accident type, and future judge who is liable for the accident.
Article
Trajectory data serving as an essential data-source, has been widely applied in traffic flow analysis, traffic prediction and transportation management. In real situations, trajectory data is often corrupted with noises, which may introduce estimation bias and control inefficiency to intelligent transportation systems. This paper presents a novel trajectory reconstruction method which is generic for both highway and urban arterial trajectories. The reconstruction method establishes an Empirical Mode Decomposition (EMD) based Butterworth low-pass filter framework to filter the noises and simultaneously maintain physical integrity. The two-stage framework firstly applies the EMD to decompose the original trajectories into components, multiple intrinsic mode functions (IMFs), to find out the main components of different temporal-frequency characteristics. Based on that, an optimal Butterworth-filter is applied on the lower order IMFs to filter the acceleration of an unexpected high-frequency range. To test the effectiveness of our proposed method, multiple resource data-sets are applied. As results indicated that our proposed reconstruction method performs well in terms of physical trajectories integrity, high-frequency noise removal, and measurement error rejection with minimum signal distortion. Further, our method efficiently produces speed and acceleration with higher quality compared with the state-of-the-art methods.