ArticlePDF Available

Abstract and Figures

This paper presents a continuous curvature planning algorithm with obstacle avoidance capabilities. The automated system generates a collision free path that considers vehicle's constraints, the road and different obstacles inside the horizon of view. The developed planning module was integrated in the RITS (former IMARA) autonomous vehicle architecture. The goal of this module is to obtain an accurate, continuous and safe path generation, by implementing parametric curves. To this end, a continuous curvature profile when calculating vehicle trajectory is introduced. It also permits to generate different speed profiles, improving the comfort by reducing lateral accelerations in the driving process. These algorithms have been implemented in simulated -ProSiVIC- and real platforms -Cybercars- showing good results in both cases. This approach is currently being implemented in the framework of the EU CityMobil2 project.
Content may be subject to copyright.
Continuous curvature planning with obstacle avoidance capabilities in
urban scenarios
David Gonz´
alez, Joshue P´
erez, Ray Lattarulo, Vicente Milan´
es and Fawzi Nashashibi
Abstract This paper presents a continuous curvature plan-
ning algorithm with obstacle avoidance capabilities. The au-
tomated system generates a collision free path that considers
vehicle’s constraints, the road and different obstacles inside the
horizon of view. The developed planning module was integrated
in the RITS (former IMARA) autonomous vehicle architecture.
The goal of this module is to obtain an accurate, continuous
and safe path generation, by implementing parametric curves.
To this end, a continuous curvature profile when calculating
vehicle trajectory is introduced. It also permits to generate
different speed profiles, improving the comfort by reducing
lateral accelerations in the driving process. These algorithms
have been implemented in simulated -ProSiVIC- and real
platforms -Cybercars- showing good results in both cases. This
approach is currently being implemented in the framework of
the EU CityMobil2 project.
I. INTRODUCTION
The development of autonomous driving systems is
strongly related to technological advances to get a safety,
efficient and comfortable road transportation. Recent studies
show that autonomous vehicles would have a higher level of
acceptability in our society [1]. When developing driverless
cars, one can breakdown the algorithms in different ones
according to the driving area (highway, urban environment,
mixed traffic corridor) [2]. The complexity of the control
system in each scenario is highly related to the traffic,
infrastructure and safety characteristics demanded by the
users. Due to this, traffic in congested urban areas is one
of the most difficult tasks to manage.
Some Advanced Driver Assistance Systems (ADAS) show
improvements for road monitoring and partial control of
transportation systems, such as: emergency braking [3],
keeping inter-vehicle safe distance, automated parking [4],
obstacle avoidance and so on. Moreover, many platforms
have been tested in real urban scenarios and highways
(v.g.: Google driverless cars, DAIMLER’s automated ve-
hicle, PROUD platform from Parma University [5], [6]
etc), showing significant progresses in the field. However,
some unsolved challenges remains on dynamic trajectory
generation, collision avoidance, comfort and safe driving.
The trajectory planning and control of autonomous vehi-
cles has to mainly consider driving laws and road layout
(number of lanes, pedestrians, cyclists and so on)[7], [8].
Among the different dynamic trajectory generation algo-
rithms, B´
ezier curves are a suitable candidate in terms
Authors are with the Robotics and Intelligent Transportation Systems
(RITS) Team, Inria Paris-Rocquencourt, Domaine de Voluceau,
78153 Le Chesnay, France david.gonzalez-bautista,
joshue.perez rastelli, vicente.milanes,
fawzi.nashashibi @inria.fr
of computation efficiency for real-time applications. Some
authors have previously implemented them in path planners
with anti-collision behavior [9]. They estimated trajectories
based on laser data. The simulation showed that B´
ezier
curves are a good solution for the curvature continuity in
urban scenarios. However, passengers comfort with different
speed profiles was not considered.
Digital navigation maps can contain errors or unexpected
situations, like accidents or blocked streets. In Zinoune et
al.[10], a detection of map errors for autonomous vehicles,
based on embedded sensors, was presented. They use a
trajectory generation that makes a statistical comparison
with geometric data in the maps. This approach allows the
improvements of the trajectories based on local information.
Recently, other authors have proposed online maneuvers gen-
eration for path planning and obstacle avoidance [11]. Other
path planning methods as state lattice planner, predictive
constraint-based planning and spline-based have been pro-
posed [11]. This paper presents a trajectory planning for an
accurate, continuous and safe path generation, by considering
vehicle and infrastructure limits and obstacles inside the
horizon of view. This approach is based on parametric curve
generation (B´
ezier polynomials) for a comfortable driving,
accounting for lateral acceleration. It permits to determine
a dynamic longitudinal control according to the type of the
route.
The paper is organized as follows: A curvature profile op-
timization for different intersections is presented in Section
II. Section III presents the obstacle avoidance module, which
is capable to plan an obstacle free path. This module also
considers the curvature to set the speed profile in the path,
explained in Section IV. The validation of the algorithms is
carried out in Section V, using simulated environments and
real platforms.
II. MOTI ON PL ANN ING A PPROACH
RITS previous works [12], [13] proposed a control archi-
tecture comprising six main stages: acquisition, perception,
communications, decision, control and actuation. This paper
is mainly focused on the decision stage where the path
generation is located.
The decision stage hosts the motion planning, which
coordinates two main tasks: the global and the local planner.
The first one takes into account the location of the vehicle,
its destination and a map from the database for planning the
route. This raw route is modified in the local planner module,
that is responsible for smoothing the raw path, turning it into
2014 IEEE 17th International Conference on
Intelligent Transportation Systems (ITSC)
October 8-11, 2014. Qingdao, China
978-1-4799-6077-4/14/$31.00 ©2014 IEEE 1430
Fig. 1. Intelligent intersection curve generation
a drivable trajectory that considers the road constraints and
the vehicle’s limitations.
A. Intelligent intersection handling
The local planner manages turn stretches and intersections
with B´
ezier curves, taking into account the route generated
by the global planner (P
npoints) [13], It also includes
constraints of the road (critical intersection points) and the
vehicle limitations (W = vehicle width, maximum vehicle
turning radius), as shown in Figure 1.
A geometrical approach considering the joining of straight
and curved segments was carried out. The generation of the
B´
ezier curve is as shown in Equation 1.
B(t) =
n
i=0
P
in
i(1t)nitit[0,1](1)
where nis the degree of the polynomial equation, P
iare the
control points that define the curve.
To achieve a continuous curvature profile, a weighting
algorithm has been implemented. Its computation gives the
best parametric curve to be set in the intersection planning,
achieving continuity between straight and curved segments.
The proposed approach generates several control points,
evaluating the curvature profiles at the beginning and end
of the curvature (giving each a weight in terms of the
continuity), and comparing the maximum curvature with
the maximum possible realizable by the vehicle (discarding
the ones physically impossible to achieve). Moreover, the
measure of the distance between the curve segments and the
intersection critical point is also considered.
The curvature evaluation is performed as follows:
C(t)=
~
Q0
(t)×~
Q00
(t)
~
Q0
(t)
3(2)
Equation 2 presents the curvature C(t)of a parametric
curve. A 4th degree B´
ezier curve is implemented if the 3rd
degree generated does not meet the requirements established
(see Figure 1). The curve generation is defined as follows:
The points R0,R1and R2describe the separation with
respect to the external band of the road (with W/2 of
separation), where the internal control points will be
set (i.e. P
1,P
3, and P
2=R1). This implementation is
generated within its convex hull (see [13]), forcing the
B´
ezier curve to fit the external road constraints.
The maximum curvature in the B´
ezier curve must be
realizable by the vehicle.
The generated curves must fit the internal road con-
straints, i.e. all the curves have to be at least (W/2mts)
away from the intersection critical point, inside the lane.
The location of all points in a 4th degree B´
ezier curve is
described by the following equations:
P
0=R1+d1
Tn1Tn
kTn1Tnk(3)
P
1=R1+ d2+rkTnR1k2+RwW
2!R0R1
kR0R1k(4)
P
3=R1+ d2+rkTnR1k2+RwW
2!R2R1
kR2R1k(5)
P
4=R1+d1
Tn+1Tn
kTn+1Tnk(6)
where d1and d2are the separation distances between P
0and
Tnand between P
4and Tnrespectively (see Figure 1). Rwis
the road width and Wis the vehicle width. The point P
2will
be fixed at the location of R1.
3rd degree B´
ezier curve control points definition is done
as follows: Equations 3 and 4 will remain the same. Equation
5 will calculate point P
2and Equation 6 will calculate point
P
3. Then, the B´
ezier curves are evaluated, chosing the most
suitable one (blue curve in Figure 1).
B. Adjacent consecutive intersections
The presented trajectory generation is able to plan turns
and intersections. However, it was limited by the amount
of space needed between two different consecutive curves
to generate a continuous path. These close points (defined
in the global planning) are a common situation in urban
scenarios (especially at downtown), where the roads are
not homogenous. A good approach of adjacent consecutive
algorithm for this kind of situations is proposed in this
section.
The limiting problem is due to the consecutive joint points
of two (or more) curves, since both have a curvature profile
different than zero. In previous works [14], [15], a study on
the curvature continuance for B´
ezier and parametric curves
1431
has been applied by considering the derivative of the curve at
the junction point. The study of the B´
ezier curvature permits
to find the best place to set the control points in order to
have C1continuity. To achieve this, it suffices to ensure that
the ending tangent vector of the first curve is identical to the
first tangent vector of the second curve, as in Equation 7.
~
Q0
(1)=m(CmC(m1)) = ~
R0
(0)=n(D1D0)(7)
where mand nare the order of each curve, C0,C1,...,Cmare
the control points of Q(t)and D0,D1,...,Dnare the control
points of R(t). Since mand nare fixed, the relation depends
on the distance between the mentioned control points.
In order to handle different adjacent intersection points
(closer than the previous definition of fixed positions at
20mts, as in [12]), the planner considers the previous Pg(n1)
and the next Pg(n+1)intersection points, evaluating the need
for a joint between two curves, and if so, applying the
previous mathematical procedure.
Fig. 2. Solution for consecutive intersections
Figure 2 shows three adjacent B´
ezier curves. In order to
achieve C1continuity in the path, the local planner takes into
account the space between each intersection point (Pgn).
First, the intersection distances Pgn1Pgnand PgnPgn+1
are calculated; if the control points maximum distance (MD)
set in the planner is bigger than half the minor intersection
distance (minor of (Pgn1Pgn)/2 and (PgnPgn+1)/2) a junc-
tion is required.
Therefore, the minor of the calculated distances is MD. In
Figure 2 is shown when Q(t)(blue curve) needs to adjust to
P
(t)(red curve) and R(t)(yellow curve), being (Pgn1Pgn)/2
the constraint distance for the B´
ezier generation. Once the
minor distance is defined, the segmentation process of the
B´
ezier curve is done as in Section II.A.
III. OBS TACLE AVOIDA NCE M ODU LE
An obstacle avoidance module has been developed as part
of the local planner (see Figure 3). This module is able to
avoid static obstacles in the path by taking into account
the trajectory already defined, the different obstacles from
the perception stage, the road constraints and the vehicle
limitations.
Fig. 3. Obstacle avoidance module added to the local planning
A buffer was set in the control architecture, as presented
in [12]. It communicates the local planner with the obstacle
avoidance module, and then the vehicle control as in Figure
3. This feature modifies the trajectory planned with a new
one if needed by flushing the buffer.
To manage the obstacle avoidance, we take into account
the current planned path, and if no obstacles are found,
it bypasses the path information onto the controller. When
obstacles are detected, an avoidance route is planned. The
previous path is held until the maneuver is finished. This
module (as well as the local planner), will plan a trajectory
until the horizon of view of the sensors (set at 30mts [13]).
Fig. 4. B´
ezier control points generation in case of an obstacle avoidance
maneuver (Beginning stage)
The obstacle avoidance maneuver is done in three main
phases (beginning, middle, end), as in [16], which are
described as follows:
Beginning: First, the algorithm sets the control points of
a new 3rd degree B´
ezier curve that redirects the vehicle
into an obstacle free path. It triggers the beginning of
the obstacle avoidance maneuver as in Figure 4.
The starting point of the curve (P
0) is in the front of the
vehicle in the predefined path. Point P
3is placed beside
the obstacle, with a distance of half the vehicle width
plus a safe distance (W/2+SD). The algorithm chooses
the position of the control points, taking into account
the availability to put the end points of the curve in the
same lane, either it is on the left or right side. Then, the
minor curvature possible is determined by applying the
previous segmentation described in Section II.A., to the
inner control points of the curve (i.e. P
1and P
2).
Middle: Once the vehicle is in an obstacle free path,
the middle phase ensures that the obstacle is overtaken.
The length of the vehicle (L) and also the length of the
obstacle are taken into account to achieve this. In this
1432
phase a straight segment is planned following the vector
L2from Figure 4. This consideration assures a trajectory
continuity between the Beginning and the Middle phase
of the maneuver.
End: This phase is performed symmetrically as the
Beginning phase. The control points are set considering
that the vehicle is able to return to the previous path.
This phase, sets the starting control point in the front
part of the vehicle (P
0), and the ending point (P
3) at a
distance D(defined in 16mts). The segmentation process
of the curvature is generated as in II.A.
Fig. 5. Obstacle Avoidance with continuous curvature
Each phase can be recalculated at any point of the obstacle
avoidance maneuver. If a new obstacle is found further ahead,
the proposed method is able to redefine a new trajectory. Ev-
ery time that an obstacle is found, the maneuver is restarted
from the current location of the vehicle. Figure 5 presents
the planning implemented when the vehicle follows the
path, and obstacles are detected. The module considers this
situation with the three phases previously stated, replacing
the previous path and calculating a new one.
IV. LONGITUDINAL CONTROL IN CURVED SEGMENTS
Curvature continuity does not only affects the smoothness
and safeness of the path, but also the comfort while driving
through it. In order to set an adequate speed profile that
ensures a comfortable travel for the passengers, our approach
considers the curvature profile of the road.
Different levels of discomfort, associated to lateral and
overall accelerations experienced by the passengers, have
been set in the ISO 2631-1 Standard and implemented in
previous works [17]. These levels are: Not uncomfortable,
A little uncomfortable, Fairly uncomfortable, Uncomfort-
able, Very uncomfortable, Extremely uncomfortable. Differ-
ent speed profiles can be generated taking into account these
levels, and the lateral acceleration caused by the velocity
in curved segments. The calculation of the overall r.m.s.
acceleration acting on the seated human body is as presented
by Equation 8:
aw=qkx2awx2+ky2awy 2+kz2awz2(8)
where kx=ky=1.4, kz=1, are multiplying factors and
awx,awy ,awz are the r.m.s. accelerations in the different axis
[17].
Since the vehicle operates in a two dimensional space, the
awz component is zero; also, we can assume the longitudinal
awx component as zero, because of the low speed profiles
implemented in urban scenarios.
awy =V2C(9)
Furthermore, the lateral acceleration component awy is as
presented by Equation 9, where Cis the curvature value
of the evaluated segment and Vis the velocity. Taking
Equations 8, 9 and the previous considerations, we are left
with Equation 10.
Vmax =raw
kyC(10)
This last equation, considered in the obstacle avoidance
module, sets a speed profile in the trajectory according to the
curvature of each segment, and the level of comfort set by the
user. Once the trajectory is planned in the obstacle avoidance
module, it is sent onto the vehicle controller module.
V. VALI DATI ON TE STS
Different tests were carried out in simulated and real
environments for the trajectory generation algorithm.
A. Simulated environments
The simulated experiments are developed in ProSivic1, a
multi-sensory environment, and takes into account detailed
models of real vehicles.
Two simulations are described. The first one is shown
in Figure 6, which depicts the intelligent planning of an
intersection. Different curvature profiles are calculated (blue
lines), evaluated through a weighting algorithm as in Section
II.A, and one is selected as the best suitable curve to apply
to the current intersection (Red curve).
The second experiment is presented in Figure 7. It shows
the performance of the vehicle following the given path
(blue line), and implementing the obstacle avoidance module
every time an obstacle is found (green lines), as described
in Section III.
The versatility of the present approach allows to the plan-
ner to overtake every time an obstacle is found; regardless
if the vehicle was already performing the maneuver (middle
left of Figure 7) or passing through an intersection (upper
left of Figure 7).
For the performance shown in Figure 7, different levels
of comfort were taken into consideration to provide the
speed suggestion presented in Figure 9: Not uncomfortable,
awy =0.315m/s2(red line), A little uncomfortable,awy =
0.63m/s2(gray line), Fairly uncomfortable,awy =1m/s2
1http://www.civitec.com/
1433
Fig. 8. Performance of our real platform -Cybercar- following the path planned
Fig. 6. Planning of different curvature profiles to find the best curve
(cyan line), Uncomfortable,awy =1.6m/s2(green line), Very
uncomfortable,awy =2.5m/s2(blue line). This is done as in
Section IV.
B. Real Platforms
A prototype Cybus was used as validation platform. It
is a drive-by-wire Cybercar vehicle with fully automation
capabilities. This Cybus is equipped with four lasers, two in
the front and two in the back (two near the bumper and two
near the ceiling). The higher ones allow its localization by
a SLAM method, while the lower ones permit the obstacle
localization
Figure 8 shows the performance on the Cybus. It depicts
the map (black points), the different intersection and turns
(blue points), and the good performance of the vehicle while
following the path planned (red line).
The path following generated at the intersection is accu-
rate, where no jumps or fast changes occur in the vehicle
performance; showing a smooth and safe behavior. The
curvature implemented by the controller shows a smooth
behavior in Figure 10 (blue line), where the maximum
curvature achievable by the Cybus is shown with a red line
(4.4 1/m). Moreover, Figure 11 shows the suggested speed
Fig. 7. Performance of the vehicle avoiding obstacles
Fig. 9. Different speed profiles according to the levels implemented in
[17]
profile in the intersection according to a Not uncomfortable
level of comfort for the user. When the vehicle arrives
to the curved segment, the suggested speed is lower in
order to decrease the lateral accelerations and keep the Not
uncomfortable level of comfort.
VI. CONCLUSIONS AND FUTURE WORKS
Based on previous works, the development and implemen-
tation of different algorithms for a safe and comfortable path
planning is presented. These are oriented to intersections and
obstacles handling, where the main contribution to the RITS
control architecture takes place in the local planning.
1434
Fig. 10. Real curvature profile at the curved segment in Figure 8
Fig. 11. Speed profile suggestion
Implementing parametric curves, different intersections
are handled. By searching the position of the B´
ezier control
points, a smooth path that fits the vehicle and road constraints
can be planned (as explained in II.A).
The generation of these curves needed a space in between
(20mts), in previous works. This is solved by taking into
account the derivative of the parametric curve at its limits,
where the position of the control points can be found in
order to have a C1continuity between adjacent intersections
(as explained in II.B).
Furthermore, an obstacle avoidance module is included in
the local planning stage of the architecture. This stage is
capable to avoid static obstacles on the road, by defining an
overtaking maneuver with three defined phases.
The curvature profile is considered to reduce the lateral
accelerations. The user is able to set a level of comfort in the
navigation system, as this modules calculates the longitudinal
speed profile to meet the requirements of the user.
These algorithms have been validated in simulations (with
ProSivic) and in real platforms (Cybus), showing good
results in both platforms and giving proof of its modularity
and versatility.
In future works, improvements in the obstacle avoidance
capability of the vehicle will be done. Dynamic obstacles
and different vehicle communications (V2V and V2I) will
be considered to achieve a safer and more comfortable
navigation.
ACKNOWLEDGMENTS
Authors wants to thank to the ARTEMIS project DE-
SERVE and FP7 CityMobil2 for its support in the devel-
opment of this work.
REFERENCES
[1] J. H. Frank M. F. Verberne and C. J. H. Midden, “Trust in smart
systems sharing driving goals and giving information to increase
trustworthiness and acceptability of smart systems in cars,” Human
Factors: The Journal of the Human Factors and Ergonomics Society,
2012.
[2] M. Van Schijndel-de Nooij, B. Krosse, T. Van den Broek, S. Maas,
E. Van Nunen, H. Zwijnenberg, A. Schieben, H. Mosebach, N. Ford,
M. McDonald, and J. Sanchez, “Definition of necessary vehicle and
infrastructure systems for automated driving,” SMART 2010/0064
European Commission, 2011.
[3] R. Zheng, K. Nakano, S. Yamabe, M. Aki, H. Nakamura, and Y. Suda,
“Study on emergency-avoidance braking for the automatic platooning
of trucks,” Intelligent Transportation Systems, IEEE Transactions on,
vol. PP, no. 99, pp. 1–10, 2014.
[4] F. Ghilardelli, G. Lini, and A. Piazzi, “Path generation using mbi4
-splines for a truck and trailer vehicle,” Automation Science and
Engineering, IEEE Transactions on, vol. 11, no. 1, pp. 187–203, Jan
2014.
[5] S. Ingolfo and V. Silva Souza, “Law and adaptivity in requirements
engineering,” in Software Engineering for Adaptive and Self-Managing
Systems (SEAMS), 2013 ICSE Workshop on, May 2013, pp. 163–168.
[6] A. Broggi, P. Cerri, S. Debattisti, M. Laghi, P. Medici, M. Panciroli,
and A. Prioletti, “Proudpublic road urban driverless test: architecture
and results,” in Intelligent Vehicles Symposium (IV), 2014 IEEE, June
2014, pp. 931–937.
[7] K. Jo and M. Sunwoo, “Generation of a precise roadway map for
autonomous cars,” Intelligent Transportation Systems, IEEE Transac-
tions on, vol. 15, no. 3, pp. 925–937, June 2014.
[8] J. Nilsson, M. Ali, P. Falcone, and J. Sjoberg, “Predictive manoeu-
vre generation for automated driving,” in Intelligent Transportation
Systems - (ITSC), 2013 16th International IEEE Conference on, Oct
2013, pp. 418–423.
[9] L. Han, H. Yashiro, H. Nejad, Q. H. Do, and S. Mita, “Bzier curve
based path planning for autonomous vehicle in urban environment,
in Intelligent Vehicles Symposium (IV), 2010 IEEE, June 2010, pp.
1036–1042.
[10] C. Zinoune, P. Bonnifait, and J. Ibanez-Guzman, “A sequential test for
autonomous localisation of map errors for driving assistance systems,”
in Intelligent Transportation Systems (ITSC), 2012 15th International
IEEE Conference on, Sept 2012, pp. 1377–1382.
[11] D. Madas, M. Nosratinia, M. Keshavarz, P. Sundstrom, R. Philippsen,
A. Eidehall, and K.-M. Dahlen, “On path planning methods for
automotive collision avoidance,” in Intelligent Vehicles Symposium
(IV), 2013 IEEE, June 2013, pp. 931–937.
[12] D. Gonzalez and J. Perez, “Control architecture for cybernetic trans-
portation systems in urban environments,” in Intelligent Vehicles
Symposium (IV), 2013 IEEE, June 2013, pp. 1119–1124.
[13] J. Perez, R. Lattarulo, and F. Nashashibi, “Dynamic trajectory genera-
tion using continuous-curvature algorithms for door to door assistance
vehicles,” in Intelligent Vehicles Symposium (IV), 2014 IEEE, 2014.
[14] K. Yang and S. Sukkarieh, “An analytical continuous-curvature path-
smoothing algorithm,” Robotics, IEEE Transactions on, vol. 26, no. 3,
pp. 561–568, 2010.
[15] D. Walton, D. Meek, and J. Ali, “Planar G2transition curves composed
of cubic b´
ezier spiral segments,” Journal of Computational and
Applied Mathematics, vol. 157, no. 2, pp. 453–476, 2003.
[16] J. Naranjo, C. Gonzalez, R. Garcia, and T. de Pedro, “Lane-change
fuzzy control in autonomous vehicles for the overtaking maneuver,”
Intelligent Transportation Systems, IEEE Transactions on, vol. 9, no. 3,
pp. 438–450, Sept 2008.
[17] L. Labakhua, U. Nunes, R. Rodrigues, and F. Leite, “Smooth trajectory
planning for fully automated passengers vehicles: Spline and clothoid
based methods and its simulation,” in Informatics in Control Automa-
tion and Robotics. Springer Berlin Heidelberg, 2008, vol. 15, pp.
169–182.
1435
... But, scenarios close to the limit are difficult to consider in this approach. Some other approaches based on pure mathematical functions can be applied to connect the sampled waypoints with a smooth path profile, such as Bezier curves [15], splines curves [16], or the lattice planner with polynomial curves for the path's curvature [17]. These approaches can have the advantage of not embedding a dynamic model of the robot into the logic, which can simplify the implementation. ...
... The final reward function can be simply built by adding the single reward functions (15). Each reward function is normalized between −1 and 0. A weighted addition of the single reward functions is performed to prioritize the requirements: r = K sa f ety * r sa f ety + K legal * r legal + K com f ort * r com f ort + K task * r task (15) In general, the order of importance within the requirements is as follows: safety, legal, comfort, and task-oriented (16): ...
... The final reward function can be simply built by adding the single reward functions (15). Each reward function is normalized between −1 and 0. A weighted addition of the single reward functions is performed to prioritize the requirements: r = K sa f ety * r sa f ety + K legal * r legal + K com f ort * r com f ort + K task * r task (15) In general, the order of importance within the requirements is as follows: safety, legal, comfort, and task-oriented (16): ...
Article
Full-text available
Complex and high-computational-cost algorithms are usually the state-of-the-art solution for autonomous driving cases in which non-holonomic robots must be controlled in scenarios with spatial restrictions and interaction with dynamic obstacles while fulfilling at all times safety, comfort, and legal requirements. These highly complex software solutions must cover the high variability of use cases that might appear in traffic conditions, especially when involving scenarios with dynamic obstacles. Reinforcement learning algorithms are seen as a powerful tool in autonomous driving scenarios since the complexity of the algorithm is automatically learned by trial and error with the help of simple reward functions. This paper proposes a methodology to properly define simple reward functions and come up automatically with a complex and successful autonomous driving policy. The proposed methodology has no motion planning module so that the computational power can be limited like in the reactive robotic paradigm. Reactions are learned based on the maximization of the cumulative reward obtained during the learning process. Since the motion is based on the cumulative reward, the proposed algorithm is not bound to any embedded model of the robot and is not being affected by uncertainties of these models or estimators, making it possible to generate trajectories with the consideration of non-holonomic constrains. This paper explains the proposed methodology and discusses the setup of experiments and the results for the validation of the methodology in scenarios with dynamic obstacles. A comparison between the reinforcement learning algorithm and state-of-the-art approaches is also carried out to highlight how the methodology proposed outperforms state-of-the-art algorithms.
... This approach is able to generate smooth and continuous-curvature paths, with the favorable property of passing through initial and final points and having the whole path always lie within the convex hull of the control points. This property makes the Bézier paths not much sensitive to a small change in the parameters, and it becomes particularly useful when the vehicle dynamics is subject to uncertainties and perturbations which are unclear or difficult to model [18][19][20]. Another tool to generate smooth flyable paths are segmented splines, defined by a series of low-order polynomials [15]. ...
... Historically, the optimization problems (13), (18), and (19) are widely studied with convex-concave OFs. However, due to the non-convexity nature of the optimization problems, they need to be solved numerically in contrast to the analytical solutions given by Theorems 2 and 3. ...
Article
Full-text available
This paper describes a path planning approach for smooth entry of an aerospace vehicle (ASV) into a 3D elliptic orbit. The generated path represents a polynomial Bézier curve connecting a given position of the ASV with the orbital entry point. Recursive and non-recursive analytical formulas for the last k intermediate control points determining Ck smooth Bézier path are derived. To evaluate the performance of the proposed approach, a practical measure of path smoothness such as path length, average curvature, and maximum curvature is introduced to choose the best entry point on the orbit and the corresponding Bézier path. The simulation results demonstrate that minimizing the maximum curvature yields a path that optimizes the proposed smoothness measure.
Chapter
In the last years, the use of unmanned aerial vehicles (UAVs) has become particularly relevant in multiple sectors, including search and rescue (SAR) missions, due to their flexibility, precision, speed, and operation range. These systems can dramatically enhance the survival chances of disaster victims while safeguarding and protecting the integrity of rescue teams. UAVs can address these challenges by accessing remotely hazardous areas, performing complex operations, and providing real-time monitoring and environment modeling capabilities. This chapter aims to provide readers with the current state-of-the-art technologies that can be integrated within UAVs to enhance the effectiveness and security of SAR operations.
Article
Navigating automated driving systems (ADSs) through complex driving environments is difficult. Predicting the driving behavior of surrounding human-driven vehicles (HDVs) is a critical component of an ADS. This paper proposes an enhanced motion-planning approach for an ADS in a highway-merging scenario. This method utilizes the results of two aspects: the driving behavior and long-term trajectory of surrounding HDVs, which are coupled using a hierarchical model that is used for the motion planning of an ADS to improve driving safety. An unsupervised clustering algorithm is utilized to classify HDV drivers into two categories: aggressive and normal, as part of predicting their driving behaviors. Subsequently, a logistic regression model is employed for driving style prediction. For trajectory prediction, a transformer-based model that concentrated parallelization computations on longer sequence predictions via a self-attention mechanism is developed. Based on the predicted driving styles and trajectories of the surrounding HDVs, an intelligent decision-making strategy is utilized for ADS motion planning. Finally, real-world traffic data collected from drones on a highway ramp in Xi’an is used as a case study to train and evaluate the proposed model. The results demonstrate that the proposed approach can predict HDVs merging trajectories with a mean squared error (MSE) smaller than 0.125 at 30 seconds away from the merging point, outperforming existing approaches in terms of predictable duration and accuracy. Furthermore, it exhibited safety improvements by adjusting the ADS motion state in advance with good predictive power for the surrounding HDVs’ motion. For both normal and aggressive driving styles, the ADS trajectories reached optimal safety at a prediction horizon of at least 10 seconds and over 6.67 seconds, respectively, when evaluating both time-to-collision (TTC) and deceleration rate to avoid a crash (DRAC) metrics. This indicates that our proposed procedures have improved safety for AVs with long-term predictive capabilities (i.e., over 6 seconds) for surrounding HDVs. Interestingly, the safety performance does not continue to improve with the increase in prediction horizon once the optimal safety performance (highest TTC and lowest DRAC) has been achieved for both normal and aggressive styles. This suggests that an excessively long prediction horizon (e.g., 30 seconds) is not always beneficial for safety performance of ADS in our case study. When ADS encounter aggressive HDVs, having a predicted surrounding HDV trajectory can extremely reduce crash risk and maintain a safe situation. This demonstrates that planning ADS trajectories with HDV predictions has significant effects on safety, especially for aggressive driving styles as compared to normal driving styles.
Article
Full-text available
A trajectory planning method for local obstacle avoidance based on an improved artificial potential field (APF) method is proposed, which is aimed at the problem for dual motor driven unmanned tracked vehicles avoiding dynamic and static obstacles in unstructured environments. Firstly, in traditional artificial potential fields, by adding virtual target points, unmanned tracked vehicles can avoid large obstacles and reach the target point in off-road environments. Secondly, a water droplet type repulsive potential field function for static obstacles and an improved dynamic obstacle potential field function including relative velocity function and relative acceleration function are established in the proposed improved APF method to improve the smoothness of lane changing obstacle avoidance paths. The simulation results of overtaking and obstacle avoidance in the same direction show that the change in heading angle is reduced by 42.9%, and the lateral displacement is reduced by 39.5%. Finally, a trajectory planning method based on improved APF for obstacle avoidance and lane changing of the unmanned tracked vehicle is constructed, which also considers the speed planning with kinematic and dynamic constraints. For obstacle avoidance under lateral meeting condition, the collaborative simulation results of Prescan-Adams-Matlab/Simulink show that the change in heading angle is reduced by 84%, and the lateral displacement is almost zero. Under complex working conditions with multiple static and dynamic obstacles, the results of hardware in loop (HIL) simulation testing and vehicle experiments show that the number of drastic changes in turning radius and heading angle of the vehicle is significantly reduced, and the maximum amplitude was reduced by 63.2% and 37.5% respectively, making the vehicle’s obstacle avoidance and lane changing safer, smoother, and more efficient.
Article
Motion planning is a crucial and challenging step in autonomous driving navigation tasks. Since traditional motion planning methods largely rely on complex hand-crafted designs, recent research has shifted focus to simple and effective learning-based methods. However, most of the existing learning-based methods primarily employ end-to-end networks to directly generate trajectories or control commands, which may not satisfy vehicle kinematic constraints. These kinematically infeasible outputs cause autonomous driving vehicles deviating from the intended trajectories, significantly impacting both ride comfort and task completion. In this paper, we propose a new Feasible And Smooth Tree (FAST) to concentrate on the generation and utilization of trajectory tree. This trajectory tree structure possesses curvature continuity and kinematic feasibility, making it a cluster of feasible and smooth trajectories that can represent various intentions for traffic participants. Moreover, by employing the trajectory tree as the outputs for both motion planning and auxiliary trajectory prediction tasks, FAST effectively integrates the trajectory tree into a multi-task framework to improve its performance. We evaluate FAST in the closed-loop urban driving setting using the different scenarios provided by CARLA simulator. Experimental results demonstrate that FAST outperforms other learning-based methods while maintaining high efficiency.
Article
In autonomous driving, an accurate understanding of the environment, e.g., the vehicle-to-vehicle and vehicle-to-lane interactions, plays a critical role in many driving tasks, such as trajectory prediction and motion planning. Environment information comes from high-definition maps and historical trajectories of vehicles. To interpret and utilize such information for the two aforementioned driving tasks, both learning-based models and mathematical methods have been proposed, while these existing approaches suffer from the following issues. Specifically, due to the heterogeneity of the map data and trajectory data, many learning-based models extract vehicle-to-vehicle and vehicle-to-lane interactions in a separate and sequential manner, which may capture biased interpretations of interactions, causing lower prediction and planning accuracy. As for the mathematical models, the environment information is mainly used to characterize the collision-free space, while the interactions are largely ignored. To address the above issues, we propose an environment representation, called Temporal Occupancy Flow Graph (TOFG). Specifically, TOFG unifies the map information and vehicle trajectories into a homogeneous data format and enables a consistent prediction. We incorporate TOFG with a graph attention (GAT) based neural network and propose TOFG-GAT to demonstrate the benefit of TOFG to learning-based trajectory prediction and motion planning. Moreover, we design and implement an interaction-aware sampling strategy based on TOFG to improve the mathematical sampling-based motion planning algorithms. Extensive experiment results show that our proposed TOFG can contribute to the trajectory prediction and motion planning tasks by improving the quality of the generated trajectory and computation efficiency for both the learning-based and mathematical models. Extensive experiment results show that our proposed TOFG can contribute to the trajectory prediction and motion planning tasks by improving the quality of the generated trajectory and computation efficiency for both the learning-based and mathematical models.
Conference Paper
Full-text available
In this paper, an algorithm for dynamic path generation in urban environments is presented, taking into account structural and sudden changes in straight and bend segments (e.g. roundabouts and intersections). The results present some improvements in path generation (previously hand plotted) considering parametric equations and continuous-curvature algorithms, which guarantees a comfortable lateral acceleration. This work is focused on smooth and safe path generation using road and obstacle detection information. Finally, some simulation results show a good performance of the algorithm using different ranges of urban curves. The main contribution is an Intelligent Trajectory Generator, which considers infrastructure and vehicle information. This method is recently used in the framework of the project CityMobil21, for urban autonomous guidance of Cybercars.
Conference Paper
Full-text available
The presence of autonomous vehicles on public roads is becoming a reality. In the last 10 years, autonomous prototypes have been confined in controlled or isolated environments, but new traffic regulations for testing and direct automotive companies interests are moving autonomous vehicles tests on real roads. This paper presents a test on public urban roads and freeways that was held in Parma on July 12, 2013. This was the first test in open public urban roads with nobody behind the steering wheel: the vehicle had to cope with roundabouts, junctions, pedestrian crossings, freeway junctions, traffic lights, and regular traffic. The vehicle setup, the software architecture, and the route are here presented together with some results and possible future improvements.
Article
Full-text available
This paper proposes a map generation algorithm for a precise roadway map designed for autonomous cars. The roadway map generation algorithm is composed of three steps, namely, data acquisition, data processing, and road modeling. In the data acquisition step, raw trajectory and motion data for map generation are acquired through exploration using a probe vehicle equipped with GPS and on-board sensors. The data processing step then processes the acquired trajectory and motion data into roadway geometry data. GPS trajectory data are unsuitable for direct roadway map use by autonomous cars due to signal interruptions and multipath; therefore, motion information from the on-board sensors is applied to refine the GPS trajectory data. A fixed-interval optimal smoothing theory is used for a refinement algorithm that can improve the accuracy, continuity, and reliability of road geometry data. Refined road geometry data are represented into the B-spline road model. A gradual correction algorithm is proposed to accurately represent road geometry with a reduced amount of control parameters. The developed map generation algorithm is verified and evaluated through experimental studies under various road geometry conditions. The results show that the generated roadway map is sufficiently accurate and reliable to utilize for autonomous driving.
Article
Full-text available
In developing automatic platooning of trucks as an energy-saving technology, the reliable driving of the platooned trucks is a primary objective for public implementation and future applications. At the same time, there is also an emergency requirement to ensure the safety of the driving experiment in the automatic platooning of trucks, including the conditions of a system failure. This paper presents a detailed experimental study on emergency avoidance braking for the automatic platooning of trucks using a driving simulator (DS) and an actual-vehicle experiment. In addition, a modification on the braking capability of the trucks of a platoon was applied for safety control. Therefore, human drivers can brake without risking a rear-end collision, in the case of an emergency for a failure in automatic platooning. Initially, an experimental platform was built to reproduce the automatic platooning of trucks in an advanced DS system. Assuming system failure and the emergency deceleration of the preceding truck without warning, the behavior of the driver in the following truck was studied in terms of emergency avoidance of a collision. In particular, with different settings for the mean maximum decelerations of the brake system of the following truck, the stopping gap distances and driver reaction times were analyzed in the driving experiment using the advanced DS and an actual vehicle. The experimental results indicated that emergency braking is an effective method for avoiding a rear-end collision when there is a system failure in the automatic platooning, resulting in the mean maximum deceleration for the following truck being higher than that for the preceding truck.
Conference Paper
Full-text available
Nowadays, the insertion of Intelligent Transporta-tion System (ITS) in the society is a fact, due to a big number of projects, demonstrations and researches that have been carried out around the world. The Cybernetic Transportation Systems (CTS) are part of the ITS, and these have especial attention thanks to its versatility, adaptability and clean energy characteristics. This paper aims to describe the evolution of the on-demand door-to-door transport systems, with Cybercars, in the framework of the IMARA team. A review of differ-ent approaches and the description of the last projects and scenarios with CTSs are considered. This work focuses in a new approach that contemplates a modular architecture, which allows parametric curve generation in real time, considering the different environment conditions-obstacle detections, shape of the road, among others. This architecture has been tested in simulations. These results promise good behavior for its future implementation in real urban scenarios, in the framework of the CityMobil2 project 1 .
Conference Paper
Full-text available
The great impact that law has on the design of software systems has been widely recognized in past years. However, little attention has been paid to the challenge of coping with variability characterizing the legal domain (e.g., multiple ways to comply with a given law, frequent updates to regulations, different jurisdictions, etc.) on the design of software systems. This position paper advocates the use of adaptation mechanisms in order to support regulatory compliance for software systems. First we show an example of how Zanshin, a requirements-based adaptation framework, can be used to design a system that adapts to legal requirements to accommodate legal variability. Then we examine how legal texts can be analyzed as sources for parameters and indicators needed to support adaptation. As motivating running example we consider legal situations concerning the Google driverless car and its recent legalization in the highways of Nevada and soon also in California.
Article
Full-text available
Generation of high-quality drive paths is a significant issue for automated wheeled vehicles. To achieve this aim for a truck and trailer vehicle, the paper proposes the use of a parameterized curve primitive, the η4-spline. Using this spline, generation and shaping of smooth feasible paths is made possible as well as the transfer between arbitrary dynamic configurations of the articulated vehicle. The η4-spline is a ninth-order polynomial curve that can interpolate given Cartesian points with associated arbitrary unit tangent vector, curvature, and first and second derivatives of curvature. It depends on a set of eight (eta) parameters that can be freely chosen to modify the path shape without changing the interpolations conditions at the path endpoints. Completeness, minimality, and symmetry of the η4-spline are established. An example on a parking maneuver of the articulated vehicle is presented and the pertinent optimal path planning is also discussed.
Conference Paper
Full-text available
Driving assistance systems are progressively introduced to enhance safety and comfort in passenger vehicles. They increasingly rely on information stored in digital navigation maps. However maps can be obsolete or contain errors, resulting in malfunctions of context based driving assistance systems and possibly generating hazardous situations. This paper aims at making the vehicle able to detect and localise map errors in an autonomous manner using its embedded sensors. The proposed approach relies on the sequential generation and monitoring of residuals. The vehicle estimated trajectory is compared statistically with the geometric data in the map. The approach allows driving assistance functions to know if they can rely on the map in real-time and to store this information for future journeys. The method is very efficient in terms of computational load which makes embedded applications possible. Performance is assessed using vehicle data acquired in real traffic conditions, which is then compared with an outdated navigation map.
Conference Paper
This paper focuses on the problem of trajectory planning in an autonomous guidance application for one-way, two-lane roads. The problem is formulated in a receding horizon framework, as the minimization of the deviation from a desired velocity subject to a set of constraints introduced to avoid collision with surrounding vehicles, and to stay within the lane boundaries. As well known, this formulation can result in planning algorithms with prohibitive computational complexity, thus preventing real-time implementation. To avoid this limitation, the paper shows how the structured environment of one-way roads, can be exploited in order to formulate a low complexity receding horizon problem that can be efficiently solved in real-time. The proposed algorithm is demonstrated in simulations considering overtake manoeuvres.
Article
In curve and surface design it is often desirable to have a planar transition curve, composed of at most two spiral segments, between two circles. The purpose may be practical, e.g., in highway design, or aesthetic. Cubic Bézier curves are commonly used in curve and surface design because they are of low degree, are easily evaluated, and allow inflection points. This paper generalizes earlier results on planar cubic Bézier spiral segments which were proposed as transition curve elements, and examines techniques for curve design using the new results.