ArticlePDF Available

Dilemma game structure observed in traffic flow at a 2-to-1 lane junction

Authors:

Abstract and Figures

Using a cellular automaton traffic model based on the stochastic optimal velocity model with appropriate assumptions for both incoming and outgoing vehicle boundaries, the so-called bottleneck issue on a lane-closing section was investigated in terms of game theory. In the system, two classified driver agents coexist: C agents (cooperative strategy) always driving in the first lane and D agents (defective strategy) trying to drive in a lower-density lane whether the first or the second lane. In high-density flow, D agents' interruption into the first lane from the second just before the lane-closing section creates a heavier traffic jam, which reduces social efficiency. This particular event can be described with a prisoner's dilemma game structure.
Content may be subject to copyright.
Dilemma game structure observed in traffic flow at a 2-to-1 lane junction
Atsuo Yamauchi,*Jun Tanimoto, Aya Hagishima, and Hiroki Sagara
Interdisciplinary Graduate School of Engineering Sciences, Kyushu University Kasuga-koen, Kasuga-shi,
Fukuoka 816-8580, Japan
Received 24 October 2008; published 13 March 2009
Using a cellular automaton traffic model based on the stochastic optimal velocity model with appropriate
assumptions for both incoming and outgoing vehicle boundaries, the so-called bottleneck issue on a lane-
closing section was investigated in terms of game theory. In the system, two classified driver agents coexist: C
agents cooperative strategyalways driving in the first lane and D agents defective strategytrying to drive
in a lower-density lane whether the first or the second lane. In high-density flow, D agents’ interruption into the
first lane from the second just before the lane-closing section creates a heavier traffic jam, which reduces social
efficiency. This particular event can be described with a prisoner’s dilemma game structure.
DOI: 10.1103/PhysRevE.79.036104 PACS numbers: 89.40.a
I. INTRODUCTION
Recently, traffic flow models have been studied increas-
ingly. In order to understand significant traffic flow phenom-
ena, traffic models such as the kinetic gas theory 1, fluid-
dynamical model 2,3, car-following model 4,5, and
cellular automaton CAmodel have been developed. In par-
ticular, since 1992, when the first CA traffic model, the
Nagel-Schreckenberg model 6, was proposed, CA model
research has made extensive progress because of the model’s
simplicity and features that can reproduce real traffic flows
well. For example, the free-flow and jam phases can be ap-
proximately reproduced with the most basic CA model,
called the asymmetric simple exclusion process ASEP兲关7.
However, ASEP cannot reproduce an unstable flow phase,
called the metastable phase, which is commonly observed at
the critical density when real traffic flow switches from the
free-flow phase to congested flow. However, some advanced
CA models, e.g., the slow-start model 8or stochastic opti-
mal velocity SOVmodel 9, can reproduce this phenom-
enon.
Although numerous previous models have analyzed
simple systems without bottlenecks except at boundaries,
study on bottlenecks in real traffic has attracted many re-
searchers. For example, Li et al. 10and Gao et al. 11
introduced a model considering the effect of on-ramps. In
particular, the model introduced by Gao et al. 11can repro-
duce complex traffic flow states discussed by Kerner 12.
Moreover, a series of studies revealed that Burgers’ equa-
tion, which governs one-dimensional 1Dshock wave
propagation, is exactly equivalent to the asymptotic behavior
of elementary CA rule 184 13when Cole-Hopf transforma-
tion is applied to the ultradiscrete diffusion equation 14.
This theoretical consistency is one reason why CA traffic
models are regarded as a powerful tool for analyzing traffic
flow kinetics.
However, none of these previous studies provided a com-
prehensive understanding on real traffic flow phenomena be-
cause these models did not include the decision-making pro-
cess of the drivers. In other words, most of the studies focus
only on the kinetics of a self-driven many-particle system
and ignore the effect of drivers’ decisions on the entire sys-
tem. Beyond those backgrounds, the objectives of this paper
are to add a game theory framework as a rational decision
process to the traffic model, construct a new CA model, and
demonstrate that a bottleneck at a 2-to-1 lane junction has a
dilemma game structure.
This paper is organized as follows: in Sec. II, the traffic
model we use is explained along with basic simulation re-
sults of the SOV model with the open boundary condition. In
Sec. III, the 2-lane model that we assume is presented. In
Sec. IV, the results of the numerical experiment are shown
and discussed. Finally, a brief conclusion is provided in Sec.
V.
II. SOV MODEL
In this paper, we adopted the SOV model 9. Considering
the work by Gao et al. 11, SOV might be less plausible
when dealing with bottleneck effects. However, here we fo-
cus on whether the dilemma game structure exists in traffic
flow, not on the detailed physics of the traffic flow itself. On
the other hand, we should not adopt a simpler model which
cannot reproduce the metastable phase since bottleneck jams
relate to vehicles’ slow-start effect that is also bringing to
reproduce the metastable phase. This compels us to adopt a
relatively simple but acceptably accurate traffic model in this
study. Hence, we choose the SOV model because it is simple
to define a lane change by a driver using the model.
In the SOV model, the velocity vi
t+1 of vehicle iat time t
is defined by
vi
t+1 =1−avi
t+aVixi
t,1
where a0a1is a parameter, xis the headway, and
function Viis the optimal velocity function, which is defined
as
Vx=tanhxc+ tanh c
1 + tanh c.2
Here, cis a parameter. It is important to note that Viis
restricted to 0,1at any xand c; thus, vi
tis also restricted to
*Corresponding author; es208181@s.kyushu-u.ac.jp
PHYSICAL REVIEW E 79, 036104 2009
1539-3755/2009/793/0361046©2009 The American Physical Society036104-1
0,1if vi
0is less than 1. In other words, vi
texpresses the hop
probability i.e., a normalized velocity.
The SOV model encompasses two fundamental stochastic
submodels; i.e., when ain Eq. 1is 0, this model is the same
as ASEP 7, while in the case of a= 1, it becomes the zero-
range process 15. In these two models, we can deduce the
exact probability distribution for the configuration of ve-
hicles in the stationary state by an analytical approach.
Moreover, the SOV model has the same structure as the dis-
crete OV model, which features coupled differential equa-
tions related to both inertia and the headway effect 16,17.
These two points highlighting the SOV’s advantage in terms
of theoretical robustness led us to adopt it.
When modeling, the way we set boundary conditions is
important. In some previous models, a cyclical boundary
condition was applied because of its simplicity and plausibil-
ity for tracing basic traffic flow features. However, in a road
with a bottleneck, nonequilibrium flow can occur near the
bottleneck. To apply the cyclical boundary condition leads to
an idea that downstream of the nonequilibrium flow condi-
tion affects on the upstream flow of the bottleneck, which
seems unrealistic. To avoid this, an open boundary condition
is applied in this paper.
The scheme of the SOV model with the open boundary
condition is shown in Fig. 1. When the cell in front of ve-
hicle iis vacant, the vehicle can hop with probability vi
t+1.A
vehicle is created at the leftmost cell with probability
and
deleted at the rightmost cell with probability
. The hop
probability of the newly introduced vehicle is set as 1. Head-
way xof the furthest forward vehicle is set as . The up-
date rule is applied to parallel updates.
Figure 2shows fundamental diagrams of real traffic data
and our simulation result with a=0.01 in Eq. 1and c
=3/2 in Eq. 2. Note that the flux represented on the vertical
axis is defined by the product of the velocity and density.
Here, the system length is set as 200 cells. Figure 2a18
indicates that four traffic flow phases can be observed in the
real fundamental diagram. The most notable characteristic is
that a metastable phase, in which the flow condition drops to
that of the high-density phase even if a subtle disturbance is
added, emerges between the free-flow and high-density
phases. Some CA models cannot reproduce this feature, but
our SOV model with the open boundary condition can repro-
duce this particular characteristic, as shown in Fig. 2b.
Note that the normalized flux and density in Fig. 2bcan be
transformed to the real scale, as shown in the top and right
axes, when we assume a cell size of 5 m and a maximum
velocity of 100 km/h.
III. 2-LANE MODEL INCLUDING BOTTLENECK
In this paper, we analyze the bottleneck effect when clos-
ing lanes from double to single by means of the SOV model
under the open boundary condition. The drivers’ decision-
making process is described by game theory; i.e., we assume
that drivers have a strategy that is either cooperative or de-
fective. Cooperative drivers C agentsdrive only in the first
lane. The rules of defective drivers D agentsare as follows:
first, they are created in a lower-density lane; second, while
in an overtaking area and if the second lane has lower den-
sity than the first, they will move to the second lane; and
third, when they reach the interrupting area, they attempt to
cut into the first lane. The rules of changing lanes are as
follows: in the case of overtaking, drivers can change lanes
only when other vehicles are not present in both the adjacent
cell and one cell behind the adjacent cell; in the case of
interrupting, even if another vehicle appears one cell behind
the adjacent cell, they can change lanes with probability p.
The rules are illustrated in Fig. 3. Of course, a D agent can-
not be allowed to enter the first lane if the left adjacent cell is
occupied by another agent.
FIG. 1. Proposed SOV model considering both incoming and
outgoing open boundary conditions.
ja
ja
mph
m ph
a
a
s
s
e
e
m
m
e
e
ta
ta
st
st
ab
ab
l
l
e
e
p
p
h
h
as
as
e
e
hi
hi
gh-dens
gh-dens
i
i
t
t
y
y
pha
pha
s
s
e
e
free-fl
free-fl
ow pha
ow pha
s
s
e
e
Flux [1/5min]
(a)Observed
Density [1/km]
0
0.06
0.12
0.18
00.20.40.60.81
0
100
200
300
0100200
Flux
[
1/5min
]
Normalized Density
Density [1/km]
Norma
li
ze
d
F
l
ux
ja
ja
mph
m ph
a
a
s
s
e
e
hi
hi
gh-dens
gh-dens
i
i
t
t
y
y
pha
pha
s
s
e
e
free-fl
free-fl
ow pha
ow pha
s
s
e
e
m
m
e
e
ta
ta
st
st
ab
ab
l
l
e
e
p
p
h
h
as
as
e
e
(
b
)
Simulated
FIG. 2. Comparison of fundamental diagrams afield observed
data to bsimulated one by the proposed SOV model.
YAMAUCHI et al. PHYSICAL REVIEW E 79, 036104 2009
036104-2
The updated rules of the system within a single time step
are as follows:
1A vehicle is created with probability
. The strategy is
determined to be C or D according to the cooperation frac-
tion PC, which is one of the simulation parameters.
2The velocity of all vehicles is calculated.
3All vehicles’ moves are decided, i.e., hopping or not
for C agent and hopping or not or changing lanes for D
agent.
4Update all vehicles.
5If the newly created vehicle stays in the leftmost cell,
it is deleted.
The following results are drawn from each 30-trial en-
semble average observed from the 10 001th step to the
12 000th step. Lengths of L1= 400, L2=200, L3= 100, and
L4=20 cells are assumed. The density and flux are measured
for L2xL1because the flow efficiency should be evalu-
ated from amount the flux is in the downstream section of the
bottleneck. It is confirmed that the effect of changing L2,L3,
and L4is not very significant. We also confirm that there is a
certain dependence of L1L2on the bottleneck effect, which
is not sufficient to invalidate what we are trying to demon-
strate below.
L4
L3
Overtaking-Area;
A D-agent can move
from the 1st lane to 2nd
lane.
p
Interrupting-Area;
A D-agent can move from
the 2nd lane to 1st lane with
probability p.
L2
L4
L3
L
1
1st lane
2nd lane
FIG. 3. Assumed model with both incoming and outgoing open
boundary conditions. L1, the length of the first lane; L2, the length
of the second lane; L3, the length of the overtaking area; and L4, the
length of the interrupting area. An open circle indicates a C agent
and a closed one is a D agent.
jam phase
metastable phase
high-density
Phase
free-flow phase
α
β
metasta
bl
ep
h
ase
α
β
(c)
0.110
Normalized Flux
(b)
(a)
FIG. 4. aTwo-dimensional 2Dand b3D flow-
-
dia-
grams; gray-scale contour indicates normalized flux with an as-
sumption of cooperation fraction PC=1. cIndicates four represen-
tative traffic flow phases based on a sketch observation on a.
0.110 N
o
rmaliz
ed
Fl
u
x
β
1
0
α
1
α
β
1
0
(e)
(d)
(c)
(b)
(a)
β
1
0
α
1
α
β
1
0
β
1
0
α
1
α
β
1
1
0
β
1
0
α
1
α
β
1
1
0
β
1
0
α
1
α
β
1
1
0
FIG. 5. Flow-
-
diagram; gray-scale contour indicates normal-
ized flux. Parameters are aPc=0, bPc= 0.3, cPc=0.5, d
Pc=0.7, and ePc=1. Four symbols open and closed circles and
open and closed squaresare representative points of the free-flow
=0.05,
=0.65, jam
=0.65,
=0.05, metastable
=0.10,
=0.65, and high-density
=0.65,
=0.65phases
shown in Fig. 7.
DILEMMA GAME STRUCTURE OBSERVED IN TRAFFIC PHYSICAL REVIEW E 79, 036104 2009
036104-3
IV. RESULTS AND DISCUSSIONS
In this section, we analyze the flow state with changing
,
, and the fraction of cooperators PC.
First, consider Fig. 4. Figures 4aand 4bshow the
-
phase diagram in two and three dimensions with PC= 1, i.e.,
the system contains only C agents. Figure 4cis a sketch of
the resulting classified flow phases. First, the area character-
ized by small
and insensitivity to
can be classified as the
free-flow phase. Second, the area characterized by small
and insensitivity to
can be classified as the jam phase.
Third, the area characterized by insensitivity to both
and
can be classified as the high-density phase. Finally, the area
with the highest flux can be classified as the metastable
phase.
Figure 5shows the
-
phase diagram with a changing
fraction of cooperators PC, where we can observe normalized
flux ahead of the bottleneck. Likewise, Fig. 6shows the pay-
off difference between D agents and C agents in several co-
operation fractions. In this diagram, if the payoff difference
is positive, defecting is more rational than cooperating. Fig-
ure 7shows payoff structure functions of four representative
points that indicate the free-flow
=0.05,
=0.65, jam
=0.65,
=0.05, metastable
=0.1,
=0.65, and
high-density
=0.65,
=0.65phases these four points
are also shown in both Figs. 5and 6. The payoffs of both
strategies are evaluated by hop probabilities measured within
the L2area. Note that employing the higher payoff strategy is
more rational than using the opposite strategy from the view-
point of individual benefit. We evaluate the social profit by
0.1-0.1 0
β
α
01
1
1
1
●■
●■
0.1-0.1 0
0.1-0.1 0 0.
5
-0.5 0
0
.
8
-
0
.
80
β
α
01
1
β
α
01
1
β
α
01
1
β
α
01
1
(d)
(e)
(c)
(b)(a)
FIG. 6. Payoff difference-
-
diagram. The payoff indicates
hop probability normalized velocitydifference between D and C
agents. Each subgraph from ato eshows the result for PC
=0.1– 0.9. Four symbols open and closed circles and open and
closed squaresare representative points of the free-flow
=0.05,
=0.65, metastable
=0.10,
=0.65, jam
=0.65,
=0.05, and high-density
=0.65,
=0.65phases
shown in Fig. 7. The + and signs indicate positive and negative
areas, respectively.
0.6
0.7
0.8
0.9
1
0.06
0.07
0.08
0.09
0.1
0
0.1
0.2
0.3
0.4
0
0.01
0.02
0.03
0.04
0
0.2
0.4
0.6
0.8
00.51
0.05
0.06
0.07
0.08
0.09
0.6
0.7
0.8
0.9
1
0.01
0.02
0.03
0.04
0.05
Norma
li
ze
d
Ve
l
oc
i
tyNorma
li
ze
d
Ve
l
oc
i
tyNorma
li
ze
d
Ve
l
oc
i
ty
Norma
li
ze
d
F
l
ux
P
C
(A) free-flow
α
=0.05
β
=0.65
(B)jam
α
=0.65
β
=0.05
(D) high-density
α
=0.65
β
=0.65
Norma
li
ze
d
Ve
l
oc
i
ty
Norma
li
ze
d
F
l
ux
(C) metastable
α
=0.1
β
=0.65
Norma
li
ze
d
F
l
ux Norma
li
ze
d
F
l
ux
Normalized Flux
Normalized Velocity of D
Normalized Velocity of C
FIG. 7. Payoff structure functions of both C trianglesand D
gray circlesagents with social average line. The payoff implies
averaged hop probability normalized velocityof agents. The so-
cial average indicates a normalized flux of the traffic. aFree-flow
=0.05,
=0.65,bjam
=0.65,
=0.05,cmetastable
=0.10,
=0.65, and dhigh-density
=0.65,
=0.65phases.
Those four points are shown in both Figs. 5and 6by open and
closed circles and open and closed squares, respectively.
YAMAUCHI et al. PHYSICAL REVIEW E 79, 036104 2009
036104-4
flux observed ahead of the bottleneck. We can observe both
individual and social benefits simultaneously in Fig. 7, which
indicates social dynamics. For example, if we have a situa-
tion where the D-agent payoff is always larger than the
C-agent payoff, this inevitably leads to fewer C agents in the
society and eventually no C agents PC=0. In addition, if
the social maximum payoff is not consistent with this situa-
tion, game theory defines this as a social dilemma 19.
In the free-flow phase, there is no difference between C-
and D-agents’ payoffs, and social profit does not depend on
the fraction of cooperation, as indicated in Fig. 7a. Thus,
this has a trivial game structure, where no social dilemma
occurs 19.
Figure 7bindicates the jam phase. We may consider this
as an n-player prisoner’s dilemma nPDsince the D strategy
always dominates over the C strategy 19because the D
agents’ profit is higher than that of C agents at all fractions of
cooperation. However, this structure can never be nPD since
the social profit is almost constant, regardless of the fraction
of cooperation. This means that the jam phase has a trivial
game structure, where the strategy dynamics do not affect the
social efficiency.
Figure 7cshows the metastable phase. In PC0.6, be-
cause the D agents’ payoff is higher than that of C agents,
there is an incentive for C agents to drive in the second lane
i.e., to convert to the D strategy.InPC0.6, however,
there is no velocity difference between strategies i.e., no
incentive for C agents to change their strategy. Therefore,
the strategy dynamics based on each individual’s payoff
leads to a midway cooperation fraction around PC= 0.6. The
society cannot avoid D agents’ incursions, but the equilib-
rium favors coexisting C agents and D agents. One should
note that this internal equilibrium fraction around PC= 0.6 is
consistent with the social maximum payoff point. In this
sense, this particular game class also does not contain any
social dilemmas. This implies that in the metastable phase,
driving in the second lane to a moderate extent can improve
flow efficiency rather than all driving in only the first lane
PC=1.
Finally, Fig. 7dshows the high-density phase. Here, the
strategy payoff structure is “D dominant over C” dynamics,
similar to the jam phase, but the social maximum point is at
the fraction of cooperation PC= 0.95. This situation can be
exactly the same as nPD, namely, the social maximum pay-
off appears around PC= 1. However, the society inherently
has a robust incentive to increase D agents since D agents
can obtain higher payoff than C agents at any cooperative
fraction. Thus, D agents always increase, finally reaching
absorbed equilibrium PC= 0, where no C agents can survive.
This structure can be recognized by observing the high-
density phase area in Figs. 5and 6. Figure 6explicitly shows
that in the high-density phase, the D agents’ payoff is always
higher than that of C agents. Moreover, Fig. 5explicitly
shows that the social payoff at PC= 0 is the lowest among all
PC.
In the high-density phase, traffic flow seems so fragile
that exogenous impacts can easily lead to congestion. The
best situation having high social efficiency from an egalitar-
ian point of view is that all drivers stay in the first lane. The
society, however, cannot avoid the entry of a defecting agent
who is willing to drive in the second lane because he can
enjoy a higher payoff than C agents by adopting the D strat-
egy.
V. CONCLUSION
To clarify the social dilemma structure in traffic flow that
is one of the pure physical processes, we built a CA model
based on the SOV model with the open boundary condition
and applied it to the bottleneck problem caused by reducing
lanes from double to single. The established model contains
a game theory framework to deal with drivers’ decision-
making processes.
We found that the four traffic flow phases have various
game structures. Precisely speaking, the nPD game structure
arises in high-density phase areas, which account for most
ranges of car-creating probability
and car-deleting prob-
ability
. On the other hand, no dilemma exists at other flow
phases. In the free-flow and jam phases, there is no incentive
to drive in the overtaking lane. In situations of quite high
flow, in the high-density phase for instance, selfish drivers
changing lanes can obtain a higher payoff than altruistic
drivers staying in the first lane, but they cause a remarkable
decrease in social efficiency. In contrast to the high-density
phase, in the metastable phase, the social efficiency is likely
to increase when drivers use the overtaking lane.
What we present here implies that the social dilemma
structure that game theorists use may underlie a traffic flow
phenomenon that is believed to be a typical physics problem,
which might be interesting.
In this paper, we analyzed the bottleneck effect at closing
lanes from double to single. However, there might be lots of
other application cases. Potential bottlenecks might be one of
the examples. For example, a question if frequent lane
changes in a 1D like homogenous road without any other
obvious bottlenecks such as lane-closing, uphill, or tunnel
may also bring another social dilemma might be interesting.
We are presuming that “changing lanes” itself could call the
dilemma in a traffic flow. To figure out this is our next chal-
lenge.
1M. J. Lighthill and G. B. Whitham, Proc. R. Soc. London, Ser.
A229, 317 1955.
2B. S. Kerner and P. Konhäuser, Phys. Rev. E 50,541994.
3D. Helbing, Phys. Rev. E 51, 3164 1995.
4L. A. Pipes, J. Appl. Phys. 24, 274 1953.
5C. Gazis, R. Herman, and R. W. Rothery, Oper. Res. 9, 545
1961.
6K. Nagel and M. Schreckenberg, J. Phys. I 2, 2221 1992.
7N. Rajewsky, L. Santen, A. Schadschneider, and M. Schreck-
enberg, J. Stat. Phys. 92, 151 1998.
DILEMMA GAME STRUCTURE OBSERVED IN TRAFFIC PHYSICAL REVIEW E 79, 036104 2009
036104-5
8M. Takayasu and H. Takayasu, Fractals 1, 860 1993.
9M. Kanai, K. Nishinari, and T. Tokihiro, Phys. Rev. E 72,
035102R兲共2005.
10F. Li, Z. Y. Gao, and B. Jia, Physica A 385, 333 2007.
11K. Gao, R. Jiang, S. X. Hu, B. H. Wang, and Q. S. Wu, Phys.
Rev. E 76, 026105 2007.
12B. S. Kerner, The Physics of Traffic Springer, Berlin, 2004.
13S. Wolfram, Theory and Applications of Cellular Automata
World Scientific, Singapore, 1986.
14K. Nishinari and D. Takahashi, J. Phys. A 31, 5439 1998.
15F. Spitzer, Adv. Math. 5, 246 1970.
16M. Bando, K. Hasebe, A. Nakayama, A. Shibata, and Y. Sug-
iyama, Phys. Rev. E 51, 1035 1995.
17M. Bando, K. Hasebe, A. Nakayama, A. Shibata, and Y. Sug-
iyama, J. Phys. I 5, 1389 1995.
18Y. Sugiyama, Nagare 22,952003兲共in Japanese.
19J. Tanimoto and H. Satara, BioSystems 90, 105 2007.
YAMAUCHI et al. PHYSICAL REVIEW E 79, 036104 2009
036104-6
... Some of them also conducted a thorough examination of the system's stationary properties through a boundary-layer analysis [41][42][43]. In addition to these studies, some other cellular automata models has been applied to simulate realistic traffic flow scenarios, including multilane systems with and without lane-changing feature [44][45][46][47][48]. ...
Article
The motivation for the proposed work is drawn from the attachment-detachment observed in biological and physical transport processes that entail finite resources. We investigate the influence of limited particle availability on particle dynamics within two parallel totally asymmetric simple exclusion lanes, with one lane incorporating only particle detachment and the other considering particle attachment. We establish a theoretical framework by employing vertical mean-field theory in conjunction with singular perturbation technique. The analytical findings are supported by numerical and stochastic validation using a finite-difference scheme and the Gillespie algorithm. By utilizing these approaches, we scrutinize various stationary properties, including particle densities, phase boundaries, and particle currents for both lanes. Our analysis reveals that the complexity of the phase diagram exhibits a nonmonotonic trend in the number of stationary phases as the particle count increases. Each phase diagram is constructed with respect to the intrinsic boundary parameters, illustrating both bulk and surface transitions occurring within the lanes. The interplay between finite resources and coupling mechanisms gives rise to two phases involving upward shock in one of the lanes, while two phases exhibit synchronized downward shock in both lanes. Finally, we delve into shock dynamics to comprehend critical phase transitions occurring in the system.
... Also, the TFT and PAVLOV strategies were ranked worst in LPI than HPI, and strategies that were high-ranked in HPI were low-ranked in LPI and vice-versa. This pattern suggests that the dynamics of the PD depends on the probability of interactions, similar to the dynamics of interactions in traffic, in which the low probability of meeting again other drivers makes strategies such as Always Defect dominate drivers decisions, in a similar way as describe by Nakata et al. [18], Tanimoto and Nakamura [25] and Yamauchi et al. [29] who affirm that traffic flow involves social dilemma structures, such as that in the Chicken game or PD game. The above corroborates the importance of social dilemmas in the context of human-AI interactions, in particular with regard to AV programming, for which the incorporation of this type of rules would be useful for models that estimate the probability of a certain behavior by another vehicle. ...
Article
Full-text available
With the rapid and continuing development of AI, the study of human-AI interaction is increasingly relevant. In this sense, we propose a reference framework to explore a model development in the context of social science to try to extract valuable information to the AI context. The model we choose was the Prisoner Dilemma using the Markov chain approach to study the evolution of memory-one strategies used in the Prisoner's Dilemma in different agent-based simulation contexts using genetic algorithms programmed on the NetLogo environment. We developed the Multiplayer Prisoner's Dilemma simulation from deterministic and probabilistic conditions, manipulating not only the probability of communication errors (noise) but also the probability of finding again the same agent. Our results suggest that the best strategies depend on the context of the game, following the rule: the lower the probability of finding the same agent again, the greater the chance of defect. Therefore, in environments with a low probability of interaction, the best strategies were the 'Always Defect' ones. But as the number of interactions increases, a different strategy emerges that is able to win Always Defect strategies, such as the Spiteful/grim. In addition, our results also highlight strategies that emerge in situations in which Spiteful/grim and Always Defect were banned. These are memory-one strategies with better performance than both TFT and PAVLOV under all conditions showing behaviors that are particularly deceiving but successful. The previously memory-one strategies for the Prisoner Dilemma represent a set of extensively tested strategies in contexts with different probability of encountering each other again and provide a framework for programming algorithms that interact with humans in PD-like trusted contexts.
... The transition behavior is sometimes considered "egocentric," because the vehicle involved often attempts to maximize its chance of accelerating without considering the traffic [4]. Based on previous studies, frequent transitions may cause severe Prisoner's Dilemmas, even influencing the traffic in large areas [5,6]. If vehicle behaviors in a large area are controlled by an ITS to avoid unnecessary transitions, the overall traffic flow may be expected to improve without degrading the benefits of individual drivers. ...
Preprint
Full-text available
Transitions between two lanes often have a significant impact on various forms of road traffic. To address this problem, we have developed a two-lane asymmetric simple exclusion process model and two hypothetical traffic control strategies, to simulate a futuristic scenario where the timing and location of transitions between two lanes are highly controlled. Various scenarios were proposed to study the effectiveness of these control strategies. An optimized control strategy, whose parameters were determined through an optimization algorithm, is confirmed to effectively maximize the average traffic flow. Consequently, we may identify suitable road sections and the corresponding timings of transitions to resolve congestion in this model.
... A social dilemma is a situation in which non-cooperative decisions of all rational individuals leave them worse off than if all of them had cooperated (Dawes, 1980). Focusing on traffic flow analysis, Yamauchi et al. (2009) andNakata et al. (2010) found that social dilemmas occur when two lanes merge into one. Following their study, Tanimoto et al. (2014a,b), Tanimoto and Nakamura (2016) also observed social dilemma structures in lane-changing and route-choice problems and inferred that this dilemma can be used to analyze traffic flow. ...
Article
Full-text available
An increase in autonomous vehicles (AVs) would result in a decline in traffic congestion; however , the travel cost associated with AVs is always higher than that of manually-driven vehicles (MV). This situation is interpreted as a so-called multi-player social dilemma. This study designed an economic experiment to investigate the effect of AVs on mode choice in mixed traffic flows. Participants were informed about the cost function in both modes and were asked to choose the travel mode for more than 60 rounds. In full information (FI) treatment, participants received information about the travel costs of the AV and MV modes at the end of each round. In the partial information (PI) treatment, participants received information only about the travel cost of the mode they chose. We found that participants were sensitive to cost differences in the FI treatments. Based on inequality aversion models, we proposed a perceived cost that could better explain the experimental equilibrium. A monetary reward was provided to encourage participants to take AVs and solve social dilemmas. The results demonstrated that the reward mechanism reduces traffic congestion and increases social benefits, especially in the FI treatment. Finally, a learning model that considers inertia and perceived cost is proposed to explain the decision-making process of the participants during the experiment. The findings have implications for traffic forecasting in the mixed flow of MVs and AVs and provide insights and policy suggestions for AV management.
Article
We investigate a simple network, which has a branching-merging structure, using the totally asymmetric simple exclusion process, considering conflicts at the merging point. For both periodic and open boundary conditions, the system exhibits metastability. Specifically, for open boundary conditions, we observe two types of metastability: hysteresis and a nonergodic phase. We analytically determine the tipping points, that is, the critical conditions under which a small disturbance can lead to the collapse of metastability. Our findings provide insights into metastability induced by branching-merging structures, which exist in all network systems in various fields.
Article
How to complete a lane changing process considering various variables has always been a critical issue in the field of autonomous driving. Developing a lane-changing decision model with full consideration of the surrounding vehicles and related decision-based trajectory planning model that comprehensively weighs safety and efficiency are conducive to the driving of autonomous vehicles (AVs) under mixed autonomous vehicle and human-driven vehicle (AV-HV) environment. Under the mixed AV-HV environment, we optimize a multi-player dynamic game model considering the status of surrounding vehicles to ensure the accurate execution of lane-changing decision of AVs. Lane changing trajectory of AV is planned based on polynomial curves, which can be dynamically updated according to the real-time status of vehicles and game results. Then, a computational experiment basing on the lane changing vehicles data from NGSIM (Next Generation Simulation) is performed with proposed models. The simulation results show that the lane-changing decision and trajectory planning model developed in our research have good adaptability to lane changing process in different scenarios, which can effectively measure the driving intention of surrounding vehicles and dynamically plan a smooth trajectory line considering safety and efficiency.
Article
Transitions between two lanes often have a significant impact on various forms of road traffic. To address this problem, we have developed a two-lane asymmetric simple exclusion process model and two hypothetical traffic control strategies, to simulate a futuristic scenario where the timing and location of transitions between two lanes are highly controlled. Various scenarios were proposed to study the effectiveness of these control strategies. An optimized control strategy, whose parameters were determined through an optimization algorithm, is confirmed to effectively maximize the average traffic flow. Consequently, we may identify suitable road sections and the corresponding timings of transitions to resolve congestion in this model.
Chapter
Decision making in unsignalized traffic intersection can be challenging for autonomous vehicles. An autonomous system only depends on predefined street priorities and considering other cars as moving objects will cause the car to freeze and fail the maneuverer. Human drivers influence the cooperation of other drivers to evade such deadlock situations and convince others to change their behavior. Decision making processes should reason about the interaction with other drivers and anticipate a wide range of driver behaviors. In this paper, we present a reinforcement learning approach (Q-LEARNING) to learn how to interact with drivers with different situation. We enhanced the performance of Q-LEARNING algorithms by maintaining a belief over the level of cooperation of other drivers. We show that our drives successfully learns how to navigate with less deadlocks than without learning.KeywordsReinforcement learningQ-learningCellular automataUnsignalized intersectionTraffic flowGame theory
Article
Full-text available
High density traffic on highways and city streets consists of endless interactions among participants. These interactions and the corresponding behaviours have great impact not only on throughput of traffic but also on safety, comfort and economy. Because of this, there is a great interest in deeper understanding of these interactions and concluding the impacts on traffic participants. This paper explores and maps the world of traffic behaviour analysis, especially researches focusing on groups of vehicles called traffic swarm, while presents the state-of-the-art methods and algorithms. The conclusion of this paper states that there are special areas of traffic behaviour analysis which have great research potential in the near future to describe traffic behaviour in more detail than present methods.
Article
Full-text available
We introduce a stochastic discrete automaton model to freeway traffic. Monte-Carlo simulations of the model show a transition from laminar traffic flow to start-stop-waves with increasing vehicle density, as is observed in real freeway traffic. For special cases analytical results can be obtained.
Article
Full-text available
One-dimensional traffic flow is simulated by a cellular-automaton-type discrete model. As we increase the car density, the model shows a phase transition between a jam phase and a non-jam phase. By adding random perturbations, we found a 1/f power spectrum in the jam phase, whereas a white noise is observed in the non-jam phase.
Article
Full-text available
In this paper, we propose an ultradiscrete Burgers equation of which all the variables are discrete. The equation is derived from a discrete Burgers equation under an ultradiscrete limit and reduces to an ultradiscrete diffusion equation through the Cole-Hopf transformation. Moreover, it becomes a cellular automaton (CA) under appropriate conditions and is identical to rule-184 CA in a specific case. We show shock wave solutions and asymptotic behaviours of the CA exactly via the diffusion equation. Finally, we propose a particle model expressed by the CA and discuss a mean flux of particles.
Article
For a gentle approach to the problems connected with interacting Markov processes we review first what is known in the absence of interaction. For simplicity let S be a countable (or finite) set, and consider a countable (or finite if S is finite) collection of independent Markov processes on S,with common transition function P t (x,y), x, y ∈ S. It is natural to assume constant invariant measure, i.e., $$ \sum\limits_{{x \in S}} {{{P}_{t}}(x,y)} = \sum\limits_{{y \in S}} {{{P}_{t}}(x,y)} = 1, x,y S, t \geqslant 0. $$ (0.1)
Article
The dynamics of a line of traffic composed of n vehicles is studied mathematically. It is postulated that the movements of the several vehicles are controlled by an idealized ``law of separation.'' The law considered in the analysis specifies that each vehicle must maintain a certain prescribed ``following distance'' from the preceding vehicle. This distance is the sum of a distance proportional to the velocity of the following vehicle and a certain given minimum distance of separation when the vehicles are at rest. By the application of this postulated law to the motion of the column of vehicles, the differential equations governing the dynamic state of the system are obtained. The solution of the dynamical equations for several assumed types of motion of the leading vehicle is effected by the operational or Laplace transform method and the velocities and accelerations of the various vehicles are thus obtained. Consideration is given to the use of an electrical analog computer for studying the dynamical equations of the system.
Article
This paper uses the method of kinematic waves, developed in part I, but may be read independently. A functional relationship between flow and concentration for traffic on crowded arterial roads has been postulated for some time, and has experimental backing (§2). From this a theory of the propagation of changes in traffic distribution along these roads may be deduced (§§2, 3). The theory is applied (§4) to the problem of estimating how a ‘hump’, or region of increased concentration, will move along a crowded main road. It is suggested that it will move slightly slower than the mean vehicle speed, and that vehicles passing through it will have to reduce speed rather suddenly (at a ‘shock wave’) on entering it, but can increase speed again only very gradually as they leave it. The hump gradually spreads out along the road, and the time scale of this process is estimated. The behaviour of such a hump on entering a bottleneck, which is too narrow to admit the increased flow, is studied (§5), and methods are obtained for estimating the extent and duration of the resulting hold-up. The theory is applicable principally to traffic behaviour over a long stretch of road, but the paper concludes (§6) with a discussion of its relevance to problems of flow near junctions, including a discussion of the starting flow at a controlled junction. In the introductory sections 1 and 2, we have included some elementary material on the quantitative study of traffic flow for the benefit of scientific readers unfamiliar with the subject.
Article
A variety of nonlinear follow-the-leader models of traffic flow are discussed in the light of available observational and experimental data. Emphasis is placed on steady-state flow equations. Some trends regarding the advantages of certain follow-the-leader functionals over others are established. However, it is found from extensive correlation studies that more data are needed before one can establish the unequivocal superiority of one particular model. A discussion is given of some ideas concerning the possible reasons for the existence of a bimodal flow versus concentration curve especially for multilane highways.