ArticlePDF Available

Gaussian Process Regression Feedforward Controller for Diesel Engine Airpath

Authors:

Abstract and Figures

Gaussian Process Regression (GPR) provides emerging modeling opportunities for diesel engine control. Recent serial production hardwares increase online calculation capabilities of the engine control units. This paper presents a GPR modeling for feedforward part of the diesel engine airpath controller. A variable geotmetry turbine (VGT) and an exhaust gas recirculation (EGR) valve outer loop controllers are developed. The GPR feedforward models are trained with a series of mapping data with physically related inputs instead of speed and torque utilized in conventional control schemes. A physical model-free and calibratable controller structure is proposed for hardware flexibility. Furthermore, a discrete time sliding mode controller (SMC) is utilized as a feedback controller. Feedforward modeling and the subsequent airpath controller (SMC+GPR) are implemented on the physical diesel engine model and the performance of the proposed controller is compared with a conventional PID controller with table based feedforward.
Content may be subject to copyright.
International Journal of Automotive Technology, Vol. ?, No. ?, pp. ??(year) Copyright © 2000 KSAE
Serial#Given by KSAE
GAUSSIAN PROCESS REGRESSION FEEDFORWARD CONTROLLER
FOR DIESEL ENGINE AIRPATH
Volkan ARAN1,3, Mustafa UNEL2,3*
1) FORD OTOSAN Sancaktepe Engineering Center, Akpınar Mah. Sancaktepe Istanbul Turkey
2) Integrated Manufacturing Technologies Research and Application Center,
Sabanci University, 34956, Istanbul, Turkey.
3) Faculty of Engineering and Natural Sciences, Sabancı University, Istanbul Turkey
(Received date ; Revised date ; Accepted date ) * Please leave blank
ABSTRACTGassian Process Regression (GPR) gives emerging modeling opportunities for diesel engine control.
Recent serial production hardwares increases online calculation capabilities of the engine control units. This paper
presents a GPR modeling for feedforward part of the diesel engine airpath controller. A variable geotmetry turbine
(VGT) and an exhaust gas recirculation (EGR) valve outer loop controllers are developed. The GPR feedforward
models are trained with a series of mapping data with physically related inputs instead of speed and torque as in
conventional case. A physical model free and calibratable controller structure is proposed for hardware flexibility.
Furthermore, a discrete time sliding mode controller is utilized as a feedback controller. Feedforward modeling and
the subsequent airpath controller are implemented on the physical diesel engine model.
KEY WORDS:Gaussian process regression, Feedforward control, Discrete time sliding mode control, Airpath
control
NOMENCLATURE
i
P
: Intake manifold pressure
x
P
: Exhaust manifold pressure
c
P
: Compressor power
a
P
: Ambient pressure
R: Ideal gas constant
i
T
: Intake manifold temperature
x
T
: Exhaust manifold temperature
a
T
: Ambient temperature
i
V
: Intake manifold volume
: Turbocharger time constant
ci
W
: Compressor mass airflow
xi
W
:Exhaust gas recirculation mass flow
ie
W
: Engine inlet gas mass flow
xt
W
: Turbine inlet gas mass flow
: Fuel mass flow
c
: Isentropic compressor efficiency
T
: Turbine total efficiency
c: specific heat of air
ff
u
: feedforward control term
fb
u
: Feedback control component
EGR
Ar
: Exhaust gas recirculation valve area
xt
h
: Exhaust gas enthalpy
1
u
: Controlled input 1, Area of EGR
2
u
: Controlled input 2, Area of VGT
: isentropic ratio
VGT
r
: VGT vane position
EGR
r
:EGR valve position
* Corresponding author. munel@sabanciuniv.edu
Author
1. INTRODUCTION
Emissions control is probably the most challenging part
of the current diesel engine development process.
Tailpipe emissions is a result of aftertreatment and
engine out (feedgas) emissions. Both tailpipe and engine
out emissions are closely related to the engine airpath
control performance. One of the most harmful kind of
exhaust emission gases is nitrogen oxides (NOx).
Exhaust gas recirculation (EGR) system is a major
engine out NOx reduction element in diesel engines
(Heywood 2000). Higher combustion temperature
favours NOx formation. Combustion temperature
reduction requires lower oxygen concentration and
increased gas heat capacity which are mainly achieved
by utilization of the EGR. However, lower temperature
and reduced oxygen concentration boosts formation of
another diesel engine emission type called particulate
matter (PM) that threatens the human health. The
described trade-off emphasizes the importance of
precise airpath control.
Fresh air is pumped to the engine via turbocharger.
Modern diesel engines utilize geometry turbochargers
(VGT) for higher boost build up performance and
optimized pumping loss. Turbocharger harvests the
waste heat after exhaust stroke and uses the energy for
pumping air into the engine. VGT actuator governs the
energy that is being harvested through the turbine and
changes the exhaust manifold and intake manifold
pressures. EGR line gas flow is driven by the pressure
difference between intake and exhaust manifolds and
shares the total exhaust flow with the turbine. As a
result, VGT and EGR systems are closely coupled. Also
the airpath has non-minimum phase behavior which
creates challenge in obtaining inverse models
(Kolmanovsky 1997).
Although selection of output is another line of
research examined by several authors (e.g. Nieuwstadt
et. al. 2000, Wahlstrom and Eriksson 2013), mass air
flow (MAF) through compressor and manifold air
pressure (MAP) are the common selection of controlled
outputs of diesel engine airpath. In the practical
applications, desired values of MAF and MAP signals
are interpolated from predefined (calibrated) tables
whose axes are speed and injected fuel quantity or
desired inner torque. When one neglects low pressure
EGR or multi turbocharger configurations, diesel engine
airpath control problem can be defined as tracking MAF
and MAP desired values via manipulation of EGR and
VGT actuators despite disturbances of other engine
dynamics.
Due to its complex nature, diesel engine airpath has
been an interesting plant for control research for
decades. However, PID control with extensive gain
scheduling structure is the most common in the
industrial application softwares. Since sensors have
inevitable delayed nature and fast tracking is crucial for
engine performance and emissions, feedforward term
plays an important role in the airpath control problem. A
recent airpath feedforward control study is the dynamic
feedforward control with predetermined optimum tables
(Mancini et. al. 2014). This study utilizes speed and fuel
quantity based static feedforward maps and applies an
optimized dynamical correction on them. Suggested
implementation is explicit. Changes in the boundary
conditions such as backpressure and inlet depression is
not taken into the account and main problems of the
static mapping are unresolved while its transients are
improved.
Gaussian process regression (GPR) models are being
used for online inverse modeling of the robotic systems
(Schreiter et. al. 2016). In an automotive application,
inner loop dynamics of the throttle valve is represented
by nonlinear autoregression with exogenous inputs
(NARX) model whose nonlinear part is a GPR
(Bischoff et al. 2014). Diesel engine fuel systems
dynamics are modelled with local gaussian process
regression in (Tietze 2015) for offline model based
calibration. Current generation of an ECU supplier has
an advanced modeling unit in its ECU and online
simulation of GPR models become practical for the
automotive industry. This is a new capability for the
powertrain control development and its application
areas is expected to be broadening.
A calibratable and physical model free control
approach is sought in our work. Singularity free and
accurate inverse model for the airpath is known to be a
hard problem; therefore a data driven inherently smooth
modeling approach is favorable. On the other hand,
mapping feedforward terms with respect to the physical
states rather than operation points makes calibration
procedure robust to the boundary condition variations
such as backpressure. GPR can be seen as a gray-box
modeling procedure since it is physically interpretable
and contains prior information itself instead of a total
abstraction. This nature of the model distinguishes from
other modeling approaches from calibratability point of
view. Authors initiated feasibility study for GPR EGR
inverse model recently (Aran and Unel 2016). However,
it was only a modeling study and control aspects were
not discussed. Current study includes VGT as well, and
develops both a GPR based feedforward controller and a
discrete time sliding mode feedback controller
(Sabanovic et. al. 2003). The controller is preferred
since it does not require computation of equivalent
Author
control. All the modeling and control studies are
realized on a modeling environment called Virtual
Drive (VD). The Virtual Drive was developed and
enhanced based on (Unver et. al. 2016) and became an
inhouse vehicle and powertrain modeling software of
Ford Otosan Powertrain Controls team.
The organization of the text is as follows: Diesel
engine airptha control problem is stated in Section 2,
and the Gaussian process regression feedforward
controller ise developed in Section 3. Discerete time
sliding mode feedback control is provided in Section 4.
Both modeling and control simulations are givenh in
Section 5. Finally, the paper is concluded with several
remarks and possible future directions are indicated.
2. DIESEL ENGINE AIRPATH CONTROL
PROBLEM
A basic diesel engine airpath model is based on ideal
gas law, isentropic compressor work, conservation of
mass and throttle equation for the layout given in Fig. 1.
An engine simulation model requires 12 states to
capture dynamics of the whole engine system (Unver et.
al. 2016). However, airpath models for control can be
constructed with three states (Jankovic and
Kolmanovsky 1998, Jung et. al. 2005) or one can
include a fourth state if the throttle is included.
Figure 1 Airpath schematic of Diesel Engine (Jung et. al.
2005).
Equations (1)-(3) represent a widely used state
equations for the intake manifold pressure
i
P
, exhaust
manifold pressure
x
P
and compressor power
c
P
. MAF,
MAP, EGR position, VGT position and charge air
cooler out gas temperature sensors are generally
available in the modern serial production diesel engines.
i
e
i
iexici
i
i
iP
T
T
WWW
V
RT
P
.
.)( ++=
(1)
i
x
x
xtxifie
x
x
xP
T
T
WWWW
V
RT
P
.
.)( +++=
(2)
)(
1
.
ctc PPP =
(3)
Assuming constant temperatures (i.e.,
.
i
T
,
.
x
T
are zero)
and following the steps in the literature (Jung et. al.
2005), one can reach the control affine representation of
the form
111
.),(),( uPPbPPfP xicii +=
(4)
23122
.)(),(),( uPbuPPbPPfP xxixix ++=
(5)
243
.)(),,( uPbPPPfP xcxic +=
(6)
where
1
u
and
2
u
are control inputs which are EGR and
VGT valve areas, respectively. If MAF (Wci ) is
selected as one of the controlled outputs, then the output
equation for the MAF can be written as
)( a
i
P
P
airc
c
ci c
P
W=
(7)
In light of (4) and (6), one can obtain the following
state- space form:
uxbxfx )()( +=
(8)
3. FEEDFORWARD CONTROLLER FOR THE
AIRPATH
Engine development process gives the opportunity of
operation region mapping. That means one can obtain
nearly complete prior information of possible operation
points and related inputs. These mappings are done for
steady state operation points and also emission
modeling design of experiments includes almost all
feasible operation zone. If steady mappings, i.e. states
for which
0=x
dt
d
, are available with complete state
and controlled values, then the control effort required to
conserve the measured states are known. Therefore, in
light of (8), the feedforward control can be determined
by setting
0=x
; i.e.
Author
)(
)(
)()(0 xb
xf
ffff uuxbxf =+=
(9)
Conventionally speed and inner torque based maps are
used in the industry for the estimation of feedforward
term. This study proposes a Gaussian Process
Regression model based on physically related inputs
such as
x
P
,
i
P
and
xi
W
.
Inverse actuator model for EGR (Wahlstrom and
Eriksson 2011) based on normal operation conditions is
given by (10). In this equation
EGR
Ar
represents area of
the EGR valve which is directly related to the EGR
valve position
)( EGR
r
, which is the output of the
inverse actuator model. Obtaining desired accuracy for
the EGR flow requires introduction of further
parameters and their tuning in the aforementioned study.
=2
1
1
1
opt
x
i
i
xxi
EGR
P
P
P
RTW
Ar
(10)
Energy flow from turbine to compressor can be used for
VGT inverse model. Total efficiency for VGT based on
vane position can be defined as (11) using steady state
turbine compressor energy balance.
)(
)(
xxtxt
c
VGTT ThW P
r=
(11)
State equation (3) can be rewritten in terms of efficiency
as in (12).
))()()((
1
.
a
i
P
P
airciVGTTxxtxtccWrThWP =
(12)
As a result of presented physical modeling, input
channels for the inverse EGR model are selected as
xi PP /
,
i
P
and
xi
W
. VGT inverse model inputs are
ci
W
,
i
P
,
x
T
, respectively, and its output is the VGT
vane position
)( VGT
r
.
3.1. Gaussian Process Regression
It is assumed that the inverse actuator system is a zero
mean Gaussian process model. A Gaussian process is a
collection of random variables, any finite number of
which has a joint Gaussian distribution (Rasmussen and
Williams 2006)). The noise is assumed to be additive
independent and identically distributed, and the ouput y
is feedforward control value. The formulation detailed
in (Rasmussen and Williams 2006) will be followed in
this section.
EGR and VGT channels are seperately modelled in
multi-input single-output (MISO) fashion. Let the
relationship between inputs (
x
:
xi PP /
,
i
P
,
xi
W
;
ci
W
,
i
P
,
x
T
) and the output (y:
VGTEGR rr ,
) be given as:
+= )(xfy
,
),0( 2
N
(13)
Prior covariance on the noisy output observations
i
y
and
j
y
is defined as
ijjiji xxkyy
2
),(),cov( +=
(14)
Covariance function
),( ji xxk
is defined over input
samples
i
x
and
j
x
, and
ij
is the Kronecker delta
function. Definition of
),( ji xxk
for the squared
exponential covariance term is given as
rr
dji
T
exxk 5.0
),(
=
(15)
where horizontal scale parameter
d
is a scalar and
r
is a scaled input sample given by
T
n
ji
jiji l
xx
l
xx
l
xx
rnn
=...
21
2211
(16)
where length scale parameters
j
l
determine the weights
between input channels.
For an experiment of
m
samples, one can construct the
following covariance matrix that will be used in
subsequent analysis:
=
),(.........
...),(......
),(...),(),(
),(
12111
mm
ji
m
xxk
xxk
xxkxxkxxk
XXK
(17)
Author
Length scale “
l
” and horizontal scale “
d
” are the
main parameters of the model and they are called
hyperparameters. These parameters are found by
maximum likelihood estimation. Training values are
used for finding hyperparameters and they are also
embedded into the model through K matrix. The test
values are the simulation inputs, current states in our
case, whose outputs are calculated. Test inputs are
denoted by
*
x
. The covariance vector between
simulation point and the training points is represented
as:
 
T
m
xxkxxkxxkk ),(...),(),( *2*1** =
(18)
Predicted output
*
y
(uffegr or uffvgt ) is calculated with
(19).
yIKky T12
** )(
+=
(19)
For efficient simulation equation, (19) can be rewritten
as
T
ky ** =
(20)
where
is a vector of size
m
, and can be calculated as
)\( yLLT
=
(21)
where L is retrieved through cholesky decomposition,
)( 2IKcholeskyL
+=
(22)
Parameter optimization procedure utilizes the following
maximum likelihood cost function
)2log(2/))(log(5.0)|(log
nLtraceyXyp T=
(23)
3.2. Modeling Details
Gaussian process regression requires a space filling
design of experiment (DoE) for the inputs. Test data is
collected with engine mapping simulations by setting
speed and desired torque to grid points and waiting for
10 seconds settling, then averaging values of the last 30
seconds. Test grid of 417 points from the engine
operation region is shown in Figure 2.
Boost delay is the characteristic of the turbocharger
system, therefore mapping tests are repeated with 90%
and 80% of the base calibration MAP values as shown
in Figure 3.
Figure 2. Engine mapping operation points
Figure 3. Three mapping boost values
Training points are selected with a bin logic. Input data
is divided into bins of equal intervals and 3 values (i.e.
minimum, maximum and median of the bin) from each
bin is taken as training samples. A sample bin for EGR
model is shown in Figure 4.
Figure 4. A sample training data selection bin
Author
Training points are selected with the described logic and
rest of the data are left for the validation. Total number
of 179 training samples are selected for VGT and 1252
points are left for validation. EGR modeling required
more training data (i.e. 312 samples for training and
1164 samples for validation) yet resulted in lower
accuracy than the VGT inverse model. Model training is
done with “fitrgp” function in MATLAB. Exact method
is used with squared exponential kernel utilizing auto
relevance determination in the form of (15) and (16).
Hyperparameters
,, d
l
and
are extracted from
“fitrgp” function and simulations are executed using
equation (20).
3. DISCRETE TIME SLIDING MODE
CONTROL
One of the aims of this paper is finding a flexible
architecture in terms of related hardware’s physical
details. Although modelling of airpath is described in
terms of simplified physical equations, this information
is used only for input selection. Similarly extensive use
of physical modelling is avoided in the feedback control
as well. A discrete-time sliding mode controller
developed by (Sabanovic et.al. 2003) is employed in
this work. This controller does not require computations
of equivalent control, and therefore detailed physical
modelling is not necessary. For a control affine system
as given in (4-6), a sliding surface can be defined as
(24). The discrete-time sliding mode control law is
given in (25). Controller sensitivity matrix B is the only
plant related information.
)()( xxCxx refref +=
(24)
))1()1(()()1()( 1+= tDtGBtutu
(25)
where
D
and
C
are design parameters and
x
G
=
.
The whole control effort consists of GPR feedforward
and sliding mode type feedback controller as depicted in
Fig.7.
Figure 5 Overall control diagram
Simulation results are presented in the next section for
MAF and MAP outputs.
4. RESULTS
Simulation model is a 13L heavy duty diesel engine
model. WHTC (world harmonized test cycle) is the
certification test cycle for dynamometer homologation
of heavy duty diesel engines in Europe (UN ECE 2013).
Thus, WHTC is selected for controller performance
analysis. Normalized speed (n_norm) and torque cycle
(M_n) is presented in Fig. 8.
Figure 6 WHTC in speed (n_norm) and torque
(M_norm) (UN ECE 2013)
Validation results for VGT and EGR valve position
estimations are depicted in Fig. 7 and Fig. 8 respectively.
Although less training samples are used for VGT
inverse model fitting (feedforward for MAP control), its
validation accuracy is higher than EGR inverse model
(feedforward for MAF control).
Figure 7. Validation Fit Results for VGT
Author
Figure 8. Validation Fit Results for EGR
Since there are cross-talks between model based
feedforward term and feedback control, individual
performance of the sliding mode feedback controller is
analyzed first. Base performance of the sliding mode
feedback controller is checked on WHTC cycle as
depicted in Fig.9-10 where a 60 sec section
corresponding to high torque gradients is illustrated.
Figure 9 MAF tracking results for WHTC
It is clear that feecback controller provides satisfactory
performance for MAF channel while MAP control
could be improved by VGT feedforward term. Thus,
feedforward plus sliding mode feedback control for both
MAF and MAP outputs are applied in WHTC
simulation. Results for the same 60 sec section are
depicted in Fig. 11-12. Comparing these results with Fig.
9-10, it is clear that MAP channel performance is
significantly improved; but MAF performance is getting
not better due to small oscillations caused by EGR
feedforward.
Figure 10 MAP tracking results for WHTC
Figure 11 MAF tracking results for WHTC
Figure 12 MAP tracking results for WHTC
In the last simulation, feedforward is used only for MAP
channel through VGT and results are depicted in Figs.
13-14. It can be seen that MAP performance is
improved as before, and MAF tracking is still as good
as Fig. 9.
Author
Figure 13 MAF tracking results for WHTC
Figure 14 MAP tracking results for WHTC
Control efforts for the last simulation are presented in
Fig. 15.
Figure 15 Control efforts (VGT and EGR)
Overall tracking performances of the implemented
controllers with various metrics for the whole WHTC
test cycle which ends in 1800 seconds are tabulated in
Table 1.
Table 1 Results Summary
MAF
MAP
Method
bestfit
rmse
nrmse
R2
bestfit
rmse
nrmse
R2
FB (SMC)
86,86
39,67
0,03
0,98
58,72
236,96
0,10
0,83
FB+FF
(SMC+GPR)
85,63
43,58
0,03
0,98
66,55
187,18
0,08
0,89
FB+FF*
(SMC+GPR)
87,32
38,06
0,03
0,98
66,23
188,98
0,08
0,89
FB (SMC): Sliding mode feedback controller
FF (GPR): Gaussian process regression feedforward
FF*: Feedfoward is used only for VGT.
5. CONCLUSIONS
Gaussian process regression (GPR) models are being
available in real time applications of automotive serial
production hardware. Proposed models require less data
points than previous table based applications.
Feedforward has an important role in delayed systems
such as diesel engine boost (MAP) build up and its
calculation via GPR modeling improves control
performance significantly as can be seen from presented
simulation results. However, MAF control through EGR
does not show a similar characteristic, and therefore a
sliding mode feedback controller is applied without an
EGR feedforward term due to its superior performance
on WHTC.
As a future study, improved GPR models for EGR will
be investigated. GPR models for feedback control will
also be studied.
ACKNOWLEDGEMENT The authors would like to thank
Ford Otosan Powertrain Control Software team for their
support on the plant model.
REFERENCES
1. Journals
Aran V. and Unel M. (2016) Feedforward mapping for
engine control, IECON Proc. (Industrial Electron.
Conf., pp. 154159, 2016)
Bischoff B., Nguyen-Tuong D., Koller T., Markert H.,
and Knoll A. (2013), Learning throttle valve control
using policy search, Lect. Notes Comput. Sci.
(including Subser. Lect. Notes Artif. Intell. Lect.
Author
Notes Bioinformatics), vol. 8188 LNAI, no. PART 1,
pp. 4964, 2013.
Jankovic M. and Kolmanovsky I. (1998), Robust
nonlinear controller for turbocharged diesel engines,
Am. Control Conf. , pp. 13891394, 1998.
Jung M., Glover K., and Christen U. (2005) Comparison
of uncertainty param- eterisations for H infinity
robust control of turbocharged diesel engines,
Control Eng. Pract., vol. 13, no. 1, pp. 1525, 2005.
Kolmanovsky I. (1997), Issues in modelling and control
of intake flow in variable geometry turbocharged
engines, Proc. 18th IFIP Conf. Syst. Model. Optim.,
pp. 436445, 1997
Mancini G., Asprion J., Cavina N., Onder C., and
Guzzella L. (2014), Dynamic Feedforward Control of
a Diesel Engine Based on Optimal Transient
Compensation Maps, Energies, vol. 7, pp. 54005424,
2014.
Nieuwstadt M. J., Kolmanovsky I. V., Moraal P. E.,
Stefanopoulou A., and Jankovic M. (2000) EGR-
VGT control schemes: experimental comparison for a
high-speed diesel engine, Control Syst. IEEE, vol. 20,
no. 3
Sabanovic A., Sabanovic N., Jezernik, K. (2003) Sliding
Modes in Sampled data Systems, AUTOMATIKA, vol.
44, pp. 163-181
Schreiter J., Nguyen-Tuong D., and Toussaint M.
(2016) Efficient sparsification for Gaussian process
regression, Neurocomputing, vol. 192, pp. 2937,
2016.
Tietze N. (2015), Model-based Calibration of Engine
Control Units Using Gaussian Process Regression,
Ph.D. Thesis, Vom Fachbereich Elektrotechnik und
Informationstechnik der Technischen Universität
Darmstadt
Unver B., Koyuncuoglu Y., Gokasan M., and Bogosyan
S. (2016) Modeling and validation of turbocharged
diesel engine airpath and combustion systems, Int. J.
Automot. Technol., 2016. Vol. 17, No. 1, pp. 13−34 (
2. Books
Heywood, J. (2000) Internal Combustion Engine
Fundamentals, McGraw-Hill Book Co.
Rasmussen C. E. and Williams C. (2006), Gaussian
Processes for Machine Learning, the MIT Press
online version.
4. Reports and User Guide
UN ECE (2013) E/ECE/324/Rev.1/Add.48/Rev.6-
E/ECE/TRANS/505/Rev.1/Add.48/Rev.6
... 24 Machine Learning (ML)-based surrogate modeling of internal combustion engines (ICE) has been widely used for a broad range of applications. [25][26][27][28][29] Data-driven ML approaches, in particular, are popular for building ICE surrogate models; such approaches include neural networks (NN), [30][31][32][33][34][35][36][37][38][39][40][41][42][43][44][45] Support Vector Machines (SVM), [46][47][48][49] Gaussian Processes (GPs, [50][51][52][53][54][55][56][57][58][59][60] also known as kriging 61 ), and other learning models. [62][63][64][65][66][67][68] In surrogate modeling applications with limited training runs from expensive simulators, GPs (and its recent non-stationary extensions) have several key advantages over alternate deep learning models. ...
... 52,53 Such models have also been used as virtual engines for feed-forward engine control design. 54,55,71 For instance, Dong et al. 12 used a kriging-based surrogate model (trained via experimental data) for testing a feed-forward control strategy for a two input system involving pilot injection timing (PIT) and main injection timing (MIT), and found excellent agreement in achieving the desired engine CA50. ...
Article
For energy-assisted compression ignition (EACI) engine propulsion at high-altitude operating conditions using sustainable jet fuels with varying cetane numbers, it is essential to develop an efficient engine control system for robust and optimal operation. Control systems are typically trained using experimental data, which can be costly and time consuming to generate due to setup time of experiments, unforeseen delays/issues with manufacturing, mishaps/engine failures and the consequent repairs (which can take weeks), and errors in measurements. Computational fluid dynamics (CFD) simulations can overcome such burdens by complementing experiments with simulated data for control system training. Such simulations, however, can be computationally expensive. Existing data-driven machine learning (ML) models have shown promise for emulating the expensive CFD simulator, but encounter key limitations here due to the expensive nature of the training data and the range of differing combustion behaviors (e.g. misfires and partial/delayed ignition) observed at such broad operating conditions. We thus develop a novel physics-integrated emulator, called the Misfire-Integrated GP (MInt-GP), which integrates important auxiliary information on engine misfires within a Gaussian process surrogate model. With limited CFD training data, we show the MInt-GP model can yield reliable predictions of in-cylinder pressure evolution profiles and subsequent heat release profiles and engine CA50 predictions at a broad range of input conditions. We further demonstrate much better prediction capabilities of the MInt-GP at different combustion behaviors compared to existing data-driven ML models such as kriging and neural networks, while also observing up to 80 times computational speed-up over CFD, thus establishing its effectiveness as a tool to assist CFD for fast data generation in control system training.
... Machine Learning (ML) has widely been used in favor of CFD for developing models for internal combustion engine (ICE) applications [4][5][6][7][8][9][10][11][12][13] which include optimization, as well as for engine controls development [14][15][16][17]. Kodavasal et al. [5] used an ML random forest model to study cycle to cycle variations in spark ignition engines. ...
... Bin et al. [19] found GPR to perform better than SVM and artificial neural networks (ANN) in their study of predicting thermal comfort index as function of environmental parameters such as air temperature and humidity. Aran et al. [14] used a GPR model for the feed-forward part of a diesel engine air-path controller. Erikkson and Nielsen [16] list physics-based regression models of embedded turbocharger maps in model-based feed-forward controller for air-path control system. ...
Conference Paper
Full-text available
Control model training is an essential step towards the development of an engine controls system. A robust controls strategy is required for engines to perform reliably and optimally under challenging conditions, such as using low cetane number fuels (vital to achieving a single fuel concept). Developing such a control strategy through physical experiments, however, can be very costly due to issues such as unexpected engine failure and manufacturing delays. One approach is to rely solely on CFD simulations for control model training, which can be accurate but places significant burden on computing resources to explore the desired control design space. Another approach is via purely data-driven machine learning models, but the training data needed to achieve desirable accuracy can also be prohibitively expensive to generate. To address this, we develop a novel physics-integrated Segmented Gaussian Process (SegGP) model, which integrates fundamental physics on the pressure curve within a flexible probabilistic learning framework. This integration of physics allows for accurate predictive modeling of pressure, heat release and thus control using limited training data, which greatly reduces computational burden. We demonstrate the effectiveness of this approach for quickening the control development training of diesel engines.
... This makes the control design approach datadriven. Few research works have been done for designing the feedforward control using the Gaussian process regression model [Aran and Unel (2018); Trojaola et al. (2020)], but the approaches do not involve model inversion. Instead, the inverse dynamics are directly modeled using the Gaussian process. ...
Article
Full-text available
An engine is a complex system that requires a control strategy to perform optimally and reliably. The majority of the existing system uses a lookup table-based control strategy, also known as feedforward tables, generated offline by performing engine calibration, which is usually an expensive process. The calibration cost can be significantly reduced using a system model, but due to the increased engine complexity, developing a physics-based model that can capture all the system modes becomes challenging. Therefore, the current work uses a data-driven approach to model a diesel engine and designs its control strategy based on it. It uses Gaussian Process Regression (GPR) to model the engine and perform system inversion to achieve the desired optimal feedforward control. Two control inputs, namely, pilot injection timing (PIT) and main injection timing (MIT), are calculated to achieve the desired combustion performance in terms of CA50 from the engine. Model inversion is done using the real-variable genetic algorithm (rGA) to obtain the optimal control strategy corresponding to the desired CA50. The study tries to address two fundamental issues for developing a data-driven control strategy for a practical system: when the model is developed using limited number of data points, and the inversion problem when multiple control settings generate the same optimal output. Finally, the proposed control strategy is validated on an actual experimental test bench, and the results show excellent performance in achieving the desired CA50 value.
... Moreover, data driven modeling have become increasingly popular in the recent years due to the abundance of data (Aran and Unel (2018), Alcan et al. (2019), Mumcuoglu et al. (2020)). Some examples of these can be seen in the works by Gao et al. (2017) and Doan et al. (2018) where uncertainties for an industrial robot were modeled and compensated using radial basis functions and neural networks. ...
Article
In this work a feedforward control approach based on SINDYc (Sparse Identification of Nonlinear Dynamics with Control) is proposed for increasing the trajectory tracking accuracy of industrial robots. Initially, the dynamic relationship between the desired and the actual trajectory is sparsely identified using polynomial basis functions. Then a new trajectory is created from the desired trajectory using a feedforward controller based on the inverse of the sparsely identified dynamic model. The effectiveness of the proposed approach is evaluated by a simulation study in which 4 different KUKA robots were tasked to follow 16 distinct trajectories based on ISO 9283 standard. The obtained results show that the proposed method successfully models the dynamic relationship between the desired and the actual trajectory with accuracies above 98.09% when all of the robots are considered. Moreover, the developed feedforward controller improves the trajectory tracking accuracy of industrial robots by at least 91.1% and 94.5% for position and orientation tracking, respectively while providing parsimonious models.
... Therefore, data driven approaches that can take the sensor noise and uncertainties in the system into account have found to be more effective. One of the most effective data based modeling techniques has been proven to be deep learning [18][19][20][21]. In this regard, many recent applications of deep learning have emerged in industrial robot applications for system identification of the nonlinear residual errors using a laser tracker [22], in process tool condition forecasting based on a deep learning method [23], prediction of arm trajectories for force limiting on industrial robots for human-robot collaboration [24], and positioning error compensation on two-dimensional manifold for robotic machining [25]. ...
Article
In this work, an eye to hand camera based pose estimation system is developed for robotic machining and the accuracy of the estimated pose is improved using two different approaches, namely Long Short Term Memory (LSTM) neural networks and sparse regression. To improve the accuracy obtained from the Levenberg–Marquardt (LM) based pose estimation algorithm, two distinct supervised data driven approaches are proposed which can take the dynamics into account during robotic machining through utilization of the torque information available from the sensors at each joint. The first one is a LSTM neural network and the second one is a method based on sparse regression. The proposed methods are validated by an experimental study performed using a KUKA KR240 R2900 ultra robot while machining a NAS 979 part, during which the orientation of the cutting tool was fixed, and free form milling, during which the orientation of the cutting tool continuously changed. A target object to be tracked by the camera was designed with fiducial markers to guarantee trackability with ±90°in all directions. The design of these fiducial markers guarantee the detection of at least two distinct non-parallel markers from any view, thus preventing pose estimation ambiguities. Moreover, in order to reduce the errors due to the construction of the camera target and placement of the markers on it, this work proposes a method for optimizing the positions of the corners of the fiducial markers in the object frame using a laser tracker. The proposed methods were compared with an Extended Kalman Filter (EKF) and the experimental results show that both of the proposed approaches significantly improve the pose estimation accuracy and precision of the vision based system during robotic machining while proving much more effective than the EKF approach. The attainable absolute position errors were 5.47 mm, 2.9 mm and 2.05 mm on average for NAS 979 machining and 5.35 mm, 2.17 mm and 0.86 mm on average for free form machining when using the EKF, the proposed LSTM network and the proposed sparse regression approaches, respectively. Moreover, the proposed sparse regression based method provides parsimonious models and better results when compared with the proposed LSTM based approach.
Article
Purpose The purpose of this study is to address the issue that the traditional V-shaped ball valve profile shape is limiting the flow control characteristics in a series structure and to optimize the design profile by proposing an open-hole profile. Design/methodology/approach This paper proposes a Gaussian process regression surrogate model based on the genetic algorithm optimization of swarm intelligence, combined with the Expected Improvement point addition criterion, to optimize and correct the design profile. The flow regulation performance of the optimized V-shaped regulating ball valve is verified through a combination of numerical simulation and experiment. Findings The results demonstrate that the optimized V-shaped regulating ball valve has higher flow regulation accuracy and a more stable flow regulation process. After optimization, the flow characteristic curve of the spool is closer to the ideal equal percentage characteristic. The simulation results of the flow field are consistent with the experimental results. Originality/value The proposed method significantly reduces the optimization time, has higher efficiency and solves the problem that traditional optimization methods struggle with, which is ensuring optimal flow regulation performance. Compared to the traditional trial-and-error optimization method, the proposed method is more effective. The feasibility of the method is supported by experimental results.
Article
This article proposes a novel adaptive robust control approach based on Gaussian processes (GPs) for the high-precision tracking problem of uncertain Euler-Lagrange (EL) systems with time-varying external disturbances. Given a prior dynamic model, the GP regression (GPR) technique is employed to obtain a nonparametric data-based uncertainty model, including its probabilistic confidence intervals. Based on the adaptive sliding mode control (ASMC) framework, the posterior means of GPs are utilized for dynamic compensation, whereas the posterior variances are applied to adjust the feedback gains. This proposed control strategy is robust against significant system uncertainty with low feedback gains. A novel adaptive law for updating hyperparameters based on tracking error feedback is presented, thereby improving the performance of both tracking control and GP modeling simultaneously. Compared to existing likelihood-based optimization methods, this hyperparameter adaptive law enables data-efficient and fast uncertainty learning for control applications. The proposed control strategy guarantees the semiglobal asymptotic convergence to zero tracking error with a specified probability. Simulations using an underwater robot model demonstrate that the utilization of GPs and hyperparameter adaptive law significantly improves the performance of tracking control and uncertainty learning.
Article
Complexity of engine control systems is continuously growing due to an increased number of subsystems and the need for robust performance. For traditional map-based as well as state-of-the-art model-based approaches, this will lead to unacceptable development costs and time for future engines. Parametrization of the embedded models using supervised learning regression methods can immensely reduce the number of calibration parameters and hence the calibration effort. However, a methodology for performance assessment of different promising data-driven modelling methods for engine control development is currently lacking. In this paper, a systematic methodology that assesses model inaccuracy, and also implementation aspects such as calibration effort and computational complexity is introduced. This method is applied to assess the potential of Supervised Learning (SL) methods for parametrizing the feedforward controller of a modern diesel engine air-path controller. Using requirements analysis and the specified performance criteria, two regression methods were selected: artificial neural networks (ANN) and support vector machines (SVM). After careful data selection and model training, performance is compared with the benchmark controller, which uses a physics-based model. From simulation results, it is shown that a 97% reduction in the number of calibration parameters with both regression models can be realized. For a standard test cycle, cumulative engine out NOx emissions with regression based controllers are close to the allowable inaccuracy of 10% compared to the benchmark controller. Among the two methods, ANN shows the best performance for the studied performance criteria of inaccuracy, number of calibration parameters and computational complexity.
Article
Increasingly strict legislation for greenhouse gas and real-world pollutant emissions makes it necessary to develop fuel-efficient and robust control solutions for future automotive engines. Today’s engine control development relies on traditional map-based and model-based control approaches. Due to growing system complexity and real-world requirements, these expert-intensive and time-consuming approaches are facing a turning point, which will lead to unacceptable development time and costs in the near future. Artificial Intelligence (AI) is a disruptive technology, which has interesting features that can tackle these challenges. AI-based methods have received growing interest due to the increasing availability of data and the success of AI applications for complex problems. This paper presents an overview of the state-of-the-art in Machine Learning (ML)-based methods that are applied for engine control development with focus on the time-consuming calibration process. The overview here shows that the vast majority of studies concentrates on regression modelling to model complex processes, to reduce the number of model parameters and to develop real-time, ECU implementable models. The identified promising directions for future ML-based engine control research include the application of reinforcement learning methods to on-line optimize engine performance and guarantee robust performance and unsupervised learning methods for data quality monitoring.
Conference Paper
Full-text available
The throttle valve is a technical device used for regulating a fluid or a gas flow. Throttle valve control is a challenging task, due to its complex dynamics and demanding constraints for the controller. Using state-of-the-art throttle valve control, such as model-free PID controllers, time-consuming and manual adjusting of the controller is necessary. In this paper, we investigate how reinforcement learning (RL) can help to alleviate the effort of manual controller design by automatically learning a control policy from experiences. In order to obtain a valid control policy for the throttle valve, several constraints need to be addressed, such as no-overshoot. Furthermore, the learned controller must be able to follow given desired trajectories, while moving the valve from any start to any goal position and, thus, multi-targets policy learning needs to be considered for RL. In this study, we employ a policy search RL approach, Pilco [2], to learn a throttle valve control policy. We adapt the Pilco algorithm, while taking into account the practical requirements and constraints for the controller. For evaluation, we employ the resulting algorithm to solve several control tasks in simulation, as well as on a physical throttle valve system. The results show that policy search RL is able to learn a consistent control policy for complex, real-world systems.
Article
Full-text available
To satisfy the increasingly stringent emission regulations and a demand for an ever lower fuel consumption, diesel engines have become complex systems with many interacting actuators. As a consequence, these requirements are pushing control and calibration to their limits. The calibration procedure nowadays is still based mainly on engineering experience, which results in a highly iterative process to derive a complete engine calibration. Moreover, automatic tools are available only for stationary operation, to obtain control maps that are optimal with respect to some predefined objective function. Therefore, the exploitation of any leftover potential during transient operation is crucial. This paper proposes an approach to derive a transient feedforward (FF) control system in an automated way. It relies on optimal control theory to solve a dynamic optimization problem for fast transients. A partially physics-based model is thereby used to replace the engine. From the optimal solutions, the relevant information is extracted and stored in maps spanned by the engine speed and the torque gradient. These maps complement the static control maps by accounting for the dynamic behavior of the engine. The procedure is implemented on a real engine and experimental results are presented along with the development of the methodology.
Article
Full-text available
A mean-value model of a diesel engine with a variable-geometry turbocharger (VGT) and exhaust gas recirculation (EGR) is developed, parameterized, and validated. The intended model applications are system analysis, simulation, and development of model-based control systems. The goal is to construct a model that describes the gas flow dynamics including the dynamics in the manifold pressures, turbocharger, EGR, and actuators with few states in order to obtain short simulation times. An investigation of model complexity and descriptive capabilities is performed, resulting in a model that has only eight states. A Simulink implementation including a complete set of parameters of the model are available for download. To tune and validate the model, stationary and dynamic measurements have been performed in an engine laboratory. All the model parameters are estimated automatically using weighted least-squares optimization and it is shown that it is important to tune both the submodels and the complete model and not only the submodels or not only the complete model. In static and dynamic validations of the entire model, it is shown that the mean relative errors are 5.8 per cent or lower for all measured variables. The validations also show that the proposed model captures the system properties that are important for control design, i.e. a non-minimum phase behaviour in the channel EGR valve to the intake manifold pressure and a non-minimum phase behaviour, an overshoot, and a sign reversal in the VGT to the compressor mass flow channel, as well as couplings between channels.
Conference Paper
We give a basic introduction to Gaussian Process regression models. We focus on understanding the role of the stochastic process and how it is used to define a distribution over functions. We present the simple equations for incorporating training data and examine how to learn the hyperparameters using the marginal likelihood. We explain the practical advantages of Gaussian Process and end with conclusions and a look at the current trends in GP work.
Article
The ultimate aim of this study is the development of an engine modeling approach that would facilitate the design of model-based control techniques for diesel engines. This will allow for the development of more generalized, modular control strategies for different engine types and sizes as opposed to the commonly practiced map-based engine control strategies that depend on maps and feedforward control and require lengthy modifications every time a change is made. Also, most engine modeling studies focus on either airpath or combustion systems, treating these models and their validation individually, and not as an integrated system as is actually the case. To address the need for more realistic models suitable for model-based control design, this study develops a combined airpath and combustion model for the engine, using analytical models wherever possible and derives a model with appropriate control inputs and outputs that could be used in a control scheme. The inclusion of the actuator dynamics of the Exhaust gas recirculation (EGR), variable geometry turbine (VGT), and Throttle (THR) valves in the airpath model and the consideration of nonlinearities in the combustion model allow for the development of a more thorough engine model, as well as the validation of subsystems and the whole integrated engine model using a complete World Harmonized Transient Cycle (WHTC). This test cycle finds limited use due to its challenging transients, and yet, is the demanded test cycle for emission regulations nowadays. These are unique aspects of this modeling study, the results of which indicate that the developed engine model could be used in control design and hardware-in-the-loop simulation (HILS) based engine control prototyping.
Article
Control of exhaust gas recirculation (EGR) and variable geometry turbine in diesel engines is a challenging problem and model predictive control (MPC) seems to be a promising method. In MPC the choice of output variables, and thereby the criterion, has a direct impact on the optimization problem to solve and the resulting control performance. Different selections of outputs are investigated and discussed, proposing that it is beneficial to include EGR-fraction and pumping losses in the criterion while having the oxygen/fuel ratio as a constraint. The rational for this constraint is that, in diesel engines, it is allowed to have the oxygen/fuel ratio larger than a set-point. The proposed design also includes integral action of the EGR-fraction to handle model errors and prediction of engine load and speed. A comparison is made between the proposed MPC, a proportional-integral-derivative (PID) controller, and an MPC with intake manifold pressure and compressor flow as outputs, which is the common choice in the literature. Comparisons are performed in simulation on the European transient cycle showing the following two points. First, the proposed design gives 9% lower oxygen/fuel ratio error, 80% lower EGR-error, and 12% lower pumping losses compared to an MPC design with intake manifold pressure and compressor flow as outputs. Second, the proposed design gives 9% lower EGR-error and 6% lower pumping losses compared to a control structure with PID controllers with oxygen/fuel ratio and EGR-fraction as the main outputs.