In this chapter, we discuss so-called autoregressive processes, i.e. stationary solutions \((x_t)\) of difference equations of the form $$ x_{t}=a_{1}x_{t-1}+\cdots +a_{p}x_{t-p}+\epsilon _{t},\,\,\forall t\in \mathbb {Z}$$where \((\epsilon _{t})\) is white noise. AR models are probably the most widely used class of models for practical applications of time series analysis. Autoregressive models enable us to model processes with an “infinite” memory (i.e. where the present values of the process correlate with values that lie arbitrarily far back in time) and, in contrast to general MA\((\infty )\) processes, with a finite number of parameters. AR models are, for instance, well suited for describing processes with pronounced peaks in the spectral density. These are processes with dominating, “almost periodic” components, which can be found in many applications, for example, in electrocardiogram (ECG) signals. Moreover, any regular process can be approximated with arbitrary accuracy by an AR process if the order p is chosen large enough. Another important advantage of autoregressive processes is the simplicity of their prediction. Under the stability condition, the one-step-ahead prediction from the infinite past is simply \(\hat{x}_{t,1}=a_{1}x_{t-1}+\cdots +a_{p}x_{t-p} \). This means that the least squares prediction depends only on the last p past values and the corresponding coefficients are exactly the coefficients of the AR model. Therefore, the AR model is an explicit description of the intertemporal dependence structure. The model decomposes \(x_t\) into the part determined by the past and the innovation. Last but not least, the AR model can also be estimated in a very simple way, e.g., using the so-called Yule-Walker equations. The model can be interpreted as a regression model. This explains the name “autoregressive” and shows that the model can also be estimated with the ordinary least squares method. In the first section, we shall briefly discuss the stationary solution of the AR system under the stability condition. We already did essential preliminary work on this in the previous chapter. Next, we shall cover the prediction of AR processes from finite or infinite past and discuss the main characteristics of the spectral density of AR processes. The penultimate section focuses on the Yule Walker equations, which establish the interrelation between the parameters of the AR system and the covariance function. As stated above, these equations also form the basis for one of the most important methods used to estimate AR systems. In the last section, we will omit the stability condition and briefly discuss the stationary solutions of AR systems in general. This section will also consider special non-stationary solutions, so-called integrated and co-integrated processes, which occur in the case of a so-called unit root. One of the most important results in this context is Granger’s representation theorem.