Single Exponential Smoothing

This smoothing scheme begins by setting S2 to y1, where Si stands for smoothed observation or EWMA, and y stands for the original observation. The subscripts refer to the time periods, 1,2,…,n. For the third period, S3=αy2+(1−α)S2; and so on. There is no S1; the smoothed series starts with the smoothed version of the second observation.

For any time period t, the smoothed value St is found by computing

This is the basic equation of exponential smoothing and the constant or parameter α is called the smoothing constant.

Note: There is an alternative approach to exponential smoothing that replaces yt−1 in the basic equation with yt, the current observation. That formulation, due to Roberts (1959), is described in the section on EWMA control charts. The formulation here follows Hunter (1986).

Setting the first EWMA
The first forecast is very important The initial EWMA plays an important role in computing all the subsequent EWMAs. Setting S2 to y1 is one method of initialization. Another way is to set it to the target of the process.
Still another possibility would be to average the first four or five observations.

It can also be shown that the smaller the value of α, the more important is the selection of the initial EWMA. The user would be wise to try a few methods, (assuming that the software has them available) before finalizing the settings.

Why is it called “Exponential”?
Let us expand the basic equation by first substituting for St−1 in the basic equation to obtain

By substituting for St−2, then for St−3, and so forth, until we reach S2 (which is just y1), it can be shown that the expanding equation can be written as:

For example, the expanded equation for the smoothed value S5 is:

This illustrates the exponential behavior. The weights, α(1−α)t decrease geometrically, and their sum is unity as shown below, using a property of geometric series:

From the last formula we can see that the summation term shows that the contribution to the smoothed value St becomes less at each consecutive time period.

Let α=0.3. Observe that the weights α(1−α)t decrease exponentially (geometrically) with time.

What is the “best” value for α?

The speed at which the older responses are dampened (smoothed) is a function of the value of α. When α is close to 1, dampening is quick and when α is close to 0, dampening is slow. This is illustrated in the table below.

We choose the best value for α so the value which results in the smallest MSE.

Let us illustrate this principle with an example. Consider the following data set consisting of 12 observations taken over time:

The sum of the squared errors (SSE) = 208.94. The mean of the squared errors (MSE) is the SSE /11 = 19.0.

The MSE was again calculated for α=0.5 and turned out to be 16.29, so in this case we would prefer an α of 0.5. Can we do better? We could apply the proven trial-and-error method. This is an iterative procedure beginning with a range of α between 0.1 and 0.9. We determine the best initial choice for α and then search between α−Δ and α+Δ. We could repeat this perhaps one more time to find the best α to 3 decimal places.

But there are better search methods, such as the Marquardt procedure. This is a nonlinear optimizer that minimizes the sum of squares of residuals. In general, most well designed statistical software programs should be able to find the value of α that minimizes the MSE.