ML

Multivariate process monitoring with Hotelling T² and SPE

Read correlated sensors through T² and SPE together rather than one statistic, interpret contribution plots, and learn where the method’s assumptions break.

In short
  • Correlated process variables can move into a wrong combination while each one stays inside its own single-variable limits.
  • T² measures how extreme a point is within the normal model plane, while SPE measures how far it lies from that plane.
  • Both statistics depend on clean normal training data and standardised variables, and both need retraining after regime changes.

The blind spot of single-variable charts

In a pump, flow, pressure and motor current often move together. When flow rises, motor current may rise as well, and pressure depends on system resistance. If you place a control chart on each variable, all three can stay inside their own limits while the pattern they form together has broken. Single-variable charts do not see that wrong combination. Multivariate monitoring models the shared structure of the variables in one model and measures departures from it.

Two separate questions follow. The first asks how extreme the point is within normal variation. The second asks whether the normal relationship between the variables still holds. The two catch different faults, which is why this approach uses two statistics.

The model plane: PCA and standardisation

Principal component analysis (PCA) finds the main directions along which the variables move together. The first component is the direction of largest normal variation, and later components carry the remaining variation in directions perpendicular to the earlier ones. The model keeps k components; the subspace they span is called the model plane. Choose k so that it explains a sufficient share of the normal variation.

Before fitting, standardise the variables: subtract the training mean from each sensor and divide by its standard deviation. Otherwise a sensor with a large numeric range dominates the others. The training data should contain only clean, normal operation. If a fault period enters the training window, the plane treats that fault as part of normal structure.

How T² and SPE are calculated

T² measures how far a new point lies from the centre of normal variation inside the model plane. It is computed from the point’s component scores and reads as a Mahalanobis-type distance:

T² = Σ (t_i² / λ_i), for i = 1, …, k

Here t_i is the point’s score on component i, and λ_i is the variance of that component’s scores in the training data. A large T² means the point is unusually extreme within normal variation.

SPE, also called Q, is the squared distance from the point to the model plane. Let r = x − x̂ be the residual vector, where x̂ is the projection of x onto the plane:

SPE = Σ r_j²

A large SPE means the relationship between variables has moved outside the structure seen in training. It can indicate a broken correlation.

A hypothetical calculation: two statistics, two questions

The numbers below are hypothetical, and the variables are assumed to be standardised. The model has k = 2 components, and in the training data their score variances are λ1 = 4 and λ2 = 1. A new point has scores t1 = 4 and t2 = 1.5. Then:

  • T² = 4² / 4 + 1.5² / 1 = 16 / 4 + 2.25 = 4 + 2.25 = 6.25

Set a hypothetical T² limit of 9. The value 6.25 is below it, so the point looks normal inside the plane.

Now let the residual vector be r = (0.3, −0.4, 0). Then SPE = 0.3² + 0.4² + 0² = 0.09 + 0.16 = 0.25. With a hypothetical SPE limit of 0.10, the point is flagged on the SPE side.

The conclusion: the point’s position within the plane is normal, but it has left the plane. A break of this kind may be invisible when each sensor is viewed on its own chart.

Assumptions and limit values

The method assumes that relationships between variables are largely linear. If they are not, the plane does not represent the real structure, and both T² and SPE can raise false alarms. Clean training data is also essential: a fault or a post-maintenance shift inside the training window moves the normal limit with it.

Limits can be set in three ways: an approximation based on the F distribution for T², an approximation based on residual eigenvalues for SPE, or the empirical percentile of the training data. Each rests on assumptions. The empirical percentile is only as representative as the training data. After maintenance, a product change or a change of operating regime, retrain the model.

Where to start on a process

Choose a period of stable operation and record the sensors at the same sampling interval; write the units into the data dictionary. Standardise the variables, and set the number of components and the limits from training data only.

Then replay a past event with the maintenance logs. When did the model signal, and when did the maintenance team act? For each signal, look at the contribution plot and note which variable drove the departure. Interpret those notes together with the engineers who know the process. Finally, record the false-alarm rate and the average time spent reviewing one alarm; these two numbers show directly what the method is worth for your plant.

Frequently asked

What is the difference between T² and SPE?

T² measures how extreme a point is within normal variation. SPE measures how far the point lies from the model plane, which shows whether the relationship between variables has broken. A fault may raise only one of them, so monitoring both gives a fuller picture.

Does Hotelling T² require normally distributed data?

The classical limit based on the F distribution assumes that the variables are approximately multivariate normal. If the data are strongly skewed, an empirical percentile limit may be a safer starting point. In either case, check the limit against a clean normal training period.

Sources and further reading

Pilot steps in this guide are proposed engineering workflows. Examples do not constitute measured field performance.

Questions on this topic