ML

How much data do I need for predictive maintenance?

Short answer

There is no fixed row count. The number of recorded failure events and the coverage of operating modes matter more than the number of rows. Start with condition thresholds and anomaly detection. Remaining useful life (RUL) models need run-to-failure histories, along with load, speed and dated maintenance logs.

Events and coverage, not rows

A million rows do not teach a model much about failures if only two failures are among them. When judging data volume, two questions matter more: how many failure or maintenance events are recorded, and do they cover the conditions the machine runs under, including low and high load, different speeds and product changes?

If all the failures happened under one operating condition, the model learns that condition and little else, and a large row count can hide this. Sampling must also be consistent: the same sensors, at the same rate, with trustworthy timestamps. Irregular or gap-filled records shrink the usable data without any warning.

Hypothetical count

Suppose a plant has 50 pumps, each logged hourly for two years.

  • Row count: 50 × 2 × 8 760 = 876 000 hourly rows.
  • Failure count: the logs hold only 2 failures in those two years.

So the table has 876 000 rows but only 2 failure events, about 438 000 rows per failure. If one failure happened at high load and one at low load, a remaining useful life (RUL) model still has too few failure histories to learn the degradation path. The row count looks large; the event count does not.

What to start with, and common mistakes

Start with the data you have. Condition thresholds on a single measurement, such as a vibration level checked against the machine’s own baseline, need little history. Anomaly detection, as described in the other questions here, needs a clean normal period. Remaining useful life models need run-to-failure histories and a defined failure threshold, which many plants do not yet have.

Common mistakes include confusing row count with evidence, mixing maintenance records with undated entries, and assuming public data stands in for your own. The Case Western Reserve University Bearing Data Center offers bearing measurements for practice. It helps test methods, but it does not replace the history of your own machines.

Follow-up questions

How many failures does a remaining useful life model need?

There is no universal number. What matters is how many failures cover each operating condition and degradation path. A handful of failures usually gives very wide uncertainty bands, and the width itself tells you how much the data can support. Report the band rather than a single estimate.

Does anomaly detection need as much data as RUL?

Usually less. Anomaly detection needs a representative normal period that includes the operating modes the machine really runs in, but it does not need recorded failures. If the normal data omits a mode, the model will mistake that mode’s routine behaviour for an anomaly.

Sources

Example numbers are hypothetical, not measured field results.

Related questions

All questions