Home / Knowledge / AI in the OT

Artificial Intelligence in the OT

Quick answer

Artificial intelligence in the OT is, above all, a decision about location: where is a model allowed to run, and where is it allowed to act? A model is usually trained centrally, because that is where compute and history live. It usually runs at the edge of the network, right next to the machine, because that is where milliseconds count and process data does not need to leave the plant. The real work sits in between: turning a prediction into a recommended action that a person — and eventually the machine itself — can trust.

Reading time 8 minutesEditorial team inray Industriesoftware
On the left a cloud panel for training with historical data, on the right an edge panel for ongoing operation right at the plant; below it a comparison of response time: a cloud request takes about 150 to 300 milliseconds, an edge decision less than 10 milliseconds.

Where a decision gets made: edge or cloud

Artificial intelligence in production can run in two places: centrally in the cloud, or locally at the plant, at the so-called edge. The choice is not a matter of taste; it follows from three requirements that weigh differently in the OT than in the office.

First, latency. Even under good conditions, a cloud request needs anywhere from a few tens to a few hundred milliseconds for the round trip. For a visual inspection that is meant to stop the line before the next cycle, or a control loop adjusting a speed in real time, that is often too slow. A local decision right on the device, by contrast, costs only the time of the computation itself.

Second, data sovereignty. Process data from production is among a company’s most sensitive data — it reveals recipes, cycle times, and utilization. Whoever processes it locally does not have to send it to someone else’s data center to benefit from it. That matters especially where contractual requirements from customers, certifications, or status as an operator of critical infrastructure dictate where data may reside.

Third, availability. An edge application keeps running when the internet connection fails — a cloud application does not. In a production line that runs around the clock, that is not an edge case; it is an operating state that eventually occurs.

None of this means cloud AI has no place in the OT. It means the question has to be answered before the project, not after it.

The sentence that carries this page

A model does not have to run where it was built. It has to run where its decision is needed — and in manufacturing, that is rarely a data center.

Trained in the cloud, run at the machine

In practice, the answer is usually both, just at different points in time. Training a model — learning from large volumes of historical data — needs compute that is easier to provide centrally: many examples, plenty of storage, often specialized hardware that barely pays off for a single site. Operating the finished, trained model — so-called inference, meaning its application to new, continuously arriving values — needs little compute but does need continuity and low latency. That is usually better solved locally, on compact hardware right next to the plant, than over a permanent cloud connection.

This split is not the exception; it is the rule:

Phase Where Needs Rhythm
Training Cloud or central data center large volumes of historical data, heavy compute once, then again as needed
Operation (inference) Edge, right at the plant little compute, but low latency continuous, in real time
Monitoring Edge or central ongoing comparison values between prediction and reality continuous

The third row is the one most often overlooked. A model nobody watches loses accuracy without anyone noticing — an effect known as drift and covered in detail in our article on Industrial AI and machine learning. For the OT, an additional question comes up: who makes sure a trained model actually reaches the edge devices reliably — all of them, not just the first one?

From description to recommended action

Analytics in production typically moves through four maturity levels that build on one another. Each stage answers a different question, and each depends on the one before it.

Descriptive answers what happened: a dashboard shows temperature curves, unit counts, downtime. Diagnostic answers why it happened: a correlation between a sensor value and a rise in scrap. Predictive answers what will happen: the classic predictive-maintenance case that flags a bearing failure two weeks out. Prescriptive answers what to do: not just the warning, but the suggestion to lower the speed by five percent to avoid overheating.

Most OT projects stop at the first two stages — dashboards and reports are visible and easy to justify. But the economic leap sits between stage three and four: a prediction alone does not change a process yet. Only a recommended action concrete enough to be followed affects scrap rate, downtime, or energy use.

Four maturity levels of analytics: descriptive, diagnostic, predictive, prescriptive — the last stage is highlighted

Each stage depends on the one before it — jumping straight to a recommended action usually skips the foundation it would need to stand on.

Scalable intelligence instead of one-off solutions

A model that works on one machine is not yet a solution — it is proof that it can work at all. The step toward real impact is the second one: bringing the same intelligence to hundreds of identical machines, several lines, or several sites, without starting a separate project for each one.

Two building blocks make that possible. The first is technical: when a model is packaged like a containerized application, it can be rolled out unchanged across different edge devices, managed centrally, and swapped out via update when needed — much like an app on a phone, just without an app store and without user interaction. The second building block is structural, and it is easy to overlook: a model only transfers from machine one to machine two if both machines name their values the same way. If a value on one line is called sps-3-db12-dw4 and something else on the identical neighboring line, the model has to be rebuilt for every plant instead of simply copied.

Whoever solves both — uniform naming and containerized distribution — turns a single pilot project into a platform. Whoever solves only one of the two ends up with either many one-off solutions, or distribution without a shared language.

Who decides in the end

The closer an AI gets to taking action, the more trust it needs — and trust rarely appears all at once. In practice, a graduated approach has become the norm.

With human-in-the-loop, the model proposes an action and a person confirms it before it is carried out — for example, a maintenance suggestion that only becomes a work order after approval. With human-on-the-loop, the system acts on its own within defined limits, while a person monitors continuously and can step in at any time — for example, an automatic parameter adjustment that moves within a defined corridor and flags an overshoot instead of acting on it.

Moving from the first stage to the second is not a technical upgrade; it is an organizational decision based on demonstrated reliability — not accuracy in a test run, but experience from live operation over time.

One boundary stays untouched by any of this: functional safety is not learned. A model may observe, warn, and suggest; shutting down, when in doubt, remains the job of certified safety technology, not the model. How the European AI Act classifies AI systems in manufacturing is covered in detail in our article on Industrial AI and machine learning.

Implementation with pronubes

pronubes does not supply an AI model. The platform supplies the infrastructure without which a model in the OT can neither be reliably fed with data nor brought to effect in a controlled way.

pronubes Edge connects machines, sensors, and systems through standard connectors — OPC UA, MQTT, REST, SQL, file formats — and is a natural place to run a trained model close to the plant instead of sending every request beyond the factory network.

pronubes Zones holds the uniform naming that carries a model from the first plant to the second — the prerequisite for the scaling described in the previous section.

pronubes Insights shows which source is delivering, which has gone quiet, and how current a value is — the monitoring of input data without which neither drift nor a silent outage gets noticed.

For connecting to AI and analytics platforms such as Snowflake, production data can be handed over in a structured form, near real time. Through an MCP server, relevant production data, context information, and functions can additionally be made available in a standardized way for AI applications and agents — so a model gets not just numbers, but the context from real production that actually makes them meaningful.

The payoff of AI in the OT does not show up in the first model on the first machine, but in how quickly the second one follows.

More about the platform

Terms explained briefly
Edge AI
Running an AI model right where the data is generated, instead of in a central data center.
Inference
Applying an already-trained model to new data — as opposed to training, where the model is still learning.
Prescriptive analytics
The stage that turns a prediction into a concrete recommended action, instead of just announcing an event.
Human-in-the-loop
A person confirms an action the AI has proposed before it is carried out.
Human-on-the-loop
The AI acts on its own within defined limits, while a person monitors and can step in.
Containerization
Packaging an application so it runs unchanged on many different devices and can be managed centrally.
Frequently asked

Frequently asked questions

Does AI in the OT have to run at the edge?

No. For analysis without a real-time requirement — a weekly quality review across several sites, for example — there is little against the cloud. As soon as milliseconds count, or data should not leave the plant, edge operation becomes a requirement rather than an option.

What happens if the internet connection fails?

A model running at the edge keeps working, because the decision is made locally. What is affected is only what already depends on connectivity: a model update, syncing with central systems, or retraining.

At what point is an AI allowed to act on its own?

Only after a phase as human-in-the-loop, which shows how reliable its suggestions actually are. Functional safety stays with certified safety technology regardless, never with the model.

How is this different from classic automation?

Classic automation follows a fixed, programmed rule. An AI model derives the rule from data and can adapt when the process changes — but that requires ongoing observation that a fixed rule does not need.

What does this have to do with the AI Act?

The classification depends on the intended purpose, not on the use of AI as such. A model that plans maintenance generally does not fall under the high-risk categories of the European AI Act; it becomes serious where a model intervenes in a safety function. Details are covered in our article on Industrial AI and machine learning.

Get started

AI that keeps deciding reliably at the edge.

30 minutes about your system landscape: where your AI runs today — and where it should run.

pronubes by inray

pronubes is a product of inray Industriesoftware GmbH. Over 30 years of industrial software from Germany. Innovative and reliable for manufacturing companies.