All articles
Engineering Standards

Safety-Driven Industries Measure Twice.

Enterprise Software Does Not.
Younes Aatif
Younes Aatif
Founder & CEO, Flowsiti
12 min read

There is a principle that every serious engineering discipline treats as non-negotiable: prove the design before you build from it.

Not review it. Not approve it. Not sign it off in a steering committee. Prove it — demonstrate, with formal rigor, that the system as designed will behave correctly under all expected conditions before a single physical element is committed to its construction.

This principle is so deeply embedded in certain industries that violating it is not just professionally negligent. It is illegal. It is career-ending. In some cases, it is criminal.

Enterprise software has never adopted this principle. And the cost of that omission is measured in billions of dollars annually, in failed transformations that were blamed on everything except the actual cause, and in a 70% implementation failure rate that has not meaningfully improved in thirty years despite dramatic advances in platform capability, implementation methodology, and consulting sophistication.

How Serious Industries Handle This

Consider what happens in industries where the cost of getting it wrong is immediate, visible, and unambiguous.

In structural engineering, no building is constructed without a complete structural analysis proving that the design can bear the loads it will encounter. This analysis is not a review of the architect's drawings. It is a mathematical proof — demonstrating that the materials specified, in the configuration specified, will not fail under the forces they will be subjected to. A structural engineer who stamps drawings without completing this proof is not cutting a corner. They are committing professional fraud.

In aerospace, no flight control system is certified without formal verification of its logic. The software that controls an aircraft's flight surfaces, engine management, and safety systems is not tested by flying the aircraft and seeing what happens. It is formally verified — analyzed by automated reasoning tools that prove the software will behave correctly for all possible inputs, including the inputs nobody thought to test for. A single unverified logical path in a flight control system can ground an entire fleet. The industry learned this through disasters and built the verification requirement into law.

In pharmaceutical development, no drug reaches human patients without clinical proof of efficacy and safety across a defined population. The molecule that looks promising in a laboratory model is not prescribed to patients and monitored for adverse effects. It is proved — through years of controlled trials — before any patient takes it. The cost of this proof is enormous. The alternative — discovering drug failures after widespread prescription — has been demonstrated repeatedly to be far more expensive, in lives and in liability.

In banking and financial services, no complex instrument is issued without a formal risk model that proves the exposure under defined conditions. Regulators require it. Counterparties demand it. The institution that issues a financial instrument without a proved risk model is not being agile or moving fast. It is accumulating liability that will eventually be enforced.

The pattern is consistent across every industry where the consequences of failure are immediate and unambiguous. Prove before you build. Verify before you deploy. Demonstrate structural integrity before anyone depends on the system.

What Enterprise Software Does Instead

Enterprise software has developed an elaborate alternative to proof: the approval process.

Requirements are gathered in workshops. The outputs are documented in specifications. The specifications are reviewed by stakeholders. The stakeholders provide feedback. The feedback is incorporated. The revised specifications are reviewed again. Eventually, a steering committee approves the requirements and the implementation begins.

This process feels rigorous. It produces artifacts — requirement documents, process maps, approval records, sign-off matrices — that look like evidence of due diligence. It involves expensive professionals, significant time investment, and genuine organizational effort.

It does not prove anything.

A requirements document that has been reviewed, revised, and approved by every stakeholder in the organization can still contain a circular dependency that makes the approval process it describes structurally impossible to start. A process map that has been validated by the subject matter experts who designed it can still describe a data flow in which a critical step reads from a source that does not exist at the moment of execution. A steering committee sign-off can authorize the configuration of a system on logic that is structurally incompatible with the logic already encoded in every other system in the enterprise.

None of these failures are caught by the approval process because the approval process is not designed to find them. It is designed to build organizational consensus around a set of documented intentions. Consensus is not proof. Approval is not verification. A well-governed implementation of a structurally flawed design is a well-governed failure.

Why the Standard Never Developed

The absence of formal verification standards in enterprise software is not an oversight. It is a consequence of specific historical conditions that made proof seem unnecessary and perhaps impossible.

Early enterprise software was simpler. A single-system deployment with a small number of integration points and a relatively contained set of business rules could be validated adequately through testing and observation. If the system behaved incorrectly in production, the failure was visible, locatable, and correctable at reasonable cost. The process of discovering failures through deployment rather than preventing them through verification was expensive but tolerable.

As enterprise systems grew in complexity — more integration points, more business rules, more interdependencies between systems that were designed independently and expected to operate coherently — the testing approach became progressively less adequate. The space of possible failures grew faster than the space of tests that could be designed to find them. But the industry response was not to adopt formal verification. It was to invest more in testing, more in user acceptance protocols, more in post-deployment monitoring. To find failures faster rather than to prevent them earlier.

The consulting industry that developed around enterprise software implementation had a structural interest in this approach. An implementation methodology that prevents failures through formal verification before configuration begins requires less consulting engagement than an implementation methodology that discovers failures through deployment and manages them through remediation. The market rewarded the approach that generated more billable work, not the approach that generated better outcomes.

The result is an industry that has normalized a failure rate that no other serious engineering discipline would tolerate, and has built an elaborate vocabulary of blame — insufficient executive sponsorship, poor change management, inadequate requirements gathering — to explain failures whose actual cause is consistently the same: the logic was never proved to be sound before the system was configured to execute it.

What Changes When Proof Is Required

The industries that require formal verification before deployment are not slower than enterprise software. Some of them — aerospace, automotive, medical devices — operate on innovation cycles that are genuinely demanding and produce systems of extraordinary complexity.

What they have is not slowness. They have a different sequence. The proof happens before the build, not after it. The time invested in formal verification before configuration begins is recovered many times over in the reduction of post-deployment failures, remediation costs, and implementation restarts.

In practice, this means that a formally verified organizational logic model — one in which every approval chain has been proved to have a valid entry point, every data dependency has a verified source, every authority boundary has been demonstrated to hold under all conditions — produces a configuration specification that implementation teams can execute with a confidence that no amount of requirements review can provide.

The platform configuration team is not working from assumptions that seemed reasonable to the people in the requirements workshop. They are working from proved specifications — derived from a formal model that has been demonstrated to be structurally coherent. The integrations they build are connecting systems whose logic has been proved to be compatible, not hoped to be compatible.

When something goes wrong in the implementation — and implementation is always complex, always imperfect, always subject to the friction of reality — the failure is a technical problem with a known correct solution, not a structural failure whose cause is somewhere in the unproved assumptions of the design. The proof establishes the target. The implementation works toward it.

The Standard the Industry Has Been Avoiding

The proof requirement has not been adopted in enterprise software because it surfaces contradictions that organizations would prefer to discover later, when the consequences feel less preventable and the responsibility feels more distributed.

A formal verification that proves an approval process is structurally impossible to start is an uncomfortable finding. It means the design is wrong. It means the workshops that produced the design, the stakeholders who approved it, and the consultants who documented it all failed to catch a structural impossibility that was visible in the logic all along.

Discovering this before configuration begins requires changing the design. It requires going back to the stakeholders. It requires revising decisions that were made in workshops and signed off by committees. It is disruptive in the way that all genuine quality control is disruptive — it surfaces problems at the moment when they are cheapest and least painful to fix, which is also the moment when the people responsible for the design are most resistant to the finding.

The alternative — proceeding without proof, discovering the structural impossibility six months later in production, attributing the failure to insufficient change management, and beginning the remediation engagement — is more expensive, more painful, and more damaging to the organization. It is also more comfortable in the short term for everyone involved in the design phase, because the failure appears later and its connection to the design decision is harder to trace.

Safety-driven industries made the opposite choice. They required proof before build because experience demonstrated, repeatedly and expensively, that discovering failures after deployment is categorically more costly than preventing them through verification before it.

Enterprise software has not yet made this choice. The AI agents currently being deployed across enterprise operations — executing business logic at scale, without human judgment in the loop — are about to make the cost of that choice dramatically more visible.

The structural engineer does not build the bridge and monitor for collapse. The aerospace engineer does not ship the flight control system and patch in production. The bank does not extend credit and hope the risk model was coherent.

Only enterprise software ships on assumption and calls the consequences inevitable.

They are not inevitable. They are the predictable result of an industry that has never required proof. The standard exists. The tools to apply it exist. The question is whether the enterprise will demand it before the agents execute — or discover its absence afterward.

Flowsiti applies formal verification to organizational logic before deployment. The same discipline that aerospace and banking treat as non-negotiable — applied to the business logic your systems, your agents, and your people depend on. flowsiti.com

Logic before code. Flowsiti formally validates business logic before deployment — the same discipline safety-driven industries treat as non-negotiable.
Request a Session