In the AI Era, There Is a Growing Anti-AI Trend Nobody Is Talking About

by Nicolae Buldumac
· 05/08/2026 07:00 · 20 min read
In the AI Era, There Is a Growing Anti-AI Trend Nobody Is Talking About

Every software company on earth is racing to add AI. In one corner of the enterprise — compliance, risk, and procurement — a growing class of buyers is racing the other way. They are asking vendors to remove AI, prove it isn't there, or sign that it never will be. Here is the quiet movement reshaping who wins compliance contracts in 2026.

For two years, the only acceptable answer to "what's your AI strategy?" has been a list of features. Every category leader has rushed to put "AI-powered" on the deck. Every challenger has rushed to bolt a model into the workflow. The market has assumed, almost universally, that adding AI is the same thing as adding value.

It isn't — at least not in compliance. While Sumsub, ComplyAdvantage, Middesk, and most of the KYC/KYB category lean harder into "AI-powered" positioning, a growing number of compliance, risk, and procurement teams have started saying so out loud. Not in op-eds or on LinkedIn, but where it matters: in procurement forms, in vendor questionnaires, in the contractual fine print that decides who gets the renewal. They are asking software vendors a new question, and the answer they want is increasingly the opposite of what the rest of the market is racing to deliver.

This is the trend that no one in the AI hype cycle is talking about. It is quiet, it is well-funded, and it is reshaping how compliance contracts get won in 2026. Here is what it looks like in practice.

Two weeks ago, a procurement contact at a major tech buyer sent us an email. They were filling out their internal AI risk form before signing the renewal. The form looked something like this:

The buyer was relieved. That answer is now the easiest one to give in compliance procurement — because every other vendor in the stack is being interrogated on AI risk, and most of them cannot pass.

Welcome to the quiet correction of 2026. After two years of "AI-everywhere" marketing, enterprise buyers are pulling back. Not because AI is useless — but because compliance, risk, and procurement teams have learned the hard way that generated text is not evidence, and the bill for pretending otherwise is now visible on the balance sheet.

The $67 billion problem nobody underwrote

Here is the number the vendor pitch decks leave out.

Global enterprise losses from AI hallucinations reached $67.4 billion in 2024 — direct and indirect costs combined.

That figure, from AllAboutAI's enterprise study and corroborated by Korra's analysis, covers bad business decisions made on hallucinated content, regulatory fines, legal liability, customer trust erosion, and the salaried hours spent cleaning up after AI errors. It is not a worst-case projection. It is what already happened.

The per-employee number is more useful for budget planning. Forrester estimates each enterprise knowledge worker now costs companies roughly $14,200 per year in hallucination mitigation — fact-checking, re-verification, and rework. Microsoft's 2025 productivity data puts the time tax at 4.3 hours per employee per week. Deloitte's Global AI Survey found that 47% of enterprise AI users have already made at least one major business decision based on hallucinated content.

Stack those into a procurement TCO model and the picture is unflattering. A 500-person enterprise running AI tooling broadly is absorbing roughly $7.1M a year in verification overhead, before counting the cost of decisions made on bad information. McKinsey reports that 42% of companies abandoned most AI initiatives in 2025, up from 17% in 2024. MIT's NANDA study found 95% of pilots delivered no measurable P&L impact.

The market spent $644 billion on enterprise AI in 2025. Between 70% and 95% of those pilots, depending on how you count, failed to reach production. The hallucination problem is not an edge case. It is the median outcome.

$67.4B
Global enterprise losses to AI hallucinations, 2024
$14,200
Per-employee per-year mitigation cost (Forrester)
47%
Enterprise AI users who made a major decision on hallucinated content (Deloitte)
4.3 hrs
Per employee per week spent verifying AI output (Microsoft, 2025)

Why hallucinations are fatal in KYB and supplier verification

Hallucinations are tolerable when the cost of being wrong is low. A summarised email with a slightly off paraphrase is annoying. A creative draft that invents a metaphor is fixable. Compliance is different. Every one of the following has a binary, verifiable answer that lives in a primary source — and getting it wrong is a regulator-facing failure:

The questions AI cannot answer

Seven facts your compliance team must verify on every counterparty

  1. Is this company actually registered, and in what jurisdiction?
  2. Is the entity currently active, dissolved, or in liquidation?
  3. Is this VAT number, EIN, or LEI valid and tied to this legal entity?
  4. Who are the current directors, officers, and shareholders?
  5. Who is the Ultimate Beneficial Owner (UBO) at the 25% control threshold?
  6. Are any related individuals listed under PEPs, sanctions, or adverse media?
  7. What were the latest filed financials — and when were they filed?

You cannot answer these questions from a confidence score. You answer them from Companies House, the IRS, the Bundesanzeiger, the ONRC, OpenSanctions, and 400+ other primary registries. Each record needs the same three things: source attribution, timestamp, and an audit trail. That is what a regulator asks to see — not a "78% confident this is the director" output.

The newer the model, the worse it can get

This is the part that surprises most procurement teams. The intuition that "AI is improving so this will fix itself" is wrong on the tasks that compliance actually cares about.

OpenAI's own data on its o3 reasoning model shows it hallucinated 33% of the time on PersonQA — double the rate of its predecessor. The April 2026 ICLR paper "The Reasoning Trap" formalised the finding: training models for stronger reasoning increases tool-hallucination rates in lockstep with task gains. Smarter models, more confident hallucinations.

Worse, MIT's January 2025 research found that AI models are 34% more likely to use confident language — "definitely," "certainly," "without doubt" — when generating incorrect information than when telling the truth. The wronger the AI, the surer it sounds. That is a catastrophic property in a verification workflow where someone has to decide whether to onboard a counterparty.

The compliance failure modes

The financial damage is one thing; the operational damage is more specific. In KYB and supplier verification, an AI hallucination is not a bad summary or an awkward draft — it is a sanctioned counterparty that gets onboarded because the model invented a clean record. It is a shell entity that passes UBO screening because the model fabricated a beneficial owner. It is an invoice paid to a dissolved supplier. It is an AML report filed on content that does not match any registry record.

None of these errors are recoverable through better prompting. They are inherent to using a generative system in a verification workflow. The same query, asked of an AI versus asked of a registry, returns fundamentally different outputs:

Compliance questionWhat AI gives youWhat a verified KYB source gives you
Is this company active?Probabilistic answer based on training dataLive registry status with timestamp
Who is the UBO?"Likely" or "probable" individual, sometimes inventedNamed individual from official UBO register
Latest financial filing?Plausible-looking numbers, often fabricatedFiled accounts with submission date and source
Sanctioned or PEP?Inference, no list referenceExact match against named sanctions list with date
Audit defence?Chat log, irreproducibleSource URL, registry name, timestamp, audit trail

Hallucination rates by task type, 2026

Vendor benchmarks are measured under controlled conditions. Real compliance work is multi-source synthesis across jurisdictions — the exact tasks where models fail hardest. Sources: Stanford HAI legal benchmark; OpenAI PersonQA disclosure; ICLR 2026 "Reasoning Trap" paper; AllAboutAI 2025 enterprise study.

Hallucination rate (%) by task typeCompliance lives on the right side of this chart.0%20%40%60%80%100%Vendorbenchmark~1%Simplefactual Q&A~15%OpenAI o3PersonQA~33%Medicalsummaries~64%Legal multi-source synth~82%Cross-juris.KYB~88%Vendor benchmarks (~1%) vs. real compliance tasks (33–88%) — the gap is regulatory liability.

What "verified" actually means in 2026

Vendors throw the word "verified" around. It is mostly a marketing term. To compliance buyers — and increasingly to the procurement contracts they sign — it now has a specific meaning. Across the compliance and procurement conversations we have had over the past two quarters, the same five properties keep showing up. The first three are now appearing as contractual requirements, especially for firms operating under EU AML6, the U.S. Corporate Transparency Act, and the EU AI Act's high-risk system rules taking full effect on 2 August 2026.

  1. Source attribution. The exact registry, filing, or authority that produced each field. Not "our database." Companies House, the IRS, Bundesanzeiger, ONRC, OpenSanctions — name the source. Buyers want a registry name, a URL or filing ID, and a date — not a vendor logo.
  2. Timestamps and recency guarantees. Two timestamps, not one: when the record was retrieved from the source, and when the source itself last updated. A registry record from 18 months ago is a liability. Static datasets fail this test, and so do AI tools that synthesise from cached web pages of unknown vintage.
  3. Audit trail. A reproducible reference — filing ID, registry URL, document ID — that another reviewer can independently verify. The question being asked in vendor reviews is no longer "Does this tool work?" It is "Will this tool withstand scrutiny if challenged?" AI-generated outputs cannot reproduce themselves identically on a second run, which means they cannot be audited.
  4. Versioning. Historical states of the record, so you can show what was true on the date of the onboarding decision — even if the record has changed since.
  5. Standardisation. The same field, in the same format, across every jurisdiction. UBO data from Germany should be parseable identically to UBO data from Mexico.

None of these five properties are satisfied by a generated summary. All five are satisfied by registry-sourced data with a documented pipeline. This is the gap.

Why this trend is structural, not a fad

The pendulum is swinging. Three forces are pushing compliance buyers off the AI-everything pitch and back toward verified primary sources — and none of them are reversing in 2026.

Regulators are catching up. The EU AI Act's high-risk system obligations take full effect on 2 August 2026. Compliance and KYB tooling that makes autonomous decisions about people or businesses falls inside that scope. Vendors that can answer "no, this is registry data, not a model output" simply have less compliance burden — and their buyers know it.

Procurement is becoming AI-aware. The procurement email at the top of this article is now standard. AI-usage disclosure is a new section in vendor onboarding forms. Compliance buyers are scoring vendors on whether they use AI for the answer or for the workflow around the answer. Models are fine for routing tickets. They are not fine for deciding if a supplier exists.

The CFO has noticed. When 95% of AI pilots deliver no P&L impact (per the MIT NANDA study) and verification overhead runs $14,200 per employee per year, the AI line item gets a column in the next budget review. Aon's 2026 AI risk report explicitly recommends "human-in-the-loop review for high-stakes AI outputs" — which, for KYB, means the loop never closes if the underlying data was hallucinated to begin with. The cheaper architecture is to skip the model and pull the registry record directly.

The compliance correction in motion

Two curves moving in opposite directions: documented AI hallucination incidents on one side, enterprise demand for source-attributed data on the other. Sources: Charlotin AI Hallucination Cases Database; Law360 AI tracker; Global Database buyer-side enterprise procurement signal data, 2024–2026.

AI hallucination incidents vs. demand for verified dataIndexed scale, 2023 = 100. Both curves rising.2,0001,5001,00050002023202420252026 (proj.)~1,4005.4×AI hallucination court casesBuyer demand for verified data

How Global Database solves this

Every record is pulled directly from 400+ official government registries across 200+ countries — with source attribution, registry timestamps, and a full audit trail on every field.

No generated content. No confidence scores. No "trust the model."

See how it works →

Three ways to access

Get the data. Skip the model.

Pick the delivery method that fits your stack.

The takeaway

AI is genuinely useful for the workflow around compliance — routing alerts, summarising case files, drafting internal notes. It is not useful for the answer. The answer to "is this company registered?" lives in a registry. The answer to "who is the UBO?" lives in a beneficial ownership filing. The answer to "are they sanctioned?" lives on a list with a date.

Enterprises burned $67.4 billion in 2024 learning that lesson. 2026 is the year compliance buyers stopped paying the tuition — and started rewarding the vendors who never asked them to.

Frequently Asked Questions

1. Can I use AI to verify if a company is registered?

No. Company registration status is a binary fact held in a government registry. Asking an AI model to confirm it produces a probabilistic answer based on training data, which may be months or years out of date. To verify registration, query the official registry directly — or use a KYB platform that pulls from the registry with a timestamp and source attribution.

2. What is an AI hallucination in a compliance context?

An AI hallucination is when a generative model produces plausible-sounding but factually incorrect or fabricated output. In compliance, common examples include invented director names, fabricated registration numbers, non-existent sanctions list entries, or made-up financial filings. Stanford research has documented hallucination rates of 58–88% on complex legal and compliance queries, and OpenAI's own data shows its o3 reasoning model hallucinated 33% of the time on PersonQA.

3. Does the EU AI Act apply to KYB and compliance software?

Yes — likely as a "high-risk AI system." The EU AI Act's full obligations on high-risk systems take effect on 2 August 2026. KYB, UBO identification, and sanctions-screening tools that make automated decisions about people or businesses fall inside the scope, triggering requirements for transparency, accuracy, human oversight, technical documentation, and post-market monitoring. Vendors using registry-sourced data without generative AI in the decision step have a far simpler compliance posture — which is why many enterprise buyers now prefer them.

4. Is using AI for KYB illegal?

It is not illegal, but under the EU AI Act high-risk system obligations effective 2 August 2026, KYB tooling that makes autonomous decisions about people or businesses faces strict transparency, accuracy, and human-oversight requirements. Many compliance teams are choosing to keep AI out of the verification step entirely to avoid the regulatory burden.

5. Is AI banned from compliance workflows?

No, AI is not banned. But a growing number of compliance and procurement teams are choosing to keep AI out of the verification step itself. AI is generally accepted for the workflow around compliance — routing alerts, summarising case files, drafting internal notes, fuzzy name matching to reduce false positives. It is not accepted as the source of truth for whether a company is registered, who its UBO is, whether it is sanctioned, or what its filed financials say. Those answers are required to come from a primary source with attribution and a timestamp.

6. How do I evidence supplier verification to a regulator?

Regulators expect to see the source registry name, the date of retrieval, the data points returned, and a reproducible reference (filing ID, document ID, or registry URL). A confidence score from an AI model does not satisfy this — it is not reproducible and has no source. Use a KYB provider that exposes all of these in its data model.

7. Why are buyers now asking vendors about AI usage?

Procurement teams are responding to the EU AI Act, U.S. state-level AI transparency laws, and a wave of high-profile AI hallucination incidents — Deloitte's $440K refund to the Australian government, Sullivan & Cromwell's April 2026 court apology, $12.7M in SEC fines for AI misrepresentations across 2024–2025. AI usage disclosure is now a standard procurement form field for enterprise vendor reviews.

8. Can AI help with sanctions screening?

AI can help reduce false positives in fuzzy name matching, but it should never be the sole source of a sanctions decision. The underlying match must come from the official sanctions list (OFAC, EU Consolidated, UK HMT, UN), with the list version and date recorded. AI on top of verified data is acceptable; AI in place of verified data is not.

9. What should a verified KYB record contain?

At minimum: legal name, registration number, jurisdiction, current status, registered address, incorporation date, current directors, current shareholders or UBOs, latest filed financials, sanctions and PEP screening results — and for every field, a source reference, a retrieval timestamp, and a registry-side update date. Without all three metadata fields, the record is not audit-ready.

10. How is Global Database different from AI-powered KYB providers?

Global Database is a first-party, registry-sourced data provider. We collect company data directly from 400+ official government registries across 200+ countries, then standardise and serve it via API, bulk feeds, and a web platform. Every field carries source attribution and a timestamp. We do not generate data. We do not hallucinate. The data exists in a registry, or we don't have it.

Related posts

View more