AI Risk Isn't Just Hallucinations

Ask most people to name the risk of enterprise AI and they'll say hallucination: the model confidently stating something false. It's a real risk, and an easy one to demo, which is exactly why it dominates the conversation. It's rarely the risk that actually does the most damage in production.

A broader risk taxonomy

• Data leakage. Sensitive information surfacing somewhere it shouldn't, including through a retrieval system with weak access control, a prompt that includes more context than intended, or a third-party provider's data handling policy nobody read closely.
• Silent model drift. A model or its underlying provider changes behavior, whether through a version update, a fine-tune, or a shift in the underlying training data, and outputs quietly become less reliable in ways nobody notices until downstream quality drops.
• Bias amplification at scale. A pattern that existed quietly in historical data gets encoded into a model and then applied consistently, at volume, across every decision the system touches, turning an inconsistent human bias into a systematic one.
• Over-automation. Removing a human checkpoint because the model has been reliable so far, right up until an edge case the model has never encountered produces a confident, wrong answer with nobody positioned to catch it.
• Vendor and dependency risk. Building critical workflows on top of a model or API that can change pricing, availability, or behavior on the provider's timeline, not yours.

Hallucination is the risk you can show in a demo. The others are the risks you find in a postmortem, which is exactly why they deserve more attention upfront, not less.

Why hallucination gets disproportionate attention

It's visible, easy to reproduce, and doesn't require deep system knowledge to explain: you can show someone a wrong answer and the risk is self-evident. Data leakage, drift, and dependency risk require understanding the system's architecture to even notice, which makes them easy to underinvest in even though their downside is frequently larger.

What a real risk review covers

A risk assessment that stops at “how often does the model make things up” is only checking the most visible box. A more complete one asks: what happens if this data leaks, what happens if this model's behavior silently shifts, what happens if this vendor becomes unavailable, and what happens if a human stops checking the output because it's been right for months. Those are the questions that determine whether an AI system is actually production-ready. Hallucination rate is just the one that's easiest to put in a slide.