The agent evaluation gap: Enterprise AI organizations have a reality-alignment problem, not a coverage problem — and most are shipping to production anyway

A recent study reveals that 50% of organizations have deployed AI agents or LLM features that caused failures in production after passing internal evaluations. Trust in automated evaluations is low, with only 5% of technical leaders fully trusting them, while two-thirds of organizations are already permitting automated deployment without human oversight.