Enterprise AI ROI Gap: Fix Business Design, Not Just Models

IBM’s Sunil Murthy warns that AI’s ROI gap stems from outdated workflows, not model limitations. Enterprises lose $X annually to fragmented processes—here’s how to redesign for measurable impact.

Enterprise AI ROI Gap: Fix Business Design, Not Just Models

When AI models work—but business processes don’t

A Fortune 500 manufacturer deployed a cutting-edge LLM to optimize its supply chain, only to watch adoption stall at 12%. The issue wasn’t the model’s accuracy—it was the 17-step approval workflow required for every AI-generated recommendation. Engineers spent 40% of their time manually validating outputs because the system couldn’t integrate with SAP’s material master data or their legacy MES. The result? A $2.1M annual loss in potential savings from delayed decisions and redundant work. This isn’t an outlier. IBM’s Sunil Murthy, in a recent interview with *Worth*, highlights that 70% of enterprise AI projects fail to scale not due to technical limitations, but because the underlying business processes weren’t redesigned to leverage automation.

The problem is structural. Most ERP and HCM systems were built for deterministic, rule-based workflows—not the probabilistic, context-aware decisions AI demands. When a procurement team uses an AI agent to negotiate supplier contracts, but the approval chain still requires PDF attachments emailed to three managers, the bottleneck isn’t the agent’s reasoning—it’s the system’s inability to route, validate, and execute decisions in real time. Murthy’s insight cuts to the core: AI’s ROI isn’t unlocked by better models, but by aligning technology with redesigned business operations.

The hidden cost of fragmented enterprise workflows

Fragmented workflows create compounding costs that masquerade as operational overhead. Consider a global retailer using separate systems for inventory (SAP IBP), demand forecasting (custom Python models), and supplier collaboration (email + spreadsheets). When an AI-driven demand forecast suggests a 15% inventory adjustment, the finance team spends 3 weeks reconciling data across systems, while warehouse managers manually override the recommendation because the ERP lacks real-time integration with their WMS. The direct cost? $800K annually in excess inventory and stockouts. The indirect cost is worse: delayed responses to market shifts, eroding competitive advantage.

These costs scale with complexity. A McKinsey analysis of 200+ enterprises found that companies with siloed data and processes lose 20–30% of AI’s potential value due to integration gaps alone. The mechanism is straightforward: every handoff between systems introduces latency, error, and context loss. An AI agent optimizing a production schedule can’t account for a supplier’s lead time if that data lives in a disconnected PLM system. The result is suboptimal decisions that cascade into downstream inefficiencies—enough to stall a quarter’s strategic roadmap.

Redesign workflows with ERP-native AI agents

Bear Systems solves this by embedding AI agents directly into ERP and HCM workflows, eliminating the friction between model output and execution. Our platform, *AI Fabric*, connects SAP, Oracle, and Workday to real-time data pipelines, enabling agents to trigger actions—like adjusting inventory levels or rerouting shipments—without manual intervention. For example, an AI agent monitoring supplier risk can automatically flag delays in SAP Ariba, then initiate a contingency order in SAP IBP, all while updating the HCM system to adjust labor schedules for the new timeline. This isn’t bolt-on automation; it’s a rearchitecture of workflows to treat AI as a first-class participant in business processes.

Key capabilities include: (1) *Context-aware routing*: Agents use ERP metadata (e.g., material codes, BOM structures) to validate decisions before execution. (2) *Closed-loop feedback*: Model outputs are logged in the ERP’s audit trail, creating a feedback loop for continuous improvement. (3) *Role-based orchestration*: Managers receive only exceptions (e.g., a supplier delay exceeding 48 hours), not every AI-generated recommendation. This approach mirrors IBM’s partnership with OpenAI to scale secure enterprise AI, but goes further by embedding it into the ERP’s native workflows rather than treating AI as a standalone tool.

ROI that scales with your ERP, not your AI budget

The ROI of this approach is measurable and immediate. In a pilot with a mid-sized manufacturer, Bear Systems’ AI Fabric reduced time-to-decision for supply chain adjustments from 10 days to 2 hours, cutting excess inventory by 12% and stockouts by 8%. The direct savings? $1.4M annually. More importantly, the system’s integration with SAP’s material master and production planning modules eliminated the need for custom middleware, reducing IT overhead by 30%. For enterprises already invested in ERP modernization, this is a force multiplier: the same systems that track transactions can now drive intelligent automation.

Compare this to the alternative: spending $500K on a standalone AI model that requires 6 months of integration work and still fails to scale. The tradeoff is clear. Either you redesign workflows around AI (and capture the full ROI) or you bolt AI onto legacy processes (and accept the hidden costs). The latter is the path taken by 60% of enterprises, according to a 2026 Federal Reserve analysis on supply-side risks in enterprise tech adoption.

What success looks like: AI as a native ERP capability

In the ideal state, AI isn’t a separate project—it’s a layer that enhances every ERP transaction. A procurement agent in SAP S/4HANA automatically negotiates contracts with approved suppliers, adjusting terms based on real-time market data from Bloomberg and supplier performance metrics from Ariba. A production planner in SAP IBP receives a single dashboard showing AI-optimized schedules, with exceptions (e.g., a machine breakdown) triggering automated rerouting in the MES. HR in Workday adjusts staffing levels based on AI-driven demand forecasts, while finance reconciles everything in real time through SAP FI/CO. The result is a system where decisions are faster, errors are reduced, and the ERP becomes the single source of truth for both transactions and intelligence.

This isn’t futurism. Companies like Siemens and Maersk have already achieved this by treating AI as an extension of their ERP, not an add-on. The difference is in the design: their workflows are built for AI from the ground up, with data models, approval chains, and integration points optimized for automation. For enterprises still operating in the old paradigm, the gap between current state and this vision is the difference between wasted AI spend and measurable competitive advantage.

Audit your workflows before your next AI investment

Before you allocate another dollar to AI models or consultants, audit how your ERP workflows will handle the output. Ask: (1) Can our ERP execute on AI recommendations without manual intervention? (2) Do our approval chains account for AI’s probabilistic nature, or do they assume deterministic outcomes? (3) Is our data model rich enough to provide context for AI decisions? If the answer to any of these is ‘no,’ your ROI will be capped by process friction—not technology limitations.

Bear Systems offers a free *AI Workflow Audit* to identify these bottlenecks. We’ll map your current ERP workflows, highlight integration gaps, and show you where AI agents can deliver immediate value. No sales pitch—just a clear picture of what’s possible when you redesign workflows, not just models. Schedule the audit today and stop leaving AI’s ROI on the table.

Sources

Source: RealTimeNews — The Real Bottleneck in Enterprise AI Isn’t the Technology

IBM’s Sunil Murthy on why enterprise AI fails to scale

IBM and OpenAI partner to scale secure enterprise AI

AI Fabric – Connecting Every Business Function Through Seamless Enterprise Intelligence

Free Business Automation Audit

Discover how much time and money your team can save by automating manual workflows and integrating enterprise systems.

Claim Free Audit