When Salesforce lately rolled out an AI agent on its web site, the agent began to hallucinate and wasn’t giving constant outcomes.
Salesforce ended up briefly turning it off, Shibani Ahuja, senior vice chairman of enterprise IT technique, mentioned throughout a roundtable dialogue at Fortune’s Brainstorm Tech convention in Park Metropolis, Utah.
However the agent, it turned out, wasn’t the issue. “What we had noticed was there was an underlying problem with our data,” Ahuja mentioned. When her crew investigated what had occurred, they discovered that Salesforce had printed contradictory “knowledge articles” on its web site.
“It wasn’t actually the agent. It was the agent that helped us identify a problem that always existed,” Ahuja mentioned. “We turned it into an auditor agent that actually checked our content across our public site for anomalies. Once we’d cleaned up our underlying data, we pointed it back out, and it’s been functional.”
New AI merchandise will solely be nearly as good because the underlying knowledge, based on Ahuja and different audio system who took half within the dialogue. Ashok Srivastava, senior vice chairman and Chief AI Officer at Intuit, mentioned he wasn’t shocked concerning the outcomes of a current MIT research that discovered that 95% of AI pilots at giant firms had failed, due to the archaic programs at giant corporations.
“The fact is that the foundation of AI—which is data—people don’t invest in it,” Srivastava mentioned. “So you’ve got 1990s data sitting in a super-expensive, unnamed database over here, you’ve got AI here, you’ve got the CEO telling you to do something, and it’s just not going to work.”
Sean Bruich, senior vice chairman of synthetic intelligence and knowledge at Amgen, added that it’s additionally tough for bigger firms to maneuver from a pilot to enterprise-wide adoption.
“Pilots in large companies never deliver ROI,” he mentioned. “They might deliver learnings, they might deliver proof points, they might deliver inspiration. But the path to scale—that is where you get the return on investment in any large technology program.”
To ensure that corporations to see a return on funding from new AI instruments, they must kind by means of each the info and the scaling difficulty.
Fortune International Discussion board returns Oct. 26–27, 2025 in Riyadh. CEOs and world leaders will collect for a dynamic, invitation-only occasion shaping the way forward for enterprise. Apply for an invite.
