It was revealed by KPMG, one of many world’s ‘Large 4’ accounting corporations.
In October final 12 months, KPMG revealed a report titled Whole Expertise: Redefining Excellence within the Age of Agentic AI, which was about how corporations are utilizing AI to cater to clients’ wants. KPMG is among the “Large 4” skilled companies and accounting corporations on the earth, together with Deloitte, PricewaterhouseCoopers and Ernst & Younger. Apparently, although, that report was filled with AI hallucinations and included examples of agentic AIs that both didn’t exist or didn’t have the capabilities KPMG said within the paper. Investigators for GPTZero, the maker of an AI content material detection software, discovered inaccuracies and pretend footnotes everywhere in the report, which have been additionally verified by the Monetary Instances.
In its report of the investigation, GPTZero stated that solely 5 citations out of 45 within the paper precisely pointed to actual sources. A complete of 28 citations paraphrased titles or added faux elements to actual sources, whereas 12 have been phrased too vaguely to find out whether or not they truly existed. GPTZero referred to as the creation of pretend references by AI fashions “vibe citing.”
Along with the faux or inaccurate citations, the investigators additionally discovered that roughly half of the claims within the paper have been faux or misattributed. They have been “seemingly the results of an AI analysis software over-complying with a request to search out examples of ‘agentic AI’ within the wild,” GPTZero wrote. In a single instance, KPMG claimed that Emirates launched a cell chatbot referred to as Sara that may discuss to passengers and alter their flights for them. Sara was a cell assistant launched in 2023 and never an AI-powered chatbot, and it additionally did not have the ability to alter bookings for passengers.
KPMG additionally claimed that Swiss multinational funding financial institution UBS built-in agentic AI throughout its “funding advisory, threat administration and compliance monitoring.” The financial institution informed the Instances that the data was “factually incorrect.” In one other instance, KMPG stated that Swiss Federal Railways (SBB) has AI brokers that may assist passengers plan, ebook and optimize their journeys based mostly on preferences, real-time situations and carbon impression. An SBB spokesperson stated that was “not correct.”
Papers by corporations like KPMG are usually cited in different analysis papers and articles, since they’re thought-about as extremely trusted sources. GPTZero chief govt Edward Tian defined that error-riddled papers revealed by the Large 4 might “poison the properly of data” and will result in second-hand AI hallucinations. A KPMG spokesperson informed the Instances that the corporate “takes the accuracy and integrity of its revealed content material significantly.” KPMG has since pulled the paper and is now “reviewing the circumstances surrounding its publication.”
