Coinbase benchmark finds newer AI models missed more payment fraud
Coinbase reported on Oct. 7 that a historical replay benchmark for its Onramp service found newer versions of three major AI model families (Opus 5, Sonnet 5, and GPT-5.6) caught fewer fraudulent payments and a smaller share of fraud value compared to their predecessors, despite an unchanged decision policy. Sonnet's recall fell 22.2 percentage points, and Opus's recall declined 0.8 points. While GPT's precision improved by 11.5 percentage points, its recall dropped by 20.7 points, indicating more fraud cases and value escaped detection.
No AI analysis yet. Tap the "AI Analysis" button above to generate one now.
Disclaimer: This content reflects the author's personal views only and does not constitute investment advice.
24H Trending
-
1
TypeSafe AI, the maker of the non-text AI model Jev, reached a valuation of $7.5 billion just weeks after its launch, with a16z leading an $870 million funding round.
-
2
iPhone Vulnerabilities Continue to Threaten Crypto Users, Older iOS Devices Remain at Risk
-
3
Litecoin (LTC) Trading Platforms and Reliable Wallet Choices Guide
-
4
UN Envoy Warns Yemen Has Returned to 'Full-Scale War'
-
5
Privatix (PRIX) Token Analysis: Project Status and Market Liquidity Review
-
6
Trump sends mixed signals on military action against Iran, saying it's "possible" to act immediately before the midterm elections.
-
7
US stocks closed higher, with the Dow Jones Industrial Average rising 0.83%; Donald Trump stated he would not attack Iran before the midterm elections, leading to an increase in oil prices; SpaceX acquired nationwide low-frequency spectrum, causing telecommunications stocks to fall.
-
8
Aero sets October 21 as merger launch date and announces token conversion terms
-
9
Oracle CDS spreads hit a record high of 261 basis points, with Morgan Stanley warning that its massive capital expenditure demands concentrated in 2028 could trigger a debt crisis.
-
10
Google Cloud and the Defunct Loopring Protocol: A Historical Collaboration and Current Status of zkRollup Scaling Solutions
Markets Today
Recommended Reading





