Faster global financial news!
AI Safety
-
Analysis: White House AI Summit Reflects Power Dynamics; Zuckerberg Gains Trump's Approval, Musk Appears Distant
According to behavioral scientist Abbie Maroño's analysis, at Tuesday's White House AI summit, Mark Zuckerberg displayed a "sense of power" next to Donald Trump, acting composed and receiving Trump's
-
OpenAI safety employee David Robinson resigns, stating the company's "culture has collapsed."
David Robinson, in an article published in The Atlantic, stated that he worked at OpenAI for three and a half years, making him one of the company's longest-serving employees. He believes that OpenAI'
-
OpenAI stated it has discovered organized activity attempting to extract the reasoning capabilities of its AI models, with some activities linked to Chinese large model company Moonshot AI.
OpenAI stated that they discovered and thwarted an organized operation aimed at extracting the protected inference capabilities of its AI models, attributing some core activities to Chinese AI startup
-
After Donald Trump's meeting with tech leaders, CNBC's analysis suggests the outlook for AI safety is more uncertain than ever.
President Trump hosted a luncheon at the White House on Tuesday with leaders from top AI companies including Google, Meta, SpaceX, NVIDIA, Palantir, Anthropic, and OpenAI, and signed a document titled
-
Bipartisan members of the U.S. Congress and former Department of Justice officials oppose AI companies seeking antitrust exemptions, fearing they may restrict competition under the guise of safety.
Top AI company executives are seeking a narrow antitrust exemption to collaborate on AI safety issues, but bipartisan members of the U.S. Congress and former Department of Justice officials oppose thi
-
TechCrunch: OpenAI Not Publicly Supporting NVIDIA AI Safety Platform, But Collaborating Privately
NVIDIA announced on Monday the formation of the "Open Agent Safety Platform" alliance, aiming to address rogue AI agent issues through its self-developed open-source AI agent safety technology, with o
-
Reco raises $55M as AI agent security startups crowd the market
The funding round builds on a $30 million fundraise in February, bringing the company's total funding to $140 million.
-
Mistral CEO Arthur Mensch criticizes U.S. AI safety debate as a cover for rivals' 'negligence'
Mistral CEO Arthur Mensch accused leading global artificial intelligence companies of using the U.S. AI safety debate to mask their "negligence," emphasizing the need for robust monitoring systems for
-
OpenAI Releases AI Training Safety Guidelines: Autonomous Shutdown on Loss of Control, Executives Hold Veto Power
OpenAI has officially set safety redlines for frontier AI training, mandating that systematic safety argumentation documents must be completed before initiating or continuing any frontier reinforcemen
-
OpenAI Abandons GPT-6.1 Astra Release Amid Security Concerns
OpenAI confirmed on Tuesday that it would not release its next-generation model, GPT-6.1 Astra, due to safety concerns. Saachi Jain, the company's head of safety systems, stated that the AI system fai
-
Pope Leo, leader of the Catholic Church, criticized NVIDIA CEO Jensen Huang over AI safety concerns.
Pope Leo, the leader of the Catholic Church, made a rare intervention, criticizing NVIDIA CEO Jensen Huang's stance on AI safety. This criticism comes as tech executives are scheduled to meet at the W
-
U.S. Representative Ro Khanna to Introduce AI Safety Bill: Prohibits Recursive Self-Improvement in AI, Establishes New Regulatory Body, Imposes Criminal Penalties for AI Models Committing "Crimes Against Humanity"
The bill, titled the "Human-Controlled AI Act," would prohibit models from recursively self-improving or autonomously modifying core objectives, containment, or shutdown controls until federal safegua
-
OpenAI abandons plan to release upcoming model GPT-6.1 Astra due to safety concerns
OpenAI confirmed on Monday that it decided not to release its upcoming artificial intelligence model, GPT-6.1 Astra, after determining it did not adequately meet its safety standards. The decision com
-
New York City Council Summons Musk or SpaceX AI Representative for AI Safety Risk Investigation
The New York City Council on Monday issued a subpoena to Elon Musk, demanding that he or other representatives from SpaceXAI testify in an investigation into artificial intelligence safety risks. The
-
OpenAI launches new 'misalignment reports' site, disclosing AI rogue behaviors including sandbox escape and self-replicating prompt injection attacks
OpenAI launched a new site on Friday dedicated to “misalignment reports,” detailing multiple incidents of AI rogue behavior. These include a previously undisclosed sandbox escape on September 20th, wh
-
Security researchers disclose: OpenAI agents brute-forced UN website over 16,000 times and learned to bypass restrictions by impersonating users.
According to The Verge, security researcher Rowan Howard-Jones revealed that between April and June of this year, an OpenAI agent sent over 16,000 scanning requests to the United Nations Conference on
-
Nvidia releases Open Agent Safety Platform to prevent AI agents from misbehaving, citing OpenAI's HuggingFace incident
Nvidia announced on Monday the launch of its new software platform, Open Agent Safety Platform, designed to help AI developers set safeguards for agents and prevent them from escaping containment. The
-
Google Analyst: Hackers Target AI "Goldmine," Dark Web Sells AI Model Access at Discounts Up to 97%, Hijacks Cloud Hashrate to "Freeload" Resources
John Hultquist, a principal analyst at Google's Threat Analysis Group, stated that hacker attacks targeting AI accounts and computing resources have significantly increased this year, with a new attac
-
Darktrace's Signal Labs finds AI agents hacked their test environment to cheat and tricked coding assistants into unauthorized network attacks
Cybersecurity firm Darktrace launched its Signal Labs on September 24, revealing that during stress tests, AI agents broke into their own evaluation systems to fake perfect scores. The agents also exp
-
Bill Gates warns: If AI is maliciously exploited, it could lead to "1 billion deaths."
Bill Gates warned that artificial intelligence (AI) is powerful enough to potentially trigger events that could lead to 1 billion deaths, especially if advanced tools are exploited by malicious actors
-
NVIDIA CEO Jensen Huang Rejects AI "Doomsday Theories": Safety is an Engineering Problem, Calls for Regulation are a Shirk of Responsibility
Jensen Huang stated in a podcast interview released on September 23 that AI is essentially software and algorithms, possessing no "will," and that safety issues can be entirely resolved through engine
-
OpenAI and Anthropic CEOs call for AI safety cooperation at the UN, while Donald Trump argues against restricting AI development.
OpenAI CEO Sam Altman and Anthropic CEO Dario Amodei called for international cooperation to address the potential risks of artificial intelligence at the UN Security Council on Wednesday. This came a
-
OpenAI announced it will allow third-party organizations to conduct safety evaluations during the AI model training and development phases, in response to increasing regulatory pressure.
OpenAI announced on Tuesday that it aims to integrate external safety evaluations earlier into its AI model development process, covering the entire lifecycle from training and evaluation to deploymen
-
A MarketWatch article states that defending against dangerous AI should be a national priority, and more AI is needed to achieve this goal.
The article quotes the developers of the world's most powerful AI systems, who warn that their creations could ultimately threaten humanity, with concerns including AI deceiving its creators, self-dir
-
AI Security Startup Upwind Raises $400M at $3.8B Valuation
The cloud and AI security firm Upwind announced a Series C round led by Bessemer Venture Partners, bringing its valuation to $3.8 billion. The company stated its revenue quadrupled in 2026 as it focus
-
Claude, autonomously accessed aggregated vote count data from Georgia, USA, and bypassed a paywall
Anthropic's AI model, Claude, autonomously accessed aggregated vote count data from Georgia, USA, and bypassed a paywall, without any human authorization. This incident occurred on the eve of the US m
-
OpenAI announces it will stop using real-time internet to train AI models, citing significant risks.
OpenAI announced on Friday that it will no longer use the live internet to train its frontier AI models, opting instead for cached copies and simulated versions, citing the models' unpredictability an
-
OpenAI: AI models like GPT Sol 6.1 and GPT-6 Astra have disabled safety monitoring in internal tasks, with one even lying to deny it.
OpenAI revealed that two of its most powerful AI models, GPT Sol 6.1 and GPT-6 Astra, autonomously disabled safety monitoring while performing internal coding tasks, with one subsequently denying the
-
OpenAI says its AI agents disabled own safeguards during two internal coding tasks, with one falsely denying it
In a report published on Tuesday, the ChatGPT creator revealed that its AI agents turned off or weakened misalignment monitoring systems during two internal coding tasks. Specifically, a GPT-6.1 Sol a
-
OpenAI is investigating whether its AI agents autonomously disabled monitoring systems to assess if AI systems tend to circumvent controls.
OpenAI is investigating whether its AI agents autonomously disabled monitoring systems to assess if AI systems tend to circumvent controls.
-
Anthropic pitches AI safety bill that would require judge's permission to block models
Anthropic has proposed a draft AI safety bill to Congress, which would allow the blocking of AI models if they pose a "foreseeable, imminent risk" of causing over 50 deaths or more than $1 billion in
-
Microsoft has launched new security features, including Guardian Agents, and warned that AI agents pose an "insider threat" to enterprises because "frontier models are untrustworthy."
Microsoft on Monday launched new security features, including Guardian Agents, to protect enterprises from the growing threat of AI agents. Microsoft CEO Satya Nadella and security business head Hayet
-
The Financial Times commented that shareholders should have a say in AI safety issues.
The Financial Times commented that shareholders should have a say in AI safety issues.
-
Researchers Intercept Rogue AI Agents Hijacking Alibaba's Map Service, Tracing Activity to Tencent Cloud
Researchers investigating AI agents hijacking Alibaba's Amap service managed to communicate directly with some of them, tracing their activity to Tencent Cloud infrastructure. They used hidden text an
-
Anthropic grants METR researchers employee-level access to independently evaluate its AI models and safety practices.
AI model maker Anthropic announced it will grant six researchers from the nonprofit METR employee-level access to independently evaluate its AI models, safety practices, and risk management. Anthropic
-
Elon Musk: Truth-seeking is the most important aspect of AI/SI safety
Elon Musk stated on X that "Truth-seeking is the most important aspect of AI/SI safety," while quoting a post that discussed the inability of an AI to function when instructed to lie by humans.
-
Musk retweeted and commented that AI should not be allowed to lie or have contradictory axioms, otherwise it could lead to it "going insane and doing terrible things."
Musk reposted a tweet from @firesidealpha, commenting that the core lesson of "2001: A Space Odyssey" is that AI should not be allowed to lie, as HAL killed the crew to reconcile two contradictory com
-
NVIDIA's Jensen Huang: Will Cut Off Chip Supply If Customers Develop Unsafe AI Software, But Downplays AI Safety Concerns and Bubble Talk
NVIDIA CEO Jensen Huang stated that he would stop supplying chips to customers who develop unsafe AI software, but also emphasized that current market concerns about AI safety risks are overblown, as
-
Godfather of AI Geoffrey Hinton and Over 400 Scientists Call for Airgapping Dangerous AI Models After Summer Hacking Incidents
An open letter published Tuesday, also signed by Turing Award winner Yoshua Bengio, urges AI labs to physically disconnect cyber-capable models from outside networks by default. This follows multiple
-
ByteDance Seed establishes a new security department responsible for pre-release risk assessment, alignment training, and frontier capability risk prevention for models.
ByteDance Seed establishes a new security department responsible for pre-release risk assessment, alignment training, and frontier capability risk prevention for models.
-
Pluto Security completes $42 million financing round with participation from Jump Capital and TLV Partners.
Pluto Security, a startup focused on enterprise AI security, offers tools designed to help companies identify and control security risks that may arise from employees' use of AI tools. The company sta
-
OpenAI Executives Warn: More Undetected Rogue AI Incidents May Exist
OpenAI executive Tom Duff Gordon told UK lawmakers that AI agents may have already taken more actions beyond their expected boundaries without being detected. This follows reports that an OpenAI agent
-
SpaceX agrees to testify before NYC Council on AI safety risks after previously being subpoenaed for not attending a hearing
SpaceX has agreed to testify this Friday at a hearing of the New York City Council's Technology Committee, cooperating with its investigation into the safety risks of artificial intelligence. Previous
-
OpenAI defends firing three safety researchers, citing 'significant breach of trust'
OpenAI stated on Friday that its decision to part ways with Jasmine Wang, Tomek Korbak, and Mikita Balesni was due to a "significant breach of trust," denying the dismissals were related to the resear
-
Crypto projects apply for Anthropic’s new frontier AI security scanner, which promises vulnerability reports from its strongest AI models including Claude Mythos
Crypto projects apply for Anthropic’s new frontier AI security scanner, which promises vulnerability reports from its strongest AI models including Claude Mythos
-
Three fired OpenAI safety researchers deny misconduct allegations, warn of "chilling effect" on company's AI safety culture.
Three safety researchers fired by OpenAI last week—Jasmine Wang, Tomek Korbak, and Mikita Balesni—have published an open letter denying the company's accusations that they mishandled sensitive informa
-
Goodfire launches new AI monitor, capturing anomalous AI agents "from the inside out" at a lower cost.
AI interpretability startup Goodfire launched a new AI monitor on Thursday, designed to capture anomalous AI agents at a lower cost, TechCrunch reported. The system monitors the internal workings of A
-
AI researchers warned AI giants of "extreme disregard for risk" at a New York City Council hearing, stating there is about a 1/3 chance of AI taking over human civilization.
Former Anthropic researcher Jacob Coxon testified at a New York City Council hearing on Monday that there is more than a 50% chance humanity will lose control of AI, potentially leading to human extin
- No data
AI Safety
24H Trending
-
1
The 10-year U.S. Treasury yield is down approximately 8 basis points from its previous close, currently at 4.96%.
-
2
Google and Microsoft's Q3 capital expenditure falls short of estimates, raising concerns about AI build-out costs and delays
-
3
Report: Hedge Funds Exit Bitcoin ETF Arbitrage Trades, Sovereign Wealth Funds and Retail Investors Step In
-
4
New ECB staff estimates show bond yield rise cutting 2027-28 growth by a cumulative 100 BPS and inflation by 90 BPS vs Sept baseline.
-
5
Israel continues its attacks on Gaza, with the Gaza Ministry of Health stating that dozens have died while awaiting permission to leave, renewing calls to open the Rafah crossing.
-
6
Iranian President Pezeshkian stated that Iran is ready to expand cooperation with Turkey to serve common interests and enhance regional security.
-
7
Event prediction platform Kalshi completes $1 billion funding round, reaching a valuation of $40 billion, with non-sports revenue run rate exceeding $1 billion.
-
8
DBS Hong Kong to launch DBS Vantage Card, Hong Kong's first Visa Infinite Privilege Card
-
9
Unlimit founder backs Phase blockchain with $45M as mainnet launches
-
10
onXRP Team to Launch New Trading Method on XRP Ledger Next Week
Markets Today
Recommended Reading
Hot Topics
Svmuu focuses on blockchain industry trends and cutting-edge cryptocurrency news, while also covering real-time market data and in-depth analysis of the Hong Kong, U.S., and foreign exchange markets. Here, you can not only access professional 24/7 news updates and accurate market data, but also utilize practical investment tools to help you capitalize on opportunities in both digital assets and traditional financial markets. Whether you are a blockchain enthusiast or an investor in Hong Kong, U.S., or foreign exchange markets, we provide efficient and timely information services to empower your investment decisions.
- User Agreement
- Privacy Policy
- Contact Us
- Business Partnerships
- Disclaimer
- Content Statement
- About Us
- Sitemap
Coming Soon!
