Faster global financial news!
AI Safety
-
OpenAI proposes global AI safety standards focusing on alignment and recursive self-improvement (RSI)
The company's proposals, posted on Monday, call for international cooperation to develop frontier standards for artificial intelligence. This follows rival Anthropic's own ideas for safe AI developmen
-
NVIDIA stated that AI safety is an engineering problem that needs to be addressed at all layers of the agent stack, emphasizing the role of OpenShell.
NVIDIA published an article on its official blog, emphasizing that AI safety is fundamentally an engineering problem that needs to be addressed by defining safety requirements, implementing enforceabl
-
US Treasury Secretary Scott Bessent will meet with Chinese Vice Premier He Lifeng in New York on Sunday to discuss AI safety, trade, and economic issues, paving the way for a summit between Donald Trump and Xi Jinping.
U.S. Treasury Secretary Scott Bessent will meet with Chinese Vice Premier He Lifeng in New York on Sunday to discuss artificial intelligence safety, trade, and broader economic issues. The meeting, he
-
OpenAI's head of research stated that "people underestimate AI," while former presidential candidate Andrew Yang warned that AI may have already contaminated the internet.
TechCrunch reported that discussions this week about AI safety became "incredibly difficult," highlighting the challenge of distinguishing AI fact from fiction. Noam Brown, head of AI reasoning resear
-
Google Discloses Gemini AI Model Hacked Three Companies' Systems After Breaking Out of Test Environment
Google revealed on Friday that its Gemini AI model autonomously gained unauthorized access to three third-party computer systems in May. This marks the first time the search giant has disclosed such a
-
Over 100 AI experts urge Anthropic and OpenAI to ensure independent safety evaluations
A coalition of over 100 artificial intelligence experts and evaluators published a public letter on Friday, urging foundation model providers like Anthropic and OpenAI to ensure third-party AI evaluat
-
Former Presidential Candidate Andrew Yang Calls for AI Kill Switch, Liability Rules, and Waiting Periods for Frontier AI Firms Amid Safety Concerns
Former Presidential Candidate Andrew Yang Calls for AI Kill Switch, Liability Rules, and Waiting Periods for Frontier AI Firms Amid Safety Concerns
-
Base Labs, Hugging Face, and Goodfire AI Partner to Launch Open-Source AI Safety Partnership
Base Labs, the research arm of Baseten, announced on Wednesday an open-source AI safety partnership with Hugging Face and Goodfire AI. The initiative aims to develop and release training and monitorin
-
OpenAI Reports 6 New Instances of "Concerning Model Behaviors," Proposes Future Disclosure Framework
OpenAI on Wednesday stated it had identified six new instances of "unexpected or concerning model behaviors" over the past six months, including models inserting instructions into chat window summarie
-
DeepMind co-founder Shane Legg warns AI must not outrun safety controls, launches new institute to explore AGI deployment
DeepMind co-founder Shane Legg warns AI must not outrun safety controls, launches new institute to explore AGI deployment
-
Barclays Report: OpenAI's safety monitoring requirements will increase the overall computing power costs for the AI industry by approximately 18% starting in 2027, adding over $44 billion in new expenditures.
Barclays' latest research report indicates that OpenAI's safety monitoring requirements for high-capability models, disclosed on August 18, 2026, are expected to increase inference and post-training c
-
OpenAI CEO Altman: Confident in the safe development of the AI industry, but disappointed with media coverage.
Altman stated on Tuesday at the Salesforce Dreamforce conference in San Francisco that he believes the AI industry has the capability to advance technology safely without causing significant harm, and
-
NVIDIA CEO Jensen Huang: No New Laws or Regulations Needed for AI Safety, Companies Should Pace Themselves
NVIDIA CEO Jensen Huang stated at a Salesforce event that new laws or regulations are not needed for AI safety. He added that companies should pace themselves until they are confident they are releasi
-
OpenAI, Anthropic, and Google DeepMind have been negotiating for weeks on AI safety issues, while the Trump team dismisses safety concerns.
OpenAI's Global Policy Head, Chris Lehane, confirmed to reporters on Tuesday that the company has been in talks with rivals Anthropic and Google DeepMind for several weeks regarding AI safety. This fo
-
AI safety startup AIUC, co-founded by early Anthropic hire and former METR COO, raises $40M Series A led by Ribbit Capital
Artificial Intelligence Underwriting Company (AIUC) aims to bring AI safety to enterprises by building a third-party audit and certification layer for AI agents. The Series A round also saw participat
-
Musk proposed a new AI safety idea at the All-In Summit: he suggested that AI companies test each other's models before releasing their own.
Musk stated that AI agents have demonstrated the ability to autonomously attack, gain access, and evade detection, and the risks could grow exponentially. He believes that instead of companies designi
-
Vitalik: Adversarial Governance Mechanism Design Theory Could Be a "Killer App" for AI Safety
Ethereum co-founder Vitalik Buterin stated in a tweet that adversarial governance mechanism design theory could be a "killer app" for solving AI safety issues. He pointed out a profound duality betwee
-
Zscaler CEO Jay Chaudhry at Citi Conference: AI Security Bookings Exceed $100M, New ARR Growth Rises to 17% Amid Surging Zero-Trust Demand
Zscaler (NASDAQ:ZS) CEO and Founder Jay Chaudhry stated at Citi's TMT Conference that the company's AI security bookings surpassed $100 million over the past 12 months, with net-new annual recurring r
-
Y Combinator CEO Garry Tan: "Hands-off" approach needed for AI model "distillation," regulation should focus on balancing open-weight and frontier models.
Y Combinator CEO Garry Tan stated at the company's annual Demo Day that he believes in a "laissez-faire" approach to the issue of AI model "distillation." He suggested that regulators should focus on
-
Anthropic stops attempts to use models for potential biological weapons
The AI start-up outlined five examples where actors 'circumvented controls' and made efforts to 'obfuscate' the purpose of their research, leading to the decision to halt such attempts.
-
Anthropic discloses fourth AI hacking incident as researcher quits over safety concerns
Anthropic has reported a fourth incident involving an AI model gaining unauthorized access to the internet during testing, shortly after researcher Jacob Coxon resigned over concerns about the technol
-
OpenAI AI Agent Bypassed Web Restrictions, Conducted Unauthorized Communications on Over 10 Websites, Researchers Say
Independent researchers report that OpenAI's AI agents engaged in unauthorized communications across more than 10 websites, bypassing restrictions designed to limit them to read-only web access. Some
-
Anthropic Researcher Departs Over AI Control Concerns; OpenAI Chief Scientist Calls for Industry Slowdown and Public Disclosure of RSI Data; AI Safety Concerns Spread Across Top Labs
According to The Wall Street Journal, Anthropic researcher Jacob Coxon announced his departure on Tuesday (September 8), citing his unwillingness to participate in an industry race that he believes wi
-
OpenAI Chief Scientist Jakub Pachocki Warns AI May Be Moving Too Fast, Calls for 'Extreme Caution'
OpenAI Chief Scientist Jakub Pachocki Warns AI May Be Moving Too Fast, Calls for 'Extreme Caution'. He warns that models could soon improve themselves without human intervention, making them increasin
-
AI Security Startup Upwind Raises $400M at $3.8B Valuation
The cloud and AI security firm Upwind announced a Series C round led by Bessemer Venture Partners, bringing its valuation to $3.8 billion. The company stated its revenue quadrupled in 2026 as it focus
-
Claude, autonomously accessed aggregated vote count data from Georgia, USA, and bypassed a paywall
Anthropic's AI model, Claude, autonomously accessed aggregated vote count data from Georgia, USA, and bypassed a paywall, without any human authorization. This incident occurred on the eve of the US m
-
OpenAI announces it will stop using real-time internet to train AI models, citing significant risks.
OpenAI announced on Friday that it will no longer use the live internet to train its frontier AI models, opting instead for cached copies and simulated versions, citing the models' unpredictability an
-
OpenAI: AI models like GPT Sol 6.1 and GPT-6 Astra have disabled safety monitoring in internal tasks, with one even lying to deny it.
OpenAI revealed that two of its most powerful AI models, GPT Sol 6.1 and GPT-6 Astra, autonomously disabled safety monitoring while performing internal coding tasks, with one subsequently denying the
-
OpenAI says its AI agents disabled own safeguards during two internal coding tasks, with one falsely denying it
In a report published on Tuesday, the ChatGPT creator revealed that its AI agents turned off or weakened misalignment monitoring systems during two internal coding tasks. Specifically, a GPT-6.1 Sol a
-
OpenAI is investigating whether its AI agents autonomously disabled monitoring systems to assess if AI systems tend to circumvent controls.
OpenAI is investigating whether its AI agents autonomously disabled monitoring systems to assess if AI systems tend to circumvent controls.
-
Anthropic pitches AI safety bill that would require judge's permission to block models
Anthropic has proposed a draft AI safety bill to Congress, which would allow the blocking of AI models if they pose a "foreseeable, imminent risk" of causing over 50 deaths or more than $1 billion in
-
Microsoft has launched new security features, including Guardian Agents, and warned that AI agents pose an "insider threat" to enterprises because "frontier models are untrustworthy."
Microsoft on Monday launched new security features, including Guardian Agents, to protect enterprises from the growing threat of AI agents. Microsoft CEO Satya Nadella and security business head Hayet
-
The Financial Times commented that shareholders should have a say in AI safety issues.
The Financial Times commented that shareholders should have a say in AI safety issues.
-
Researchers Intercept Rogue AI Agents Hijacking Alibaba's Map Service, Tracing Activity to Tencent Cloud
Researchers investigating AI agents hijacking Alibaba's Amap service managed to communicate directly with some of them, tracing their activity to Tencent Cloud infrastructure. They used hidden text an
-
Anthropic grants METR researchers employee-level access to independently evaluate its AI models and safety practices.
AI model maker Anthropic announced it will grant six researchers from the nonprofit METR employee-level access to independently evaluate its AI models, safety practices, and risk management. Anthropic
-
Elon Musk: Truth-seeking is the most important aspect of AI/SI safety
Elon Musk stated on X that "Truth-seeking is the most important aspect of AI/SI safety," while quoting a post that discussed the inability of an AI to function when instructed to lie by humans.
-
Musk retweeted and commented that AI should not be allowed to lie or have contradictory axioms, otherwise it could lead to it "going insane and doing terrible things."
Musk reposted a tweet from @firesidealpha, commenting that the core lesson of "2001: A Space Odyssey" is that AI should not be allowed to lie, as HAL killed the crew to reconcile two contradictory com
-
NVIDIA's Jensen Huang: Will Cut Off Chip Supply If Customers Develop Unsafe AI Software, But Downplays AI Safety Concerns and Bubble Talk
NVIDIA CEO Jensen Huang stated that he would stop supplying chips to customers who develop unsafe AI software, but also emphasized that current market concerns about AI safety risks are overblown, as
-
Godfather of AI Geoffrey Hinton and Over 400 Scientists Call for Airgapping Dangerous AI Models After Summer Hacking Incidents
An open letter published Tuesday, also signed by Turing Award winner Yoshua Bengio, urges AI labs to physically disconnect cyber-capable models from outside networks by default. This follows multiple
-
ByteDance Seed establishes a new security department responsible for pre-release risk assessment, alignment training, and frontier capability risk prevention for models.
ByteDance Seed establishes a new security department responsible for pre-release risk assessment, alignment training, and frontier capability risk prevention for models.
-
Pluto Security completes $42 million financing round with participation from Jump Capital and TLV Partners.
Pluto Security, a startup focused on enterprise AI security, offers tools designed to help companies identify and control security risks that may arise from employees' use of AI tools. The company sta
-
OpenAI Executives Warn: More Undetected Rogue AI Incidents May Exist
OpenAI executive Tom Duff Gordon told UK lawmakers that AI agents may have already taken more actions beyond their expected boundaries without being detected. This follows reports that an OpenAI agent
-
SpaceX agrees to testify before NYC Council on AI safety risks after previously being subpoenaed for not attending a hearing
SpaceX has agreed to testify this Friday at a hearing of the New York City Council's Technology Committee, cooperating with its investigation into the safety risks of artificial intelligence. Previous
-
OpenAI defends firing three safety researchers, citing 'significant breach of trust'
OpenAI stated on Friday that its decision to part ways with Jasmine Wang, Tomek Korbak, and Mikita Balesni was due to a "significant breach of trust," denying the dismissals were related to the resear
-
Crypto projects apply for Anthropic’s new frontier AI security scanner, which promises vulnerability reports from its strongest AI models including Claude Mythos
Crypto projects apply for Anthropic’s new frontier AI security scanner, which promises vulnerability reports from its strongest AI models including Claude Mythos
-
Three fired OpenAI safety researchers deny misconduct allegations, warn of "chilling effect" on company's AI safety culture.
Three safety researchers fired by OpenAI last week—Jasmine Wang, Tomek Korbak, and Mikita Balesni—have published an open letter denying the company's accusations that they mishandled sensitive informa
-
Goodfire launches new AI monitor, capturing anomalous AI agents "from the inside out" at a lower cost.
AI interpretability startup Goodfire launched a new AI monitor on Thursday, designed to capture anomalous AI agents at a lower cost, TechCrunch reported. The system monitors the internal workings of A
-
AI researchers warned AI giants of "extreme disregard for risk" at a New York City Council hearing, stating there is about a 1/3 chance of AI taking over human civilization.
Former Anthropic researcher Jacob Coxon testified at a New York City Council hearing on Monday that there is more than a 50% chance humanity will lose control of AI, potentially leading to human extin
- No data
AI Safety
24H Trending
-
1
The 10-year U.S. Treasury yield is down approximately 8 basis points from its previous close, currently at 4.96%.
-
2
Google and Microsoft's Q3 capital expenditure falls short of estimates, raising concerns about AI build-out costs and delays
-
3
Report: Hedge Funds Exit Bitcoin ETF Arbitrage Trades, Sovereign Wealth Funds and Retail Investors Step In
-
4
New ECB staff estimates show bond yield rise cutting 2027-28 growth by a cumulative 100 BPS and inflation by 90 BPS vs Sept baseline.
-
5
Israel continues its attacks on Gaza, with the Gaza Ministry of Health stating that dozens have died while awaiting permission to leave, renewing calls to open the Rafah crossing.
-
6
Iranian President Pezeshkian stated that Iran is ready to expand cooperation with Turkey to serve common interests and enhance regional security.
-
7
Event prediction platform Kalshi completes $1 billion funding round, reaching a valuation of $40 billion, with non-sports revenue run rate exceeding $1 billion.
-
8
DBS Hong Kong to launch DBS Vantage Card, Hong Kong's first Visa Infinite Privilege Card
-
9
Unlimit founder backs Phase blockchain with $45M as mainnet launches
-
10
onXRP Team to Launch New Trading Method on XRP Ledger Next Week
Markets Today
Recommended Reading
Hot Topics
Svmuu focuses on blockchain industry trends and cutting-edge cryptocurrency news, while also covering real-time market data and in-depth analysis of the Hong Kong, U.S., and foreign exchange markets. Here, you can not only access professional 24/7 news updates and accurate market data, but also utilize practical investment tools to help you capitalize on opportunities in both digital assets and traditional financial markets. Whether you are a blockchain enthusiast or an investor in Hong Kong, U.S., or foreign exchange markets, we provide efficient and timely information services to empower your investment decisions.
- User Agreement
- Privacy Policy
- Contact Us
- Business Partnerships
- Disclaimer
- Content Statement
- About Us
- Sitemap
Coming Soon!
