threat modeling
17 articles about threat modeling in AI news
US Officials Warn Anthropic's 'Mythos' AI Poses Major Cybersecurity Threat
Senior US officials, including Jerome Powell, warn that Anthropic's highly advanced 'Mythos' AI model presents significant cybersecurity risks. Its powerful ability to find system vulnerabilities requires tight restrictions to prevent misuse.
MIT Open-Sources AI That Turns Photos Into Editable CAD Models
MIT open-sourced an AI that turns photos into editable CAD files, threatening $150/hour modeling work. No benchmarks or training details disclosed.
Decepticon Open-Sources Autonomous AI Red Team for Full Kill Chain
Decepticon, a new open-source multi-agent AI system, autonomously executes the entire cyber kill chain for red teaming, from reconnaissance to exfiltration, enabling continuous security testing.
DARPA Leases 50 Nvidia H100 GPUs for Biological AI Program
DARPA's Biological Technologies Office is procuring 50 Nvidia HGX H100 GPU systems for its NODES program, with hardware delivery required within one month. This represents a significant government investment in AI infrastructure for biological research applications.
Google DeepMind Maps AI Attack Surface, Warns of 'Critical' Vulnerabilities
Google DeepMind researchers published a paper mapping the fundamental attack surface of AI agents, identifying critical vulnerabilities that could lead to persistent compromise and data exfiltration. The work provides a framework for red-teaming and securing autonomous AI systems before widespread deployment.
Open-Source 3D Building Editor Runs in Browser, Powered by AI
A developer has open-sourced a full 3D building editor that runs entirely in a web browser. This tool uses AI to lower the barrier to architectural design, potentially disrupting professional software workflows.
ContextSim: A New LLM Framework for Context-Aware Recommender System Simulation
A new arXiv preprint introduces ContextSim, a framework that uses LLM agents to simulate users interacting with recommender systems within realistic daily scenarios (time, location, needs). Experiments show it generates more human-aligned interactions and that RS parameters optimized with it yield improved real-world engagement.
DrugPlayGround Benchmark Tests LLMs on Drug Discovery Tasks
A new framework called DrugPlayGround provides the first standardized benchmark for evaluating large language models on key drug discovery tasks, including predicting drug-protein interactions and chemical properties. This addresses a critical gap in objectively assessing LLMs' potential to accelerate pharmaceutical research.
Anthropic Rumored to Develop 'Mythos' and 'Capybara' Models, With Mythos Positioned as Premium Tier Above Claude 3.5 Opus
Anthropic is reportedly preparing new AI models codenamed 'Mythos' and 'Capybara,' with Mythos positioned as a premium tier above Claude 3.5 Opus. The rumored model is described as extremely expensive to run, suggesting a larger, more computationally intensive system.
Morgan Stanley Predicts 10x Compute Spike to Double AI Intelligence, Highlights 18 GW Energy Crisis
Morgan Stanley forecasts a massive AI leap from a 10x increase in training compute, but warns of an 18-gigawatt U.S. power shortfall by 2028. The report claims GPT-5.4 matches human experts with 83% on GDPVal.
Is the Luxury Comeback Still on Track? - The Business of Fashion
The Business of Fashion reports on the uncertain trajectory of the luxury sector's recovery. This macro-economic and consumer sentiment analysis is critical context for AI investment and deployment strategies within luxury houses.
Palantir and NVIDIA Forge Strategic Alliance to Power Next-Generation AI Platforms
Palantir Technologies and NVIDIA have announced a major collaboration to develop enterprise AI platforms. The partnership aims to integrate Palantir's data analytics with NVIDIA's accelerated computing to deliver powerful AI solutions for government and commercial sectors.
The Overrefusal Problem: How AI Safety Training Can Make Models Too Cautious
New research reveals why safety-aligned AI models often reject harmless queries, identifying 'refusal triggers' as the culprit. The study proposes a novel mitigation strategy that improves responsiveness while maintaining security.
VAST's $50M Funding Signals 3D AI Revolution: From Foundation Models to World Simulation
AI startup VAST has secured $50 million in Series A funding while advancing its 3D foundation models that are setting new industry standards. The company is preparing to launch its first world model, positioning itself at the forefront of spatial AI development.
The Agent-User Problem: Why Your AI-Powered Personalization Models Are About to Break
New research reveals AI agents acting on behalf of users create fundamentally uninterpretable behavioral data, breaking core assumptions of retail personalization and recommendation systems. Luxury brands must prepare for this paradigm shift.
Anthropic Draws Ethical Line: Refuses Pentagon Demand to Remove AI Safeguards
Anthropic CEO Dario Amodei has publicly refused a Pentagon ultimatum to remove key safety guardrails from its Claude AI models for military use, risking a $200M contract. The company insists on maintaining restrictions against mass surveillance and autonomous weapons deployment.
Beyond the Transformer: Liquid AI's Hybrid Architecture Challenges the 'Bigger is Better' Paradigm
Liquid AI's LFM2-24B-A2B model introduces a novel hybrid architecture blending convolutions with attention, addressing critical scaling bottlenecks in modern LLMs. This 24-billion parameter model could redefine efficiency standards in AI development.