llm release
30 articles about llm release in AI news
Google Gemma 4 Model Reportedly in Testing, Signaling Next-Gen Open-Weight LLM Release
A developer reports that Google's Gemma 4 model is 'incoming' and currently being tested. This suggests the next iteration of Google's open-weight language model family is nearing release.
Ethan Mollick: OpenAI's O1 Release Was Second Most Important LLM Launch
Ethan Mollick tweeted that OpenAI's O1 launch was the second most important LLM release after GPT-3.5, featuring a pivotal chart. He expressed surprise that OpenAI disclosed its biggest AI advance rather than keeping it proprietary.
ZML releases free LLM inference server supporting Nvidia
ZML released LLMD, a free inference server for LLMs supporting Nvidia, AMD, Google TPU, Apple Metal, and Intel Arc, aiming to reduce AI costs and break vendor lock-in.
Stanford Releases Free LLM & Transformer Cheatsheets Covering LoRA, RAG, MoE
Stanford University has released a free, open-source collection of cheatsheets covering core LLM concepts from self-attention to RAG and LoRA. This provides a consolidated technical reference for engineers and researchers.
Open-Source Multi-Agent LLM System for Complex Software Engineering Tasks Released by Academic Consortium
A consortium of researchers from Stony Brook, CMU, Yale, UBC, and Fudan University has open-sourced a multi-agent LLM system specifically architected for complex software engineering. The release aims to provide a collaborative, modular framework for tackling tasks beyond single-agent capabilities.
Meta to Release First LLM Built Under Scale AI's Alexandr Wang
Meta is set to release its first large language model developed under the technical leadership of Scale AI founder Alexandr Wang. While not fully open initially, the company plans to eventually open-source versions of the new model family.
Miami Startup Claims 12M-Token LLM Inference at $8 vs. $2,600 on Claude
Miami startup claims 12M-token LLM inference for $8 vs. $2,600 on Claude Opus 4.6. No paper or benchmarks released yet.
ModelBest Drops BitCPM-CANN: First 1.58-bit LLM on Ascend 910B
ModelBest released BitCPM-CANN, the first 1.58-bit ternary LLM on Ascend 910B NPUs, using 6× less VRAM than BF16 with minimal capability loss.
Developer Ships LLM-Powered Knowledge Graph Days After Karpathy Tweet
Following a tweet by Andrej Karpathy, a developer rapidly built and released a working implementation of an LLM-powered knowledge graph on GitHub, showcasing the speed of open-source AI development.
Anthropic Paper: 'Emotion Concepts and their Function in LLMs' Published
Anthropic has released a new research paper titled 'Emotion Concepts and their Function in LLMs.' The work investigates the role and representation of emotional concepts within large language model architectures.
Google's TurboQuant Cuts LLM KV Cache Memory by 6x, Enables 3-Bit Storage Without Accuracy Loss
Google released TurboQuant, a novel two-stage quantization algorithm that compresses the KV cache in long-context LLMs. It reduces memory by 6x, achieves 3-bit storage with no accuracy drop, and speeds up attention scoring by up to 8x on H100 GPUs.
LLM Architecture Gallery Compiles 38 Model Designs from 2024-2026 with Diagrams and Code
A new open-source repository provides annotated architecture diagrams, key design choices, and code implementations for 38 major LLMs released between 2024 and 2026, including DeepSeek V3, Qwen3 variants, and GLM-5 744B.
Relay-OPD: On-Policy Distillation Fixes Prefix Failure in LLMs
Relay-OPD introduces on-policy distillation where a teacher briefly takes over student LLM generation to fix prefix failure, reducing error compounding without full teacher compute.
Xiaomi MiMo-V2.5 Tops Global LLM Token Usage at 31.2T/Month
Xiaomi MiMo-V2.5 leads global LLM token usage on OpenRouter at 31.2T/month, as Chinese models capture 63.5% share vs US 35.5%.
LLM Waterfall Pattern: 429 Failover Beats Retries & Circuit Breakers
The LLM waterfall pattern cascades requests across providers on 429 errors, outperforming retries and circuit breakers for zero-downtime AI inference.
SWE-Pruner Pro Saves 39% Tokens by Reading LLM Hidden States
SWE-Pruner Pro saves up to 39% tokens on coder LLMs by reading keep-or-prune signals from hidden states, maintaining task quality without external heuristics.
100+ Papers Surveyed: LLMs' Metacognition Gap
A systematic survey of 100+ papers reveals gaps in LLM metacognition, including 10-30% miscalibration in top models like GPT-4 and Claude 3.
GPT-Red: OpenAI's LLM Super-Hacker Finds 84% of Attacks, Humans 13%
OpenAI's GPT-Red LLM finds 84% of attacks vs 13% for humans, hardening GPT-5.6 Sol. Automated red-teaming shifts safety paradigm.
Graphify Turns Codebases Into Queryable Graphs Without Vectors or LLMs
Graphify maps codebases into local knowledge graphs using tree-sitter AST parsing, no LLMs or vector stores. At 82k+ stars, it supports 40+ languages and 20+ AI assistants.
LLMForge: 7 Models Score 0.89 on CAD Benchmark; VLMs Fix Cylinders
LLMForge scores 0.89 on 97-design CAD benchmark. VLM critic achieves 100% watertight meshes but cylinders remain a failure mode.
BayesBench: LLMs Match Bayesian Posteriors But Fail Downstream Prediction
BayesBench tests 7 LLMs on multi-turn Bayesian reasoning. Scaling improves latent inference but not prediction, exposing a critical gap for agentic deployment.
3 MCP Gateway Security Gaps LiteLLM's Audit Found (And How to Fix Them in
LiteLLM's audit revealed 3 MCP gateway gaps: fail-open resolver, unpinned servers, opt-in least-privilege. Fix them in Claude Code with version pinning and allowed_tools.
White House Orders OpenAI to Gate GPT-5.6 Release per Customer
White House orders OpenAI to gate GPT-5.6 release per customer, mirroring Anthropic's voluntary suspension of Claude Mythos under regulatory pressure.
OpenAI, Broadcom Unveil Jalapeño ASIC for LLM Inference
OpenAI and Broadcom unveiled Jalapeño, a custom ASIC for LLM inference, targeting volume deployment by late 2026. No performance metrics were disclosed.
Zalando Introduces MLLM-Based Evaluation for Product Retrieval
Zalando presents a multimodal LLM-based evaluation for product retrieval, aiming to enhance search relevance in e-commerce. This matters as it could set a new standard for assessing AI in retail search.
Metric Match Cuts LLM Judge Annotation Cost 32.5% via Subset Selection
MIT and Stanford researchers developed Metric Match, a subset selection method that reduces LLM judge annotation costs by 32.5% and estimation error by 18.7%, achieving a 0.838 win-rate against random selection.
General LLMs Beat Clinical AI Tools in Doctor Study
Frontier LLMs beat clinical AI tools like OpenEvidence in all evaluations, matching Google Search AI Overview.
SVoT Boosts MLLM Spatial Reasoning by 65% via RL-Verified Visual Chains
SVoT uses RL to verify MLLM spatial reasoning states, achieving up to 65% accuracy gains on OOD tests across five domains including Pacman and Gather.
UniSound U2 Cuts Token Use 25%, Joins Top Chinese LLM Tier
UniSound's U2 foundation model cuts token consumption by 25% while matching top Chinese LLM performance, entering the top tier with an efficiency-first design.
WorldBench: Top MLLM Scores 64% on Visually Diverse Benchmark
WorldBench, a new multimodal benchmark, tests 15 MLLMs on visually diverse images. Top model scores 64.0%, exposing fundamental gaps in visual understanding.