architecture
30 articles about architecture in AI news
Anthropic Leases xAI's Colossus 1 After Mixed-Architecture Flaw Blocked
Anthropic leased xAI's 220K-GPU Colossus 1 after its mixed architecture failed to train Grok. Musk builds Blackwell-only Colossus 2 for training and IPO.
Claude Code's Six-Layer Architecture: Harness, Not Magic
Claude Code's six-layer architecture uses a 3-layer context compressor at 92% threshold and Redis-based multi-agent FSM protocol. The model is just one node in a harness.
Large Memory Models: New Architecture Beyond RAG and Vector Search
Researchers with 160+ Nature and ICLR publications have built Large Memory Models (LMMs), a new architecture designed to emulate human memory processes, offering an alternative to RAG and vector search paradigms.
A Reference Architecture for Agentic Hybrid Retrieval in Dataset Search
A new research paper presents a reference architecture for 'agentic hybrid retrieval' that orchestrates BM25, dense embeddings, and LLM agents to handle underspecified queries against sparse metadata. It introduces offline metadata augmentation and analyzes two architectural styles for quality attributes like governance and performance.
Apple's 'Attention to Mamba' Paper Proposes Cross-Architecture Transfer
Apple researchers introduced a two-stage recipe for transferring capabilities from Transformer models to Mamba-based architectures. This could enable efficient models that retain the performance of larger, attention-based predecessors.
Akshay Pachaar Inverts LLM Agent Architecture with 'Harness' Design
AI engineer Akshay Pachaar outlined a novel 'harness' architecture for LLM agents that externalizes intelligence into memory, skills, and protocols. He is building a minimal, didactic open-source implementation of this design.
Stop Bloating Your CLAUDE.md: A 6-Layer Memory Architecture That Actually Works
Implement path-scoped rules and a wiki layer before reaching for complex RAG—this architecture saves tokens and prevents ignored instructions.
Seven Voice AI Architectures That Actually Work in Production
An engineer shares seven voice agent architectures that have survived production, detailing their components, latency improvements, and failure modes. This is a practical guide for building real-time, interruptible, and scalable voice AI.
How a Healthcare Startup Used Claude Code to Ship 66 Architecture Tickets in 4 Hours
Claude Code can autonomously execute complex architecture work when given proper domain expertise, ticket planning, and execution authority—no magic required.
ASI-Evolve: This AI Designs Better AI Than Humans Can — 105 New Architectures, Zero Human Guidance
Researchers built an AI that runs the entire research cycle on its own — reading papers, designing experiments, running them, and learning from results. It discovered 105 architectures that beat human-designed models, and invented new learning algorithms. Open-sourced.
Memory Systems for AI Agents: Architectures, Frameworks, and Challenges
A technical analysis details the multi-layered memory architectures—short-term, episodic, semantic, procedural—required to transform stateless LLMs into persistent, reliable AI agents. It compares frameworks like MemGPT and LangMem that manage context limits and prevent memory drift.
8 RAG Architectures Explained for AI Engineers: From Naive to Agentic Retrieval
A technical thread explains eight distinct RAG architectures with specific use cases, from basic vector similarity to complex agentic systems. This provides a practical framework for engineers choosing the right approach for different retrieval tasks.
FAOS Neurosymbolic Architecture Boosts Enterprise Agent Accuracy by 46% via Ontology-Constrained Reasoning
Researchers introduced a neurosymbolic architecture that constrains LLM-based agents with formal ontologies, improving metric accuracy by 46% and regulatory compliance by 31.8% in controlled experiments. The system, deployed in production, serves 21 industries with over 650 agents.
UniMixer: A Unified Architecture for Scaling Laws in Recommendation Systems
A new arXiv paper introduces UniMixer, a unified scaling architecture for recommender systems. It bridges attention-based, TokenMixer-based, and factorization-machine-based methods into a single theoretical framework, aiming to improve parameter efficiency and scaling return on investment (ROI).
Storing Less, Finding More: Novelty Filtering Architecture for Cross-Modal Retrieval on Edge Cameras
A new streaming retrieval architecture uses an on-device 'epsilon-net' filter to retain only semantically novel video frames, dramatically improving cross-modal search accuracy while reducing power consumption to 2.7 mW. This addresses the fundamental problem of redundant frames crowding out correct results in continuous video streams.
Sam Altman Predicts Next 'Transformer-Level' Architecture Breakthrough, Says AI Models Are Now Smart Enough to Help Find It
OpenAI CEO Sam Altman stated he believes a new AI architecture, offering gains as significant as transformers over LSTMs, is yet to be discovered. He argues current advanced models are now sufficiently capable of assisting in that foundational research.
Solving LLM Debate Problems with a Multi-Agent Architecture
A developer details moving from generic prompts to a multi-agent system where two LLMs are forced to refute each other, improving reasoning and output quality. This is a technical exploration of a novel prompting architecture.
AIGQ: Taobao's End-to-End Generative Architecture for E-commerce Query Recommendation
Alibaba researchers propose AIGQ, a hybrid generative framework for pre-search query recommendations. It uses list-level fine-tuning, a novel policy optimization algorithm, and a hybrid deployment architecture to overcome traditional limitations, showing substantial online improvements on Taobao.
8 AI Model Architectures Visually Explained: From Transformers to CNNs and VAEs
A visual guide maps eight foundational AI model architectures, including Transformers, CNNs, and VAEs, providing a clear reference for understanding specialized models beyond LLMs.
AI Agent Types and Communication Architectures: From Simple Systems to Multi-Agent Ecosystems
A guide to designing scalable AI agent systems, detailing agent types, multi-agent patterns, and communication architectures for real-world enterprise production. This represents the shift from reactive chatbots to autonomous, task-executing AI.
Multi-Agent AI Systems: Architecture Patterns and Governance for Enterprise Deployment
A technical guide outlines four primary architecture patterns for multi-agent AI systems and proposes a three-layer governance framework. This provides a structured approach for enterprises scaling AI agents across complex operations.
A Deep Dive into LoRA: The Mathematics, Architecture, and Deployment of Low-Rank Adaptation
A technical guide explores the mathematical foundations, memory architecture, and structural consequences of Low-Rank Adaptation (LoRA) for fine-tuning LLMs. It provides critical insights for practitioners implementing efficient model customization.
LLM Architecture Gallery Compiles 38 Model Designs from 2024-2026 with Diagrams and Code
A new open-source repository provides annotated architecture diagrams, key design choices, and code implementations for 38 major LLMs released between 2024 and 2026, including DeepSeek V3, Qwen3 variants, and GLM-5 744B.
Sam Altman Teases 'Massive Upgrade' AI Architecture, Compares Impact to Transformers vs. LSTM
OpenAI CEO Sam Altman said a new AI architecture is coming that represents a 'massive upgrade' comparable to the Transformer's leap over LSTM. He also stated current frontier models are now powerful enough to help research these next breakthroughs.
AI Agents Get a Memory Upgrade: New Framework Treats Multi-Agent Memory as Computer Architecture
A new paper proposes treating multi-agent memory systems as a computer architecture problem, introducing a three-layer hierarchy and identifying critical protocol gaps. This approach could significantly improve reasoning, skills, and tool usage in collaborative AI systems.
Google DeepMind Unveils 'Intelligent AI Delegates': A Paradigm Shift in Autonomous Agent Architecture
Google DeepMind has introduced a groundbreaking framework called 'Intelligent AI Delegates' that fundamentally reimagines how AI agents operate. This new architecture enables more autonomous, efficient, and collaborative problem-solving by allowing AI systems to delegate tasks dynamically.
Claude Code's New Inline Visualizations Let You See Architecture, Data, and Dependencies Instantly
Claude Code now generates interactive charts and diagrams directly in chat—no side panel needed. Use it to visualize system architecture, data flows, and code dependencies on the fly.
RF-DETR: A Real-Time Transformer Architecture That Surpasses 60 mAP on COCO
RF-DETR is a new lightweight detection transformer using neural architecture search and internet-scale pre-training. It's the first real-time detector to exceed 60 mAP on COCO, addressing generalization issues in current models.
OpenDev Paper Formalizes the Architecture for Next-Generation Terminal AI Coding Agents
A comprehensive 81-page research paper introduces OpenDev, a systematic framework for building terminal-based AI coding agents. The work details specialized model routing, dual-agent architectures, and safety controls that address reliability challenges in autonomous coding systems.
LeCun's NYU Team Unveils Breakthrough in Efficient Transformer Architecture
Yann LeCun and NYU collaborators have published new research offering significant improvements to Transformer efficiency. The work addresses critical computational bottlenecks in current architectures while maintaining performance.