llm architecture
30 articles about llm architecture in AI news
LLM Architecture Gallery Compiles 38 Model Designs from 2024-2026 with Diagrams and Code
A new open-source repository provides annotated architecture diagrams, key design choices, and code implementations for 38 major LLMs released between 2024 and 2026, including DeepSeek V3, Qwen3 variants, and GLM-5 744B.
Moonshot AI CEO Yang Zhilin Advocates for Attention Residuals in LLM Architecture
Yang Zhilin, founder of Moonshot AI, argues for the architectural value of attention residuals in large language models. This technical perspective comes from the creator of the popular Kimi Chat model.
DriveXQA: New AI Framework Helps Autonomous Vehicles See Through Fog and Sensor Failures
Researchers introduce DriveXQA, a multimodal dataset and MVX-LLM architecture that enables autonomous vehicles to answer complex questions about adverse driving conditions by fusing data from multiple visual sensors, significantly improving performance in challenging scenarios like fog.
Solving LLM Debate Problems with a Multi-Agent Architecture
A developer details moving from generic prompts to a multi-agent system where two LLMs are forced to refute each other, improving reasoning and output quality. This is a technical exploration of a novel prompting architecture.
DualPath Architecture Shatters KV-Cache Bottleneck, Doubling LLM Throughput for AI Agents
Researchers have developed DualPath, a novel architecture that eliminates the KV-cache storage bottleneck in agentic LLM inference. By implementing dual-path loading with RDMA transfers, the system achieves nearly 2× throughput improvements for both offline and online scenarios.
MARS Method Boosts LLM Throughput 1.7x With No Architecture Changes
Researchers introduced MARS, a training-free method that allows autoregressive LLMs to generate multiple tokens per forward pass, boosting throughput by 1.5-1.7x without architectural modifications or accuracy loss.
New Pipeline Enables Lossless Distillation of Transformer LLMs into Hybrid xLSTM Architectures
Researchers developed a distillation pipeline that transfers transformer LLM knowledge into hybrid xLSTM models. The distilled students match or exceed teacher models like Llama, Qwen, and Olmo on downstream tasks.
Expert Pyramid Tuning: A New Parameter-Efficient Fine-Tuning Architecture for Multi-Task LLMs
Researchers propose Expert Pyramid Tuning (EPT), a novel PEFT method that uses multi-scale feature pyramids to better handle tasks of varying complexity. It outperforms existing MoE-LoRA variants while using fewer parameters, offering more efficient multi-task LLM deployment.
SauerkrautLM-Doom-MultiVec: 1.3M-Param Model Outperforms LLMs 92,000x Its Size
Researchers built a 1.3M-parameter model that plays DOOM in real-time, scoring 178 frags in 10 episodes. It outperforms LLMs like Nemotron-120B and GPT-4o-mini, which scored only 13 combined, demonstrating the power of small, task-specific architectures.
Memory Systems for AI Agents: Architectures, Frameworks, and Challenges
A technical analysis details the multi-layered memory architectures—short-term, episodic, semantic, procedural—required to transform stateless LLMs into persistent, reliable AI agents. It compares frameworks like MemGPT and LangMem that manage context limits and prevent memory drift.
Andrej Karpathy's Personal Knowledge Management System Uses LLM Embeddings Without RAG for 400K-Word Research Base
AI researcher Andrej Karpathy has developed a personal knowledge management system that processes 400,000 words of research notes using LLM embeddings rather than traditional RAG architecture. The system enables semantic search, summarization, and content generation directly from his Obsidian vault.
FAOS Neurosymbolic Architecture Boosts Enterprise Agent Accuracy by 46% via Ontology-Constrained Reasoning
Researchers introduced a neurosymbolic architecture that constrains LLM-based agents with formal ontologies, improving metric accuracy by 46% and regulatory compliance by 31.8% in controlled experiments. The system, deployed in production, serves 21 industries with over 650 agents.
Meta's Adaptive Ranking Model: A Technical Breakthrough for Efficient LLM-Scale Inference
Meta has developed a novel Adaptive Ranking Model (ARM) architecture designed to drastically reduce the computational cost of serving large-scale ranking models for ads. This represents a core infrastructure breakthrough for deploying LLM-scale models in production at massive scale.
Alibaba's XuanTie C950 CPU Hits 70+ SPECint2006, Claims RISC-V Record with Native LLM Support
Alibaba's DAMO Academy launched the XuanTie C950, a RISC-V CPU scoring over 70 on SPECint2006—the highest single-core performance for the architecture—with native support for billion-parameter LLMs like Qwen3 and DeepSeek V3.
8 AI Model Architectures Visually Explained: From Transformers to CNNs and VAEs
A visual guide maps eight foundational AI model architectures, including Transformers, CNNs, and VAEs, providing a clear reference for understanding specialized models beyond LLMs.
A Deep Dive into LoRA: The Mathematics, Architecture, and Deployment of Low-Rank Adaptation
A technical guide explores the mathematical foundations, memory architecture, and structural consequences of Low-Rank Adaptation (LoRA) for fine-tuning LLMs. It provides critical insights for practitioners implementing efficient model customization.
The Digital Twin Revolution: How LLMs Are Creating Virtual Testbeds for Social Media Policy
Researchers have developed an LLM-augmented digital twin system that simulates short-video platforms like TikTok to test policy changes before implementation. This four-twin architecture allows platforms to study long-term effects of AI tools and content policies in realistic closed-loop simulations.
dLLM Framework Unifies Diffusion Language Models, Opening New Frontiers in AI Text Generation
Researchers have introduced dLLM, a unified framework that standardizes training, inference, and evaluation for diffusion language models. This breakthrough enables conversion of existing models like BERT into diffusion architectures and facilitates reproduction of cutting-edge models like LLaDA and Dream.
Beyond the Transformer: Liquid AI's Hybrid Architecture Challenges the 'Bigger is Better' Paradigm
Liquid AI's LFM2-24B-A2B model introduces a novel hybrid architecture blending convolutions with attention, addressing critical scaling bottlenecks in modern LLMs. This 24-billion parameter model could redefine efficiency standards in AI development.
Anthropic Paper: 'Emotion Concepts and their Function in LLMs' Published
Anthropic has released a new research paper titled 'Emotion Concepts and their Function in LLMs.' The work investigates the role and representation of emotional concepts within large language model architectures.
Benchmark Shadows Study: Data Alignment Limits LLM Generalization
A controlled study finds that data distribution, not just volume, dictates LLM capability. Benchmark-aligned training inflates scores but creates narrow, brittle models, while coverage-expanding data leads to more distributed parameter adaptation and better generalization.
ReRec: A New Reinforcement Fine-Tuning Framework for Complex LLM-Based
A new paper introduces ReRec, a reinforcement fine-tuning framework designed to enhance LLMs' reasoning capabilities for complex recommendation tasks. It uses specialized reward shaping and curriculum learning to improve performance while preserving the model's general abilities. This addresses a key weakness in using off-the-shelf LLMs for sophisticated personalization.
Developer Builds LLM Wiki 'Second Brain' for AI Coding Agents
A developer built an 'LLM Wiki' that feeds an AI coding agent's context window with a living knowledge base of a specific codebase. This aims to solve the agent's short-term memory problem, leading to more consistent and informed code generation.
Developer Ships LLM-Powered Knowledge Graph Days After Karpathy Tweet
Following a tweet by Andrej Karpathy, a developer rapidly built and released a working implementation of an LLM-powered knowledge graph on GitHub, showcasing the speed of open-source AI development.
Target's Tech Blog Teases 'Next-Gen Solution' for Digital Order Fulfillment
Target's internal tech blog has announced work on a next-generation solution for digital order fulfillment, specifically targeting the balance between operational speed and inventory accuracy. This is a core operational challenge for omnichannel retailers.
Sipeed Launches PicoClaw, Open-Source Alternative to OpenClaw for LLM Orchestration
Sipeed, known for its AI hardware, has open-sourced PicoClaw, a framework for orchestrating multiple LLMs across different channels. This provides a direct, community-driven alternative to the popular OpenClaw project.
Microsoft's BitNet Enables 100B-Parameter LLMs on CPU, Cuts Energy 82%
Microsoft Research's BitNet project demonstrates 1-bit LLMs with 100B parameters that run efficiently on CPUs, using 82% less energy while maintaining performance, challenging the need for GPUs in local deployment.
Agent Harness Engineering: The 'OS' That Makes LLMs Useful
A clear analogy frames raw LLMs as CPUs needing an operating system. The agent harness—managing tools, memory, and execution—is what creates useful applications, as proven by LangChain's benchmark jump.
FAERec: A New Framework for Fusing LLM Knowledge with Collaborative Signals for Tail-Item Recommendations
A new paper introduces FAERec, a framework designed to improve recommendations for niche items by better fusing semantic knowledge from LLMs with collaborative filtering signals. It addresses structural inconsistencies between embedding spaces to enhance model accuracy.
CMU Study: Top LLMs Fail Simple Contradiction Tests, Lack True Reasoning
Carnegie Mellon researchers tested 14 leading LLMs on simple contradiction tasks; all failed consistently, revealing fundamental reasoning gaps despite advanced benchmarks. (199 chars)