retrieval systems
30 articles about retrieval systems in AI news
Differentiable Geometric Indexing: A Technical Breakthrough for Generative Retrieval Systems
New research introduces Differentiable Geometric Indexing (DGI), solving core optimization and geometric conflicts in generative retrieval. This enables end-to-end training that better surfaces long-tail items, validated on e-commerce datasets.
New Research Reveals Fundamental Limitations of Vector Embeddings for Retrieval
A new theoretical paper demonstrates that embedding-based retrieval systems have inherent limitations in representing complex relevance relationships, even with simple queries. This challenges the assumption that better training data alone can solve all retrieval problems.
Google's STATIC Framework Revolutionizes LLM Retrieval with 948x Speed Boost
Google AI's STATIC framework uses sparse matrix computation to accelerate constrained decoding in generative retrieval systems by up to 948x. This breakthrough enables LLMs to enforce business logic while maintaining real-time performance in recommendation systems.
Beyond RAG: How AI Memory Systems Are Creating Truly Adaptive Agents
AI development is shifting from static retrieval systems to dynamic memory architectures that enable continual learning. This evolution from RAG to agent memory represents a fundamental change in how AI systems accumulate and utilize knowledge over time.
New Diagnostic Tool Reveals Hidden Flaws in AI Ranking Systems
Researchers have developed a novel diagnostic method that isolates and analyzes LLM reranking behavior using fixed evidence pools. The study reveals surprising inconsistencies in how different AI models prioritize information, with implications for search engines and information retrieval systems.
PoisonedRAG Attack Hijacks LLM Answers 97% of Time with 5 Documents
Researchers demonstrated that inserting only 5 poisoned documents into a 2.6 million document database can hijack a RAG system's answers 97% of the time, exposing critical vulnerabilities in 'hallucination-free' retrieval systems.
New Research Proposes Lightweight Method to Fix Stale Semantic IDs in
Researchers propose a method to update 'stale' Semantic IDs in generative retrieval systems without full retraining. Their alignment technique improves key metrics and reduces compute costs by ~8-9x, addressing a core challenge in dynamic recommendation environments.
From BM25 to Corrective RAG: A Benchmark Study Challenges the Dominance of Semantic Search for Tabular Data
A systematic benchmark of 10 RAG retrieval strategies on a financial QA dataset reveals that a two-stage hybrid + reranking pipeline performs best. Crucially, the classic BM25 algorithm outperformed modern dense retrieval models, challenging a core assumption in semantic search. The findings provide actionable, cost-aware guidance for building retrieval systems over heterogeneous documents.
A Systematic Study of Pseudo-Relevance Feedback with LLMs: Key Design Choices for Search
New research systematically analyzes how to best use LLMs for pseudo-relevance feedback in search, finding that the method for using feedback is critical and that LLM-generated text can be a cost-effective feedback source. This provides clear guidance for improving retrieval systems.
Memory Sparse Attention (MSA) Enables 100M Token Context Windows with Minimal Performance Loss
Memory Sparse Attention (MSA) is a proposed architecture that allows AI models to store and reason over massive long-term memory directly within their attention mechanism, eliminating the need for external retrieval systems. The approach reportedly enables context windows of up to 100 million tokens with minimal performance degradation.
Beyond Simple Retrieval: The Rise of Agentic RAG Systems That Think for Themselves
Traditional RAG systems are evolving into 'agentic' architectures where AI agents actively control the retrieval process. A new 5-layer evaluation framework helps developers measure when these intelligent pipelines make better decisions than static systems.
GRank: A New Target-Aware, Index-Free Retrieval Paradigm for Billion-Scale Recommender Systems
A new paper introduces GRank, a structured-index-free retrieval framework that unifies target-aware candidate generation with fine-grained ranking. It significantly outperforms tree- and graph-based methods on recall and latency, and is already deployed at massive scale.
The Multimodal Retrieval Gap: New Benchmark Exposes Critical Weakness in AI Systems
Researchers introduce MultiHaystack, a benchmark revealing that multimodal AI models struggle significantly when required to retrieve evidence from large, mixed-media collections before reasoning. While models perform well when given correct evidence, their accuracy plummets when they must first locate it across 46,000+ documents, images, and videos.
AI Memory Survey: Three Systems Needed for Human-Like Recall
A new survey paper proposes that modern AI requires three distinct memory systems—parametric, retrieval, and agent memory—to achieve human-like cognition, highlighting control as the key bottleneck.
Beyond Relevance: A New Framework for Utility-Centric Retrieval in the LLM Era
This tutorial paper posits that the rise of Retrieval-Augmented Generation (RAG) changes the fundamental goal of information retrieval. Instead of finding documents relevant to a query, systems must now retrieve information that is most *useful* to an LLM for generating a high-quality answer. This requires new evaluation frameworks and system designs.
Why Most RAG Systems Fail in Production: A Critical Look at Common Pitfalls
An expert article diagnoses the primary reasons RAG systems fail in production, focusing on poor retrieval, lack of proper evaluation, and architectural oversights. This is a crucial reality check for teams deploying AI assistants.
8 RAG Architectures Explained for AI Engineers: From Naive to Agentic Retrieval
A technical thread explains eight distinct RAG architectures with specific use cases, from basic vector similarity to complex agentic systems. This provides a practical framework for engineers choosing the right approach for different retrieval tasks.
Nemotron ColEmbed V2: NVIDIA's New SOTA Embedding Models for Visual Document Retrieval
NVIDIA researchers have released Nemotron ColEmbed V2, a family of three models (3B, 4B, 8B parameters) that set new state-of-the-art performance on the ViDoRe benchmark for visual document retrieval. The models use a 'late interaction' mechanism and are built on top of pre-trained VLMs like Qwen3-VL and NVIDIA's own Eagle 2. This matters because it directly addresses the challenge of retrieving information from visually rich documents like PDFs and slides within RAG systems.
Late Interaction Retrieval Models Show Length Bias, MaxSim Operator Efficiency Confirmed in New Study
New arXiv research analyzes two dynamics in Late Interaction retrieval models: a documented length bias in scoring and the efficiency of the MaxSim operator. Findings validate theoretical concerns and confirm the pooling method's effectiveness, with implications for high-precision search systems.
VMLOps Publishes Comprehensive RAG Techniques Catalog: 34 Methods for Retrieval-Augmented Generation
VMLOps has released a structured catalog documenting 34 distinct techniques for improving Retrieval-Augmented Generation (RAG) systems. The resource provides practitioners with a systematic reference for optimizing retrieval, generation, and hybrid pipelines.
AI Efficiency Breakthrough: New Framework Optimizes Agentic RAG Systems Under Budget Constraints
Researchers have developed a systematic framework for optimizing agentic RAG systems under budget constraints. Their study reveals that hybrid retrieval strategies and limited search iterations deliver maximum accuracy with minimal costs, providing practical guidance for real-world AI deployment.
Democratizing AI: How Open-Source RAG Systems Are Revolutionizing Enterprise Incident Analysis
A new guide demonstrates how to build production-ready Retrieval-Augmented Generation systems using completely free, local tools. This approach enables organizations to analyze incidents and leverage historical data without costly API dependencies, making advanced AI accessible to all.
Multi-Agent LLM Systems Fail to Outperform Single Models, Study Finds
New paper finds multi-agent LLM systems underperform single models by 2.3% on reasoning benchmarks, challenging a core assumption in AI engineering.
A Reference Architecture for Agentic Hybrid Retrieval in Dataset Search
A new research paper presents a reference architecture for 'agentic hybrid retrieval' that orchestrates BM25, dense embeddings, and LLM agents to handle underspecified queries against sparse metadata. It introduces offline metadata augmentation and analyzes two architectural styles for quality attributes like governance and performance.
Poisoned RAG: 5 Documents Can Corrupt 'Hallucination-Free' AI Systems
Researchers proved that planting a handful of poisoned documents in a RAG system's database can cause it to generate confident, incorrect answers. This exposes a critical vulnerability in systems marketed as 'hallucination-free'.
Skill-RAG Uses Hidden-State Probes to Trigger Retrieval Only When Needed
Researchers introduced Skill-RAG, a system that uses hidden-state probing to detect when an LLM is about to fail, triggering targeted retrieval. This improves over uniform RAG baselines on HotpotQA, Natural Questions, and TriviaQA.
Rethinking the Necessity of Adaptive Retrieval-Augmented Generation
Researchers propose AdaRankLLM, a framework that dynamically decides when to retrieve external data for LLMs. It reduces computational overhead while maintaining performance, shifting adaptive retrieval's role based on model strength.
WebAI's Open-Source Model Hits #1 on MTEB Retrieval Leaderboard
WebAI has open-sourced a document retrieval model that currently holds the #1 position on the Massive Text Embedding Benchmark (MTEB) leaderboard. This provides a high-performance, free alternative to closed-source embedding APIs used in Retrieval-Augmented Generation (RAG) pipelines.
Indexing Multimodal LLMs for Large-Scale Image Retrieval
A new arXiv paper proposes using Multimodal LLMs (MLLMs) for instance-level image-to-image retrieval. By prompting models with paired images and converting next-token probabilities into scores, the method enables training-free re-ranking. It shows superior robustness to clutter and occlusion compared to specialized models, though struggles with severe appearance changes.
Walmart Research Proposes Unified Training for Sponsored Search Retrieval
A new arXiv preprint details Walmart's novel bi-encoder training framework for sponsored search retrieval. It addresses the limitations of using user engagement as a sole training signal by combining graded relevance labels, retrieval priors, and engagement data. The method outperformed the production system in offline and online tests.