langsmith
14 articles about langsmith in AI news
Harbor Adds LangSmith Sandbox Support, Making Agent Eval Backends Swappable
Harbor, an open-source agent-evaluation framework, now integrates LangSmith sandboxes. This allows users to run the same eval across multiple providers (Daytona, Modal, E2B, LangSmith) with a single flag change, eliminating per-provider setup tax.
Microsoft RAMPART Brings Pytest-Based Safety Testing to AI Agents
Microsoft's RAMPART brings pytest-native safety testing to AI agents, covering adversarial attacks and benign failures, addressing a critical gap in agent development.
Hermes Agent Desktop App Launches for Multi-Agent Management
Hermes Agent launched a desktop app for orchestrating autonomous AI agents with persistent memory and continuous workflows, announced via X.
Vibe Training: SLM Replaces LLM-as-a-Judge, 8x Faster, 50% Fewer Errors
Plurai introduces 'vibe training,' using adversarial agent swarms to distill a small language model (SLM) for evaluating and guarding production AI agents. The SLM outperforms standard LLM-as-a-judge setups with ~8x faster inference and ~50% fewer evaluation errors.
Future AGI Open-Sources Platform to Stop Agent Hallucination
Future AGI open-sourced a full platform that aims to eliminate silent hallucination in production AI agents, offering runtime monitoring and intervention tools.
DigitalOcean's Signal Sampling Finds Top Agent Trajectories Without LLM Cost
DigitalOcean's paper introduces lightweight behavioral signals to rank 80k agent-user trajectories, achieving 82% informativeness in sampled reviews compared to 54% for random sampling, with no LLM overhead.
Anthropic Launches Managed Agents for Long-Running AI Workflows
Anthropic has launched Managed Agents, a hosted service for creating and running long-running AI agents. This addresses core system design challenges for persistent AI workflows that operate beyond single API calls.
4 Observability Layers Every AI Developer Needs for Production AI Agents
A guide published on Towards AI details four critical observability layers for production AI agents, addressing the unique challenges of monitoring systems where traditional tools fail. This is a foundational technical read for teams deploying autonomous AI systems.
Top AI Agent Frameworks in 2026: A Production-Ready Comparison
A comprehensive, real-world evaluation of 8 leading AI agent frameworks based on deployments across healthcare, logistics, fintech, and e-commerce. The analysis focuses on production reliability, observability, and cost predictability—critical factors for enterprise adoption.
Meta-Harness Framework Automates AI Agent Engineering, Achieves 6x Performance Gap on Same Model
A new framework called Meta-Harness automates the optimization of AI agent harnesses—the system prompts, tools, and logic that wrap a model. By analyzing raw failure logs at scale, it improved text classification by 7.7 points while using 4x fewer tokens, demonstrating that harness engineering is a major leverage point as model capabilities converge.
Research: Cheaper Reasoning Models Can Cost 3x More Due to Higher Error Rates and Retry Loops
New research indicates that selecting AI models based solely on per-token pricing can be a false economy. Models with lower accuracy often require multiple expensive retries, ultimately increasing total costs by up to 300%.
Cline Launches Kanban Platform for Visualizing and Managing Multi-Agent AI Workflows
Cline has launched Cline Kanban, a visual platform for developers to manage and orchestrate multi-agent AI workflows. It aims to address the complexity of coordinating multiple specialized AI agents on a single task.
LangGraph vs CrewAI vs AutoGen: A 2026 Decision Guide for Enterprise AI Agent Frameworks
A practical comparison of three leading AI agent frameworks—LangGraph, CrewAI, and AutoGen—based on production readiness, development speed, and observability. Essential reading for technical leaders choosing a foundation for agentic systems.
K9 Audit: The Cryptographic Safety Net AI Agents Desperately Need
K9 Audit introduces a revolutionary causal audit trail system for AI agents that records not just actions but intentions, addressing critical reliability gaps in autonomous systems. By creating tamper-evident, hash-chained records of what agents were supposed to do versus what they actually did, it provides unprecedented visibility into AI decision-making failures.