streaming
30 articles about streaming in AI news
DIET: A New Framework for Continually Distilling Streaming Datasets in Recommender Systems
Researchers propose DIET, a framework for streaming dataset distillation in recommender systems. It maintains a compact, evolving dataset (1-2% of original size) that preserves training-critical signals, reducing model iteration costs by up to 60x while maintaining performance trends.
Kimi 2.5's 1T Parameter MoE Model Runs on 96GB Mac Hardware via SSD Streaming
Developers have demonstrated that Kimi 2.5's 1 trillion parameter Mixture-of-Experts model can run on Mac hardware with just 96GB RAM by streaming expert weights from SSD, with only 32B parameters active per token.
Qwen 3.5 397B-A17B MoE Model Runs on M3 Mac at 5.7 TPS with 5.5GB Active Memory via SSD Streaming
Developer Dan reportedly runs the 209GB Qwen 3.5 397B-A17B MoE model on an M3 Mac at ~5.7 tokens per second using only 5.5GB of active memory by quantizing and streaming weights from SSD.
Global TV Liberation: How Open Source Collaboration Is Disrupting Streaming
An open-source project called Free-TV/IPTV has compiled free live TV channels from over 60 countries into a single M3U playlist. With 88 contributors maintaining the repository, this GitHub project offers HD streams from major platforms without subscriptions.
AWS Personalize cuts recommendation latency to under 10 seconds in new
AWS published a real-time e-commerce personalization blueprint that cuts recommendation latency to under 10 seconds using AWS Personalize, Kinesis, and Lambda. The architecture bridges batch and streaming modes for luxury retailers.
Alibaba Open-Sources Qwen-AgentWorld for Generalist Agent Training
Alibaba open-sourced Qwen-AgentWorld and Wan-Streamer v0.1 on Hugging Face, targeting generalist agent training and real-time streaming. The releases include 8 additional papers on agent benchmarks and architectures.
Run Claude Code in Any Sandbox with One API: AgentBox SDK
Swap coding agents and sandbox providers without changing code. Preserves full interactive capabilities (approval flows, streaming).
IAT: Instance-As-Token Compression for Historical User Sequence Modeling
Researchers propose Instance-As-Token (IAT), which compresses all features of each historical interaction into a unified embedding token, then applies standard sequence modeling. This approach outperforms state-of-the-art methods and has been deployed in e-commerce advertising, shopping mall marketing, and live-streaming e-commerce with substantial business metric improvements.
OpenClaw Voice Interface Demo Shows Real-Time AI Assistant Hardware
A developer showcased a custom hardware rig that integrates a push-button voice interface with the OpenClaw AI model, streaming responses in real-time. This demonstrates a tangible, open-source alternative to proprietary voice assistants like Amazon Alexa.
scan-for-secrets 0.2: Streamline Your Security Workflow with New CLI Options
Simon Willison's scan-for-secrets 0.2 adds streaming output, multi-directory scanning, and file-specific options that developers can use immediately in Claude Code workflows.
Building a Memory Layer for a Voice AI Agent: A Developer's Blueprint
A developer shares a technical case study on building a voice-first journal app, focusing on the critical memory layer. The article details using Redis Agent Memory Server for working/long-term memory and key latency optimizations like streaming APIs and parallel fetches to meet voice's strict responsiveness demands.
Storing Less, Finding More: Novelty Filtering Architecture for Cross-Modal Retrieval on Edge Cameras
A new streaming retrieval architecture uses an on-device 'epsilon-net' filter to retain only semantically novel video frames, dramatically improving cross-modal search accuracy while reducing power consumption to 2.7 mW. This addresses the fundamental problem of redundant frames crowding out correct results in continuous video streams.
Extended Thinking's Two-Block Response: What Claude Code Users Need to Know
Extended Thinking returns separate thinking and text blocks - handle them correctly in streaming or your UI will show raw reasoning.
FastAPI-FullStack: Production-Ready Template for AI Agent Apps with FastAPI, Next.js, and Framework Choice
A new open-source template, fastapi-fullstack, provides a pre-built foundation for deploying AI agent applications. It integrates FastAPI, Next.js, and multiple agent frameworks with WebSocket streaming, authentication, and database support out of the box.
Claude-to-IM Skill: Get Claude Code in Your Team Chat (Without OpenClaw's Security Risks)
Open-source bridge brings Claude Code to Telegram/Discord with permission prompts, streaming, and persistent sessions—safer alternative to OpenClaw.
OmniForcing Enables Real-Time Joint Audio-Visual Generation at 25 FPS with 0.7s Latency
Researchers introduced OmniForcing, a method that distills a bidirectional LTX-2 model into a causal streaming generator for joint audio-visual synthesis. It achieves ~25 FPS with 0.7s latency, a 35× speedup over offline diffusion models while maintaining multi-modal fidelity.
The Billion-Dollar Bet on AI World Models: How AMI's Funding Signals a New Era of Machine Understanding
AMI's $1 billion funding round for world model development highlights a strategic shift toward AI systems that understand physical reality. Meanwhile, robotics and creative AI tools see massive investments, with YouTube maintaining streaming dominance.
CLI vs MCP: Hands-On Experiments Show 250 Tokens vs Over 2,000 for the Same Task
An AI developer ran three experiments comparing CLI and MCP for AI agents. CLI used 250 tokens for file ops and Git; MCP used over 2,000 due to tool schema overhead, but MCP won for web fetching (250 tokens vs 2,000+ for CLI).
Microsoft Merges AutoGen and Semantic Kernel into Agent Framework
Microsoft merged AutoGen and Semantic Kernel into Agent Framework, a unified production-grade framework for .NET and Python with graph-based workflows and Foundry deployment.
Inside Shopify Hack Days: Building a prototype for music-playing pages (2026)
Shopify's 2026 Hack Days produced a prototype for music-playing product pages, involving 150 participants over 48 hours with a 200ms load time. This explores audio commerce for merchants.
Feature Freshness: The Production Bug That Makes Good Recommenders Look Bad
Jie Li's article reveals that stale features—outdated user signals—can degrade recommender performance by 20-30% in offline metrics, often misdiagnosed as model problems. The piece urges teams to prioritize feature freshness monitoring alongside model tuning.
Hugging Face Papers: 35B Agent Matches Trillion-Parameter Performance
Hugging Face Daily Papers featured eight AI papers, including Orca (world model), Dockerless (62% SWE-bench), and a 35B agent matching trillion-parameter performance.
How Major Retailers Use AI to Reimagine the Customer Journey
BizTech Magazine reports that retailers like Kering and Nike use Google Cloud AI to personalize customer journeys, lifting revenue 10-30%. This matters as AI transforms omnichannel retail with real-time data and generative models.
FreeLLMAPI Aggregates 1.7B Free Tokens/Month Across 11 Providers
FreeLLMAPI aggregates 11 free LLM providers into one endpoint, offering 1.7B tokens/month with automatic fallover. Reduces friction for side projects but faces provider tolerance risks.
Future Launches CdG PLAY x Converse Chucks in Paris
Future launched two CdG PLAY x Converse Chuck Taylors at Dover Street Market Paris, featuring Robert Nava art, alongside his album The Real Me.
MCP Server Versioning: How to Avoid Breaking All Your AI Clients (Like I
Stop breaking AI clients with MCP schema changes. Use query param versioning (?v=2) — it works with every MCP client, requires no code changes, and lets old and new versions coexist seamlessly.
Wan-Streamer v0.1 Cuts Audio-Visual Interaction Latency to 200ms in Single
Wan-Streamer v0.1 achieves 200ms model-side latency in a single Transformer for full-duplex audio-visual interaction, eliminating cascaded modules. The paper lacks parameter count and benchmark comparisons, limiting reproducibility.
How to Build a Native MCP Server
Native MCP servers embed the Model Context Protocol directly into your CMS, letting Claude Code act like a trusted team member with full permission enforcement. No more copy-paste.
Gemini 3.5 Live Translate Debuts as Real-Time Audio Model
Google DeepMind released Gemini 3.5 Live Translate, an audio model for real-time translation, but disclosed no pricing, latency, or language pair details.
DeepSeek-V4 Hits 500K Context with 90% Less KV Cache via FlashMemory
DeepSeek-V4 achieves 500K context with 90% less KV cache via FlashMemory's lookahead sparse attention, keeping only 13.5% of cache in GPU memory without retraining.