open data
30 articles about open data in AI news
Donate Claude Code Traces to Hugging Face's Open Dataset in One Command
Trace Commons lets Claude Code users donate anonymized session traces to an open CC-BY-4.0 dataset on Hugging Face. Run `/donate-trace` after open-source work to share how you solved problems — without exposing secrets or paths.
AWS launches MCP server for its open-data registry
AWS launched an MCP server for its Registry of Open Data, giving AI agents natural-language access to 170+ public datasets.
OpenAI's $20B Georgia Data Center Tests Gigawatt Buildout
OpenAI announced $20B Georgia data center. Gigawatt buildout faces execution test amid supply chain and power constraints.
OpenAI Stargate Abilene: $100B data center cluster breaks ground in Texas
OpenAI's $100B Stargate Abilene data center cluster in Texas targets 5 GW capacity by 2028, the largest single AI compute build. Epoch AI estimates power consumption equivalent to 5 nuclear reactors.
OpenAI Stargate Data Centers Lag Behind Rivals in Cost, Timeline
OpenAI's Stargate data centers face higher costs and longer timelines than competitors, per a Distilled report, threatening its AI scaling ambitions.
OpenAI Eyes 10GW Ohio Data Center with Nvidia Backing
OpenAI is negotiating a 10GW Ohio data center with Nvidia backing, potentially costing $500B on federal land.
DataArc-SynData-Toolkit: Open-Source Framework for Multimodal Synthetic Data
DataArc-SynData-Toolkit is an open-source framework for multimodal synthetic data, aiming to lower technical barriers for LLM training. It features a configuration-driven pipeline with visual interface and modular architecture.
Billionaire Sues Tiny Michigan Township to Force OpenAI Data Center Through
Billionaire Steven Roth's Related Digital sued Saline Township, Michigan, after it rejected a 21M sq ft OpenAI data center, forcing approval via 'exclusionary zoning' claim.
OpenAI Open-Sources Datacenter Networking Tech
OpenAI open-sourced its datacenter networking tech (Tectonic filesystem, custom stack) to challenge Google Cloud's proprietary AI infrastructure and set an open standard.
OpenAI Privacy Filter Gets 6x More PII Labels via Nvidia Data
OpenAI has retrained its privacy filter using Nvidia's Nemotron-PII dataset, expanding PII detection from 8 to over 50 label types, targeting healthcare and enterprise use cases with better accuracy.
OpenAI's 'Freebird' Data Center in Texas to Span 549K Sq Ft, Cost $470M
OpenAI is building a massive 548,950-square-foot data center in Milam, Texas, named 'Freebird,' with a first-phase cost of around $470 million. This infrastructure investment is critical for scaling next-generation AI model training and inference.
OpenCSF: A 1.5TB Free Computer Science Library Emerges from Unstructured Web Data
A new open-source dataset called OpenCSF has been compiled, containing 1.5TB of computer science materials scraped from public web sources. It provides a massive, free corpus for AI training and research in software engineering and CS education.
Developer Releases Open-Source Toolkit for Local Satellite Weather Data Processing
A developer has released an open-source toolkit that enables local processing of live satellite weather imagery and raw data, bypassing traditional APIs. The tool appears to use computer vision and data parsing to extract information directly from satellite feeds.
Massive Open-Source Dataset of Computer Screen Recordings Released to Train AI Agents
Researchers have released the world's largest open-source dataset of computer-use recordings on Hugging Face. The collection contains 48,478 screen recording videos totaling approximately 12,300 hours of professional software usage, licensed under CC-BY-4.0 for AI training and evaluation.
Open-Source AI Agent Unifies Database Analytics Without Manual Joins
A developer has created an open-source analytics agent that queries MongoDB and HubSpot through a single SQL interface, eliminating manual joins and enabling cross-source reasoning. The system can answer complex business questions like identifying top customers with combined revenue and CRM data.
OpenAI's IH-Challenge Dataset: Teaching AI to Distinguish Trusted from Untrusted Instructions
OpenAI has released IH-Challenge, a novel training dataset designed to teach AI models to prioritize trusted instructions over untrusted ones. Early results indicate significant improvements in security and defenses against prompt injection attacks, marking a step toward more reliable and controllable AI systems.
AI Infrastructure Shakeup: Meta Steps In as Oracle-OpenAI Texas Data Center Deal Collapses
Oracle and OpenAI have abandoned plans to expand a flagship AI data center in Texas, with Meta Platforms now negotiating to lease the site. The collapse highlights the complex financing and strategic challenges in building billion-dollar AI infrastructure.
OpenAI's Database Mastery: How PostgreSQL Powers ChatGPT's Global Infrastructure
OpenAI has revealed how it scaled a single PostgreSQL database to handle millions of queries per second for 800 million ChatGPT users. Their 10 strategic optimizations demonstrate how traditional databases can support massive AI workloads.
Vercel Data: Open Models Spend Collapses to All-Time Low
Closed AI models hit 97.09% spend share via Vercel; open models at all-time low over past 5 days.
Amazon Opens Trainium Chips to Outside Data Centers, Targeting Nvidia's Core Business
AWS AI chief Peter DeSantis confirmed Amazon is negotiating to sell Trainium chips externally for the first time, backed by Andy Jassy's estimate of a $50B annual revenue potential. With Trainium3 sold out, Trainium4 pre-booked, and Anthropic and OpenAI already running gigawatts of Trainium capacity
InsForge Open-Source Framework Gives AI Agents Backend Database & Auth
Developer Akshay Pachaar launched InsForge, an open-source framework that exposes backend primitives through a semantic layer AI agents can understand. This aims to solve a core weakness where agents excel at frontend code but fail at backend logic.
Scrapy Revolutionizes Web Scraping: How This Open-Source Framework Is Democratizing Data Extraction
Scrapy, a powerful Python framework, enables developers to extract structured data from any website locally, eliminating SaaS dependencies and cloud costs. With 15+ years of production use and 59K GitHub stars, it offers enterprise-grade scraping capabilities for free.
Datalab's Marker v2 Hits 23.7 Pages/s on B200
Datalab's Marker v2 parses documents at 23.7 pages/s on a B200, supports 90+ languages, and is open-source. The speed claim targets bulk ingestion for RAG pipelines.
RLSVR Turns Open-Ended Tasks Into Spy Game for Verifiable Rewards
RLSVR uses a 'spy' game to generate verifiable rewards for open-ended LLM tasks, removing the judge model. Announced via tweet, no benchmark data disclosed.
Nvidia Weighs $250B Guarantee for OpenAI's Ohio Campus
Nvidia may guarantee $250B for OpenAI's Ohio data center lease, with a $350B chip financing deal, per @tomshardware. Unconfirmed but signals massive AI infrastructure funding.
Xiaomi Open-Sources 38B Robotics-U0 Unifying Four Embodied Tasks
Xiaomi open-sourced 38B-parameter Robotics-U0, unifying four embodied tasks in a single model. No benchmarks or training data disclosed yet.
MCP Explained: The Standard Quietly Changing How AI Agents Connect to Data
Anthropic released MCP in November 2024; OpenAI and Google DeepMind adopted it by March 2025. The protocol standardizes AI agent-data connectivity, reducing integration complexity.
OpenAI Can Predict Model Failures via Past Chat Replay
OpenAI can estimate model failures by replaying past chats, enabling proactive error detection without new labeled data. No benchmark numbers disclosed.
OpenAI's ChatGPT 'Dreaming' Memory Retains Preferences Across Sessions
OpenAI launched a dreaming memory system for ChatGPT that retains user preferences across conversations by compressing and replaying session data, enabling persistent personalization.
Miso One: 8B Open-Source TTS Hits 110ms Latency, Real Emotion
Miso One, an 8B open-source TTS model, achieves 110ms latency with emotional range. Weights are fully open-source for self-hosting, but no benchmark data is provided.