training
30 articles about training in AI news
Alibaba's MIPI fixes LLM training-inference mismatch with direct RL
Alibaba's MIPI directly optimizes inference policy, fixing the mismatch in LLM post-training via the MIPU framework.
PhotoQuilt Makes Training-Free Photomosaics at 14K Resolution
PhotoQuilt generates training-free photomosaics at any resolution, bootstrapping a global layout at low res then upscaling tiles via FLUX, scaling past 14K without quadratic attention cost.
Alibaba Open-Sources Qwen-AgentWorld for Generalist Agent Training
Alibaba open-sourced Qwen-AgentWorld and Wan-Streamer v0.1 on Hugging Face, targeting generalist agent training and real-time streaming. The releases include 8 additional papers on agent benchmarks and architectures.
Meta-skill evolution lets multi-agent systems self-improve without retraining
Multi-agent systems can improve orchestration by evolving a meta-skill via RL on interactions, without retraining agents. Demonstrated on a simulated benchmark.
Alignment Pretraining Could Backfire, LessWrong Post Warns
LessWrong post warns synthetic alignment pretraining data could backfire in capable LLMs, leading to rebel personas.
NVIDIA Blackwell Sweeps MLPerf Training 6.0, GB300 Hits 1.6x Speedup
NVIDIA Blackwell swept MLPerf Training 6.0 across all seven benchmarks. GB300 NVL72 delivered 1.6x speedup over GB200 NVL72 using NVFP4 and 8,192 GPUs.
Cerebras Claims Performance Parity With Nvidia H100 on AI Training
Cerebras claims wafer-scale chips match Nvidia H100 on AI training performance per watt, challenging Nvidia's dominance.
SemiAnalysis: Pretraining Dead for All but Frontier Labs
@SemiAnalysis_ declares pretraining dead for non-frontier labs, citing 'Pretrainitis' as vanity-driven waste. Prompt engineering offers higher ROI.
NVIDIA NVFP4 on Blackwell Cuts JAX Training by 1.8x in MaxText
NVIDIA NVFP4 on Blackwell achieves 1.8x training speedup over FP8 in JAX/MaxText with no claimed accuracy loss for models up to 70B, but larger-scale validation is needed.
xAI Drops JAX, Builds Custom C Training Framework After <10% MFU
xAI dropped JAX for GPU training after <10% MFU, building a custom C framework with Grok Build. NVIDIA's JAX team loses its biggest customer.
LLM-EDT: Dual-Phase Training Boosts Cross-Domain Rec by 12.4%
LLM-EDT improves cross-domain sequential recommendation by up to 12.4% using dual-phase training and LLM-based item generation.
Cerebras WSE-3 Claims 10x Training Speed Over Nvidia H100 on GPT-Scale Model
Cerebras claims 10x training speed over Nvidia H100 for GPT-3-scale models using WSE-3. Benchmark lacks power and cost data, limiting independent verification.
Nebius Claims First NVIDIA GB300 Exemplar Cloud for Training
Nebius becomes first cloud provider validated as NVIDIA Exemplar Cloud on GB300 for training, targeting hyperscale AI workloads.
Vibe Training: SLM Replaces LLM-as-a-Judge, 8x Faster, 50% Fewer Errors
Plurai introduces 'vibe training,' using adversarial agent swarms to distill a small language model (SLM) for evaluating and guarding production AI agents. The SLM outperforms standard LLM-as-a-judge setups with ~8x faster inference and ~50% fewer evaluation errors.
Google Splits TPU Line: 8t for Training, 8i for Inference
At Cloud Next 2026, Google introduced two new AI chips — TPU 8t for training and TPU 8i for inference — splitting its custom silicon for the first time. OpenAI, Anthropic, and Meta are buying multi-gigawatt TPU capacity, signaling a crack in NVIDIA's 81% market share.
GPT-5.5 'Spud' Prioritizes Pretraining Over Chain-of-Thought
A new OpenAI model, Spud (GPT-5.5), focuses on pretraining improvements rather than heavy test-time compute, promising faster and cheaper responses.
Building a Real-World Fraud Detection System: Beyond Just Training a Model
The article provides a practical breakdown of how to build a production-ready fraud detection system, emphasizing the integration of payment models, sequence models, and shadow mode deployment. It moves beyond pure model training to focus on the operational ML system.
Apple Releases DFNDR-12M Dataset, Claims 5x CLIP Training Efficiency
Apple has open-sourced DFNDR-12M, a multimodal dataset of 12.8 million image-text pairs with synthetic captions and pre-computed embeddings. The company claims it enables up to 5x training efficiency over standard CLIP datasets.
Gur Singh Claims 7 M4 MacBooks Match A100, Calls Cloud GPU Training a 'Scam'
Developer Gur Singh posted that seven M4 MacBooks (2.9 TFLOPS each) match an NVIDIA A100's performance, calling cloud GPU training a 'scam' and advocating for distributed, consumer-hardware approaches.
AirTrain Enables Distributed ML Training on MacBooks Over Wi-Fi
Developer @AlexanderCodes_ open-sourced AirTrain, a tool that enables distributed ML training across Apple Silicon MacBooks using Wi-Fi by syncing gradients every 500 steps instead of every step. This makes personal device training feasible for models up to 70B parameters without cloud GPU costs.
Shopify Engineering Teases 'Autoresearch' Beyond Model Training in 2026 Preview
Shopify Engineering has previewed a 2026 perspective suggesting 'autoresearch'—automated research processes—will have applications extending beyond just training AI models. This signals a broader operational automation strategy for the e-commerce giant.
LLM-HYPER: A Training-Free Framework for Cold-Start Ad CTR Prediction
A new arXiv paper introduces LLM-HYPER, a framework that treats large language models as hypernetworks to generate parameters for click-through rate estimators in a training-free manner. It uses multimodal ad content and few-shot prompting to infer feature weights, drastically reducing the cold-start period for new promotional ads and has been deployed on a major U.S. e-commerce platform.
MiniMax Open-Sources M2.7 Model, Details 'Self-Evolution' Training
Chinese AI firm MiniMax has open-sourced its M2.7 model. The key detail from its blog is a 'self-evolution' training process, likened to AlphaGo's self-play, for iterative improvement.
xAI's Grok 4.2 at 0.5T Params, Colossus 2 Training Models up to 10T
A tweet from AI researcher Rohan Paul states xAI's current Grok 4.2 model uses 0.5 trillion parameters. In parallel, the Colossus 2 project is training a suite of seven models ranging from 1 trillion to 10 trillion parameters.
Anthropic Faces Backlash Over Alleged Unauthorized Email Training for Claude
Anthropic is accused of training its Claude AI on a company's private email database without permission. This raises severe data privacy and legal questions for enterprise AI.
Walmart Research Proposes Unified Training for Sponsored Search Retrieval
A new arXiv preprint details Walmart's novel bi-encoder training framework for sponsored search retrieval. It addresses the limitations of using user engagement as a sole training signal by combining graded relevance labels, retrieval priors, and engagement data. The method outperformed the production system in offline and online tests.
Meta's New Training Recipe: Small Models Should Learn from a Single Expert
Meta AI researchers propose a novel training recipe for small language models: instead of learning from many large 'expert' models simultaneously, they should be trained sequentially on one expert at a time. This method, detailed in a new paper, reportedly improves final model performance and training efficiency.
NVIDIA Advances AI Robotics with Simulation-First Training, Isaac & Jetson
NVIDIA showcased AI robotics advances using foundation models and synthetic environments for training, enabling scalable deployment in real-world sectors like agriculture and solar. Key platforms are the Isaac simulator and Jetson edge AI hardware.
Tiny 9M Parameter LLM Tutorial Runs on Colab, Demystifies Transformer Training
A developer shared a complete tutorial for training a ~9M parameter transformer language model from scratch, including tokenizer, training, and inference, all runnable on Google Colab in minutes.
OpenAI Finishes GPT-5.5 'Spud' Pretraining, Halts Sora for Compute
OpenAI has finished pretraining its next major model, codenamed 'Spud' (likely GPT-5.5), built on a new architecture and data mix. The company reportedly halted its Sora video generation project entirely, sacrificing a $1B Disney investment, to prioritize compute for Spud's launch.