hardware benchmarks
30 articles about hardware benchmarks in AI news
Ant Ling-3.0-flash Beats 1T-Ring-2.6 on 11 of 12 Benchmarks
Ant's 124B-param Ling-3.0-flash with 5.1B activated beats 1T-Ring-2.6 in 11 of 12 benchmarks, tying DeepSeek V4 Flash. Sparse activation economics are the story.
InternVLA-A1.5 Unifies Vision, Foresight, Action — SOTA on All Six Sim Benchmarks
InternVLA-A1.5 unifies vision-language understanding, latent foresight, and action into one robot policy, achieving SOTA on all six simulation benchmarks.
NVIDIA Vera CPU Benchmarks: 1.55x Faster Than Intel Xeon in Phoronix Tests
NVIDIA Vera CPU benchmarks show 1.55x performance over Intel Xeon 6980P and 10% over AMD EPYC 9575F, with 1.2 TB/s memory bandwidth.
MiniMax M2.7 Hits 400 TPS on SambaNova Hardware
MiniMax M2.7 reaches 400 TPS on SambaNova hardware, making latency imperceptible. Details on model size and batch size undisclosed.
Claude Opus 4.7 Builds AlphaZero-Style Self-Play on Consumer Hardware
Claude Opus 4.7 built AlphaZero self-play from scratch on consumer hardware in three hours, showing autonomous algorithmic code generation.
AI-Powered Circuit Simulator Offers Free Hardware Prototyping
A new website provides a free, AI-assisted environment for designing and testing electronic circuits, featuring pre-built projects for learning. This lowers the barrier to entry for hardware prototyping and education.
OpenClaw Voice Interface Demo Shows Real-Time AI Assistant Hardware
A developer showcased a custom hardware rig that integrates a push-button voice interface with the OpenClaw AI model, streaming responses in real-time. This demonstrates a tangible, open-source alternative to proprietary voice assistants like Amazon Alexa.
MLPerf 6.0: NVIDIA Sweeps New Benchmarks, AMD MI355X Within 30% on Select Tests
MLPerf 6.0 results show NVIDIA winning every new benchmark, with its GB300 NVL72 system achieving nearly 3x more throughput than six months ago. AMD's MI355X showed progress, coming within 10-30% on select single-node tests but skipping most new benchmarks.
Apple M5 Max NPU Benchmarks 2x Faster Than Intel Panther Lake NPU in Parakeet v3 AI Inference Test
A leaked benchmark using the Parakeet v3 AI speech recognition model shows Apple's next-generation M5 Max Neural Processing Unit (NPU) delivering double the inference speed of Intel's competing Panther Lake NPU. This real-world test provides early performance data in the intensifying on-device AI hardware race.
PhAIL: Open Benchmark for Robot AI on Real Hardware Shows Best Model at 5% of Human Throughput
Researchers have launched PhAIL (phail.ai), an open benchmark for evaluating robot AI systems on real hardware using the DROID platform, with the best-performing model achieving only 5% of human throughput and requiring intervention every 4 minutes.
Perplexity's OpenClaw Evolution: Building Secure AI Agents for Local Hardware
Perplexity AI has expanded its agent ecosystem to enable local hardware and cloud infrastructure to run AI agents securely, addressing vulnerabilities found in earlier OpenClaw implementations while maintaining open-source accessibility.
SEval-NAS: The Flexible Framework That Could Revolutionize Hardware-Aware AI Design
Researchers propose SEval-NAS, a search-agnostic evaluation method that decouples metric calculation from the Neural Architecture Search process. This allows AI developers to easily introduce new performance criteria, especially for hardware-constrained devices, without redesigning their entire search algorithms.
Qwen 3.5 Small Models Defy Expectations, Outperforming Giants in Key AI Benchmarks
Alibaba's Qwen 3.5 small models (4B and 9B parameters) are reportedly outperforming much larger competitors like GPT-OSS-120B on several metrics. These compact models feature a 262K context window, early-fusion vision-language training, and hybrid architecture, achieving impressive scores on MMLU-Pro and other benchmarks.
LLM4Cov: How Offline Agent Learning is Revolutionizing Hardware Verification
Researchers have developed LLM4Cov, a novel framework that enables execution-aware LLM agents to learn from expensive simulator feedback without costly online reinforcement learning. The approach achieves 69.2% coverage in hardware verification tasks, outperforming larger models through innovative offline learning techniques.
GPT-5.5 Tops Benchmarks, Costs 2x API Price, Still Hallucinates
OpenAI launched GPT-5.5, an agentic model that tops Terminal-Bench 2.0 at 82.7% and surpasses Claude Opus 4.7 and Gemini 3.1 Pro on coding and math. However, independent testing shows higher hallucination rates and effective API costs 20% above GPT-5.4 despite doubled token prices.
Alibaba's ABot Models Top Embodied AI Benchmarks, Beat Google & NVIDIA
Alibaba's mapping division, Amap, launched three embodied AI models that topped the AGIbot World Challenge and World Arena, beating Google and NVIDIA. The ABot-M0 model for manipulation is fully open-source.
Hugging Face Launches 'Kernels' Hub for GPU Code, Like GitHub for AI Hardware
Hugging Face has launched 'Kernels,' a new section on its Hub for sharing and discovering optimized GPU kernels. This treats performance-critical code as a first-class artifact, similar to AI models.
VoxCPM2 Open-Source Voice AI Outperforms ElevenLabs on Key Benchmarks
Researchers from OpenBMB and Tsinghua University released VoxCPM2, a 2B-parameter open-source voice AI that clones voices from short clips and creates voices from text descriptions. It outperforms ElevenLabs on the Minimax-MLS benchmark and runs locally with no API costs.
Agent Psychometrics: New Framework Predicts Task-Level Success in Agentic Coding Benchmarks with 0.81 AUC
A new research paper introduces a framework using Item Response Theory and task features to predict success on individual agentic coding tasks, achieving 0.81 AUC. This enables benchmark designers to calibrate difficulty without expensive evaluations.
Ornith-1.5 Open-Source LLM Family: 9B Dense, 35B MoE
Ornith-1.5 open-source LLM family announced with 9B Dense, 35B MoE, and 39B variants. No benchmarks or technical details disclosed, limiting immediate evaluation.
FreeToken Runs 284B MoE Locally on a Gaming Desktop
FreeToken claims 284B MoE serving on a gaming desktop via unified PC inference. No benchmarks disclosed; feasibility depends on MoE sparsity and offload strategy.
Redis Creator antirez Writes MiniMax H3 Mac Inference Engine
Redis creator antirez wrote a MiniMax H3 Mac inference engine, announced on X. Open weights enabled the port, highlighting community-driven hardware support.
SemiAnalysis: Can TileRT Software Match Cerebras on NVIDIA GPUs?
SemiAnalysis is testing TileRT InferenceX, software claiming batch-1 ultra-high interactivity on NVIDIA GPUs, targeting Cerebras, Groq LPU, and SambaNova. No benchmarks disclosed yet.
DeepSeek Sparse Attention: DSA Redefines Resource Allocation
SemiAnalysis touts DeepSeek Sparse Attention as a paradigm shift, but lacks data. Sparse attention could cut costs, yet no benchmarks yet.
Cursor Open-Sources MoE Megakernel for NVL72s
Cursor open-sourced Mixture-of-Kittens, an MoE megakernel for NVL72s, targeting inference efficiency. No benchmarks disclosed, but the move signals Cursor's infrastructure ambitions.
China's DFSX SuperNode Doubles GB200 Memory Bandwidth on 14nm
China's DFSX SuperNode claims 2x GB200 memory bandwidth using 14nm vertical towers, but lacks benchmarks or ship dates, warranting skepticism.
MiniMax H3 Video Model Beats Seedance 2.0, Opens Weights
MiniMax launched H3 video model, ranking #1 in editing benchmarks while opening weights to challenge ByteDance's Seedance 2.0 and Google's Gemini Omni Flash.
M4 Max Mac Studio Tops GB10 in Local AI Decode Throughput
M4 Max Mac Studio beats GB10 and Strix Halo in local AI decode throughput but memory bandwidth caps large model performance. Tom's Hardware tested llama.cpp across three platforms.
Moonshot AI Releases 1.56T-Parameter Kimi K3, Requires 2x B200 Nodes
Moonshot AI released Kimi K3, a 1.56T parameter MoE model at 1561 GB, requiring 2x B200 nodes. No benchmarks disclosed.
China Builds First Phase-Change Memristor Neural Chip
Chinese researchers built the first phase-change memristor neural chip, claiming 10,000x energy efficiency but releasing no benchmarks.