PhAIL: Open Benchmark for Robot AI on Real Hardware Shows Best Model at 5% of Human Throughput

Researchers have launched PhAIL (phail.ai), an open benchmark for evaluating robot AI systems on real hardware using the DROID platform, with the best-performing model achieving only 5% of human throughput and requiring intervention every 4 minutes.