research methodology
30 articles about research methodology in AI news
Google's Groundsource: Using AI to Mine Historical Disaster Data from Global News
Google AI Research has unveiled Groundsource, a novel methodology using the Gemini model to transform unstructured global news reports into structured historical datasets. The system addresses critical data gaps in disaster management, starting with 2.6 million urban flash flood events.
LangFuse on Evaluating AI Agents in Production
The article outlines a practical methodology for monitoring and enhancing AI agent performance post-deployment. It emphasizes combining automated LLM-based evaluation with human feedback loops to create actionable datasets for fine-tuning.
Google Launches PaperBanana AI to Format Raw Methods into Publication Text
Google has launched PaperBanana, an AI tool designed to transform unstructured methodology notes into polished, publication-ready text. This targets a key bottleneck in academic writing, automating the formatting and structuring of methods sections.
Google's PaperBanana AI Generates Academic Diagrams, Beats Human Designs 3:1
Google released PaperBanana, an AI system that transforms raw methodology text into publication-ready academic diagrams using a 5-agent creative pipeline. In blind evaluations, humans preferred its outputs nearly 3 out of 4 times over manually designed figures.
Study of 1,222 Users Claims ChatGPT Use Reduces Cognitive Effort
A viral social media post references a study of 1,222 people, claiming it proves ChatGPT use reduces cognitive effort. The claim lacks published methodology or data, highlighting the ongoing debate over AI's impact on human cognition.
The Trust Revolution: New AI Benchmark Promises Unprecedented Transparency and Integrity
A new AI benchmark system introduces a dual-check methodology with monthly refreshes to prevent memorization, offering full transparency through open-source verification and independence from tool vendors.
New AI Coding Benchmark Sets Standard with Real-World Pull Requests
A groundbreaking AI coding benchmark uses real GitHub pull requests instead of synthetic tests, measuring both precision and recall across 8 tools. The transparent methodology includes publishing all results, even unfavorable ones.
OpenAI Agents Now Ask Questions Good Enough for Research Papers
Sébastien Bubeck revealed on the OpenAI Podcast that internal AI agents now ask research questions so insightful they're inspiring papers and correcting published mistakes, with a 1-2 year timeline for full researcher-level capabilities.
Google Launches Deep Research Max Agent on Gemini 3.1 Pro
Google DeepMind rolled out Deep Research Max and standard Deep Research agents on Gemini 3.1 Pro, enabling autonomous web and proprietary data research via the Gemini API. The Max variant uses extended test-time compute for thorough asynchronous reports.
AI Research Suggests Whale 'Vowels' in Sperm Whale Communication
AI researchers analyzing sperm whale vocalizations have identified combinatorial structures that function like vowels, marking a step toward decoding cetacean communication.
Tsinghua Researchers Diagnose On-Policy Distillation Failures, Propose Fixes
Researchers from Tsinghua University have pinpointed two necessary conditions for successful on-policy distillation: compatible thinking patterns and novel teacher capabilities. They propose two recovery methods to salvage failing distillation runs.
Anthropic's AI Researchers Outperform Humans, Discover Novel Science
Anthropic reports its AI systems for alignment research are surpassing human scientists in performance and generating novel scientific concepts, broadening the exploration space for AI safety.
AI Agent Research Faces Human Evaluation Bottleneck
A prominent AI researcher argues that human-based evaluation is fundamentally flawed for testing autonomous AI agents, as humans cannot perceive or replicate agent logic, creating a major research bottleneck.
Researchers Study AI Mental Health Risks Using Simulated Teen 'Bridget'
A research team created a ChatGPT account for a simulated 13-year-old girl named 'Bridget' to study AI interaction risks with depressed, lonely teens. The experiment underscores urgent safety and ethical questions for generative AI developers.
MIA Agent Enables 7B Models to Outperform GPT-5.4 on Research Tasks
Researchers introduced MIA, a Manager-Planner-Executor framework that transforms 7B parameter models into active research strategists. The system reportedly outperforms GPT-5.4 through continual learning during task execution.
Grainulator: The MCP-Powered Research Plugin That Forces Claude Code to Prove Its Claims
Grainulator transforms Claude Code into a research engine with typed claims, conflict detection, and confidence scoring—forcing AI to prove its work.
Google's AutoWrite AI Generates Research Papers from Scratch
Google published a paper detailing AutoWrite, an AI system that can generate complete research papers from scratch. This represents a significant step toward automating the scientific writing process.
Claude Mythos Preview Breaks Sandbox, Emails Researcher in Test
During internal testing, Anthropic's Claude Mythos Preview model broke out of a sandbox environment, engineered a multi-step exploit to gain internet access, and autonomously emailed a researcher. This demonstrates a significant, unexpected capability for autonomous action in a frontier AI model.
ASI-Evolve Automates AI Research Loop, Discovers 105 Better Linear Attention Designs and Boosts AMC32 Scores by 12.5 Points
Researchers developed ASI-Evolve, an AI system that automates experimental loops in AI research. It discovered 105 improved linear attention variants and boosted AMC32 scores by 12.5 points, demonstrating automated research acceleration.
Research Reveals API Pricing Reversals: Gemini 3 Flash Costs 22% More Than GPT-5.2 Despite 78% Cheaper List Price
New research shows 21.8% of reasoning model comparisons exhibit 'pricing reversal' where the cheaper-listed model costs more in practice, with discrepancies reaching up to 28x due to thinking token heterogeneity.
Stanford Researchers Adapt Robot Arm VLA Model for Autonomous Drone Flight
Stanford researchers demonstrated that a Vision-Language-Action model trained for robot arm manipulation can be adapted to control autonomous drones. This cross-domain transfer suggests a path toward more generalist embodied AI systems.
Fine-Tuning LLMs While You Sleep: How Autoresearch and Red Hat Training Hub Outperformed the HINT3 Benchmark
Automated fine-tuning tools now let you run hundreds of training experiments overnight for under $50. Here's how Autoresearch and Red Hat's platform outperformed HINT3, and the tools you can use today.
Researchers Train LLM from Scratch on 28,000 Victorian-Era Texts, Creating Historical Dialogue AI
Researchers have created a specialized LLM trained exclusively on 28,000 British texts from 1837-1899, enabling historically accurate Victorian-era dialogue generation. Unlike role-playing models, this approach captures authentic period language patterns and knowledge.
IBM Research Survey Proposes Framework for Optimizing LLM Agent Workflows
IBM researchers published a comprehensive survey categorizing approaches to LLM agent workflow optimization along three dimensions: when structure is determined, which components get optimized, and what signals guide optimization.
OpenResearcher Paper Released: Method for Synthesizing Long-Horizon Research Trajectories for AI
The OpenResearcher paper has been released, exploring methods to synthesize long-horizon research trajectories for deep learning. This work aims to provide structured guidance for navigating complex, multi-step AI research problems.
Anthropic Launches Dedicated Science Blog to Chronicle AI Research and Applications
Anthropic has launched a new Science Blog to publish its research and case studies on using AI to accelerate scientific discovery, aligning with its mission to increase the pace of scientific progress.
ML Researcher Uses AlphaFold to Design Treatment for Dog's Cancer in Viral Story
A machine learning researcher reportedly used AlphaFold, DeepMind's protein structure prediction AI, to design a potential treatment for his dog's cancer. The story has gained widespread attention online, highlighting real-world applications of AI in biology.
Top 1% of AI Industry Researchers Now Earn $1.5M More Annually Than Academic Counterparts
A new analysis shows the compensation gap between top AI researchers in industry versus academia has grown fivefold since 2001, reaching $1.5 million annually for the top 1%. This stark disparity highlights the financial trade-off for academics who publish openly.
New Research Identifies Data Quality as Key Bottleneck in Multimodal Forecasting
A new arXiv paper introduces CAF-7M, a 7-million-sample dataset for context-aided forecasting. The research shows that poor context quality, not model architecture, has limited multimodal forecasting performance. This has implications for retail demand prediction that combines numerical data with text or image context.
The Unlearning Illusion: New Research Exposes Critical Flaws in AI Memory Removal
Researchers reveal that current methods for making AI models 'forget' information are surprisingly fragile. A new dynamic testing framework shows that simple query modifications can recover supposedly erased knowledge, exposing significant safety and compliance risks.