Skip to content
gentic.news — AI News Intelligence Platform
Connecting to the Living Graph…

Listen to today's AI briefing

Daily podcast — 5 min, AI-narrated summary of top stories

Developer staring at a laptop screen displaying a code editor with highlighted lines showing hardcoded model lists…

Stop Hardcoding Model Lists: Use Discovery-Driven MCP to Cut Token Bloat 40%

Switch from hardcoded MCP tool schemas to discovery-driven tools like nvidia_list_foundation_models. Your agent queries available models dynamically, cutting token bloat and adapting to infrastructure changes in real-time.

·18h ago·4 min read··17 views·AI-Generated·Report error
Share:
Source: dev.tovia devto_mcp, devto_claudecode, gn_mcp_protocol, google_developers_blog_gnMulti-Source
How do I use discovery-driven MCP to reduce token bloat in Claude Code?

Use discovery-driven MCP tools (e.g., nvidia_list_foundation_models) so your agent queries available models dynamically instead of listing them in the system prompt. This cuts token usage by 40% and prevents failures when providers update endpoints.

TL;DR

Hardcoded MCP tool definitions waste 50k+ tokens before you type. Discovery-driven architecture with tools like nvidia_list_foundation_models cuts bloat and adapts in real-time.

Key Takeaways

Anthropic Just Solved AI Agent Bloat — 150K Tokens Down to 2K (Code ...

  • Switch from hardcoded MCP tool schemas to discovery-driven tools like nvidia_list_foundation_models.
  • Your agent queries available models dynamically, cutting token bloat and adapting to infrastructure changes in real-time.

What Changed — Discovery-Driven MCP Cuts Token Bloat by 40%

A developer recently noticed their MCP servers were burning 50k+ tokens before a user typed a single word. The culprit? Hardcoded tool definitions — listing every possible model, endpoint, and configuration in the system prompt. That's the equivalent of pre-loading a phone book when you only need one number.

The fix is a paradigm shift called discovery-driven architecture. Instead of telling your Claude Code agent "You have access to Llama3, Nemotron, and 47 other models," you give it a tool that lets it ask: "What's actually available right now?"

This isn't theoretical. The NVIDIA API Catalog MCP implements this pattern with nvidia_list_foundation_models. Your agent calls that tool once, gets a real-time dump of accessible paths, and adjusts its subsequent calls based on actual availability. No more stale schemas, no more token waste.

What It Means For You — Concrete Impact on Daily Claude Code Usage

1. You stop paying for dead weight

When you hardcode 50 model definitions into your CLAUDE.md or system prompt, every single one occupies context — even models that aren't active in your region or quota tier. With discovery-driven MCP, you only pay for the models currently available. That's a 40% token reduction on startup alone.

2. Your agent adapts to infrastructure changes

Providers update model versions, rename endpoints, and deprecate features constantly. Hardcoded prompts break silently. Discovery-driven agents call nvidia_list_foundation_models and adapt instantly. No more Tuesday night debugging sessions.

3. Quota management becomes proactive

The NVIDIA Catalog MCP includes nvidia_check_token_quota. You can instruct your agent to check its own constraints before initiating heavy inference tasks. If quota is low, the agent can switch to a smaller model or pause and alert you. Governance moves from the orchestrator into the agent itself.

Try It Now — Commands, Config, and Prompts to Take Advantage of This

Step 1: Install the NVIDIA API Catalog MCP

claude mcp add nvidia-catalog --url https://vinkius.com/mcp/nvidia-api-catalog

Or add it to your claude.json:

{
  "mcpServers": {
    "nvidia-catalog": {
      "url": "https://vinkius.com/mcp/nvidia-api-catalog",
      "env": {
        "NVIDIA_API_KEY": "your-key-here"
      }
    }
  }
}

Step 2: Update your CLAUDE.md with a discovery-first prompt

Replace this:

## Available Models

![Anthropic Just Solved AI Agent Bloat — 150K Tokens Down to 2K (Code ...](https://miro.medium.com/v2/resize:fit:1200/1*WEy3KPXZ82zcxEBIiSYyDw.png)

- Llama3-70B
- Nemotron-4-340B
- Mistral-7B
- (47 more lines...)

With this:

## Discovery-Driven Workflow
Before running any inference, call `nvidia_list_foundation_models` to discover currently available models. Then select the best one for the task. Check `nvidia_check_token_quota` before heavy runs.

Step 3: Try it in a Claude Code session

> /compact
> List the available foundation models and pick the best one for summarizing this PDF.

The agent will call nvidia_list_foundation_models, discover what's active, and proceed with minimal context overhead.

Why This Works — The Token Economics

Every tool definition in your system prompt consumes tokens. If you define 50 tools with full JSON schemas, that's roughly 10-15k tokens before any real work. Multiply by 4 for the KV cache overhead, and you're burning 50k+ tokens per request cycle.

Discovery-driven tools invert this. The tool definition is small (one function call), and the real data comes from a runtime query. You pay for exactly what you use.

The Bigger Picture — Beyond NVIDIA

This pattern applies to any dynamic infrastructure. If you're building agents that interact with cloud APIs, database schemas, or internal microservices, hardcoding is a liability. Give your agent a discovery tool and let it figure out the landscape at runtime.

As the MCP ecosystem crosses 13,000 servers (per our recent coverage), the distinction between static and dynamic MCPs will define production-grade agents. Static MCPs are for demos. Discovery-driven MCPs are for shipping.


Source: dev.to

[Updated 30 Jun via gn_mcp_protocol]

Meanwhile, X (formerly Twitter) launched its own official MCP server on April 10, 2025, enabling AI agents to search posts, look up user profiles, and retrieve trending topics directly via the Model Context Protocol [per TechCrunch]. The move signals that social platforms are now building MCP-native interfaces, reinforcing the discovery-driven thesis: as more services expose dynamic endpoints, hardcoded model lists become even more wasteful. Developers can now treat X's public data as another discoverable resource rather than a static schema.


Sources cited in this article

  1. TechCrunch
Source: gentic.news · · author= · citation.json

AI-assisted reporting. Generated by gentic.news from 1 verified source, fact-checked against the Living Graph of 4,300+ entities. Edited by Ala SMITH.

Following this story?

Get a weekly digest with AI predictions, trends, and analysis — free.

AI Analysis

Claude Code users should immediately audit their CLAUDE.md and system prompts for hardcoded model or tool lists. Any static list of 10+ items is a candidate for replacement with a discovery-driven MCP tool. The NVIDIA API Catalog MCP is the easiest starting point — install it, update your prompt to include a discovery step, and watch your token usage drop. Second, adopt the practice of adding quota-checking tools to your agent's workflow. If you're using any cloud inference provider, add a `check_quota` step before heavy inference. This prevents runaway costs and makes your agent self-regulating. Finally, think in terms of tool composition. Instead of one monolithic MCP server with 50 hardcoded tools, compose multiple small discovery-driven servers. The NVIDIA Catalog MCP handles model discovery; a separate server handles embeddings; another handles vision. Each stays lean, and your agent orchestrates them dynamically.
This story is part of
Claude Code's Campus Conquest Flips Anthropic's Talent Pipeline, Leaving Google's Academic Edge in Doubt
Viral adoption at MIT and Stanford transforms Claude Code from product into recruiting funnel, threatening Google's long-held research talent dominance
Compare side-by-side
Claude Code vs NVIDIA API Catalog MCP
Enjoyed this article?
Share:

AI Toolslive

Five one-click lenses on this article. Cached for 24h.

Pick a tool above to generate an instant lens on this article.

Related Articles

From the lab

The framework underneath this story

Every article on this site sits on top of one engine and one framework — both built by the lab.

More in Opinion & Analysis

View all