| Internet-Draft | Multi-Model Agent Registration | July 2026 |
| Zhu | Expires 7 January 2027 | [Page] |
Existing agent registration and discovery mechanisms assume that each intelligent agent is backed by a single, static inference model. However, in real-world deployments, agents increasingly incorporate internal model routing mechanisms where multiple foundation models are used dynamically within a single agent based on task complexity, latency requirements, system load, and cost constraints.¶
Although such agents are exposed externally as single service endpoints, their execution behavior is not static and may vary due to internal model selection logic that is not visible to external systems. This leads to mismatches between registered metadata and actual service behavior, reducing the effectiveness of discovery and QoS-aware routing.¶
The key words "MUST", "MUST NOT", "REQUIRED", "SHALL", "SHALL NOT", "SHOULD", "SHOULD NOT", "RECOMMENDED", "MAY", and "OPTIONAL" in this document are to be interpreted as described in RFC 2119.¶
This Internet-Draft is submitted in full conformance with the provisions of BCP 78 and BCP 79.¶
Internet-Drafts are working documents of the Internet Engineering Task Force (IETF). Note that other groups may also distribute working documents as Internet-Drafts. The list of current Internet-Drafts is at https://datatracker.ietf.org/drafts/current/.¶
Internet-Drafts are draft documents valid for a maximum of six months and may be updated, replaced, or obsoleted by other documents at any time. It is inappropriate to use Internet-Drafts as reference material or to cite them other than as "work in progress."¶
This Internet-Draft will expire on 7 January 2027.¶
Copyright (c) 2026 IETF Trust and the persons identified as the document authors. All rights reserved.¶
This document is subject to BCP 78 and the IETF Trust's Legal Provisions Relating to IETF Documents (https://trustee.ietf.org/license-info) in effect on the date of publication of this document. Please review these documents carefully, as they describe your rights and restrictions with respect to this document. Code Components extracted from this document must include Revised BSD License text as described in Section 4.e of the Trust Legal Provisions and are provided without warranty as described in the Revised BSD License.¶
Intelligent agents built upon large language models (LLMs) have been widely deployed as core service components within AI-native systems. Conventional agent registration and discovery mechanisms expose static metadata, such as agent identifiers, service endpoints, authentication schemes, and supported capability catalogs.¶
These mechanisms operate under an implicit assumption that each agent is backed by only one inference model, and key service metrics including latency and functional capability remain stable and deterministic.¶
This foundational assumption, however, no longer holds true in production deployments. Most modern agents incorporate internal model routing capabilities, which dynamically select distinct foundation models at runtime to achieve balanced tradeoffs among inference latency, invocation cost, and output quality.¶
The broad adoption of intra-agent multi-model routing stems from two primary production scenarios.¶
Tiered Model Scheduling for Latency-Cost Balance: A single business-oriented agent integrates lightweight small-scale models, medium general-purpose models, and high-performance flagship models. Trivial routine queries are handled by low-latency, low-cost small models, while tasks involving sophisticated logical reasoning, long-document parsing, and mathematical computation are automatically routed to high-capacity flagship models. Downstream systems only need to connect to a unified service entry without manual model selection or switching.¶
Load-Adaptive Degradation and Fault Fallback: During traffic surges or GPU resource saturation, the routing module automatically offloads heavy-load requests from flagship models onto lightweight backup models to prevent request timeouts and sustain uninterrupted service. The full degradation and disaster recovery logic is fully transparent to external service discovery modules.¶
From an external perspective, such agents appear as a single logical service entity, yet their internal runtime execution behaviors exhibit substantial heterogeneity.¶
In modern deployments of LLM-based agents, it is increasingly common for a single agent system to incorporate multiple foundation models internally. These systems typically implement internal routing mechanisms that dynamically select models based on runtime conditions such as request complexity, system load, latency constraints, and cost optimization policies.¶
Although multiple models may be involved in execution, this routing logic is generally not exposed to external registration or discovery systems. As a result, the agent continues to be represented as a single static service entity.¶
Current registration and discovery mechanisms do not provide visibility into:¶
how internal models are selected for different request types¶
when fallback or degradation occurs¶
how latency, cost, and quality trade-offs are enforced internally¶
This lack of transparency prevents external systems from accurately reasoning about expected service behavior.¶
The absence of model-level or execution-level visibility leads to inaccurate discovery decisions.¶
In particular:¶
agents may be selected without awareness of internal fallback behavior¶
latency expectations may be violated due to hidden model switching¶
cost-efficient routing decisions cannot be enforced externally¶
high-complexity requests may be routed to insufficient capability paths under degradation¶
These issues arise because current systems rely on static metadata that does not reflect dynamic execution behavior.¶
Existing registration models assume that an agent can be described using a single, stable capability profile.¶
However, in multi-model routing systems:¶
capability is not static but context-dependent¶
execution paths are dynamic and non-deterministic¶
service-level characteristics vary across requests¶
Therefore, static registration information is insufficient to accurately represent real-world agent behavior.¶
There is a requirement for registration and discovery systems to evolve beyond static capability descriptions and support representations that reflect:¶
dynamic execution behavior within agents¶
variability in service-level outcomes¶
internal heterogeneity of model usage¶
Such support is necessary to enable accurate service discovery and QoS-aware routing in environments where multiple models are used within a single agent system.¶
The following design goals are defined for the extension mechanism:¶
The system consists of the following entities:¶
Agent: service provider with internal execution pipeline¶
Registration Center: maintains metadata¶
Service Consumer: performs discovery and invocation¶
Figure 1 illustrates the overall architecture of the extended registration and discovery framework.¶
+----------+ +-------------------+ +----------+
| | | | | |
| Agent |<------->| Registration |<------->| Consumer |
| | Register| Center | Discover| |
+----------+ +-------------------+ +----------+
| |
| Invoke |
+-------------------------------------------+
This section defines the extended registration format for agents with internal multi-model routing capabilities.¶
The extended registration format includes the following fields:¶
Each Model Profile contains the following fields:¶
Model-ID: unique identifier for the model within the agent¶
Model-Type: model architecture or family¶
Model-Version: version identifier¶
Capability-Level: capability classification¶
Latency-Class: expected latency classification¶
Context-Length: maximum supported context length¶
Cost-Class: cost classification¶
Availability: availability status¶
Supported-Skills: skills supported by this model¶
Agents SHOULD report internal model lifecycle changes to the Registration Center. The following update types are defined:¶
MODEL_ADDED: a new model has been added to the agent¶
MODEL_REMOVED: an existing model has been removed from the agent¶
MODEL_UPDATED: properties of an existing model have changed¶
MODEL_DEGRADED: a model has entered a degraded state¶
Upon receiving an update notification, the Registration Center SHOULD update the corresponding Model Profile entries and notify affected consumers if necessary.¶
This section defines the extended discovery mechanism that enables consumers to perform QoS-aware service selection.¶
The extended discovery request includes the following fields:¶
The extended discovery response includes the following fields:¶
Single-model agents are represented using a single default Model Profile entry. No protocol changes are required for existing implementations.¶
Registration Centers that do not support the extended format MAY ignore the Model-Profile-List field and treat the agent as a traditional single-model agent.¶
Consumers that do not support the extended format MAY continue to use the basic discovery mechanism without the QoS-aware fields.¶
Model-level information MAY reveal sensitive system characteristics. Implementations SHOULD:¶
protect registration and update messages using appropriate security mechanisms¶
restrict exposure of internal model identities to authorized consumers¶
prefer abstract capability representation where possible to avoid revealing sensitive model details¶
Registration Centers SHOULD implement access control policies to limit which consumers can access detailed Model Profile information.¶
This document does not require any IANA actions.¶
This document describes an emerging gap in current agent registration and discovery systems caused by internal multi-model routing within modern agent architectures. It identifies the need for execution-aware representation of agent behavior to enable accurate discovery and QoS-aware service selection in future AI-native networks.¶
The design goals, protocol overview, and extension mechanisms defined in this document provide a foundation for addressing this gap while maintaining backward compatibility with existing systems.¶