RFC 975 Network Working Group D. L. Mills Request for Comments: 975 M/A-COM Linkabit February 1986 Autonomous Confederations Status of This Memo This RFC proposes certain enhancements of the Exterior Gateway Protocol (EGP) to support a simple, multiple-level routing capability while preserving the robustness features of the current EGP model. It requests discussion and suggestions for improvements. Distribution of this memo is unlimited. Overview The enhancements, which do not require retrofits in existing implementations in order to interoperate with enhanced implementations, in effect generalize the concept of core system to include multiple communities of autonomous systems, called autonomous confederations. Autonomous confederations maintain a higher degree of mutual trust than that assumed between autonomous systems in general, including reasonable protection against routing loops between the member systems, but allow the routing restrictions of the current EGP model to be relaxed. The enhancements involve the "hop count" or distance field of the EGP Update message, the interpretation of which is not covered by the current EGP model. This field is given a special interpretation within each autonomous confederation to support up to three levels of routing, one within the autonomous system, a second within the autonomous confederation and an optional third within the universe of confederations. 1. Introduction and Background The historical development of Internet exterior-gateway routing algorithms began with a rather rigid and restricted topological model which emphasized robustness and stability at the expense of routing dynamics and flexibility. Evolution of robust and dynamic routing algorithms has since proved extraordinarily difficult, probably due more to varying perceptions of service requirements than to engineering problems. The original exterior-gateway model suggested in RFC-827 [1] and subsequently refined in RFC-888 [2] severely restricted the Internet topology essentially to a tree structure with root represented by the BBN-developed "core" gateway system. The most important characteristic of the model was that debilitating resource-consuming routing loops between clusters of gateways (called autonomous Mills [Page 1] RFC 975 February 1986 Autonomous Confederations systems) could not occur in a tree-structured topology. However, the administrative and enforcement difficulties involved, not to mention the performance liabilities, made widespread implementation impractical. 1.1. The Exterior Gateway Protocol Requirements for near-term interoperability between the BBN core gateways and the remainder of the gateway population implemented by other organizations required that an interim protocol be developed with the capability of exchanging reachability information, but not necessarily the capability to function as a true routing algorithm. This protocol is called the Exterior Gateway Protocol (EGP) and is documented in RFC-904 [3]. EGP was not designed as a routing algorithm, since no agreement could be reached on a trusted, common metric. However, EGP was designed to provide high-quality reachability information, both about neighbor gateways and about routes to non-neighbor gateways. At the present state of development, dynamic routes are computed only by the core system and provided to non-core gateways using EGP only as an interface mechanism. Non-core gateways can provide routes to the core system and even to other non-core gateways, but cannot pass on "third-party" routes computed using data received from other gateways. As operational experience with EGP has accumulated, it has become clear that a more decentralized dynamic routing capability is needed in order to avoid resource-consuming suboptimal routes. In addition, there has long been resistance to the a-priori assumption of a single core system, with implications of suboptimal performance, administrative problems, impossible enforcement and possible subversion. Whether or not this resistance is real or justified, the important technical question remains whether a more dynamic, distributed approach is possible without significantly diluting stability and robustness. This document proposes certain enhancements of EGP which generalize the concept of core system to include multiple communities of autonomous systems, called autonomous confederations. Autonomous confederations maintain a higher degree of mutual trust than that assumed between autonomous systems in general, including reasonable protection against routing loops between the member systems. The enhancements involve the "hop count" or distance field of the EGP Update Mills [Page 2] RFC 975 February 1986 Autonomous Confederations message, which is given a special interpretation as described later. Note that the interpretation of this field is not specified in RFC-904, but is left as a matter for further study. The interpretation of the distance field involves three levels of metrics, in which the lowest level is available to the interior gateway protocol (IGP) of the autonomous system itself to extend the interior routes to the autonomous system boundary. The next higher level selects preferred routes within the autonomous system to those outside, while the third and highest selects preferred routes within the autonomous confederation to those outside. The proposed model is believed compatible with the current specifications and practices used in the Internet. In fact, the entire present conglomeration of autonomous systems, including the core system, can be represented as a single autonomous confederation, with new confederations being formed from existing and new systems as necessary. 1.2. Routing Restrictions It was the intent in RFC-904 that the stipulated routing restrictions superceded all previous documents, including RFC-827 and RFC-888. The notion that a non-core gateway must not pass on third-party information was suggested in planning meetings that occured after the previous documents had been published and before RFC-904 was finalized. This effectively obsoletes prior notions of "stub" or any other asymmetry other than the third-party rule. Thus, the only restrictions placed on a non-core gateway is that in its EGP messages (a) a gateway can be listed only if it belongs to the same autonomous system (internal neighbor) and (b) a net can be listed only if it is reachable via gateways belonging to that system. There are no other restrictions, overt or implied. The specification does not address the design of the core system or its gateways. The restrictions imply that, to insure full connectivity, every non-core gateway must run EGP with a core gateway. Since the present core-gateway implementation disallows other gateways on EGP-neighbor paths, this further implies that every non-core gateway must share a net in common with at least one core gateway. Note that there is no a-priori prohibition on using EGP as an IGP, or even on using EGP with a gateway of another non-core system, Mills [Page 3] RFC 975 February 1986 Autonomous Confederations providing that the third-party rule is observed. If a gateway in each system ran EGP with a gateway in every other system, the notion of core system would be unneccessary and superflous. At one time during the evolution of the EGP model a strict hierarchical topology (tree structure) of autonomous systems was required, but this is not the case now. At one time it was forbidden for two nets to be connected by gateways of two or more systems, but this is not the case now. Autonomous systems are sets of gateways, not nets or hosts, so that a given net or host can be reachable via more than one system; however, every gateway belongs to exactly one system. 1.3. Examples and Problems Consider the common case of two local-area nets A and B connected to the ARPANET by gateways of different systems. Now assume A and B are connected to each other by a gateway A-B belonging to the same system as the A-ARPANET gateway, which could then list itself and both the A and B nets in EGP messages sent to any other gateway, since both are now reachable in its system. However, the B-ARPANET gateway could list itself and only the B net, since the A-B gateway is not in its system. In principle, we could assume the existence of a second gateway B-A belonging to the same system as the B-ARPANET gateway, which would entitle it to list the A net as well; however, it may be easier for both systems to sign a treaty and consider the A-B gateway under joint administration. The implementation of the treaty may not be trivial, however, since the joint gateway must appear to other gateways as two distinct gateways, each with its own autonomous-system number. Another case occurs when for some reason or other a system has no path to a core gateway other than via another non-core system. Consider a third local-are net C, together with gateway C-A belonging to a system other than the A-ARPANET and B-ARPANET gateways. According to the restrictions above, gateway C-A could list net C in EGP messages sent to A-ARPANET, while A-ARPANET could list ARPANET in messages sent to C-A, but not other nets which it may learn about from the core. Thus, gateway C-A cannot acquire full routing information unless it runs EGP directly with a core gateway. Mills [Page 4] RFC 975 February 1986 Autonomous Confederations 2. Autonomous Systems and Confederations The second example above illustrates the need for a mechanism in which arbitrary routing information can be exchanged between non-core gateways without degrading the degree of robustness relative to a mutually agreed security model. One way of doing this is is to extend the existing single-core autonomous-system model to include multiple core systems. This requires both a topological model which can be used to define the scope of these systems together with a global, trusted metric that can be used to drive the routing computations. An appropriate topological model is described in the next section, while an appropriate metric is suggested in the following section. 2.1. Topological Models An "autonomous system" consists of a set of gateways, each of which can reach any other gateway in the same system using paths via gateways only in that system. The gateways of a system cooperatively maintain a routing data base using an interior gateway protocol (IGP) and a intra-system trusted routing mechanism of no further concern here. The IGP is expected to include security mechanisms to insure that only gateways of the same system can acquire each other as neighbors. One or more gateways in an autonomous system can run EGP with one or more gateways in a neighboring system. There is no restriction on the number or configuration of EGP neighbor paths, other than the requirement that each path involve only gateways of one system or the other and not intrude on a third system. It is specifically not required that EGP neighbors share a common network, although most probably will. An "autonomous confederation" consists of a set of autonomous systems sharing a common security model; that is, they trust each other to compute routes to other systems in the same confederation. Each gateway in a confederation can reach any other gateway in the same confederation using paths only in that confederation. Although there is no restriction on the number or configuration of EGP paths other than the above, it is expected that some mechanism be available so that potential EGP neighbors can discover whether they are in the same confederation. This could be done by access-control lists, for example, or by partitioning the set of system numbers. A network is "directly reachable" from an autonomous system if a gateway in that system has an interface to it. Every gateway in Mills [Page 5] RFC 975 February 1986 Autonomous Confederations that system is entitled to list all directly reachable networks in EGP messages sent to any other system. In general, it may happen that a particular network is directly reachable from more than one system. A network is "reachable" from an autonomous system if it is directly reachable from an autonomous system belonging to the same confederation. A directly reachable net is always reachable from the same system. Every gateway in that confederation is entitled to list all reachable nets in EGP messages sent to any other system. It may happen that a particular net is either directly reachable or reachable from different confederations. In order to preserve global routing stability in the Internet, it is explicitly assumed that routes within an autonomous system to a directly reachable net are always preferred over routes outside that system and that routes within an autonomous confederation are always preferred over routes outside that confederation. The mechanism by which this is assured is described in the next section. In general, EGP Update messages can include two lists of gateways, one for those gateways belonging to the same system (internal neighbors) and the other for gateways belonging to different systems (external neighbors). Directly reachable nets must always be associated with gateways of the same system, that is, with internal neighbors, while non-directly reachable nets can be associated with either internal or external neighbors. Nets that are reachable, but not directly reachable, must always be associated with gateways of the same confederation. 2.2. Trusted Routing Metrics There seems to be a general principle which characterizes distributed systems: The "nearer" a thing is the more dynamic and trustable it is, while the "farther" a thing is the more static and suspicious it is. For instance, the concept of network is intrinsic to the Internet model, as is the concept of gateways which bind them together. A cluster of gateways "near" each other (e.g. within an autonomous system) typically exchange routing information using a high-performance routing algorithm capable of sensitive monitoring of, and rapid adaptation to, changing performance indicators such as queueing delays and link loading. However, clusters of gateways "far" from each other (e.g. widely separated autonomous systems) usually need only coarse routing information, possibly only "hints" on the best likely next hop to Mills [Page 6] RFC 975 February 1986 Autonomous Confederations the general destination area. On the other hand, mutual suspicion increases with distance, so these clusters may need elaborate security considerations, including peer authentication, confidentiality, secrecy and signature verification. In addition, considerations of efficiency usually dictate that the allowable network bandidth consumed by the routing protocol itself decreases with distance. The price paid for both of these things typically is in responsiveness, with the effect that the more distant clusters are from each other, the less dynamic is the routing algorithm. The above observations suggest a starting point for the evolution of a globally acceptable routing metric. Assume the metric is represented by an integer, with low values representing finer distinctions "nearer" the gateway and high values coarser distinctions "farther" from it. Values less than a globally agreed constant X are associated with paths confined to the same autonomous system as the sender, values greater than X but less than another constant Y with paths confined to the autonomous confederation of the sender and values greater than Y associated with the remaining paths. At each of these three levels - autonomous system, autonomous confederation and universe of confederations - multiple routing algorithms could be operated simultaneously, with each producing for each destination net a possibly different subtree and metric in the ranges specified above. However, within each system the metric must have the same interpretation, so that other systems can mitigate routes between multiple gateways in that system. Likewise, within each confederation the metric must have the same interpretation, so that other confederations can mitigate routes to gateways in that confederation. Although all confederations must agree on a common universe-of-confederations algorithm, not all confederations need to use the same confederation-level algorithm and not all systems in the same confederation need to use the same system-level algorithm. 3. Implementation Issues The manner in which the eight-bit "hop count" or distance field in the EGP Update to be used is not specified in RFC-904, but left as a matter for further study. The above model provides both an interpretation of this field, as well as hints on how to design appropriate routing algorithms. For the sake of illustration, assume the values of X and Y above are 128 and 192 respectively. This means that the gateways in a Mills [Page 7] RFC 975 February 1986 Autonomous Confederations particular system will assign distance values less than 128 for directly-reachable nets and that exterior gateways can compare these values freely in order to select among these gateways. It also means that the gateways in all systems of a particular confederation will assign distance values between 128 and 192 for those nets not directly reachable in the system but reachable in the confederation. In the following it will be assumed that the various confederations can be distinguished by some feature of the 16-bit system-number field, perhaps by reserving a subfield. 3.1. Data-Base Management Functions The following implementation model may clarify the above issues, as well as present at least one way to organize the gateway data base. The data base is organized as a routing table, the entries of which include a net number together with a list of items, where each item consists of (a) the gateway address, system number and distance provided by an EGP neighbor, (b) a time-to-live counter, local routing information and other information as necessary to manage the data base. The routing table is updated each time an EGP Update message is received from a neighbor and possibly by other means, such as the system IGP. The message is first decoded into a list of quads consisting of a network number, gateway address, system number and distance. If the gateway address is internal to the neighbor system, as determined from the EGP message, the system number of the quad is set to that system; while, if not, the system number is set to zero, indicating "external." Next, a new value of distance is computed from the old value provided in the message and subject to the following constraints: If the system number matches the local system number, the new value is determined by the rules for the system IGP but must be less than 128. If not and either the system number belongs to the same confederation or the system number is zero and the old distance is less than 192, the value is determined by the rules for the confederation EGP, but must be at least 128 and less than 192. Otherwise, the value is determined by the rules for the (global) universe-of-federations EGP, but must be at least 192. For each quad in the list the routing table is first searched for matching net number and a new entry made if not already there. Next, the list of items for that net number is searched for matching gateway address and system number and a new entry made if not already there. Finally, the distance field is recomputed, the time-to-live field reset and local routing information inserted. Mills [Page 8] RFC 975 February 1986 Autonomous Confederations The time-to-live fields of all items in each list are incremented on a regular basis. If a field exceeds a preset maximum, the item is discarded; while, if all items on a list are discarded, the entire entry including net number is discarded. When a gateway sends an EGP Update message to a neighbor, it must invert the data base in order by gateway address, rather than net number. As part of this process the routing table is scanned and the gateway with minimum distance selected for each net number. The resulting list is sorted by gateway address and partitioned on the basis of internal/external system number. 3.2. Routing Functions A gateway encountering a datagram (service unit) searches the routing table for matching destination net number and then selects the gateway on that list with minimum distance. As the result of the value assignments above, it should be clear that routes at a higher level will never be chosen if routes at a lower level exist. It should also be clear that route selection within a system cannot affect route selection outside that system, except through the intervention of the intra-confederation routing algorithm. If a simple min-system-hop algorithm is used for the confederation EGP, the IGP of each system can influence it only to the extent of reachability. 3.3. Compatibility Issues The proposed interpretation is backwards-compatibile with known EGP implementations which do not interpret the distance field and with several known EGP implementations that take private liberties with this field. Perhaps the simplest way to evolve the present system is to collect the existing implementations that do not interpet the distance field at all as a single confederation with the present core system and routing restrictions. All distances provided by this confederation would be assumed equal to 192, which would provide at least a rudimentary capability for routing within the universe of confederations. One or more existing or proposed systems in which the distance field has a uniform interpretation throughout the system can be organized as autonomous confederations. This might include the Butterfly gateways now now being deployed, as well as clones elsewhere. These systems provide the capability to select routes into the system based on the distance fields for the different gateways. It is anticipated that the distance fields for the Butterfly system can be set to at least 128 if the routing Mills [Page 9] RFC 975 February 1986 Autonomous Confederations information comes from another Butterfly system and to at least 192 if from a non-Butterfly system presumed outside the confederation. New systems using an implmentation model such as suggested above can select routes into a confederation based on the distance field. For this to work properly, however, it is necessary that all systems and confederations adopt a consistent interpretation of distance values exceeding 192. 4. Summary and Conclusions Taken at face value, this document represents a proposal for an interpretation of the distance field of the EGP Update message, which has previously been assigned no architected interpretation, but has been often used informally. The proposal amounts to ordering the autonomous systems in a hierarchy of systems and confederations, together with an interpretation of the distance field as a three-level metric. The result is to create a corresponding three-level routing community, one prefering routes inside a system, a second preferring routes inside a confederation and the third with no preference. While the proposed three-level hierarchy can readily be extended to any number of levels, this would create strain on the distance field, which is limited to eight bits in the current EGP model. The concept of distance can easily be generalized to "administrative distance" as suggested by John Nagle and others. 5. References [1] Rosen, E., Exterior Gateway Protocol (EGP), DARPA Network Working Group Report RFC-827, Bolt Beranek and Newman, September 1982. [2] Seamonson, L.J., and E.C., Rosen. "STUB" Exterior Gateway Protocol, DARPA Network Working Group Report RFC-888, BBN Communications, January 1984. [3] Mills, D.L., Exterior Gateway Protocol Formal Specification, DARPA Network Working Group Report RFC-904, M/A-COM Linkabit, April 1984. Mills [Page 10]