Internet Draft Traffic Engineering Working Group W. Lai Internet Draft AT&T Document: <draft-wlai-tewg-cap-eng-00.txt> March 2000 Expiration Date: September 2000 Capacity Engineering of IP-based Networks with MPLS Status of this Memo This document is an Internet-Draft and is in full conformance with all provisions of Section 10 of RFC2026 [1]. Internet-Drafts are working documents of the Internet Engineering Task Force (IETF), its areas, and its working groups. Note that other groups may also distribute working documents as Internet- Drafts. Internet-Drafts are draft documents valid for a maximum of six months and may be updated, replaced, or obsoleted by other documents at any time. It is inappropriate to use Internet-Drafts as reference material or to cite them other than as "work in progress." The list of current Internet-Drafts can be accessed at http://www.ietf.org/ietf/1id-abstracts.txt The list of Internet-Draft Shadow Directories can be accessed at http://www.ietf.org/shadow.htm l. Abstract Drawing from the experience and work done in ITU-T on traffic engineering, the feasibility of extending telecommunications network dimensioning methods to IP-based networks with MPLS is explored. This version of the document is preliminary, reporting work in progress. 1. Introduction The routing protocols currently used in public IP networks are typically traffic-insensitive in that they do not include network resource utilization information in making routing decisions. As a result of this lack of traffic control, traffic tends to converge onto the same network segments, thereby causing unbalanced network loading with subsets of network resources being congested and other resources being underutilized. This shortcoming of network operation, coupled with the phenomenal growth of Internet usage, makes it very difficult to manage IP-based network performance. Hence, current engineering practice sometimes resorts to over- provisioning of network capacity. As IP-based network services evolve from a single best-effort class toward differentiation with multiple levels of quality of service Lai Category - Expiration 1 Capacity Engineering of IP/MPLS Networks March 2000 (QoS), a network infrastructure that offers consistent and predictable network performance is required. To achieve this, proper control and provisioning of network resources would be needed. Recently, the multiprotocol label switching (MPLS) technology [1, 2] has been developed to overcome the above limitations of existing destination-based routing protocols so that more effective traffic engineering of IP-based networks can be performed. MPLS integrates the connection-oriented label-swapping operation with connectionless network-layer routing, thus gaining much of the control capabilities of a connection-oriented network such as ATM- based B-ISDN. In particular, MPLS facilitates the establishment of a set of paths satisfying certain constraints [3]. Such a kind of path, called a constraint-based routing label-switched path (CRLSP), is conceptually very similar to a virtual-path connection in an ATM network for traffic engineering purposes. For example, a CRLSP enables the implementation of connection control and resource allocation functions on aggregated groups of traffic flows, instead of on individual flows. This allows support for different classes of service [3, 4] and fits well with the Differentiated Services (DiffServ) architecture [5, 6]. Furthermore, the ability of MPLS to set up explicitly routed CRLSPs permits source-node control, i.e., source routing, to operate efficiently. This provides network administrators the capability to steer traffic on desired paths. Such flexibility to direct the traffic to follow engineered paths through a network offers a number of advantages, e.g., load sharing across multiple paths, and shifting traffic away from congested links. The ability to use fixed preferred paths for routing traffic, so-called route pinning, also gives the means to measure and capture the statistics of the traffic associated with each source-destination node pair. As a result, there is the potential to develop more refined measurement technology so as to obtain a more accurate estimation and characterization of the traffic demands for network planning purposes. The rest of this document is organized into sections describing general aspects of traffic engineering, capacity engineering, traffic demand characterization, performance objectives and reference connections, and network dimensioning. Much of the materials presented here are adapted and drawn from the experience and work done in ITU-T on traffic engineering of telecommunications networks. 2. Traffic Engineering of IP-based Networks The issue of IP network traffic engineering has been addressed by two recent documents [7, 8]. As defined in [7], Internet traffic engineering is ôthat aspect of Internet network engineering that deals with the issue of performance evaluation and performance Lai Category - Expiration 2 Capacity Engineering of IP/MPLS Networks March 2000 optimization of operational IP networks.ö Since network congestion is a primary cause of performance degradation, a major objective of traffic engineering is to increase the efficiency of resource utilization while minimizing the possibility of congestion through capacity and traffic management. Reference [7] also includes a discussion of requirements for routing, traffic mapping, measurement, survivability, and other attributes, from the perspective of traffic engineering. The interactions between traffic and capacity management in controlling a networkÆs response to traffic demands and network failures are further explored in [8]. Real-time traffic management functions such as routing control, path selection, and resource management, ensures that performance objectives are met under all conditions including load shifts and failures. Capacity management, through control of network design, ensures that network provisioning meets performance objectives for a given set of traffic demands at minimum cost. A global problem of network engineering is the choice and implementation of a specific routing strategy for the selection of paths for carrying traffic. Reference [8] provides an overview and categorization of various routing methods, as well as routing table management methods for different network types and their interworking with each other. Also described are resource management methods to achieve QoS objectives, such as connection admission and bandwidth reservation. Taking account of the provisioned network capacity, routing patterns (i.e., path sets and rules for path selection) are designed for different traffic streams between different source-destination node pairs. Periodically or possibly on a real-time basis, these routing patterns may be adjusted as necessary to correct service problems. An iterative network design process encompassing both routing- pattern design and capacity allocation is used to determine the minimum network capacity required to meet the performance objectives for given traffic demands. Reference [8] also presents a set of traffic engineering operational requirements. For example, network management controls such as call gapping can be used to assure acceptable network performance in case of overload or failures. 3. Capacity Engineering According to ITU-T Recommendation E.600 [9], traffic engineering includes measurements, forecasting, planning, dimensioning, and performance monitoring. Traffic engineering has a goal of ensuring trafficability performance objectives for telecommunications services. Trafficability performance is defined in Recommendation E.800 [10] as follows. For each individual network element or functional subsystem, it is the ability of the element to meet a Lai Category - Expiration 3 Capacity Engineering of IP/MPLS Networks March 2000 traffic demand of a given size and other characteristics, under given internal conditions. These internal conditions may be, e.g., any combination of faulty and not faulty parts within the element. Thus, trafficability performance has a direct impact on the accessibility, retainability, and integrity of any given service offered by a network; it is one of the major factors in QoS. Service accessibility refers to the ability of a service to be obtained, within specified tolerances and other given conditions, when requested by the user. Service retainability refers to the ability of a service, once obtained, to continue to be provided under given conditions for a requested duration. Service integrity refers to the degree to which a service is provided without excessive impairments, once obtained. Generally, trafficability performance is an attribute of network performance and can be described in terms of measures such as losses and delays. However, E.800 has not explicitly provided any specific measures for trafficability performance. In this document, the focus is primarily on the dimensioning aspect of traffic engineering and its related tasks. In mapping given user demands onto network resources, network dimensioning involves the sizing of the network elements, such as links and buffers, so that performance objectives can be met at minimum cost. Thus, two major inputs to the dimensioning process are characterization of user demands and specification of performance objectives. (While cost is an important factor, the development of cost models will not be dealt with in this document.) The term capacity engineering is used here to cover this subset of traffic engineering tasks related to dimensioning. These tasks are covered in more detail in the next three sections. 4. Traffic Demand Characterization Typically, dimensioning procedures are based on models that approximate the statistical behavior of network traffic in large populations of users. To allow straightforward characterization of the traffic demands, these models necessarily adopt some simplifying assumptions concerning the usually complicated traffic processes, such as the arrival patterns of flows and the distribution of flow sizes. For these assumptions to be relevant and applicable, they must give rise to statistical patterns that closely approximate the behavior of aggregate traffic flows in operational networks. Traffic data are collected to validate these assumptions, with modifications being made when needed. Additionally, traffic measurements are used to estimate offered load and to provide forecasting of future demands for capacity planning purposes. Forecasting and planning may result in capacity augmentation or may lead to the introduction of new technology and architecture. Lai Category - Expiration 4 Capacity Engineering of IP/MPLS Networks March 2000 Thus, a first step in the dimensioning process is to develop user demand models as input to characterize the offered load to the network. In the context of an ATM-based B-ISDN, ITU-T Recommendation E.716 [11] describes the characterization of user demand as manifested at the user-network interface. Since a CRLSP in MPLS is conceptually similar to a virtual-path connection in ATM for traffic engineering purposes, the methodology of E.716, when suitably modified and extended, may be applicable to MPLS-based IP networks. Further investigation of this feasibility is needed. To allow the characterization of traffic offered to an IP-based network, user demands may be modeled as an arrival process of demands for IP-based services of different types. As each such service demand generates a set of flows, each service type may be defined by a set of flow attributes and by a flow pattern as follows. (1) Flow attributes are those attributes of the service demand that identify the resources needed by the service demand in the network. These may include, e.g., access channel rate, communication configuration such as point-to-point or multipoint, and traffic conditioning agreements as defined in DiffServ [6]. (2) A flow pattern describes the packet arrival process in a flow through a set of traffic variables. E.716 presents four approaches for defining these traffic variables to describe the transient nature of rate variations. For example, they may be related to the burst structure of the packet flow, the number of packet arrivals in time intervals of specified length, packet interarrival time, or the number of packet arrivals exceeding a given rate. (Currently, models that describe the self-similar nature of IP traffic have been proposed in the literature. However, for capacity engineering purposes, models that capture the burstiness characteristics of source traffic will suffice.) To recapitulate, a set of flow attributes and traffic variables may be used together to characterize a particular service type by setting appropriate values for the parameters. Depending on the different values chosen for these attributes and variables, the number of service types can potentially be very large. To minimize the effort of traffic engineering, especially in the initial stage of deployment, it may be desirable to limit the total number of service types. For example, service types with similar values may possibly be combined to form one representative type that captures the salient features essential for dimensioning. 5. Performance Objectives and Reference Connections Performance objectives can be viewed from two perspectives: the user and the network service provider. Quality of service (QoS), which is performance perceivable by a user of a service, expresses the user's degree of satisfaction of the service [9, 10]. Thus, QoS parameters focus on performance effects that are observable at the service access points and network interfaces, rather than their causes within the network. Different service types usually have Lai Category - Expiration 5 Capacity Engineering of IP/MPLS Networks March 2000 different QoS requirements. This allows a network provider to provide different treatment to different service types, to gain higher resource utilization. Grade of service (GoS) is a number of traffic engineering parameters to provide a measure of adequacy of a group of resources under specified conditions [9]. These GoS parameters may be probability of blocking, probability of delay, etc. They are essential for network internal design and operation, as well as specification of component performance. The latter is related to the trafficability performance described previously. Based on a given set of QoS requirements, a set of GoS parameters are selected and defined on an end-to-end basis within the network boundary, for each major service category provided by a network. The selected GoS parameters are specified in such a way that the GoS can be derived at well-defined reference points, i.e., traffic significant points. This is to allow the partitioning of end-to-end GoS objectives to obtain the GoS objectives for each network stage or component, on the basis of some well-defined reference connections. As defined in E.600, for traffic engineering purposes, a connection is an association of resources providing means for communication between two or more devices in, or attached to, a telecommunication network. There can be different types of connections as the number and types of resources in a connection may vary. Therefore, the concept of a reference connection is used to identify representative cases of the different types of connections without involving the specifics of their actual realizations by different physical means. Typically, different network segments are involved in the path of a connection. For example, a connection may be local, national, or international. The purposes of reference connections are for clarifying and specifying traffic performance issues at various interfaces between different network domains. Each domain may consist of one or more service provider networks. Recommendation E.651 [12] specifies reference connections for IP-access networks. Other reference connections are to be specified. From the QoS objectives, a set of end-to-end GoS parameters and their objectives for different reference connections are derived. For example, end-to-end connection blocking probability and end-to- end packet transfer delay may be relevant GoS parameters. The GoS objectives should be specified with reference to traffic load conditions, such as under normal and high load conditions. The end- to-end GoS objectives are then apportioned to individual resource components of the reference connections for dimensioning purposes. In an operational network, to ensure that the GoS objectives have been met, performance measurements and performance monitoring are required. Lai Category - Expiration 6 Capacity Engineering of IP/MPLS Networks March 2000 6. Network Dimensioning As discussed previously, network dimensioning involves the optimal (e.g., minimum cost) sizing of the network elements to accommodate given traffic demands, while meeting performance objectives. In using MPLS, this means the dimensioning of a set of pre-selected CRLSPs for carrying traffic, and mapping the logical network of CRLSPs onto a physical network of links with capacity constraints. The dimensioning process also determines the link capacity parameters or thresholds associated with the use of some bandwidth reservation scheme for service protection. Service protection controls the GoS for certain service types by restricting access to bandwidth, or by giving priority access to one type of traffic over another. Such methods are essential, e.g., to guarantee a minimum amount of resources for connections with expected short duration, to improve the blocking probabilities for connections with high bandwidth requirements, or to maintain network stability by preventing GoS degradation in case of a local overload. In performing the task of dimensioning, it is assumed that a network topology, both at the logical and physical levels, has been defined. This is because the layout of a network is usually influenced by other factors, such as the network providerÆs policy/administrative constraints, or considerations of an existing network. Also, it is assumed that the network is available, i.e., it does not consider network equipment in a failure state. Routing deals with the selection of network paths for connection requests. To simplify the dimensioning process, a fixed routing- pattern with pre-determined paths for different traffic streams is usually assumed. As described previously, the process of routing- pattern design and dimensioning is iterated until an optimal design is reached. The series of ITU-T Recommendations E.735-7 [13, 14, 15] presents a set of general principles and methods for dimensioning ATM-based B- ISDNs. The notion of Equivalent Cell Rate (ECR) has been used effectively therein for dimensioning purposes. The ECR captures the effects of expected traffic mix, cell-level control mechanisms, priority scheduling, bandwidth and buffer capacity limitations, thereby characterizing the estimated amount of resources that needs to be allocated to a connection to satisfy the specified cell-level GoS objectives. Borrowing from this technique, it may be useful to define some Equivalent Bandwidth parameter for dimensioning IP-based networks. Further studies are needed for its definition. Assuming that connection blocking probability is the only GoS parameter at the connection level, and using ECR to account for cell-level performance, E.737 presents several iterative methods for dimensioning. To reduce computational complexity, approximation methods based on the independence assumption and the principle of decomposition may be developed. For example, if the capacity of a link can be considered as well delimited, independent of the traffic Lai Category - Expiration 7 Capacity Engineering of IP/MPLS Networks March 2000 carried by other links, then the global end-to-end decision on connection admission can be decomposed into local decisions. These techniques may be applicable to the dimensioning of CRLSPs in an MPLS-based network. 7. Security Considerations Security considerations are not addressed in this version of the draft. 8. References [1] E.C. Rosen, A. Viswanathan, and R. Callon, ôMultiprotocol Label Switching Architecture,ö Internet-Draft, Work in Progress, August 1999. [2] R. Callon, P. Doolan, N. Feldman, A. Fredette, G. Swallow, and A. Viswanathan, ôA Framework for Multiprotocol Label Switching,ö Internet-Draft, Work in Progress, September 1999. [3] D. Awduche, J. Malcolm, J. Agogbua, M. OÆDell, and J. McManus, ôRequirements for Internet Traffic Engineering Over MPLS,ö RFC 2702, September 1999. [4] T. Li and Y. Rekhter, ôA Provider Architecture for Differentiated Services and Traffic Engineering (PASTE),ö RFC 2430, October 1998. [5] K. Nichols, S. Blake, F. Baker, and D. Black, ôDefinition of the Differentiated Services Field (DS Field) in the IPv4 and IPv6 Headers,ö RFC 2474, December 1998. [6] S. Blake, D. Black, M. Carlson, E. Davies, Z. Wang, and W. Weiss, ôAn Architecture for Differentiated Services,ö RFC 2475, December 1998. [7] D.O. Awduche, A. Chiu, A. Elwalid, I. Widjaja, and X. Xiao, ôA Framework for Internet Traffic Engineering,ö Internet-Draft, Work in Progress, January 2000. [8] ITU-T Draft Recommendation E.TE, ôTraffic Engineering and QoS Methods for IP-, ATM-, and TDM-Based Multiservice Networks,ö March 2000 (Contact: G. Ash). [9] ITU-T Recommendation E.600, ôTerms and Definitions of Traffic Engineering,ö March 1993. [10] ITU-T Recommendation E.800, ôTerms and Definitions Related to Quality of Service and Network Performance Including Dependability,ö August 1994. Lai Category - Expiration 8 Capacity Engineering of IP/MPLS Networks March 2000 [11] ITU-T Recommendation E.716, ôUser Demand Modelling in Broadband-ISDN,ö October 1996. [12] ITU-T Draft Recommendation E.651, ôReference Connections for Traffic Engineering of IP Access Networks,ö to be approved. [13] ITU-T Recommendation E.735, ôFramework for Traffic Control and Dimensioning in B-ISDN,ö May 1997. [14] ITU-T Recommendation E.736, ôMethods for Cell Level Traffic Control in B-ISDN,ö May 1997. [15] ITU-T Recommendation E.737, ôDimensioning Methods for B-ISDN,ö May 1997. 10. Acknowledgments The review and comments of Gerald Ash is much appreciated. 11. Author's Addresses Wai Sum Lai AT&T Labs Room D5-3D18 200 Laurel Avenue Middletown, New Jersey 07748, USA Phone: 732-420-3712 Email: wlai@att.com Full Copyright Statement "Copyright (C) The Internet Society (2000). All Rights Reserved. This document and translations of it may be copied and furnished to others, and derivative works that comment on or otherwise explain it or assist in its implmentation may be prepared, copied, published and distributed, in whole or in part, without restriction of any kind, provided that the above copyright notice and this paragraph are included on all such copies and derivative works. However, this document itself may not be modified in any way, such as by removing the copyright notice or references to the Internet Society or other Internet organizations, except as needed for the purpose of developing Internet standards in which case the procedures for copyrights defined in the Internet Standards process must be followed, or as required to translate it into languages other than English. Lai Category - Expiration 9 Capacity Engineering of IP/MPLS Networks March 2000 The limited permissions granted above are perpetual and will not be revoked by the Internet Society or its successors or assigns. mailto:mikega@microsoft.co m Lai Category - Expiration 10