netmod R. Peschi Internet-Draft S. Ashraf Intended status: Informational D. Rajaram Expires: 4 September 2025 Nokia 3 March 2025 Populating a list of YANG data nodes using templates draft-rajaram-netmod-yang-cfg-template-framework-01 Abstract This document presents a modeling technique for configuring large scale devices in a compact way, when the device contains many similar data node patterns. A device here refers to any such entity that acts as a netconf server. This is realized by instructing the device to locally generate repetitive patterns of data nodes from a master copy called 'template' that is configured in the device. This approach is both convenient and efficient, as it minimizes the size of the running data store and reduces network provisioning time. It leverages existing YANG specification features and can be implemented with standard, off-the-shelf tools.The concept that is described in this draft does not aim to be a standard track document and does not cover the template solution that is currently being discussed within ietf netmod. About This Document This note is to be removed before publishing as an RFC. Status information for this document may be found at https://datatracker.ietf.org/doc/draft-rajaram-netmod-yang-cfg- template-framework/. Discussion of this document takes place on the netmod Working Group mailing list (mailto:netmod@ietf.org), which is archived at https://mailarchive.ietf.org/arch/browse/netmod/. Subscribe at https://www.ietf.org/mailman/listinfo/netmod/. Status of This Memo This Internet-Draft is submitted in full conformance with the provisions of BCP 78 and BCP 79. Internet-Drafts are working documents of the Internet Engineering Task Force (IETF). Note that other groups may also distribute working documents as Internet-Drafts. The list of current Internet- Drafts is at https://datatracker.ietf.org/drafts/current/. Peschi, et al. Expires 4 September 2025 [Page 1] Internet-Draft yang-config-template-framework March 2025 Internet-Drafts are draft documents valid for a maximum of six months and may be updated, replaced, or obsoleted by other documents at any time. It is inappropriate to use Internet-Drafts as reference material or to cite them other than as "work in progress." This Internet-Draft will expire on 4 September 2025. Copyright Notice Copyright (c) 2025 IETF Trust and the persons identified as the document authors. All rights reserved. This document is subject to BCP 78 and the IETF Trust's Legal Provisions Relating to IETF Documents (https://trustee.ietf.org/ license-info) in effect on the date of publication of this document. Please review these documents carefully, as they describe your rights and restrictions with respect to this document. Code Components extracted from this document must include Revised BSD License text as described in Section 4.e of the Trust Legal Provisions and are provided without warranty as described in the Revised BSD License. Table of Contents 1. Introduction . . . . . . . . . . . . . . . . . . . . . . . . 3 2. Template technique framework . . . . . . . . . . . . . . . . 4 2.1. Provisioning the running data store . . . . . . . . . . . 4 2.2. Device expanding the running data store . . . . . . . . . 6 2.3. Mandatories and Defaults . . . . . . . . . . . . . . . . 6 3. Benefits of Templates in YANG Design . . . . . . . . . . . . 7 4. Template Realisation Using YANG Groupings . . . . . . . . . . 7 4.1. Templates for existing YANG models using YANG Groupings . . . . . . . . . . . . . . . . . . . . . . . . 8 5. Conclusion . . . . . . . . . . . . . . . . . . . . . . . . . 13 6. Conventions and Definitions . . . . . . . . . . . . . . . . . 13 7. Security Considerations . . . . . . . . . . . . . . . . . . . 13 8. IANA Considerations . . . . . . . . . . . . . . . . . . . . . 13 9. Appendix . . . . . . . . . . . . . . . . . . . . . . . . . . 13 9.1. A. Example of applying the template method. . . . . . . 13 9.1.1. A.1.Device running data store using the template mechanism . . . . . . . . . . . . . . . . . . . . . . 13 9.1.2. A2:Data generated by the template mechanism . . . . . 15 9.2. B: Using existing YANG constructs in template and instance YANG definition . . . . . . . . . . . . . . . . . . . . . 18 9.2.1. The grouping construct . . . . . . . . . . . . . . . 18 9.2.2. The uses construct . . . . . . . . . . . . . . . . . 19 9.2.3. The refine construct to control default and mandatory statements . . . . . . . . . . . . . . . . . . . . . 20 10. Normative References . . . . . . . . . . . . . . . . . . . . 21 Peschi, et al. Expires 4 September 2025 [Page 2] Internet-Draft yang-config-template-framework March 2025 Acknowledgments . . . . . . . . . . . . . . . . . . . . . . . . . 22 Authors' Addresses . . . . . . . . . . . . . . . . . . . . . . . 22 1. Introduction This draft considers the case of a device that contains a functional entity, characterized by a well-defined data nodes pattern, that is massively replicated and where each replication instance needs individual configuration with only limited variation. Having a device manager that repetitively configures each data node for every functional instance can become complex and prone to errors. This approach may lead to issues, such as extended configuration times, increased memory usage on the device, and inefficient YANG validation processes due to the large size of the running data store. These challenges only intensify as the system scales. This draft proposes a technique to improve this, which is based on 'YANG templates' that results in a smaller running data store even when the device is very large. A 'YANG template' is the configuration of a functional entity that the device is instructed to replicate multiple times to generate copies of the entity. The technique that we address in this draft allows to generate copies with the same data node values as in the template with the possibility, though, to overrule some of these values on an individual copy basis. The general template technique detailed in this draft does not suffer from the drawbacks mentioned earlier where the device manager is explicitly configuring all device data nodes. This method is not aimed at becoming a standard itself. It is a YANG modeling technique that can be considered, where appropriate, by any implementor or standardization organization, when designing a YANG module for a specific purpose. For the sake of completeness, note that other IETF documents do mention already the use of YANG template concept for specific applications, for instance draft-ietf-ccamp- optical-impairment-topology-yang (https://datatracker.ietf.org/doc/ draft-ietf-ccamp-optical-impairment-topology-yang/) and RFC8795 (https://datatracker.ietf.org/doc/html/rfc8795#section-5.9). However, they don't provide full context about the method. This draft can help clarifying and formalizing in a generic framework how to define and use YANG templates. The next sections will elaborate on some of the constructs to apply the template technique and highlight how to mitigate some potential issues. More specifically, Peschi, et al. Expires 4 September 2025 [Page 3] Internet-Draft yang-config-template-framework March 2025 * How to define the template of a functional entity, how to instruct the device to replicate it (including per instance variations) and * How the replication process takes place when expanding the template into functional entity instances configuration data nodes. 2. Template technique framework 2.1. Provisioning the running data store This section outlines how the device's running data store is utilized to implement the template technique. In the YANG model of the device, many functional instances can be organized in a list. Since a template represents the typical configuration pattern of a functional instance, it is often necessary to choose between multiple templates for replication. For Example: the device may host various types of functional instances, each with its own specific data structure. Say, one template might define data nodes for a 'function-1' type, while another template could define data nodes for a 'function-2' type. For a given type of functional instance, different sets of values for the data nodes may be required. Say, a 'function-1' type might have templates for 'function-1-bronze-grade', 'function-1-silver-grade', and 'function- 1-gold-grade' variants. As a result, multiple templates can also be organized into a list within the device's YANG model. Assume for example, that list-a and list-b data nodes need to be configured in the device. Traditionally, the tree structure will be as below: root +--(...) // out of scope +--rw data-nodes-pattern // container for functional instances +--rw instance* [name] // the list of functional instances +--rw name string-ascii64 +--rw description? string-ascii128 +--rw data +--rw list-a [name] //e.g. a list of interfaces | +--rw name | +--rw parm-x | +--rw parm-y +--rw list-b [name] //e.g. a list of hardware components +--rw name +--rw parm-t +--rw parm-u Peschi, et al. Expires 4 September 2025 [Page 4] Internet-Draft yang-config-template-framework March 2025 In contrast, the YANG tree of a device using the template technique would appear as below: root +--(...) // out of scope +--rw data-nodes-pattern // container for functional instances +--rw template* [name] // the list of templates | +--rw name string-ascii64 | +--rw description? string-ascii128 | +--rw data | +--rw list-a [name] //e.g. a list of interfaces | | +--rw name | | +--rw parm-x | | +--rw parm-y | +--rw list-b [name] //e.g. a list of hardware components | +--rw name | +--rw parm-t | +--rw parm-u +--rw instance* [name] // the list of functional instances +--rw name string-ascii64 +--rw description? string-ascii128 +--rw template? -> /data-nodes-pattern/template/name +--rw data +--rw list-a [name] //e.g. a list of interfaces | +--rw name | +--rw parm-x //overrule if present,or take it from template | +--rw parm-y //overrule if present,or take it from template +--rw list-b [name] //e.g. a list of hardware components +--rw name +--rw parm-t //overrule if present,or take it from template +--rw parm-u //overrule if present,or take it from template Each entry in the template list encompasses the generic configuration data nodes that are needed for all the functional entities to be addressed by this template, as contained in the data container, in this example, data nodes of list-a and list-b. In practice, naturally, the more data nodes that can be replicated the more efficient the template technique will be. Each entry in the instance list represents a copy to be made of the data nodes pattern defined by the leaf-ref template, to create a functional entity instance. The data container contains all the data nodes needed to customize each copy of the template, by overruling one or the other data node value originating from the template (eg: parm-x, parm-y, parm-t, parm-u), or possibly to add to the copy one or the other data nodes not provided by the template. Peschi, et al. Expires 4 September 2025 [Page 5] Internet-Draft yang-config-template-framework March 2025 Although it is recommended that the same data nodes are defined in the data container of template and the data container of instance, only a limited number of such data nodes should be configured in the instance. This reflects the assumption that functional instances should have only limited variations from their template model. It should be noted that in a good application of the template technique, only few templates would suffice to generate a very large number of functional instances; in other words, the instance list would be much larger, typically by order of magnitudes, than the template list. A simple configuration example in the running data store of the device can be found at Appendix A.1 (Section 9.1.1) 2.2. Device expanding the running data store Once the configuration is applied to the device, the device will dynamically create each instance as specified. The process for generating data nodes for a particular instance follows these steps: -A copy of the template's data nodes is made, serving as the foundation for the instance's configuration. -If any of these data nodes are also configured in the running data store for this instance, they will override the template values. If an instance data node is configured in the running data store but not provided by the template, it will be added to the generated instance configuration. The resulting instance expansion corresponding to the example in appendix A.1 is provided in Appendix A.2 (Section 9.1.2) 2.3. Mandatories and Defaults While conceptually, the idea of templates improves the re-usability and consistency factor, there are certain nuances, that need to be addressed while handling data nodes with defaults and mandatories. If certain replicable data patterns contain default or mandatory values, and are used as-is both in the template and in the instance, -There is a possibility of silent and unintentional overwriting the configured value of the node in the template with the default value in the instance due to the merge operation. Peschi, et al. Expires 4 September 2025 [Page 6] Internet-Draft yang-config-template-framework March 2025 -Mandatory data nodes must be unconditionally configured in the instance although they are already configured in the template, reducing the efficiency of the template mechanism. Hence, while the same data nodes are used in the templates and instances, it is imperative that instance data nodes are without default and mandatory statements. there may be different implementation to solve this, one such way that uses the existing YANG constructs is provided in Appendix B (Section 9.2). 3. Benefits of Templates in YANG Design 1. Reusability: Templates encourage reusability by allowing common structures to be defined once and reused multiple times. This reduces duplication and simplifies model management. 2. Consistency: By using templates, similar configurations are defined and applied uniformly, leading to more consistent data modeling and network configuration management. 3. Simplified Maintenance: When a template is modified, all places where it is used will automatically reflect those changes, reducing the effort required to maintain and update the model. 4. Modularity: Templates promote a modular approach to YANG model design. By splitting the model into reusable parts, it becomes easier to scale and extend. 4. Template Realisation Using YANG Groupings As described in Provisioning the running data store (Section 2.1), this template technique requires a similar YANG structure to be used in the list of templates(/data-nodes-pattern/template) and the list of template-consumers/instances(/data-nodes-pattern/instance). Rather than making copies of the same data nodes at different places, groupings can be used. Peschi, et al. Expires 4 September 2025 [Page 7] Internet-Draft yang-config-template-framework March 2025 grouping list-a-nodes { list list-a { leaf parm-x{ type int } leaf parm-y{ type string } } } grouping list-b-nodes { list list-b { leaf parm-t{ type int } leaf parm-u{ type string } } } augment "./data-nodes-pattern/template/data" { description "...."; uses list-a-nodes; uses list-b-nodes; } augment "./data-nodes-pattern/instance/data" { description "...."; uses list-a-nodes; uses list-b-nodes; } 4.1. Templates for existing YANG models using YANG Groupings An implementation that intends to apply the technique of templates for existing YANG models, such as ietf-interface.yang, could also realise this by copying these data nodes in to a new YANG grouping and then applying them with 'uses' statement. Below is an example implementation for data nodes defined in ietf-interfaces.yang module xxx-interfaces-common { yang-version 1.1; namespace "urn:xxx-interfaces-common"; prefix xxx-ifc; import ietf-yang-types { prefix yang; Peschi, et al. Expires 4 September 2025 [Page 8] Internet-Draft yang-config-template-framework March 2025 } // Grouping few nodes of ietf-interfaces.yang grouping interface-attributes { container interfaces { description "Interface parameters."; list interface { key "name"; description "The list of interfaces on the device. The status of an interface is available in this list in the operational state. If the configuration of a system-controlled interface cannot be used by the system (e.g., the interface hardware present does not match the interface type), then the configuration is not applied to the system-controlled interface shown in the operational state. If the configuration of a user-controlled interface cannot be used by the system, the configured interface is not instantiated in the operational state. System-controlled interfaces created by the system are always present in this list in the operational state, whether or not they are configured."; leaf name { type string; description "The name of the interface. A device MAY restrict the allowed values for this leaf, possibly depending on the type of the interface. For system-controlled interfaces, this leaf is the device-specific name of the interface. If a client tries to create configuration for a system-controlled interface that is not present in the operational state, the server MAY reject the request if the implementation does not support pre-provisioning of interfaces or if the name refers to an interface that can never exist in the system. A Network Configuration Protocol (NETCONF) server MUST reply with an rpc-error with the error-tag 'invalid-value' in this case. If the device supports pre-provisioning of interface configuration, the 'pre-provisioning' feature is advertised. If the device allows arbitrarily named user-controlled interfaces, the 'arbitrary-names' feature is advertised. Peschi, et al. Expires 4 September 2025 [Page 9] Internet-Draft yang-config-template-framework March 2025 When a configured user-controlled interface is created by the system, it is instantiated with the same name in the operational state. A server implementation MAY map this leaf to the ifName MIB object. Such an implementation needs to use some mechanism to handle the differences in size and characters allowed between this leaf and ifName. The definition of such a mechanism is outside the scope of this document."; reference "RFC 2863: The Interfaces Group MIB - ifName"; } leaf description { type string; description "A textual description of the interface. A server implementation MAY map this leaf to the ifAlias MIB object. Such an implementation needs to use some mechanism to handle the differences in size and characters allowed between this leaf and ifAlias. The definition of such a mechanism is outside the scope of this document. Since ifAlias is defined to be stored in non-volatile storage, the MIB implementation MUST map ifAlias to the value of 'description' in the persistently stored configuration."; reference "RFC 2863: The Interfaces Group MIB - ifAlias"; } leaf type { type identityref { base interface-type; } /*mandatory true;could be refined when grouping is used*/ description "The type of the interface. When an interface entry is created, a server MAY initialize the type leaf with a valid value, e.g., if it is possible to derive the type from the name of the interface. If a client tries to set the type of an interface to a value that can never be used by the system, e.g., if the type is not supported or if the type does not match the name of the interface, the server MUST reject the request. Peschi, et al. Expires 4 September 2025 [Page 10] Internet-Draft yang-config-template-framework March 2025 A NETCONF server MUST reply with an rpc-error with the error-tag 'invalid-value' in this case."; reference "RFC 2863: The Interfaces Group MIB - ifType"; } leaf enabled { type boolean; /*default "true";could be refined when grouping is used*/ description "This leaf contains the configured, desired state of the interface. Systems that implement the IF-MIB use the value of this leaf in the intended configuration to set IF-MIB.ifAdminStatus to 'up' or 'down' after an ifEntry has been initialized, as described in RFC 2863. Changes in this leaf in the intended configuration are reflected in ifAdminStatus."; reference "RFC 2863: The Interfaces Group MIB - ifAdminStatus"; } leaf link-up-down-trap-enable { type enumeration { enum enabled { value 1; description "The device will generate linkUp/linkDown SNMP notifications for this interface."; } enum disabled { value 2; description "The device will not generate linkUp/linkDown SNMP notifications for this interface."; } } description "Controls whether linkUp/linkDown SNMP notifications should be generated for this interface. If this node is not configured, the value 'enabled' is operationally used by the server for interfaces that do not operate on top of any other interface (i.e., there are no 'lower-layer-if' entries), and 'disabled' otherwise."; reference "RFC 2863: The Interfaces Group MIB - Peschi, et al. Expires 4 September 2025 [Page 11] Internet-Draft yang-config-template-framework March 2025 ifLinkUpDownTrapEnable"; } }//interface } //interfaces } } This module could then be imported into any applicable module which needs to be modularized, thereby avoiding the need to duplicate the definitions. module xxx-interfaces-template { yang-version 1.1; namespace "urn:xxx-interfaces-tmplt"; prefix xxx-ifc-tmplt; import xxx-interfaces-common { prefix xxx-ifc; } container data-nodes-pattern { list template { key "name"; leaf name { type string; } container data { uses xxx-ifc:interface-attributes; } } list instance { key "name"; leaf name { type string; } leaf template { type leafref { path "/data-nodes-pattern/template/name"; } } container data { uses xxx-ifc:interface-attributes; } } } } Peschi, et al. Expires 4 September 2025 [Page 12] Internet-Draft yang-config-template-framework March 2025 5. Conclusion Using templates in YANG allows to efficiently configure large amounts of similar data nodes while keeping the running data store size small. This is beneficial in term of device memory footprint, ease of configuration, configuration time and potentially YANG validation processing in the device. This draft explains some practicalities of the template method, including how to ensure that mandatory and default statements do not jeopardize the effectiveness of the method. In addition to the above, The template method mentioned in Template Realisation Using YANG Groupings (Section 4)is also beneficial for existing standard nodes as well. 6. Conventions and Definitions The key words "MUST", "MUST NOT", "REQUIRED", "SHALL", "SHALL NOT", "SHOULD", "SHOULD NOT", "RECOMMENDED", "NOT RECOMMENDED", "MAY", and "OPTIONAL" in this document are to be interpreted as described in BCP 14 [RFC2119] [RFC8174] when, and only when, they appear in all capitals, as shown here. 7. Security Considerations TODO Security 8. IANA Considerations This document has no IANA actions. 9. Appendix 9.1. A. Example of applying the template method. 9.1.1. A.1.Device running data store using the template mechanism In this example, one template template-1 is configured, and three instances are configured, to be derived from template-1 and with limited overruling of the template values. // a first instance instance-1 //config is derived from template-1 templ-1-list-a-entry-2 // inherited from template 33 //overrule template value 30 with 33 // a second instance instance-2 //config is derived from template-1 // nothing from template to be overruled Peschi, et al. Expires 4 September 2025 [Page 14] Internet-Draft yang-config-template-framework March 2025 // a third instance instance-3 //config is derived from template-1 templ-1-list-a-entry-3 //inherited from template 55 //overrule template value 50 with 55 templ-1-list-b-entry-3 //inherited from template 88 //overrule template value 80 with 88 9.1.2. A2:Data generated by the template mechanism The running data store example in section A.1 leads the device to generate the following data used to control the instances (without the aid of the template mechanism, this data would need to explicitly come from the running data store, instead of being locally expanded): generated through instance-1 merged with template-1 expansion Peschi, et al. Expires 4 September 2025 [Page 15] Internet-Draft yang-config-template-framework March 2025 templ-1-list-a-entry-1 1 30 templ-1-list-a-entry-2 3 33 //deviate from template value templ-1-list-a-entry-3 3 50 templ-1-list-b-entry-1 2 40 templ-1-list-b-entry-2 4 60 templ-1-list-b-entry-3 4 80 (generated through instance-2 merged with template-1 expansion) Peschi, et al. Expires 4 September 2025 [Page 16] Internet-Draft yang-config-template-framework March 2025 templ-1-list-a-entry-1 1 30 templ-1-list-a-entry-2 3 30 templ-1-list-a-entry-3 3 50 templ-1-list-b-entry-1 2 40 templ-1-list-b-entry-2 4 60 templ-1-list-b-entry-3 4 80 (generated through instance-3 merged with template-1 expansion) Peschi, et al. Expires 4 September 2025 [Page 17] Internet-Draft yang-config-template-framework March 2025 templ-1-list-a-entry-1 1 30 templ-1-list-a-entry-2 3 30 templ-1-list-a-entry-3 3 55 //deviate from template value templ-1-list-b-entry-1 2 40 templ-1-list-b-entry-2 4 60 templ-1-list-b-entry-3 4 88 //deviate from template value 9.2. B: Using existing YANG constructs in template and instance YANG definition This appendix illustrates the use of groupings in the YANG definition of template and instances and more specifically it shows how easily mandatory and default statements can be introduced in the template definition by refining the grouping uses statement. 9.2.1. The grouping construct By defining common structures using grouping, one avoids repeating code, ensures consistency and makes future changes easier since modifications only need to happen in one place. Example: Peschi, et al. Expires 4 September 2025 [Page 18] Internet-Draft yang-config-template-framework March 2025 grouping interface-config { leaf parm-a { type string; } leaf parm-b { type boolean; } leaf parm-c { type unint32; } } This 'interface-config' grouping defines a common structure that can be reused across different YANG modules or different parts of the same module. 9.2.2. The uses construct The 'uses' statement applies a previously defined grouping where needed in the model (e.g. it copies the data nodes of the grouping at the place of the 'uses' statement. As an example, the data nodes defined in the grouping above can be used in the template and in the instance definition: Peschi, et al. Expires 4 September 2025 [Page 19] Internet-Draft yang-config-template-framework March 2025 container data-nodes-pattern { list template { key "name"; leaf name { type string; } container data { list interface { key "interface-name"; leaf name { type string; } uses interface-config; } } } list instance { key "name"; leaf name { type string; } container data { list interface { key "interface-name"; leaf name { type string; } uses interface-config; } } } } 9.2.3. The refine construct to control default and mandatory statements As explained in section 2.3, with the template method, some data nodes may need a default or mandatory statement when used for the template definition but should have no mandatory neither default statements when used for the instance definition. The refine statement available in existing YANG version easily allows to control mandatory and default statements when used along with the uses statement. Assume in our example that it is desired that parm-b has a default statement and parm-c has a mandatory statement when they are used for the template definition. Peschi, et al. Expires 4 September 2025 [Page 20] Internet-Draft yang-config-template-framework March 2025 Then the YANG becomes: container data-nodes-pattern { list template { key "name"; leaf name { type string; } container data { list interface { key "interface-name"; uses interface-config { refine parm-b { default "true" } refine parm-c { mandatory true } } } } } list instance { key "name"; leaf name { type string; } container data { list interface { key "interface-name"; uses interface-config; } } } } 10. Normative References [RFC2119] Bradner, S., "Key words for use in RFCs to Indicate Requirement Levels", BCP 14, RFC 2119, DOI 10.17487/RFC2119, March 1997, . [RFC8174] Leiba, B., "Ambiguity of Uppercase vs Lowercase in RFC 2119 Key Words", BCP 14, RFC 8174, DOI 10.17487/RFC8174, May 2017, . Peschi, et al. Expires 4 September 2025 [Page 21] Internet-Draft yang-config-template-framework March 2025 Acknowledgments Authors' Addresses Robert Peschi Nokia Antwerp Email: robert.peschi@nokia.com Shiya Ashraf Nokia Antwerp Email: shiya.ashraf@nokia.com Deepak Rajaram Nokia Chennai Email: deepak.rajaram@nokia.com Peschi, et al. Expires 4 September 2025 [Page 22]