While tools are valuable for YANG module validation and versioning, they have important limitations:¶
Limitation 1: Cannot Always Distinguish Editorial from BC Changes¶
Tools cannot determine whether a description change is purely editorial (clarifying existing meaning) or backwards-compatible (adding new information). Human judgment is required to make this distinction.¶
Example: Changing "Ethernet interface" to "Ethernet interface, including 10BASE-T and 100BASE-T" could be editorial (if those variants were always included) or BC (if documenting newly supported variants).¶
Limitation 2: Cannot Detect Semantic Changes in Descriptions¶
If a description change alters the intended behavior or meaning of a schema node, it may be an NBC change, but tools cannot detect this automatically.¶
Example: Changing "includes IPv4 only" to "includes IPv4 and IPv6" changes the semantic meaning and may be NBC, but tools will not flag this.¶
Limitation 3: Cannot Assess Practical Impact¶
Tools can identify that an NBC change has occurred but cannot assess how many implementations are affected or what the practical migration cost will be.¶
Limitation 4: May Produce False Positives or False Negatives¶
Tool implementations may have bugs or may not cover all edge cases in the YANG versioning rules. Always review tool output critically and consult experts if results are unexpected.¶
Recommendation: Always combine tool usage with the classification guidance in this document (particularly Appendix B) and seek expert review (Section 7) when uncertainty remains.¶