Configuring switch for newly added servers

NOTE:

This procedure is only applicable for Cumulus switches.

Prerequisites

Ensure that the cabling is connected as per the Port Map.

Procedure
  1. To perform management switch configuration, do the following:
    1. Connect iLO port to management switch in free port.
    2. Configure port with iLO as untagged VLAN.
      Swtich# interface gi1/1/xx
         Swtich(gi1/1/xx)# desc < as per portmap>
         Swtich(gi1/1/xx)# port access vlan <ilo vlan>
  2. To perform data switch configuration, do the following:
    1. Configure management NIC for worker nodes in both switches.
      NOTE:

      Ensure that the port is split to 25G.

      net add interface swp7 breakout 4x
    2. Configure alias for connected interface:
      • Switch1:
        net add interface swp7s2 alias w4-640-p1
      • Switch 2:
        net add interface swp7s2 alias w4-640-p2
    3. Configure bond for management Interface in both switches:
      net add bond w4_640 bond slaves swp7s2
      
    4. Enable LACP BYPASS for bond interface in both switches:
      net add bond w4_640 bond lacp-bypass-allow
      net add bond w4_640 bond lacp-rate slow
    5. Set MTU for bond interface in both switches:
      net add bond w4_640 mtu 9216
    6. Allow management VLAN ( OCP) for bond interface in both switches:
      net add bond w4_640 bridge pvid 1901
      net add bond w4_640 bridge vids 1901
    7. Add Bond interface to Bridge in both switches:
      net add bridge bridge ports w4_640
    8. Set unique CLAG ID for Bond interface in both switches:
      net add bond w4_640 clag id 15
  3. Data NICs to configure SR-IOV
    NOTE:
    Ensure that the port is split to 25G
    net add interface swp9 breakout 4x
  4. Configure Alias for connected PCI interface:
    • Switch1:
      net add interface swp9s0 alias w2-661-NIC1-P1
    • Switch 2:
      net add interface swp9s0 alias w2-661-NIC1-P2
  5. Set the MTU to jumbo frame in both switches:
    net add interface swp9s0 mtu 9216
  6. Add interface to Bridge in both switches:
    net add bridge bridge ports swp9s0
  7. Allow required Provider VLAN(1949-1960) on Data NIC in both switches:
    net add interface swp9s0 bridge vids 1949-1960