Not new to linux but to Ubuntu as a distribution to use in production.
Trying to build a production class (NSPOF) KVM server with Ubuntu server 16.0.4.4ppc le
Installation goes fine (draft guide I will post .. if forum allows for space..once I get last few things cleaned up).
Down now to networking.. so I can get to fun part of bringing it under POWERVC (IBM's version of Open Stack IAAS control) then into ICP (IBM's version of Kubernetes)
.. i digress...
Issue:
1) Too many googling / forums / differnt documentation sites.. none of which articulate what is needed for KVM NSPOF.. Bond.. with interfaces across two switches, and to that bind VLANs. Switch is simple "Trunk allow vlan all" so KVM can create VLANs (public / private etc) as needed.
2) I had to manually construct device aliases for udev... but still does not do a clean job of managment of interfaces. "systemclt stop networking" does not shut down intefaces.. I can do a "ifdown bond0" and it shuts down the logical interface and subsequent slave interfaces.. This needs some cleanup.
Attached is a dmeg output of clean boot, as well as draft of "how I did it" and so should articulate full story.
What I need is correction to stanzas of vlans (some with and most without IP bound).. bound to bond.
Trying to build a production class (NSPOF) KVM server with Ubuntu server 16.0.4.4ppc le
Installation goes fine (draft guide I will post .. if forum allows for space..once I get last few things cleaned up).
Down now to networking.. so I can get to fun part of bringing it under POWERVC (IBM's version of Open Stack IAAS control) then into ICP (IBM's version of Kubernetes)
.. i digress...
Issue:
1) Too many googling / forums / differnt documentation sites.. none of which articulate what is needed for KVM NSPOF.. Bond.. with interfaces across two switches, and to that bind VLANs. Switch is simple "Trunk allow vlan all" so KVM can create VLANs (public / private etc) as needed.
2) I had to manually construct device aliases for udev... but still does not do a clean job of managment of interfaces. "systemclt stop networking" does not shut down intefaces.. I can do a "ifdown bond0" and it shuts down the logical interface and subsequent slave interfaces.. This needs some cleanup.
Attached is a dmeg output of clean boot, as well as draft of "how I did it" and so should articulate full story.
What I need is correction to stanzas of vlans (some with and most without IP bound).. bound to bond.
| root@l8247l1p1:~# sudo vi /etc/network/interfaces | Switch side: Ex Brocade VDX 6740 |
| # and how to activate them. For more information, see interfaces(5). source /etc/network/interfaces.d/* # The loopback network interface auto lo iface lo inet loopback # The primary network interface #enP4p1s0f0 configuration sw26-10 auto enP4p1s0f0 iface enP4p1s0f0 inet manual bond-master bond0 #enP5p9s0f1 configuration sw20-09 auto enP5p9s0f1 iface enP5p9s0f1 inet manual bond-master bond0 # bond0 is the bonded NIC for VM and Mgmt traffic auto bond0 iface bond0 inet manual # bond0 uses standard IEEE 802.3ad LACP bonding protocol bond-mode 4 bond-miimon 100 bond-lacp-rate fast bond-slaves enP4p1s0f0 enP5p9s0f1 bond-downdelay 0 bond-updelay 0 bond-xmit_hash_policy 1 auto bond0.11 iface bond0.11 inet static address 172.20.11.131 gateway 202.1.2.1 netmask 255.255.255.0 dns-nameservers 8.8.8.8 vlan-raw-device bond0 ###### #enP4p1s0f1 configuration sw20-10 auto enP4p1s0f1 iface enP4p1s0f1 inet manual bond-master bond1 #enP5p9s0f0 configuration sw26-09 auto enP5p9s0f0 iface enP5p9s0f0 inet manual bond-master bond1 # bond1 is the bonded NIC for iSCSI traffic # bond1 is used by VMs for block traffic auto bond1 iface bond1 inet manual # bond1 uses standard IEEE 802.3ad LACP bonding protocol bond-mode 4 bond-miimon 100 bond-lacp-rate fast bond-slaves enP4p1s0f1 enP5p9s0f0 bond-downdelay 0 bond-updelay 0 bond-xmit_hash_policy 1 auto bond1.19 iface bond1.19 inet static address 172.20.19.250 gateway 172.20.19.1 netmask 255.255.255.0 dns-nameservers 172.20.12.100 vlan-raw-device bond1 |
! interface Port-channel 23 vlag ignore-split mtu 9028 description l8247l1p1_bond0 switchport switchport mode trunk switchport trunk allowed vlan all no switchport trunk tag native-vlan no switchport trunk native-vlan 11 spanning-tree shutdown no shutdown ! interface Port-channel 24 vlag ignore-split mtu 9028 description l8247l1p1_bond1 switchport switchport mode trunk switchport trunk allowed vlan all no switchport trunk tag native-vlan no switchport trunk native-vlan 11 spanning-tree shutdown no shutdown ! interface TenGigabitEthernet 26/0/10 description l8247l1p1_enP4p1s0f0 channel-group 23 mode active type standard fabric isl enable fabric trunk enable lacp timeout long storm-control ingress broadcast limit-percent 5 monitor storm-control ingress multicast limit-percent 5 monitor storm-control ingress unknown-unicast limit-percent 5 monitor no shutdown ! interface TenGigabitEthernet 20/0/9 description l8247l1p1_enP5p9s0f1 channel-group 23 mode active type standard fabric isl enable fabric trunk enable lacp timeout long storm-control ingress broadcast limit-percent 5 monitor storm-control ingress multicast limit-percent 5 monitor storm-control ingress unknown-unicast limit-percent 5 monitor no shutdown ! interface TenGigabitEthernet 20/0/10 description l8247l1p1_enP4p1s0f1 channel-group 24 mode active type standard fabric isl enable fabric trunk enable lacp timeout long storm-control ingress broadcast limit-percent 5 monitor storm-control ingress multicast limit-percent 5 monitor storm-control ingress unknown-unicast limit-percent 5 monitor no shutdown ! interface TenGigabitEthernet 26/0/9 description l8247l1p1_enP5p9s0f0 channel-group 24 mode active type standard fabric isl enable fabric trunk enable lacp timeout long storm-control ingress broadcast limit-percent 5 monitor storm-control ingress multicast limit-percent 5 monitor storm-control ingress unknown-unicast limit-percent 5 monitor no shutdown |