Vxlan with openvswitch

Community Support Network
1

Hi, all!

I need to make VXLAN network with OVS. I do all as in the docs.

As an examble I make such network:
BRIDGE = “vxlan100”
BRIDGE_TYPE = “openvswitch”
GATEWAY = “10.0.100.254”
NETWORK_ADDRESS = “10.0.100.0”
NETWORK_MASK = “255.255.255.0”
PHYDEV = “ovsbr0.400”
SECURITY_GROUPS = “0”
VN_MAD = “ovswitch_vxlan”

Create two vms on two different hosts. These are templates of these vms:
First vm:

CONTEXT = [
  DISK_ID = "1",
  ETH0_CONTEXT_FORCE_IPV4 = "",
  ETH0_DNS = "",
  ETH0_EXTERNAL = "",
  ETH0_GATEWAY = "10.0.100.254",
  ETH0_GATEWAY6 = "",
  ETH0_IP = "10.0.100.10",
  ETH0_IP6 = "",
  ETH0_IP6_PREFIX_LENGTH = "",
  ETH0_IP6_ULA = "",
  ETH0_MAC = "00:00:0a:00:64:0a",
  ETH0_MASK = "255.255.255.0",
  ETH0_MTU = "",
  ETH0_NETWORK = "10.0.100.0",
  ETH0_SEARCH_DOMAIN = "",
  ETH0_VLAN_ID = "3",
  ETH0_VROUTER_IP = "",
  ETH0_VROUTER_IP6 = "",
  ETH0_VROUTER_MANAGEMENT = "",
  NETWORK = "YES",
  SSH_PUBLIC_KEY = "",
  TARGET = "hda" ]
NIC = [
  AR_ID = "0",
  BRIDGE = "vxlan100",
  BRIDGE_TYPE = "openvswitch",
  CLUSTER_ID = "0",
  IP = "10.0.100.10",
  MAC = "00:00:0a:00:64:0a",
  NAME = "NIC0",
  NETWORK = "vxlan100",
  NETWORK_ID = "1",
  NIC_ID = "0",
  OUTER_VLAN_ID = "3",
  PHYDEV = "ovsbr0.400",
  SECURITY_GROUPS = "0",
  TARGET = "one-12-0",
  VLAN_ID = "3",
  VN_MAD = "ovswitch_vxlan" ]

Second vm:

CONTEXT = [
  DISK_ID = "1",
  ETH0_CONTEXT_FORCE_IPV4 = "",
  ETH0_DNS = "",
  ETH0_EXTERNAL = "",
  ETH0_GATEWAY = "10.0.100.254",
  ETH0_GATEWAY6 = "",
  ETH0_IP = "10.0.100.11",
  ETH0_IP6 = "",
  ETH0_IP6_PREFIX_LENGTH = "",
  ETH0_IP6_ULA = "",
  ETH0_MAC = "00:00:0a:00:64:0b",
  ETH0_MASK = "255.255.255.0",
  ETH0_MTU = "",
  ETH0_NETWORK = "10.0.100.0",
  ETH0_SEARCH_DOMAIN = "",
  ETH0_VLAN_ID = "3",
  ETH0_VROUTER_IP = "",
  ETH0_VROUTER_IP6 = "",
  ETH0_VROUTER_MANAGEMENT = "",
  NETWORK = "YES",
  SSH_PUBLIC_KEY = "",
  TARGET = "hda" ]
NIC = [
  AR_ID = "0",
  BRIDGE = "vxlan100",
  BRIDGE_TYPE = "openvswitch",
  CLUSTER_ID = "0",
  IP = "10.0.100.11",
  MAC = "00:00:0a:00:64:0b",
  NAME = "NIC0",
  NETWORK = "vxlan100",
  NETWORK_ID = "1",
  NIC_ID = "0",
  OUTER_VLAN_ID = "3",
  PHYDEV = "ovsbr0.400",
  SECURITY_GROUPS = "0",
  TARGET = "one-13-0",
  VLAN_ID = "3",
  VN_MAD = "ovswitch_vxlan" ]

“ovs-vsctl show” from both hosts are here:

[root@JKE974700104-24 ~]# ovs-vsctl show
0b5a3769-1777-4caa-94d3-5ac06c5f9040
    Bridge "ovsbr0"
        Port "ovsbr0.400"
            tag: 400
            Interface "ovsbr0.400"
                type: internal
        Port "ovsbr0"
            Interface "ovsbr0"
                type: internal
        Port "bond0"
            Interface "enp94s0f1"
            Interface "enp94s0f0"
        Port "ovsbr0.129"
            tag: 129
            Interface "ovsbr0.129"
                type: internal
    Bridge "vxlan100"
        Port "ovsbr0.400.3"
            Interface "ovsbr0.400.3"
        Port "vxlan100"
            Interface "vxlan100"
                type: internal
        Port "one-12-0"
            tag: 3
            Interface "one-12-0"
    ovs_version: "2.11.0"

[root@JKE974700104-22 ~]# ovs-vsctl show
39b7dabf-5f79-4522-a37f-bc024c00b9ab
    Bridge "ovsbr0"
        Port "bond0"
            Interface "enp94s0f1"
            Interface "enp94s0f0"
        Port "ovsbr0"
            Interface "ovsbr0"
                type: internal
        Port "ovsbr0.129"
            tag: 129
            Interface "ovsbr0.129"
                type: internal
        Port "ovsbr0.400"
            tag: 400
            Interface "ovsbr0.400"
                type: internal
    Bridge "vxlan100"
        Port "ovsbr0.400.4"
            Interface "ovsbr0.400.4"
        Port "one-13-0"
            tag: 3
            Interface "one-13-0"
        Port "vxlan100"
            Interface "vxlan100"
                type: internal
        Port "ovsbr0.400.3"
            Interface "ovsbr0.400.3"
    ovs_version: "2.11.0"

So when I’m trying to ping from fist vm to second I can see only arp traffic which is come from one host to anothe on interface ovsbr0.400, And this traffic does not go inside vxlan100 bridge.

This is the dump of traffic on second host from ovsbr0.400 interface:
[root@JKE974700104-22 ~]# tcpdump -i ovsbr0.400 -en -vvvv
tcpdump: listening on ovsbr0.400, link-type EN10MB (Ethernet), capture size 262144 bytes
17:16:38.766042 72:a8:74:0d:40:4c > 01:00:5e:00:00:03, ethertype IPv4 (0x0800), length 96: (tos 0x0, ttl 16, id 30406, offset 0, flags [none], proto UDP (17), length 82)
10.0.140.24.55301 > 239.0.0.3.otv: [no cksum] OTV, flags [I] (0x08), overlay 0, instance 3
00:00:0a:00:64:0a > Broadcast, ethertype 802.1Q (0x8100), length 46: vlan 3, p 0, ethertype ARP, Ethernet (len 6), IPv4 (len 4), Request who-has 10.0.100.11 tell 10.0.100.10, length 28

On ovsbr0.400.3 interface I don’t see these traffic.

Please, help me to debugg this problem.
Version of OpenNebula on hosts is is 5.10.1.

Thaks in advance,
Anton Lopatin