Skip site navigation (1)Skip section navigation (2)
Date:      Wed, 23 Jan 2013 19:52:06 +0100
From:      Franz Schwartau <franz@electromail.org>
To:        Bryan Venteicher <bryanv@daemoninthecloset.org>
Cc:        freebsd-stable@freebsd.org, bane ivosev <bane.ivosev@pmf.uns.ac.rs>
Subject:   Re: kvm vlan virtio problem
Message-ID:  <51003156.3010509@electromail.org>
In-Reply-To: <627694717.15.1358912662920.JavaMail.root@daemoninthecloset.org>
References:  <2103527496.1667.1351994019607.JavaMail.root@daemoninthecloset.org> <50FE627C.7070701@electromail.org> <627694717.15.1358912662920.JavaMail.root@daemoninthecloset.org>

next in thread | previous in thread | raw e-mail | index | archive | help
Hi Bryan,

On 23.01.2013 04:44, Bryan Venteicher wrote:
> Hi,
> 
> ----- Original Message -----
>> Hi!
>>
>> The same warning shows up in our setup:
>>
>> Jan 21 23:40:46 host kernel: WARNING: at net/core/dev.c:1712
>> skb_gso_segment+0x1df/0x2b0() (Tainted: G        W  ---------------   )
>> Jan 21 23:40:46 host kernel: Hardware name: System Product Name
>> Jan 21 23:40:46 host kernel: tun: caps=(0x1b0049, 0x0) len=4452
>> data_len=4380 ip_summed=0
>> [...]
>>
>> KVM host: CentOS 6.3, Linux kernel 2.6.32-279.19.1.el6.x86_64
>> VM guest: FreeBSD 9.1, virtio-kmod-9.1-0.242658
>>
>> Disabling TSO on vtnet0 stops the warnings on the KVM host.
>>
>> Is there any progress on this issue?
>>
> 
> Alright, I tried to recreate this on Ubuntu 12.10 without any luck. Please
> describe your network configuration. 
> 
> On my Linux host, my VLAN interface looks like:
> 
> eth0.100  Link encap:Ethernet  HWaddr 6c:f0:49:05:2b:6d  
>           inet6 addr: fe80::6ef0:49ff:fe05:2b6d/64 Scope:Link
>           UP BROADCAST RUNNING MULTICAST  MTU:1500  Metric:1
>           RX packets:3119867 errors:0 dropped:0 overruns:0 frame:0
>           TX packets:3790183 errors:0 dropped:0 overruns:0 carrier:0
>           collisions:0 txqueuelen:0 
>           RX bytes:166813040 (166.8 MB)  TX bytes:5435432448 (5.4 GB)
> 
> That is plugged into this bridge:
> 
> br100     Link encap:Ethernet  HWaddr 6c:f0:49:05:2b:6d  
>           inet addr:192.168.99.101  Bcast:192.168.99.255  Mask:255.255.255.0
>           inet6 addr: fe80::6ef0:49ff:fe05:2b6d/64 Scope:Link
>           UP BROADCAST RUNNING MULTICAST  MTU:1500  Metric:1
>           RX packets:14 errors:0 dropped:0 overruns:0 frame:0
>           TX packets:18 errors:0 dropped:0 overruns:0 carrier:0
>           collisions:0 txqueuelen:0 
>           RX bytes:876 (876.0 B)  TX bytes:1420 (1.4 KB)
> 
> With the tap device created by QEMU for my FreeBSD guest:
> 
> vnet1     Link encap:Ethernet  HWaddr fe:54:00:ec:4f:4e  
>           inet6 addr: fe80::fc54:ff:feec:4f4e/64 Scope:Link
>           UP BROADCAST RUNNING MULTICAST  MTU:1500  Metric:1
>           RX packets:800284 errors:0 dropped:0 overruns:0 frame:0
>           TX packets:3119877 errors:0 dropped:0 overruns:0 carrier:0
>           collisions:0 txqueuelen:500 
>           RX bytes:5238099122 (5.2 GB)  TX bytes:210492002 (210.4 MB)
> 
> All this tied together:
> 
> # brctl show br100
> bridge name	bridge id		STP enabled	interfaces
> br100		8000.6cf049052b6d	no		eth0.100
> 							vnet1
> 
> Does this approximate your configuration? What's the output of `ethtool -k`
> for your VLAN, bridge, and vnet interfaces?

First of all: Thanks for your efforts.

We are using a different setup. Basically we are using a router VM,
which means: All IP traffic for the actual VMs is routed through it. One
ethernet interface of the router VM is bridged with the physical
ethernet interface of the KVM host. The router VM has one or more
additional interfaces for the actual VMs.

This is the output of "ifconfig -a" from the KVM host:

br0       Link encap:Ethernet  HWaddr AA:50:00:1F:23:AD
          inet addr:88.12.100.100  Bcast:88.12.100.127  Mask:255.255.255.255
          inet6 addr: fe80::aa50:ff:fe1f:23ad/64 Scope:Link
          UP BROADCAST RUNNING MULTICAST  MTU:1500  Metric:1
          RX packets:338087 errors:0 dropped:0 overruns:0 frame:0
          TX packets:213316 errors:0 dropped:0 overruns:0 carrier:0
          collisions:0 txqueuelen:0
          RX bytes:115518852 (110.1 MiB)  TX bytes:528688448 (504.1 MiB)

eth0      Link encap:Ethernet  HWaddr AA:50:00:1F:23:AD
          inet6 addr: fe80::aa50:ff:fe1f:23ad/64 Scope:Link
          UP BROADCAST RUNNING MULTICAST  MTU:1500  Metric:1
          RX packets:6398703 errors:0 dropped:0 overruns:0 frame:0
          TX packets:8451045 errors:0 dropped:0 overruns:0 carrier:0
          collisions:0 txqueuelen:1000
          RX bytes:3566218121 (3.3 GiB)  TX bytes:7532154606 (7.0 GiB)
          Interrupt:43

lo        Link encap:Local Loopback
          inet addr:127.0.0.1  Mask:255.0.0.0
          inet6 addr: ::1/128 Scope:Host
          UP LOOPBACK RUNNING  MTU:16436  Metric:1
          RX packets:138575 errors:0 dropped:0 overruns:0 frame:0
          TX packets:138575 errors:0 dropped:0 overruns:0 carrier:0
          collisions:0 txqueuelen:0
          RX bytes:480320359 (458.0 MiB)  TX bytes:480320359 (458.0 MiB)

virbr0    Link encap:Ethernet  HWaddr 52:54:00:83:09:92
          inet addr:10.30.1.1  Bcast:10.30.1.255  Mask:255.255.255.0
          UP BROADCAST RUNNING MULTICAST  MTU:1500  Metric:1
          RX packets:7 errors:0 dropped:0 overruns:0 frame:0
          TX packets:11 errors:0 dropped:0 overruns:0 carrier:0
          collisions:0 txqueuelen:0
          RX bytes:232 (232.0 b)  TX bytes:3156 (3.0 KiB)

virbr0-nic Link encap:Ethernet  HWaddr 52:54:00:83:09:92
          BROADCAST MULTICAST  MTU:1500  Metric:1
          RX packets:0 errors:0 dropped:0 overruns:0 frame:0
          TX packets:0 errors:0 dropped:0 overruns:0 carrier:0
          collisions:0 txqueuelen:500
          RX bytes:0 (0.0 b)  TX bytes:0 (0.0 b)

virbr1    Link encap:Ethernet  HWaddr 52:54:00:D3:C4:BE
          inet addr:10.30.2.1  Bcast:10.30.2.255  Mask:255.255.255.0
          UP BROADCAST RUNNING MULTICAST  MTU:1500  Metric:1
          RX packets:7267 errors:0 dropped:0 overruns:0 frame:0
          TX packets:14 errors:0 dropped:0 overruns:0 carrier:0
          collisions:0 txqueuelen:0
          RX bytes:521172 (508.9 KiB)  TX bytes:3372 (3.2 KiB)

virbr1-nic Link encap:Ethernet  HWaddr 52:54:00:D3:C4:BE
          BROADCAST MULTICAST  MTU:1500  Metric:1
          RX packets:0 errors:0 dropped:0 overruns:0 frame:0
          TX packets:0 errors:0 dropped:0 overruns:0 carrier:0
          collisions:0 txqueuelen:500
          RX bytes:0 (0.0 b)  TX bytes:0 (0.0 b)

vnet0     Link encap:Ethernet  HWaddr FE:50:56:00:13:C5
          inet6 addr: fe80::fc50:56ff:fe00:13c5/64 Scope:Link
          UP BROADCAST RUNNING MULTICAST  MTU:1500  Metric:1
          RX packets:6664419 errors:0 dropped:0 overruns:0 frame:0
          TX packets:5152582 errors:0 dropped:0 overruns:0 carrier:0
          collisions:0 txqueuelen:500
          RX bytes:6904113626 (6.4 GiB)  TX bytes:3382814134 (3.1 GiB)

vnet1     Link encap:Ethernet  HWaddr FE:54:00:9C:A9:AE
          inet6 addr: fe80::fc54:ff:fe9c:a9ae/64 Scope:Link
          UP BROADCAST RUNNING MULTICAST  MTU:1500  Metric:1
          RX packets:16 errors:0 dropped:0 overruns:0 frame:0
          TX packets:4041 errors:0 dropped:0 overruns:0 carrier:0
          collisions:0 txqueuelen:500
          RX bytes:1176 (1.1 KiB)  TX bytes:267856 (261.5 KiB)

vnet2     Link encap:Ethernet  HWaddr FE:54:00:09:82:25
          inet6 addr: fe80::fc54:ff:fe09:8225/64 Scope:Link
          UP BROADCAST RUNNING MULTICAST  MTU:1500  Metric:1
          RX packets:5200680 errors:0 dropped:0 overruns:0 frame:0
          TX packets:6733169 errors:0 dropped:0 overruns:0 carrier:0
          collisions:0 txqueuelen:500
          RX bytes:3341649436 (3.1 GiB)  TX bytes:6895134123 (6.4 GiB)

vnet3     Link encap:Ethernet  HWaddr FE:54:00:A0:06:84
          inet6 addr: fe80::fc54:ff:fea0:684/64 Scope:Link
          UP BROADCAST RUNNING MULTICAST  MTU:1500  Metric:1
          RX packets:4833709 errors:0 dropped:0 overruns:0 frame:0
          TX packets:3119549 errors:0 dropped:0 overruns:0 carrier:0
          collisions:0 txqueuelen:500
          RX bytes:4412472305 (4.1 GiB)  TX bytes:1931670365 (1.7 GiB)

vnet4     Link encap:Ethernet  HWaddr FE:54:00:32:27:E2
          inet6 addr: fe80::fc54:ff:fe32:27e2/64 Scope:Link
          UP BROADCAST RUNNING MULTICAST  MTU:1500  Metric:1
          RX packets:201383 errors:0 dropped:0 overruns:0 frame:0
          TX packets:211537 errors:0 dropped:0 overruns:0 carrier:0
          collisions:0 txqueuelen:500
          RX bytes:97363028 (92.8 MiB)  TX bytes:37970834 (36.2 MiB)


This is the output of "brctl show" from the KVM host:

bridge name	bridge id		STP enabled	interfaces
br0		8000.aa50001f23ad	no		eth0
							vnet0
virbr0		8000.525400830992	no		virbr0-nic
							vnet1
virbr1		8000.525400d3c4be	no		virbr1-nic
							vnet2
							vnet3
							vnet4


This is the output of "ethtool -k <interface>" from the KVM host:

Offload parameters for br0:
rx-checksumming: on
tx-checksumming: on
scatter-gather: on
tcp-segmentation-offload: on
udp-fragmentation-offload: on
generic-segmentation-offload: on
generic-receive-offload: off
large-receive-offload: off

Offload parameters for eth0:
rx-checksumming: on
tx-checksumming: off
scatter-gather: off
tcp-segmentation-offload: off
udp-fragmentation-offload: off
generic-segmentation-offload: off
generic-receive-offload: on
large-receive-offload: off

Offload parameters for virbr0:
rx-checksumming: on
tx-checksumming: on
scatter-gather: on
tcp-segmentation-offload: on
udp-fragmentation-offload: on
generic-segmentation-offload: on
generic-receive-offload: off
large-receive-offload: off

Offload parameters for virbr0-nic:
rx-checksumming: on
tx-checksumming: off
scatter-gather: off
tcp-segmentation-offload: off
udp-fragmentation-offload: off
generic-segmentation-offload: off
generic-receive-offload: off
large-receive-offload: off

Offload parameters for virbr1:
rx-checksumming: on
tx-checksumming: on
scatter-gather: on
tcp-segmentation-offload: on
udp-fragmentation-offload: on
generic-segmentation-offload: on
generic-receive-offload: off
large-receive-offload: off

Offload parameters for virbr1-nic:
rx-checksumming: on
tx-checksumming: off
scatter-gather: off
tcp-segmentation-offload: off
udp-fragmentation-offload: off
generic-segmentation-offload: off
generic-receive-offload: off
large-receive-offload: off

Offload parameters for vnet0:
rx-checksumming: on
tx-checksumming: on
scatter-gather: on
tcp-segmentation-offload: on
udp-fragmentation-offload: on
generic-segmentation-offload: off
generic-receive-offload: off
large-receive-offload: off

Offload parameters for vnet1:
rx-checksumming: on
tx-checksumming: on
scatter-gather: on
tcp-segmentation-offload: on
udp-fragmentation-offload: on
generic-segmentation-offload: off
generic-receive-offload: off
large-receive-offload: off

Offload parameters for vnet2:
rx-checksumming: on
tx-checksumming: on
scatter-gather: on
tcp-segmentation-offload: on
udp-fragmentation-offload: on
generic-segmentation-offload: off
generic-receive-offload: off
large-receive-offload: off

Offload parameters for vnet3:
rx-checksumming: on
tx-checksumming: on
scatter-gather: on
tcp-segmentation-offload: on
udp-fragmentation-offload: off
generic-segmentation-offload: off
generic-receive-offload: off
large-receive-offload: off

Offload parameters for vnet4:
rx-checksumming: on
tx-checksumming: on
scatter-gather: on
tcp-segmentation-offload: on
udp-fragmentation-offload: on
generic-segmentation-offload: off
generic-receive-offload: off
large-receive-offload: off

Please let me know if you need more information.

	Best regards
		Franz



Want to link to this message? Use this URL: <https://mail-archive.FreeBSD.org/cgi/mid.cgi?51003156.3010509>