Skip site navigation (1)Skip section navigation (2)
Date:      Tue, 26 Aug 2014 13:35:10 -0300
From:      Raimundo Santos <raitech@gmail.com>
To:        "freebsd-net@freebsd.org" <freebsd-net@freebsd.org>
Subject:   9.3 RELEASE not forwarding pkt-gen (netmap) packets over XenServer
Message-ID:  <CAGQ6iC_4kd-ELDtU2jxzAep3rEUtrrdMjau3YuOdQ8Qm5oU6VA@mail.gmail.com>

next in thread | raw e-mail | index | archive | help
Hello list,

I am using FreeBSD 9.3 RELEASE over XenServer 6.2 with a quad port Intel
NIC dedicated to my tests.

I have three virtual machines, all using NICs with PCI passthrough, in this
way:

One VM (vm0) as router between the others, with two Intel NIC. Stock kernel.

One VM (vm1) as generator, with one Intel NIC. netmap + XEMHVM kernel.

One VM (vm2) as consumer, with one Intel NIC. netmap + XEMHVM kernel.


When I connect vm1 to vm2 directly, traffic flows without problem, no
matter how I select the source an destination IP and MAC addresses.

When I connect through vm0, just enabling IP forwarding and no packet
filter active (i.e., no PF compiled in and no ipfw module loaded), vm2 can
consume all the traffic, but only if I specify only one source and only one
destination IP addresses.

With this in vm1:
pkt-gen -i igb0 -f tx -s 10.0.0.1 -d 192.168.10.1 \
     -S <igb0 real MAC> -D <router igb> -R 100000

And this in vm2:
pkt-gen -i igb0 -f rx

Setting up static ARP table and route table entries in vm0 for vm1 and vm2,
I can see 100Kpps on vm2. But only changing in vm1

-d 192.168.10.1-192.168.10.2

I can only see 50Kpps going out to vm2 (with tcpdump inside vm0, where I
have stock kernel), but 100Kpps coming from vm1. If I designate a range of
four destination addresses, I get 1/4 of the total designated rate going to
vm2, even with all the packets getting to vm0 from vm1.

Does not matter at all the packet rate I set, the division continues to
occur.

What could be wrong?

In vm0:

Routes:
192.168.10/24 gateway 192.168.2.2
192.168.11/24 gateway 192.168.2.2
10/8 gateway 192.168.1.1

ARP static:
192.168.2.2 <MAC from igb0 of vm2>
192.168.1.1 <MAC from igb0 of vm1>

Thank you for your attention!
Raimundo Santos



Want to link to this message? Use this URL: <https://mail-archive.FreeBSD.org/cgi/mid.cgi?CAGQ6iC_4kd-ELDtU2jxzAep3rEUtrrdMjau3YuOdQ8Qm5oU6VA>