From owner-freebsd-net@FreeBSD.ORG Tue Aug 26 16:35:31 2014 Return-Path: Delivered-To: freebsd-net@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) (using TLSv1 with cipher ADH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id 99B69726 for ; Tue, 26 Aug 2014 16:35:31 +0000 (UTC) Received: from mail-ob0-x22e.google.com (mail-ob0-x22e.google.com [IPv6:2607:f8b0:4003:c01::22e]) (using TLSv1 with cipher ECDHE-RSA-RC4-SHA (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 651BA3A15 for ; Tue, 26 Aug 2014 16:35:31 +0000 (UTC) Received: by mail-ob0-f174.google.com with SMTP id vb8so11946549obc.33 for ; Tue, 26 Aug 2014 09:35:30 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:from:date:message-id:subject:to:content-type; bh=5IAWiddwEBxmbminy1BLtQcMDIG07n7mj88hC1d5LnI=; b=iUQMx06Cvvj8Cvo3ipsavlVwHdQeqbNdB74243lXjOHp8XhE3KxvuoJWM9OJ9nyVdM gAqSfiOUpMiTX6lpD3JC37SwY6aNieUMedarK58BgkEu3FkQtM+83eVFkTBlnEOcDunL qHFZiHeubMaTeilxHuT9Nni36oE2jFMgxqdxRvlIbtAs05algfOPYdyx6eOuJnCrltsa +J+A0QQtroR4PqvpHA21bGZAn6CEtXxjd2P0MD0qVTBQKVIcU1PEOs05AXcqyC9E081t 7m0286oBrBpYyQvdQQ+0u64O9VoL8HZX1EbFOPYF84wOIush9vEpCafe7Bsm5bUNpdJu Cz4Q== X-Received: by 10.60.70.65 with SMTP id k1mr15257559oeu.61.1409070930571; Tue, 26 Aug 2014 09:35:30 -0700 (PDT) MIME-Version: 1.0 Received: by 10.60.232.163 with HTTP; Tue, 26 Aug 2014 09:35:10 -0700 (PDT) From: Raimundo Santos Date: Tue, 26 Aug 2014 13:35:10 -0300 Message-ID: Subject: 9.3 RELEASE not forwarding pkt-gen (netmap) packets over XenServer To: "freebsd-net@freebsd.org" Content-Type: text/plain; charset=UTF-8 X-Content-Filtered-By: Mailman/MimeDel 2.1.18-1 X-BeenThere: freebsd-net@freebsd.org X-Mailman-Version: 2.1.18-1 Precedence: list List-Id: Networking and TCP/IP with FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 26 Aug 2014 16:35:31 -0000 Hello list, I am using FreeBSD 9.3 RELEASE over XenServer 6.2 with a quad port Intel NIC dedicated to my tests. I have three virtual machines, all using NICs with PCI passthrough, in this way: One VM (vm0) as router between the others, with two Intel NIC. Stock kernel. One VM (vm1) as generator, with one Intel NIC. netmap + XEMHVM kernel. One VM (vm2) as consumer, with one Intel NIC. netmap + XEMHVM kernel. When I connect vm1 to vm2 directly, traffic flows without problem, no matter how I select the source an destination IP and MAC addresses. When I connect through vm0, just enabling IP forwarding and no packet filter active (i.e., no PF compiled in and no ipfw module loaded), vm2 can consume all the traffic, but only if I specify only one source and only one destination IP addresses. With this in vm1: pkt-gen -i igb0 -f tx -s 10.0.0.1 -d 192.168.10.1 \ -S -D -R 100000 And this in vm2: pkt-gen -i igb0 -f rx Setting up static ARP table and route table entries in vm0 for vm1 and vm2, I can see 100Kpps on vm2. But only changing in vm1 -d 192.168.10.1-192.168.10.2 I can only see 50Kpps going out to vm2 (with tcpdump inside vm0, where I have stock kernel), but 100Kpps coming from vm1. If I designate a range of four destination addresses, I get 1/4 of the total designated rate going to vm2, even with all the packets getting to vm0 from vm1. Does not matter at all the packet rate I set, the division continues to occur. What could be wrong? In vm0: Routes: 192.168.10/24 gateway 192.168.2.2 192.168.11/24 gateway 192.168.2.2 10/8 gateway 192.168.1.1 ARP static: 192.168.2.2 192.168.1.1 Thank you for your attention! Raimundo Santos