From owner-freebsd-net@FreeBSD.ORG Tue May 21 10:32:40 2013 Return-Path: Delivered-To: freebsd-net@freebsd.org Received: from mx1.freebsd.org (mx1.FreeBSD.org [8.8.178.115]) by hub.freebsd.org (Postfix) with ESMTP id 3FF8C9EE for ; Tue, 21 May 2013 10:32:40 +0000 (UTC) (envelope-from zec@fer.hr) Received: from mail.fer.hr (mail.fer.hr [161.53.72.233]) by mx1.freebsd.org (Postfix) with ESMTP id C9D6678E for ; Tue, 21 May 2013 10:32:39 +0000 (UTC) Received: from dyn4.nxlab.fer.hr (161.53.63.204) by MAIL.fer.hr (161.53.72.233) with Microsoft SMTP Server (TLS) id 14.2.309.2; Tue, 21 May 2013 12:31:27 +0200 From: Marko Zec To: Subject: Re: netmap bridge can tranmit big packet in line rate ? Date: Tue, 21 May 2013 12:29:27 +0200 User-Agent: KMail/1.9.10 References: <1369036008085-5813346.post@n5.nabble.com> <1369128316187-5813643.post@n5.nabble.com> In-Reply-To: <1369128316187-5813643.post@n5.nabble.com> MIME-Version: 1.0 Content-Type: text/plain; charset="iso-8859-1" Content-Transfer-Encoding: 7bit Content-Disposition: inline Message-ID: <201305211229.28182.zec@fer.hr> X-Originating-IP: [161.53.63.204] Cc: liujie X-BeenThere: freebsd-net@freebsd.org X-Mailman-Version: 2.1.14 Precedence: list List-Id: Networking and TCP/IP with FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 21 May 2013 10:32:40 -0000 On Tuesday 21 May 2013 11:25:16 liujie wrote: > Hi, Prof.Luigi RIZZO > > Firstly i should thank you for netmap. I tried to send a e-mail to you > yestoday, but it was rejected. > > I used two machines to test netmap bridge. all with i7-2600 cpu and > intel 82599 dual-interfaces card. > > One worked as sender and receiver with pkt-gen, the other worked as > bridge with bridge.c. > > as you said,I feeled comfous too when i saw the big packet performance > dropped, i tried to change the memory parameters of netmap(netmap_mem1.c > netmap_mem2.c),but it seemed that can not resove the problem. > 60-byte packet send 14882289 pps recv 13994753 pps > 124-byte send 8445770 pps recv 7628942 pps > 252-byte send 4529819 pps recv 3757843 pps > 508-byte send 2350815 pps recv 1645647 pps > 1514-byte send 814288 pps recv 489133 pps > > sender command: pkt-gen -i ix0 -t 500000000 -l 60 > receiver command: pkt-gen -i ix1 -r 500000000 > bridge(other machine) command:bridge -i ix0 -i ix1 > > can sender and receiver on a same machine ? Most likely the PCIe path between the dual-ported card and the CPU is the bottleneck. Depending on the chipset and motherboard design, it may be that your card is only using 4 instead of 8 PCIe lanes, because some of the lanes may be "shared" with another PCIe slot, such as the one in which a graphic card is plugged in. You can also try experimenting with slightly overclocking the PCIe bus if the BIOS permits that - I had no problems overclocking the ixgbe and an AMD PCIe chipset by 25%. Marko