From owner-freebsd-net@freebsd.org Wed Jan 11 19:55:35 2017 Return-Path: Delivered-To: freebsd-net@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 98B10CABD5A for ; Wed, 11 Jan 2017 19:55:35 +0000 (UTC) (envelope-from olivier@freebsd.org) Received: from smtp.smtpout.orange.fr (smtp08.smtpout.orange.fr [80.12.242.130]) by mx1.freebsd.org (Postfix) with ESMTP id EA1C81DF2 for ; Wed, 11 Jan 2017 19:55:34 +0000 (UTC) (envelope-from olivier@freebsd.org) Received: from mail-qt0-f174.google.com ([209.85.216.174]) by mwinf5d43 with ME id X7ns1u0133mLd29037ntgo; Wed, 11 Jan 2017 20:47:56 +0100 X-ME-Helo: mail-qt0-f174.google.com X-ME-Auth: Y29jaGFyZC1sYWJiZS5vbGl2aWVyQG9yYW5nZS5mcg== X-ME-Date: Wed, 11 Jan 2017 20:47:56 +0100 X-ME-IP: 209.85.216.174 Received: by mail-qt0-f174.google.com with SMTP id l7so156702804qtd.1; Wed, 11 Jan 2017 11:47:53 -0800 (PST) X-Gm-Message-State: AIkVDXIe8weV+RtjVyFHKYHbEBr6U+xqaSL8EAEto1egqpuFcm9ZgS0yF/Pm56AFyKrfmXXDJd1HEpmGwqjHOg== X-Received: by 10.200.1.11 with SMTP id e11mr9001087qtg.85.1484164072421; Wed, 11 Jan 2017 11:47:52 -0800 (PST) MIME-Version: 1.0 Received: by 10.237.34.248 with HTTP; Wed, 11 Jan 2017 11:47:31 -0800 (PST) In-Reply-To: <574a7ac7-4842-9518-8286-a4d89a9f7a27@freebsd.org> References: <30f21c75-d3a2-edcd-1999-d5ed9f970c06@freebsd.org> <1598d97bf2a.c6bcb76838987.6501340920645175463@nextbsd.org> <574a7ac7-4842-9518-8286-a4d89a9f7a27@freebsd.org> From: =?UTF-8?Q?Olivier_Cochard=2DLabb=C3=A9?= Date: Wed, 11 Jan 2017 20:47:31 +0100 X-Gmail-Original-Message-ID: Message-ID: Subject: Re: HEADS-UP: IFLIB implementations of sys/dev/e1000 em, lem, igb pending To: Sean Bruno Cc: Matthew Macy , "freebsd-net@freebsd.org" , "freebsd-current@freebsd.org" Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: quoted-printable X-Content-Filtered-By: Mailman/MimeDel 2.1.23 X-BeenThere: freebsd-net@freebsd.org X-Mailman-Version: 2.1.23 Precedence: list List-Id: Networking and TCP/IP with FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 11 Jan 2017 19:55:35 -0000 On Wed, Jan 11, 2017 at 4:17 PM, Sean Bruno wrote: > > > Olivier: > > Give this a quick try. This isn't the correct way to do this, but I > want to see if I'm on the right path: > =E2=80=8Bthanks, it fix the problem, I've got back the 4 queues:=E2=80=8B =E2=80=8Bigb2: port 0x3000-0= x301f mem 0xdfea0000-0xdfebffff,0xdff24000-0xdff27fff irq 18 at device 20.0 on pci0 igb2: attach_pre capping queues at 8 igb2: using 1024 tx descriptors and 1024 rx descriptors igb2: msix_init qsets capped at 8 igb2: pxm cpus: 4 queue msgs: 9 admincnt: 1 igb2: using 4 rx queues 4 tx queues igb2: Using MSIX interrupts with 5 vectors igb2: allocated for 4 tx_queues igb2: allocated for 4 rx_queues igb2: Ethernet address: 00:08:a2:09:33:da igb2: netmap queues/slots: TX 4/1024, RX 4/1024 =E2=80=8B In forwarding mode, I measure about 10% performance drop with this new drivers on this hardware: x head r311848: packets per second + head r311849 and BAR patch: packets per second +--------------------------------------------------------------------------= + |++ ++ + xxx x x= | | |__M__A____| = | | |___AM__| = | +--------------------------------------------------------------------------= + N Min Max Median Avg Stddev x 5 924170 943071 927509 931612.1 8096.8269 + 5 831452 845929.5 840940 838730.5 6413.5602 Difference at 95.0% confidence -92881.6 +/- 10652.2 -9.96999% +/- 1.07481% (Student's t, pooled s =3D 7303.85) Regards, Olivier