From owner-freebsd-net@freebsd.org Wed Jan 11 20:02:12 2017 Return-Path: Delivered-To: freebsd-net@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 1F88ECAB251; Wed, 11 Jan 2017 20:02:12 +0000 (UTC) (envelope-from sbruno@freebsd.org) Received: from mail.ignoranthack.me (ignoranthack.me [199.102.79.106]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id EC7B91B52; Wed, 11 Jan 2017 20:02:11 +0000 (UTC) (envelope-from sbruno@freebsd.org) Received: from [192.168.0.6] (67-0-248-244.albq.qwest.net [67.0.248.244]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (No client certificate requested) (Authenticated sender: sbruno@ignoranthack.me) by mail.ignoranthack.me (Postfix) with ESMTPSA id 2091F1928BA; Wed, 11 Jan 2017 20:02:10 +0000 (UTC) Subject: Re: HEADS-UP: IFLIB implementations of sys/dev/e1000 em, lem, igb pending To: =?UTF-8?Q?Olivier_Cochard-Labb=c3=a9?= References: <30f21c75-d3a2-edcd-1999-d5ed9f970c06@freebsd.org> <1598d97bf2a.c6bcb76838987.6501340920645175463@nextbsd.org> <574a7ac7-4842-9518-8286-a4d89a9f7a27@freebsd.org> Cc: Matthew Macy , "freebsd-net@freebsd.org" , "freebsd-current@freebsd.org" From: Sean Bruno Message-ID: <6c6cb534-73c7-464b-8af1-7445a9c0188c@freebsd.org> Date: Wed, 11 Jan 2017 13:02:06 -0700 User-Agent: Mozilla/5.0 (X11; FreeBSD amd64; rv:45.0) Gecko/20100101 Thunderbird/45.6.0 MIME-Version: 1.0 In-Reply-To: Content-Type: multipart/signed; micalg=pgp-sha512; protocol="application/pgp-signature"; boundary="2vdJXqMe1gBhPGe7www9f7nJ3gpI1JuMx" X-BeenThere: freebsd-net@freebsd.org X-Mailman-Version: 2.1.23 Precedence: list List-Id: Networking and TCP/IP with FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 11 Jan 2017 20:02:12 -0000 This is an OpenPGP/MIME signed message (RFC 4880 and 3156) --2vdJXqMe1gBhPGe7www9f7nJ3gpI1JuMx Content-Type: multipart/mixed; boundary="QS57mcSObCrNIKjmEVANwKR6hUMcA7uqn"; protected-headers="v1" From: Sean Bruno To: =?UTF-8?Q?Olivier_Cochard-Labb=c3=a9?= Cc: Matthew Macy , "freebsd-net@freebsd.org" , "freebsd-current@freebsd.org" Message-ID: <6c6cb534-73c7-464b-8af1-7445a9c0188c@freebsd.org> Subject: Re: HEADS-UP: IFLIB implementations of sys/dev/e1000 em, lem, igb pending References: <30f21c75-d3a2-edcd-1999-d5ed9f970c06@freebsd.org> <1598d97bf2a.c6bcb76838987.6501340920645175463@nextbsd.org> <574a7ac7-4842-9518-8286-a4d89a9f7a27@freebsd.org> In-Reply-To: --QS57mcSObCrNIKjmEVANwKR6hUMcA7uqn Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: quoted-printable On 01/11/17 12:47, Olivier Cochard-Labb=C3=A9 wrote: > On Wed, Jan 11, 2017 at 4:17 PM, Sean Bruno > wrote: >=20 >=20 >=20 > Olivier: >=20 > Give this a quick try. This isn't the correct way to do this, but = I > want to see if I'm on the right path: >=20 >=20 > =E2=80=8Bthanks, it fix the problem, I've got back the 4 queues:=E2=80=8B= >=20 > =E2=80=8Bigb2: port 0x30= 00-0x301f > mem 0xdfea0000-0xdfebffff,0xdff24000-0xdff27fff irq 18 at device 20.0 o= n > pci0 > igb2: attach_pre capping queues at 8 > igb2: using 1024 tx descriptors and 1024 rx descriptors > igb2: msix_init qsets capped at 8 > igb2: pxm cpus: 4 queue msgs: 9 admincnt: 1 > igb2: using 4 rx queues 4 tx queues > igb2: Using MSIX interrupts with 5 vectors > igb2: allocated for 4 tx_queues > igb2: allocated for 4 rx_queues > igb2: Ethernet address: 00:08:a2:09:33:da > igb2: netmap queues/slots: TX 4/1024, RX 4/1024 > =E2=80=8B > In forwarding mode, I measure about 10% performance drop with this new > drivers on this hardware: >=20 > x head r311848: packets per second > + head r311849 and BAR patch: packets per second > +----------------------------------------------------------------------= ----+ > |++ ++ + xxx x= x| > | |__M__A___= _| | > | |___AM__| = | > +----------------------------------------------------------------------= ----+ > N Min Max Median Avg St= ddev > x 5 924170 943071 927509 931612.1 8096.= 8269 > + 5 831452 845929.5 840940 838730.5 6413.= 5602 > Difference at 95.0% confidence > -92881.6 +/- 10652.2 > -9.96999% +/- 1.07481% > (Student's t, pooled s =3D 7303.85) >=20 > Regards, >=20 > Olivier >=20 Hmmm ... did your old tests do 4 or 8 queues on this hardware? Did the old tests run 1024 tx/rx slots or the max 4096? sean --QS57mcSObCrNIKjmEVANwKR6hUMcA7uqn-- --2vdJXqMe1gBhPGe7www9f7nJ3gpI1JuMx Content-Type: application/pgp-signature; name="signature.asc" Content-Description: OpenPGP digital signature Content-Disposition: attachment; filename="signature.asc" -----BEGIN PGP SIGNATURE----- iQGTBAEBCgB9FiEEuq1GMucSHejSCZfdEgHvyh5yfmQFAlh2jz5fFIAAAAAALgAo aXNzdWVyLWZwckBub3RhdGlvbnMub3BlbnBncC5maWZ0aGhvcnNlbWFuLm5ldEJB QUQ0NjMyRTcxMjFERThEMjA5OTdERDEyMDFFRkNBMUU3MjdFNjQACgkQEgHvyh5y fmTW1Af/ev4/sYMZG4173M8OKsh0iJgHojq837uThv2pQUWGjzTlxQgtn0fS8u9Y WFFOSP8cKqGugrwf9rup816GKk57bohmcSGs0He9rJRcszzocwExhWCiCwidk+aT LLqSG6U/DfMU9C4O8yzWrnZ+OM2vlnLKegxPBONSrJapQQIOPeHlWuL0Eb5gIItA mzT0s0owzdrozHazIGpNMaf5KU27nKtcPpeGgLbV1amVqp7lPM1nA8TQ6L7uvtha LNWpvDFqlvRctBHc3iYm+ZWwba25EcSNqgiR006uQeTfGDxaHV6Tk3qX5HLeSTK6 3kkjvsAS0OH0/bcUpXY7IHxjfwYTHQ== =e2yN -----END PGP SIGNATURE----- --2vdJXqMe1gBhPGe7www9f7nJ3gpI1JuMx--