From owner-freebsd-net@freebsd.org Wed Jan 11 20:37:06 2017 Return-Path: Delivered-To: freebsd-net@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id BD9CECAB167; Wed, 11 Jan 2017 20:37:06 +0000 (UTC) (envelope-from mmacy@nextbsd.org) Received: from sender163-mail.zoho.com (sender163-mail.zoho.com [74.201.84.163]) (using TLSv1 with cipher ECDHE-RSA-AES256-SHA (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 9F0B418D3; Wed, 11 Jan 2017 20:37:06 +0000 (UTC) (envelope-from mmacy@nextbsd.org) Received: from mail.zoho.com by mx.zohomail.com with SMTP id 1484167021964143.00894341522314; Wed, 11 Jan 2017 12:37:01 -0800 (PST) Date: Wed, 11 Jan 2017 12:37:01 -0800 From: Matthew Macy To: =?UTF-8?Q?=22Olivier_Cochard-Labb=C3=A9=22?= Cc: "Sean Bruno" , "freebsd-net@freebsd.org" , "freebsd-current@freebsd.org" Message-ID: <1598f3f8588.d20017893749.339651164872952258@nextbsd.org> In-Reply-To: References: <30f21c75-d3a2-edcd-1999-d5ed9f970c06@freebsd.org> <1598d97bf2a.c6bcb76838987.6501340920645175463@nextbsd.org> <574a7ac7-4842-9518-8286-a4d89a9f7a27@freebsd.org> <6c6cb534-73c7-464b-8af1-7445a9c0188c@freebsd.org> <1598f29d379.ea6360351471.8752933472741761813@nextbsd.org> Subject: Re: HEADS-UP: IFLIB implementations of sys/dev/e1000 em, lem, igb pending MIME-Version: 1.0 Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Priority: Medium User-Agent: Zoho Mail X-Mailer: Zoho Mail X-BeenThere: freebsd-net@freebsd.org X-Mailman-Version: 2.1.23 Precedence: list List-Id: Networking and TCP/IP with FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 11 Jan 2017 20:37:06 -0000 You can still explicitly set the number of descriptors. It is now reported = under the dev sysctl tree. dev... -M ---- On Wed, 11 Jan 2017 12:34:23 -0800 Olivier Cochard-Labb=C3=A9 wrote ----=20 >=20 > On Wed, Jan 11, 2017 at 9:13 PM, Matthew Macy wrote: >=20 > > Hmmm ... did your old tests do 4 or 8 queues on this hardware? > > > > Did the old tests run 1024 tx/rx slots or the max 4096? > =20 > That's a great point, only having one thread per core could easily acco= unt for this. I'm hoping Sean can make txq !=3D rxq work so that you can ha= ve 8txqs and 4 rxqs. > =20 >=20 > =E2=80=8BThe netgate RCC-VE 4860 is a 4 cores atom C2558E, and I'm using= 2 of the 4 Gigabit Intel i350 ports. > Lab detail: > https://bsdrp.net/documentation/examples/forwarding_performance_lab_of_a= _netgate_rcc-ve_4860 >=20 > My tunning are (same for both test): > hw.igb.rxd=3D"2048" (it should be useless now) > hw.igb.txd=3D"2048" (it should be useless now) > hw.em.rxd=3D"2048" > hw.em.txd=3D"2048" > hw.igb.rx_process_limit=3D"-1" (It should be useless now too) > hw.em.rx_process_limit=3D"-1" >=20 > dev.igb.2.fc=3D0 > dev.igb.3.fc=3D0 >=20 > I can generate profiling data for you: what kind of data do you want ? > =20