From owner-freebsd-net@freebsd.org Wed Jan 11 20:42:24 2017 Return-Path: Delivered-To: freebsd-net@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id E30E7CAB54D for ; Wed, 11 Jan 2017 20:42:24 +0000 (UTC) (envelope-from olivier@freebsd.org) Received: from smtp.smtpout.orange.fr (smtp02.smtpout.orange.fr [80.12.242.124]) by mx1.freebsd.org (Postfix) with ESMTP id 521EC1FE0 for ; Wed, 11 Jan 2017 20:42:23 +0000 (UTC) (envelope-from olivier@freebsd.org) Received: from mail-qt0-f171.google.com ([209.85.216.171]) by mwinf5d56 with ME id X8ak1u00E3iTc1M038akSX; Wed, 11 Jan 2017 21:34:45 +0100 X-ME-Helo: mail-qt0-f171.google.com X-ME-Auth: Y29jaGFyZC1sYWJiZS5vbGl2aWVyQG9yYW5nZS5mcg== X-ME-Date: Wed, 11 Jan 2017 21:34:45 +0100 X-ME-IP: 209.85.216.171 Received: by mail-qt0-f171.google.com with SMTP id l7so157935477qtd.1; Wed, 11 Jan 2017 12:34:44 -0800 (PST) X-Gm-Message-State: AIkVDXJpXBvUv2MdGyu9rGa7bwduCJgpE7qEoseenj/GBkoACx+7IDLUJpS6aYeFTaSagdLlnmUYFZKZU56NOg== X-Received: by 10.200.41.198 with SMTP id 6mr10201420qtt.130.1484166883894; Wed, 11 Jan 2017 12:34:43 -0800 (PST) MIME-Version: 1.0 Received: by 10.237.34.248 with HTTP; Wed, 11 Jan 2017 12:34:23 -0800 (PST) In-Reply-To: <1598f29d379.ea6360351471.8752933472741761813@nextbsd.org> References: <30f21c75-d3a2-edcd-1999-d5ed9f970c06@freebsd.org> <1598d97bf2a.c6bcb76838987.6501340920645175463@nextbsd.org> <574a7ac7-4842-9518-8286-a4d89a9f7a27@freebsd.org> <6c6cb534-73c7-464b-8af1-7445a9c0188c@freebsd.org> <1598f29d379.ea6360351471.8752933472741761813@nextbsd.org> From: =?UTF-8?Q?Olivier_Cochard=2DLabb=C3=A9?= Date: Wed, 11 Jan 2017 21:34:23 +0100 X-Gmail-Original-Message-ID: Message-ID: Subject: Re: HEADS-UP: IFLIB implementations of sys/dev/e1000 em, lem, igb pending To: Matthew Macy Cc: Sean Bruno , "freebsd-net@freebsd.org" , "freebsd-current@freebsd.org" Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: quoted-printable X-Content-Filtered-By: Mailman/MimeDel 2.1.23 X-BeenThere: freebsd-net@freebsd.org X-Mailman-Version: 2.1.23 Precedence: list List-Id: Networking and TCP/IP with FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 11 Jan 2017 20:42:25 -0000 On Wed, Jan 11, 2017 at 9:13 PM, Matthew Macy wrote: > > > Hmmm ... did your old tests do 4 or 8 queues on this hardware? > > > > Did the old tests run 1024 tx/rx slots or the max 4096? > > That's a great point, only having one thread per core could easily accoun= t > for this. I'm hoping Sean can make txq !=3D rxq work so that you can have > 8txqs and 4 rxqs. > > > =E2=80=8BThe netgate RCC-VE 4860 is a 4 cores atom C2558E, and I'm using = 2 of the 4 Gigabit Intel i350 ports. Lab detail: https://bsdrp.net/documentation/examples/forwarding_performance_lab_of_a_ne= tgate_rcc-ve_4860 My tunning are (same for both test): hw.igb.rxd=3D"2048" (it should be useless now) hw.igb.txd=3D"2048" (it should be useless now) hw.em.rxd=3D"2048" hw.em.txd=3D"2048" hw.igb.rx_process_limit=3D"-1" (It should be useless now too) hw.em.rx_process_limit=3D"-1" dev.igb.2.fc=3D0 dev.igb.3.fc=3D0 I can generate profiling data for you: what kind of data do you want ?