From owner-freebsd-net@FreeBSD.ORG Tue Oct 25 08:06:35 2011 Return-Path: Delivered-To: freebsd-net@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 523071065676 for ; Tue, 25 Oct 2011 08:06:35 +0000 (UTC) (envelope-from jfvogel@gmail.com) Received: from mail-ww0-f50.google.com (mail-ww0-f50.google.com [74.125.82.50]) by mx1.freebsd.org (Postfix) with ESMTP id B4AF98FC0C for ; Tue, 25 Oct 2011 08:06:34 +0000 (UTC) Received: by wwi18 with SMTP id 18so298530wwi.31 for ; Tue, 25 Oct 2011 01:06:33 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=gamma; h=mime-version:in-reply-to:references:date:message-id:subject:from:to :cc:content-type; bh=KuO/lImrecu3JxIxWLeYmStuY2b8HmDBwR4pgqERdrQ=; b=a0S6nUqMSjJCEqQK2uHhG9o9NJiVLSBLXqejcAjp0VuPIqf7CLRtaOGk4jSLlC9nK9 t4NsS+XwVNVLZKTEm+5Z7LE3J4A0RKFFLKHa4vnMGjQKnG0ReahpgrjZPrAkUzeyLs7h Sul5eJWsjLvV27zwRPh/YrA6h+JvY72eCPmtY= MIME-Version: 1.0 Received: by 10.227.60.131 with SMTP id p3mr2310335wbh.4.1319529993507; Tue, 25 Oct 2011 01:06:33 -0700 (PDT) Received: by 10.180.79.103 with HTTP; Tue, 25 Oct 2011 01:06:33 -0700 (PDT) In-Reply-To: <1319527328469-4935272.post@n5.nabble.com> References: <1319449307149-4931883.post@n5.nabble.com> <1319478384269-4933498.post@n5.nabble.com> <1319483324861-4933765.post@n5.nabble.com> <1319485884830-4933934.post@n5.nabble.com> <1319527328469-4935272.post@n5.nabble.com> Date: Tue, 25 Oct 2011 01:06:33 -0700 Message-ID: From: Jack Vogel To: Sergey Saley Content-Type: text/plain; charset=ISO-8859-1 X-Content-Filtered-By: Mailman/MimeDel 2.1.5 Cc: freebsd-net@freebsd.org Subject: Re: Too much interrupts on ixgbe X-BeenThere: freebsd-net@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Networking and TCP/IP with FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 25 Oct 2011 08:06:35 -0000 On Tue, Oct 25, 2011 at 12:22 AM, Sergey Saley wrote: > > Ryan Stone-2 wrote: > > > > On Mon, Oct 24, 2011 at 3:51 PM, Sergey Saley <sergeysaley@> > wrote: > >> MPD5, netgraph, pppoe.Types of traffic - any (customer traffic). > >> Bying this card I counted on a 3-4G traffic at 3-4K pppoe sessions. > >> It turned to 600-700Mbit/s, about 50K pps at 700-800 pppoe sessions. > > > > PPPoE is your problem. The Intel cards can't load-balance PPPoE > > traffic, so everything goes to one queue. It may be possible to write > > a netgraph module to load-balance the traffic across your CPUs. > > > > OK, thank You for explanation. > And what about the large number of interrupts? > As for me, it's too much... > irq256: ix0:que 0 240536944 6132 > irq257: ix0:que 1 89090444 2271 > irq258: ix0:que 2 93222085 2376 > irq259: ix0:que 3 89435179 2280 > irq260: ix0:link 1 0 > irq261: ix1:que 0 269468769 6870 > irq262: ix1:que 1 110974 2 > irq263: ix1:que 2 434214 11 > irq264: ix1:que 3 112281 2 > irq265: ix1:link 1 0 > > How do you decide its 'too much' ? It may be that with your traffic you end up not being able to use offloads, just thinking. Its not like the hardware just "makes it up", it interrupts on the last descriptor of a packet which has the RS bit set. With TSO you will get larger chunks of data and thus less interrupts but your traffic probably doesn't qualify for it. Jack