From owner-freebsd-net@FreeBSD.ORG Tue Oct 25 01:59:13 2011 Return-Path: Delivered-To: freebsd-net@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 5823E1065673 for ; Tue, 25 Oct 2011 01:59:13 +0000 (UTC) (envelope-from lacombar@gmail.com) Received: from mail-ww0-f42.google.com (mail-ww0-f42.google.com [74.125.82.42]) by mx1.freebsd.org (Postfix) with ESMTP id DBCFC8FC08 for ; Tue, 25 Oct 2011 01:59:12 +0000 (UTC) Received: by wwn22 with SMTP id 22so4455414wwn.1 for ; Mon, 24 Oct 2011 18:59:11 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=gamma; h=mime-version:in-reply-to:references:date:message-id:subject:from:to :cc:content-type:content-transfer-encoding; bh=UA2PpxVmSP/8XxgaXEd+ES29kyH93Y7SUkOJSC5qfmY=; b=pRdkihE0WcAqaUOROI8LSA+kKtSgMDlxhgzGvLq4ubLx8dKX/QGe+DYRZXMZ2Zxlno tS/Y02cdIghQYfOqj47oA6LqhM5g5Ku0ysc2ljwEa5jkclAKBaWsSJHKRF/w+JKIHU43 +0Yoj4LpdcNYZL01sBMAwc+L9E0rcCi1OVMjY= MIME-Version: 1.0 Received: by 10.216.221.11 with SMTP id q11mr3882646wep.86.1319507951174; Mon, 24 Oct 2011 18:59:11 -0700 (PDT) Received: by 10.180.105.162 with HTTP; Mon, 24 Oct 2011 18:59:11 -0700 (PDT) In-Reply-To: References: <1319449307149-4931883.post@n5.nabble.com> <1319478384269-4933498.post@n5.nabble.com> <1319483324861-4933765.post@n5.nabble.com> <1319485884830-4933934.post@n5.nabble.com> Date: Mon, 24 Oct 2011 21:59:11 -0400 Message-ID: From: Arnaud Lacombe To: Ryan Stone Content-Type: text/plain; charset=ISO-8859-1 Content-Transfer-Encoding: quoted-printable Cc: freebsd-net@freebsd.org, Sergey Saley Subject: Re: Too much interrupts on ixgbe X-BeenThere: freebsd-net@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Networking and TCP/IP with FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 25 Oct 2011 01:59:13 -0000 Hi, On Mon, Oct 24, 2011 at 4:32 PM, Ryan Stone wrote: > On Mon, Oct 24, 2011 at 3:51 PM, Sergey Saley wro= te: >> MPD5, netgraph, pppoe.Types of traffic - any (customer traffic). >> Bying this card I counted on a 3-4G traffic at 3-4K pppoe sessions. >> It turned to 600-700Mbit/s, about 50K pps at 700-800 pppoe sessions. > > PPPoE is your problem. =A0The Intel cards can't load-balance PPPoE > traffic, so everything goes to one queue. =A0It may be possible to write > a netgraph module to load-balance the traffic across your CPUs. > NetGraph already runs a thread per CPU, as you can see in top's output. There is also still have plenty of CPU usable, so I'd assume some hard-limit are hit, maybe any of `net.graph.maxdata' or `net.graph.maxalloc'. Sergey, what is the output of: # vmstat -z | grep NetGraph Thanks, - Arnaud