From owner-freebsd-net@FreeBSD.ORG Wed Mar 15 10:17:30 2006 Return-Path: X-Original-To: freebsd-net@freebsd.org Delivered-To: freebsd-net@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id 0284F16A424 for ; Wed, 15 Mar 2006 10:17:30 +0000 (UTC) (envelope-from cch@kmu.edu.tw) Received: from cc.kmu.edu.tw (cc.kmu.edu.tw [163.15.154.1]) by mx1.FreeBSD.org (Postfix) with ESMTP id E166143D45 for ; Wed, 15 Mar 2006 10:17:27 +0000 (GMT) (envelope-from cch@kmu.edu.tw) Received: from [163.15.154.198] (c198.cc.kmu.edu.tw [163.15.154.198]) by cc.kmu.edu.tw (8.13.4/8.13.3) with ESMTP id k2FAGSvc023190 for ; Wed, 15 Mar 2006 18:16:29 +0800 (CST) (envelope-from cch@kmu.edu.tw) Message-ID: <4417E97D.7050202@kmu.edu.tw> Date: Wed, 15 Mar 2006 18:16:29 +0800 From: Chih-Chang Hsieh User-Agent: Thunderbird 1.5 (X11/20060221) MIME-Version: 1.0 To: freebsd-net@freebsd.org Content-Type: text/plain; charset=Big5 Content-Transfer-Encoding: 7bit X-cc.kmu.edu.tw-MailScanner-Information: Please contact the ISP for more information X-cc.kmu.edu.tw-MailScanner: Found to be clean X-cc.kmu.edu.tw-MailScanner-From: cch@kmu.edu.tw Subject: if_bridge + polling get lower througphts X-BeenThere: freebsd-net@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Networking and TCP/IP with FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 15 Mar 2006 10:17:30 -0000 We have a FreeBSD 6.1-PRELEASE box. It runs with 2 em NICs and uses if_bridge + IPFW + ipfilter + pf. This box usually gets a very high interrupt rate >90%. By using netstat -I em0 1, we see: input (em0) output packets errs bytes packets errs bytes colls 15164 0 9549410 16842 0 12132262 0 15331 0 9220723 17466 0 12354486 0 16486 0 10089165 17926 0 13256014 0 14936 10 8363433 17090 0 13367271 0 14712 0 8449705 16701 0 13443079 0 When we enable the polling on em0 and em1 by ifconfig, netstat -I em0 shows: input (em0) output packets errs bytes packets errs bytes colls 10910 0 6629176 11467 0 7681346 0 10951 0 6916042 11397 0 7954205 0 11281 0 7437813 10804 0 7390386 0 10711 0 6308033 11605 0 8400405 0 10807 0 6270716 10973 0 7700748 0 the interrupt rate decreases (<30%) but we get lower throuphts. The related sysctl MIBs are: kern.polling.idlepoll_sleeping: 1 kern.polling.stalled: 0 kern.polling.suspect: 0 kern.polling.phase: 0 kern.polling.enable: 0 kern.polling.handlers: 0 kern.polling.residual_burst: 0 kern.polling.pending_polls: 0 kern.polling.lost_polls: 0 kern.polling.short_ticks: 0 kern.polling.reg_frac: 20 kern.polling.user_frac: 50 kern.polling.idle_poll: 1 kern.polling.each_burst: 5 kern.polling.burst_max: 1000 kern.polling.burst: 5 net.link.bridge.ipfw: 1 net.link.bridge.pfil_member: 1 net.link.bridge.pfil_bridge: 1 net.link.bridge.pfil_onlyip: 0 How could we tune the box to reach higher throughputs as in non-polling mode? Thanks in advance.