From owner-freebsd-net@FreeBSD.ORG Sat Jan 29 16:30:10 2005 Return-Path: Delivered-To: freebsd-net@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id 4460A16A4CE; Sat, 29 Jan 2005 16:30:10 +0000 (GMT) Received: from relay.bestcom.ru (relay.bestcom.ru [217.72.144.5]) by mx1.FreeBSD.org (Postfix) with ESMTP id 3FFBE43D1F; Sat, 29 Jan 2005 16:30:09 +0000 (GMT) (envelope-from glebius@freebsd.org) Received: from cell.sick.ru (root@cell.sick.ru [217.72.144.68]) by relay.bestcom.ru (8.13.1/8.12.9) with ESMTP id j0TGTnnL042539 (version=TLSv1/SSLv3 cipher=DHE-RSA-AES256-SHA bits=256 verify=FAIL); Sat, 29 Jan 2005 19:29:50 +0300 (MSK) (envelope-from glebius@freebsd.org) Received: from cell.sick.ru (glebius@localhost [127.0.0.1]) by cell.sick.ru (8.12.11/8.12.8) with ESMTP id j0TGTnaX000129 (version=TLSv1/SSLv3 cipher=DHE-RSA-AES256-SHA bits=256 verify=NO); Sat, 29 Jan 2005 19:29:49 +0300 (MSK) (envelope-from glebius@freebsd.org) Received: (from glebius@localhost) by cell.sick.ru (8.12.11/8.12.11/Submit) id j0TGTnTs000128; Sat, 29 Jan 2005 19:29:49 +0300 (MSK) (envelope-from glebius@freebsd.org) X-Authentication-Warning: cell.sick.ru: glebius set sender to glebius@freebsd.org using -f Date: Sat, 29 Jan 2005 19:29:48 +0300 From: Gleb Smirnoff To: Thomas Vogt Message-ID: <20050129162948.GA99968@cell.sick.ru> Mail-Followup-To: Gleb Smirnoff , Thomas Vogt , freebsd-performance@freebsd.org, freebsd-net@freebsd.org References: <1106932700.48903.58.camel@bert.mlan.solnet.ch> Mime-Version: 1.0 Content-Type: text/plain; charset=koi8-r Content-Disposition: inline In-Reply-To: <1106932700.48903.58.camel@bert.mlan.solnet.ch> User-Agent: Mutt/1.5.6i X-Virus-Scanned: ClamAV version devel-20050125, clamav-milter version 0.80ff on relay.bestcom.ru X-Virus-Status: Clean cc: freebsd-net@freebsd.org cc: freebsd-performance@freebsd.org Subject: Re: freebsd router project. Problems with polling? X-BeenThere: freebsd-net@freebsd.org X-Mailman-Version: 2.1.1 Precedence: list List-Id: Networking and TCP/IP with FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 29 Jan 2005 16:30:10 -0000 Thomas, can you try if_em driver from HEAD and check whether this help. There were some work done during 5.3-RELEASE. On Fri, Jan 28, 2005 at 06:18:19PM +0100, Thomas Vogt wrote: T> netstat -w 1 (polling disabled) T> input (Total) output T> packets errs bytes packets errs bytes colls T> 300531 0 23441438 300585 0 23444792 0 T> 300939 0 25872898 300895 0 25870184 0 T> 300738 0 23457584 300768 0 23460626 0 T> 300304 10 25826466 300304 0 25826876 0 T> ... T> T> Interrupt load is about 70% with net.inet.ip.fastforwarding enabled. If T> I disable this the system becomes unusable. T> The system hasn't reach the limit yet. But the interrupt is much to T> high. It's not worthy to add a second udp sender machine, at the moment. T> T> T> netstat -w 1 (polling enabled) T> input (Total) output T> packets errs bytes packets errs bytes colls T> 150151 47647 12910330 150150 0 12911806 0 T> 150151 0 11711798 150152 0 11711876 0 T> 150151 47665 12910986 150151 0 12911810 0 T> 150151 0 11711798 150151 0 11711798 0 T> ... T> T> Interrupt load is about 10%. CPU is about 60% and with T> kern.polling.idle_poll enabled it goes to 100% (as expected). T> T> As you see the speed is droping down to 50% with polling enable and and T> I got a lot of errors. T> kern.polling.lost_polls: 188748 and kern.polling.suspect: 186919 are T> also very high. I don't know why polling is so bad on this machine. All T> SMP option are disabled in the kernel and bios. T> I tried to do as much as in T> http://lists.freebsd.org/pipermail/freebsd-questions/2004-November/064427.html described. T> T> I will prepare others tests with -STABLE and -CURRENT in the next few T> days. At the mean time, are they some other magic things config option I T> can try? Perhaps increase the HZ to 2000 in the kernel or remove polling T> and try smp machine? I doubt that I can run the machine without polling. T> If you see 70% interrupt load with 300k pps without polling. T> T> regards T> Thomas Vogt T> T> _______________________________________________ T> freebsd-net@freebsd.org mailing list T> http://lists.freebsd.org/mailman/listinfo/freebsd-net T> To unsubscribe, send any mail to "freebsd-net-unsubscribe@freebsd.org" -- Totus tuus, Glebius. GLEBIUS-RIPN GLEB-RIPE