From owner-freebsd-stable@FreeBSD.ORG Mon Nov 20 04:54:42 2006 Return-Path: X-Original-To: freebsd-stable@freebsd.org Delivered-To: freebsd-stable@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [69.147.83.52]) by hub.freebsd.org (Postfix) with ESMTP id 172B016A407; Mon, 20 Nov 2006 04:54:42 +0000 (UTC) (envelope-from mike@sentex.net) Received: from smarthost1.sentex.ca (smarthost1.sentex.ca [64.7.153.18]) by mx1.FreeBSD.org (Postfix) with ESMTP id EDD6C43D49; Mon, 20 Nov 2006 04:54:27 +0000 (GMT) (envelope-from mike@sentex.net) Received: from lava.sentex.ca (pyroxene.sentex.ca [199.212.134.18]) by smarthost1.sentex.ca (8.13.6/8.13.6) with ESMTP id kAK4seAr033789; Sun, 19 Nov 2006 23:54:40 -0500 (EST) (envelope-from mike@sentex.net) Received: from mdt-xp.sentex.net (simeon.sentex.ca [192.168.43.27]) by lava.sentex.ca (8.13.6/8.13.3) with ESMTP id kAK4sdat083568 (version=TLSv1/SSLv3 cipher=DHE-RSA-AES256-SHA bits=256 verify=NO); Sun, 19 Nov 2006 23:54:39 -0500 (EST) (envelope-from mike@sentex.net) Message-Id: <200611200454.kAK4sdat083568@lava.sentex.ca> X-Mailer: QUALCOMM Windows Eudora Version 7.1.0.9 Date: Sun, 19 Nov 2006 23:54:50 -0500 To: Scott Long From: Mike Tancsa In-Reply-To: <4558E3DC.6080800@samsco.org> References: <2a41acea0611081719h31be096eu614d2f2325aff511@mail.gmail.com> <200611091536.kA9FaltD018819@lava.sentex.ca> <45534E76.6020906@samsco.org> <200611092200.kA9M0q1E020473@lava.sentex.ca> <200611102004.kAAK4iO9027778@lava.sentex.ca> <2a41acea0611101400w5b8cef40ob84ed6de181f3e2c@mail.gmail.com> <200611102221.kAAML6ol028630@lava.sentex.ca> <455570D8.6070000@samsco.org> <200611120412.kAC4CuIB035746@lava.sentex.ca> <45574ECA.4080207@samsco.org> <200611130040.kAD0etbp040637@lava.sentex.ca> <4557CECD.2000609@samsco.org> <200611130158.kAD1wdKE040908@lava.sentex.ca> <4557EF13.9060305@samsco.org> <200611130454.kAD4sZwe041556@lava.sentex.ca> <4557FF7A.8020704@samsco.org> <200611132054.kADKsFvK045726@lava.sentex.ca> <4558E3DC.6080800@samsco.org> Mime-Version: 1.0 Content-Type: text/plain; charset="us-ascii"; format=flowed X-Virus-Scanned: ClamAV version 0.88.3, clamav-milter version 0.88.3 on clamscanner3 X-Virus-Status: Clean Cc: freebsd-net , glebius@freebsd.org, freebsd-stable@freebsd.org Subject: Re: Proposed 6.2 em RELEASE patch X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 20 Nov 2006 04:54:42 -0000 At 04:30 PM 11/13/2006, Scott Long wrote: >Mike Tancsa wrote: >>At 12:15 AM 11/13/2006, Scott Long wrote: >> >>>Is this with EM_INTR_FAST enabled also? >> >>Without it, the 2 streams are definitely lossy on the management interface >> >> ---Mike > >Ok, and would you be able to test the polling options as well? Here are some more results. I am still going through testing with firewall rules as well as testing with the size of the routing table. Should get through that tomorrow. Again, this is the same setup as described at http://www.tancsa.com/blast.jpg Note about platforms. The HEAD w Patch is a patch glebius@freebsd.org asked me to test. FastFWD is with net.inet.ip.fastforwarding on. Also with FastFWD set to one, I always used the kernel options ADAPTIVE_GIANT commented out and added NO_ADAPTIVE_MUTEXES. INET6 was removed from all kernels as well. With these kernel changes, and fast forwarding on, I was able to keep the box r2 responsive from the console as while blasting packets across its 2 interfaces. Otherwise, the box seemingly livelocked. For the linux kernel config, it was pretty well the default, except I removed INET6, IPSEC and disabled iptables. The LINUX kernel was 2.6.18.2 on FC5. The first test is with UDP netperf. /usr/local/netperf/netperf -l 60 -H 192.168.44.1 -i 10,2 -I 99,10 -t UDP_STREAM -- -m 10 -s 32768 -S 32768 /usr/local/netperf/netperf -l 60 -H 192.168.44.1 -i 10,2 -I 99,10 -t UDP_STREAM -- -m 64 -s 32768 -S 32768 /usr/local/netperf/netperf -l 60 -H 192.168.44.1 -i 10,2 -I 99,10 -t UDP_STREAM -- -m 128 -s 32768 -S 32768 /usr/local/netperf/netperf -l 60 -H 192.168.44.1 -i 10,2 -I 99,10 -t UDP_STREAM -- -m 200 -s 32768 -S 32768 Not much difference UDP STREAM TEST Platform 10 64 128 200 Linux 2.18.2 NAPI 46.79 297.65 531.00 706.00 FreeBSD HEAD 46.75 297.82 530.70 728.01 RELENG6 i386 46.70 296.32 529.12 721.80 RELENG6 i386 FastFWD 46.37 295.88 529.72 722.02 FreeBSD HEAD w Patch 46.39 293.78 529.41 728.17 FreeBSD HEAD w Patch FastFWD 46.52 295.71 529.81 718.32 AMD64 RELENG6 w FastFWD 46.27 295.85 529.44 721.96 Next test was one box blasting packets across using netrate, as measured at the receiving end of the blast-- i.e. what made it through the 2 interfaces on R2. I would sample the rate for 10 seconds and then record the average. The values were pretty tight with little variation. LINUX was faster, but the difference is uninteresting between it and the top values for FreeBSD. Straight Routing test One Stream pps Linux 581,309.81 FreeBSD HEAD 441,559.50 RELENG6 i386 407,403.00 RELENG6 i386 FastFWD 557,589.25 FreeBSD HEAD w Patch 422,294.13 FreeBSD HEAD w Patch FastFWD 567,290.00 AMD64 RELENG6 w FastFWD 574,591.88 AMD64 RELENG6 polling 285,917.13 AMD64 RELENG6 polling FastFWD 512,042.00 RELENG6 i386 polling FastFWD 558,603.00 The differences here between LINUX and FreeBSD were a bit more in this test. Straight Routing test 2 streams opposite direction pps Linux 473,814 FreeBSD HEAD 204,043 RELENG6 i386 165,461 RELENG6 i386 FastFWD 368,967 FreeBSD HEAD w Patch 127,832 FreeBSD HEAD w Patch FastFWD 346,220 AMD64 RELENG6 w Polling 155,659 AMD64 RELENG6 w Polling FastFWD 231,541 More data to come.... ---Mike