From owner-freebsd-net@FreeBSD.ORG Thu Nov 9 15:36:56 2006 Return-Path: X-Original-To: freebsd-net@freebsd.org Delivered-To: freebsd-net@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id 57F3516A416; Thu, 9 Nov 2006 15:36:56 +0000 (UTC) (envelope-from mike@sentex.net) Received: from smarthost2.sentex.ca (smarthost2.sentex.ca [205.211.164.50]) by mx1.FreeBSD.org (Postfix) with ESMTP id 3151343D6B; Thu, 9 Nov 2006 15:36:48 +0000 (GMT) (envelope-from mike@sentex.net) Received: from lava.sentex.ca (pyroxene.sentex.ca [199.212.134.18]) by smarthost2.sentex.ca (8.13.8/8.13.8) with ESMTP id kA9FamFS023231; Thu, 9 Nov 2006 10:36:48 -0500 (EST) (envelope-from mike@sentex.net) Received: from mdt-xp.sentex.net (simeon.sentex.ca [192.168.43.27]) by lava.sentex.ca (8.13.6/8.13.3) with ESMTP id kA9FaltD018819 (version=TLSv1/SSLv3 cipher=DHE-RSA-AES256-SHA bits=256 verify=NO); Thu, 9 Nov 2006 10:36:47 -0500 (EST) (envelope-from mike@sentex.net) Message-Id: <200611091536.kA9FaltD018819@lava.sentex.ca> X-Mailer: QUALCOMM Windows Eudora Version 7.1.0.9 Date: Thu, 09 Nov 2006 10:36:51 -0500 To: "Jack Vogel" , freebsd-stable@freebsd.org, freebsd-net From: Mike Tancsa In-Reply-To: <2a41acea0611081719h31be096eu614d2f2325aff511@mail.gmail.co m> References: <2a41acea0611081719h31be096eu614d2f2325aff511@mail.gmail.com> Mime-Version: 1.0 Content-Type: text/plain; charset="us-ascii"; format=flowed Cc: Subject: Re: Proposed 6.2 em RELEASE patch X-BeenThere: freebsd-net@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Networking and TCP/IP with FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 09 Nov 2006 15:36:56 -0000 At 08:19 PM 11/8/2006, Jack Vogel wrote: >BUT, I've added the FAST_INTR changes back into the code, so >if you go into your Makefile and add -DEM_FAST_INTR you will >then get the taskqueue stuff. It certainly does make a difference performance wise. I did some quick testing with netperf and netrate. Back to back boxes, using an AMD x2 with bge nic and one intel box CPU: AMD Athlon(tm) 64 X2 Dual Core Processor 3800+ (2009.27-MHz 686-class CPU) CPU: Intel(R) Core(TM)2 CPU 6400 @ 2.13GHz (2144.01-MHz 686-class CPU) The intel is a DG965SS with integrated em nic, the AMD a Tyan with integrated bge. Both running SMP kernels with pf built in, no inet6. Intel box as sender. In this test its with the patch from yesterday. The first set with the patch as is, the second test with -DEM_FAST_INTR. TCP STREAM TEST to 192.168.44.1 : +/-2.5% @ 99% conf. Recv Send Send Socket Socket Message Elapsed Size Size Size Time Throughput bytes bytes bytes secs. 10^6bits/sec 57344 57344 4096 62.19 858.16 57344 57344 4096 62.19 934.58 TCP STREAM TEST to 192.168.44.1 : +/-2.5% @ 99% conf. Recv Send Send Socket Socket Message Elapsed Size Size Size Time Throughput bytes bytes bytes secs. 10^6bits/sec 32768 32768 4096 62.27 551.46 32768 32768 4096 62.26 788.56 TCP REQUEST/RESPONSE TEST to 192.168.44.1 : +/-2.5% @ 99% conf. Local /Remote Socket Size Request Resp. Elapsed Trans. Send Recv Size Size Time Rate bytes Bytes bytes bytes secs. per sec 32768 65536 1 1 62.26 2999.88 32768 65536 32768 65536 1 1 62.31 6165.46 32768 65536 UDP REQUEST/RESPONSE TEST to 192.168.44.1 : +/-2.5% @ 99% conf. Local /Remote Socket Size Request Resp. Elapsed Trans. Send Recv Size Size Time Rate bytes Bytes bytes bytes secs. per sec 9216 41600 1 1 62.30 3170.25 9216 41600 9216 41600 1 1 62.34 6170.81 9216 41600 UDP REQUEST/RESPONSE TEST to 192.168.44.1 : +/-2.5% @ 99% conf. Local /Remote Socket Size Request Resp. Elapsed Trans. Send Recv Size Size Time Rate bytes Bytes bytes bytes secs. per sec 9216 41600 516 4 62.28 2999.17 9216 41600 9216 41600 516 4 62.33 6031.56 9216 41600 UDP UNIDIRECTIONAL SEND TEST to 192.168.44.1 : +/-2.5% @ 99% conf. Socket Message Elapsed Messages Size Size Time Okay Errors Throughput bytes bytes secs # # 10^6bits/sec 32768 4096 60.00 1743632 24778919 952.25 41600 60.00 1742801 951.79 32768 4096 60.00 1743633 24722456 952.25 41600 60.00 1742828 951.81 UDP UNIDIRECTIONAL SEND TEST to 192.168.44.1 : +/-2.5% @ 99% conf. Socket Message Elapsed Messages Size Size Time Okay Errors Throughput bytes bytes secs # # 10^6bits/sec 32768 1024 60.00 6831370 28639884 932.70 41600 60.00 6828166 932.27 32768 1024 60.00 6831369 28465662 932.70 41600 60.00 6828086 932.26 Intel box as receiver, bge0/AMD as sender First set of results using stock em driver from 6.2beta2 second set of results using first patch 3rd set using taskqueue enabled /usr/local/netperf/netperf -t TCP_STREAM -l 60 -H 192.168.44.244 -i 10,3 -I 99,5 -- -s 57344 -S 57344 -m 4096 TCP STREAM TEST to 192.168.44.244 : +/-2.5% @ 99% conf. Recv Send Send Socket Socket Message Elapsed Size Size Size Time Throughput bytes bytes bytes secs. 10^6bits/sec 57344 57344 4096 60.00 680.24 57344 57344 4096 60.00 680.34 57344 57344 4096 60.00 680.54 TCP STREAM TEST to 192.168.44.244 : +/-2.5% @ 99% conf. Recv Send Send Socket Socket Message Elapsed Size Size Size Time Throughput bytes bytes bytes secs. 10^6bits/sec 32768 32768 4096 60.00 496.72 32768 32768 4096 60.00 499.87 32768 32768 4096 60.00 677.63 TCP REQUEST/RESPONSE TEST to 192.168.44.244 : +/-2.5% @ 99% conf. Local /Remote Socket Size Request Resp. Elapsed Trans. Send Recv Size Size Time Rate bytes Bytes bytes bytes secs. per sec 32768 65536 1 1 60.00 2999.61 32768 65536 32768 65536 1 1 60.00 2999.50 32768 65536 32768 65536 1 1 60.00 6163.75 32768 65536 UDP REQUEST/RESPONSE TEST to 192.168.44.244 : +/-2.5% @ 99% conf. Local /Remote Socket Size Request Resp. Elapsed Trans. Send Recv Size Size Time Rate bytes Bytes bytes bytes secs. per sec 9216 41600 1 1 60.00 3099.52 9216 41600 9216 41600 1 1 60.00 3102.97 9216 41600 9216 41600 1 1 60.00 6178.13 9216 41600 UDP REQUEST/RESPONSE TEST to 192.168.44.244 : +/-2.5% @ 99% conf. Local /Remote Socket Size Request Resp. Elapsed Trans. Send Recv Size Size Time Rate bytes Bytes bytes bytes secs. per sec 9216 41600 516 4 60.00 2956.58 9216 41600 9216 41600 516 4 60.00 2956.15 9216 41600 9216 41600 516 4 60.00 6075.79 9216 41600 /usr/local/netperf/netperf -t UDP_STREAM -l 60 -H 192.168.44.244 -i 10,3 -I 99,5 -- -s 32768 -S 32768 -m 4096 UDP UNIDIRECTIONAL SEND TEST to 192.168.44.244 : +/-2.5% @ 99% conf. Socket Message Elapsed Messages Size Size Time Okay Errors Throughput bytes bytes secs # # 10^6bits/sec 32768 4096 60.00 1340178 20058972 731.91 41600 60.00 1340178 731.90 32768 4096 60.00 1340076 19963473 731.85 41600 60.00 1340076 731.85 32768 4096 60.00 1340497 20167227 732.09 41600 60.00 1340497 732.09 UDP UNIDIRECTIONAL SEND TEST to 192.168.44.244 : +/-2.5% @ 99% conf. Socket Message Elapsed Messages Size Size Time Okay Errors Throughput bytes bytes secs # # 10^6bits/sec 32768 1024 60.00 5468540 29141343 746.64 41600 60.00 5468538 746.63 32768 1024 60.00 5469132 29805133 746.71 41600 60.00 5469132 746.71 32768 1024 60.00 5468372 30181335 746.61 41600 60.00 5468372 746.61