From owner-freebsd-performance@FreeBSD.ORG Wed Mar 21 12:58:26 2007 Return-Path: X-Original-To: freebsd-performance@freebsd.org Delivered-To: freebsd-performance@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [69.147.83.52]) by hub.freebsd.org (Postfix) with ESMTP id 441D916A408 for ; Wed, 21 Mar 2007 12:58:26 +0000 (UTC) (envelope-from roma.a.g@gmail.com) Received: from ug-out-1314.google.com (ug-out-1314.google.com [66.249.92.170]) by mx1.freebsd.org (Postfix) with ESMTP id 77FCC13C458 for ; Wed, 21 Mar 2007 12:58:25 +0000 (UTC) (envelope-from roma.a.g@gmail.com) Received: by ug-out-1314.google.com with SMTP id 71so295719ugh for ; Wed, 21 Mar 2007 05:58:24 -0700 (PDT) DKIM-Signature: a=rsa-sha1; c=relaxed/relaxed; d=gmail.com; s=beta; h=domainkey-signature:received:received:date:from:x-mailer:reply-to:x-priority:message-id:to:subject:mime-version:content-type:content-transfer-encoding; b=r8NwFMOzzYbed/OS53vXTo5LlOzHJ7wFNXD6x6ClFgWp1Ho1JVp3VMriurFBxDxjWfrIHKE+GorQ+43JvDL7QUMvGTNpkBQ7eecJpQ8ZkvzAjJgrlSLtedRxHna+S9W+7NGCfcFF64kEsfpojQcusO9I8g2kgWEWGDdo1Zb2oqI= DomainKey-Signature: a=rsa-sha1; c=nofws; d=gmail.com; s=beta; h=received:date:from:x-mailer:reply-to:x-priority:message-id:to:subject:mime-version:content-type:content-transfer-encoding; b=nUWcQ50NL7NCRSD+83G6px7PGAgLANdcohOgIaR6q7BpkG0n7PkwHcUjt8lT+Q2khIhpTEQAuto5Ac0sfNcH3756BV6OBM8+XJAt5qwFD4tuKq+F1U9pjLHY6pkgQvUB+4v3LUPfPuyIqWUsRVghuKA7FrxYDXfXLg/ULa/Fd6c= Received: by 10.66.232.9 with SMTP id e9mr3048327ugh.1174480455367; Wed, 21 Mar 2007 05:34:15 -0700 (PDT) Received: from ?10.200.0.64? ( [81.211.90.3]) by mx.google.com with ESMTP id 53sm1808286ugn.2007.03.21.05.34.13; Wed, 21 Mar 2007 05:34:14 -0700 (PDT) Date: Wed, 21 Mar 2007 15:34:12 +0300 From: "Roman Gorohov. " X-Mailer: The Bat! (v3.62.14) Professional X-Priority: 3 (Normal) Message-ID: <1036039198.20070321153412@gmail.com> To: freebsd-performance@freebsd.org MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Transfer-Encoding: 7bit Subject: Slow on heavy I/O operations. X-BeenThere: freebsd-performance@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list Reply-To: "roma.a.g" List-Id: Performance/tuning List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 21 Mar 2007 12:58:26 -0000 Hello list. There is a server with FreeBSD FreeBSD 4.11-STABLE(can't upgrade fornow) on HP ProLiant DL140. Disk system: at scbus0 target 0 lun0(pass0,da0) on a ASC-29320A. If I do: [idle@hst ~]#dd if=/dev/zero of=bigfile bs=64k count=5000 5000+0 records in 5000+0 records out 327680000 bytes transferred in 37.515699 secs (8734477 bytes/sec) All is hung while dd working. Its look like that: [idle@hst ~]#systat -v skip... Disks da0 pass0 pass1 md0 KB/t 20.33 0.00 0.00 0.00 tps 812 0 0 0 MB/s 16.11 0.00 0.00 0.00 % busy 100 0 0 0 skip... [idle@hst ~]#vmstat -w 5 procs memory page disks faults cpu r b w avm fre flt re pi po fr sr da0 md0 in sy cs us sy id 1 0 0 1996756 54208 42 23 25 7 39 336 0 0 531 638 404 21 5 74 1 6 0 2011488 13272 571 0 0 1 2506 8 129 0 1356 2125 159 3 4 93 4 27 0 2022852 4228 267 0 0 1 1657 4 272 0 1450 784 96 1 3 96 1 10 0 2027492 40220 449 5 0 12 3257 9384 574 0 1773 4366 189 8 7 85 1 10 0 2035064 25604 746 2 1 7 2965 4466 157 0 1380 4486 184 8 7 85 0 11 0 2030860 4228 515 2 1 3 2098 31 214 0 1412 3077 149 16 5 79 3 14 0 2042792 10004 1014 4 1 5 2787 4432 267 0 1440 1735 118 2 4 94 2 16 0 2062664 4228 301 0 1 2 2843 27 564 0 1759 1250 107 5 4 91 [idle@hst ~]#iostat -w 5 tty da0 pass0 pass1 cpu tin tout KB/t tps MB/s KB/t tps MB/s KB/t tps MB/s us ni sy in id 0 25 0.00 0 0.00 0.00 0 0.00 0.00 0 0.00 21 0 4 0 74 1 109 62.56 242 14.81 0.00 0 0.00 0.00 0 0.00 7 0 9 0 83 0 101 18.29 433 7.73 0.00 0 0.00 0.00 0 0.00 2 0 2 0 95 0 76 26.45 281 7.25 0.00 0 0.00 0.00 0 0.00 3 0 4 0 93 0 94 15.99 357 5.57 0.00 0 0.00 0.00 0 0.00 2 0 2 0 96 0 15 16.04 667 10.45 0.00 0 0.00 0.00 0 0.00 0 0 3 1 96 0 93 15.99 558 8.71 0.00 0 0.00 0.00 0 0.00 0 0 2 1 97 0 80 16.16 252 3.98 0.00 0 0.00 0.00 0 0.00 0 0 1 0 98 0 117 23.44 240 5.49 0.00 0 0.00 0.00 0 0.00 9 0 6 0 85 Why this happen? What should I do? And one more question - how do I find process that doing heavy IO operations? For now I suspecting zope that run on the server. Thanks in advance. Roman. From owner-freebsd-performance@FreeBSD.ORG Wed Mar 21 13:54:31 2007 Return-Path: X-Original-To: freebsd-performance@FreeBSD.ORG Delivered-To: freebsd-performance@FreeBSD.ORG Received: from mx1.freebsd.org (mx1.freebsd.org [69.147.83.52]) by hub.freebsd.org (Postfix) with ESMTP id 24F7D16A403 for ; Wed, 21 Mar 2007 13:54:31 +0000 (UTC) (envelope-from olli@lurza.secnetix.de) Received: from lurza.secnetix.de (lurza.secnetix.de [83.120.8.8]) by mx1.freebsd.org (Postfix) with ESMTP id 4FA9E13C4BC for ; Wed, 21 Mar 2007 13:54:30 +0000 (UTC) (envelope-from olli@lurza.secnetix.de) Received: from lurza.secnetix.de (ojuzmj@localhost [127.0.0.1]) by lurza.secnetix.de (8.13.4/8.13.4) with ESMTP id l2LDsKCj080912; Wed, 21 Mar 2007 14:54:29 +0100 (CET) (envelope-from oliver.fromme@secnetix.de) Received: (from olli@localhost) by lurza.secnetix.de (8.13.4/8.13.1/Submit) id l2LDsKnV080911; Wed, 21 Mar 2007 14:54:20 +0100 (CET) (envelope-from olli) Date: Wed, 21 Mar 2007 14:54:20 +0100 (CET) Message-Id: <200703211354.l2LDsKnV080911@lurza.secnetix.de> From: Oliver Fromme To: freebsd-performance@FreeBSD.ORG, "roma.a.g" In-Reply-To: <1036039198.20070321153412@gmail.com> X-Newsgroups: list.freebsd-performance User-Agent: tin/1.8.2-20060425 ("Shillay") (UNIX) (FreeBSD/4.11-STABLE (i386)) MIME-Version: 1.0 Content-Type: text/plain; charset=ISO-8859-1 Content-Transfer-Encoding: 8bit X-Greylist: Sender IP whitelisted, not delayed by milter-greylist-2.1.2 (lurza.secnetix.de [127.0.0.1]); Wed, 21 Mar 2007 14:54:29 +0100 (CET) Cc: Subject: Re: Slow on heavy I/O operations. X-BeenThere: freebsd-performance@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list Reply-To: freebsd-performance@FreeBSD.ORG, "roma.a.g" List-Id: Performance/tuning List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 21 Mar 2007 13:54:31 -0000 Roman Gorohov. wrote: > Hello list. > There is a server with FreeBSD FreeBSD 4.11-STABLE(can't upgrade fornow) on HP ProLiant DL140. > Disk system: at scbus0 target 0 lun0(pass0,da0) on a ASC-29320A. > If I do: > [idle@hst ~]#dd if=/dev/zero of=bigfile bs=64k count=5000 > 5000+0 records in > 5000+0 records out > 327680000 bytes transferred in 37.515699 secs (8734477 bytes/sec) > All is hung while dd working. > > Its look like that: > [idle@hst ~]#systat -v > skip... > Disks da0 pass0 pass1 md0 > KB/t 20.33 0.00 0.00 0.00 > tps 812 0 0 0 > MB/s 16.11 0.00 0.00 0.00 > % busy 100 0 0 0 > skip... > > [idle@hst ~]#vmstat -w 5 > procs memory page disks faults cpu > r b w avm fre flt re pi po fr sr da0 md0 in sy cs us sy id > 1 0 0 1996756 54208 42 23 25 7 39 336 0 0 531 638 404 21 5 74 > 1 6 0 2011488 13272 571 0 0 1 2506 8 129 0 1356 2125 159 3 4 93 > 4 27 0 2022852 4228 267 0 0 1 1657 4 272 0 1450 784 96 1 3 96 > 1 10 0 2027492 40220 449 5 0 12 3257 9384 574 0 1773 4366 189 8 7 85 > 1 10 0 2035064 25604 746 2 1 7 2965 4466 157 0 1380 4486 184 8 7 85 > 0 11 0 2030860 4228 515 2 1 3 2098 31 214 0 1412 3077 149 16 5 79 > 3 14 0 2042792 10004 1014 4 1 5 2787 4432 267 0 1440 1735 118 2 4 94 > 2 16 0 2062664 4228 301 0 1 2 2843 27 564 0 1759 1250 107 5 4 91 > > [idle@hst ~]#iostat -w 5 > tty da0 pass0 pass1 cpu > tin tout KB/t tps MB/s KB/t tps MB/s KB/t tps MB/s us ni sy in id > 0 25 0.00 0 0.00 0.00 0 0.00 0.00 0 0.00 21 0 4 0 74 > 1 109 62.56 242 14.81 0.00 0 0.00 0.00 0 0.00 7 0 9 0 83 > 0 101 18.29 433 7.73 0.00 0 0.00 0.00 0 0.00 2 0 2 0 95 > 0 76 26.45 281 7.25 0.00 0 0.00 0.00 0 0.00 3 0 4 0 93 > 0 94 15.99 357 5.57 0.00 0 0.00 0.00 0 0.00 2 0 2 0 96 > 0 15 16.04 667 10.45 0.00 0 0.00 0.00 0 0.00 0 0 3 1 96 > 0 93 15.99 558 8.71 0.00 0 0.00 0.00 0 0.00 0 0 2 1 97 > 0 80 16.16 252 3.98 0.00 0 0.00 0.00 0 0.00 0 0 1 0 98 > 0 117 23.44 240 5.49 0.00 0 0.00 0.00 0 0.00 9 0 6 0 85 > > Why this happen? The numbers from your vmstat output indicate that your machine is paging ("swapping"), i.e. it's running out or RAM. Of course, such paging activity competes with other I/O operations in the system, which explains the symptoms that you're seeing. > What should I do? Either add more RAM, or reduce the memory requirements of your applications, if possible. Another work-around wold be to add a second disk and use it exclusively for swap. That way it won't compete with I/O operations on yoru data disk. The paging will still slow down your machine, though, therefore you should really try to add more RAM. Best regards Oliver -- Oliver Fromme, secnetix GmbH & Co. KG, Marktplatz 29, 85567 Grafing b. M. Handelsregister: Registergericht Muenchen, HRA 74606, Geschäftsfuehrung: secnetix Verwaltungsgesellsch. mbH, Handelsregister: Registergericht Mün- chen, HRB 125758, Geschäftsführer: Maik Bachmann, Olaf Erb, Ralf Gebhart FreeBSD-Dienstleistungen, -Produkte und mehr: http://www.secnetix.de/bsd "What is this talk of 'release'? We do not make software 'releases'. Our software 'escapes', leaving a bloody trail of designers and quality assurance people in its wake." From owner-freebsd-performance@FreeBSD.ORG Thu Mar 22 13:20:32 2007 Return-Path: X-Original-To: freebsd-performance@freebsd.org Delivered-To: freebsd-performance@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [69.147.83.52]) by hub.freebsd.org (Postfix) with ESMTP id 6628E16A400 for ; Thu, 22 Mar 2007 13:20:32 +0000 (UTC) (envelope-from roma.a.g@gmail.com) Received: from ug-out-1314.google.com (ug-out-1314.google.com [66.249.92.174]) by mx1.freebsd.org (Postfix) with ESMTP id 57CC813C4B9 for ; Thu, 22 Mar 2007 13:20:31 +0000 (UTC) (envelope-from roma.a.g@gmail.com) Received: by ug-out-1314.google.com with SMTP id 71so683137ugh for ; Thu, 22 Mar 2007 06:20:30 -0700 (PDT) DKIM-Signature: a=rsa-sha1; c=relaxed/relaxed; d=gmail.com; s=beta; h=domainkey-signature:received:received:date:from:x-mailer:reply-to:x-priority:message-id:to:subject:in-reply-to:references:mime-version:content-type:content-transfer-encoding; b=gPWh6stl1B8+T9cC3t6IS6CAgR075Dkrk52RZuBJ2Fb/LuDZrdmWtz1dDVMpNQy0aLk5sp378nZUTm+V1WyBdgjLUcm8dq5f/lzKVYr3smUVeeCV8glNjjMKWeKTrxu1+k8tpY3fT3RAAdwPAYxINo23bs5P6HmHmY5+toq+Ri8= DomainKey-Signature: a=rsa-sha1; c=nofws; d=gmail.com; s=beta; h=received:date:from:x-mailer:reply-to:x-priority:message-id:to:subject:in-reply-to:references:mime-version:content-type:content-transfer-encoding; b=ioPlPtz+v4Q9OL//+vi1YT09hoOYaImW/mK3sm86xhO5U9GMvCvpPYPuz/IcxcSJ3DEEsbGAipLJ3CsQ6Gckj4jsk2oMy3jbf68olBP+KEZEe+05Qtx1fx+O2bv2/JKkT4P8oUxwMbywSzoZqedZA48IjyO/9wVo36JZHVmHbNU= Received: by 10.66.255.7 with SMTP id c7mr4905529ugi.1174569630182; Thu, 22 Mar 2007 06:20:30 -0700 (PDT) Received: from ?10.200.0.64? ( [81.211.90.3]) by mx.google.com with ESMTP id k30sm3185645ugc.2007.03.22.06.20.28; Thu, 22 Mar 2007 06:20:29 -0700 (PDT) Date: Thu, 22 Mar 2007 16:20:26 +0300 From: "Roman Gorohov. " X-Mailer: The Bat! (v3.62.14) Professional X-Priority: 3 (Normal) Message-ID: <1465093066.20070322162026@gmail.com> To: Oliver Fromme In-Reply-To: <200703211354.l2LDsKnV080911@lurza.secnetix.de> References: <1036039198.20070321153412@gmail.com> <200703211354.l2LDsKnV080911@lurza.secnetix.de> MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Transfer-Encoding: 7bit Cc: Subject: Re[2]: Slow on heavy I/O operations. X-BeenThere: freebsd-performance@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list Reply-To: "roma.a.g" List-Id: Performance/tuning List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 22 Mar 2007 13:20:32 -0000 Hi, Oliver. Thanks for explanations. > Roman Gorohov. wrote: >> Hello list. >> There is a server with FreeBSD FreeBSD 4.11-STABLE(can't upgrade fornow) on HP ProLiant DL140. >> Disk system: at scbus0 target 0 lun0(pass0,da0) on a ASC-29320A. >> If I do: >> [idle@hst ~]#dd if=/dev/zero of=bigfile bs=64k count=5000 >> 5000+0 records in >> 5000+0 records out >> 327680000 bytes transferred in 37.515699 secs (8734477 bytes/sec) >> All is hung while dd working. >> >> Its look like that: >> [idle@hst ~]#systat -v >> skip... >> Disks da0 pass0 pass1 md0 >> KB/t 20.33 0.00 0.00 0.00 >> tps 812 0 0 0 >> MB/s 16.11 0.00 0.00 0.00 >> % busy 100 0 0 0 >> skip... >> >> [idle@hst ~]#vmstat -w 5 >> procs memory page disks faults cpu >> r b w avm fre flt re pi po fr sr da0 md0 in sy cs us sy id >> 1 0 0 1996756 54208 42 23 25 7 39 336 0 0 531 638 404 21 5 74 >> 1 6 0 2011488 13272 571 0 0 1 2506 8 129 0 1356 2125 159 3 4 93 >> 4 27 0 2022852 4228 267 0 0 1 1657 4 272 0 1450 784 96 1 3 96 >> 1 10 0 2027492 40220 449 5 0 12 3257 9384 574 0 1773 4366 189 8 7 85 >> 1 10 0 2035064 25604 746 2 1 7 2965 4466 157 0 1380 4486 184 8 7 85 >> 0 11 0 2030860 4228 515 2 1 3 2098 31 214 0 1412 3077 149 16 5 79 >> 3 14 0 2042792 10004 1014 4 1 5 2787 4432 267 0 1440 1735 118 2 4 94 >> 2 16 0 2062664 4228 301 0 1 2 2843 27 564 0 1759 1250 107 5 4 91 >> >> [idle@hst ~]#iostat -w 5 >> tty da0 pass0 pass1 cpu >> tin tout KB/t tps MB/s KB/t tps MB/s KB/t tps MB/s us ni sy in id >> 0 25 0.00 0 0.00 0.00 0 0.00 0.00 0 0.00 21 0 4 0 74 >> 1 109 62.56 242 14.81 0.00 0 0.00 0.00 0 0.00 7 0 9 0 83 >> 0 101 18.29 433 7.73 0.00 0 0.00 0.00 0 0.00 2 0 2 0 95 >> 0 76 26.45 281 7.25 0.00 0 0.00 0.00 0 0.00 3 0 4 0 93 >> 0 94 15.99 357 5.57 0.00 0 0.00 0.00 0 0.00 2 0 2 0 96 >> 0 15 16.04 667 10.45 0.00 0 0.00 0.00 0 0.00 0 0 3 1 96 >> 0 93 15.99 558 8.71 0.00 0 0.00 0.00 0 0.00 0 0 2 1 97 >> 0 80 16.16 252 3.98 0.00 0 0.00 0.00 0 0.00 0 0 1 0 98 >> 0 117 23.44 240 5.49 0.00 0 0.00 0.00 0 0.00 9 0 6 0 85 >> >> Why this happen? > The numbers from your vmstat output indicate that your > machine is paging ("swapping"), i.e. it's running out > or RAM. That seems like true, and I forget to mention that 2/3 of swap is located at physical disk(da0). [idle@hst ~]#swapinfo Device 1K-blocks Used Avail Capacity Type /dev/da0s1b 524160 463300 60860 88% Interleaved /dev/rvn0b 1048448 578724 469724 55% Interleaved Total 1572608 1042024 530584 66% But what I can't understand - why such non-critical(as it seems to me) disk activity, cause 100% busyness for disk? Its claim to be 40.000MB/s transfers, but sometimes its 100% busy when iostat show only 1 MB/s. Regards, Roman. From owner-freebsd-performance@FreeBSD.ORG Thu Mar 22 13:32:25 2007 Return-Path: X-Original-To: freebsd-performance@freebsd.org Delivered-To: freebsd-performance@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [69.147.83.52]) by hub.freebsd.org (Postfix) with ESMTP id 0D2D816A4D2 for ; Thu, 22 Mar 2007 13:32:25 +0000 (UTC) (envelope-from anderson@freebsd.org) Received: from mh1.centtech.com (moat3.centtech.com [64.129.166.50]) by mx1.freebsd.org (Postfix) with ESMTP id E02B813C44C for ; Thu, 22 Mar 2007 13:32:24 +0000 (UTC) (envelope-from anderson@freebsd.org) Received: from [10.177.171.220] (neutrino.centtech.com [10.177.171.220]) by mh1.centtech.com (8.13.8/8.13.8) with ESMTP id l2MDWNdw048066; Thu, 22 Mar 2007 08:32:24 -0500 (CDT) (envelope-from anderson@freebsd.org) Message-ID: <46028567.8080209@freebsd.org> Date: Thu, 22 Mar 2007 08:32:23 -0500 From: Eric Anderson User-Agent: Thunderbird 1.5.0.10 (X11/20070320) MIME-Version: 1.0 To: "roma.a.g" References: <1036039198.20070321153412@gmail.com> <200703211354.l2LDsKnV080911@lurza.secnetix.de> <1465093066.20070322162026@gmail.com> In-Reply-To: <1465093066.20070322162026@gmail.com> Content-Type: text/plain; charset=ISO-8859-1; format=flowed Content-Transfer-Encoding: 7bit X-Virus-Scanned: ClamAV 0.88.4/2904/Thu Mar 22 06:03:31 2007 on mh1.centtech.com X-Virus-Status: Clean X-Spam-Status: No, score=-2.6 required=8.0 tests=AWL,BAYES_00 autolearn=ham version=3.1.6 X-Spam-Checker-Version: SpamAssassin 3.1.6 (2006-10-03) on mh1.centtech.com Cc: Oliver Fromme Subject: Re: Slow on heavy I/O operations. X-BeenThere: freebsd-performance@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Performance/tuning List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 22 Mar 2007 13:32:25 -0000 On 03/22/07 08:20, Roman Gorohov. wrote: > Hi, Oliver. > Thanks for explanations. > >> Roman Gorohov. wrote: > >> Hello list. > >> There is a server with FreeBSD FreeBSD 4.11-STABLE(can't upgrade fornow) on HP ProLiant DL140. > >> Disk system: at scbus0 target 0 lun0(pass0,da0) on a ASC-29320A. > >> If I do: > >> [idle@hst ~]#dd if=/dev/zero of=bigfile bs=64k count=5000 > >> 5000+0 records in > >> 5000+0 records out > >> 327680000 bytes transferred in 37.515699 secs (8734477 bytes/sec) > >> All is hung while dd working. > >> > >> Its look like that: > >> [idle@hst ~]#systat -v > >> skip... > >> Disks da0 pass0 pass1 md0 > >> KB/t 20.33 0.00 0.00 0.00 > >> tps 812 0 0 0 > >> MB/s 16.11 0.00 0.00 0.00 > >> % busy 100 0 0 0 > >> skip... > >> > >> [idle@hst ~]#vmstat -w 5 > >> procs memory page disks faults cpu > >> r b w avm fre flt re pi po fr sr da0 md0 in sy cs us sy id > >> 1 0 0 1996756 54208 42 23 25 7 39 336 0 0 531 638 404 21 5 74 > >> 1 6 0 2011488 13272 571 0 0 1 2506 8 129 0 1356 2125 159 3 4 93 > >> 4 27 0 2022852 4228 267 0 0 1 1657 4 272 0 1450 784 96 1 3 96 > >> 1 10 0 2027492 40220 449 5 0 12 3257 9384 574 0 1773 4366 189 8 7 85 > >> 1 10 0 2035064 25604 746 2 1 7 2965 4466 157 0 1380 4486 184 8 7 85 > >> 0 11 0 2030860 4228 515 2 1 3 2098 31 214 0 1412 3077 149 16 5 79 > >> 3 14 0 2042792 10004 1014 4 1 5 2787 4432 267 0 1440 1735 118 2 4 94 > >> 2 16 0 2062664 4228 301 0 1 2 2843 27 564 0 1759 1250 107 5 4 91 > >> > >> [idle@hst ~]#iostat -w 5 > >> tty da0 pass0 pass1 cpu > >> tin tout KB/t tps MB/s KB/t tps MB/s KB/t tps MB/s us ni sy in id > >> 0 25 0.00 0 0.00 0.00 0 0.00 0.00 0 0.00 21 0 4 0 74 > >> 1 109 62.56 242 14.81 0.00 0 0.00 0.00 0 0.00 7 0 9 0 83 > >> 0 101 18.29 433 7.73 0.00 0 0.00 0.00 0 0.00 2 0 2 0 95 > >> 0 76 26.45 281 7.25 0.00 0 0.00 0.00 0 0.00 3 0 4 0 93 > >> 0 94 15.99 357 5.57 0.00 0 0.00 0.00 0 0.00 2 0 2 0 96 > >> 0 15 16.04 667 10.45 0.00 0 0.00 0.00 0 0.00 0 0 3 1 96 > >> 0 93 15.99 558 8.71 0.00 0 0.00 0.00 0 0.00 0 0 2 1 97 > >> 0 80 16.16 252 3.98 0.00 0 0.00 0.00 0 0.00 0 0 1 0 98 > >> 0 117 23.44 240 5.49 0.00 0 0.00 0.00 0 0.00 9 0 6 0 85 > >> > >> Why this happen? > >> The numbers from your vmstat output indicate that your >> machine is paging ("swapping"), i.e. it's running out >> or RAM. > > That seems like true, and I forget to mention that 2/3 of swap is > located at physical disk(da0). > [idle@hst ~]#swapinfo > Device 1K-blocks Used Avail Capacity Type > /dev/da0s1b 524160 463300 60860 88% Interleaved > /dev/rvn0b 1048448 578724 469724 55% Interleaved > Total 1572608 1042024 530584 66% > > But what I can't understand - why such non-critical(as it seems to me) disk activity, > cause 100% busyness for disk? Its claim to be 40.000MB/s transfers, but > sometimes its 100% busy when iostat show only 1 MB/s. If the disks are truly busy, then the heads might be wiggling away all your 40MB/s due to seeks. Run gstat and see what it shows also. I don't think you can do any real tests while the machine is swapping, since that will most likely destroy any notion of performance for you. The dd test you did above also isn't that accurate, because you were writing to a file system on the disk, and that can change your performance quite a bit depending on a lot of factors based on the file system. Eric From owner-freebsd-performance@FreeBSD.ORG Thu Mar 22 13:39:37 2007 Return-Path: X-Original-To: freebsd-performance@freebsd.org Delivered-To: freebsd-performance@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [69.147.83.52]) by hub.freebsd.org (Postfix) with ESMTP id 6CA8716A402 for ; Thu, 22 Mar 2007 13:39:37 +0000 (UTC) (envelope-from gofp-freebsd-performance@m.gmane.org) Received: from ciao.gmane.org (main.gmane.org [80.91.229.2]) by mx1.freebsd.org (Postfix) with ESMTP id 2C57F13C455 for ; Thu, 22 Mar 2007 13:39:36 +0000 (UTC) (envelope-from gofp-freebsd-performance@m.gmane.org) Received: from list by ciao.gmane.org with local (Exim 4.43) id 1HUNVp-0000bh-S0 for freebsd-performance@freebsd.org; Thu, 22 Mar 2007 14:39:29 +0100 Received: from 85.114.54.226 ([85.114.54.226]) by main.gmane.org with esmtp (Gmexim 0.1 (Debian)) id 1AlnuQ-0007hv-00 for ; Thu, 22 Mar 2007 14:39:29 +0100 Received: from ivoras by 85.114.54.226 with local (Gmexim 0.1 (Debian)) id 1AlnuQ-0007hv-00 for ; Thu, 22 Mar 2007 14:39:29 +0100 X-Injected-Via-Gmane: http://gmane.org/ To: freebsd-performance@freebsd.org From: Ivan Voras Date: Thu, 22 Mar 2007 14:39:33 +0100 Lines: 9 Message-ID: References: <1036039198.20070321153412@gmail.com> <200703211354.l2LDsKnV080911@lurza.secnetix.de> <1465093066.20070322162026@gmail.com> Mime-Version: 1.0 Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: 7bit X-Complaints-To: usenet@sea.gmane.org X-Gmane-NNTP-Posting-Host: 85.114.54.226 User-Agent: Thunderbird 1.5.0.10 (Windows/20070221) In-Reply-To: <1465093066.20070322162026@gmail.com> X-Enigmail-Version: 0.94.1.0 Sender: news Subject: Re: Slow on heavy I/O operations. X-BeenThere: freebsd-performance@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Performance/tuning List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 22 Mar 2007 13:39:37 -0000 Roman Gorohov. wrote: > But what I can't understand - why such non-critical(as it seems to me) disk activity, > cause 100% busyness for disk? Its claim to be 40.000MB/s transfers, but > sometimes its 100% busy when iostat show only 1 MB/s. Because disk seeks count. If you have a lot of small transactions that need seeks they'll kill performance (try running "find /" - you'll get ~500 kB/s rate and 100% busy disks). From owner-freebsd-performance@FreeBSD.ORG Thu Mar 22 13:43:56 2007 Return-Path: X-Original-To: freebsd-performance@FreeBSD.ORG Delivered-To: freebsd-performance@FreeBSD.ORG Received: from mx1.freebsd.org (mx1.freebsd.org [69.147.83.52]) by hub.freebsd.org (Postfix) with ESMTP id 4A01916A400 for ; Thu, 22 Mar 2007 13:43:56 +0000 (UTC) (envelope-from cheffo@FreeBSD-BG.org) Received: from blah.sun-fish.com (blah.sun-fish.com [217.18.249.150]) by mx1.freebsd.org (Postfix) with ESMTP id 04A7B13C468 for ; Thu, 22 Mar 2007 13:43:53 +0000 (UTC) (envelope-from cheffo@FreeBSD-BG.org) Received: from blah.sun-fish.com (localhost [127.0.0.1]) by blah.sun-fish.com (Postfix) with ESMTP id F35181B10F02; Thu, 22 Mar 2007 14:43:52 +0100 (CET) Received: from [192.168.3.125] (hater.cmotd.com [192.168.3.125]) by blah.sun-fish.com (Postfix) with ESMTP id ED8711B10EA4; Thu, 22 Mar 2007 14:43:52 +0100 (CET) Message-ID: <46028813.5030209@FreeBSD-BG.org> Date: Thu, 22 Mar 2007 15:43:47 +0200 From: Cheffo User-Agent: Thunderbird 1.5.0.10 (X11/20070307) MIME-Version: 1.0 To: "roma.a.g" References: <1036039198.20070321153412@gmail.com> <200703211354.l2LDsKnV080911@lurza.secnetix.de> <1465093066.20070322162026@gmail.com> In-Reply-To: <1465093066.20070322162026@gmail.com> Content-Type: text/plain; charset=windows-1251; format=flowed Content-Transfer-Encoding: 7bit X-Virus-Scanned: ClamAV using ClamSMTP on BLAH Cc: freebsd-performance@FreeBSD.ORG Subject: Re: Slow on heavy I/O operations. X-BeenThere: freebsd-performance@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Performance/tuning List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 22 Mar 2007 13:43:56 -0000 Roman Gorohov. wrote: -CUT- > > That seems like true, and I forget to mention that 2/3 of swap is > located at physical disk(da0). > [idle@hst ~]#swapinfo > Device 1K-blocks Used Avail Capacity Type > /dev/da0s1b 524160 463300 60860 88% Interleaved > /dev/rvn0b 1048448 578724 469724 55% Interleaved > Total 1572608 1042024 530584 66% > > But what I can't understand - why such non-critical(as it seems to me) disk activity, > cause 100% busyness for disk? Its claim to be 40.000MB/s transfers, but > sometimes its 100% busy when iostat show only 1 MB/s. > > Regards, Roman. Imagine 1000 request per second and every request is 1KB, and compare it with a single request that is 1MB. In first variant your disk will be 100% busy and in the second 2-3%. I think you can guess why ? > > _______________________________________________ > freebsd-performance@freebsd.org mailing list > http://lists.freebsd.org/mailman/listinfo/freebsd-performance > To unsubscribe, send any mail to "freebsd-performance-unsubscribe@freebsd.org" > > -- Best Wishes, Stefan Lambrev ICQ# 24134177 From owner-freebsd-performance@FreeBSD.ORG Thu Mar 22 17:46:33 2007 Return-Path: X-Original-To: freebsd-performance@freebsd.org Delivered-To: freebsd-performance@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [69.147.83.52]) by hub.freebsd.org (Postfix) with ESMTP id 1829E16A408 for ; Thu, 22 Mar 2007 17:46:33 +0000 (UTC) (envelope-from list@deeboz.ca) Received: from deeboz.ca (S0106000102685618.cg.shawcable.net [68.147.195.40]) by mx1.freebsd.org (Postfix) with ESMTP id 01A6213C4DA for ; Thu, 22 Mar 2007 17:46:32 +0000 (UTC) (envelope-from list@deeboz.ca) Received: by deeboz.ca (Postfix, from userid 1001) id 73426F8B0FB; Thu, 22 Mar 2007 10:16:02 -0700 (MST) Date: Thu, 22 Mar 2007 10:16:02 -0700 From: Sally Janghos To: freebsd-performance@freebsd.org Message-ID: <20070322171602.GA71746@deeboz.ca> Mime-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline User-Agent: Mutt/1.4.2.2i Subject: Where to troubleshoot Intel PRO/1000 performance problems? X-BeenThere: freebsd-performance@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Performance/tuning List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 22 Mar 2007 17:46:33 -0000 I'm looking for some suggestions on where to start troubleshooting performance issues on a Intel PRO 1000 card. It's installed in a box with the following configuration: FreeBSD 6.1 AMD Athlon(tm) XP 2100+ (1741.42-MHz 686-class CPU) Dell CERC SATA RAID 2 The file transfer(ftp/smb/scp) speeds from/to this machine do not appear to go above 10Mb. The other machine doing the transfers has similar specs(same Ethernet Card) but is a Windows XP box. I've tried replacing the switch with a crossover cable between the machines and the same speed persists. Any suggestions on where to start and what tools should I use to do the benchmarks? Thanks, Sally From owner-freebsd-performance@FreeBSD.ORG Thu Mar 22 21:31:34 2007 Return-Path: X-Original-To: freebsd-performance@freebsd.org Delivered-To: freebsd-performance@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [69.147.83.52]) by hub.freebsd.org (Postfix) with ESMTP id 8E69416A401 for ; Thu, 22 Mar 2007 21:31:34 +0000 (UTC) (envelope-from freebsd@sopwith.solgatos.com) Received: from schitzo.solgatos.com (pool-71-245-104-192.ptldor.fios.verizon.net [71.245.104.192]) by mx1.freebsd.org (Postfix) with ESMTP id 5664513C489 for ; Thu, 22 Mar 2007 21:31:34 +0000 (UTC) (envelope-from freebsd@sopwith.solgatos.com) Received: from schitzo.solgatos.com (localhost.home.localnet [127.0.0.1]) by schitzo.solgatos.com (8.13.8/8.13.6) with ESMTP id l2MLBkXG030653 for ; Thu, 22 Mar 2007 14:11:46 -0700 Received: from sopwith.solgatos.com (uucp@localhost) by schitzo.solgatos.com (8.13.8/8.13.4/Submit) with UUCP id l2MLBkVf030648 for freebsd-performance@freebsd.org; Thu, 22 Mar 2007 14:11:46 -0700 Received: from localhost by sopwith.solgatos.com (8.8.8/6.24) id VAA29654; Thu, 22 Mar 2007 21:02:20 GMT Message-Id: <200703222102.VAA29654@sopwith.solgatos.com> To: freebsd-performance@freebsd.org Date: Thu, 22 Mar 2007 14:02:20 +0100 From: Dieter X-Mailman-Approved-At: Thu, 22 Mar 2007 21:33:33 +0000 Subject: Re: Slow on heavy I/O operations. X-BeenThere: freebsd-performance@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list Reply-To: freebsd@sopwith.solgatos.com List-Id: Performance/tuning List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 22 Mar 2007 21:31:34 -0000 > But what I can't understand - why such non-critical(as it seems to me) > disk activity, cause 100% busyness for disk? Others have pointed out the effect of seeking. It would be very useful if there was a way to nice I/O up or down the way we can nice CPU usage up or down. Then non-critical disk activity could be niced down and not impact critical I/O so much. From owner-freebsd-performance@FreeBSD.ORG Fri Mar 23 08:07:40 2007 Return-Path: X-Original-To: freebsd-performance@freebsd.org Delivered-To: freebsd-performance@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [69.147.83.52]) by hub.freebsd.org (Postfix) with ESMTP id 03FE116A402 for ; Fri, 23 Mar 2007 08:07:40 +0000 (UTC) (envelope-from rea-fbsd@codelabs.ru) Received: from pobox.codelabs.ru (pobox.codelabs.ru [144.206.177.45]) by mx1.freebsd.org (Postfix) with ESMTP id B147413C483 for ; Fri, 23 Mar 2007 08:07:39 +0000 (UTC) (envelope-from rea-fbsd@codelabs.ru) DomainKey-Signature: a=rsa-sha1; q=dns; c=simple; s=one; d=codelabs.ru; h=Received:Date:From:To:Cc:Message-ID:References:MIME-Version:Content-Type:Content-Disposition:In-Reply-To:Sender:X-Spam-Status:Subject; b=Tc3Abi3iT7F9Akf2zlpQxq9fnr6r/s2bhmAp9N+H/RQdCN9TbiZAN+SH0l22ebz3wHQWsY7VUSs0oWUmSl9QxiNZJLKEMi4j6yKe861VhMc/PBQyLJHHgUjz4o4kpKqgv8/cp0VEe3+TGGcyAE3WtnqBwri0pYOJ8NvLsjxaj9I=; Received: from codelabs.ru (pobox.codelabs.ru [144.206.177.45]) by pobox.codelabs.ru with esmtpsa (TLSv1:AES256-SHA:256) id 1HUeVD-0007gN-4W; Fri, 23 Mar 2007 10:47:59 +0300 Date: Fri, 23 Mar 2007 10:47:54 +0300 From: Eygene Ryabinkin To: Sally Janghos Message-ID: <20070323072959.GX14837@codelabs.ru> References: <20070322171602.GA71746@deeboz.ca> MIME-Version: 1.0 Content-Type: text/plain; charset=koi8-r Content-Disposition: inline In-Reply-To: <20070322171602.GA71746@deeboz.ca> Sender: rea-fbsd@codelabs.ru X-Spam-Status: No, score=-2.2 required=4.0 tests=ALL_TRUSTED,AWL,BAYES_40 Cc: freebsd-performance@freebsd.org Subject: Re: Where to troubleshoot Intel PRO/1000 performance problems? X-BeenThere: freebsd-performance@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Performance/tuning List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 23 Mar 2007 08:07:40 -0000 Sally, good day. Thu, Mar 22, 2007 at 10:16:02AM -0700, Sally Janghos wrote: > I'm looking for some suggestions on where to start troubleshooting > performance issues on a Intel PRO 1000 card. > > It's installed in a box with the following configuration: > FreeBSD 6.1 > AMD Athlon(tm) XP 2100+ (1741.42-MHz 686-class CPU) > Dell CERC SATA RAID 2 > > The file transfer(ftp/smb/scp) speeds from/to this machine do not > appear to go above 10Mb. Assuming that you're talking about MBytes/sec there is a chance that your network link is using 100 MBit/sec full-duplex mode instead of 1Gbit/sec. Try to do 'ifconfig | grep media' on the FreeBSD box and watch for the speed regime specification. > The other machine doing the transfers has similar specs (same > Ethernet Card) but is a Windows XP box. Windows should report the interface speed too: unplug the cable, plug it again and watch for the fancy popup on the taskbar. Or check the interface properties box. -- Eygene From owner-freebsd-performance@FreeBSD.ORG Fri Mar 23 17:58:40 2007 Return-Path: X-Original-To: freebsd-performance@freebsd.org Delivered-To: freebsd-performance@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [69.147.83.52]) by hub.freebsd.org (Postfix) with ESMTP id 56FC816A400 for ; Fri, 23 Mar 2007 17:58:40 +0000 (UTC) (envelope-from list@deeboz.ca) Received: from deeboz.ca (S0106000102685618.cg.shawcable.net [68.147.195.40]) by mx1.freebsd.org (Postfix) with ESMTP id 3AFDF13C468 for ; Fri, 23 Mar 2007 17:58:38 +0000 (UTC) (envelope-from list@deeboz.ca) Received: by deeboz.ca (Postfix, from userid 1001) id 83CA9F8B0A6; Fri, 23 Mar 2007 10:58:38 -0700 (MST) Date: Fri, 23 Mar 2007 10:58:38 -0700 From: Sally Janghos To: Eygene Ryabinkin Message-ID: <20070323175838.GA94047@deeboz.ca> References: <20070322171602.GA71746@deeboz.ca> <20070323072959.GX14837@codelabs.ru> Mime-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: <20070323072959.GX14837@codelabs.ru> User-Agent: Mutt/1.4.2.2i Cc: freebsd-performance@freebsd.org Subject: Re: Where to troubleshoot Intel PRO/1000 performance problems? X-BeenThere: freebsd-performance@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Performance/tuning List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 23 Mar 2007 17:58:40 -0000 Eygene, Both machines are reporting a 1Gb link: media: Ethernet autoselect (1000baseTX ) Thanks for you help though. On Fri, Mar 23, 2007 at 10:47:54AM +0300, Eygene Ryabinkin wrote: > Sally, good day. > > Thu, Mar 22, 2007 at 10:16:02AM -0700, Sally Janghos wrote: > > I'm looking for some suggestions on where to start troubleshooting > > performance issues on a Intel PRO 1000 card. > > > > It's installed in a box with the following configuration: > > FreeBSD 6.1 > > AMD Athlon(tm) XP 2100+ (1741.42-MHz 686-class CPU) > > Dell CERC SATA RAID 2 > > > > The file transfer(ftp/smb/scp) speeds from/to this machine do not > > appear to go above 10Mb. > > Assuming that you're talking about MBytes/sec there is a chance > that your network link is using 100 MBit/sec full-duplex mode instead > of 1Gbit/sec. Try to do 'ifconfig | grep media' on the FreeBSD box > and watch for the speed regime specification. > > > The other machine doing the transfers has similar specs (same > > Ethernet Card) but is a Windows XP box. > > Windows should report the interface speed too: unplug the cable, plug it > again and watch for the fancy popup on the taskbar. Or check the interface > properties box. > -- > Eygene From owner-freebsd-performance@FreeBSD.ORG Fri Mar 23 18:14:37 2007 Return-Path: X-Original-To: freebsd-performance@freebsd.org Delivered-To: freebsd-performance@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [69.147.83.52]) by hub.freebsd.org (Postfix) with ESMTP id E75BE16A401 for ; Fri, 23 Mar 2007 18:14:37 +0000 (UTC) (envelope-from list@deeboz.ca) Received: from deeboz.ca (S0106000102685618.cg.shawcable.net [68.147.195.40]) by mx1.freebsd.org (Postfix) with ESMTP id C9DC013C469 for ; Fri, 23 Mar 2007 18:14:37 +0000 (UTC) (envelope-from list@deeboz.ca) Received: by deeboz.ca (Postfix, from userid 1001) id 27AB7F8B0B8; Fri, 23 Mar 2007 11:14:37 -0700 (MST) Date: Fri, 23 Mar 2007 11:14:37 -0700 From: Sally Janghos To: Aaron Seelye Message-ID: <20070323181437.GA94251@deeboz.ca> References: <006101c76cda$313892d0$da11e00a@Seelye> Mime-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: <006101c76cda$313892d0$da11e00a@Seelye> User-Agent: Mutt/1.4.2.2i Cc: freebsd-performance@freebsd.org Subject: Re: Where to troubleshoot Intel PRO/1000 performance problems? X-BeenThere: freebsd-performance@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Performance/tuning List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 23 Mar 2007 18:14:38 -0000 Aaron, Thanks for your reply. Here is some output from some dd's on the disk that I'm reading/writing to. > dd if=/dev/zero of=testfile count=1000000;dd if=testfile of=/dev/null 1000000+0 records in 1000000+0 records out 512000000 bytes transferred in 27.951769 secs (18317267 bytes/sec) 1000000+0 records in 1000000+0 records out 512000000 bytes transferred in 16.864945 secs (30358830 bytes/sec) > dd if=/dev/zero of=testfile count=1000000 ; dd if=testfile of=/dev/null 1000000+0 records in 1000000+0 records out 512000000 bytes transferred in 28.492921 secs (17969376 bytes/sec) 1000000+0 records in 1000000+0 records out 512000000 bytes transferred in 16.605797 secs (30832607 bytes/sec) Am I reading right, the max network transfer rate from this disk will be between 143Mbit and 246Mbit/sec? Is there a way to determine if there is an IRQ conflict? How do you find out what IRQ's are currently used by the system? Sally Thu, Mar 22, 2007 at 04:31:16PM -0700, Aaron Seelye wrote: > If it's platform agnostic, I'd start looking for IRQ conflicts. It would > seems that your test all involve disk io, check that first and narrow down > that it's a network or disk problem. You may have a bum raid card, irq > conflict on the network card, any number of things. > > -Aaron > ----- Original Message ----- > From: "Sally Janghos" > To: > Sent: Thursday, March 22, 2007 10:16 AM > Subject: Where to troubleshoot Intel PRO/1000 performance problems? > > > >I'm looking for some suggestions on where to start troubleshooting > >performance issues on a Intel PRO 1000 card. > > > >It's installed in a box with the following configuration: > >FreeBSD 6.1 > >AMD Athlon(tm) XP 2100+ (1741.42-MHz 686-class CPU) > >Dell CERC SATA RAID 2 > > > >The file transfer(ftp/smb/scp) speeds from/to this machine do not appear > >to go above 10Mb. The other machine > >doing the transfers has similar specs(same Ethernet Card) but is a Windows > >XP box. I've tried replacing the switch with > >a crossover cable between the machines and the same speed persists. Any > >suggestions on where to start and what tools > >should I use to do the benchmarks? > > > >Thanks, > > Sally > >_______________________________________________ > >freebsd-performance@freebsd.org mailing list > >http://lists.freebsd.org/mailman/listinfo/freebsd-performance > >To unsubscribe, send any mail to > >"freebsd-performance-unsubscribe@freebsd.org" > > > > > >-- > >No virus found in this incoming message. > >Checked by AVG Free Edition. > >Version: 7.5.446 / Virus Database: 268.18.17/730 - Release Date: 3/22/2007 > >7:44 AM > > > > > From owner-freebsd-performance@FreeBSD.ORG Fri Mar 23 18:25:42 2007 Return-Path: X-Original-To: freebsd-performance@freebsd.org Delivered-To: freebsd-performance@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [69.147.83.52]) by hub.freebsd.org (Postfix) with ESMTP id 6BC5A16A400 for ; Fri, 23 Mar 2007 18:25:42 +0000 (UTC) (envelope-from wmoran@collaborativefusion.com) Received: from mx00.pub.collaborativefusion.com (mx00.pub.collaborativefusion.com [206.210.89.199]) by mx1.freebsd.org (Postfix) with ESMTP id 419CA13C45D for ; Fri, 23 Mar 2007 18:25:42 +0000 (UTC) (envelope-from wmoran@collaborativefusion.com) Received: from vanquish.pgh.priv.collaborativefusion.com (vanquish.pgh.priv.collaborativefusion.com [192.168.2.61]) (SSL: TLSv1/SSLv3,256bits,AES256-SHA) by wingspan with esmtp; Fri, 23 Mar 2007 14:13:51 -0400 id 00056496.460418DF.00005242 Date: Fri, 23 Mar 2007 14:13:51 -0400 From: Bill Moran To: Sally Janghos Message-Id: <20070323141351.148b15e0.wmoran@collaborativefusion.com> In-Reply-To: <20070323175838.GA94047@deeboz.ca> References: <20070322171602.GA71746@deeboz.ca> <20070323072959.GX14837@codelabs.ru> <20070323175838.GA94047@deeboz.ca> Organization: Collaborative Fusion X-Mailer: Sylpheed 2.3.1 (GTK+ 2.10.11; i386-portbld-freebsd6.1) Mime-Version: 1.0 Content-Type: text/plain; charset=US-ASCII Content-Transfer-Encoding: 7bit Cc: freebsd-performance@freebsd.org Subject: Re: Where to troubleshoot Intel PRO/1000 performance problems? X-BeenThere: freebsd-performance@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Performance/tuning List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 23 Mar 2007 18:25:42 -0000 In response to Sally Janghos : > Eygene, > > Both machines are reporting a 1Gb link: > media: Ethernet autoselect (1000baseTX ) > > Thanks for you help though. There are a lot of things that can go wrong to cause these types of problems. Some of the more common I've seen that you didn't provide enough information for me to guess at: *) Some switches suck. Some gigabit switches don't really move data faster than 100mbit. Some incorrectly negotiate the speed/duplex. I understand that the FreeBSD side is correct, but I've seen the _switch_ side be incorrect, which causes all manner of lousy performance. *) Your testing methodology is flawed. You sure the machine you're testing against can do gb/s? Are you sure whatever is providing the data can feed it at gb/s? This is a very common mistake as well. Since you don't describe your testing methodology, I can only speculate. > > > On Fri, Mar 23, 2007 at 10:47:54AM +0300, Eygene Ryabinkin wrote: > > Sally, good day. > > > > Thu, Mar 22, 2007 at 10:16:02AM -0700, Sally Janghos wrote: > > > I'm looking for some suggestions on where to start troubleshooting > > > performance issues on a Intel PRO 1000 card. > > > > > > It's installed in a box with the following configuration: > > > FreeBSD 6.1 > > > AMD Athlon(tm) XP 2100+ (1741.42-MHz 686-class CPU) > > > Dell CERC SATA RAID 2 > > > > > > The file transfer(ftp/smb/scp) speeds from/to this machine do not > > > appear to go above 10Mb. > > > > Assuming that you're talking about MBytes/sec there is a chance > > that your network link is using 100 MBit/sec full-duplex mode instead > > of 1Gbit/sec. Try to do 'ifconfig | grep media' on the FreeBSD box > > and watch for the speed regime specification. > > > > > The other machine doing the transfers has similar specs (same > > > Ethernet Card) but is a Windows XP box. > > > > Windows should report the interface speed too: unplug the cable, plug it > > again and watch for the fancy popup on the taskbar. Or check the interface > > properties box. > > -- > > Eygene > _______________________________________________ > freebsd-performance@freebsd.org mailing list > http://lists.freebsd.org/mailman/listinfo/freebsd-performance > To unsubscribe, send any mail to "freebsd-performance-unsubscribe@freebsd.org" > > > > > > -- Bill Moran Collaborative Fusion Inc. wmoran@collaborativefusion.com Phone: 412-422-3463x4023 **************************************************************** IMPORTANT: This message contains confidential information and is intended only for the individual named. If the reader of this message is not an intended recipient (or the individual responsible for the delivery of this message to an intended recipient), please be advised that any re-use, dissemination, distribution or copying of this message is prohibited. Please notify the sender immediately by e-mail if you have received this e-mail by mistake and delete this e-mail from your system. E-mail transmission cannot be guaranteed to be secure or error-free as information could be intercepted, corrupted, lost, destroyed, arrive late or incomplete, or contain viruses. The sender therefore does not accept liability for any errors or omissions in the contents of this message, which arise as a result of e-mail transmission. **************************************************************** From owner-freebsd-performance@FreeBSD.ORG Fri Mar 23 19:58:57 2007 Return-Path: X-Original-To: freebsd-performance@freebsd.org Delivered-To: freebsd-performance@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [69.147.83.52]) by hub.freebsd.org (Postfix) with ESMTP id A36CE16A40D for ; Fri, 23 Mar 2007 19:58:57 +0000 (UTC) (envelope-from aseelye-lists@eltopia.com) Received: from MAILSCAN1.sslisp.com (lb.sslisp.com [209.213.12.74]) by mx1.freebsd.org (Postfix) with ESMTP id 0F91413C4F3 for ; Fri, 23 Mar 2007 19:58:56 +0000 (UTC) (envelope-from aseelye-lists@eltopia.com) Received: from Seelye (unverified [71.115.197.183]) by MAILSCAN1.sslisp.com (Vircom SMTPRS 4.4.568.0) with ESMTP id ; Fri, 23 Mar 2007 12:48:33 -0700 X-Modus-BlackList: 71.115.197.183=OK;aseelye-lists@eltopia.com=OK X-Modus-RBL: 71.115.197.183=OK X-Modus-Trusted: 71.115.197.183=NO X-Modus-Audit: FALSE;0;0;0 Message-ID: <007801c76d84$3f268c30$a001a8c0@Seelye> From: "Aaron Seelye" To: "Sally Janghos" References: <006101c76cda$313892d0$da11e00a@Seelye> 20070323181437.GA94251@deeboz.ca Date: Fri, 23 Mar 2007 12:48:34 -0700 MIME-Version: 1.0 Content-Type: text/plain; format=flowed; charset="iso-8859-1"; reply-type=original Content-Transfer-Encoding: 7bit X-Priority: 3 X-MSMail-Priority: Normal X-Mailer: Microsoft Outlook Express 6.00.2900.3028 X-MimeOLE: Produced By Microsoft MimeOLE V6.00.2900.3028 Cc: freebsd-performance@freebsd.org Subject: Re: Where to troubleshoot Intel PRO/1000 performance problems? X-BeenThere: freebsd-performance@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Performance/tuning List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 23 Mar 2007 19:58:57 -0000 So how about any irq conflicts? tried netcat from this machine to another and vice versa? duplexing/cabling problems? ----- Original Message ----- From: "Sally Janghos" To: "Aaron Seelye" Cc: Sent: Friday, March 23, 2007 11:14 AM Subject: Re: Where to troubleshoot Intel PRO/1000 performance problems? > Aaron, > > Thanks for your reply. Here is some output from some dd's on the disk > that I'm reading/writing to. > >> dd if=/dev/zero of=testfile count=1000000;dd if=testfile of=/dev/null > 1000000+0 records in > 1000000+0 records out > 512000000 bytes transferred in 27.951769 secs (18317267 bytes/sec) > 1000000+0 records in > 1000000+0 records out > 512000000 bytes transferred in 16.864945 secs (30358830 bytes/sec) >> dd if=/dev/zero of=testfile count=1000000 ; dd if=testfile of=/dev/null > 1000000+0 records in > 1000000+0 records out > 512000000 bytes transferred in 28.492921 secs (17969376 bytes/sec) > 1000000+0 records in > 1000000+0 records out > 512000000 bytes transferred in 16.605797 secs (30832607 bytes/sec) > > Am I reading right, the max network transfer rate from this disk will be > between 143Mbit and 246Mbit/sec? Is there a way to determine if there is > an IRQ conflict? How do you find out what IRQ's are currently used by the > system? > > Sally > > Thu, Mar 22, 2007 at 04:31:16PM -0700, Aaron Seelye wrote: >> If it's platform agnostic, I'd start looking for IRQ conflicts. It would >> seems that your test all involve disk io, check that first and narrow >> down >> that it's a network or disk problem. You may have a bum raid card, irq >> conflict on the network card, any number of things. >> >> -Aaron >> ----- Original Message ----- >> From: "Sally Janghos" >> To: >> Sent: Thursday, March 22, 2007 10:16 AM >> Subject: Where to troubleshoot Intel PRO/1000 performance problems? >> >> >> >I'm looking for some suggestions on where to start troubleshooting >> >performance issues on a Intel PRO 1000 card. >> > >> >It's installed in a box with the following configuration: >> >FreeBSD 6.1 >> >AMD Athlon(tm) XP 2100+ (1741.42-MHz 686-class CPU) >> >Dell CERC SATA RAID 2 >> > >> >The file transfer(ftp/smb/scp) speeds from/to this machine do not appear >> >to go above 10Mb. The other machine >> >doing the transfers has similar specs(same Ethernet Card) but is a >> >Windows >> >XP box. I've tried replacing the switch with >> >a crossover cable between the machines and the same speed persists. Any >> >suggestions on where to start and what tools >> >should I use to do the benchmarks? >> > >> >Thanks, >> > Sally >> >_______________________________________________ >> >freebsd-performance@freebsd.org mailing list >> >http://lists.freebsd.org/mailman/listinfo/freebsd-performance >> >To unsubscribe, send any mail to >> >"freebsd-performance-unsubscribe@freebsd.org" >> > >> > >> >-- >> >No virus found in this incoming message. >> >Checked by AVG Free Edition. >> >Version: 7.5.446 / Virus Database: 268.18.17/730 - Release Date: >> >3/22/2007 >> >7:44 AM >> > >> > >> > > > -- > No virus found in this incoming message. > Checked by AVG Free Edition. > Version: 7.5.446 / Virus Database: 268.18.17/730 - Release Date: 3/22/2007 > 7:44 AM > > From owner-freebsd-performance@FreeBSD.ORG Fri Mar 23 20:49:15 2007 Return-Path: X-Original-To: freebsd-performance@freebsd.org Delivered-To: freebsd-performance@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [69.147.83.52]) by hub.freebsd.org (Postfix) with ESMTP id 8F9F516A401 for ; Fri, 23 Mar 2007 20:49:15 +0000 (UTC) (envelope-from gofp-freebsd-performance@m.gmane.org) Received: from ciao.gmane.org (main.gmane.org [80.91.229.2]) by mx1.freebsd.org (Postfix) with ESMTP id 203E913C45A for ; Fri, 23 Mar 2007 20:49:14 +0000 (UTC) (envelope-from gofp-freebsd-performance@m.gmane.org) Received: from list by ciao.gmane.org with local (Exim 4.43) id 1HUqh4-0002s6-N2 for freebsd-performance@freebsd.org; Fri, 23 Mar 2007 21:49:02 +0100 Received: from 89-172-37-14.adsl.net.t-com.hr ([89.172.37.14]) by main.gmane.org with esmtp (Gmexim 0.1 (Debian)) id 1AlnuQ-0007hv-00 for ; Fri, 23 Mar 2007 21:49:02 +0100 Received: from ivoras by 89-172-37-14.adsl.net.t-com.hr with local (Gmexim 0.1 (Debian)) id 1AlnuQ-0007hv-00 for ; Fri, 23 Mar 2007 21:49:02 +0100 X-Injected-Via-Gmane: http://gmane.org/ To: freebsd-performance@freebsd.org From: Ivan Voras Date: Fri, 23 Mar 2007 21:48:36 +0100 Lines: 42 Message-ID: References: <20070322171602.GA71746@deeboz.ca> Mime-Version: 1.0 Content-Type: multipart/signed; micalg=pgp-sha1; protocol="application/pgp-signature"; boundary="------------enig9DC77594AE2DBAA22CF8C969" X-Complaints-To: usenet@sea.gmane.org X-Gmane-NNTP-Posting-Host: 89-172-37-14.adsl.net.t-com.hr User-Agent: Thunderbird 1.5.0.10 (Windows/20070221) In-Reply-To: <20070322171602.GA71746@deeboz.ca> X-Enigmail-Version: 0.94.1.2 Sender: news Subject: Re: Where to troubleshoot Intel PRO/1000 performance problems? X-BeenThere: freebsd-performance@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Performance/tuning List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 23 Mar 2007 20:49:15 -0000 This is an OpenPGP/MIME signed message (RFC 2440 and 3156) --------------enig9DC77594AE2DBAA22CF8C969 Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: quoted-printable Sally Janghos wrote: > I'm looking for some suggestions on where to start troubleshooting perf= ormance issues on a Intel PRO 1000 card. >=20 > It's installed in a box with the following configuration: > FreeBSD 6.1 > AMD Athlon(tm) XP 2100+ (1741.42-MHz 686-class CPU) > Dell CERC SATA RAID 2 >=20 > The file transfer(ftp/smb/scp) speeds from/to this machine do not appea= r to go above 10Mb. The other machine > doing the transfers has similar specs(same Ethernet Card) but is a Wind= ows XP box. I've tried replacing the switch with > a crossover cable between the machines and the same speed persists. An= y suggestions on where to start and what tools > should I use to do the benchmarks? As a general rule you should update to 6.1 to get the latest fixes. Try using iperf (ports/benchmarks/iperf) - I don't know if it's available for Windows, though. --------------enig9DC77594AE2DBAA22CF8C969 Content-Type: application/pgp-signature; name="signature.asc" Content-Description: OpenPGP digital signature Content-Disposition: attachment; filename="signature.asc" -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.4.4 (MingW32) Comment: Using GnuPG with Mozilla - http://enigmail.mozdev.org iD8DBQFGBD0qldnAQVacBcgRAlPdAJ0eMDjeHwkWxRy8AO1RQ+y/lLOYqACdE0Na GM/iVnJZVdouNobZEbtTBNc= =v4+r -----END PGP SIGNATURE----- --------------enig9DC77594AE2DBAA22CF8C969--