From owner-freebsd-performance@FreeBSD.ORG Thu Mar 22 13:20:32 2007 Return-Path: X-Original-To: freebsd-performance@freebsd.org Delivered-To: freebsd-performance@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [69.147.83.52]) by hub.freebsd.org (Postfix) with ESMTP id 6628E16A400 for ; Thu, 22 Mar 2007 13:20:32 +0000 (UTC) (envelope-from roma.a.g@gmail.com) Received: from ug-out-1314.google.com (ug-out-1314.google.com [66.249.92.174]) by mx1.freebsd.org (Postfix) with ESMTP id 57CC813C4B9 for ; Thu, 22 Mar 2007 13:20:31 +0000 (UTC) (envelope-from roma.a.g@gmail.com) Received: by ug-out-1314.google.com with SMTP id 71so683137ugh for ; Thu, 22 Mar 2007 06:20:30 -0700 (PDT) DKIM-Signature: a=rsa-sha1; c=relaxed/relaxed; d=gmail.com; s=beta; h=domainkey-signature:received:received:date:from:x-mailer:reply-to:x-priority:message-id:to:subject:in-reply-to:references:mime-version:content-type:content-transfer-encoding; b=gPWh6stl1B8+T9cC3t6IS6CAgR075Dkrk52RZuBJ2Fb/LuDZrdmWtz1dDVMpNQy0aLk5sp378nZUTm+V1WyBdgjLUcm8dq5f/lzKVYr3smUVeeCV8glNjjMKWeKTrxu1+k8tpY3fT3RAAdwPAYxINo23bs5P6HmHmY5+toq+Ri8= DomainKey-Signature: a=rsa-sha1; c=nofws; d=gmail.com; s=beta; h=received:date:from:x-mailer:reply-to:x-priority:message-id:to:subject:in-reply-to:references:mime-version:content-type:content-transfer-encoding; b=ioPlPtz+v4Q9OL//+vi1YT09hoOYaImW/mK3sm86xhO5U9GMvCvpPYPuz/IcxcSJ3DEEsbGAipLJ3CsQ6Gckj4jsk2oMy3jbf68olBP+KEZEe+05Qtx1fx+O2bv2/JKkT4P8oUxwMbywSzoZqedZA48IjyO/9wVo36JZHVmHbNU= Received: by 10.66.255.7 with SMTP id c7mr4905529ugi.1174569630182; Thu, 22 Mar 2007 06:20:30 -0700 (PDT) Received: from ?10.200.0.64? ( [81.211.90.3]) by mx.google.com with ESMTP id k30sm3185645ugc.2007.03.22.06.20.28; Thu, 22 Mar 2007 06:20:29 -0700 (PDT) Date: Thu, 22 Mar 2007 16:20:26 +0300 From: "Roman Gorohov. " X-Mailer: The Bat! (v3.62.14) Professional X-Priority: 3 (Normal) Message-ID: <1465093066.20070322162026@gmail.com> To: Oliver Fromme In-Reply-To: <200703211354.l2LDsKnV080911@lurza.secnetix.de> References: <1036039198.20070321153412@gmail.com> <200703211354.l2LDsKnV080911@lurza.secnetix.de> MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Transfer-Encoding: 7bit Cc: Subject: Re[2]: Slow on heavy I/O operations. X-BeenThere: freebsd-performance@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list Reply-To: "roma.a.g" List-Id: Performance/tuning List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 22 Mar 2007 13:20:32 -0000 Hi, Oliver. Thanks for explanations. > Roman Gorohov. wrote: >> Hello list. >> There is a server with FreeBSD FreeBSD 4.11-STABLE(can't upgrade fornow) on HP ProLiant DL140. >> Disk system: at scbus0 target 0 lun0(pass0,da0) on a ASC-29320A. >> If I do: >> [idle@hst ~]#dd if=/dev/zero of=bigfile bs=64k count=5000 >> 5000+0 records in >> 5000+0 records out >> 327680000 bytes transferred in 37.515699 secs (8734477 bytes/sec) >> All is hung while dd working. >> >> Its look like that: >> [idle@hst ~]#systat -v >> skip... >> Disks da0 pass0 pass1 md0 >> KB/t 20.33 0.00 0.00 0.00 >> tps 812 0 0 0 >> MB/s 16.11 0.00 0.00 0.00 >> % busy 100 0 0 0 >> skip... >> >> [idle@hst ~]#vmstat -w 5 >> procs memory page disks faults cpu >> r b w avm fre flt re pi po fr sr da0 md0 in sy cs us sy id >> 1 0 0 1996756 54208 42 23 25 7 39 336 0 0 531 638 404 21 5 74 >> 1 6 0 2011488 13272 571 0 0 1 2506 8 129 0 1356 2125 159 3 4 93 >> 4 27 0 2022852 4228 267 0 0 1 1657 4 272 0 1450 784 96 1 3 96 >> 1 10 0 2027492 40220 449 5 0 12 3257 9384 574 0 1773 4366 189 8 7 85 >> 1 10 0 2035064 25604 746 2 1 7 2965 4466 157 0 1380 4486 184 8 7 85 >> 0 11 0 2030860 4228 515 2 1 3 2098 31 214 0 1412 3077 149 16 5 79 >> 3 14 0 2042792 10004 1014 4 1 5 2787 4432 267 0 1440 1735 118 2 4 94 >> 2 16 0 2062664 4228 301 0 1 2 2843 27 564 0 1759 1250 107 5 4 91 >> >> [idle@hst ~]#iostat -w 5 >> tty da0 pass0 pass1 cpu >> tin tout KB/t tps MB/s KB/t tps MB/s KB/t tps MB/s us ni sy in id >> 0 25 0.00 0 0.00 0.00 0 0.00 0.00 0 0.00 21 0 4 0 74 >> 1 109 62.56 242 14.81 0.00 0 0.00 0.00 0 0.00 7 0 9 0 83 >> 0 101 18.29 433 7.73 0.00 0 0.00 0.00 0 0.00 2 0 2 0 95 >> 0 76 26.45 281 7.25 0.00 0 0.00 0.00 0 0.00 3 0 4 0 93 >> 0 94 15.99 357 5.57 0.00 0 0.00 0.00 0 0.00 2 0 2 0 96 >> 0 15 16.04 667 10.45 0.00 0 0.00 0.00 0 0.00 0 0 3 1 96 >> 0 93 15.99 558 8.71 0.00 0 0.00 0.00 0 0.00 0 0 2 1 97 >> 0 80 16.16 252 3.98 0.00 0 0.00 0.00 0 0.00 0 0 1 0 98 >> 0 117 23.44 240 5.49 0.00 0 0.00 0.00 0 0.00 9 0 6 0 85 >> >> Why this happen? > The numbers from your vmstat output indicate that your > machine is paging ("swapping"), i.e. it's running out > or RAM. That seems like true, and I forget to mention that 2/3 of swap is located at physical disk(da0). [idle@hst ~]#swapinfo Device 1K-blocks Used Avail Capacity Type /dev/da0s1b 524160 463300 60860 88% Interleaved /dev/rvn0b 1048448 578724 469724 55% Interleaved Total 1572608 1042024 530584 66% But what I can't understand - why such non-critical(as it seems to me) disk activity, cause 100% busyness for disk? Its claim to be 40.000MB/s transfers, but sometimes its 100% busy when iostat show only 1 MB/s. Regards, Roman.