From owner-freebsd-performance@FreeBSD.ORG Fri Jun 1 10:38:44 2007 Return-Path: X-Original-To: freebsd-performance@freebsd.org Delivered-To: freebsd-performance@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [69.147.83.52]) by hub.freebsd.org (Postfix) with ESMTP id 4A8A716A400 for ; Fri, 1 Jun 2007 10:38:44 +0000 (UTC) (envelope-from hunreal@gmail.com) Received: from an-out-0708.google.com (an-out-0708.google.com [209.85.132.241]) by mx1.freebsd.org (Postfix) with ESMTP id 0D00413C43E for ; Fri, 1 Jun 2007 10:38:43 +0000 (UTC) (envelope-from hunreal@gmail.com) Received: by an-out-0708.google.com with SMTP id c14so194537anc for ; Fri, 01 Jun 2007 03:38:43 -0700 (PDT) DKIM-Signature: a=rsa-sha1; c=relaxed/relaxed; d=gmail.com; s=beta; h=domainkey-signature:received:received:message-id:date:from:to:subject:mime-version:content-type:content-transfer-encoding:content-disposition; b=QQLlUv3OEt0KuTYWq693YIjLw8CiX+wbsK0ERzI3gM0+1Lj5Nanl1EDwzI3nnFD0UbTpsOhyVRXrRj27iE70LVs45nTT9939DjtrHIVAS4oXVpC/0g5bwTgDWwYRuaCLopwZylQAjglzZoJ383TbV43GtmgyPTUM+7pNHnooz4c= DomainKey-Signature: a=rsa-sha1; c=nofws; d=gmail.com; s=beta; h=received:message-id:date:from:to:subject:mime-version:content-type:content-transfer-encoding:content-disposition; b=byYf7QQ0DffxXURQyjETBcumkQBfXGkUNWO6SRFFrrxOFy/CuN9IiH4sOnbY+d9QcMrPSnbKP0ftl+aWsLgkdEIbPZWBPxhxr3NuLYPAiH1bu+eKe17q/PgvGaYa2wbKjtO019yvEYKC78V3xyABULvTr9tG8YFgeDjJHKyZfv0= Received: by 10.100.40.17 with SMTP id n17mr938839ann.1180692653164; Fri, 01 Jun 2007 03:10:53 -0700 (PDT) Received: by 10.100.95.14 with HTTP; Fri, 1 Jun 2007 03:10:53 -0700 (PDT) Message-ID: <9b6b59500706010310h145a1804ie97e57aa0c5e90a4@mail.gmail.com> Date: Fri, 1 Jun 2007 18:10:53 +0800 From: hshh To: freebsd-performance@freebsd.org MIME-Version: 1.0 Content-Type: text/plain; charset=UTF-8; format=flowed Content-Transfer-Encoding: 7bit Content-Disposition: inline Subject: Bad performance while transfer large block size through NFS. X-BeenThere: freebsd-performance@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Performance/tuning List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 01 Jun 2007 10:38:44 -0000 I set up one NFS server, and mounted on other server by TCP. Servers connected with Giga network, and running 6.2-RELEASE. But I found the performance is very bad while transfering large block size data. For example, I use dd on NFS client to test the speed. # dd if=/dev/zero of=/mnt/test bs=16k count=20k 20480+0 records in 20480+0 records out 335544320 bytes transferred in 6.172289 secs (54363027 bytes/sec) # dd if=/dev/zero of=/mnt/test bs=32k count=10k 10240+0 records in 10240+0 records out 335544320 bytes transferred in 6.481602 secs (51768733 bytes/sec) # dd if=/dev/zero of=/mnt/test bs=512k count=1k 1024+0 records in 1024+0 records out 536870912 bytes transferred in 11.859133 secs (45270671 bytes/sec) # dd if=/dev/zero of=/mnt/test bs=1m count=512 512+0 records in 512+0 records out 536870912 bytes transferred in 11.963019 secs (44877544 bytes/sec) # dd if=/dev/zero of=/mnt/test bs=1651k count=200 200+0 records in 200+0 records out 338124800 bytes transferred in 7.431332 secs (45499891 bytes/sec) # dd if=/dev/zero of=/mnt/test bs=1652k count=50 50+0 records in 50+0 records out 84582400 bytes transferred in 22.319528 secs (3789614 bytes/sec) ----Test End--- As test result, while block size smaller than 1652k, it's fast. But speed drop to only 3.6M/s while block size bigger or equal 1652k. And ``systat -vm 1'' is displayed HDD is most busy, Disks da0 KB/t 16.00 tps 239 MB/s 3.73 % busy 91 Can I do some tuning to improve large block size transfer over NFS?