From owner-freebsd-geom@FreeBSD.ORG Sun Oct 14 14:15:27 2007 Return-Path: Delivered-To: freebsd-geom@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id EDA8416A41A for ; Sun, 14 Oct 2007 14:15:27 +0000 (UTC) (envelope-from scottl@samsco.org) Received: from pooker.samsco.org (pooker.samsco.org [168.103.85.57]) by mx1.freebsd.org (Postfix) with ESMTP id 6B26313C447 for ; Sun, 14 Oct 2007 14:15:27 +0000 (UTC) (envelope-from scottl@samsco.org) Received: from phobos.samsco.home (phobos.samsco.home [192.168.254.11]) (authenticated bits=0) by pooker.samsco.org (8.13.8/8.13.8) with ESMTP id l9EDtAlH059643; Sun, 14 Oct 2007 07:55:10 -0600 (MDT) (envelope-from scottl@samsco.org) Message-ID: <47121F9F.7050900@samsco.org> Date: Sun, 14 Oct 2007 07:54:39 -0600 From: Scott Long User-Agent: Mozilla/5.0 (Macintosh; U; Intel Mac OS X; en-US; rv:1.8.1.6) Gecko/20070802 SeaMonkey/1.1.4 MIME-Version: 1.0 To: d_elbracht References: <008801c80e65$47cbe650$639049d9@EC1a> In-Reply-To: <008801c80e65$47cbe650$639049d9@EC1a> Content-Type: text/plain; charset=ISO-8859-1; format=flowed Content-Transfer-Encoding: 7bit X-Greylist: Sender succeeded SMTP AUTH authentication, not delayed by milter-greylist-2.0.2 (pooker.samsco.org [168.103.85.57]); Sun, 14 Oct 2007 07:55:10 -0600 (MDT) X-Spam-Status: No, score=-1.4 required=5.5 tests=ALL_TRUSTED autolearn=failed version=3.1.8 X-Spam-Checker-Version: SpamAssassin 3.1.8 (2007-02-13) on pooker.samsco.org Cc: freebsd-stable@freebsd.org, freebsd-geom@freebsd.org Subject: Re: g_vfs_done():da3s1a[READ(offset=81064794762854400, length=8192)]error = 5 X-BeenThere: freebsd-geom@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: GEOM-specific discussions and implementations List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 14 Oct 2007 14:15:28 -0000 d_elbracht wrote: > we are trying to diagnose errors seen on 6.2, SMP, amd64, cvsup'ed of > 2007-10-09 > > Mainboard is a Tyan Thunder h2000M (S3992-E) with 16 GB RAM and 2 x Opteron > 2216, da3 is on a 3ware 9550-12 > > we are seeing this error: > g_vfs_done():da3s1a[READ(offset=81064794762854400, length=8192)]error = 5 > on a 12 GB Hyperdrive > > the offset changes sometimes, but it is always 81064794xxxxxxxxx and well > out the 12GB range. > > We did have the Hyperdrive connected directly to the mainboards SATA0 (ad4) > with similar errors. > We used to have a md instead of the hyperdrive before, coming up with > similar errors. > > Blocksize on the partition is 8192 (newsfs -b 8192 ..). > We did have a blocksize of 65536 before, but after some hours (sometimes > days), the machine will be unresponsible with "newbuf" as a waitmessage in > top and has to be hard-reset. > Regarding "newbuf", as well as nbufkv and nbufbs, I will write a seperate > message to the list. > > According to systat -vm, da3 does tps > 500 (yes, that's a lot) > > This leads to an assumption, the error has to do with very high IOs per > second on a SMP machine. > The system-disk is a RAID1 on an ICP 5805. All other disks (51) are 20 > gstripe'd partitions. > > Any hint to diagnose / fix the problem is well appreciated. > > Cheers, > > Dieter > I can geneate 30,000 I/O's per second for hours on end on several types of storage hardware on FreeBSD SMP, and have no problems. Since you're seeing this problem both when connected to a 3ware controller and when connected to a simple ATA/SATA controller (both of which have also been observed to do high amounts of I/O with no problems), I suspect that the problem is with your disk device, not with FreeBSD. I don't know anything about a "hyperdrive" though, so more information might help. Scott