From owner-freebsd-fs@FreeBSD.ORG Mon Sep 15 15:18:47 2008 Return-Path: Delivered-To: freebsd-fs@FreeBSD.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id D75FA1065672 for ; Mon, 15 Sep 2008 15:18:47 +0000 (UTC) (envelope-from owner-bugmaster@FreeBSD.org) Received: from freefall.freebsd.org (freefall.freebsd.org [IPv6:2001:4f8:fff6::28]) by mx1.freebsd.org (Postfix) with ESMTP id C656D8FC25 for ; Mon, 15 Sep 2008 15:18:47 +0000 (UTC) (envelope-from owner-bugmaster@FreeBSD.org) Received: from freefall.freebsd.org (localhost [127.0.0.1]) by freefall.freebsd.org (8.14.2/8.14.2) with ESMTP id m8FFIltt018871 for ; Mon, 15 Sep 2008 15:18:47 GMT (envelope-from owner-bugmaster@FreeBSD.org) Received: (from gnats@localhost) by freefall.freebsd.org (8.14.2/8.14.1/Submit) id m8FFIlDh018867 for freebsd-fs@FreeBSD.org; Mon, 15 Sep 2008 15:18:47 GMT (envelope-from owner-bugmaster@FreeBSD.org) Date: Mon, 15 Sep 2008 15:18:47 GMT Message-Id: <200809151518.m8FFIlDh018867@freefall.freebsd.org> X-Authentication-Warning: freefall.freebsd.org: gnats set sender to owner-bugmaster@FreeBSD.org using -f From: FreeBSD bugmaster To: freebsd-fs@FreeBSD.org Cc: Subject: Current problem reports assigned to freebsd-fs@FreeBSD.org X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 15 Sep 2008 15:18:47 -0000 Note: to view an individual PR, use: http://www.freebsd.org/cgi/query-pr.cgi?pr=(number). The following is a listing of current problems submitted by FreeBSD users. These represent problem reports covering all versions including experimental development code and obsolete releases. S Tracker Resp. Description -------------------------------------------------------------------------------- o kern/127213 fs [tmpfs] sendfile on tmpfs data corruption o kern/127029 fs [panic] mount(8): trying to mount a write protected zi o kern/126287 fs [ufs] [panic] Kernel panics while mounting an UFS file o kern/125536 fs [ext2fs] ext 2 mounts cleanly but fails on commands li o kern/124621 fs [ext3] Cannot mount ext2fs partition o kern/122888 fs [zfs] zfs hang w/ prefetch on, zil off while running t o bin/122172 fs [fs]: amd(8) automount daemon dies on 6.3-STABLE i386, o bin/121072 fs [smbfs] mount_smbfs(8) cannot normally convert the cha o bin/118249 fs mv(1): moving a directory changes its mtime o kern/116170 fs [panic] Kernel panic when mounting /tmp o kern/114955 fs [cd9660] [patch] [request] support for mask,dirmask,ui o kern/114847 fs [ntfs] [patch] [request] dirmask support for NTFS ala o kern/114676 fs [ufs] snapshot creation panics: snapacct_ufs2: bad blo o bin/114468 fs [patch] [request] add -d option to umount(8) to detach o bin/113838 fs [patch] [request] mount(8): add support for relative p o bin/113049 fs [patch] [request] make quot(8) use getopt(3) and show o kern/112658 fs [smbfs] [patch] smbfs and caching problems (resolves b o kern/93942 fs [vfs] [patch] panic: ufs_dirbad: bad dir (patch from D 18 problems total. From owner-freebsd-fs@FreeBSD.ORG Mon Sep 15 23:53:41 2008 Return-Path: Delivered-To: freebsd-fs@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 98CED106566B for ; Mon, 15 Sep 2008 23:53:41 +0000 (UTC) (envelope-from ahnjoan@gmail.com) Received: from wf-out-1314.google.com (wf-out-1314.google.com [209.85.200.168]) by mx1.freebsd.org (Postfix) with ESMTP id 65D838FC1A for ; Mon, 15 Sep 2008 23:53:41 +0000 (UTC) (envelope-from ahnjoan@gmail.com) Received: by wf-out-1314.google.com with SMTP id 24so2287155wfg.7 for ; Mon, 15 Sep 2008 16:53:41 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=gamma; h=domainkey-signature:received:received:message-id:date:from:to :subject:mime-version:content-type:content-transfer-encoding :content-disposition; bh=/DKLm96bRF5jEG9XQDyVfEId6jd8g0GPrUu34Od0sFE=; b=e1WHPxU4hNRX+3l8dJW0NRLbZJ42B/yQ8TjqmBxmbMXEHhDjfe5IZ0Br61/2Ny1+Nz 3G7UX1n3hFpDvAplaJbVS5v8mihRzwPbd1a0A0/bVDG2mri7yJKlFu4DikIU+GIqe4Dc tCiJ/6rfgQGBuwTi93jVbgloqsBZzSEOf4QrU= DomainKey-Signature: a=rsa-sha1; c=nofws; d=gmail.com; s=gamma; h=message-id:date:from:to:subject:mime-version:content-type :content-transfer-encoding:content-disposition; b=BJpBeVOwlJXA/Mg7Yk3ZgOc62sETKdqJOei0h0Y72U5LKdh4f98+YgrbzGCs7oKD4T acsnzQHK2gvWeTLk8a8h4Qx7uq5LoN9/3Ny66rEF1PsA34kMWu61v4EamNVdK3vjFR3L uPiscrCZIQWYgNRcANLAUAmkbGczPZLlm2xnc= Received: by 10.114.195.19 with SMTP id s19mr172481waf.110.1221520904169; Mon, 15 Sep 2008 16:21:44 -0700 (PDT) Received: by 10.114.174.8 with HTTP; Mon, 15 Sep 2008 16:21:44 -0700 (PDT) Message-ID: <5e575c8a0809151621t55810568wd16fde9b501997f2@mail.gmail.com> Date: Mon, 15 Sep 2008 19:21:44 -0400 From: "Ahnjoan Amous" To: freebsd-fs@freebsd.org MIME-Version: 1.0 Content-Type: text/plain; charset=WINDOWS-1252 Content-Transfer-Encoding: quoted-printable Content-Disposition: inline Subject: host hangs, can only drop to ddb after accessing a file that is owned by a non privileged user X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 15 Sep 2008 23:53:41 -0000 A week or so ago we had a power bump and since then one of our servers now hangs on access to one of two files. Just `ls -al` will cause the machine to hang. The files are excel spreadsheets owned by a normal user and served out by samba. The host does not panic when the files are accessed but the only thing I can do is break in to ddb on the serial console. Once inside of ddb I'm able to see which of the two files was being accessed by typing in "show lockedvnods" and using the inode to identify the file via the find command. I'm not able to remove the files either as this causes the host to hang in the same manner. I really don't know anything about ddb other than how to type in "show lockedvnods" so far. I can reproduce this behavior every time if anyone would like me to trouble shoot this possible bug. One thing to note this is a 5.2.1-Release so if it is even a bug it might be fixed already. Most importantly does anyone have any thoughts on how I can remove this file? Its accessible by my users and even with a preemptive e-mail they seem to take delight in clicking the little icon twice and watching me run down the hall... FYI =96 Here is the ddb output from two different hangings, the inodes correspond to the two files that make this happen. 0xcc880410: tag ufs, type VREG, usecount 1, writecount 0, refcount 1, flags (VV_OBJBUF), lock type ufs: EXCL (count 1) by thread 0xc9b58dc0 ino 3933646, on dev da2s1e (4, 29) 0xca42d71c: tag ufs, type VREG, usecount 1, writecount 0, refcount 1, lock type ufs: EXCL (count 1) by thread 0xca23da00 ino 3933648, on dev da2s1e (4, 29) Thanks Ahnjoan From owner-freebsd-fs@FreeBSD.ORG Tue Sep 16 09:19:32 2008 Return-Path: Delivered-To: freebsd-fs@FreeBSD.ORG Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 491AC1065673 for ; Tue, 16 Sep 2008 09:19:32 +0000 (UTC) (envelope-from olli@lurza.secnetix.de) Received: from lurza.secnetix.de (unknown [IPv6:2a01:170:102f::2]) by mx1.freebsd.org (Postfix) with ESMTP id 9F6438FC0A for ; Tue, 16 Sep 2008 09:19:31 +0000 (UTC) (envelope-from olli@lurza.secnetix.de) Received: from lurza.secnetix.de (localhost [127.0.0.1]) by lurza.secnetix.de (8.14.3/8.14.3) with ESMTP id m8G9JUoX021477; Tue, 16 Sep 2008 11:19:30 +0200 (CEST) (envelope-from oliver.fromme@secnetix.de) Received: (from olli@localhost) by lurza.secnetix.de (8.14.3/8.14.3/Submit) id m8G9JTC7021476; Tue, 16 Sep 2008 11:19:29 +0200 (CEST) (envelope-from olli) Date: Tue, 16 Sep 2008 11:19:29 +0200 (CEST) Message-Id: <200809160919.m8G9JTC7021476@lurza.secnetix.de> From: Oliver Fromme To: freebsd-fs@FreeBSD.ORG, ahnjoan@gmail.com In-Reply-To: <5e575c8a0809151621t55810568wd16fde9b501997f2@mail.gmail.com> X-Newsgroups: list.freebsd-fs User-Agent: tin/1.8.3-20070201 ("Scotasay") (UNIX) (FreeBSD/6.4-PRERELEASE-20080904 (i386)) MIME-Version: 1.0 Content-Type: text/plain; charset=ISO-8859-1 Content-Transfer-Encoding: 8bit X-Greylist: Sender IP whitelisted, not delayed by milter-greylist-2.1.2 (lurza.secnetix.de [127.0.0.1]); Tue, 16 Sep 2008 11:19:30 +0200 (CEST) Cc: Subject: Re: host hangs, ?can only drop to ddb after accessing a file that is owned by a non ?privileged user X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list Reply-To: freebsd-fs@FreeBSD.ORG, ahnjoan@gmail.com List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 16 Sep 2008 09:19:32 -0000 Ahnjoan Amous wrote: > A week or so ago we had a power bump and since then one of our servers > now hangs on access to one of two files. Just `ls -al` will cause the > machine to hang. The files are excel spreadsheets owned by a normal > user and served out by samba. The host does not panic when the files > are accessed but the only thing I can do is break in to ddb on the > serial console. > > Once inside of ddb I'm able to see which of the two files was being > accessed by typing in "show lockedvnods" and using the inode to > identify the file via the find command. I'm not able to remove the > files either as this causes the host to hang in the same manner. > > I really don't know anything about ddb other than how to type in "show > lockedvnods" so far. I can reproduce this behavior every time if > anyone would like me to trouble shoot this possible bug. One thing to > note this is a 5.2.1-Release so if it is even a bug it might be fixed > already. > > Most importantly does anyone have any thoughts on how I can remove > this file? Its accessible by my users and even with a preemptive > e-mail they seem to take delight in clicking the little icon twice and > watching me run down the hall... First and most importantly, I assume you have good backups. Unmount the file system, use clri(8) to zero out the broken inodes, then run fsck(8) to clean up, then mount the file system and restore the lost files from your backup. Finally, update your FreeBSD version, because 5.x is EoL and not supported anymore. In particular, you don't get security fixes for it anymore. If your users take delight in causing harm to your server, they could certainly do more serious things than just cause it to crash. By the way, if clri(8) or fsck(8) hang, too, or if the problem persists afterwards, chances are that the disk hardware is broken and should be replaced. Best regards Oliver -- Oliver Fromme, secnetix GmbH & Co. KG, Marktplatz 29, 85567 Grafing b. M. Handelsregister: Registergericht Muenchen, HRA 74606, Geschäftsfuehrung: secnetix Verwaltungsgesellsch. mbH, Handelsregister: Registergericht Mün- chen, HRB 125758, Geschäftsführer: Maik Bachmann, Olaf Erb, Ralf Gebhart FreeBSD-Dienstleistungen, -Produkte und mehr: http://www.secnetix.de/bsd "I started using PostgreSQL around a month ago, and the feeling is similar to the switch from Linux to FreeBSD in '96 -- 'wow!'." -- Oddbjorn Steffensen From owner-freebsd-fs@FreeBSD.ORG Tue Sep 16 20:57:16 2008 Return-Path: Delivered-To: freebsd-fs@FreeBSD.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 93CA0106564A for ; Tue, 16 Sep 2008 20:57:16 +0000 (UTC) (envelope-from marck@rinet.ru) Received: from woozle.rinet.ru (woozle.rinet.ru [195.54.192.68]) by mx1.freebsd.org (Postfix) with ESMTP id 1B4AD8FC08 for ; Tue, 16 Sep 2008 20:57:15 +0000 (UTC) (envelope-from marck@rinet.ru) Received: from localhost (localhost [127.0.0.1]) by woozle.rinet.ru (8.14.2/8.14.2) with ESMTP id m8GKvEXR019871 for ; Wed, 17 Sep 2008 00:57:14 +0400 (MSD) (envelope-from marck@rinet.ru) Date: Wed, 17 Sep 2008 00:57:14 +0400 (MSD) From: Dmitry Morozovsky To: freebsd-fs@FreeBSD.org Message-ID: User-Agent: Alpine 2.00 (BSF 1167 2008-08-23) X-NCC-RegID: ru.rinet X-OpenPGP-Key-ID: 6B691B03 MIME-Version: 1.0 Content-Type: TEXT/PLAIN; charset=US-ASCII X-Greylist: Sender IP whitelisted, not delayed by milter-greylist-4.0 (woozle.rinet.ru [0.0.0.0]); Wed, 17 Sep 2008 00:57:14 +0400 (MSD) Cc: Subject: gpt in-place editing X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 16 Sep 2008 20:57:16 -0000 Dear colleagues, is there a way to split existing GPT partition into two, like one can do in bsdlabel case? I found myself wanting to shrink swap to have an alternate root, but have no luck in my experiments. For the reference, I have da0p1 boot da0p2 bootdisk da0p3 swap da0p4 ZFS and want to place two partitions in place of da0p3... Thanks in advance. Sincerely, D.Marck [DM5020, MCK-RIPE, DM3-RIPN] [ FreeBSD committer: marck@FreeBSD.org ] ------------------------------------------------------------------------ *** Dmitry Morozovsky --- D.Marck --- Wild Woozle --- marck@rinet.ru *** ------------------------------------------------------------------------ From owner-freebsd-fs@FreeBSD.ORG Wed Sep 17 15:16:20 2008 Return-Path: Delivered-To: freebsd-fs@hub.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 07FA51065675; Wed, 17 Sep 2008 15:16:20 +0000 (UTC) (envelope-from linimon@FreeBSD.org) Received: from freefall.freebsd.org (freefall.freebsd.org [IPv6:2001:4f8:fff6::28]) by mx1.freebsd.org (Postfix) with ESMTP id D20868FC08; Wed, 17 Sep 2008 15:16:19 +0000 (UTC) (envelope-from linimon@FreeBSD.org) Received: from freefall.freebsd.org (linimon@localhost [127.0.0.1]) by freefall.freebsd.org (8.14.2/8.14.2) with ESMTP id m8HFGJeU088821; Wed, 17 Sep 2008 15:16:19 GMT (envelope-from linimon@freefall.freebsd.org) Received: (from linimon@localhost) by freefall.freebsd.org (8.14.2/8.14.1/Submit) id m8HFGJJf088817; Wed, 17 Sep 2008 15:16:19 GMT (envelope-from linimon) Date: Wed, 17 Sep 2008 15:16:19 GMT Message-Id: <200809171516.m8HFGJJf088817@freefall.freebsd.org> To: linimon@FreeBSD.org, freebsd-bugs@FreeBSD.org, freebsd-fs@FreeBSD.org From: linimon@FreeBSD.org Cc: Subject: Re: kern/127420: [gjournal] [panic] Journal overflow on gmirrored gjournal X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 17 Sep 2008 15:16:20 -0000 Synopsis: [gjournal] [panic] Journal overflow on gmirrored gjournal Responsible-Changed-From-To: freebsd-bugs->freebsd-fs Responsible-Changed-By: linimon Responsible-Changed-When: Wed Sep 17 15:16:09 UTC 2008 Responsible-Changed-Why: Over to maintainer(s). http://www.freebsd.org/cgi/query-pr.cgi?pr=127420 From owner-freebsd-fs@FreeBSD.ORG Wed Sep 17 17:15:46 2008 Return-Path: Delivered-To: freebsd-fs@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 04C70106566C for ; Wed, 17 Sep 2008 17:15:46 +0000 (UTC) (envelope-from softsearch@gmail.com) Received: from gv-out-0910.google.com (gv-out-0910.google.com [216.239.58.189]) by mx1.freebsd.org (Postfix) with ESMTP id 11BEA8FC27 for ; Wed, 17 Sep 2008 17:15:44 +0000 (UTC) (envelope-from softsearch@gmail.com) Received: by gv-out-0910.google.com with SMTP id n8so1590192gve.39 for ; Wed, 17 Sep 2008 10:15:44 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=gamma; h=domainkey-signature:received:received:date:from:reply-to :organization:x-priority:message-id:to:subject:mime-version :content-type:content-transfer-encoding; bh=KQrxZmZ6hZLsOW8w18hwtEUJYVVLCMfJq2yN2ntIzDo=; b=jvY97G6zA4gltII+ggMwcLId9EatCjwsEL4l7jZsK1aOqi71Yk9nQmSQ/bnxb+nGcb u5gNT9wdCBlCh9RGLbIIBKnSigC9DbCR5MXm6vvdkE+O4NDraoZWnbgK7qeulJjLXTto vXGtY8kpl0zLCNjCLOy2S6ib/+/ghdNggAcXM= DomainKey-Signature: a=rsa-sha1; c=nofws; d=gmail.com; s=gamma; h=date:from:reply-to:organization:x-priority:message-id:to:subject :mime-version:content-type:content-transfer-encoding; b=Qmz72hSM3l74v1szv225JUFTLnIYTxNTua3yWqAHLDsIB17sGKOo2pb7QRx7sW6qu7 VK4d07yKeN3VWdolfjz7vAQE5JNk2dL8QoodS8/nPn5SgI8UFrm+p/8b0J5u6wQYmgZv UmMhe5hzSAG8FrhvNyvOzW19Z9GexZKi1AbB8= Received: by 10.86.26.11 with SMTP id 11mr1202821fgz.12.1221669815765; Wed, 17 Sep 2008 09:43:35 -0700 (PDT) Received: from ?192.168.1.102? ( [81.200.127.6]) by mx.google.com with ESMTPS id d6sm1669380fga.2.2008.09.17.09.43.34 (version=SSLv3 cipher=OTHER); Wed, 17 Sep 2008 09:43:35 -0700 (PDT) Date: Wed, 17 Sep 2008 20:43:22 +0400 From: Michael Monashev Organization: SoftSearch.ru X-Priority: 3 (Normal) Message-ID: <946072909.20080917204322@gmail.com> To: freebsd-fs@FreeBSD.org MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Transfer-Encoding: 7bit Cc: Subject: gmirror performance patch X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list Reply-To: Michael Monashev List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 17 Sep 2008 17:15:46 -0000 Hi, Pawel. Patch for improve gmirror performance: http://www.freebsd.org/cgi/query-pr.cgi?pr=113885 -- Michael From owner-freebsd-fs@FreeBSD.ORG Sat Sep 20 09:31:17 2008 Return-Path: Delivered-To: freebsd-fs@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 3C2861065679 for ; Sat, 20 Sep 2008 09:31:17 +0000 (UTC) (envelope-from andrew@modulus.org) Received: from email.octopus.com.au (host-122-100-2-232.octopus.com.au [122.100.2.232]) by mx1.freebsd.org (Postfix) with ESMTP id EF2BE8FC1B for ; Sat, 20 Sep 2008 09:31:11 +0000 (UTC) (envelope-from andrew@modulus.org) Received: by email.octopus.com.au (Postfix, from userid 1002) id 51E0B17369; Sat, 20 Sep 2008 19:31:09 +1000 (EST) X-Spam-Checker-Version: SpamAssassin 3.2.3 (2007-08-08) on email.octopus.com.au X-Spam-Level: X-Spam-Status: No, score=-1.4 required=10.0 tests=ALL_TRUSTED autolearn=failed version=3.2.3 Received: from [10.1.50.60] (142.19.96.58.exetel.com.au [58.96.19.142]) (using TLSv1 with cipher DHE-RSA-AES256-SHA (256/256 bits)) (No client certificate requested) (Authenticated sender: admin@email.octopus.com.au) by email.octopus.com.au (Postfix) with ESMTP id C5DE317261 for ; Sat, 20 Sep 2008 19:31:04 +1000 (EST) Message-ID: <48D4C2AA.8080000@modulus.org> Date: Sat, 20 Sep 2008 19:30:18 +1000 From: Andrew Snow User-Agent: Thunderbird 2.0.0.14 (X11/20080523) MIME-Version: 1.0 To: freebsd-fs@freebsd.org Content-Type: text/plain; charset=ISO-8859-1; format=flowed Content-Transfer-Encoding: 7bit Subject: zfs benchmarks and 7 disk raidz oddity X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 20 Sep 2008 09:31:17 -0000 Hi all, I am running 8-CURRENT with ZFS patches on a 3ghz Core2Duo with Intel P45 chipset. I took some benchmarks of ZFS on six old SATA disks and one PATA, onboard controllers only, and I expect you are interested to see the results. The disks range in size from 200gb to 320gb. I tried several configurations with quick and dirty testing. Listed below is the sequential megabytes/sec rating as measured by dd bs=1m for a 10GB file. All ZFS settings were left at their defaults. Conf Write Read (MB/s) ------------------------------------ 7 disk RAIDZ2 220 305 7 disk RAIDZ1 84 361 7 disk striped 318 409 7 disk stripe copies=2 140 164 6 disk RAIDZ2 173 260 6 disk RAIDZ1 238 307 6 disk striped 280 346 6 disk 2xRAIDZ1 striped 188 251 6 disk striped mirrors 164 323 6 disk stripe copies=2 151 179 A few notes: 1. using copies=2 is a nice way to be able to get RAID1-like mirroring reliability but on an odd number of disks. However you take a noticeable performance penalty: Write speed is fine but read speed is almost half of what RAID0+1 achieved. 2. RAIDZ1 and RAIDZ2 are fast and efficient. However in total it caused the system to use almost all of one CPU core during writing. 3. There seemed to be a bug with 7 disks and RAIDZ1 - the write performance was terrible! When I ran "gstat" I noticed it was spending much time writing to only two disks most of the time, which became a serious bottleneck - the worst write score of the lot. Read was fine. Perhaps the algorithm isn't optimised for choosing parity locations out of exactly 7 disks? - Andrew From owner-freebsd-fs@FreeBSD.ORG Sat Sep 20 09:53:26 2008 Return-Path: Delivered-To: freebsd-fs@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 7FE081065679 for ; Sat, 20 Sep 2008 09:53:26 +0000 (UTC) (envelope-from softsearch@gmail.com) Received: from fg-out-1718.google.com (fg-out-1718.google.com [72.14.220.153]) by mx1.freebsd.org (Postfix) with ESMTP id 04A318FC18 for ; Sat, 20 Sep 2008 09:53:25 +0000 (UTC) (envelope-from softsearch@gmail.com) Received: by fg-out-1718.google.com with SMTP id l26so790820fgb.35 for ; Sat, 20 Sep 2008 02:53:24 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=gamma; h=domainkey-signature:received:received:date:from:reply-to :organization:x-priority:message-id:to:cc:subject:in-reply-to :references:mime-version:content-type:content-transfer-encoding; bh=ShIUecJvdAtPP3EmHI5bVG+XIpc2ZEo07kX/+I0fx/w=; b=wzfk7GWlREuIQ96H3NMfVAgr1WwUHTguP6ZamZji2Y/nt3iqve2kb4Sxdt21EknkTf yyFFo3Gsv64rrtjXgWSNbq5VWtbyBfhh7oHMjja583sviIbkFesaTDf4XoqK0Z96dNrh a0mlvnlXJI1cT+mXO7EJD+mxSQaCtvp4z4rX0= DomainKey-Signature: a=rsa-sha1; c=nofws; d=gmail.com; s=gamma; h=date:from:reply-to:organization:x-priority:message-id:to:cc:subject :in-reply-to:references:mime-version:content-type :content-transfer-encoding; b=JcvilnBWdl7N8gBn7VHchBFrlvOo/LsDoNM867MyiFlDity66gYw7gI1LaptfMjbFc 3+86a6jaC4SQEHiXph7doJizmczwA6iz6NeJwZ7YnXeW1AzFKeUny9hxoBBvL9LnPhY+ +1s7/88EH3FfgjL+KIIzOrh7jwgvFNFe5+CHU= Received: by 10.86.93.19 with SMTP id q19mr2889720fgb.76.1221904404746; Sat, 20 Sep 2008 02:53:24 -0700 (PDT) Received: from ?192.168.1.102? ([81.200.127.6]) by mx.google.com with ESMTPS id d6sm2043842fga.2.2008.09.20.02.53.21 (version=SSLv3 cipher=OTHER); Sat, 20 Sep 2008 02:53:23 -0700 (PDT) Date: Sat, 20 Sep 2008 13:53:08 +0400 From: Michael Monashev Organization: SoftSearch.ru X-Priority: 3 (Normal) Message-ID: <1441440775.20080920135308@gmail.com> To: freebsd-fs@FreeBSD.org In-Reply-To: <946072909.20080917204322@gmail.com> References: <946072909.20080917204322@gmail.com> MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Transfer-Encoding: 7bit Cc: Pawel Jakub Dawidek Subject: Re: gmirror performance patch X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list Reply-To: Michael Monashev List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 20 Sep 2008 09:53:26 -0000 Hi. MM> Patch for improve gmirror performance: MM> http://www.freebsd.org/cgi/query-pr.cgi?pr=113885 before: >gstat -I5s dT: 5.384s w: 5.000s L(q) ops/s r/s kBps ms/r w/s kBps ms/w %busy Name 12 118 117 1372 349.0 1 12 383.6 100.0| ad4 4 117 116 1349 297.5 1 12 30.7 99.8| ad6 38 131 130 1323 459.9 1 9 415.0 100.0| ad8 62 126 125 1418 534.5 1 9 291.9 98.9| ad10 34 131 129 1403 639.0 2 128 783.4 100.1| ad12 47 131 129 1525 747.4 2 128 1044.4 100.1| ad14 after patch: >gstat -I5s dT: 5.001s w: 5.000s L(q) ops/s r/s kBps ms/r w/s kBps ms/w %busy Name 40 93 92 1072 101.4 1 54 20.7 79.3| ad4 8 114 113 1645 285.0 1 54 87.7 95.8| ad6 6 52 45 451 23.8 7 312 19.0 44.3| ad8 85 143 136 1753 1428.8 7 312 556.6 100.2| ad10 28 91 91 707 217.0 0 0 0.1 79.1| ad12 100 129 128 1488 894.8 0 0 956.9 100.0| ad14 >gstat -I5s dT: 5.001s w: 5.000s L(q) ops/s r/s kBps ms/r w/s kBps ms/w %busy Name 10 84 83 1239 86.1 1 10 123.1 65.6| ad4 34 121 120 1698 254.2 1 10 215.8 97.3| ad6 50 132 132 1841 481.3 0 0 0.0 99.9| ad8 0 63 63 685 46.3 0 0 0.0 57.0| ad10 70 131 131 2124 532.5 0 0 166.7 100.0| ad12 0 92 91 893 69.1 1 0 49.6 80.4| ad14 -- Michael From owner-freebsd-fs@FreeBSD.ORG Sat Sep 20 18:53:17 2008 Return-Path: Delivered-To: freebsd-fs@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id B1E47106566C for ; Sat, 20 Sep 2008 18:53:17 +0000 (UTC) (envelope-from yalur@mail.ru) Received: from mx4.mail.ru (fallback.mail.ru [194.67.57.14]) by mx1.freebsd.org (Postfix) with ESMTP id 696DF8FC0A for ; Sat, 20 Sep 2008 18:53:17 +0000 (UTC) (envelope-from yalur@mail.ru) Received: from mx39.mail.ru (mx39.mail.ru [194.67.23.35]) by mx4.mail.ru (mPOP.Fallback_MX) with ESMTP id 841ECABB44 for ; Sat, 20 Sep 2008 22:35:24 +0400 (MSD) Received: from [93.73.134.74] (port=4480 helo=scrupulous.sifter.volia.net) by mx39.mail.ru with asmtp id 1Kh7Ig-0002RP-00 for freebsd-fs@freebsd.org; Sat, 20 Sep 2008 22:35:22 +0400 From: Ruslan Kovtun Organization: Home To: freebsd-fs@freebsd.org Date: Sat, 20 Sep 2008 21:35:20 +0300 User-Agent: KMail/1.9.7 References: <48D4C2AA.8080000@modulus.org> In-Reply-To: <48D4C2AA.8080000@modulus.org> MIME-Version: 1.0 Content-Type: text/plain; charset="utf-8" Content-Transfer-Encoding: quoted-printable Content-Disposition: inline Message-Id: <200809202135.20730.yalur@mail.ru> X-Spam: Not detected X-Mras: OK X-Mailman-Approved-At: Sat, 20 Sep 2008 21:27:44 +0000 Subject: Re: zfs benchmarks and 7 disk raidz oddity X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list Reply-To: yalur@mail.ru List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 20 Sep 2008 18:53:17 -0000 Hi. Thank you very much, very useful information.=20 It is interesting when we can use this on 7.x? =D0=92 =D1=81=D0=BE=D0=BE=D0=B1=D1=89=D0=B5=D0=BD=D0=B8=D0=B8 =D0=BE=D1=82 = =D0=A1=D1=83=D0=B1=D0=B1=D0=BE=D1=82=D0=B0 20 =D1=81=D0=B5=D0=BD=D1=82=D1= =8F=D0=B1=D1=80=D1=8F 2008 Andrew Snow =D0=BD=D0=B0=D0=BF=D0=B8=D1=81=D0=B0= =D0=BB(a): > Hi all, > > I am running 8-CURRENT with ZFS patches on a 3ghz Core2Duo with Intel > P45 chipset. I took some benchmarks of ZFS on six old SATA disks and > one PATA, onboard controllers only, and I expect you are interested to > see the results. The disks range in size from 200gb to 320gb. > > I tried several configurations with quick and dirty testing. Listed > below is the sequential megabytes/sec rating as measured by dd bs=3D1m for > a 10GB file. All ZFS settings were left at their defaults. > > > Conf Write Read (MB/s) > ------------------------------------ > 7 disk RAIDZ2 220 305 > 7 disk RAIDZ1 84 361 > 7 disk striped 318 409 > 7 disk stripe copies=3D2 140 164 > > 6 disk RAIDZ2 173 260 > 6 disk RAIDZ1 238 307 > 6 disk striped 280 346 > 6 disk 2xRAIDZ1 striped 188 251 > 6 disk striped mirrors 164 323 > 6 disk stripe copies=3D2 151 179 > > > A few notes: > > 1. using copies=3D2 is a nice way to be able to get RAID1-like mirroring > reliability but on an odd number of disks. However you take a > noticeable performance penalty: Write speed is fine but read speed is > almost half of what RAID0+1 achieved. > > 2. RAIDZ1 and RAIDZ2 are fast and efficient. However in total it caused > the system to use almost all of one CPU core during writing. > > 3. There seemed to be a bug with 7 disks and RAIDZ1 - the write > performance was terrible! When I ran "gstat" I noticed it was spending > much time writing to only two disks most of the time, which became a > serious bottleneck - the worst write score of the lot. Read was fine. > Perhaps the algorithm isn't optimised for choosing parity locations out > of exactly 7 disks? > > > > - Andrew > > _______________________________________________ > freebsd-fs@freebsd.org mailing list > http://lists.freebsd.org/mailman/listinfo/freebsd-fs > To unsubscribe, send any mail to "freebsd-fs-unsubscribe@freebsd.org" =2D-=20 ________________ Ruslan Kovtun=20 mailto: yalur@mail.ru mob: +380503557878, +380919015095 ICQ: 277696182