From owner-freebsd-geom@FreeBSD.ORG Mon Nov 17 11:06:50 2008 Return-Path: Delivered-To: freebsd-geom@FreeBSD.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 7DD991065686 for ; Mon, 17 Nov 2008 11:06:50 +0000 (UTC) (envelope-from owner-bugmaster@FreeBSD.org) Received: from freefall.freebsd.org (freefall.freebsd.org [IPv6:2001:4f8:fff6::28]) by mx1.freebsd.org (Postfix) with ESMTP id 6D1B08FC13 for ; Mon, 17 Nov 2008 11:06:50 +0000 (UTC) (envelope-from owner-bugmaster@FreeBSD.org) Received: from freefall.freebsd.org (localhost [127.0.0.1]) by freefall.freebsd.org (8.14.3/8.14.3) with ESMTP id mAHB6oGV082524 for ; Mon, 17 Nov 2008 11:06:50 GMT (envelope-from owner-bugmaster@FreeBSD.org) Received: (from gnats@localhost) by freefall.freebsd.org (8.14.3/8.14.3/Submit) id mAHB6nVi082520 for freebsd-geom@FreeBSD.org; Mon, 17 Nov 2008 11:06:49 GMT (envelope-from owner-bugmaster@FreeBSD.org) Date: Mon, 17 Nov 2008 11:06:49 GMT Message-Id: <200811171106.mAHB6nVi082520@freefall.freebsd.org> X-Authentication-Warning: freefall.freebsd.org: gnats set sender to owner-bugmaster@FreeBSD.org using -f From: FreeBSD bugmaster To: freebsd-geom@FreeBSD.org Cc: Subject: Current problem reports assigned to freebsd-geom@FreeBSD.org X-BeenThere: freebsd-geom@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: GEOM-specific discussions and implementations List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 17 Nov 2008 11:06:50 -0000 Note: to view an individual PR, use: http://www.freebsd.org/cgi/query-pr.cgi?pr=(number). The following is a listing of current problems submitted by FreeBSD users. These represent problem reports covering all versions including experimental development code and obsolete releases. S Tracker Resp. Description -------------------------------------------------------------------------------- o kern/128529 geom [gjournal] root FS on GEOM Journal cannot boot when jo o kern/128398 geom [PATCH] glabel(8): teach geom_label to recognise gpt l f kern/128276 geom [gmirror] machine lock up when gmirror module is used o kern/126902 geom [geom] [geom_label] Kernel panic during install boot o kern/124973 geom [gjournal] [patch] boot order affects geom_journal con o kern/124969 geom gvinum(8): gvinum raid5 plex does not detect missing s o kern/124294 geom [geom] gmirror(8) have inappropriate logic when workin o kern/124130 geom [gmirror][usb] gmirror fails to start usb devices that o kern/123962 geom [panic] [gjournal] gjournal (455Gb data, 8Gb journal), o kern/123630 geom [patch] [gmirror] gmirror doesnt allow the original dr o kern/123122 geom [geom] GEOM / gjournal kernel lock f kern/122415 geom [geom] UFS labels are being constantly created and rem o kern/122067 geom [geom] [panic] Geom crashed during boot o kern/121559 geom [patch] [geom] geom label class allows to create inacc o kern/121364 geom [gmirror] Removing all providers create a "zombie" mir o kern/120231 geom [geom] GEOM_CONCAT error adding second drive o kern/120044 geom [msdosfs] [geom] incorrect MSDOSFS label fries adminis o kern/120021 geom [geom] [panic] net-p2p/qbittorrent crashes system when o kern/119743 geom [geom] geom label for cds is keeped after dismount and f kern/115547 geom [geom] [patch] [request] let GEOM Eli get password fro o kern/114532 geom [geom] GEOM_MIRROR shows up in kldstat even if compile o kern/113957 geom [gmirror] gmirror is intermittently reporting a degrad o kern/113885 geom [gmirror] [patch] improved gmirror balance algorithm o kern/113837 geom [geom] unable to access 1024 sector size storage o kern/113419 geom [geom] geom fox multipathing not failing back p bin/110705 geom gmirror(8) control utility does not exit with correct o kern/107707 geom [geom] [patch] [request] add new class geom_xbox360 to o kern/104389 geom [geom] [patch] sys/geom/geom_dump.c doesn't encode XML o kern/98034 geom [geom] dereference of NULL pointer in acd_geom_detach o kern/94632 geom [geom] Kernel output resets input while GELI asks for o kern/90582 geom [geom] [panic] Restore cause panic string (ffs_blkfree o bin/90093 geom fdisk(8) incapable of altering in-core geometry a kern/89660 geom [vinum] [patch] [panic] due to g_malloc returning null o kern/89546 geom [geom] GEOM error s kern/89102 geom [geom] [panic] panic when forced unmount FS from unplu o kern/87544 geom [gbde] mmaping large files on a gbde filesystem deadlo o kern/84556 geom [geom] GBDE-encrypted swap causes panic at shutdown o kern/79251 geom [2TB] newfs fails on 2.6TB gbde device o kern/79035 geom [vinum] gvinum unable to create a striped set of mirro o bin/78131 geom gbde(8) "destroy" not working. s kern/73177 geom kldload geom_* causes panic due to memory exhaustion 41 problems total. From owner-freebsd-geom@FreeBSD.ORG Tue Nov 18 04:21:31 2008 Return-Path: Delivered-To: freebsd-geom@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 7CB5F106564A for ; Tue, 18 Nov 2008 04:21:31 +0000 (UTC) (envelope-from xcllnt@mac.com) Received: from asmtpout016.mac.com (asmtpout016.mac.com [17.148.16.91]) by mx1.freebsd.org (Postfix) with ESMTP id 633898FC0A for ; Tue, 18 Nov 2008 04:21:31 +0000 (UTC) (envelope-from xcllnt@mac.com) MIME-version: 1.0 Content-transfer-encoding: 7BIT Content-type: text/plain; charset=US-ASCII; format=flowed; delsp=yes Received: from [192.168.1.95] (209-128-86-226.BAYAREA.NET [209.128.86.226]) by asmtp016.mac.com (Sun Java(tm) System Messaging Server 6.3-7.03 (built Aug 7 2008; 32bit)) with ESMTPSA id <0KAI00AT5HFUTG90@asmtp016.mac.com> for freebsd-geom@freebsd.org; Mon, 17 Nov 2008 20:21:31 -0800 (PST) Message-id: From: Marcel Moolenaar To: vadim_nuclight@mail.ru In-reply-to: Date: Mon, 17 Nov 2008 20:21:29 -0800 References: <9e77bdb50810011331y7216eac3yf85907f96f5e8370@mail.gmail.com> <7353F23F-F944-47C9-A97D-6DE247F958AE@mac.com> <0A1A5002-A643-4738-B775-5E450C02486A@mac.com> X-Mailer: Apple Mail (2.929.2) Cc: freebsd-geom@freebsd.org Subject: Re: Experiences with Gpart X-BeenThere: freebsd-geom@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: GEOM-specific discussions and implementations List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 18 Nov 2008 04:21:31 -0000 [sorry for the delay] On Nov 10, 2008, at 3:45 AM, Vadim Goncharov wrote: >>> But, allowing for configuring partitioning as user wants (and >>> complex nesting, >>> if one wish) was always strong benefit of the GEOM. So why not? It >>> is allowed >>> author of this thread to manage mirrors the way he wants, not the >>> way somebody >>> enforces. Unix is tools, not policy (c) >> >> Gratuitous non-compliance in the name of freedom is >> not the Unix-way of things. > > Unix always had at least knob allow_me_to_shoot_in_the_foot, if now > allowed > this directly. So what alternative do you propose to group > partitions together > or to split GPT partitions? bsdlabel? But that is limited to 26 > partitions > and 2^32 sectors. FreeBSD allowed nested GPTs before and I didn't change this in GPart. Put differently: I didn't add special code to disallow it. By way of how GEOM works, FreeBSD will support it by default: # mdconfig -a -t malloc -s 128m md0 # gpart create -s gpt md0 md0 created # gpart add -b 34 -s 131038 -t freebsd md0 md0s1 added # gpart add -b 131072 -s 131038 -t freebsd md0 md0s2 added # gpart create -s gpt md0s1 md0s1 created # gpart create -s gpt md0s2 md0s2 created # gpart show | grep GPT => 34 262077 md0 GPT (128M) => 34 130971 md0s1 GPT (64M) => 34 130971 md0s2 GPT (64M) FYI, -- Marcel Moolenaar xcllnt@mac.com From owner-freebsd-geom@FreeBSD.ORG Tue Nov 18 04:42:53 2008 Return-Path: Delivered-To: freebsd-geom@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 445821065670 for ; Tue, 18 Nov 2008 04:42:53 +0000 (UTC) (envelope-from xcllnt@mac.com) Received: from asmtpout020.mac.com (asmtpout020.mac.com [17.148.16.95]) by mx1.freebsd.org (Postfix) with ESMTP id 304258FC14 for ; Tue, 18 Nov 2008 04:42:53 +0000 (UTC) (envelope-from xcllnt@mac.com) MIME-version: 1.0 Content-transfer-encoding: 7BIT Content-type: text/plain; charset=US-ASCII; format=flowed; delsp=yes Received: from [192.168.1.95] (209-128-86-226.BAYAREA.NET [209.128.86.226]) by asmtp020.mac.com (Sun Java(tm) System Messaging Server 6.3-7.03 (built Aug 7 2008; 32bit)) with ESMTPSA id <0KAI000OBIFGAQ60@asmtp020.mac.com> for freebsd-geom@freebsd.org; Mon, 17 Nov 2008 20:42:53 -0800 (PST) Message-id: From: Marcel Moolenaar To: Andriy Gapon In-reply-to: <4919879E.5080900@icyb.net.ua> Date: Mon, 17 Nov 2008 20:42:51 -0800 References: <4919879E.5080900@icyb.net.ua> X-Mailer: Apple Mail (2.929.2) Cc: freebsd-geom@freebsd.org Subject: Re: "unused" partition: disklabel vs. gpart X-BeenThere: freebsd-geom@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: GEOM-specific discussions and implementations List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 18 Nov 2008 04:42:53 -0000 [sorry for the delay] On Nov 11, 2008, at 5:24 AM, Andriy Gapon wrote: > E.g. I had a label with a single partition 'd' with type unused. I > actually put ZFS pool into this partition, but marked it 'unused', so > that some smart scripts on certain live cds do not try to mount or > swappon the partitions. This worked OK with geom_bsd, but > geom_part_bsd > considered the slice entirely empty, it didn't find the 'd' > partition in it. Hmmm... Let me think about this one. While I don't like the ambiguity, if historically you could have partitions of type FS_UNUSED (other than 'c') then GPart should allow that too... -- Marcel Moolenaar xcllnt@mac.com From owner-freebsd-geom@FreeBSD.ORG Tue Nov 18 05:27:20 2008 Return-Path: Delivered-To: freebsd-geom@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 67648106564A for ; Tue, 18 Nov 2008 05:27:20 +0000 (UTC) (envelope-from xcllnt@mac.com) Received: from asmtpout021.mac.com (asmtpout021.mac.com [17.148.16.96]) by mx1.freebsd.org (Postfix) with ESMTP id 52C668FC0A for ; Tue, 18 Nov 2008 05:27:20 +0000 (UTC) (envelope-from xcllnt@mac.com) MIME-version: 1.0 Content-transfer-encoding: 7BIT Content-type: text/plain; charset=US-ASCII; format=flowed; delsp=yes Received: from [192.168.1.95] (209-128-86-226.BAYAREA.NET [209.128.86.226]) by asmtp021.mac.com (Sun Java(tm) System Messaging Server 6.3-7.03 (built Aug 7 2008; 32bit)) with ESMTPSA id <0KAI00EI3KHJZ390@asmtp021.mac.com>; Mon, 17 Nov 2008 21:27:20 -0800 (PST) Message-id: From: Marcel Moolenaar To: Andriy Gapon In-reply-to: <49198A1A.3080600@icyb.net.ua> Date: Mon, 17 Nov 2008 21:27:18 -0800 References: <4911C3E9.405@icyb.net.ua> <49198A1A.3080600@icyb.net.ua> X-Mailer: Apple Mail (2.929.2) Cc: freebsd-fs@freebsd.org, freebsd-geom@freebsd.org Subject: Re: zfs: affected by geom_(mbr|bsd) => geom_part_(mbr|bsd) ? X-BeenThere: freebsd-geom@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: GEOM-specific discussions and implementations List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 18 Nov 2008 05:27:20 -0000 [sorry for the delay] On Nov 11, 2008, at 5:35 AM, Andriy Gapon wrote: > on 05/11/2008 18:03 Andriy Gapon said the following: >> Using GENERIC amd64 7-BETA2 system (installed from "official" ISO) I *snip* >> Then I built a custom kernel with nooptions for GEOM_(BSD|MBR) and >> options for GEOM_PART_(BSD|MBR). When I tried to boot this kernel it >> couldn't mount ZFS root and I simply rebooted my machine when I >> stuck at >> mountroot prompt (I couldn't enter UFS2 root because of unrelated >> keyboard problem). >> The boot was verbose and I didn't see any peculiar GEOM or GEOM_PART >> messages (errors, warnings). The problem is very likely related to change 184204. This change fixes a conflict between MBR and BSD. Unfortunately this fix wasn't in 7.1-BETA2. You should not have a problem with 7.1-RELEASE (nor 7-STABLE). FYI, -- Marcel Moolenaar xcllnt@mac.com From owner-freebsd-geom@FreeBSD.ORG Tue Nov 18 05:56:39 2008 Return-Path: Delivered-To: freebsd-geom@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 6B7421065673 for ; Tue, 18 Nov 2008 05:56:39 +0000 (UTC) (envelope-from xcllnt@mac.com) Received: from asmtpout015.mac.com (asmtpout015.mac.com [17.148.16.90]) by mx1.freebsd.org (Postfix) with ESMTP id 5633C8FC12 for ; Tue, 18 Nov 2008 05:56:39 +0000 (UTC) (envelope-from xcllnt@mac.com) MIME-version: 1.0 Content-transfer-encoding: 7BIT Content-type: text/plain; charset=US-ASCII; format=flowed; delsp=yes Received: from [192.168.1.95] (209-128-86-226.BAYAREA.NET [209.128.86.226]) by asmtp015.mac.com (Sun Java(tm) System Messaging Server 6.3-7.03 (built Aug 7 2008; 32bit)) with ESMTPSA id <0KAI0002ILU9DB60@asmtp015.mac.com> for freebsd-geom@freebsd.org; Mon, 17 Nov 2008 21:56:39 -0800 (PST) Message-id: From: Marcel Moolenaar To: Andriy Gapon In-reply-to: Date: Mon, 17 Nov 2008 21:56:33 -0800 References: <4919879E.5080900@icyb.net.ua> X-Mailer: Apple Mail (2.929.2) Cc: freebsd-geom@freebsd.org Subject: Re: "unused" partition: disklabel vs. gpart X-BeenThere: freebsd-geom@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: GEOM-specific discussions and implementations List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 18 Nov 2008 05:56:39 -0000 On Nov 17, 2008, at 8:42 PM, Marcel Moolenaar wrote: > [sorry for the delay] > > On Nov 11, 2008, at 5:24 AM, Andriy Gapon wrote: > >> E.g. I had a label with a single partition 'd' with type unused. I >> actually put ZFS pool into this partition, but marked it 'unused', so >> that some smart scripts on certain live cds do not try to mount or >> swappon the partitions. This worked OK with geom_bsd, but >> geom_part_bsd >> considered the slice entirely empty, it didn't find the 'd' >> partition in it. > > Hmmm... Let me think about this one. While I don't > like the ambiguity, if historically you could have > partitions of type FS_UNUSED (other than 'c') then > GPart should allow that too... I fixed GPart. Thanks for pointing it out. -- Marcel Moolenaar xcllnt@mac.com From owner-freebsd-geom@FreeBSD.ORG Tue Nov 18 08:05:57 2008 Return-Path: Delivered-To: freebsd-geom@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 7EDC4106564A for ; Tue, 18 Nov 2008 08:05:57 +0000 (UTC) (envelope-from avg@icyb.net.ua) Received: from hosted.kievnet.com (hosted.kievnet.com [193.138.144.10]) by mx1.freebsd.org (Postfix) with ESMTP id 39DFA8FC0A for ; Tue, 18 Nov 2008 08:05:57 +0000 (UTC) (envelope-from avg@icyb.net.ua) Received: from localhost ([127.0.0.1] helo=edge.pp.kiev.ua) by hosted.kievnet.com with esmtpa (Exim 4.62) (envelope-from ) id 1L2Las-0000cq-UL; Tue, 18 Nov 2008 10:05:54 +0200 Message-ID: <4922775D.6050701@icyb.net.ua> Date: Tue, 18 Nov 2008 10:05:49 +0200 From: Andriy Gapon User-Agent: Thunderbird 2.0.0.17 (X11/20081005) MIME-Version: 1.0 To: Marcel Moolenaar References: <4919879E.5080900@icyb.net.ua> In-Reply-To: Content-Type: text/plain; charset=ISO-8859-1; format=flowed Content-Transfer-Encoding: 7bit Cc: freebsd-geom@freebsd.org Subject: Re: "unused" partition: disklabel vs. gpart X-BeenThere: freebsd-geom@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: GEOM-specific discussions and implementations List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 18 Nov 2008 08:05:57 -0000 on 18/11/2008 07:56 Marcel Moolenaar said the following: > > On Nov 17, 2008, at 8:42 PM, Marcel Moolenaar wrote: > >> [sorry for the delay] >> >> On Nov 11, 2008, at 5:24 AM, Andriy Gapon wrote: >> >>> E.g. I had a label with a single partition 'd' with type unused. I >>> actually put ZFS pool into this partition, but marked it 'unused', so >>> that some smart scripts on certain live cds do not try to mount or >>> swappon the partitions. This worked OK with geom_bsd, but geom_part_bsd >>> considered the slice entirely empty, it didn't find the 'd' partition >>> in it. >> >> Hmmm... Let me think about this one. While I don't >> like the ambiguity, if historically you could have >> partitions of type FS_UNUSED (other than 'c') then >> GPart should allow that too... > > I fixed GPart. > Thanks for pointing it out. > Thank you! -- Andriy Gapon From owner-freebsd-geom@FreeBSD.ORG Tue Nov 18 08:10:30 2008 Return-Path: Delivered-To: freebsd-geom@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id CFC03106564A; Tue, 18 Nov 2008 08:10:30 +0000 (UTC) (envelope-from avg@icyb.net.ua) Received: from hosted.kievnet.com (hosted.kievnet.com [193.138.144.10]) by mx1.freebsd.org (Postfix) with ESMTP id 892A48FC0A; Tue, 18 Nov 2008 08:10:30 +0000 (UTC) (envelope-from avg@icyb.net.ua) Received: from localhost ([127.0.0.1] helo=edge.pp.kiev.ua) by hosted.kievnet.com with esmtpa (Exim 4.62) (envelope-from ) id 1L2LfJ-0000lE-OP; Tue, 18 Nov 2008 10:10:29 +0200 Message-ID: <49227875.6090902@icyb.net.ua> Date: Tue, 18 Nov 2008 10:10:29 +0200 From: Andriy Gapon User-Agent: Thunderbird 2.0.0.17 (X11/20081005) MIME-Version: 1.0 To: Marcel Moolenaar References: <4911C3E9.405@icyb.net.ua> <49198A1A.3080600@icyb.net.ua> In-Reply-To: Content-Type: text/plain; charset=ISO-8859-1; format=flowed Content-Transfer-Encoding: 7bit Cc: freebsd-fs@freebsd.org, freebsd-geom@freebsd.org Subject: Re: zfs: affected by geom_(mbr|bsd) => geom_part_(mbr|bsd) ? X-BeenThere: freebsd-geom@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: GEOM-specific discussions and implementations List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 18 Nov 2008 08:10:30 -0000 on 18/11/2008 07:27 Marcel Moolenaar said the following: > [sorry for the delay] > > On Nov 11, 2008, at 5:35 AM, Andriy Gapon wrote: > >> on 05/11/2008 18:03 Andriy Gapon said the following: >>> Using GENERIC amd64 7-BETA2 system (installed from "official" ISO) I > *snip* >>> Then I built a custom kernel with nooptions for GEOM_(BSD|MBR) and >>> options for GEOM_PART_(BSD|MBR). When I tried to boot this kernel it >>> couldn't mount ZFS root and I simply rebooted my machine when I stuck at >>> mountroot prompt (I couldn't enter UFS2 root because of unrelated >>> keyboard problem). >>> The boot was verbose and I didn't see any peculiar GEOM or GEOM_PART >>> messages (errors, warnings). > > The problem is very likely related to change 184204. This > change fixes a conflict between MBR and BSD. Unfortunately > this fix wasn't in 7.1-BETA2. You should not have a problem > with 7.1-RELEASE (nor 7-STABLE). Marcel, this particular change was definitely in kernel. As I reported in subsequent posts gpart show reported everything correctly and device node existed in dev, etc. UFS was happy about all its partitions, only ZFS had trouble. I think that this was something different, more subtle. -- Andriy Gapon From owner-freebsd-geom@FreeBSD.ORG Tue Nov 18 16:45:39 2008 Return-Path: Delivered-To: freebsd-geom@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 3ABDE1065673; Tue, 18 Nov 2008 16:45:39 +0000 (UTC) (envelope-from xcllnt@mac.com) Received: from asmtpout020.mac.com (asmtpout020.mac.com [17.148.16.95]) by mx1.freebsd.org (Postfix) with ESMTP id 27D7C8FC1E; Tue, 18 Nov 2008 16:45:38 +0000 (UTC) (envelope-from xcllnt@mac.com) MIME-version: 1.0 Content-transfer-encoding: 7BIT Content-type: text/plain; charset=US-ASCII; format=flowed; delsp=yes Received: from [192.168.1.95] (209-128-86-226.BAYAREA.NET [209.128.86.226]) by asmtp020.mac.com (Sun Java(tm) System Messaging Server 6.3-7.03 (built Aug 7 2008; 32bit)) with ESMTPSA id <0KAJ00EGAFW19P20@asmtp020.mac.com>; Tue, 18 Nov 2008 08:45:38 -0800 (PST) Message-id: <93FC5F5D-91CD-450B-B08D-5C5EC5A1C880@mac.com> From: Marcel Moolenaar To: Andriy Gapon In-reply-to: <49227875.6090902@icyb.net.ua> Date: Tue, 18 Nov 2008 08:45:36 -0800 References: <4911C3E9.405@icyb.net.ua> <49198A1A.3080600@icyb.net.ua> <49227875.6090902@icyb.net.ua> X-Mailer: Apple Mail (2.929.2) Cc: freebsd-fs@freebsd.org, freebsd-geom@freebsd.org Subject: Re: zfs: affected by geom_(mbr|bsd) => geom_part_(mbr|bsd) ? X-BeenThere: freebsd-geom@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: GEOM-specific discussions and implementations List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 18 Nov 2008 16:45:39 -0000 On Nov 18, 2008, at 12:10 AM, Andriy Gapon wrote: > on 18/11/2008 07:27 Marcel Moolenaar said the following: >> [sorry for the delay] >> On Nov 11, 2008, at 5:35 AM, Andriy Gapon wrote: >>> on 05/11/2008 18:03 Andriy Gapon said the following: >>>> Using GENERIC amd64 7-BETA2 system (installed from "official" >>>> ISO) I >> *snip* >>>> Then I built a custom kernel with nooptions for GEOM_(BSD|MBR) and >>>> options for GEOM_PART_(BSD|MBR). When I tried to boot this kernel >>>> it >>>> couldn't mount ZFS root and I simply rebooted my machine when I >>>> stuck at >>>> mountroot prompt (I couldn't enter UFS2 root because of unrelated >>>> keyboard problem). >>>> The boot was verbose and I didn't see any peculiar GEOM or >>>> GEOM_PART >>>> messages (errors, warnings). >> The problem is very likely related to change 184204. This >> change fixes a conflict between MBR and BSD. Unfortunately >> this fix wasn't in 7.1-BETA2. You should not have a problem >> with 7.1-RELEASE (nor 7-STABLE). > > Marcel, > > this particular change was definitely in kernel. > As I reported in subsequent posts gpart show reported everything > correctly and device node existed in dev, etc. UFS was happy about > all its partitions, only ZFS had trouble. I think that this was > something different, more subtle. Hmmm... this goes over my head. Some ZFS guru needs to tell us what criteria are being checked exactly before a disk/provider is considered the one recorded in the meta-data. -- Marcel Moolenaar xcllnt@mac.com From owner-freebsd-geom@FreeBSD.ORG Tue Nov 18 17:29:45 2008 Return-Path: Delivered-To: freebsd-geom@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id D828D106564A; Tue, 18 Nov 2008 17:29:45 +0000 (UTC) (envelope-from avg@icyb.net.ua) Received: from citadel.icyb.net.ua (citadel.icyb.net.ua [212.40.38.140]) by mx1.freebsd.org (Postfix) with ESMTP id CA2D68FC14; Tue, 18 Nov 2008 17:29:44 +0000 (UTC) (envelope-from avg@icyb.net.ua) Received: from odyssey.starpoint.kiev.ua (alpha-e.starpoint.kiev.ua [212.40.38.101]) by citadel.icyb.net.ua (8.8.8p3/ICyb-2.3exp) with ESMTP id TAA28886; Tue, 18 Nov 2008 19:29:38 +0200 (EET) (envelope-from avg@icyb.net.ua) Message-ID: <4922FB81.50608@icyb.net.ua> Date: Tue, 18 Nov 2008 19:29:37 +0200 From: Andriy Gapon User-Agent: Thunderbird 2.0.0.17 (X11/20081106) MIME-Version: 1.0 To: Marcel Moolenaar References: <4911C3E9.405@icyb.net.ua> <49198A1A.3080600@icyb.net.ua> <49227875.6090902@icyb.net.ua> <93FC5F5D-91CD-450B-B08D-5C5EC5A1C880@mac.com> In-Reply-To: <93FC5F5D-91CD-450B-B08D-5C5EC5A1C880@mac.com> Content-Type: text/plain; charset=ISO-8859-1 Content-Transfer-Encoding: 7bit Cc: freebsd-fs@freebsd.org, freebsd-geom@freebsd.org Subject: Re: zfs: affected by geom_(mbr|bsd) => geom_part_(mbr|bsd) ? X-BeenThere: freebsd-geom@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: GEOM-specific discussions and implementations List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 18 Nov 2008 17:29:46 -0000 I just remembered that I saved old zpool.cache file before "migrating" the pool. I looked at the diff of hexdumps and there are a number of differences, it's hard to understand them because the file is binary (actually it seems to contain serialized name-value pairs), but one difference is prominent: ... 00000260 64 65 76 69 64 00 00 00 00 00 00 09 00 00 00 01 |devid...........| ... -00000270 00 00 00 15 61 64 3a 47 45 41 35 33 34 52 46 30 |....ad:GEA534RF0| -00000280 54 4b 33 35 41 73 31 73 33 00 00 00 00 00 00 28 |TK35As1s3......(| ... +00000270 00 00 00 11 61 64 3a 47 45 41 35 33 34 52 46 30 |....ad:GEA534RF0| +00000280 54 4b 33 35 41 00 00 00 00 00 00 28 00 00 00 28 |TK35A......(...(| ... It looks like old "devid" value is "ad:GEA534RF0TK35As1s3" and new one is "ad:GEA534RF0TK35A". Just a reminder: actual zpool device is ad6s2d. The new value is what is reported by diskinfo: $ diskinfo -v ad6 ad6 ... ad:GEA534RF0TK35A # Disk ident. $ diskinfo -v ad6s2 ad6s2 ... ad:GEA534RF0TK35A # Disk ident. $ diskinfo -v ad6s2d ad6s2d ... ad:GEA534RF0TK35A # Disk ident. Hmm, "indent" is reported to be the same for all three entities. I don't remember what diskinfo reported with pre-gpart kernel, but I suspect that it was something different. Could anybody please check this? (on 7.X machine without GEOM_PART). I quickly glimpsed through sources and it seems that this comes from DIOCGIDENT GEOM ioctl i.e. "GEOM::ident" attribute. It seems that geom_slice.c code has some special handling for that. -- Andriy Gapon From owner-freebsd-geom@FreeBSD.ORG Tue Nov 18 19:50:01 2008 Return-Path: Delivered-To: freebsd-geom@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id D0BD7106564A; Tue, 18 Nov 2008 19:50:01 +0000 (UTC) (envelope-from xcllnt@mac.com) Received: from asmtpout015.mac.com (asmtpout015.mac.com [17.148.16.90]) by mx1.freebsd.org (Postfix) with ESMTP id B938C8FC16; Tue, 18 Nov 2008 19:50:01 +0000 (UTC) (envelope-from xcllnt@mac.com) MIME-version: 1.0 Content-type: multipart/mixed; boundary="Boundary_(ID_Q/RDFC20R9f2Fuvk1My3VQ)" Received: from mverma-lt.jnpr.net (natint3.juniper.net [66.129.224.36]) by asmtp015.mac.com (Sun Java(tm) System Messaging Server 6.3-7.03 (built Aug 7 2008; 32bit)) with ESMTPSA id <0KAJ00G9MOFC1K40@asmtp015.mac.com>; Tue, 18 Nov 2008 11:50:01 -0800 (PST) Message-id: <022C4222-63B2-4535-8B7E-0426E9CE2BEA@mac.com> From: Marcel Moolenaar To: Andriy Gapon In-reply-to: <4922FB81.50608@icyb.net.ua> Date: Tue, 18 Nov 2008 11:49:59 -0800 References: <4911C3E9.405@icyb.net.ua> <49198A1A.3080600@icyb.net.ua> <49227875.6090902@icyb.net.ua> <93FC5F5D-91CD-450B-B08D-5C5EC5A1C880@mac.com> <4922FB81.50608@icyb.net.ua> X-Mailer: Apple Mail (2.929.2) Cc: freebsd-fs@freebsd.org, freebsd-geom@freebsd.org Subject: Re: zfs: affected by geom_(mbr|bsd) => geom_part_(mbr|bsd) ? X-BeenThere: freebsd-geom@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: GEOM-specific discussions and implementations List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 18 Nov 2008 19:50:01 -0000 --Boundary_(ID_Q/RDFC20R9f2Fuvk1My3VQ) Content-type: text/plain; charset=US-ASCII; format=flowed; delsp=yes Content-transfer-encoding: 7BIT On Nov 18, 2008, at 9:29 AM, Andriy Gapon wrote: > I just remembered that I saved old zpool.cache file before "migrating" > the pool. > I looked at the diff of hexdumps and there are a number of > differences, > it's hard to understand them because the file is binary (actually it > seems to contain serialized name-value pairs), but one difference is > prominent: > ... > 00000260 64 65 76 69 64 00 00 00 00 00 00 09 00 00 00 01 > |devid...........| > ... > -00000270 00 00 00 15 61 64 3a 47 45 41 35 33 34 52 46 30 > |....ad:GEA534RF0| > -00000280 54 4b 33 35 41 73 31 73 33 00 00 00 00 00 00 28 > |TK35As1s3......(| > ... > +00000270 00 00 00 11 61 64 3a 47 45 41 35 33 34 52 46 30 > |....ad:GEA534RF0| > +00000280 54 4b 33 35 41 00 00 00 00 00 00 28 00 00 00 28 > |TK35A......(...(| > ... > > It looks like old "devid" value is "ad:GEA534RF0TK35As1s3" and new one > is "ad:GEA534RF0TK35A". Just a reminder: actual zpool device is > ad6s2d. > > The new value is what is reported by diskinfo: > $ diskinfo -v ad6 > ad6 > ... > ad:GEA534RF0TK35A # Disk ident. > > $ diskinfo -v ad6s2 > ad6s2 > ... > ad:GEA534RF0TK35A # Disk ident. > > $ diskinfo -v ad6s2d > ad6s2d > ... > ad:GEA534RF0TK35A # Disk ident. > > Hmm, "indent" is reported to be the same for all three entities. > > I don't remember what diskinfo reported with pre-gpart kernel, but I > suspect that it was something different. > Could anybody please check this? (on 7.X machine without GEOM_PART). > > I quickly glimpsed through sources and it seems that this comes from > DIOCGIDENT GEOM ioctl i.e. "GEOM::ident" attribute. It seems that > geom_slice.c code has some special handling for that. Interesting. Can you try the attached patch to GPart: -- Marcel Moolenaar xcllnt@mac.com --Boundary_(ID_Q/RDFC20R9f2Fuvk1My3VQ) Content-type: application/octet-stream; x-unix-mode=0644; name=gpart.diff Content-transfer-encoding: 7bit Content-disposition: attachment; filename=gpart.diff Index: part/g_part.c =================================================================== --- part/g_part.c (revision 185030) +++ part/g_part.c (working copy) @@ -1632,6 +1632,32 @@ } static void +g_part_done(struct bio *bp) +{ + char idx[8]; + struct g_part_entry *entry; + struct g_provider *pp; + size_t sz; + + /* + * Add partition index to the ident received from the + * underlying provider. This makes GPart compatible + * with partitioning schemes using geom_slice. ZFS, + * for example, compares the ident with on-disk meta- + * data and a mismatch causes the slice to be rejected. + */ + if (bp->bio_error == 0 && bp->bio_data[0] != '\0') { + pp = bp->bio_to; + entry = pp->private; + snprintf(idx, sizeof(idx), "s%d", entry->gpe_index); + sz = strlcat(bp->bio_data, idx, bp->bio_length); + if (sz >= bp->bio_length) + bp->bio_error = ENOSPC; + } + g_std_done(bp); +} + +static void g_part_start(struct bio *bp) { struct bio *bp2; @@ -1641,6 +1667,7 @@ struct g_part_table *table; struct g_kerneldump *gkd; struct g_provider *pp; + void (*bio_done)(struct bio *); pp = bp->bio_to; gp = pp->geom; @@ -1656,6 +1683,8 @@ return; } + bio_done = g_std_done; + switch(bp->bio_cmd) { case BIO_DELETE: case BIO_READ: @@ -1689,6 +1718,10 @@ if (g_handleattr_int(bp, "PART::offset", table->gpt_offset + entry->gpe_start)) return; + if (!strcmp("GEOM::ident", bp->bio_attribute)) { + bio_done = g_part_done; + break; + } if (!strcmp("GEOM::kerneldump", bp->bio_attribute)) { /* * Check that the partition is suitable for kernel @@ -1719,7 +1752,7 @@ g_io_deliver(bp, ENOMEM); return; } - bp2->bio_done = g_std_done; + bp2->bio_done = bio_done; g_io_request(bp2, cp); } --Boundary_(ID_Q/RDFC20R9f2Fuvk1My3VQ)-- From owner-freebsd-geom@FreeBSD.ORG Sat Nov 22 00:53:15 2008 Return-Path: Delivered-To: freebsd-geom@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id D9B521065670 for ; Sat, 22 Nov 2008 00:53:15 +0000 (UTC) (envelope-from joeyea323@gmail.com) Received: from rn-out-0910.google.com (rn-out-0910.google.com [64.233.170.189]) by mx1.freebsd.org (Postfix) with ESMTP id 891688FC14 for ; Sat, 22 Nov 2008 00:53:15 +0000 (UTC) (envelope-from joeyea323@gmail.com) Received: by rn-out-0910.google.com with SMTP id j71so988999rne.12 for ; Fri, 21 Nov 2008 16:53:15 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=gamma; h=domainkey-signature:received:received:message-id:date:from:to :subject:mime-version:content-type; bh=t8EO8zZP66ArVi3Phd+h+yYDlVw5/vbnLfD37tBDtN0=; b=N0b+K74Pm8l4KYiEP4GvqdGTe7N3Esm1vnO9MwsZZFHzWQb6PgTiPI2O+AaR8bkTBs CGxn4HF4EH3aviii9vo/OOtdF2MueRwEKuxuyK2YYWBRNPBrZL9Qgu1g+fbeL6cLHoZG TVcZDonrY0LlACTiA4fD9PywmngcibWRrZN+E= DomainKey-Signature: a=rsa-sha1; c=nofws; d=gmail.com; s=gamma; h=message-id:date:from:to:subject:mime-version:content-type; b=W/V7xwrCKUnoEBL+e9hsx1CQVvp0NcHNeQMjOiIZCQZYjKwY0fiPbkuf+phx9Ojdf/ BlCaOmjMvuCJoM5ctafOtcpa3Rwjzk8EcATu2T0WOQXK1wzMnXR7mrwNaIhGRtCBFdud IAUXgiU7JzR42oFsEtEGJmA2nPffkezqOukkQ= Received: by 10.100.131.16 with SMTP id e16mr519291and.67.1227313993362; Fri, 21 Nov 2008 16:33:13 -0800 (PST) Received: by 10.100.108.8 with HTTP; Fri, 21 Nov 2008 16:33:13 -0800 (PST) Message-ID: <44f12db00811211633w52c7b600s20e13f4255a82948@mail.gmail.com> Date: Sat, 22 Nov 2008 03:33:13 +0300 From: "Joseph Yeager" To: freebsd-geom@freebsd.org MIME-Version: 1.0 Content-Type: text/plain; charset=ISO-8859-1 Content-Transfer-Encoding: 7bit Content-Disposition: inline X-Content-Filtered-By: Mailman/MimeDel 2.1.5 Subject: GGatec Performance X-BeenThere: freebsd-geom@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: GEOM-specific discussions and implementations List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 22 Nov 2008 00:53:16 -0000 I've been messing around ggatec lately and have noticed that I see a drastic decrease in write speed when I share out devices as opposed to files. For instance, lets say Server2 is trying to share a drive to Server1. Server2 has 2 partitions, one for the OS and the other for the share. If I do a newfs on the 2nd partition, mount it, and create a large file on the mount I can expect a slowdown of about 5-10MB/s compared to native speed (the drive writes at about 50-55MB/s natively) when writing over the network. If I were to, instead, do the same as above except dont bother mounting and creating a large file and just sharing out the device I see a major slowdown. Where I can easily get 40-50MB/s with the former method, the latter method has trouble hitting 15MB/s. Sometimes it will barely hit 5MB/s! I see two possible solutions here that I hope someone can help me with: 1. Perhaps there are some performance tuning steps I can do to alleviate this problem or perhaps this is the incorrect way to share it out. 2. Is there any way to quickly create large files? I do like this approach better as this gives me a better way to subdivide the share. The only problem is that even at over 50MB/s, dd will still take a very long time to create a 500GB file. Thanks for your help, Joe