From owner-freebsd-fs@freebsd.org Sun Jan 14 00:15:43 2018 Return-Path: Delivered-To: freebsd-fs@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 0BC2AE6276C for ; Sun, 14 Jan 2018 00:15:43 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.ysv.freebsd.org (mxrelay.ysv.freebsd.org [IPv6:2001:1900:2254:206a::19:3]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client CN "mxrelay.ysv.freebsd.org", Issuer "Let's Encrypt Authority X3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id E6DCB7F6A8 for ; Sun, 14 Jan 2018 00:15:42 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2001:1900:2254:206a::16:76]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mxrelay.ysv.freebsd.org (Postfix) with ESMTPS id DC27027E64 for ; Sun, 14 Jan 2018 00:15:42 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.118]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id w0E0FgCa014606 for ; Sun, 14 Jan 2018 00:15:42 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id w0E0Fgw2014604 for freebsd-fs@FreeBSD.org; Sun, 14 Jan 2018 00:15:42 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: freebsd-fs@FreeBSD.org Subject: [Bug 221075] regression: 11.1 is unable to mount ZFS / on boot Date: Sun, 14 Jan 2018 00:15:42 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 11.1-RELEASE X-Bugzilla-Keywords: regression X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: seschwar@gmail.com X-Bugzilla-Status: New X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: freebsd-fs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.25 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 14 Jan 2018 00:15:43 -0000 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D221075 --- Comment #16 from Sebastian Schwarz --- Originally I created both the GPT and the ZFS pool on Linux. I used the diskids since Linux doesn't have consistent device enumeration. To get additional data points I put that disk into a Lenovo ThinkPad Edge E= 540 which also has an SD card reader. It exhibits the same behavior as my Dell Precision M4600. FreeBSD can't find the disk unless the SD card modules are disabled. The previous installations of FreeBSD 11.1-RELEASE I did on the disk were performed manually into the already existing ZFS pool. When I performed a fresh guided installation (ZFS, UEFI) on the Lenovo from the USB installer = the system booted. I'll be trying out a few more things to narrow down what caused my disk to = be unbootable. --=20 You are receiving this mail because: You are the assignee for the bug.= From owner-freebsd-fs@freebsd.org Sun Jan 14 00:19:33 2018 Return-Path: Delivered-To: freebsd-fs@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id BA97AE62C74 for ; Sun, 14 Jan 2018 00:19:33 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.ysv.freebsd.org (mxrelay.ysv.freebsd.org [IPv6:2001:1900:2254:206a::19:3]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client CN "mxrelay.ysv.freebsd.org", Issuer "Let's Encrypt Authority X3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id A137A7F98B for ; Sun, 14 Jan 2018 00:19:33 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2001:1900:2254:206a::16:76]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mxrelay.ysv.freebsd.org (Postfix) with ESMTPS id 96A2827E77 for ; Sun, 14 Jan 2018 00:19:33 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.118]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id w0E0JXoE019788 for ; Sun, 14 Jan 2018 00:19:33 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id w0E0JXJB019787 for freebsd-fs@FreeBSD.org; Sun, 14 Jan 2018 00:19:33 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: freebsd-fs@FreeBSD.org Subject: [Bug 221075] geom_flashmap(4) exposes race rendering / on ZFS unbootable Date: Sun, 14 Jan 2018 00:19:33 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 11.1-RELEASE X-Bugzilla-Keywords: regression X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: seschwar@gmail.com X-Bugzilla-Status: New X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: freebsd-fs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: short_desc Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.25 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 14 Jan 2018 00:19:33 -0000 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D221075 Sebastian Schwarz changed: What |Removed |Added ---------------------------------------------------------------------------- Summary|regression: 11.1 is unable |geom_flashmap(4) exposes |to mount ZFS / on boot |race rendering / on ZFS | |unbootable --=20 You are receiving this mail because: You are the assignee for the bug.= From owner-freebsd-fs@freebsd.org Sun Jan 14 23:23:41 2018 Return-Path: Delivered-To: freebsd-fs@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 98048E635FB for ; Sun, 14 Jan 2018 23:23:41 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.ysv.freebsd.org (mxrelay.ysv.freebsd.org [IPv6:2001:1900:2254:206a::19:3]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client CN "mxrelay.ysv.freebsd.org", Issuer "Let's Encrypt Authority X3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 7E70172707 for ; Sun, 14 Jan 2018 23:23:41 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2001:1900:2254:206a::16:76]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mxrelay.ysv.freebsd.org (Postfix) with ESMTPS id 7335614812 for ; Sun, 14 Jan 2018 23:23:41 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.118]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id w0ENNfgX010722 for ; Sun, 14 Jan 2018 23:23:41 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id w0ENNf4l010721 for freebsd-fs@FreeBSD.org; Sun, 14 Jan 2018 23:23:41 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: freebsd-fs@FreeBSD.org Subject: [Bug 221075] geom_flashmap(4) exposes race rendering / on ZFS unbootable Date: Sun, 14 Jan 2018 23:23:40 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 11.1-RELEASE X-Bugzilla-Keywords: regression X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: seschwar@gmail.com X-Bugzilla-Status: New X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: freebsd-fs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: attachments.created Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.25 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 14 Jan 2018 23:23:41 -0000 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D221075 --- Comment #18 from Sebastian Schwarz --- Created attachment 189725 --> https://bugs.freebsd.org/bugzilla/attachment.cgi?id=3D189725&action= =3Dedit "gpart backup" of bad GPT --=20 You are receiving this mail because: You are the assignee for the bug.= From owner-freebsd-fs@freebsd.org Sun Jan 14 23:22:47 2018 Return-Path: Delivered-To: freebsd-fs@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 00E75E634CA for ; Sun, 14 Jan 2018 23:22:47 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.ysv.freebsd.org (mxrelay.ysv.freebsd.org [IPv6:2001:1900:2254:206a::19:3]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client CN "mxrelay.ysv.freebsd.org", Issuer "Let's Encrypt Authority X3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id DB9D0726A0 for ; Sun, 14 Jan 2018 23:22:46 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2001:1900:2254:206a::16:76]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mxrelay.ysv.freebsd.org (Postfix) with ESMTPS id B857F14807 for ; Sun, 14 Jan 2018 23:22:46 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.118]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id w0ENMkDt009374 for ; Sun, 14 Jan 2018 23:22:46 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id w0ENMkRf009373 for freebsd-fs@FreeBSD.org; Sun, 14 Jan 2018 23:22:46 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: freebsd-fs@FreeBSD.org Subject: [Bug 221075] geom_flashmap(4) exposes race rendering / on ZFS unbootable Date: Sun, 14 Jan 2018 23:22:46 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 11.1-RELEASE X-Bugzilla-Keywords: regression X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: seschwar@gmail.com X-Bugzilla-Status: New X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: freebsd-fs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.25 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 14 Jan 2018 23:22:47 -0000 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D221075 --- Comment #17 from Sebastian Schwarz --- I tried a few more things: I zfs send/recv-ed the affected dataset the previously created new FreeBSD 11.1-RELEASE installation. It booted with the GENERIC kernel. Then I used the FreeBSD installer to try to get a non-booting configuration= . I succeeded when using diskids for the ZFS pool. If I used /dev/ada0 the GEN= ERIC kernel would boot fine. Also while creating a ZFS pool on /dev/diskid/... I fiddled a bit with the GPT. I tried both 4K and 1M alignment. It made no difference. I tried different partition indices. It made no difference. Then I took the booting configuration (ZFS pool on /dev/ada0) and dd-ed the individual backed up partitions from my original setup (containing a ZFS po= ol on /dev/diskid/...) over the working ones (the partitions had the same size= and locations). The system still booted fine with the GENERIC kernel. So what difference did the initial ZFS pool on /dev/ada0 really make? Then I fiddled with the GPT again, trying different types, labels and numbe= r of entries, but it made no difference. The system remained bootable. Then I dd-ed the original GPT back into place (the partitions had the same = size and locations). But now the GENERIC kernel was unable to find my ZFS pool again. I tried fiddling with the GPT again. But it made no difference. Then I zeroed all space outside of the partitions (GPT & unused space due to alignment) and manually recreated the partition table. Now the GENERIC ker= nel was able to boot again. I attached the output of "gpart backup" of both the good and bad GPT. They only differ in two places. The partition type of the ZFS partition and the amount of entries (is that the number in the fist line?). The type doesn't matter. I can change it to both values and it doesn't make a difference. = That number in the first line is more interesting. When I first recreated the G= PT it was 128. After a reboot it was 152. The original GPT was create on Lin= ux using fdisk. I'm not really sure what's going on. Creating the ZFS pool with /dev/ada0 = like a fix but doesn't hold up to verification. Changing the partition table doesn't matter until it is was zeroed before. Maybe someone can make sense= of this... --=20 You are receiving this mail because: You are the assignee for the bug.= From owner-freebsd-fs@freebsd.org Sun Jan 14 23:24:11 2018 Return-Path: Delivered-To: freebsd-fs@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id C20D0E636D8 for ; Sun, 14 Jan 2018 23:24:11 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.ysv.freebsd.org (mxrelay.ysv.freebsd.org [IPv6:2001:1900:2254:206a::19:3]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client CN "mxrelay.ysv.freebsd.org", Issuer "Let's Encrypt Authority X3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id A926672796 for ; Sun, 14 Jan 2018 23:24:11 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2001:1900:2254:206a::16:76]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mxrelay.ysv.freebsd.org (Postfix) with ESMTPS id 9E73314819 for ; Sun, 14 Jan 2018 23:24:11 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.118]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id w0ENOBUA011434 for ; Sun, 14 Jan 2018 23:24:11 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id w0ENOBIb011433 for freebsd-fs@FreeBSD.org; Sun, 14 Jan 2018 23:24:11 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: freebsd-fs@FreeBSD.org Subject: [Bug 221075] geom_flashmap(4) exposes race rendering / on ZFS unbootable Date: Sun, 14 Jan 2018 23:24:11 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 11.1-RELEASE X-Bugzilla-Keywords: regression X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: seschwar@gmail.com X-Bugzilla-Status: New X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: freebsd-fs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: attachments.created Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.25 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 14 Jan 2018 23:24:11 -0000 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D221075 --- Comment #19 from Sebastian Schwarz --- Created attachment 189726 --> https://bugs.freebsd.org/bugzilla/attachment.cgi?id=3D189726&action= =3Dedit "gpt backup" of good GPT --=20 You are receiving this mail because: You are the assignee for the bug.= From owner-freebsd-fs@freebsd.org Mon Jan 15 16:01:43 2018 Return-Path: Delivered-To: freebsd-fs@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 4070DEB6F21 for ; Mon, 15 Jan 2018 16:01:43 +0000 (UTC) (envelope-from borjam@sarenet.es) Received: from cu01176b.smtpx.saremail.com (cu01176b.smtpx.saremail.com [195.16.151.151]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 0806C7E42C for ; Mon, 15 Jan 2018 16:01:42 +0000 (UTC) (envelope-from borjam@sarenet.es) Received: from [172.16.8.47] (unknown [192.148.167.11]) by proxypop01.sare.net (Postfix) with ESMTPA id 42D049DD818; Mon, 15 Jan 2018 16:54:10 +0100 (CET) Content-Type: text/plain; charset=utf-8 Mime-Version: 1.0 (Mac OS X Mail 11.2 \(3445.5.20\)) Subject: Re: Academic exercise: trying to recover a corrupted pool From: Borja Marcos In-Reply-To: Date: Mon, 15 Jan 2018 16:54:09 +0100 Cc: freebsd-fs@freebsd.org Content-Transfer-Encoding: quoted-printable Message-Id: <1DB0315C-D267-4571-864F-73D1B275111B@sarenet.es> References: To: Borja Marcos X-Mailer: Apple Mail (2.3445.5.20) X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.25 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 15 Jan 2018 16:01:43 -0000 > On 8 Jan 2018, at 15:25, Borja Marcos wrote: >=20 >=20 > Hi, >=20 > ONLY AS AN ACADEMIC EXERCISE, WARNING :) >=20 > I have a broken ZFS pool and I=E2=80=99m wondering wether it should be = readable. The pool was made with four > apparently troublesome OCZ SSD drives pulled from other systems. They = are connected to a LSI2008 adapter. >=20 > The pool was created as a raidz2, so it=E2=80=99s supposed to survive = the loss of two drives. It has lost two of them > and I am unable to import it. >=20 > I have lost no useful data, I was using it just for testing. Now it = has become an interesting study subject though :) >=20 > Any ideas? I have tried to recover even doing the =E2=80=9Cradical = thing=E2=80=9D (zdb -Z -AAA -e -p /dev poolname). No success. Now this is interesting. I copied the two surviving drives to data files = on another system using =E2=80=9Cdd=E2=80=9D. And I used mdconfig to create file backed ram disks. mdconfig -a -f /pool/disk1 mdconfig -a -f /pool/disk2 Trying an import with zpool import -R /mnt -N -m -f -F -X poolname I got a panic. Fatal trap 12: page fault while in kernel mode cpuid =3D 1; apic id =3D 02 fault virtual address =3D 0x188 fault code =3D supervisor read data, page not present instruction pointer =3D 0x20:0xffffffff81381901 stack pointer =3D 0x28:0xfffffe046bf2b250 frame pointer =3D 0x28:0xfffffe046bf2b270 code segment =3D base 0x0, limit 0xfffff, type 0x1b =3D DPL 0, pres 1, long 1, def32 0, gran 1 processor eflags =3D interrupt enabled, resume, IOPL =3D 0 current process =3D 0 (zio_read_intr_6_0) trap number =3D 12 panic: page fault cpuid =3D 1 KDB: stack backtrace: #0 0xffffffff806e3c17 at kdb_backtrace+0x67 #1 0xffffffff806a0176 at vpanic+0x186 #2 0xffffffff8069ffe3 at panic+0x43 #3 0xffffffff809953bd at trap_fatal+0x34d #4 0xffffffff80995419 at trap_pfault+0x49 #5 0xffffffff80994c6a at trap+0x29a #6 0xffffffff80979bb1 at calltrap+0x8 #7 0xffffffff81380fba at vdev_queue_io_to_issue+0x23a #8 0xffffffff81380d33 at vdev_queue_io+0x103 #9 0xffffffff813a3bbc at zio_vdev_io_start+0x24c #10 0xffffffff813a05bc at zio_execute+0xac #11 0xffffffff8139ff0b at zio_nowait+0xcb #12 0xffffffff8138205c at vdev_raidz_io_start+0x48c #13 0xffffffff813a3c1d at zio_vdev_io_start+0x2ad #14 0xffffffff813a05bc at zio_execute+0xac #15 0xffffffff8139ff0b at zio_nowait+0xcb #16 0xffffffff813802f1 at vdev_mirror_io_done+0x1f1 #17 0xffffffff813a3f58 at zio_vdev_io_done+0x1c8 Uptime: 27d3h5m23s =20= From owner-freebsd-fs@freebsd.org Mon Jan 15 23:18:33 2018 Return-Path: Delivered-To: freebsd-fs@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 6EC1DE7E36B for ; Mon, 15 Jan 2018 23:18:33 +0000 (UTC) (envelope-from Mark.Martinec+freebsd@ijs.si) Received: from mail.ijs.si (mail.ijs.si [IPv6:2001:1470:ff80::25]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 2CF7E753EA for ; Mon, 15 Jan 2018 23:18:33 +0000 (UTC) (envelope-from Mark.Martinec+freebsd@ijs.si) Received: from amavis-ori.ijs.si (localhost [IPv6:::1]) by mail.ijs.si (Postfix) with ESMTP id 3zL8RT2Xthz3TQ for ; Tue, 16 Jan 2018 00:18:29 +0100 (CET) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/simple; d=ijs.si; h= user-agent:message-id:organization:subject:subject:from:from :date:date:content-transfer-encoding:content-type:content-type :mime-version:received:received:received:received; s=jakla4; t= 1516058305; x=1518650306; bh=LRGASlVnSf5ALMyIKWD4GLTbSQlekxluViZ ozddJ7Jg=; b=blOf7CSLhlt2kmzRPfxWYDr0CFoveFsTQT6vJ/RqTMG2vi6oKsB NjK1vomCAUOD5HBCnnNNHcDPsA3ag7sfGIq+h88FpoMH7PKWH+qCZ1gl73Vkp7ss rpDo40BIw7gP5jfc9kMb+xrKGXAQ3m2Ok3PG9SglwY0AzE85+KX9GbPE= X-Virus-Scanned: amavisd-new at ijs.si Received: from mail.ijs.si ([IPv6:::1]) by amavis-ori.ijs.si (mail.ijs.si [IPv6:::1]) (amavisd-new, port 10026) with LMTP id eXYKlwAx8wF2 for ; Tue, 16 Jan 2018 00:18:25 +0100 (CET) Received: from mildred.ijs.si (mailbox.ijs.si [IPv6:2001:1470:ff80::143:1]) by mail.ijs.si (Postfix) with ESMTP id 3zL8RP6DwRz3TP for ; Tue, 16 Jan 2018 00:18:25 +0100 (CET) Received: from nabiralnik.ijs.si (nabiralnik.ijs.si [IPv6:2001:1470:ff80::80:16]) by mildred.ijs.si (Postfix) with ESMTP id 3zL8RP4mgyzrt for ; Tue, 16 Jan 2018 00:18:25 +0100 (CET) Received: from sleepy.ijs.si (2001:1470:ff80:e001::76) by webmail.ijs.si with HTTP (HTTP/1.1 POST); Tue, 16 Jan 2018 00:18:25 +0100 MIME-Version: 1.0 Content-Type: text/plain; charset=US-ASCII; format=flowed Content-Transfer-Encoding: 7bit Date: Tue, 16 Jan 2018 00:18:25 +0100 From: Mark Martinec To: freebsd-fs@freebsd.org Subject: Reducing ZFS fragmentation by copying to larger disk Organization: Jozef Stefan Institute Message-ID: X-Sender: Mark.Martinec+freebsd@ijs.si User-Agent: Roundcube Webmail/1.3.1 X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.25 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 15 Jan 2018 23:18:33 -0000 Having a ZFS filesystem with two 4 TB disks in a mirror that is 85 % full and apparently pretty much fragmented (scrubs or a resilver takes excessively long time), I intend to move its contents to a new pair of disks twice the size. My question is what method to use so that in the end the copy will be less fragmented: 1. attach new disks to a ZFS mirror and let them resilver, then remove the old disks (Would the copied content be any less fragmented, or perhaps would the added free space just relieve some of the problem?) 2. use zfs send / receive to make a copy (is this any better than method #1 ?) 3. use rsync to make a copy (losing snapshots, and would likely take much longer) Mark From owner-freebsd-fs@freebsd.org Tue Jan 16 00:34:12 2018 Return-Path: Delivered-To: freebsd-fs@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id BA205EA7739 for ; Tue, 16 Jan 2018 00:34:12 +0000 (UTC) (envelope-from bfriesen@simple.dallas.tx.us) Received: from smtp.simplesystems.org (smtp.simplesystems.org [65.66.246.90]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 8A15278232 for ; Tue, 16 Jan 2018 00:34:11 +0000 (UTC) (envelope-from bfriesen@simple.dallas.tx.us) Received: from scrappy.simplesystems.org (scrappy.simplesystems.org [65.66.246.73]) by smtp.simplesystems.org (8.14.4+Sun/8.14.4) with ESMTP id w0G0SAmG004598; Mon, 15 Jan 2018 18:28:10 -0600 (CST) Date: Mon, 15 Jan 2018 18:28:10 -0600 (CST) From: Bob Friesenhahn X-X-Sender: bfriesen@scrappy.simplesystems.org To: Mark Martinec cc: freebsd-fs@freebsd.org Subject: Re: Reducing ZFS fragmentation by copying to larger disk In-Reply-To: Message-ID: References: User-Agent: Alpine 2.20 (GSO 67 2015-01-07) MIME-Version: 1.0 Content-Type: text/plain; charset=US-ASCII; format=flowed X-Greylist: Sender IP whitelisted, not delayed by milter-greylist-4.5.16 (smtp.simplesystems.org [65.66.246.90]); Mon, 15 Jan 2018 18:28:10 -0600 (CST) X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.25 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 16 Jan 2018 00:34:12 -0000 On Tue, 16 Jan 2018, Mark Martinec wrote: > Having a ZFS filesystem with two 4 TB disks in a mirror that > is 85 % full and apparently pretty much fragmented (scrubs > or a resilver takes excessively long time), I intend to move > its contents to a new pair of disks twice the size. > > My question is what method to use so that in the end the copy will > be less fragmented: > > 1. attach new disks to a ZFS mirror and let them resilver, then > remove the old disks (Would the copied content be any less > fragmented, or perhaps would the added free space just > relieve some of the problem?) I don't think this would help with fragmentation at all. > 2. use zfs send / receive to make a copy > (is this any better than method #1 ?) This will work well as long as there is enough space to send to. It will even work within the same pool if there is enough free space. Bob -- Bob Friesenhahn bfriesen@simple.dallas.tx.us, http://www.simplesystems.org/users/bfriesen/ GraphicsMagick Maintainer, http://www.GraphicsMagick.org/ From owner-freebsd-fs@freebsd.org Tue Jan 16 04:12:14 2018 Return-Path: Delivered-To: freebsd-fs@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 58DDBE71FD1 for ; Tue, 16 Jan 2018 04:12:14 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.ysv.freebsd.org (mxrelay.ysv.freebsd.org [IPv6:2001:1900:2254:206a::19:3]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client CN "mxrelay.ysv.freebsd.org", Issuer "Let's Encrypt Authority X3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 3F5D58427D for ; Tue, 16 Jan 2018 04:12:14 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2001:1900:2254:206a::16:76]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mxrelay.ysv.freebsd.org (Postfix) with ESMTPS id 3498B23BB1 for ; Tue, 16 Jan 2018 04:12:14 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.118]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id w0G4CEgw039634 for ; Tue, 16 Jan 2018 04:12:14 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id w0G4CEHa039633 for freebsd-fs@FreeBSD.org; Tue, 16 Jan 2018 04:12:14 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: freebsd-fs@FreeBSD.org Subject: [Bug 224601] autofs: Make automount(8) call chdir("/") before create_directory() Date: Tue, 16 Jan 2018 04:12:13 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: bin X-Bugzilla-Version: CURRENT X-Bugzilla-Keywords: patch X-Bugzilla-Severity: Affects Many People X-Bugzilla-Who: pfg@FreeBSD.org X-Bugzilla-Status: New X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: freebsd-fs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: assigned_to cc Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.25 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 16 Jan 2018 04:12:14 -0000 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D224601 Pedro F. Giffuni changed: What |Removed |Added ---------------------------------------------------------------------------- Assignee|freebsd-bugs@FreeBSD.org |freebsd-fs@FreeBSD.org CC| |trasz@FreeBSD.org --- Comment #1 from Pedro F. Giffuni --- Assign it to -fs list. --=20 You are receiving this mail because: You are the assignee for the bug.= From owner-freebsd-fs@freebsd.org Tue Jan 16 14:03:20 2018 Return-Path: Delivered-To: freebsd-fs@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 2448BE7142F for ; Tue, 16 Jan 2018 14:03:20 +0000 (UTC) (envelope-from kwiat@panic.pl) Received: from mail.panic.pl (mail.panic.pl [188.68.250.13]) by mx1.freebsd.org (Postfix) with ESMTP id DB07B7AD90 for ; Tue, 16 Jan 2018 14:03:19 +0000 (UTC) (envelope-from kwiat@panic.pl) Received: from mail.panic.pl (localhost [127.0.0.1]) by mail.panic.pl (Postfix) with ESMTP id E171F42A9B for ; Tue, 16 Jan 2018 14:57:39 +0100 (CET) X-Virus-Scanned: amavisd-new at panic.pl Received: from mail.panic.pl ([127.0.0.1]) by mail.panic.pl (mail.panic.pl [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id ip2HNSIVWIpk for ; Tue, 16 Jan 2018 14:57:39 +0100 (CET) Received: from [192.168.0.28] (188.146.35.168.nat.umts.dynamic.t-mobile.pl [188.146.35.168]) by mail.panic.pl (Postfix) with ESMTPSA id E07E142A98 for ; Tue, 16 Jan 2018 14:57:38 +0100 (CET) Subject: Re: Academic exercise: trying to recover a corrupted pool To: freebsd-fs@freebsd.org References: From: Mateusz Kwiatkowski Message-ID: <19f67e4f-7df8-6184-e396-aa8cde44eb83@panic.pl> Date: Tue, 16 Jan 2018 14:57:38 +0100 User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:52.0) Gecko/20100101 Thunderbird/52.5.2 MIME-Version: 1.0 In-Reply-To: Content-Type: text/plain; charset=utf-8; format=flowed Content-Language: en-US Content-Transfer-Encoding: 8bit X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.25 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 16 Jan 2018 14:03:20 -0000 On 01/08/2018 03:25 PM, Borja Marcos wrote: > > Hi, > > ONLY AS AN ACADEMIC EXERCISE, WARNING :) > > I have a broken ZFS pool and I’m wondering wether it should be readable. The pool was made with four > apparently troublesome OCZ SSD drives pulled from other systems. They are connected to a LSI2008 adapter. > > The pool was created as a raidz2, so it’s supposed to survive the loss of two drives. It has lost two of them > and I am unable to import it. > > I have lost no useful data, I was using it just for testing. Now it has become an interesting study subject though :) > > Any ideas? I have tried to recover even doing the “radical thing” (zdb -Z -AAA -e -p /dev poolname). No success. > > Again, I am just curious. > > > Thanks! Few years ago I made similar exercise with pool broken by some ZFS on Linux bug. After many unsuccessful attempts to import the pool I came up with an idea to read data without importing the pool. Here's the script: https://gitlab.com/kwiat/zfs-recovery The code is in no way effective nor beautiful, but I learned a lot about ZFS when I was working on it. :-) -- Regards, Mateusz Kwiatkowski From owner-freebsd-fs@freebsd.org Tue Jan 16 14:56:03 2018 Return-Path: Delivered-To: freebsd-fs@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 54314E74337 for ; Tue, 16 Jan 2018 14:56:03 +0000 (UTC) (envelope-from Mark.Martinec+freebsd@ijs.si) Received: from mail.ijs.si (mail.ijs.si [IPv6:2001:1470:ff80::25]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 117D27D16A for ; Tue, 16 Jan 2018 14:56:02 +0000 (UTC) (envelope-from Mark.Martinec+freebsd@ijs.si) Received: from amavis-ori.ijs.si (localhost [IPv6:::1]) by mail.ijs.si (Postfix) with ESMTP id 3zLYFC5Q51z4jl for ; Tue, 16 Jan 2018 15:55:59 +0100 (CET) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/simple; d=ijs.si; h= user-agent:message-id:references:in-reply-to:organization :subject:subject:from:from:date:date:content-transfer-encoding :content-type:content-type:mime-version:received:received :received:received; s=jakla4; t=1516114555; x=1518706556; bh=Vm/ PejeaRFEiiyg8a7FkRV9cZOWOqVZYyehvOEwgL2c=; b=LUwSrgTl2uh/XbQuf7/ +ld1bQfGHs5PCSlTyz32cXBy/Z7Bmqr8LvbT5+Pfh/qgbawHjNrKbYrMmNl5t6Qh GhSKk3N5sk+mTQudW1rzRdR6W6Mh+jjUpxXXo1RFSMjF4y0Y9EXO9M4/YhkHeF8f 1+WfjBfMz0SlXJjtITyM4iAE= X-Virus-Scanned: amavisd-new at ijs.si Received: from mail.ijs.si ([IPv6:::1]) by amavis-ori.ijs.si (mail.ijs.si [IPv6:::1]) (amavisd-new, port 10026) with LMTP id QI5RZFvEibBG for ; Tue, 16 Jan 2018 15:55:55 +0100 (CET) Received: from mildred.ijs.si (mailbox.ijs.si [IPv6:2001:1470:ff80::143:1]) by mail.ijs.si (Postfix) with ESMTP id 3zLYF710vlz4jk for ; Tue, 16 Jan 2018 15:55:54 +0100 (CET) Received: from nabiralnik.ijs.si (nabiralnik.ijs.si [IPv6:2001:1470:ff80::80:16]) by mildred.ijs.si (Postfix) with ESMTP id 3zLYF66TVGzGW for ; Tue, 16 Jan 2018 15:55:54 +0100 (CET) Received: from neli.ijs.si (2001:1470:ff80:88:21c:c0ff:feb1:8c91) by nabiralnik.ijs.si with HTTP (HTTP/1.1 POST); Tue, 16 Jan 2018 15:55:54 +0100 MIME-Version: 1.0 Content-Type: text/plain; charset=US-ASCII; format=flowed Content-Transfer-Encoding: 7bit Date: Tue, 16 Jan 2018 15:55:54 +0100 From: Mark Martinec To: freebsd-fs@freebsd.org Subject: Re: Reducing ZFS fragmentation by copying to larger disk Organization: Jozef Stefan Institute In-Reply-To: References: Message-ID: <2bd5694830649fbe243daf533049d9d3@ijs.si> X-Sender: Mark.Martinec+freebsd@ijs.si User-Agent: Roundcube Webmail/1.3.1 X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.25 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 16 Jan 2018 14:56:03 -0000 >> 1. attach new disks to a ZFS mirror and let them resilver, ... > > I don't think this would help with fragmentation at all. Thank you for confirming my guess! >> 2. use zfs send / receive to make a copy > > [...] It will even work within the same pool if there is enough free > space. Nice, this is helpful! Mark 2018-01-16 01:28, je Bob Friesenhahn wrote: > On Tue, 16 Jan 2018, Mark Martinec wrote: >> Having a ZFS filesystem with two 4 TB disks in a mirror that >> is 85 % full and apparently pretty much fragmented (scrubs >> or a resilver takes excessively long time), I intend to move >> its contents to a new pair of disks twice the size. >> >> My question is what method to use so that in the end the copy will >> be less fragmented: >> >> 1. attach new disks to a ZFS mirror and let them resilver, then >> remove the old disks (Would the copied content be any less >> fragmented, or perhaps would the added free space just >> relieve some of the problem?) > > I don't think this would help with fragmentation at all. > >> 2. use zfs send / receive to make a copy >> (is this any better than method #1 ?) > > This will work well as long as there is enough space to send to. It > will even work within the same pool if there is enough free space. > > Bob From owner-freebsd-fs@freebsd.org Tue Jan 16 17:04:44 2018 Return-Path: Delivered-To: freebsd-fs@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 525FDE7B21A for ; Tue, 16 Jan 2018 17:04:44 +0000 (UTC) (envelope-from karli@inparadise.se) Received: from mail.inparadise.se (h-246-50.A444.priv.bahnhof.se [155.4.246.50]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id E718C82FF6 for ; Tue, 16 Jan 2018 17:04:42 +0000 (UTC) (envelope-from karli@inparadise.se) Received: from localhost (localhost [127.0.0.1]) by mail.inparadise.se (Postfix) with ESMTP id 3911F41774; Tue, 16 Jan 2018 17:59:12 +0100 (CET) Received: from mail.inparadise.se ([127.0.0.1]) by localhost (mail.inparadise.se [127.0.0.1]) (amavisd-new, port 10032) with ESMTP id 6nzyBttghDCU; Tue, 16 Jan 2018 17:59:11 +0100 (CET) Received: from localhost (localhost [127.0.0.1]) by mail.inparadise.se (Postfix) with ESMTP id 6E72941775; Tue, 16 Jan 2018 17:59:11 +0100 (CET) DKIM-Filter: OpenDKIM Filter v2.10.3 mail.inparadise.se 6E72941775 X-Virus-Scanned: amavisd-new at inparadise.se Received: from mail.inparadise.se ([127.0.0.1]) by localhost (mail.inparadise.se [127.0.0.1]) (amavisd-new, port 10026) with ESMTP id 6PlvL-2gV_zx; Tue, 16 Jan 2018 17:59:11 +0100 (CET) Received: from mail.inparadise.se (localhost [127.0.0.1]) by mail.inparadise.se (Postfix) with ESMTP id 5669D41774; Tue, 16 Jan 2018 17:59:11 +0100 (CET) Date: Tue, 16 Jan 2018 17:59:11 +0100 (CET) Subject: Re: Reducing ZFS fragmentation by copying to larger disk Message-ID: <04466c21-dfe4-4f27-a03e-da269b467bd0@email.android.com> X-Android-Message-ID: <04466c21-dfe4-4f27-a03e-da269b467bd0@email.android.com> To: Mark Martinec Cc: freebsd-fs@freebsd.org Importance: Normal X-Priority: 3 X-MSMail-Priority: Normal From: =?utf-8?B?S2FybGkgU2rDtmJlcmc=?= X-Originating-IP: [172.16.1.122, 127.0.0.1] X-Mailer: Zimbra 8.7.11_GA_1854 (Android-Mail/7.12.17.180932182.release(...883836) devip=172.16.1.122 ZPZB/66) Thread-Index: m0QeZ/BLbGCZZq+Ot2VzE0b3qY5rxQ== Thread-Topic: Reducing ZFS fragmentation by copying to larger disk MIME-Version: 1.0 Content-Type: text/plain; charset="utf-8" X-Content-Filtered-By: Mailman/MimeDel 2.1.25 X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.25 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 16 Jan 2018 17:04:44 -0000 From owner-freebsd-fs@freebsd.org Wed Jan 17 10:35:09 2018 Return-Path: Delivered-To: freebsd-fs@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id E9988EBBE6F for ; Wed, 17 Jan 2018 10:35:09 +0000 (UTC) (envelope-from devgs@ukr.net) Received: from frv190.fwdcdn.com (frv190.fwdcdn.com [212.42.77.190]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id AD99963A61 for ; Wed, 17 Jan 2018 10:35:08 +0000 (UTC) (envelope-from devgs@ukr.net) Received: from frv198.fwdcdn.com ([212.42.77.198]) by frv190.fwdcdn.com with esmtp ID 1ebkoA-0009eL-Jx for freebsd-fs@freebsd.org; Wed, 17 Jan 2018 12:19:02 +0200 DKIM-Signature: v=1; a=rsa-sha256; q=dns/txt; c=relaxed/relaxed; d=ukr.net; s=ffe; h=Content-Transfer-Encoding:Content-Type:MIME-Version:Message-Id:To: Subject:From:Date:Sender:Reply-To:Cc:Content-ID:Content-Description: Resent-Date:Resent-From:Resent-Sender:Resent-To:Resent-Cc:Resent-Message-ID: In-Reply-To:References:List-Id:List-Help:List-Unsubscribe:List-Subscribe: List-Post:List-Owner:List-Archive; bh=AiJ0OmtPqgfj2f5rBFIqhfgQsiwtFY+YGCUB97oaE/k=; b=ek7jV3EJwqB1jcMRxxiBEpY3Kh K8A/WK20GdZMiukv6qgcYBnGNScG76KQSSvl/R5O+56POcY4tfnv7i+mYh5AosU3O92kjmwe5zZY+ M7uhXC/WCp10AtCtr30l7BK0tazQwnnPQRc6UYr0ga7GcptkSxV4HpNmRseWSgnF8Zi8=; Received: from [10.10.10.33] (helo=frv33.fwdcdn.com) by frv198.fwdcdn.com with smtp ID 1ebko2-0009Lj-6A for freebsd-fs@freebsd.org; Wed, 17 Jan 2018 12:18:54 +0200 Date: Wed, 17 Jan 2018 12:18:54 +0200 From: Paul Subject: Is ARC too conservative? To: freebsd-fs@freebsd.org X-Mailer: mail.ukr.net 5.0 Message-Id: <1516183581.432902299.yk20k8gl@frv33.fwdcdn.com> Received: from devgs@ukr.net by frv33.fwdcdn.com; Wed, 17 Jan 2018 12:18:54 +0200 MIME-Version: 1.0 Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: binary X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.25 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 17 Jan 2018 10:35:10 -0000 Hello team, On numerous occasions we have observed a strange thing. Basically, we observer it after every restart of long running server. The thing is that disk busy % (both SSD and HDD) drops dramatically (given the identical overall server load): by 40% - 50%.  Then slowly, over period of few weeks, busy percentage grows to the previous value where it stabilises. You don't even have to restart server to reproduce this thing. It is enough to drop ARC size to it's minimum value by applying synthetic memory pressure. Could it be that ARC is too conservative regarding the data that is already in cache so that it gives less opportunity for new data to be added? I strongly suspect it's the MFU that is too conservative. How long may the blocks that have a lot of hits stay there? How the score is calculated and is there a way to tweak the formula via sysctl? Thanks. Best regards, Paul From owner-freebsd-fs@freebsd.org Thu Jan 18 04:23:14 2018 Return-Path: Delivered-To: freebsd-fs@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 8C75AE7BFBD for ; Thu, 18 Jan 2018 04:23:14 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.ysv.freebsd.org (mxrelay.ysv.freebsd.org [IPv6:2001:1900:2254:206a::19:3]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client CN "mxrelay.ysv.freebsd.org", Issuer "Let's Encrypt Authority X3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 7331775800 for ; Thu, 18 Jan 2018 04:23:14 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2001:1900:2254:206a::16:76]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mxrelay.ysv.freebsd.org (Postfix) with ESMTPS id 682B71DAB9 for ; Thu, 18 Jan 2018 04:23:14 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.118]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id w0I4NE6k070219 for ; Thu, 18 Jan 2018 04:23:14 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id w0I4NEU4070217 for freebsd-fs@FreeBSD.org; Thu, 18 Jan 2018 04:23:14 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: freebsd-fs@FreeBSD.org Subject: [Bug 225223] "zfs rename -r" of a snapshot doesn't rename zvol snapshots' device nodes Date: Thu, 18 Jan 2018 04:23:14 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: CURRENT X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Some People X-Bugzilla-Who: linimon@FreeBSD.org X-Bugzilla-Status: New X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: freebsd-fs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: assigned_to Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.25 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 18 Jan 2018 04:23:14 -0000 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D225223 Mark Linimon changed: What |Removed |Added ---------------------------------------------------------------------------- Assignee|freebsd-bugs@FreeBSD.org |freebsd-fs@FreeBSD.org --=20 You are receiving this mail because: You are the assignee for the bug.= From owner-freebsd-fs@freebsd.org Thu Jan 18 04:27:10 2018 Return-Path: Delivered-To: freebsd-fs@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id C5524E7C51A for ; Thu, 18 Jan 2018 04:27:10 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.ysv.freebsd.org (mxrelay.ysv.freebsd.org [IPv6:2001:1900:2254:206a::19:3]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client CN "mxrelay.ysv.freebsd.org", Issuer "Let's Encrypt Authority X3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id AC29275A2F for ; Thu, 18 Jan 2018 04:27:10 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2001:1900:2254:206a::16:76]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mxrelay.ysv.freebsd.org (Postfix) with ESMTPS id 8F6E31DAD6 for ; Thu, 18 Jan 2018 04:27:10 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.118]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id w0I4RAN0076521 for ; Thu, 18 Jan 2018 04:27:10 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id w0I4RAmO076520 for freebsd-fs@FreeBSD.org; Thu, 18 Jan 2018 04:27:10 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: freebsd-fs@FreeBSD.org Subject: [Bug 225110] UFS "cylinder checksum failed" messages after crash, with SU+J enabled Date: Thu, 18 Jan 2018 04:27:10 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: CURRENT X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: linimon@FreeBSD.org X-Bugzilla-Status: Open X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: freebsd-fs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: cc assigned_to Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.25 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 18 Jan 2018 04:27:10 -0000 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D225110 Mark Linimon changed: What |Removed |Added ---------------------------------------------------------------------------- CC| |emaste@freebsd.org Assignee|freebsd-bugs@FreeBSD.org |freebsd-fs@FreeBSD.org --=20 You are receiving this mail because: You are the assignee for the bug.= From owner-freebsd-fs@freebsd.org Thu Jan 18 04:25:25 2018 Return-Path: Delivered-To: freebsd-fs@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 44753E7C323 for ; Thu, 18 Jan 2018 04:25:25 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.ysv.freebsd.org (mxrelay.ysv.freebsd.org [IPv6:2001:1900:2254:206a::19:3]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client CN "mxrelay.ysv.freebsd.org", Issuer "Let's Encrypt Authority X3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 1AB1B7598B for ; Thu, 18 Jan 2018 04:25:25 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2001:1900:2254:206a::16:76]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mxrelay.ysv.freebsd.org (Postfix) with ESMTPS id D8C0C1DAD0 for ; Thu, 18 Jan 2018 04:25:24 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.118]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id w0I4POXT073191 for ; Thu, 18 Jan 2018 04:25:24 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id w0I4POA4073190 for freebsd-fs@FreeBSD.org; Thu, 18 Jan 2018 04:25:24 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: freebsd-fs@FreeBSD.org Subject: [Bug 225162] Source file zfs_acl.c, function zfs_aclset_common contains a use after end of the lifetime of a local variable Date: Thu, 18 Jan 2018 04:25:24 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: CURRENT X-Bugzilla-Keywords: patch X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: linimon@FreeBSD.org X-Bugzilla-Status: New X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: freebsd-fs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: keywords assigned_to Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.25 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 18 Jan 2018 04:25:25 -0000 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D225162 Mark Linimon changed: What |Removed |Added ---------------------------------------------------------------------------- Keywords| |patch Assignee|freebsd-bugs@FreeBSD.org |freebsd-fs@FreeBSD.org --=20 You are receiving this mail because: You are the assignee for the bug.= From owner-freebsd-fs@freebsd.org Thu Jan 18 04:23:35 2018 Return-Path: Delivered-To: freebsd-fs@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id AEECFE7BFE8 for ; Thu, 18 Jan 2018 04:23:35 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.ysv.freebsd.org (mxrelay.ysv.freebsd.org [IPv6:2001:1900:2254:206a::19:3]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client CN "mxrelay.ysv.freebsd.org", Issuer "Let's Encrypt Authority X3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 9479875851 for ; Thu, 18 Jan 2018 04:23:35 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2001:1900:2254:206a::16:76]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mxrelay.ysv.freebsd.org (Postfix) with ESMTPS id 89D711DABD for ; Thu, 18 Jan 2018 04:23:35 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.118]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id w0I4NZm1070729 for ; Thu, 18 Jan 2018 04:23:35 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id w0I4NZI1070727 for freebsd-fs@FreeBSD.org; Thu, 18 Jan 2018 04:23:35 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: freebsd-fs@FreeBSD.org Subject: [Bug 225200] "zfs promote" of a zvol doesn't rename device nodes for snapshots Date: Thu, 18 Jan 2018 04:23:35 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: CURRENT X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Some People X-Bugzilla-Who: linimon@FreeBSD.org X-Bugzilla-Status: New X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: freebsd-fs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: assigned_to Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.25 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 18 Jan 2018 04:23:35 -0000 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D225200 Mark Linimon changed: What |Removed |Added ---------------------------------------------------------------------------- Assignee|freebsd-bugs@FreeBSD.org |freebsd-fs@FreeBSD.org --=20 You are receiving this mail because: You are the assignee for the bug.= From owner-freebsd-fs@freebsd.org Thu Jan 18 04:44:16 2018 Return-Path: Delivered-To: freebsd-fs@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id DC788E7DD8B for ; Thu, 18 Jan 2018 04:44:16 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.ysv.freebsd.org (mxrelay.ysv.freebsd.org [IPv6:2001:1900:2254:206a::19:3]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client CN "mxrelay.ysv.freebsd.org", Issuer "Let's Encrypt Authority X3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id A8F31769FE for ; Thu, 18 Jan 2018 04:44:16 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2001:1900:2254:206a::16:76]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mxrelay.ysv.freebsd.org (Postfix) with ESMTPS id 831791DDB6 for ; Thu, 18 Jan 2018 04:44:16 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.118]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id w0I4iGwc021717 for ; Thu, 18 Jan 2018 04:44:16 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id w0I4iGs1021716 for freebsd-fs@FreeBSD.org; Thu, 18 Jan 2018 04:44:16 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: freebsd-fs@FreeBSD.org Subject: [Bug 225076] loss zfs pool after reboot Date: Thu, 18 Jan 2018 04:44:16 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 11.1-STABLE X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Many People X-Bugzilla-Who: linimon@FreeBSD.org X-Bugzilla-Status: New X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: freebsd-fs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: keywords assigned_to Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.25 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 18 Jan 2018 04:44:17 -0000 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D225076 Mark Linimon changed: What |Removed |Added ---------------------------------------------------------------------------- Keywords|install | Assignee|freebsd-standards@FreeBSD.o |freebsd-fs@FreeBSD.org |rg | --=20 You are receiving this mail because: You are the assignee for the bug.= From owner-freebsd-fs@freebsd.org Thu Jan 18 07:04:47 2018 Return-Path: Delivered-To: freebsd-fs@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 60578EB8862 for ; Thu, 18 Jan 2018 07:04:47 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.ysv.freebsd.org (mxrelay.ysv.freebsd.org [IPv6:2001:1900:2254:206a::19:3]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client CN "mxrelay.ysv.freebsd.org", Issuer "Let's Encrypt Authority X3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 478147C891 for ; Thu, 18 Jan 2018 07:04:47 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2001:1900:2254:206a::16:76]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mxrelay.ysv.freebsd.org (Postfix) with ESMTPS id 38A181F133 for ; Thu, 18 Jan 2018 07:04:47 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.118]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id w0I74lbm059145 for ; Thu, 18 Jan 2018 07:04:47 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id w0I74lVa059143 for freebsd-fs@FreeBSD.org; Thu, 18 Jan 2018 07:04:47 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: freebsd-fs@FreeBSD.org Subject: [Bug 225110] UFS "cylinder checksum failed" messages after crash, with SU+J enabled Date: Thu, 18 Jan 2018 07:04:47 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: CURRENT X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: mckusick@FreeBSD.org X-Bugzilla-Status: Open X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: freebsd-fs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: cc Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.25 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 18 Jan 2018 07:04:47 -0000 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D225110 Kirk McKusick changed: What |Removed |Added ---------------------------------------------------------------------------- CC| |mckusick@FreeBSD.org --- Comment #2 from Kirk McKusick --- Please retry with this change included as I believe it will fix the problem. New Revision: 328092 URL: https://svnweb.freebsd.org/changeset/base/328092 Log: Correct fsck journal-recovery code to update a cylinder-group check-hash after making changes to the cylinder group. The problem was that the journal-recovery code was calling the libufs bwrite() function instead of the cgput() function. The cgput() function updates the cylinder-group check-hash before writing the cylinder group. --=20 You are receiving this mail because: You are the assignee for the bug.= From owner-freebsd-fs@freebsd.org Fri Jan 19 09:25:56 2018 Return-Path: Delivered-To: freebsd-fs@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id A0608ECCCEC for ; Fri, 19 Jan 2018 09:25:56 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.ysv.freebsd.org (mxrelay.ysv.freebsd.org [IPv6:2001:1900:2254:206a::19:3]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client CN "mxrelay.ysv.freebsd.org", Issuer "Let's Encrypt Authority X3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 8766679DDD for ; Fri, 19 Jan 2018 09:25:56 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2001:1900:2254:206a::16:76]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mxrelay.ysv.freebsd.org (Postfix) with ESMTPS id 7BC805385 for ; Fri, 19 Jan 2018 09:25:56 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.118]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id w0J9PuNQ006056 for ; Fri, 19 Jan 2018 09:25:56 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id w0J9PuNn006055 for freebsd-fs@FreeBSD.org; Fri, 19 Jan 2018 09:25:56 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: freebsd-fs@FreeBSD.org Subject: [Bug 225110] UFS "cylinder checksum failed" messages after crash, with SU+J enabled Date: Fri, 19 Jan 2018 09:25:56 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: CURRENT X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: dumbbell@FreeBSD.org X-Bugzilla-Status: Open X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: freebsd-fs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: cc Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.25 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 19 Jan 2018 09:25:56 -0000 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D225110 Jean-S=C3=83=C2=A9bastien P=C3=83=C2=A9dron changed: What |Removed |Added ---------------------------------------------------------------------------- CC| |dumbbell@FreeBSD.org --- Comment #3 from Jean-S=C3=83=C2=A9bastien P=C3=83=C2=A9dron --- I tried this patch with success on my laptop! Thank you Kirk :) --=20 You are receiving this mail because: You are the assignee for the bug.= From owner-freebsd-fs@freebsd.org Fri Jan 19 15:29:34 2018 Return-Path: Delivered-To: freebsd-fs@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id F378EEB8295 for ; Fri, 19 Jan 2018 15:29:34 +0000 (UTC) (envelope-from julien@perdition.city) Received: from relay-b01.edpnet.be (relay-b01.edpnet.be [212.71.1.221]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client CN "edpnet.email", Issuer "Go Daddy Secure Certificate Authority - G2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id B2EBB1DF5 for ; Fri, 19 Jan 2018 15:29:33 +0000 (UTC) (envelope-from julien@perdition.city) X-ASG-Debug-ID: 1516375159-0a7ff54a48864590001-3nHGF7 Received: from mordor.lan (77.109.96.175.adsl.dyn.edpnet.net [77.109.96.175]) by relay-b01.edpnet.be with ESMTP id JBAGgDshc4nAIHQt (version=TLSv1.2 cipher=ECDHE-RSA-AES256-GCM-SHA384 bits=256 verify=NO) for ; Fri, 19 Jan 2018 16:19:21 +0100 (CET) X-Barracuda-Envelope-From: julien@perdition.city X-Barracuda-Effective-Source-IP: 77.109.96.175.adsl.dyn.edpnet.net[77.109.96.175] X-Barracuda-Apparent-Source-IP: 77.109.96.175 Date: Fri, 19 Jan 2018 16:19:19 +0100 From: Julien Cigar To: freebsd-fs@freebsd.org Subject: ZFS High-Availability NAS Message-ID: <20180119151919.GF507@mordor.lan> X-ASG-Orig-Subj: ZFS High-Availability NAS MIME-Version: 1.0 Content-Type: multipart/signed; micalg=pgp-sha512; protocol="application/pgp-signature"; boundary="NQTVMVnDVuULnIzU" Content-Disposition: inline User-Agent: Mutt/1.8.2 (2017-04-18) X-Barracuda-Connect: 77.109.96.175.adsl.dyn.edpnet.net[77.109.96.175] X-Barracuda-Start-Time: 1516375160 X-Barracuda-Encrypted: ECDHE-RSA-AES256-GCM-SHA384 X-Barracuda-URL: https://212.71.1.221:443/cgi-mod/mark.cgi X-Virus-Scanned: by bsmtpd at edpnet.be X-Barracuda-Scan-Msg-Size: 491 X-Barracuda-BRTS-Status: 1 X-Barracuda-Bayes: INNOCENT GLOBAL 0.5073 1.0000 0.7500 X-Barracuda-Spam-Score: 2.25 X-Barracuda-Spam-Status: No, SCORE=2.25 using global scores of TAG_LEVEL=1000.0 QUARANTINE_LEVEL=1000.0 KILL_LEVEL=7.0 tests=BSF_SC0_MV0713, BSF_SC0_MV0713_2 X-Barracuda-Spam-Report: Code version 3.2, rules version 3.2.3.47048 Rule breakdown below pts rule name description ---- ---------------------- -------------------------------------------------- 1.00 BSF_SC0_MV0713_2 BSF_SC0_MV0713_2 0.50 BSF_SC0_MV0713 Custom rule MV0713 X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.25 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 19 Jan 2018 15:29:35 -0000 --NQTVMVnDVuULnIzU Content-Type: text/plain; charset=utf-8 Content-Disposition: inline Content-Transfer-Encoding: quoted-printable Hello, I'm wondering if someone has already put in production something similar to https://github.com/ewwhite/zfs-ha/wiki (with two HBAs and=20 two disk shelves in two chains) with ZFS, gmultipath, and NFS on top ? Julien --=20 Julien Cigar Belgian Biodiversity Platform (http://www.biodiversity.be) PGP fingerprint: EEF9 F697 4B68 D275 7B11 6A25 B2BB 3710 A204 23C0 No trees were killed in the creation of this message. However, many electrons were terribly inconvenienced. --NQTVMVnDVuULnIzU Content-Type: application/pgp-signature; name="signature.asc" -----BEGIN PGP SIGNATURE----- iQIzBAABCgAdFiEE7vn2l0to0nV7EWolsrs3EKIEI8AFAlpiDHQACgkQsrs3EKIE I8AeHhAA1haHnZQgIugnOJlZaAQojEVvJaHe81oOGf9Q/P/haSG37XUJifTZdN1o wNqP+JkZaaA6hr6OMVOOlaVB5bprsTSfx2KGS0kKWqkVrJ79Gaf8pVApNxgFbkdS N0S0FXEoB0TIPVqqkcxKzq8PrhyFw3exQEsNi/s2fXmW4+wNGZ6snkWfbeBuDn5g /HhznILUY2Mxp8wiOBiGiQX+HBJEhO3hJM/p3Z6psASf7CuHpQJStFWXk01pU6Te PZK9DXmtCLKuY2m6NqKLk5lrr5816omaTmaEaBgtFbeuRYTEeDFodV9B1arFo2OZ nsCvgytr83wprIFG4gDp141N5hgHhvSFtKohRMkb2esQ0/KZKNlyeRE3LqctArXN urhCa5d5HsWD2H6JfRAXBU5nZosP9zt7fh7aYmSW+KJB2Y+NnDuDjDFg5ffho0Gp Kw6xZfW/eZC2XYl0zJaynbhSXhhBx75hNyITeAmaywaz4WrBfByUHMy/aWR5lxNX ZBypyrQZKz+U/dTIJBLjVSimWT2OnoFzgzQi74jzqugNd4TLf/V4W2N6YCNxPOvl XntlwKW5bmF8kyb9ENSZ9jdYyUUV+FrE+rEI+2bx+X2nMIlngDhDhy2/n25y6V/Y r8EfDbrkRMmBgBcXPUGxjCgp9tzSBeI+XW6iR1ufRfBXg2mC774= =rlMj -----END PGP SIGNATURE----- --NQTVMVnDVuULnIzU--