From owner-netperf-users@freebsd.org Sat Nov 21 16:18:14 2020 Return-Path: Delivered-To: netperf-users@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id E3BF646A6EB for ; Sat, 21 Nov 2020 16:18:14 +0000 (UTC) (envelope-from mike@sentex.net) Received: from pyroxene2a.sentex.ca (pyroxene19.sentex.ca [IPv6:2607:f3e0:0:3::19]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "pyroxene.sentex.ca", Issuer "Let's Encrypt Authority X3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4Cddr65g6Yz4sLk; Sat, 21 Nov 2020 16:18:14 +0000 (UTC) (envelope-from mike@sentex.net) Received: from [IPv6:2607:f3e0:0:4:b54f:3bf5:d5cc:71b0] ([IPv6:2607:f3e0:0:4:b54f:3bf5:d5cc:71b0]) by pyroxene2a.sentex.ca (8.15.2/8.15.2) with ESMTPS id 0ALGID7r088494 (version=TLSv1.3 cipher=TLS_AES_128_GCM_SHA256 bits=128 verify=NO); Sat, 21 Nov 2020 11:18:13 -0500 (EST) (envelope-from mike@sentex.net) To: Mateusz Guzik , Allan Jude Cc: Philip Paeps , "Bjoern A. Zeeb" , netperf-admin@freebsd.org, netperf-users@freebsd.org References: <1f8e49ff-e3da-8d24-57f1-11f17389aa84@sentex.net> <270b65c0-8085-fe2f-cf4f-7a2e4c17a2e8@sentex.net> <163d1815-fc4a-7987-30c5-0a21e8383c93@sentex.net> <5a46fa23-b09f-86c2-0cef-a9fbb248f2ec@freebsd.org> From: mike tancsa Subject: Re: zoo reboot Friday Nov 20 14:00 UTC Message-ID: Date: Sat, 21 Nov 2020 11:18:14 -0500 User-Agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64; rv:78.0) Gecko/20100101 Thunderbird/78.4.3 MIME-Version: 1.0 In-Reply-To: Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: quoted-printable Content-Language: en-US X-Rspamd-Queue-Id: 4Cddr65g6Yz4sLk X-Spamd-Bar: ---- Authentication-Results: mx1.freebsd.org; none X-Spamd-Result: default: False [-4.00 / 15.00]; REPLY(-4.00)[] X-BeenThere: netperf-users@freebsd.org X-Mailman-Version: 2.1.34 Precedence: list List-Id: "Announcements and discussions related to the netperf cluster. " List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 21 Nov 2020 16:18:14 -0000 Just going to reinstall now. I will boot from 2 new SSDs and then use 4 4TB in RAIDZ On 11/21/2020 12:47 AM, Mateusz Guzik wrote: > root@zoo2:/home/mjg # zdb -l /dev/gptid/db15e826-1a9c-11eb-8d25-0cc47a= 1f2fa0 > ------------------------------------ > LABEL 0 > ------------------------------------ > version: 5000 > name: 'zroot' > state: 0 > txg: 40630433 > pool_guid: 11911329414887727775 > errata: 0 > hostid: 3594518197 > hostname: 'zoo2.sentex.ca' > top_guid: 7321270789669113643 > guid: 9170931574354766059 > vdev_children: 4 > vdev_tree: > type: 'mirror' > id: 3 > guid: 7321270789669113643 > metaslab_array: 26179 > metaslab_shift: 32 > ashift: 9 > asize: 482373533696 > is_log: 0 > create_txg: 40274122 > children[0]: > type: 'disk' > id: 0 > guid: 9170931574354766059 > path: '/dev/gptid/db15e826-1a9c-11eb-8d25-0cc47a1f2fa0' > whole_disk: 1 > create_txg: 40274122 > children[1]: > type: 'disk' > id: 1 > guid: 4871900363652985181 > path: '/dev/mfid1p2' > whole_disk: 1 > create_txg: 40274122 > features_for_read: > com.delphix:hole_birth > com.delphix:embedded_data > labels =3D 0 1 2 3 > > > On 11/21/20, Allan Jude wrote: >> On 2020-11-20 21:56, Mateusz Guzik wrote: >>> root@zoo2:/home/mjg # zpool import >>> pool: zroot >>> id: 11911329414887727775 >>> state: FAULTED >>> status: The pool metadata is corrupted. >>> action: The pool cannot be imported due to damaged devices or data. >>> The pool may be active on another system, but can be imported using >>> the '-f' flag. >>> see: https://openzfs.github.io/openzfs-docs/msg/ZFS-8000-72 >>> config: >>> >>> zroot FAULTED corrupted d= ata >>> mirror-0 DEGRADED >>> replacing-0 DEGRADED >>> 1517819109053923011 OFFLINE >>> ada0p3 ONLINE >>> ada1 ONLINE >>> mirror-1 ONLINE >>> ada3p3 ONLINE >>> ada4p3 ONLINE >>> mirror-2 ONLINE >>> ada5p3 ONLINE >>> ada6p3 ONLINE >>> mirror-3 ONLINE >>> gptid/db15e826-1a9c-11eb-8d25-0cc47a1f2fa0 ONLINE >>> gptid/d98a2545-1a9c-11eb-8d25-0cc47a1f2fa0 ONLINE >>> >>> >>> On 11/21/20, Allan Jude wrote: >>>> On 2020-11-20 18:05, mike tancsa wrote: >>>>> OK. Although looks like I will have to pull it in from backups now = :( >>>>> >>>>> >>>>> root@zoo2:/home/mdtancsa # zpool import -f -R /mnt zroot >>>>> cannot import 'zroot': I/O error >>>>> Destroy and re-create the pool from >>>>> a backup source. >>>>> root@zoo2:/home/mdtancsa # >>>>> >>>>> all the disks are there :( Not sure why its not importing ? >>>>> >>>> Can you get the output of just: >>>> >>>> zpool import >>>> >>>> To try to see what the issue might be >>>> >>>> -- >>>> Allan Jude >>>> >>> >> The special vdev appears to be being see as just a plain mirror vdev, >> that is odd. >> >> zdb -l /dev/gptid/db15e826-1a9c-11eb-8d25-0cc47a1f2fa0 >> >> >> -- >> Allan Jude >> >