Date: Thu, 21 Apr 2016 13:30:46 +0800 (CST) From: pagaled <pagaled@saifunguo.com> To: freebsd-questions@FreeBSD.org Subject: Enquiry Paragliding Message-ID: <3d22b2ae.97e7.154374c95ff.Coremail.pagaled@saifunguo.com>
next in thread | raw e-mail | index | archive | help
RGVhciBDRU8sCiAgICAgICAKUGxlYXNlIHNlZSB0aGUgYXR0YWNobWVudCBvZiBQYXJhZ2xpZGlu Zy4KCgoKCi0tCgpCZXN0IHJlZ2FyZHMKCgoKClVzaGVyIENhZ2UKClRlbKO6IDAwODYtNzU1LTM2 NjIxNzM2CgpNb2IgIDowMDg2LTE1OSA4OTQ0IDExNzUKCkUtbWFpbDogYWRtaW5AcGFnYWxlZC5j b20KCiAgICAgICAgICAgICB1c2hlckBwZWdhbGVkLmNvbQ== From owner-freebsd-questions@freebsd.org Thu Apr 21 06:26:03 2016 Return-Path: <owner-freebsd-questions@freebsd.org> Delivered-To: freebsd-questions@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 0DE1EB1637C for <freebsd-questions@mailman.ysv.freebsd.org>; Thu, 21 Apr 2016 06:26:03 +0000 (UTC) (envelope-from Alexander.Holte.Davidsen@kulturit.no) Received: from mx2.kulturit.no (mx2.kulturit.no [195.159.218.104]) by mx1.freebsd.org (Postfix) with ESMTP id 839B21753 for <freebsd-questions@freebsd.org>; Thu, 21 Apr 2016 06:26:01 +0000 (UTC) (envelope-from Alexander.Holte.Davidsen@kulturit.no) X-AuditID: ac10ad3d-f79a76d000000b05-14-57186eed6715 Received: from SKIEX-002.mid.no ( [10.11.1.91]) by mx2.kulturit.no (Symantec Messaging Gateway) with SMTP id 91.71.02821.DEE68175; Thu, 21 Apr 2016 08:10:54 +0200 (CEST) Received: from SKIEX-100.mid.no ([fe80::f009:d543:74e3:208b]) by SKIEX-002.mid.no ([::1]) with mapi id 14.03.0195.001; Thu, 21 Apr 2016 08:10:53 +0200 From: Alexander Holte-Davidsen <Alexander.Holte.Davidsen@kulturit.no> To: "freebsd-questions@freebsd.org" <freebsd-questions@freebsd.org> Subject: Loss of disk made zfs pool unavailable Thread-Topic: Loss of disk made zfs pool unavailable Thread-Index: AQHRm5SPE2POMNFRAE+vLPsFvsQ32w== Date: Thu, 21 Apr 2016 06:10:52 +0000 Message-ID: <20160421061052.GA31812@fonzie.mid.no> Accept-Language: en-US, nb-NO Content-Language: en-US X-MS-Has-Attach: yes X-MS-TNEF-Correlator: x-originating-ip: [195.159.218.126] Content-Type: multipart/signed; micalg=pgp-sha256; protocol="application/pgp-signature"; boundary="9jxsPFA5p3P2qPhR" MIME-Version: 1.0 X-Brightmail-Tracker: H4sIAAAAAAAAA+NgFvrILMWRmVeSWpSXmKPExsXCxc0YrfsuTyLcoP0bi8XLr5tYHBg9Znya zxLAGMVlk5Kak1mWWqRvl8CV8e3sAeaCXomKI59SGxhXiXQxcnBICJhIzDyl28XICWSKSVy4 t56ti5GLQ0hgNaPE4sObWSGcWYwSLWfmMYNUsQm4Ssya2MECYosIOEusPvObFcQWFtCX2HJx HjtE3ESiffsjZghbT2JRwzcmEJtFQFVi4fM9YPW8AkYS83cfZAOxGQVkJVa1vgOrYRYQl7j1 ZD4TxEUiEg8vnmaDsEUlXj7+xwphK0scODiNGaK+TOLZ+YnMEDMFJU7OfMIygVFoFpJRs5CU zUJSBhHXkrjx7yVQDQeQLS2x/B8HRNhWYt269ywLGNlWMYoFe3sG55YU+JeW6BoYGOnlZqbo peRWbWIEBv4agbW2OxivfHc6xCjAwajEw7tBRiJciDWxrLgy9xCjCtCgRxtWX2CUYsnLz0tV EuE1yQJK86YkVlalFuXHF5XmpBYfYpTmYFES530+jT1cSCA9sSQ1OzW1ILUIJsvEwSnVwLhO sm67QFLGuhe1dWYmtyYr3fzyY5q8zBHjY//LezJ/CYckySQlsB5Q+jBj9g9jp/2/VnxT/3Jl pSpzXLifj+3Ue2dXMs/z9/2u5p3je+6944u7H/9w9H4yPblbgjWrjuWM9JkZSl91t+kE9QtE nKubfFD6jcrj77r1j7XPXBR+vvKD+iHTUH4lluKMREMt5qLiRACjmtaZhAIAAA== X-BeenThere: freebsd-questions@freebsd.org X-Mailman-Version: 2.1.21 Precedence: list List-Id: User questions <freebsd-questions.freebsd.org> List-Unsubscribe: <https://lists.freebsd.org/mailman/options/freebsd-questions>, <mailto:freebsd-questions-request@freebsd.org?subject=unsubscribe> List-Archive: <http://lists.freebsd.org/pipermail/freebsd-questions/>; List-Post: <mailto:freebsd-questions@freebsd.org> List-Help: <mailto:freebsd-questions-request@freebsd.org?subject=help> List-Subscribe: <https://lists.freebsd.org/mailman/listinfo/freebsd-questions>, <mailto:freebsd-questions-request@freebsd.org?subject=subscribe> X-List-Received-Date: Thu, 21 Apr 2016 06:26:03 -0000 --9jxsPFA5p3P2qPhR Content-Type: text/plain; charset=us-ascii Content-Disposition: inline Hi all, Yesterday I lost one disk in one of our zfs pools. dmesg shows the following output: Apr 20 16:07:37 sto01 kernel: (noperiph:mpr0:0:4294967295:0): SMID 1 Aborting command 0xfffffe00015db000 Apr 20 16:07:37 sto01 kernel: mpr0: Sending reset from mprsas_send_abort for target ID 49 Apr 20 16:07:40 sto01 kernel: mpr0: mprsas_prepare_remove: Sending reset for target ID 49 Apr 20 16:07:40 sto01 kernel: da22 at mpr0 bus 0 scbus12 target 49 lun 0 Apr 20 16:07:40 sto01 kernel: da22: <ATA ST4000NM0033-9ZM SN04> s/n Z1Z9QZJB detached Apr 20 16:07:41 sto01 kernel: (da22:mpr0:0:49:0): SYNCHRONIZE CACHE(10). CDB: 35 00 00 00 00 00 00 00 00 00 Apr 20 16:07:41 sto01 kernel: mpr0: (da22:mpr0:0:49:0): CAM status: Command timeout Apr 20 16:07:41 sto01 kernel: IOCStatus = 0x4b while resetting device 0x1d Apr 20 16:07:41 sto01 kernel: (da22:mpr0: mpr0:0:Unfreezing devq for target ID 49 Apr 20 16:07:41 sto01 kernel: 49:0): Error 5, Periph was invalidated Apr 20 16:07:41 sto01 kernel: mpr0: Unfreezing devq for target ID 49 Apr 20 16:07:41 sto01 kernel: (da22:mpr0:0:49:0): Periph destroyed Apr 20 16:07:41 sto01 devd: Executing 'logger -p kern.notice -t ZFS 'vdev is removed, pool_guid=8487159098644794736 vdev_guid=5745784146163956924'' Apr 20 16:07:41 sto01 ZFS: vdev is removed, pool_guid=8487159098644794736 vdev_guid=5745784146163956924 This disk was part of a raidz1. This is not really a problem, I expect disks to crash, that's why we are using zfs in this first place. What I did not expect was the pool to become unusable and having to reboot the server to be able to replace the disk. After the disk crashed all zpool and zfs command where just hanging, no output at all. The clients connected to this server also lost their ability to read and write to the pool. Is this the expected behavior or was I just unlucky? I see that the zpool property failmode is set to "wait", would using "continue" solved the issue with the server hanging? When the server was rebooted I was able to replace the disk with a spare, resilvering and scrub finished without any errors. Some system info; #freebsd-version -ku 10.3-RELEASE 10.3-RELEASE #uname -a FreeBSD sto01 10.3-RELEASE FreeBSD 10.3-RELEASE #0 r297264: Fri Mar 25 02:10:02 UTC 2016 root@releng1.nyi.freebsd.org:/usr/obj/usr/src/sys/GENERIC amd64 Regards, Alexander --9jxsPFA5p3P2qPhR Content-Type: application/pgp-signature; name="signature.asc" -----BEGIN PGP SIGNATURE----- Version: GnuPG v2 iQEcBAEBCAAGBQJXGG7sAAoJEIWqNN0T0iPS9bgH/Ah5lR4NR2M0JIH3OAVVaak8 T2LJEw19KkcE7lcZj8SLpt0NWUbfpx3djNQ3Hhh7sxw3EqjcmVhyb0Ket8P45VQU HUdrwjUsb/cZv+gtwnI+DB638n1YW4hA1Ekw3F+xSBTGzmOoF6XpUry391Z6VvUE zzMdgiKgyI+Qv8tadFPWJSy7IVBUdAPLXt8JUltznUsnL4yEb+HWKotEqZifsYX2 Bqhy3yo4UfnL+89HB/+u7f3qHZ7xZdYeEVJXCQVMH46huNoBzVcEnkTpQIrA10Xj nbU8dClp93b5IoFUCr2ioQ7ye2HGYioy6esWbr0nHZe4I9fi0jgZ8d8SWqyrcks= =sfWN -----END PGP SIGNATURE----- --9jxsPFA5p3P2qPhR--
Want to link to this message? Use this URL: <https://mail-archive.FreeBSD.org/cgi/mid.cgi?3d22b2ae.97e7.154374c95ff.Coremail.pagaled>