From owner-freebsd-fs@freebsd.org Sun May 29 00:04:02 2016 Return-Path: Delivered-To: freebsd-fs@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 13124B4EC6A for ; Sun, 29 May 2016 00:04:02 +0000 (UTC) (envelope-from blackcatzilla@gmail.com) Received: from mail-ig0-x22a.google.com (mail-ig0-x22a.google.com [IPv6:2607:f8b0:4001:c05::22a]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id D442914AD for ; Sun, 29 May 2016 00:04:01 +0000 (UTC) (envelope-from blackcatzilla@gmail.com) Received: by mail-ig0-x22a.google.com with SMTP id fh2so16406109igd.1 for ; Sat, 28 May 2016 17:04:01 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:in-reply-to:references:from:date:message-id:subject:to :cc; bh=XUepYzAYItzVkjGhJOtM1QagU5jG/47uGoYUYYGusiI=; b=G8idZRxLWgl+rbbYbJl1rcbb7LN9IO8WaHX6QuGBBwLzgabChnt83qenVuaNP28ypE xs9xyzj7r+PDSuipn1VaOSTW63h2QUobbKnkZgZ+CW6Pr6vRkHMo4UG1XRSeYq4vB6Wa H0Idop+ick7F4aatLqH0V5DHm0w7g7+qN+qvPz5uP0j85C7geDde1QZwu7nLoZITOOsz TVVbqx21yjVBk+gcgvu71I3jxDGvpkmcHsP0EG4ao92CapXAtWLudmVLpHrQ7y2p2n3E ZCKP+acW1bYTD7ONapOb05rULI6MMPOUq0xaK/ksZuhZ/UfqIAL8ANXuf/14cm0D56cc wLYg== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20130820; h=x-gm-message-state:mime-version:in-reply-to:references:from:date :message-id:subject:to:cc; bh=XUepYzAYItzVkjGhJOtM1QagU5jG/47uGoYUYYGusiI=; b=dCTv0uf6D6YRQK8LFs4T3nfvwkRKhetSHBjKeJhAhk7V0ccGF8Hl/xtSlVkMO9pAyo wVD3i3BPTX6gk0PcsSjkS8zLVfiq7jyMYIobOPS+f7iOpqri5JO7NweL1jTY0JaJurN2 Rm/kJYEq9Xd38lGzd918iTmeHVH7bAUuVF4uV4GfIXDq9tFb+8W2Br1qjt+IDMEe3ovQ tzFADu0PtWcfwSXovaVh+ZBFx4YRkgyFUOjZGgXwMvHEUSbdRCrlRSXG3NFn0cnFTHsW D2oEGAL1izUMfcECwc3uBicohevlBe/xZsjEasQ1BPYIw1oUnMUvIUa8y8cYdHHLfrlL QKCw== X-Gm-Message-State: ALyK8tLc9gJfE2zoMxUJ7kZtbgWVAOzwTxwB/NJQTCEcgdfA9xbkh6WbzqRafOq89ahZQaEFLWOSwNOIeB6JEA== X-Received: by 10.50.18.198 with SMTP id y6mr3311001igd.86.1464480241155; Sat, 28 May 2016 17:04:01 -0700 (PDT) MIME-Version: 1.0 Received: by 10.36.46.201 with HTTP; Sat, 28 May 2016 17:03:41 -0700 (PDT) In-Reply-To: References: From: BlackCat Date: Sun, 29 May 2016 03:03:41 +0300 Message-ID: Subject: Re: ZFS - RAIDZ1 Recovery (Evgeny Sam) To: Evgeny Sam Cc: freebsd-fs@freebsd.org Content-Type: text/plain; charset=UTF-8 X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.22 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 29 May 2016 00:04:02 -0000 2016-05-29 2:07 GMT+03:00 Evgeny Sam : > I ran the command "zpool import -fFn 2918670121059000644 zh_vol_old" > amd it did not work. > > [root@juicy] ~# zpool import -fFn 2918670121059000644 zh_vol_old > [root@juicy] ~# zpool status > no pools available > Does 'zpool import' print something? > I think it did not work, because I am running it on the clonned drives, > which have different GPID's, please correct me if I am wrong. I can switch > it to the original drives, if you suggest so. > No, please do not connect original drives until you get your data back. Ok, let's start info collection from beginning. Could you describe which exactly disk is fail (e.g. /dev/ada????)? Since I still can not realize this. Please describe, what happened to the disk (e.g. a lot of bad blocks or disk controller start to fail). Could you show output of these commands: zpool status zpool import zdb zdb -e And if your disk has bad blocks then please show or post to pastebin output of (where ??? is failed disk) dmesg | grep 'ada???' -- BR BC From owner-freebsd-fs@freebsd.org Sun May 29 02:42:43 2016 Return-Path: Delivered-To: freebsd-fs@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id B6B21B521E3 for ; Sun, 29 May 2016 02:42:43 +0000 (UTC) (envelope-from esamorokov@gmail.com) Received: from mail-io0-x235.google.com (mail-io0-x235.google.com [IPv6:2607:f8b0:4001:c06::235]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 814FA1AC5 for ; Sun, 29 May 2016 02:42:43 +0000 (UTC) (envelope-from esamorokov@gmail.com) Received: by mail-io0-x235.google.com with SMTP id p64so51547900ioi.2 for ; Sat, 28 May 2016 19:42:43 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:in-reply-to:references:date:message-id:subject:from:to :cc; bh=qzyTepJx3YTSPOqZFXrQ5+mfgJMyNj1fMQJ/FTCQ6qM=; b=FZEKFnPlaXg1r1Vdz8UkeqSzFAwNSSxSQqhW2xGqC4Rcp8g2fttfNJ/jduhDxxLGDe 8Tn5bJ/FMFr32N73QKctAw29SQ4O15b/rKPBCEAE82Lp2RQzGMDt6JbLH9kiZkmf8Fdm pl5GBAxq4++RPmb8RpoqVECK0SoU5gj4Dy6Dg+hMLs8ACgy7NH/d2L/yZACQoCXnfS9z LoLsCKvq+Cq9kJRGBxk1+MOaqohKLHl7wfPWKN62sSSYhGA4P5J9RhKk/S5J72x0hSos dQZ/FC6j8v8oWiNWqgdU00jX6aSmdwcnI34JwWhD1DmgB+NChA9NnrIjP3Mk6uTwgEzF IAzQ== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20130820; h=x-gm-message-state:mime-version:in-reply-to:references:date :message-id:subject:from:to:cc; bh=qzyTepJx3YTSPOqZFXrQ5+mfgJMyNj1fMQJ/FTCQ6qM=; b=bKWXLsUTfcKL+UcQb8B1Ic0IVDQJjvtZvivHHsOZy9ZToWeNX4Dn5QtCONPBMWhiYC PI8X1Xumwp6kRW+cIznoyEM3+Yl4VUVwIDsoQG6ydv1XP+54mcX+hh9CByYdw38ESgxf EXHQcqAXMWr3UR6+yR4fY3se3WhYRsP+OSjQ8prR0J0gWDNfjUlGZJPjLUULzlnoXWBS HLkgwRPVeJRy7ZeLSrBG8nXluLtFPZqhNh0Ns9GKpXCyPeslYpc3xOSoL6NHmrpqC8sb mJxb8kWqPWRxXxpvUCoshTIxMrx/acqclWhNPbsjtX+R53bO8R+S0jtUYDSi9Hh/gK9y jEuA== X-Gm-Message-State: ALyK8tL0nUwLvVBefC04oBzLLN3yu6JpVmenRrl0WChDskEkiC8yOhXAiBxX5jpa4LhdQI60fv0s/Ty+7H/pNw== MIME-Version: 1.0 X-Received: by 10.107.131.105 with SMTP id f102mr18278198iod.136.1464489762803; Sat, 28 May 2016 19:42:42 -0700 (PDT) Received: by 10.107.154.16 with HTTP; Sat, 28 May 2016 19:42:42 -0700 (PDT) In-Reply-To: References: Date: Sat, 28 May 2016 19:42:42 -0700 Message-ID: Subject: Re: ZFS - RAIDZ1 Recovery (Evgeny Sam) From: Evgeny Sam To: BlackCat Cc: freebsd-fs@freebsd.org Content-Type: text/plain; charset=UTF-8 X-Content-Filtered-By: Mailman/MimeDel 2.1.22 X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.22 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 29 May 2016 02:42:43 -0000 The Command "zpool import -fFn 2918670121059000644 zh_vol_old" does not show anything. The failed drive is(has always been) 'ada3' - currently showing bad bloks. The disk FreeNas sent me an alert that the drive has failed and I verified that. [root@juicy] ~# zpool status no pools available [root@juicy] ~# zpool import pool: zh_vol id: 2918670121059000644 state: FAULTED status: One or more devices are missing from the system. action: The pool cannot be imported. Attach the missing devices and try again. The pool may be active on another system, but can be imported using the '-f' flag. see: http://illumos.org/msg/ZFS-8000-3C config: zh_vol FAULTED corrupted data raidz1-0 DEGRADED 17624020450804741401 UNAVAIL cannot open gptid/2b70d9c0-8e40-11e3-aa1c-d43d7ed5b587 ONLINE gptid/5dacd737-18ac-11e6-9c25-001b7859b93e ONLINE [root@juicy] ~# zdb zh_vol: version: 5000 name: 'zh_vol' state: 0 txg: 1491 pool_guid: 10149654347507244742 hostid: 1802987710 hostname: 'juicy.zhelana.local' vdev_children: 2 vdev_tree: type: 'root' id: 0 guid: 10149654347507244742 create_txg: 4 children[0]: type: 'disk' id: 0 guid: 5892508334691495384 path: '/dev/ada0s2' whole_disk: 1 metaslab_array: 33 metaslab_shift: 23 ashift: 12 asize: 983564288 is_log: 0 create_txg: 4 children[1]: type: 'disk' id: 1 guid: 296669430778697937 path: '/dev/ada2p2' whole_disk: 1 metaslab_array: 37 metaslab_shift: 34 ashift: 12 asize: 2997366816768 is_log: 0 create_txg: 1489 features_for_read: [root@juicy] ~# zdb -e SHOWS ONLY HELP INFO [root@juicy] ~# dmesg | grep ada ada0 at ahcich2 bus 0 scbus0 target 0 lun 0 ada0: ATA-8 SATA 3.x device ada0: 600.000MB/s transfers (SATA 3.x, UDMA6, PIO 8192bytes) ada0: Command Queueing enabled ada0: 57241MB (117231408 512 byte sectors: 16H 63S/T 16383C) ada0: Previously was known as ad4 ada1 at ahcich3 bus 0 scbus1 target 0 lun 0 ada1: ATA-9 SATA 3.x device ada1: 600.000MB/s transfers (SATA 3.x, UDMA6, PIO 8192bytes) ada1: Command Queueing enabled ada1: 2861588MB (5860533168 512 byte sectors: 16H 63S/T 16383C) ada1: quirks=0x1<4K> ada1: Previously was known as ad6 ada2 at ahcich4 bus 0 scbus2 target 0 lun 0 ada2: ATA-9 SATA 3.x device ada2: 600.000MB/s transfers (SATA 3.x, UDMA6, PIO 8192bytes) ada2: Command Queueing enabled ada2: 2861588MB (5860533168 512 byte sectors: 16H 63S/T 16383C) ada2: quirks=0x1<4K> ada2: Previously was known as ad8 ada3 at ahcich5 bus 0 scbus3 target 0 lun 0 ada3: ATA-8 SATA 3.x device ada3: 600.000MB/s transfers (SATA 3.x, UDMA6, PIO 8192bytes) ada3: Command Queueing enabled ada3: 2861588MB (5860533168 512 byte sectors: 16H 63S/T 16383C) ada3: quirks=0x1<4K> ada3: Previously was known as ad10 GEOM_ELI: Device ada1p1.eli created. GEOM_ELI: Device ada2p1.eli created. On Sat, May 28, 2016 at 5:03 PM, BlackCat wrote: > 2016-05-29 2:07 GMT+03:00 Evgeny Sam : > > I ran the command "zpool import -fFn 2918670121059000644 zh_vol_old" > > amd it did not work. > > > > [root@juicy] ~# zpool import -fFn 2918670121059000644 zh_vol_old > > [root@juicy] ~# zpool status > > no pools available > > > Does 'zpool import' print something? > > > I think it did not work, because I am running it on the clonned drives, > > which have different GPID's, please correct me if I am wrong. I can > switch > > it to the original drives, if you suggest so. > > > No, please do not connect original drives until you get your data back. > > Ok, let's start info collection from beginning. Could you describe > which exactly disk is fail (e.g. /dev/ada????)? Since I still can not > realize this. Please describe, what happened to the disk (e.g. a lot > of bad blocks or disk controller start to fail). > > Could you show output of these commands: > zpool status > zpool import > zdb > zdb -e > > And if your disk has bad blocks then please show or post to pastebin > output of (where ??? is failed disk) > dmesg | grep 'ada???' > > -- > BR BC > From owner-freebsd-fs@freebsd.org Sun May 29 12:20:42 2016 Return-Path: Delivered-To: freebsd-fs@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id DA363B4E601 for ; Sun, 29 May 2016 12:20:42 +0000 (UTC) (envelope-from blackcatzilla@gmail.com) Received: from mail-io0-x235.google.com (mail-io0-x235.google.com [IPv6:2607:f8b0:4001:c06::235]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id B75CB1C2E for ; Sun, 29 May 2016 12:20:42 +0000 (UTC) (envelope-from blackcatzilla@gmail.com) Received: by mail-io0-x235.google.com with SMTP id p64so54817231ioi.2 for ; Sun, 29 May 2016 05:20:42 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:in-reply-to:references:from:date:message-id:subject:to :cc; bh=/Cdi3f8udJhY6coEJpIDcyL6LZwEhe9KKPRxJ9mMiDQ=; b=kHb9EngIDr4UNEkJ9VyqrpFv1GotyYtqpSts3ZTa7/UbCQARFnoKFCEZu+ROcsHK5l xnhQyGOZe6AoHZmjVTlSSsQWcqsC9mLQXZiloDHG6jzS10mmq1p3+C0croebcCZZS3hW lf1A649zdlQ7aTCOOCD4JMQv0pQobuCZLNquyFHnDUUY3fsNWhcOm0xbCist6U0u0kxF 2ilNqooM8JUCbtCBlNLdskr/Fu8/d1nP55flAPEEjfWkYse+GIbrXnJLD1Tvy11Xn4rP ALZRNcc/Mwwc1mRDMtOPbpoJN45mTXY7IgGFBwYAt8Lz5NxMaqbEZV7a7DPnYZkd6WEh LjIA== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20130820; h=x-gm-message-state:mime-version:in-reply-to:references:from:date :message-id:subject:to:cc; bh=/Cdi3f8udJhY6coEJpIDcyL6LZwEhe9KKPRxJ9mMiDQ=; b=T08y9vjEiJ7EmzDwhx7qnRc4nNKFfdT5QICaAFPcSnUuoyuDjmxP+XrRnpzOIhFznT SoN1nVGqTp4B9aQoL1Z2zoq/kAQGJPkkp7E+ee47FfbVSgYZ7TWg81yZMDqpiJxK5fSh xMpEQZFaN3p309sSQyjZ+/gSP6zvfiLU5LnqJNMLNoDurUvFUjQCKtyzkc+yJhUVPH7N 50KWnQf8hl3P67UvesRWB503JVzpxmnIiEoXZAHUSHHBKnhM5klEYDQbjJf8fd8MCTes uFygt3U4nJV2IT+CHO7TUxiCsd8gYjYMJL1Ad+6OpQnLXIrXg/F7NupxBKv2b8d46osM Vb6A== X-Gm-Message-State: ALyK8tIiNryU/BTZF1/qb4BGLUJWHr3YpNqd9PbWbC8ZdjukRyuYH+jCCqq8Zd2h3rUxXDrtzIGTwvlwJaaOYg== X-Received: by 10.107.200.18 with SMTP id y18mr18718371iof.187.1464524442149; Sun, 29 May 2016 05:20:42 -0700 (PDT) MIME-Version: 1.0 Received: by 10.36.46.201 with HTTP; Sun, 29 May 2016 05:20:22 -0700 (PDT) In-Reply-To: References: From: BlackCat Date: Sun, 29 May 2016 15:20:22 +0300 Message-ID: Subject: Re: ZFS - RAIDZ1 Recovery (Evgeny Sam) To: Evgeny Sam Cc: freebsd-fs@freebsd.org Content-Type: text/plain; charset=UTF-8 X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.22 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 29 May 2016 12:20:42 -0000 2016-05-29 5:42 GMT+03:00 Evgeny Sam : > The Command "zpool import -fFn 2918670121059000644 zh_vol_old" does not show > anything. > I briefly checked sources and looks like ZFS assume that it could import pool. Try following command (note the absence of -n option): # zpool import -o ro -fF 2918670121059000644 zh_vol_old it should really import your pool in readonly mode. -- BR BC From owner-freebsd-fs@freebsd.org Sun May 29 13:13:00 2016 Return-Path: Delivered-To: freebsd-fs@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 0B785B4F462 for ; Sun, 29 May 2016 13:13:00 +0000 (UTC) (envelope-from blackcatzilla@gmail.com) Received: from mail-it0-x22a.google.com (mail-it0-x22a.google.com [IPv6:2607:f8b0:4001:c0b::22a]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id C11B5194A for ; Sun, 29 May 2016 13:12:59 +0000 (UTC) (envelope-from blackcatzilla@gmail.com) Received: by mail-it0-x22a.google.com with SMTP id l63so20672651ita.1 for ; Sun, 29 May 2016 06:12:59 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:in-reply-to:references:from:date:message-id:subject:to :cc; bh=hScyr0onnIlRy2DxU3Eid0gXn0IufLcA9Z6g2XpFK0Q=; b=k62ulN7rmbsHf33qSPn1W6QWqYePdDmXo79QfT+M6W3cUsrZlAKj01tPnv7i4+/hMG XS0vRoeQlWSyiTZREGgxb6mmgku7RsEOhZ1u+ovOVip/K8MflrJWsco0v+a43VTorZP+ jJfUwIVFU1tVm9GjRXOHDJyHrVabEx4MghBCmAA2FThTUMw+7WHQAwxncboBj74gijll NXJVqe/p5bcoovcpb+ges4OL5pfn0qFy+tisar0A/Z+DA6j9+xVmCir43CDWm6l48ljZ cv0G1IRbGPUKiqr5UDDEMAC04zbP1KNEqFvB7daNWZrZ5KqyVzc8jWYR8OeAYaY8OD7r wj3A== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20130820; h=x-gm-message-state:mime-version:in-reply-to:references:from:date :message-id:subject:to:cc; bh=hScyr0onnIlRy2DxU3Eid0gXn0IufLcA9Z6g2XpFK0Q=; b=eQZ5gTJnGToDCPLXBNr2AOl8Ng035tKg/HfW9RSWWAdKemZwgqr69efF989TmZGssP nzF3jmMM22IN6OMAM4Elmr72hZ1Vi7L/5JVoUOGowLN70tT2TOECHhLwysezP9nP1LHr bvFaGb5DsfZpcRczpdXQqYjKB+SnJt15H57wYIms96iuInIEDm0ebCB+ZMcOkjJnfPnK IDhdpLV7OgppqCWIShIge4QAaSqqIgWn6dYTAtBsTVI3iVKMKqWDWvkH/uuFBrq8jdbo W9tGoD7OY8MN3cYENtpFTIOzOab13c9+BJQLERR6fznWEYGn90Vk63Y1xclyF4Cvts3N 7c3g== X-Gm-Message-State: ALyK8tJKPYMXpHCvWkdgD/mAplqO5FoCHB7BbCeYgD6KxiUTD7VokxO9pmatw+IH1hw8ERZqxTiT4gE7tekzzw== X-Received: by 10.36.107.5 with SMTP id v5mr4735741itc.52.1464527578744; Sun, 29 May 2016 06:12:58 -0700 (PDT) MIME-Version: 1.0 Received: by 10.36.46.201 with HTTP; Sun, 29 May 2016 06:12:39 -0700 (PDT) In-Reply-To: References: From: BlackCat Date: Sun, 29 May 2016 16:12:39 +0300 Message-ID: Subject: Re: ZFS - RAIDZ1 Recovery (Evgeny Sam) To: Evgeny Sam Cc: freebsd-fs@freebsd.org Content-Type: text/plain; charset=UTF-8 X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.22 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 29 May 2016 13:13:00 -0000 2016-05-29 15:20 GMT+03:00 BlackCat : > 2016-05-29 5:42 GMT+03:00 Evgeny Sam : >> The Command "zpool import -fFn 2918670121059000644 zh_vol_old" does not show >> anything. >> > I briefly checked sources and looks like ZFS assume that it could import pool. > > Try following command (note the absence of -n option): > # zpool import -o ro -fF 2918670121059000644 zh_vol_old > > it should really import your pool in readonly mode. > Evgeny, please do not run this command for some time. I still can not understand which disk fail, and content of which disk you modified. -- BC BR From owner-freebsd-fs@freebsd.org Sun May 29 13:31:33 2016 Return-Path: Delivered-To: freebsd-fs@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 59222B4FA7A for ; Sun, 29 May 2016 13:31:33 +0000 (UTC) (envelope-from blackcatzilla@gmail.com) Received: from mail-it0-x22f.google.com (mail-it0-x22f.google.com [IPv6:2607:f8b0:4001:c0b::22f]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 26944119E for ; Sun, 29 May 2016 13:31:33 +0000 (UTC) (envelope-from blackcatzilla@gmail.com) Received: by mail-it0-x22f.google.com with SMTP id z189so18699803itg.0 for ; Sun, 29 May 2016 06:31:33 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:in-reply-to:references:from:date:message-id:subject:to :cc; bh=tztaVE+oak5apYbQr5dsAUtYe1HQ2XxLRv8+FP86AUk=; b=ZXVYWHmTmcWJEKUiL3ow2qVSp+Oz+pg19K4zZ2UyY17F1/+EDw/JAg3HSZBm1ykPxx pVyFUhdYP4hNebYzx20v9SwuCj60zUdSJ3AqMM0DLNPEz7/HGkciasmBrc0Gmdovp2wT fs0DrvyM1EfdPdQSiFifo5BepGO9XUIUT3PwaH/KaeFI25VV15dID/TD4WOyFEFp+227 l6MAa4ShPfdLDVw54yjfDiWMPcmsoYq391UNw+Gh1+N4abMgMUqZ7Ksg3+GutYd85Ma8 HeAMaJvx6d24ReYIKSlTiVc3zrS18zJXt/5+OWsdjNJT9dca0ra1v1Q1fNafZ3kiMuIZ Rcng== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20130820; h=x-gm-message-state:mime-version:in-reply-to:references:from:date :message-id:subject:to:cc; bh=tztaVE+oak5apYbQr5dsAUtYe1HQ2XxLRv8+FP86AUk=; b=Wu9/DCNGIMjNbpUXs12/EGdeuxRGToKCMQPCisMyQQI2abyEUq77UKNDF2u6OOBraO ZApPaCbYi7MbXZNGA+lH222E15zAZu41YUTcv+VqwIYNhfXrofb9wln7UHDHLi997jWN HIkdoZ5yFj8QHL1Pp9J1d+rk/IJlghkQ6Kd7SwsC68a1eKyokyLBxbh1P/8PJPksOPIi Bvc/Lk2oRWAkv/YrBbP772iDoAKeR/aGcRR2vFI+SSC9RVgpDNkdut16sR2pclvM6mzM tWD5RUi7XyHAGvcum/LR6/Rg7qNwJNphpgu64pwyLBC2MtBD/PnNtJMGo+GB4p4rQFPS WNzw== X-Gm-Message-State: ALyK8tL7g8X3je1xlU8pRnyV8v5vXrE35LG0Attr9Dm5cZVYHWwKyn2UZnyeqEnLnxTHY5StFGskO9386Ux2Sg== X-Received: by 10.36.31.135 with SMTP id d129mr4685604itd.84.1464528692532; Sun, 29 May 2016 06:31:32 -0700 (PDT) MIME-Version: 1.0 Received: by 10.36.46.201 with HTTP; Sun, 29 May 2016 06:31:13 -0700 (PDT) In-Reply-To: References: From: BlackCat Date: Sun, 29 May 2016 16:31:13 +0300 Message-ID: Subject: Re: ZFS - RAIDZ1 Recovery (Evgeny Sam) To: Evgeny Sam Cc: freebsd-fs@freebsd.org Content-Type: text/plain; charset=UTF-8 X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.22 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 29 May 2016 13:31:33 -0000 2016-05-29 2:07 GMT+03:00 Evgeny Sam : > I ran the command "zpool import -fFn 2918670121059000644 zh_vol_old" > amd it did not work. > > [root@juicy] ~# zpool import -fFn 2918670121059000644 zh_vol_old > [root@juicy] ~# zpool status > no pools available > > I think it did not work, because I am running it on the clonned drives, > which have different GPID's, please correct me if I am wrong. How do you clone your drives? Do you copy whole drive content from first sector to last including GPT label and swap partition or do you manually create partitions and then copy only zfs partition content to the corresponding partition on fresh drive? -- BR BC From owner-freebsd-fs@freebsd.org Sun May 29 13:37:45 2016 Return-Path: Delivered-To: freebsd-fs@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 0DBF1B4FCD4 for ; Sun, 29 May 2016 13:37:45 +0000 (UTC) (envelope-from blackcatzilla@gmail.com) Received: from mail-io0-x230.google.com (mail-io0-x230.google.com [IPv6:2607:f8b0:4001:c06::230]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id CDA9C1393 for ; Sun, 29 May 2016 13:37:44 +0000 (UTC) (envelope-from blackcatzilla@gmail.com) Received: by mail-io0-x230.google.com with SMTP id p64so55360013ioi.2 for ; Sun, 29 May 2016 06:37:44 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:in-reply-to:references:from:date:message-id:subject:to :cc; bh=FiKg2kY+efGC7oVDdNR245jhEbYj0NAvAjOqVNNCoIw=; b=guYpFZkgs9u/nI6LI3/KJe1utaR4yETmYuFw1YD3lJSvKeKC0hvzxipdiAI5F8RuBw iKWol3DpGq8K0ivQfSfJqLrO2loPAgvUsfhXa92oqYzezapCbFtg28SZKc/ohhimGgFn MOWnmqAwfSy10KadWKOXoMWx6Fzk27c2nSiw/UlakK1Tet2tlWsFObICBtOoR4H9mMuO EwhvRut3P/mJSNTFZCaVuL5776iKk1KDUl53RuWLTFXMWqYehOq86e+auEHo0IWeQ0K/ sLEE0S5JeQ1r2RvipIRwTstURNCqifMjcMAql7TeGiaodjjsuJrFkbrbWOIUh7tTJaqD Z+yg== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20130820; h=x-gm-message-state:mime-version:in-reply-to:references:from:date :message-id:subject:to:cc; bh=FiKg2kY+efGC7oVDdNR245jhEbYj0NAvAjOqVNNCoIw=; b=MbebmcBgxIQ3NCduDS90ubSd//tJMomQRPbQdcLW8jiQ+lF+VYr2y0UsQQ+zuZOJ9O /oMkw1sxx2Akn6swz69Q0QIxycPHv0kaKsMQbvpMYSXuaSghEg4L5YEL7uO5UhIxV+K9 ZxISTUoAb3oQ+8tCdDDCAPM7tkFT1ESOtMmS5/sdoxfBvzcwHrksjMKM3jJOJfQtK66L zxQupdOyGSncWIVo9DOX6exCETdsVpV3j+aO5q55yDBB5P41Bd7mSHN2cZCBHiUfy59R g0+UJUweRAWjNkyJTVoq2odM3cHysxZg3h5bzPUWMpM7TUfYb/3Bbdi4jYERZcebTlEC pPhw== X-Gm-Message-State: ALyK8tI+1RD1fJmDulQZNROJJVp3n9RW5GnPy7t0nzpwgYSojimMVppTNuIcYEktrBjcIKQM6e8zj+wVL89Snw== X-Received: by 10.107.132.40 with SMTP id g40mr21260465iod.34.1464529064202; Sun, 29 May 2016 06:37:44 -0700 (PDT) MIME-Version: 1.0 Received: by 10.36.46.201 with HTTP; Sun, 29 May 2016 06:37:24 -0700 (PDT) In-Reply-To: References: From: BlackCat Date: Sun, 29 May 2016 16:37:24 +0300 Message-ID: Subject: Re: ZFS - RAIDZ1 Recovery (Evgeny Sam) To: Evgeny Sam Cc: freebsd-fs@freebsd.org Content-Type: text/plain; charset=UTF-8 X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.22 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 29 May 2016 13:37:45 -0000 2016-05-29 5:42 GMT+03:00 Evgeny Sam : > The failed drive is(has always been) 'ada3' - currently showing bad bloks. > The disk FreeNas sent me an alert that the drive has failed and I verified > that. > > [root@juicy] ~# zdb -e > > SHOWS ONLY HELP INFO > Ok, could you show output of following commands: zdb -e zh_vol zdb -l /dev/ada1p2 zdb -l /dev/ada2p2 zdb -l /dev/ada3p2 -- BR BC From owner-freebsd-fs@freebsd.org Sun May 29 14:31:30 2016 Return-Path: Delivered-To: freebsd-fs@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 62761B51C73 for ; Sun, 29 May 2016 14:31:30 +0000 (UTC) (envelope-from esamorokov@gmail.com) Received: from mail-it0-x231.google.com (mail-it0-x231.google.com [IPv6:2607:f8b0:4001:c0b::231]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 2D98E14C3 for ; Sun, 29 May 2016 14:31:30 +0000 (UTC) (envelope-from esamorokov@gmail.com) Received: by mail-it0-x231.google.com with SMTP id e62so22141391ita.1 for ; Sun, 29 May 2016 07:31:30 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:in-reply-to:references:date:message-id:subject:from:to :cc; bh=rdga9jo8O2ohGrmI/+49dDJVcMjm1Dt0S7cEbMgwMAY=; b=c/QxXkhq/F8fEF48fkGpUWJozGTGGPZ+IVlFKAyrturY+oreC98QcyM1CTUYEMKHIT TyvUaIZYBHZO0rjssm2Bq/UpUs89QRxoNjS7yrBkdzWFWOp+9YY6h4OD6WayZm9IdIdr 2NTrHE7WSqILV3u1XpmXL5KjyF1vMPxPTFEfPpc/RFsslfRnxlJHT0VWHyoB+zE5Ji7u vxAXPLyK6mMaCWu+ymhnv6A/X8d9unqVxTn6oy6LTmPVsWKJEw0C0AU286/mysZ4aZdt UaUlaiq7G+kEsBJ85Xn0yXPFHpQzh4mHLntN4FDzlacxTiGFazihMSE32FW56q88TPVG s+7w== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20130820; h=x-gm-message-state:mime-version:in-reply-to:references:date :message-id:subject:from:to:cc; bh=rdga9jo8O2ohGrmI/+49dDJVcMjm1Dt0S7cEbMgwMAY=; b=JufDeEp6wok5vjwFjr1k+YMbK9nPiZAHFX4fLNl2PWaPDCGxtZY566W55HUq+QmAkz ekz8RzO/TWmUDLmjwafIcs2wxhPemM1mMIKlR0vhXq9Tf97+xVApoyheNU0XdBeiPD/K pg1rUokxX+E92e09zNVZiJVzP50NubNKs956seDWkl9skmoTGHR9i8Xeq0kuPGx2e+cQ 84IJ6z5kcrVhpUeNmoI79vNI7rVWi/hJb5UaDUc+yAmEKM7HnAufSld/79FY7TTFei/d KTyHVLHMYLT7raO6aZMvQkpd3ChjFQMppJ6n0ty7RlpdWV1X2Qx6PDNFcXjb1A+C79DK mQxw== X-Gm-Message-State: ALyK8tJh98R9BczLEHWow8Td3JnIz2R8c0T63A2AqCqlEA+zFVz4dQ4pcV5haywmGTzmopMmmVBIHXQp03Glfw== MIME-Version: 1.0 X-Received: by 10.36.108.76 with SMTP id w73mr5106908itb.63.1464532289394; Sun, 29 May 2016 07:31:29 -0700 (PDT) Received: by 10.107.154.16 with HTTP; Sun, 29 May 2016 07:31:29 -0700 (PDT) In-Reply-To: References: Date: Sun, 29 May 2016 07:31:29 -0700 Message-ID: Subject: Re: ZFS - RAIDZ1 Recovery (Evgeny Sam) From: Evgeny Sam To: BlackCat Cc: freebsd-fs@freebsd.org Content-Type: text/plain; charset=UTF-8 X-Content-Filtered-By: Mailman/MimeDel 2.1.22 X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.22 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 29 May 2016 14:31:30 -0000 I clonned the drives as follows: 1. Created bit-to-bit images with R-Studio (I was hoping to use it to restore the data) 2. Restored the images to the new drives On Sun, May 29, 2016 at 6:31 AM, BlackCat wrote: > 2016-05-29 2:07 GMT+03:00 Evgeny Sam : > > I ran the command "zpool import -fFn 2918670121059000644 zh_vol_old" > > amd it did not work. > > > > [root@juicy] ~# zpool import -fFn 2918670121059000644 zh_vol_old > > [root@juicy] ~# zpool status > > no pools available > > > > I think it did not work, because I am running it on the clonned drives, > > which have different GPID's, please correct me if I am wrong. > > How do you clone your drives? Do you copy whole drive content from > first sector to last including GPT label and swap partition or do you > manually create partitions and then copy only zfs partition content to > the corresponding partition on fresh drive? > > -- > BR BC > From owner-freebsd-fs@freebsd.org Sun May 29 14:32:42 2016 Return-Path: Delivered-To: freebsd-fs@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 9AEFDB51DC5 for ; Sun, 29 May 2016 14:32:42 +0000 (UTC) (envelope-from esamorokov@gmail.com) Received: from mail-ig0-x234.google.com (mail-ig0-x234.google.com [IPv6:2607:f8b0:4001:c05::234]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 6458C17D4 for ; Sun, 29 May 2016 14:32:42 +0000 (UTC) (envelope-from esamorokov@gmail.com) Received: by mail-ig0-x234.google.com with SMTP id ph1so2261671igb.1 for ; Sun, 29 May 2016 07:32:42 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:in-reply-to:references:date:message-id:subject:from:to :cc; bh=FjbkNAtg3jrnZ1DD7YZhM+L8RS+kODhqhNawluqc6qY=; b=J2gpzDGDOfHgNrfB+i0DFZL7oaQUypB8fKLxkw2YHCm36KPNjIsSVXW2ug5Et4Pe7N /Qw6Q7DXKozqlEaHMYNMqdO2L3Zxqqv5el3rle7m7ALtclEj/VPum3MZUM1oibL2EuEI 5ccIHo3/pzbctJ6zxysIdGoftDfPULQ53VKtO5+45/PZPp9eiwLq+kndHqv9yi88XcAV zGbYyWDeHVzqySN3FClm03QrMfoRJdX4BeDXbQcqpKPstryA3bG/a3uILvMjXWmZBW9H 8uFSB2awRU0yrGj6878TIokLw90krCBPesbBJNTSJyltpOxbJP2gPtq+ZtDctP+TMjIk p2Gw== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20130820; h=x-gm-message-state:mime-version:in-reply-to:references:date :message-id:subject:from:to:cc; bh=FjbkNAtg3jrnZ1DD7YZhM+L8RS+kODhqhNawluqc6qY=; b=CrRWCEDJHUQesNC6HhNqIJNYMP/bvxsuyn2OPW1tIJjZp3Vh1V8xpb/hwNLxhTOwhK GXSA1WjN19LNA2qILVVkEAxyWxnn+ADH/br9GgSJplb3qaNR50L8i6Yk8LWLw6HcWiu8 EdZzFi1D1nGJXEaF2U+9sxm2/qn5Uxiq+LTkqLy6hB0YWLAlo9o2rK0b7Xg3JjFrYz5O 0DwpfMajMRLIHJTNbpiTtKRQ7un+mLOfWdQb+Y6icEr/BFWXWtX6IMTEMaotoNW6P+Bz K9mXwDoarhlk2lvfvFTp+pxKeCWAwioNKj2JOfXYxYyyUqdYU4oHTz75AFpeyFKgM17B B1bw== X-Gm-Message-State: ALyK8tIi6hg8hvlz/XYzaNkC3ThT/GAARuQ2QqE/RKq9drqY8zvGp5XB/+ZqJkc8RQ/GlErqdcWXzfNgO3vtiw== MIME-Version: 1.0 X-Received: by 10.50.228.47 with SMTP id sf15mr4588384igc.63.1464532361408; Sun, 29 May 2016 07:32:41 -0700 (PDT) Received: by 10.107.154.16 with HTTP; Sun, 29 May 2016 07:32:41 -0700 (PDT) In-Reply-To: References: Date: Sun, 29 May 2016 07:32:41 -0700 Message-ID: Subject: Re: ZFS - RAIDZ1 Recovery (Evgeny Sam) From: Evgeny Sam To: BlackCat Cc: freebsd-fs@freebsd.org Content-Type: text/plain; charset=UTF-8 X-Content-Filtered-By: Mailman/MimeDel 2.1.22 X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.22 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 29 May 2016 14:32:42 -0000 [root@juicy] ~# zdb -e zh_vol zh_vol vdev_children: 1 version: 5000 pool_guid: 2918670121059000644 name: 'zh_vol' state: 0 hostid: 1802987710 hostname: 'juicy.zhelana.local' vdev_tree: type: 'root' id: 0 guid: 2918670121059000644 children[0]: type: 'raidz' id: 0 guid: 14123440993587991088 nparity: 1 metaslab_array: 34 metaslab_shift: 36 ashift: 12 asize: 8995321675776 is_log: 0 create_txg: 4 children[0]: type: 'disk' id: 0 guid: 17624020450804741401 path: '/dev/gptid/6e5cea27-7f52-11e3-9cd8-d43d7ed5b587' whole_disk: 1 DTL: 137 create_txg: 4 children[1]: type: 'disk' id: 1 guid: 3253299067537287428 whole_disk: 1 DTL: 133 create_txg: 4 path: '/dev/gptid/2b70d9c0-8e40-11e3-aa1c-d43d7ed5b587' children[2]: type: 'disk' id: 2 guid: 17999524418015963258 whole_disk: 1 DTL: 134 create_txg: 4 path: '/dev/gptid/5dacd737-18ac-11e6-9c25-001b7859b93e' zh_vol vdev_children: 2 version: 5000 pool_guid: 10149654347507244742 name: 'zh_vol' state: 2 hostid: 1802987710 hostname: 'juicy.zhelana.local' vdev_tree: type: 'root' id: 0 guid: 10149654347507244742 children[0]: type: 'disk' id: 0 guid: 5892508334691495384 whole_disk: 1 metaslab_array: 33 metaslab_shift: 23 ashift: 12 asize: 983564288 is_log: 0 create_txg: 4 path: '/dev/ada0s2' children[1]: type: 'disk' id: 1 guid: 296669430778697937 whole_disk: 1 metaslab_array: 37 metaslab_shift: 34 ashift: 12 asize: 2997366816768 is_log: 0 create_txg: 1489 path: '/dev/ada2p2' zdb: Matched 2 pools - use pool GUID instead of pool name or pool name part of a dataset name to select pool [root@juicy] ~# zdb -l /dev/ada1p2 -------------------------------------------- LABEL 0 -------------------------------------------- version: 5000 name: 'zh_vol' state: 0 txg: 14262416 pool_guid: 2918670121059000644 hostid: 1802987710 hostname: 'juicy.zhelana.local' top_guid: 14123440993587991088 guid: 17999524418015963258 vdev_children: 1 vdev_tree: type: 'raidz' id: 0 guid: 14123440993587991088 nparity: 1 metaslab_array: 34 metaslab_shift: 36 ashift: 12 asize: 8995321675776 is_log: 0 create_txg: 4 children[0]: type: 'disk' id: 0 guid: 17624020450804741401 path: '/dev/gptid/6e5cea27-7f52-11e3-9cd8-d43d7ed5b587' whole_disk: 1 DTL: 137 create_txg: 4 children[1]: type: 'disk' id: 1 guid: 3253299067537287428 path: '/dev/gptid/2b70d9c0-8e40-11e3-aa1c-d43d7ed5b587' whole_disk: 1 DTL: 133 create_txg: 4 children[2]: type: 'disk' id: 2 guid: 17999524418015963258 path: '/dev/gptid/1e898758-9488-11e3-a86e-d43d7ed5b587' whole_disk: 1 DTL: 134 create_txg: 4 features_for_read: -------------------------------------------- LABEL 1 -------------------------------------------- version: 5000 name: 'zh_vol' state: 0 txg: 14262416 pool_guid: 2918670121059000644 hostid: 1802987710 hostname: 'juicy.zhelana.local' top_guid: 14123440993587991088 guid: 17999524418015963258 vdev_children: 1 vdev_tree: type: 'raidz' id: 0 guid: 14123440993587991088 nparity: 1 metaslab_array: 34 metaslab_shift: 36 ashift: 12 asize: 8995321675776 is_log: 0 create_txg: 4 children[0]: type: 'disk' id: 0 guid: 17624020450804741401 path: '/dev/gptid/6e5cea27-7f52-11e3-9cd8-d43d7ed5b587' whole_disk: 1 DTL: 137 create_txg: 4 children[1]: type: 'disk' id: 1 guid: 3253299067537287428 path: '/dev/gptid/2b70d9c0-8e40-11e3-aa1c-d43d7ed5b587' whole_disk: 1 DTL: 133 create_txg: 4 children[2]: type: 'disk' id: 2 guid: 17999524418015963258 path: '/dev/gptid/1e898758-9488-11e3-a86e-d43d7ed5b587' whole_disk: 1 DTL: 134 create_txg: 4 features_for_read: -------------------------------------------- LABEL 2 -------------------------------------------- failed to unpack label 2 -------------------------------------------- LABEL 3 -------------------------------------------- failed to unpack label 3 [root@juicy] ~# zdb -l /dev/ada2p2 -------------------------------------------- LABEL 0 -------------------------------------------- version: 5000 name: 'zh_vol' state: 2 txg: 2057 pool_guid: 10149654347507244742 hostid: 1802987710 hostname: 'juicy.zhelana.local' top_guid: 296669430778697937 guid: 296669430778697937 vdev_children: 2 vdev_tree: type: 'disk' id: 1 guid: 296669430778697937 path: '/dev/ada2p2' whole_disk: 1 metaslab_array: 37 metaslab_shift: 34 ashift: 12 asize: 2997366816768 is_log: 0 create_txg: 1489 features_for_read: -------------------------------------------- LABEL 1 -------------------------------------------- version: 5000 name: 'zh_vol' state: 2 txg: 2057 pool_guid: 10149654347507244742 hostid: 1802987710 hostname: 'juicy.zhelana.local' top_guid: 296669430778697937 guid: 296669430778697937 vdev_children: 2 vdev_tree: type: 'disk' id: 1 guid: 296669430778697937 path: '/dev/ada2p2' whole_disk: 1 metaslab_array: 37 metaslab_shift: 34 ashift: 12 asize: 2997366816768 is_log: 0 create_txg: 1489 features_for_read: -------------------------------------------- LABEL 2 -------------------------------------------- version: 5000 name: 'zh_vol' state: 2 txg: 2057 pool_guid: 10149654347507244742 hostid: 1802987710 hostname: 'juicy.zhelana.local' top_guid: 296669430778697937 guid: 296669430778697937 vdev_children: 2 vdev_tree: type: 'disk' id: 1 guid: 296669430778697937 path: '/dev/ada2p2' whole_disk: 1 metaslab_array: 37 metaslab_shift: 34 ashift: 12 asize: 2997366816768 is_log: 0 create_txg: 1489 features_for_read: -------------------------------------------- LABEL 3 -------------------------------------------- version: 5000 name: 'zh_vol' state: 2 txg: 2057 pool_guid: 10149654347507244742 hostid: 1802987710 hostname: 'juicy.zhelana.local' top_guid: 296669430778697937 guid: 296669430778697937 vdev_children: 2 vdev_tree: type: 'disk' id: 1 guid: 296669430778697937 path: '/dev/ada2p2' whole_disk: 1 metaslab_array: 37 metaslab_shift: 34 ashift: 12 asize: 2997366816768 is_log: 0 create_txg: 1489 features_for_read: [root@juicy] ~# zdb -l /dev/ada3p2 -------------------------------------------- LABEL 0 -------------------------------------------- version: 5000 name: 'zh_vol' state: 0 txg: 14106447 pool_guid: 2918670121059000644 hostid: 1802987710 hostname: '' top_guid: 14123440993587991088 guid: 3253299067537287428 vdev_children: 1 vdev_tree: type: 'raidz' id: 0 guid: 14123440993587991088 nparity: 1 metaslab_array: 34 metaslab_shift: 36 ashift: 12 asize: 8995321675776 is_log: 0 create_txg: 4 children[0]: type: 'disk' id: 0 guid: 17624020450804741401 path: '/dev/gptid/6e5cea27-7f52-11e3-9cd8-d43d7ed5b587' whole_disk: 1 DTL: 137 create_txg: 4 children[1]: type: 'disk' id: 1 guid: 3253299067537287428 path: '/dev/gptid/2b70d9c0-8e40-11e3-aa1c-d43d7ed5b587' whole_disk: 1 DTL: 133 create_txg: 4 children[2]: type: 'disk' id: 2 guid: 17999524418015963258 path: '/dev/gptid/1e898758-9488-11e3-a86e-d43d7ed5b587' whole_disk: 1 DTL: 134 create_txg: 4 features_for_read: -------------------------------------------- LABEL 1 -------------------------------------------- version: 5000 name: 'zh_vol' state: 0 txg: 14106447 pool_guid: 2918670121059000644 hostid: 1802987710 hostname: '' top_guid: 14123440993587991088 guid: 3253299067537287428 vdev_children: 1 vdev_tree: type: 'raidz' id: 0 guid: 14123440993587991088 nparity: 1 metaslab_array: 34 metaslab_shift: 36 ashift: 12 asize: 8995321675776 is_log: 0 create_txg: 4 children[0]: type: 'disk' id: 0 guid: 17624020450804741401 path: '/dev/gptid/6e5cea27-7f52-11e3-9cd8-d43d7ed5b587' whole_disk: 1 DTL: 137 create_txg: 4 children[1]: type: 'disk' id: 1 guid: 3253299067537287428 path: '/dev/gptid/2b70d9c0-8e40-11e3-aa1c-d43d7ed5b587' whole_disk: 1 DTL: 133 create_txg: 4 children[2]: type: 'disk' id: 2 guid: 17999524418015963258 path: '/dev/gptid/1e898758-9488-11e3-a86e-d43d7ed5b587' whole_disk: 1 DTL: 134 create_txg: 4 features_for_read: -------------------------------------------- LABEL 2 -------------------------------------------- version: 5000 name: 'zh_vol' state: 0 txg: 14106447 pool_guid: 2918670121059000644 hostid: 1802987710 hostname: '' top_guid: 14123440993587991088 guid: 3253299067537287428 vdev_children: 1 vdev_tree: type: 'raidz' id: 0 guid: 14123440993587991088 nparity: 1 metaslab_array: 34 metaslab_shift: 36 ashift: 12 asize: 8995321675776 is_log: 0 create_txg: 4 children[0]: type: 'disk' id: 0 guid: 17624020450804741401 path: '/dev/gptid/6e5cea27-7f52-11e3-9cd8-d43d7ed5b587' whole_disk: 1 DTL: 137 create_txg: 4 children[1]: type: 'disk' id: 1 guid: 3253299067537287428 path: '/dev/gptid/2b70d9c0-8e40-11e3-aa1c-d43d7ed5b587' whole_disk: 1 DTL: 133 create_txg: 4 children[2]: type: 'disk' id: 2 guid: 17999524418015963258 path: '/dev/gptid/1e898758-9488-11e3-a86e-d43d7ed5b587' whole_disk: 1 DTL: 134 create_txg: 4 features_for_read: -------------------------------------------- LABEL 3 -------------------------------------------- version: 5000 name: 'zh_vol' state: 0 txg: 14106447 pool_guid: 2918670121059000644 hostid: 1802987710 hostname: '' top_guid: 14123440993587991088 guid: 3253299067537287428 vdev_children: 1 vdev_tree: type: 'raidz' id: 0 guid: 14123440993587991088 nparity: 1 metaslab_array: 34 metaslab_shift: 36 ashift: 12 asize: 8995321675776 is_log: 0 create_txg: 4 children[0]: type: 'disk' id: 0 guid: 17624020450804741401 path: '/dev/gptid/6e5cea27-7f52-11e3-9cd8-d43d7ed5b587' whole_disk: 1 DTL: 137 create_txg: 4 children[1]: type: 'disk' id: 1 guid: 3253299067537287428 path: '/dev/gptid/2b70d9c0-8e40-11e3-aa1c-d43d7ed5b587' whole_disk: 1 DTL: 133 create_txg: 4 children[2]: type: 'disk' id: 2 guid: 17999524418015963258 path: '/dev/gptid/1e898758-9488-11e3-a86e-d43d7ed5b587' whole_disk: 1 DTL: 134 create_txg: 4 features_for_read: On Sun, May 29, 2016 at 6:37 AM, BlackCat wrote: > 2016-05-29 5:42 GMT+03:00 Evgeny Sam : > > The failed drive is(has always been) 'ada3' - currently showing bad > bloks. > > The disk FreeNas sent me an alert that the drive has failed and I > verified > > that. > > > > [root@juicy] ~# zdb -e > > > > SHOWS ONLY HELP INFO > > > Ok, could you show output of following commands: > > zdb -e zh_vol > zdb -l /dev/ada1p2 > zdb -l /dev/ada2p2 > zdb -l /dev/ada3p2 > > -- > BR BC > From owner-freebsd-fs@freebsd.org Sun May 29 18:31:53 2016 Return-Path: Delivered-To: freebsd-fs@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 978EEB54BB7 for ; Sun, 29 May 2016 18:31:53 +0000 (UTC) (envelope-from blackcatzilla@gmail.com) Received: from mail-ig0-x229.google.com (mail-ig0-x229.google.com [IPv6:2607:f8b0:4001:c05::229]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 5759711A4 for ; Sun, 29 May 2016 18:31:53 +0000 (UTC) (envelope-from blackcatzilla@gmail.com) Received: by mail-ig0-x229.google.com with SMTP id ct2so20038257igb.0 for ; Sun, 29 May 2016 11:31:53 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:in-reply-to:references:from:date:message-id:subject:to :cc; bh=Qz98ax4sJtOSImvCkinOp++kFIH/1YcAwgVyG4el0OE=; b=bNTeU0hXxHZdVFtZOKOYh5ItRomeWTcSpskmddPBETGPj/wW6PZ+g3p5YjOeE+UqI4 1+6sBuATt/i3xFK6GmkNFv1/99QzZ1A7bHLZ47Afou4hrjC/3wVgS4uq4V96MZ0+YvTO ndASoQtXfRj9mc9F+MNF5Smlkjg4BWlbcp+S+mDG22I88Iaz0R18OHV/g/XqUPlYzArx aDH8421QzlgG7YOXMT7AYRGIfS7CxanwareaU6/muJyW+WcXqLx2u5gj5bnmUbV2T0uo hzfR6G0s+ek0b2Gb+vwK+TDPx1pZE9sdlCPL2iW94Pn9+NdP+SgmuOdIuTh6PFO5Ga7h ZAYw== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20130820; h=x-gm-message-state:mime-version:in-reply-to:references:from:date :message-id:subject:to:cc; bh=Qz98ax4sJtOSImvCkinOp++kFIH/1YcAwgVyG4el0OE=; b=WmmCCvwkQRpTE5iY7dH7T1adhUsOwSYUu2sfqpA3vI+TEexS6kSdvp2V/VpRf47Ndm szRJUDnBGtpVpan2mR5BawGEhfgVuMIGgLfLNIHupy6jveZ0JNeVd5pJvgt1ONMxUBVJ 7oaWPiT5Q2iS/xmVg9MTTR6Njyx0CIjva/UawrRq2T55KRnUaullHVUhjcp9Cix9/kBk 7R4SnQFPRIeu6JHuyIK3pcwKsgvTqPcwHPGgH49xi8bfi1Yr3frPEcT5na4IhTdxvU9M MCtRk+zcD634GMqIm2/GV0UgIk5zKYDre2hwvGZcXFP7XOajII1QCARahwelAHJKRZb8 ze8A== X-Gm-Message-State: ALyK8tKaKHw9FmctRfgjdFnYXNJwxiWkqE92VTa15QSV8Qv/EgVzUOuDdUdl+6nSaWLcTUA9XgchViYRXPyJtw== X-Received: by 10.50.11.169 with SMTP id r9mr305928igb.77.1464546712615; Sun, 29 May 2016 11:31:52 -0700 (PDT) MIME-Version: 1.0 Received: by 10.36.46.201 with HTTP; Sun, 29 May 2016 11:31:33 -0700 (PDT) In-Reply-To: References: From: BlackCat Date: Sun, 29 May 2016 21:31:33 +0300 Message-ID: Subject: Re: ZFS - RAIDZ1 Recovery (Evgeny Sam) To: Evgeny Sam Cc: freebsd-fs@freebsd.org Content-Type: text/plain; charset=UTF-8 X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.22 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 29 May 2016 18:31:53 -0000 Evgeny, I still can not figure, what happened to ada2 drive. You say that the broken drive is ada3 and you attempt to replace it. But then something went wrong, you attempted to recover the pool but without success. After that you attach original ada3 drive back to machine and write your initial post to this mailing list? Log, which you attached to your initial post, shows that you attempted to remove _ada2_ from the pool, then you create new pool with the same name and add _ada2p2_ to it. zfs added _ada2p2_ to new pool without any warnings. Then you try to add _ada1p2_ to the new pool and zfs rejects to do that since it suspects that _ada1p2_ already belongs to other pool. The dump of labels from your message shows that: * _adad1p2 is partially Ok (labels at the end of partition are missed) * _ada2p2 is Ok, but belongs to new pool * _ada3p2_ is Ok: all labels exists and belongs to old pool I am really puzzled what happened with each of your drives. -- BC From owner-freebsd-fs@freebsd.org Sun May 29 21:00:10 2016 Return-Path: Delivered-To: freebsd-fs@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 28D86B54B70 for ; Sun, 29 May 2016 21:00:10 +0000 (UTC) (envelope-from bugzilla-noreply@FreeBSD.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2001:1900:2254:206a::16:76]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 080A21E25 for ; Sun, 29 May 2016 21:00:10 +0000 (UTC) (envelope-from bugzilla-noreply@FreeBSD.org) Received: from bugs.freebsd.org ([127.0.1.118]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id u4TL011u082026 for ; Sun, 29 May 2016 21:00:09 GMT (envelope-from bugzilla-noreply@FreeBSD.org) Message-Id: <201605292100.u4TL011u082026@kenobi.freebsd.org> From: bugzilla-noreply@FreeBSD.org To: freebsd-fs@FreeBSD.org Subject: Problem reports for freebsd-fs@FreeBSD.org that need special attention Date: Sun, 29 May 2016 21:00:09 +0000 X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.22 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 29 May 2016 21:00:10 -0000 To view an individual PR, use: https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=(Bug Id). The following is a listing of current problems submitted by FreeBSD users, which need special attention. These represent problem reports covering all versions including experimental development code and obsolete releases. Status | Bug Id | Description ------------+-----------+--------------------------------------------------- New | 203492 | mount_unionfs -o below causes panic Open | 136470 | [nfs] Cannot mount / in read-only, over NFS Open | 139651 | [nfs] mount(8): read-only remount of NFS volume d Open | 144447 | [zfs] sharenfs fsunshare() & fsshare_main() non f 4 problems total for which you should take action. From owner-freebsd-fs@freebsd.org Mon May 30 05:41:10 2016 Return-Path: Delivered-To: freebsd-fs@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 5D355B54399 for ; Mon, 30 May 2016 05:41:10 +0000 (UTC) (envelope-from esamorokov@gmail.com) Received: from mail-pf0-x22d.google.com (mail-pf0-x22d.google.com [IPv6:2607:f8b0:400e:c00::22d]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 34A911DC3 for ; Mon, 30 May 2016 05:41:10 +0000 (UTC) (envelope-from esamorokov@gmail.com) Received: by mail-pf0-x22d.google.com with SMTP id b124so61122043pfb.0 for ; Sun, 29 May 2016 22:41:10 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=subject:to:references:cc:from:message-id:date:user-agent :mime-version:in-reply-to; bh=3h/aTcLCdToo1pEdkUzQze0505iIXrE3qlYCWyh3MIE=; b=uP7lfoHwt+q7cv4S1na+8btGqaGly9Dlu626HuVpyH9v+uc6MAeYjq0/LJ1Vu1rPrq CmTeUfNq+FUYdFU+LBFKi5kTBSIEPuexY85OiGvWG1Rh5nZEK5DrAmWibbb5rXsU+9KA kD1DBagWrXXyih8KWxSLUCtnOBcXdv6Ny3IPrj9NEURh2GcDiXPw7/kUWx9sWZfBx+68 GhxxXG6SCZaNfOiAa0zXbE0sUQ9kRi6bc6sVtAhuRiJ+0HDFix27wApe23ITxYv4ck7z S1Ax4btCkvDiuUoVNk2VaUl02yXzvjaaRnVYu4/2aANP8vo06xoZfiIW3tuQSwRCg5CE 2o5g== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20130820; h=x-gm-message-state:subject:to:references:cc:from:message-id:date :user-agent:mime-version:in-reply-to; bh=3h/aTcLCdToo1pEdkUzQze0505iIXrE3qlYCWyh3MIE=; b=WsUehD5tKDnoQ3Lv8EcovM/a1yqhF9ZzFVJSMVlJcT/apR4U2caQ7EwCc0gaTtgWxk AOv7hT8e79TltTD1Mo9wwmAsDwkUlm/ukyXhCq4+B0ggoKxb20eZeeSB/9KdCBSmYTG1 B5wU4xBe29JeNeyaciCmqUayOnngHoeCgH33Frc0nvPIk2ER6Al4Mlt66Sli+zfEN3ME 1txDXg8DfOUUhW4BsmERKL7NwtOkhVRxgnOw2R83Tl3wV1WAg4Nrlm5fe3ZF9tcjqsbr hf2KQzRtoiW/l0SE4tKo9Ac05LGIuG46BMLYL8ynV1O/1HAGvnU3b3mfGLXccgBtrrHl OmQg== X-Gm-Message-State: ALyK8tLu+Kx27n7CPJpv7n8UKtOEtsPZKnVsOSJDfU+7SJL8wvqwvNgsSXQQg0aCONFnQA== X-Received: by 10.98.94.194 with SMTP id s185mr5263423pfb.32.1464586869465; Sun, 29 May 2016 22:41:09 -0700 (PDT) Received: from [192.168.2.60] ([65.78.190.115]) by smtp.googlemail.com with ESMTPSA id dh4sm43966757pad.37.2016.05.29.22.41.08 (version=TLSv1/SSLv3 cipher=OTHER); Sun, 29 May 2016 22:41:08 -0700 (PDT) Subject: Re: ZFS - RAIDZ1 Recovery (Evgeny Sam) To: BlackCat References: Cc: freebsd-fs@freebsd.org From: esamorokov Message-ID: <574BD273.5040401@gmail.com> Date: Sun, 29 May 2016 22:41:07 -0700 User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:38.0) Gecko/20100101 Thunderbird/38.8.0 MIME-Version: 1.0 In-Reply-To: Content-Type: text/plain; charset=utf-8; format=flowed Content-Transfer-Encoding: 7bit X-Content-Filtered-By: Mailman/MimeDel 2.1.22 X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.22 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 30 May 2016 05:41:10 -0000 BlackCat, I think this table should make it a little bit clear, i hope :) *State #1* *State #2* *State #3* *State #4* *ada1 (ada1p2)* OK OK DISCONNECTED CONNECTED (OLD POOL) *ada2 (ada2p2)* OK OK OK OK (new Pool) *ada3 (ada3p2)* OK FAILED REPLACED CONNECTED FAILED DRIVE (OLD POOL) *ZH_VOL (pool)* OK DEGRADED DESTROYED RECREATED Thank you, Evgeny. On 05/29/2016 11:31 AM, BlackCat wrote: > Evgeny, > > I still can not figure, what happened to ada2 drive. You say that the > broken drive is ada3 and you attempt to replace it. But then something > went wrong, you attempted to recover the pool but without success. > After that you attach original ada3 drive back to machine and write > your initial post to this mailing list? > > Log, which you attached to your initial post, shows that you attempted > to remove _ada2_ from the pool, then you create new pool with the same > name and add _ada2p2_ to it. zfs added _ada2p2_ to new pool without > any warnings. Then you try to add _ada1p2_ to the new pool and zfs > rejects to do that since it suspects that _ada1p2_ already belongs to > other pool. > > The dump of labels from your message shows that: > * _adad1p2 is partially Ok (labels at the end of partition are missed) > * _ada2p2 is Ok, but belongs to new pool > * _ada3p2_ is Ok: all labels exists and belongs to old pool > > I am really puzzled what happened with each of your drives. > From owner-freebsd-fs@freebsd.org Mon May 30 07:11:44 2016 Return-Path: Delivered-To: freebsd-fs@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id D9B5BB5446E for ; Mon, 30 May 2016 07:11:44 +0000 (UTC) (envelope-from blackcatzilla@gmail.com) Received: from mail-ig0-x22c.google.com (mail-ig0-x22c.google.com [IPv6:2607:f8b0:4001:c05::22c]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 9915B1A3C for ; Mon, 30 May 2016 07:11:44 +0000 (UTC) (envelope-from blackcatzilla@gmail.com) Received: by mail-ig0-x22c.google.com with SMTP id ct2so25810622igb.0 for ; Mon, 30 May 2016 00:11:44 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:in-reply-to:references:from:date:message-id:subject:to :cc; bh=bYMug2SN6rYxmHEjGLFqn+8l86geXUecNH7Ja75aGyk=; b=c8ZrigFvg26EW7YhBY0s87c0zy1K5SNx3YbKiiuSxIOGIlokWh1gii/W7Z6pxXQdzv nVbL6WcNUTpX97jRm9wc7fHkD8kShHyVYD4rcZv8oapOgOqntYT+qFOqSB4miT6euTEx bZpvHGGMMaYXhK/areJQdYS8hvi4m7PQpWlOcWVLzUsb4kfMQftCBddU2iU2YumDEKL4 6IONxZu5zJlgPMfbf+EzXJ5hVIVHkzDrNkw7ZDphskvfEnkbBY7lsJg7fl1+78Nkfmkx piIvcS7cT7Ex4Ttdue7beDzbTMVx0pw0DUBlyIicswybJksgZaaEgSE2YlUb3wcLjC3x PNTg== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20130820; h=x-gm-message-state:mime-version:in-reply-to:references:from:date :message-id:subject:to:cc; bh=bYMug2SN6rYxmHEjGLFqn+8l86geXUecNH7Ja75aGyk=; b=P7urDgIBpOHWXjvNMG4d4UD0rTwKrIzYJYpfT9njRc3en3CHJ0J2YnZGq+5k4he/tP 7Lmgb7s0KUmcQvS1ftq5X7cqqTGK0WPQsZgWl921xVvsNkTX4hTiaOpuYtYizeFl28v9 gIhr5Ug+sBoxlgLOEXfIacDYJU8sFWrCO3FAWxitv11hOVVHeG7ek9f8yd1HRvxEKxbp CCqzo5qmCxjNtEFuPKztIgjBzhC3J6INzkU1wYGZjTFj0ZWLfWkVU82q3A/NmxX0pVFa Pz2HNBnsXz/VHUCR/09O+pafW10Ykva6a81zdsULNRZX9+ImOO3ADC/LqfJElMq8pfMW 05nQ== X-Gm-Message-State: ALyK8tJ659WNWp613+b+croTUEYo5FPsMpVmqj/HRK3y+cF+1ZS5WwQWXJmrIl8cpGOjRz9N813btSrFsN7yVQ== X-Received: by 10.50.18.198 with SMTP id y6mr6122097igd.86.1464592303966; Mon, 30 May 2016 00:11:43 -0700 (PDT) MIME-Version: 1.0 Received: by 10.36.46.201 with HTTP; Mon, 30 May 2016 00:11:24 -0700 (PDT) In-Reply-To: <574BD273.5040401@gmail.com> References: <574BD273.5040401@gmail.com> From: BlackCat Date: Mon, 30 May 2016 10:11:24 +0300 Message-ID: Subject: Re: ZFS - RAIDZ1 Recovery (Evgeny Sam) To: esamorokov Cc: freebsd-fs@freebsd.org Content-Type: text/plain; charset=UTF-8 X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.22 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 30 May 2016 07:11:45 -0000 Hello Evgeny, 2016-05-30 8:41 GMT+03:00 esamorokov : > I think this table should make it a little bit clear, i hope :) > > Drive State #1 State #2 State #3 State #4 > ada1 (ada1p2) OK OK DISCONNECTED CONNECTED (OLD POOL) > ada2 (ada2p2) OK OK OK OK (new Pool) > ada3 (ada3p2) OK FAILED REPLACED CONNECTED FAILED DRIVE (OLD POOL) > ZH_VOL (pool) OK DEGRADED DESTROYED RECREATED > > Thank you, > Evgeny. > > On 05/29/2016 11:31 AM, BlackCat wrote: > > Evgeny, > > I still can not figure, what happened to ada2 drive. You say that the > broken drive is ada3 and you attempt to replace it. But then something > went wrong, you attempted to recover the pool but without success. > After that you attach original ada3 drive back to machine and write > your initial post to this mailing list? > > Log, which you attached to your initial post, shows that you attempted > to remove _ada2_ from the pool, then you create new pool with the same > name and add _ada2p2_ to it. zfs added _ada2p2_ to new pool without > any warnings. Then you try to add _ada1p2_ to the new pool and zfs > rejects to do that since it suspects that _ada1p2_ already belongs to > other pool. > > The dump of labels from your message shows that: > * _adad1p2 is partially Ok (labels at the end of partition are missed) > * _ada2p2 is Ok, but belongs to new pool > * _ada3p2_ is Ok: all labels exists and belongs to old pool > > I am really puzzled what happened with each of your drives. > Thank you for this nice formatted table, it perfectly summarize states of drives. But I still can not figure how drives change from one state to another, especially how could you attach ada2p2 to new pool without detaching it from old one. Ok if no one else would suggest any better solution, let's keep one's fingers crossed and try to import pool as-is (in any case you have copies of your original drives): # zpool import -o ro -fF 2918670121059000644 zh_vol_old -- BR BC From owner-freebsd-fs@freebsd.org Mon May 30 08:48:06 2016 Return-Path: Delivered-To: freebsd-fs@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 6E9F0B53486 for ; Mon, 30 May 2016 08:48:06 +0000 (UTC) (envelope-from lists@yamagi.org) Received: from mail1.yamagi.org (yugo.yamagi.org [212.48.122.103]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 37F271A88 for ; Mon, 30 May 2016 08:48:04 +0000 (UTC) (envelope-from lists@yamagi.org) Received: from [192.168.100.101] (helo=aka) by mail1.yamagi.org with esmtpsa (TLSv1.2:ECDHE-RSA-AES256-GCM-SHA384:256) (Exim 4.86 (FreeBSD)) (envelope-from ) id 1b7IrD-0003Lh-EF; Mon, 30 May 2016 10:48:01 +0200 Date: Mon, 30 May 2016 10:47:26 +0200 From: Yamagi Burmeister To: kostikbel@gmail.com Cc: freebsd-fs@freebsd.org Subject: Re: LOR between allproc <-> ufs Message-Id: <20160530104726.350dab8040f1eb7c57619e36@yamagi.org> In-Reply-To: <20160527141016.GL38613@kib.kiev.ua> References: <20160526160902.bbe4c36ad340f11f69f7ba08@yamagi.org> <20160526155844.GH38613@kib.kiev.ua> <20160527153705.ee502c0a528cedd29c65b0ca@yamagi.org> <20160527141016.GL38613@kib.kiev.ua> X-Mailer: Sylpheed 3.5.0 (GTK+ 2.24.29; amd64-portbld-freebsd10.1) Mime-Version: 1.0 Content-Type: text/plain; charset=US-ASCII Content-Transfer-Encoding: 7bit X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.22 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 30 May 2016 08:48:06 -0000 Hello, I think I'm a little bit late to the party. As always in this situations the panic message wasn't included into the dump, the unread portion of the kernel message buffer is empty. I've crashed the system again and got two messages: - panic: sleeping thread - panic: thread with borrowed priority returning to userland Likely another incarnation of the panic in Peter Holms kostik886.txt. Can I do something more to help with this? Regards, Yamagi On Fri, 27 May 2016 17:10:16 +0300 Konstantin Belousov wrote: > On Fri, May 27, 2016 at 03:37:05PM +0200, Yamagi Burmeister wrote: > > On Thu, 26 May 2016 18:58:44 +0300 > > Konstantin Belousov wrote: > > > > > Completely untested patch is below. I do not think that this LOR > > > can be reproduced at will. E.g. you need to record the order > > > in witness by unmounting some filesystem mounted on a directory > > > on UFS mount. Then, the chances must be that it was the last > > > reference on the vmspace, or that there were deferred vnode entry. > > > > With this patch the system panics as soon there's some load on the > > filesystem. Maybe only when several processes accessing the same > > mountpoint, but I'm not sure. For example 'make -j24 buildkernel' > > crashes the system nearly instantly. > > at /usr/src/sys/kern/kern_shutdown.c:777 > > #11 0xffffffff809b5aeb in witness_warn (flags=, lock=, > > fmt=) at /usr/src/sys/kern/subr_witness.c:1757 > > #12 0xffffffff809aa0a8 in userret (td=0xfffff800264c6960, frame=) > > at /usr/src/sys/kern/subr_trap.c:157 > > #13 0xffffffff80d78151 in amd64_syscall (td=0xfffff800264c6960, traced=) > > at subr_syscall.c:185 > > This is an assert about some lock leak. Most useful is verbatim > panic message with all surrounding kernel printouts. I do not even need > the backtrace. -- Homepage: www.yamagi.org XMPP: yamagi@yamagi.org GnuPG/GPG: 0xEFBCCBCB From owner-freebsd-fs@freebsd.org Tue May 31 05:44:34 2016 Return-Path: Delivered-To: freebsd-fs@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 29FEEB55F19 for ; Tue, 31 May 2016 05:44:34 +0000 (UTC) (envelope-from esamorokov@gmail.com) Received: from mail-pf0-x22c.google.com (mail-pf0-x22c.google.com [IPv6:2607:f8b0:400e:c00::22c]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id EF6701DD0 for ; Tue, 31 May 2016 05:44:33 +0000 (UTC) (envelope-from esamorokov@gmail.com) Received: by mail-pf0-x22c.google.com with SMTP id 62so26405202pfd.1 for ; Mon, 30 May 2016 22:44:33 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=subject:to:references:cc:from:message-id:date:user-agent :mime-version:in-reply-to:content-transfer-encoding; bh=aC3yeHVLCOBmP4+Z0nU84F8unEPHidVAmNH470dOGqs=; b=KOOjrYuxYYT6ibj/KnyW4nGFIyxmc9bWwP0VQFJpcjcsbLjeTCJt50h5kANZyb3RhV vci0qIvnDBKZ4VBpBzzfMGbyr3yrWO8/JnhTANlFeEv2majz7U5UEeF4mU83/zcE3Irb geMXw2Z0FbhNMB9tDHgW72e+cI3RQgmAx8dnzFXlIUv8DwLqnjXyOmt79BnBtds0Cxut IhbJ9aM8gPDpEMfCJZsFhdP53eCQs2/tY8pgHP5lckkxvE8EZEC0iE5dNeJ/203PcOXH Gl5PmFOJl1068xGUbGSG6vcIzTBLQ+ZLFI/Hyk3Bmf3WMj7/bZ8PThexqGq4N3UMToZr uKhg== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20130820; h=x-gm-message-state:subject:to:references:cc:from:message-id:date :user-agent:mime-version:in-reply-to:content-transfer-encoding; bh=aC3yeHVLCOBmP4+Z0nU84F8unEPHidVAmNH470dOGqs=; b=FUqckb41cOnNbmb/0QQqeBqpvsI2SkGN3htPISUvnAul4zIpr5Sm7wrKKs4gKPDqKr HoPhwuTSZoz9EK7ax/Dmfo8f3eZB49JC42ddGsQFBgHr9UOMzttAAsFp/kSlZ7vK5MCm Szy0XArzEX9pnE2HYgxD8gQ8Lzp8Ug9fMLxwMrZXgEba7iHcq4E1MTaH/vDmUzedkd3u xEdBZa/BaFu4qQZuvsNfPjAA7WZbF1Z5G1ROh3fGDtnwxlb4Fiorj9pqsVwe/xULVPiR 6i+O9RMHFYhmCVlL1hNPQYtRmgJIyfU9G8XLokFjMVeLaesPOh8kpFhwLyclWld/e46U zffw== X-Gm-Message-State: ALyK8tI2kBrnc+Yfk34txQon8YQdqkw4Gz2bQaYsrz+dZlO3wij+21a5CuOovRp90dFVAw== X-Received: by 10.98.200.215 with SMTP id i84mr16108800pfk.28.1464673473344; Mon, 30 May 2016 22:44:33 -0700 (PDT) Received: from [192.168.2.60] ([65.78.190.115]) by smtp.googlemail.com with ESMTPSA id 7sm36858155pfn.30.2016.05.30.22.44.32 (version=TLSv1/SSLv3 cipher=OTHER); Mon, 30 May 2016 22:44:32 -0700 (PDT) Subject: Re: ZFS - RAIDZ1 Recovery (Evgeny Sam) To: "Kevin P. Neal" References: <20160530202147.GA40137@neutralgood.org> Cc: freebsd-fs@freebsd.org From: esamorokov Message-ID: <574D24C0.20308@gmail.com> Date: Mon, 30 May 2016 22:44:32 -0700 User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:38.0) Gecko/20100101 Thunderbird/38.8.0 MIME-Version: 1.0 In-Reply-To: <20160530202147.GA40137@neutralgood.org> Content-Type: text/plain; charset=windows-1252; format=flowed Content-Transfer-Encoding: 7bit X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.22 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 31 May 2016 05:44:34 -0000 Kevin, > The dd command when given the "conv=noerror,sync" option can be used to > duplicate an entire disk. Yes, I know Linux and of course I know dd with it's options, moreover that was the first thing I tried (after I went out of "panic mode" :) > Does R-Studio copy the entire disk including GPT specific parts, or does > it copy partitions of disks? I've been working with R-Studio for many years and absolutely sure that it does complete copy of the drive as it is, no matter what the file system is. > When you say a disk "failed", > what does that mean? First, ZFS showed the drive unavailable. Second, the disk has a bunch of bad sectors and took forever to copy first 500MB both with dd (conv=noerror,sync) and R-studio > I feel bad for you losing precious family history. Thanks for understanding, i appreciate it! As I already said earlier, I was in the middle of my backup server build, when it all happened :( > Anyway, have you asked for help on any OpenZFS list yet? No, I have not, but if you could direct me somwhere, it would be much appreciated! The Best Regards, Evgeny. From owner-freebsd-fs@freebsd.org Tue May 31 05:52:07 2016 Return-Path: Delivered-To: freebsd-fs@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 0C534B55073 for ; Tue, 31 May 2016 05:52:07 +0000 (UTC) (envelope-from esamorokov@gmail.com) Received: from mail-pf0-x233.google.com (mail-pf0-x233.google.com [IPv6:2607:f8b0:400e:c00::233]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id CB50B1FEA for ; Tue, 31 May 2016 05:52:06 +0000 (UTC) (envelope-from esamorokov@gmail.com) Received: by mail-pf0-x233.google.com with SMTP id f144so58138632pfa.3 for ; Mon, 30 May 2016 22:52:06 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=subject:to:references:cc:from:message-id:date:user-agent :mime-version:in-reply-to:content-transfer-encoding; bh=2GrMkAcd19hM2iNYhv3h7cw47AG0E94l2NgpgCy/bUc=; b=VHhNQ6/bGd8UWgGGjH33DPzMGZOPtiLSAPbMwywMnS2GLMYPUUv60OuQwbOhyh7qNd Mm687vZLl1E+BGTGsC5v3wg6NUMr6hUWi1BJOyUqLnfbXGxB/BY8AhPLmzv/f4sbYr7J jFw47UVvuHczfvqCVdQC+ZPPfqKZomeanOi7kIZAJGJ77XEH61J5Gu1jHTAFAqmUu78k aENx/h1AzvaLoFTwHEVwbTMlqopK6Fn9Qz3YH0lZ1PNeHJHyPUq3v5oJmtBDIz2X2TWZ 9FpJfXz0G/2BjP+Yku4V8eRACPexv2Dm05wmPueP3mGUTv0++q80s0hgWwrZUI1UWKJ1 KPyQ== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20130820; h=x-gm-message-state:subject:to:references:cc:from:message-id:date :user-agent:mime-version:in-reply-to:content-transfer-encoding; bh=2GrMkAcd19hM2iNYhv3h7cw47AG0E94l2NgpgCy/bUc=; b=gch4pg4O+wBxetxVUfePBBVmpzWbOPQJp9IhbMS84Hd3kPAz2YA4ndt+QBFH5lYHBW a38GwsaBG9kacyQvrm8mVqSRUI99xJn3QGjb/KKm0n6WLJLKpCFg26ae5l9ZiAVUgbrZ iBOnX0p+9g6tEB2Sx3hc7+NA8USCyFXjvYl1oZGgOkZGUZhikQNUpEKjO/v1a5bH8pmv 5dv2PPvLdchmC5z0i0qfD3yQzeIi2HE4K6aOvNM3bWmIAnGW6f5+HXv4gTb5p3s5EGMJ 4D8Vt4LDe66/bGoN5H7ogAxnzUlU9glaTG34ZVTsonZAIBLGjMXUaxawPn2aTMJEVHea bbfQ== X-Gm-Message-State: ALyK8tI6/iBhND2jaxbGZRcAPR1gQtPz6/D8QuI/t8zo7rfeB8hTEQq37Z+KGDTN+im+sw== X-Received: by 10.98.25.212 with SMTP id 203mr18000985pfz.94.1464673926310; Mon, 30 May 2016 22:52:06 -0700 (PDT) Received: from [192.168.2.60] ([65.78.190.115]) by smtp.googlemail.com with ESMTPSA id p190sm36915607pfp.46.2016.05.30.22.52.05 (version=TLSv1/SSLv3 cipher=OTHER); Mon, 30 May 2016 22:52:05 -0700 (PDT) Subject: Re: ZFS - RAIDZ1 Recovery (Evgeny Sam) To: BlackCat References: <574BD273.5040401@gmail.com> Cc: freebsd-fs@freebsd.org From: esamorokov Message-ID: <574D2685.9040903@gmail.com> Date: Mon, 30 May 2016 22:52:05 -0700 User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:38.0) Gecko/20100101 Thunderbird/38.8.0 MIME-Version: 1.0 In-Reply-To: Content-Type: text/plain; charset=utf-8; format=flowed Content-Transfer-Encoding: 7bit X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.22 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 31 May 2016 05:52:07 -0000 BlackCat, Here is what I got with that command: [root@juicy] ~# zpool import -o ro -fF 2918670121059000644 zh_vol_old cannot import 'zh_vol' as 'zh_vol_old': I/O error Destroy and re-create the pool from a backup source. From owner-freebsd-fs@freebsd.org Tue May 31 07:33:32 2016 Return-Path: Delivered-To: freebsd-fs@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 0A34AB5564D for ; Tue, 31 May 2016 07:33:32 +0000 (UTC) (envelope-from michelle@sorbs.net) Received: from hades.sorbs.net (mail.sorbs.net [67.231.146.200]) by mx1.freebsd.org (Postfix) with ESMTP id F253D12DE for ; Tue, 31 May 2016 07:33:31 +0000 (UTC) (envelope-from michelle@sorbs.net) MIME-version: 1.0 Content-transfer-encoding: 7BIT Content-type: text/plain; CHARSET=US-ASCII; format=flowed Received: from isux.com (firewall.isux.com [213.165.190.213]) by hades.sorbs.net (Oracle Communications Messaging Server 7.0.5.29.0 64bit (built Jul 9 2013)) with ESMTPSA id <0O8100J513VX6J00@hades.sorbs.net> for freebsd-fs@freebsd.org; Mon, 30 May 2016 23:40:47 -0700 (PDT) Subject: Re: ZFS - RAIDZ1 Recovery (Evgeny Sam) To: "Kevin P. Neal" , Evgeny Sam Cc: freebsd-fs@freebsd.org References: <20160530202147.GA40137@neutralgood.org> From: Michelle Sullivan Message-id: <574D3032.9040008@sorbs.net> Date: Tue, 31 May 2016 08:33:22 +0200 User-Agent: Mozilla/5.0 (Macintosh; Intel Mac OS X 10.11; rv:43.0) Gecko/20100101 Firefox/43.0 SeaMonkey/2.40 In-reply-to: <20160530202147.GA40137@neutralgood.org> X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.22 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 31 May 2016 07:33:32 -0000 Kevin P. Neal wrote: > On Sun, May 29, 2016 at 07:31:29AM -0700, Evgeny Sam wrote: >> I clonned the drives as follows: >> 1. Created bit-to-bit images with R-Studio (I was hoping to use it to >> restore the data) >> 2. Restored the images to the new drives > A quick check of their web site shows zero support for ZFS. > > There are several good ways to duplicate a disk, and at the top of the > list are tools known to the people you are going to need help from. That > means using the 'dd' command to duplicate the entire disk including the > GPT labels. Or use something from Polytropon's list posted to these lists > (usually the questions list mostly) every so often. > > The dd command when given the "conv=noerror,sync" option can be used to > duplicate an entire disk. Then a ZFS scrub can correct the lost blocks. You know it has occurred to me on more than one occasion that having a disk added for online replacement of a failed disk, and using zfs replace, it's surprising that internal to zfs it doesn't try exactly that... bit/sector copy the drive from the old to the new replacement before switching to a scrub... if it did it would, on my system, cut the resilver time from 10 days to however long it takes for 3T of data to copy (likely <24hrs). > > Does R-Studio copy the entire disk including GPT specific parts, or does > it copy partitions of disks? It isn't obvious which one it does from your > description. > It does both (either) - depending on how you start it. The lack of support for zfs is a lack of being able to read and recover the contents of a zfs disk... nothing more nothing less. (I have R-Studio here and have used it in anger many times.) -- Michelle Sullivan http://www.mhix.org/ From owner-freebsd-fs@freebsd.org Tue May 31 07:58:33 2016 Return-Path: Delivered-To: freebsd-fs@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 85F42B55E58 for ; Tue, 31 May 2016 07:58:33 +0000 (UTC) (envelope-from blackcatzilla@gmail.com) Received: from mail-io0-x231.google.com (mail-io0-x231.google.com [IPv6:2607:f8b0:4001:c06::231]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 5628A10D2 for ; Tue, 31 May 2016 07:58:33 +0000 (UTC) (envelope-from blackcatzilla@gmail.com) Received: by mail-io0-x231.google.com with SMTP id t40so125995091ioi.0 for ; Tue, 31 May 2016 00:58:33 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:in-reply-to:references:from:date:message-id:subject:to :cc; bh=SEQhgKup0B5vSOjhLFc+T74L/c1zVoEWAPlwv+ho9Uo=; b=Li2PIPUy13uuN77q1DIReDHSNSuiVDyf2leJet2ivoB8dX860+iJNO35aaX7yNeJGw rPpAIEFWi+Q0RcrpJKSCdRTFvwvf46FUfIdJs9nuG7rJX+nkiwsTwlxS5NhALdDi2Wf0 QubiUiB57FaSjt4w6eSStiJ29TzL3T6QGhT6R5QJnF6AXFMW2+yOgrdin6NAaHX3thSs o2z45K6cyZIBpSCbkuaYyZPF0esMEgeZHXegQy7jX8SS4RCr9XXA5JAEtjk67NoQQIwz S9Vd66hC/cxPUB+nL2daAc2EoXfGLfyr71ucvqZXgAqaC69IVGv9UDS82mZnRX6Mmy1o +KsA== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20130820; h=x-gm-message-state:mime-version:in-reply-to:references:from:date :message-id:subject:to:cc; bh=SEQhgKup0B5vSOjhLFc+T74L/c1zVoEWAPlwv+ho9Uo=; b=Z5XtIdEt8KvqNSWuSmwACDTJHlAnG0cnYR7f1BBwYJulk+kBSOlSimPAiR70HniWWR 1dCbLXEUtH1kivRhJ/iggAgpIduaqS2uHusUXfUuSTRtTPX10a196YSQuMEq56CwQ5ym UvwPcyRCQSX9jFZ1tkIDX7MD3HbdBQK8r9eMuc/1NC4gnpKi2J2yoorGgjf+0MrMZ6Dm 23jPxtGtcEuNAokPBptgqFjICwxhV8OC6p9XNN/WGTizKvtxqhgPzO0tHxOzIjx0sKgk BrgnBKEC/NP6fQhBvyagiKlVxHvTtnG6Zs77GsR6lrd5Uh86bt8yGFcVtBqUWyU32JBB kpeA== X-Gm-Message-State: ALyK8tK1NxFLGehzeA6V3L4G7rknItPew+lw8R0eVpebZMlwGCd+1bjqkHr6BlgDTf5xWq4TVgg/c9lpnSTCug== X-Received: by 10.107.132.40 with SMTP id g40mr28691975iod.34.1464681512525; Tue, 31 May 2016 00:58:32 -0700 (PDT) MIME-Version: 1.0 Received: by 10.36.46.201 with HTTP; Tue, 31 May 2016 00:58:13 -0700 (PDT) In-Reply-To: <574D2685.9040903@gmail.com> References: <574BD273.5040401@gmail.com> <574D2685.9040903@gmail.com> From: BlackCat Date: Tue, 31 May 2016 10:58:13 +0300 Message-ID: Subject: Re: ZFS - RAIDZ1 Recovery (Evgeny Sam) To: esamorokov Cc: freebsd-fs@freebsd.org Content-Type: text/plain; charset=UTF-8 X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.22 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 31 May 2016 07:58:33 -0000 2016-05-31 8:52 GMT+03:00 esamorokov : > BlackCat, > Here is what I got with that command: > > [root@juicy] ~# zpool import -o ro -fF 2918670121059000644 zh_vol_old > cannot import 'zh_vol' as 'zh_vol_old': I/O error > Destroy and re-create the pool from > a backup source. > Evgeny, do you have a copy of ada3 drive? Looks like labels at ada3 is Ok, but some structures are inaccessible due to bad blocks. If you already have a copy of ada3 could you attach it instead of failed drive and try again the above command, this could help to avoid I/O errors. -- BR BC From owner-freebsd-fs@freebsd.org Tue May 31 10:07:17 2016 Return-Path: Delivered-To: freebsd-fs@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id EE4CDB549F6 for ; Tue, 31 May 2016 10:07:17 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2001:1900:2254:206a::16:76]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id DF6381BE2 for ; Tue, 31 May 2016 10:07:17 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from bugs.freebsd.org ([127.0.1.118]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id u4VA7EFH020200 for ; Tue, 31 May 2016 10:07:17 GMT (envelope-from bugzilla-noreply@freebsd.org) From: bugzilla-noreply@freebsd.org To: freebsd-fs@FreeBSD.org Subject: [Bug 194513] zfs recv hangs in state kmem arena Date: Tue, 31 May 2016 10:07:14 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 10.0-STABLE X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Some People X-Bugzilla-Who: girgen@FreeBSD.org X-Bugzilla-Status: Open X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: freebsd-fs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.22 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 31 May 2016 10:07:18 -0000 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D194513 --- Comment #16 from Palle Girgensohn --- We are seeing this regularly on a machine with 34 GB RAM 34 TB storage JBOD large array (ZFS) *no* SSD ZIL or L2Arc. ssh othermachine zfs send fs | zfs receive fs sometimes hangs. Not often, perhaps once a month or so. Always in kmem arena just like mgoroff@quorum.net describes above. I tried Stevens program to allocate memory, but it still stuck. This is backup machine, so I can always just reboot, unless someone has an = idea about something to try first, that could perhaps explain more about what's happening? Palle --=20 You are receiving this mail because: You are the assignee for the bug.= From owner-freebsd-fs@freebsd.org Tue May 31 10:15:30 2016 Return-Path: Delivered-To: freebsd-fs@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 5EB2EB54BE2 for ; Tue, 31 May 2016 10:15:30 +0000 (UTC) (envelope-from wjw@digiware.nl) Received: from smtp.digiware.nl (unknown [IPv6:2001:4cb8:90:ffff::3]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 26BF71F7B for ; Tue, 31 May 2016 10:15:29 +0000 (UTC) (envelope-from wjw@digiware.nl) Received: from rack1.digiware.nl (unknown [127.0.0.1]) by smtp.digiware.nl (Postfix) with ESMTP id 201EF153402; Tue, 31 May 2016 12:15:26 +0200 (CEST) X-Virus-Scanned: amavisd-new at digiware.com Received: from smtp.digiware.nl ([127.0.0.1]) by rack1.digiware.nl (rack1.digiware.nl [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id i5JA7P0YZ3E9; Tue, 31 May 2016 12:15:15 +0200 (CEST) Received: from [IPv6:2001:4cb8:3:1:f85f:1e7c:9313:d8b2] (unknown [IPv6:2001:4cb8:3:1:f85f:1e7c:9313:d8b2]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (No client certificate requested) by smtp.digiware.nl (Postfix) with ESMTPSA id 1270B1534C6; Tue, 31 May 2016 12:15:15 +0200 (CEST) Subject: Re: ZFS - RAIDZ1 Recovery (Evgeny Sam) To: "Kevin P. Neal" , Evgeny Sam References: <20160530202147.GA40137@neutralgood.org> Cc: freebsd-fs@freebsd.org From: Willem Jan Withagen Message-ID: Date: Tue, 31 May 2016 12:15:04 +0200 User-Agent: Mozilla/5.0 (Windows NT 10.0; WOW64; rv:45.0) Gecko/20100101 Thunderbird/45.1.0 MIME-Version: 1.0 In-Reply-To: <20160530202147.GA40137@neutralgood.org> Content-Type: text/plain; charset=windows-1252 Content-Transfer-Encoding: 7bit X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.22 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 31 May 2016 10:15:30 -0000 On 30-5-2016 22:21, Kevin P. Neal wrote: > There are several good ways to duplicate a disk, and at the top of the > list are tools known to the people you are going to need help from. That > means using the 'dd' command to duplicate the entire disk including the > GPT labels. Or use something from Polytropon's list posted to these lists > (usually the questions list mostly) every so often. > > The dd command when given the "conv=noerror,sync" option can be used to > duplicate an entire disk. Then a ZFS scrub can correct the lost blocks. Might I suggest dd_rescue here? Sort of designed for precisely this problem. Does large bulk transfers, but when in error it reduces blocksize to the sector, and tries several times.... And there are lots of other options. So it is fast and as accurate as it can get. Save my life a few times. --WjW From owner-freebsd-fs@freebsd.org Tue May 31 15:41:44 2016 Return-Path: Delivered-To: freebsd-fs@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 14C41B55C37 for ; Tue, 31 May 2016 15:41:44 +0000 (UTC) (envelope-from feld@FreeBSD.org) Received: from out2-smtp.messagingengine.com (out2-smtp.messagingengine.com [66.111.4.26]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id E32281AAD for ; Tue, 31 May 2016 15:41:43 +0000 (UTC) (envelope-from feld@FreeBSD.org) Received: from compute4.internal (compute4.nyi.internal [10.202.2.44]) by mailout.nyi.internal (Postfix) with ESMTP id 91F2C256A7; Tue, 31 May 2016 11:41:42 -0400 (EDT) Received: from web4 ([10.202.2.214]) by compute4.internal (MEProxy); Tue, 31 May 2016 11:41:42 -0400 DKIM-Signature: v=1; a=rsa-sha1; c=relaxed/relaxed; d= messagingengine.com; h=cc:content-transfer-encoding:content-type :date:from:in-reply-to:message-id:mime-version:references :subject:to:x-sasl-enc:x-sasl-enc; s=smtpout; bh=5l6JVvDnNugP07a DBhdynSMZPwQ=; b=PgHj+EQm9AUpPQr0CzIE1RFRDvngzgRnsh0cDkedMlCk4M5 PKuaWgqe82EWoKcpnUBusLxbFPjA7arK5yeusooJ/7t2dVp/G3Dj3JQQ+61w93/o OPuGOgDfjksefaXl8lKzpt3Ciuyy/U2rcenJqUSge1EkGP/8UXlmFQnwOAuk= Received: by mailuser.nyi.internal (Postfix, from userid 99) id 561CBCC350; Tue, 31 May 2016 11:41:42 -0400 (EDT) Message-Id: <1464709302.3816627.623738921.185742BF@webmail.messagingengine.com> X-Sasl-Enc: wXjCaEqR6wcZ8pfiYSsLTctjux4spfiWt6++LfhuAtL8 1464709302 From: Mark Felder To: Willem Jan Withagen , "Kevin P. Neal" , Evgeny Sam Cc: freebsd-fs@freebsd.org MIME-Version: 1.0 Content-Transfer-Encoding: 7bit Content-Type: text/plain X-Mailer: MessagingEngine.com Webmail Interface - ajax-e26fc460 In-Reply-To: References: <20160530202147.GA40137@neutralgood.org> Subject: Re: ZFS - RAIDZ1 Recovery (Evgeny Sam) Date: Tue, 31 May 2016 10:41:42 -0500 X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.22 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 31 May 2016 15:41:44 -0000 On Tue, May 31, 2016, at 05:15, Willem Jan Withagen wrote: > On 30-5-2016 22:21, Kevin P. Neal wrote: > > There are several good ways to duplicate a disk, and at the top of the > > list are tools known to the people you are going to need help from. That > > means using the 'dd' command to duplicate the entire disk including the > > GPT labels. Or use something from Polytropon's list posted to these lists > > (usually the questions list mostly) every so often. > > > > The dd command when given the "conv=noerror,sync" option can be used to > > duplicate an entire disk. Then a ZFS scrub can correct the lost blocks. > > Might I suggest dd_rescue here? > > Sort of designed for precisely this problem. > Does large bulk transfers, but when in error it reduces blocksize to the > sector, and tries several times.... > And there are lots of other options. > > So it is fast and as accurate as it can get. > > Save my life a few times. > FreeBSD has its own built-in dd_rescue alternative called recoverdisk -- Mark Felder ports-secteam member feld@FreeBSD.org From owner-freebsd-fs@freebsd.org Tue May 31 17:44:46 2016 Return-Path: Delivered-To: freebsd-fs@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 3FADCB595B7 for ; Tue, 31 May 2016 17:44:46 +0000 (UTC) (envelope-from andruimelyavas@rambler.ru) Received: from huan4.mail.rambler.ru (huan4.mail.rambler.ru [81.19.66.14]) (using TLSv1 with cipher AES256-SHA (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id F0D7312C9 for ; Tue, 31 May 2016 17:44:45 +0000 (UTC) (envelope-from andruimelyavas@rambler.ru) DKIM-Signature: v=1; a=rsa-sha256; q=dns/txt; c=relaxed/relaxed; d=rambler.ru; s=mail; h=Content-Type:MIME-Version:Date:Subject:To:From:Reply-To:Message-ID; bh=hBy8PNULYEPNl4NA6RKew8aVGfAfPFCE4dNLnEfQhDI=; b=pCMErb3pg97lpV1QG88ipmgEpVeDLQOu/Z644ItwPlGf6nSYUshwZT/C7cEhQr3r4a+tHtt/+9MSg2gG201uS8I9EzP2/de8nhz37RjWWZiWbOak2uMby7zrYZjUuXaHFJSuTuAnapwP4q7DKATxBdjTgyi2rzFMC/8huCbdXtw=; Received: from [UNAVAILABLE] ([119.145.184.226]:4878 helo=kb.co.ua) by huan4.mail.rambler.ru with esmtpa (Exim 4.76) (envelope-from ) id 1b7nic-0001zP-Qx for freebsd-fs@freebsd.org; Tue, 31 May 2016 20:44:43 +0300 Message-ID: Reply-To: "VK" From: "VK" To: Subject: Привeт Date: Tue, 31 May 2016 21:46:15 +0400 MIME-Version: 1.0 X-Priority: 3 X-MSMail-Priority: Normal X-Mailer: Microsoft Windows Live Mail 14.0.8117.416 X-MimeOLE: Produced By Microsoft MimeOLE V14.0.8117.416 X-Rambler-User: andruimelyavas@rambler.ru/119.145.184.226 X-Spam: Yes Content-Type: text/plain; charset="utf-8" Content-Transfer-Encoding: base64 X-Content-Filtered-By: Mailman/MimeDel 2.1.22 X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.22 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 31 May 2016 17:44:46 -0000 From owner-freebsd-fs@freebsd.org Tue May 31 18:08:19 2016 Return-Path: Delivered-To: freebsd-fs@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 79398B5A1E5 for ; Tue, 31 May 2016 18:08:19 +0000 (UTC) (envelope-from laundrywomen@tbspos.com) Received: from kinz.ru (unknown [IPv6:2a01:4f8:191:13b5::2]) (using TLSv1.2 with cipher DHE-RSA-AES128-SHA (128/128 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 48CF210BA for ; Tue, 31 May 2016 18:08:19 +0000 (UTC) (envelope-from laundrywomen@tbspos.com) Received: from localhost ([127.0.0.1] helo=viqsicdc) by kinz.ru with esmtp (Exim 4.80) (envelope-from ) id 1b7o5P-0001EK-SN for freebsd-fs@freebsd.org; Tue, 31 May 2016 21:08:16 +0300 Message-ID: 001e01c4b231$74416d65$85d84f48@laundrywomen@tbspos.com From: "Cialis ED Drugs" To: freebsd-fs@freebsd.org Subject: Betty Lexapro Price: USD0.85 Date: Tue, 31 May 2016 21:08:15 +0300 MIME-Version: 1.0 Content-Transfer-Encoding: quoted-printable Content-Type: text/plain; charset="UTF-8" X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.22 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 31 May 2016 18:08:19 -0000 http://MakeMyWays.com/Neet.php Betty! Lexapro Price: USD0.85 Lexapro (Escitalopram) is used for treating depression and anxiety. Cialis ED Drugs From owner-freebsd-fs@freebsd.org Wed Jun 1 11:40:47 2016 Return-Path: Delivered-To: freebsd-fs@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 3C431B6037F for ; Wed, 1 Jun 2016 11:40:47 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2001:1900:2254:206a::16:76]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 1F0AA1E0E for ; Wed, 1 Jun 2016 11:40:47 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from bugs.freebsd.org ([127.0.1.118]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id u51Beku3019430 for ; Wed, 1 Jun 2016 11:40:46 GMT (envelope-from bugzilla-noreply@freebsd.org) From: bugzilla-noreply@freebsd.org To: freebsd-fs@FreeBSD.org Subject: [Bug 207902] zfs boot into Safe Mode & Single User leads to auto mount failure. Date: Wed, 01 Jun 2016 11:40:47 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: bin X-Bugzilla-Version: 11.0-CURRENT X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Many People X-Bugzilla-Who: mikhail.rokhin@gmail.com X-Bugzilla-Status: Open X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: freebsd-fs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: bug_status resolution Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.22 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 01 Jun 2016 11:40:47 -0000 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D207902 mikhail.rokhin@gmail.com changed: What |Removed |Added ---------------------------------------------------------------------------- Status|Closed |Open Resolution|Not A Bug |--- --- Comment #2 from mikhail.rokhin@gmail.com --- There is trouble with Single User and Safe mode chosen at boot, it leads to failure when zfs formatted, but ordinary ext4 boots fine, when both Single = User and Safe mode chosen at boot. --=20 You are receiving this mail because: You are the assignee for the bug.= From owner-freebsd-fs@freebsd.org Wed Jun 1 12:31:52 2016 Return-Path: Delivered-To: freebsd-fs@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 90FA4B6033B for ; Wed, 1 Jun 2016 12:31:52 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2001:1900:2254:206a::16:76]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 81AFD13AA for ; Wed, 1 Jun 2016 12:31:52 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from bugs.freebsd.org ([127.0.1.118]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id u51CVqtm069324 for ; Wed, 1 Jun 2016 12:31:52 GMT (envelope-from bugzilla-noreply@freebsd.org) From: bugzilla-noreply@freebsd.org To: freebsd-fs@FreeBSD.org Subject: [Bug 207902] zfs boot into Safe Mode & Single User leads to auto mount failure. Date: Wed, 01 Jun 2016 12:31:52 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: bin X-Bugzilla-Version: 11.0-CURRENT X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Many People X-Bugzilla-Who: girgen@FreeBSD.org X-Bugzilla-Status: Open X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: freebsd-fs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: cc Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.22 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 01 Jun 2016 12:31:52 -0000 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D207902 Palle Girgensohn changed: What |Removed |Added ---------------------------------------------------------------------------- CC| |girgen@FreeBSD.org --- Comment #3 from Palle Girgensohn --- (In reply to mikhail.rokhin from comment #2) ext4, you mean UFS, right? :) --=20 You are receiving this mail because: You are the assignee for the bug.= From owner-freebsd-fs@freebsd.org Wed Jun 1 15:51:11 2016 Return-Path: Delivered-To: freebsd-fs@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 1C622B61D60 for ; Wed, 1 Jun 2016 15:51:11 +0000 (UTC) (envelope-from wjw@digiware.nl) Received: from mailman.ysv.freebsd.org (mailman.ysv.freebsd.org [IPv6:2001:1900:2254:206a::50:5]) by mx1.freebsd.org (Postfix) with ESMTP id 096FF1953 for ; Wed, 1 Jun 2016 15:51:11 +0000 (UTC) (envelope-from wjw@digiware.nl) Received: by mailman.ysv.freebsd.org (Postfix) id 0887EB61D5F; Wed, 1 Jun 2016 15:51:11 +0000 (UTC) Delivered-To: fs@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 08320B61D5E for ; Wed, 1 Jun 2016 15:51:11 +0000 (UTC) (envelope-from wjw@digiware.nl) Received: from smtp.digiware.nl (unknown [IPv6:2001:4cb8:90:ffff::3]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id C76A7194F for ; Wed, 1 Jun 2016 15:51:10 +0000 (UTC) (envelope-from wjw@digiware.nl) Received: from rack1.digiware.nl (unknown [127.0.0.1]) by smtp.digiware.nl (Postfix) with ESMTP id 702F315340D; Wed, 1 Jun 2016 17:50:55 +0200 (CEST) X-Virus-Scanned: amavisd-new at digiware.com Received: from smtp.digiware.nl ([127.0.0.1]) by rack1.digiware.nl (rack1.digiware.nl [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id 1WL_UoRnb2EE; Wed, 1 Jun 2016 17:50:46 +0200 (CEST) Received: from [192.168.10.10] (asus [192.168.10.10]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (No client certificate requested) by smtp.digiware.nl (Postfix) with ESMTPSA id 3546315340A for ; Wed, 1 Jun 2016 17:50:46 +0200 (CEST) To: fs@freebsd.org From: Willem Jan Withagen Subject: looking for libzfs.h Message-ID: <7e6d908d-ece5-e311-f0ab-3f4d05f96934@digiware.nl> Date: Wed, 1 Jun 2016 17:50:46 +0200 User-Agent: Mozilla/5.0 (Windows NT 10.0; WOW64; rv:45.0) Gecko/20100101 Thunderbird/45.1.1 MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 8bit X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.22 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 01 Jun 2016 15:51:11 -0000 Hi, Is there any particular reason why we (I) don't have libzfs.h in /usr/include .... Ceph sort of expects it for ZFSFileStoreBackend. I've seen a few more questions of fora when I search for this. I could rip one from OpenZFS i guess, Other one is to build the boot stuff: src/sys/boot/zfs/libzfs.h, which is not quite like what is on OpenZFS. So, is this a strange question, or nobody ever really cared enough to get it in/build it? --WjW From owner-freebsd-fs@freebsd.org Wed Jun 1 22:14:18 2016 Return-Path: Delivered-To: freebsd-fs@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 4F916B66EDC for ; Wed, 1 Jun 2016 22:14:18 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2001:1900:2254:206a::16:76]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 366621D79 for ; Wed, 1 Jun 2016 22:14:18 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from bugs.freebsd.org ([127.0.1.118]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id u51MEHB2018643 for ; Wed, 1 Jun 2016 22:14:18 GMT (envelope-from bugzilla-noreply@freebsd.org) From: bugzilla-noreply@freebsd.org To: freebsd-fs@FreeBSD.org Subject: [Bug 209158] node / npm triggering zfs rename deadlock Date: Wed, 01 Jun 2016 22:14:17 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 11.0-CURRENT X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Some People X-Bugzilla-Who: avg@FreeBSD.org X-Bugzilla-Status: Open X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: freebsd-fs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: attachments.isobsolete Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.22 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 01 Jun 2016 22:14:18 -0000 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D209158 Andriy Gapon changed: What |Removed |Added ---------------------------------------------------------------------------- Attachment #170652|0 |1 is obsolete| | --=20 You are receiving this mail because: You are the assignee for the bug.= From owner-freebsd-fs@freebsd.org Wed Jun 1 22:11:58 2016 Return-Path: Delivered-To: freebsd-fs@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id B1627B66E5B for ; Wed, 1 Jun 2016 22:11:58 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2001:1900:2254:206a::16:76]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id A28D61BF7 for ; Wed, 1 Jun 2016 22:11:58 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from bugs.freebsd.org ([127.0.1.118]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id u51MBwig013189 for ; Wed, 1 Jun 2016 22:11:58 GMT (envelope-from bugzilla-noreply@freebsd.org) From: bugzilla-noreply@freebsd.org To: freebsd-fs@FreeBSD.org Subject: [Bug 209158] node / npm triggering zfs rename deadlock Date: Wed, 01 Jun 2016 22:11:58 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 11.0-CURRENT X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Some People X-Bugzilla-Who: avg@FreeBSD.org X-Bugzilla-Status: Open X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: freebsd-fs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.22 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 01 Jun 2016 22:11:58 -0000 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D209158 --- Comment #26 from Andriy Gapon --- I've refreshed the phabricator request with a new version: https://reviews.freebsd.org/D6533 The new version contains quite a few fixes on top of the previous one. --=20 You are receiving this mail because: You are the assignee for the bug.= From owner-freebsd-fs@freebsd.org Thu Jun 2 19:58:03 2016 Return-Path: Delivered-To: freebsd-fs@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id CB3E9B663BB for ; Thu, 2 Jun 2016 19:58:03 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2001:1900:2254:206a::16:76]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id BC1B414A5 for ; Thu, 2 Jun 2016 19:58:03 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from bugs.freebsd.org ([127.0.1.118]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id u52Jw3AZ052899 for ; Thu, 2 Jun 2016 19:58:03 GMT (envelope-from bugzilla-noreply@freebsd.org) From: bugzilla-noreply@freebsd.org To: freebsd-fs@FreeBSD.org Subject: [Bug 207902] zfs boot into Safe Mode & Single User leads to auto mount failure. Date: Thu, 02 Jun 2016 19:58:03 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: bin X-Bugzilla-Version: 11.0-CURRENT X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Many People X-Bugzilla-Who: mikhail.rokhin@gmail.com X-Bugzilla-Status: Open X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: freebsd-fs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.22 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 02 Jun 2016 19:58:03 -0000 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D207902 --- Comment #4 from mikhail.rokhin@gmail.com --- (In reply to Palle Girgensohn from comment #3) Of course! Thank you for remark!) --=20 You are receiving this mail because: You are the assignee for the bug.= From owner-freebsd-fs@freebsd.org Fri Jun 3 17:48:39 2016 Return-Path: Delivered-To: freebsd-fs@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 3F2CEB681C6 for ; Fri, 3 Jun 2016 17:48:39 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2001:1900:2254:206a::16:76]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 2F8FD1815 for ; Fri, 3 Jun 2016 17:48:39 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from bugs.freebsd.org ([127.0.1.118]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id u53HmdvG086331 for ; Fri, 3 Jun 2016 17:48:39 GMT (envelope-from bugzilla-noreply@freebsd.org) From: bugzilla-noreply@freebsd.org To: freebsd-fs@FreeBSD.org Subject: [Bug 209158] node / npm triggering zfs rename deadlock Date: Fri, 03 Jun 2016 17:48:39 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 11.0-CURRENT X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Some People X-Bugzilla-Who: doug@freebsd.con.com X-Bugzilla-Status: Open X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: freebsd-fs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.22 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 03 Jun 2016 17:48:39 -0000 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D209158 --- Comment #27 from Doug Luce --- Built and installed the patched kernel this morning. I was able to do the n= pm install that was failing before, and copies/moves between ZFS and UFS seem = to be going just fine. While I don't feel qualified to provide a review on that diff, please let me know if it would be useful. I'll be happy to get myself versed on this stuf= f. --=20 You are receiving this mail because: You are the assignee for the bug.=