From owner-freebsd-fs@freebsd.org Tue Sep 27 20:53:29 2016 Return-Path: Delivered-To: freebsd-fs@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 2279FC00711; Tue, 27 Sep 2016 20:53:29 +0000 (UTC) (envelope-from ultima1252@gmail.com) Received: from mail-yw0-x231.google.com (mail-yw0-x231.google.com [IPv6:2607:f8b0:4002:c05::231]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id D8428BBE; Tue, 27 Sep 2016 20:53:28 +0000 (UTC) (envelope-from ultima1252@gmail.com) Received: by mail-yw0-x231.google.com with SMTP id g192so16479323ywh.1; Tue, 27 Sep 2016 13:53:28 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:from:date:message-id:subject:to; bh=MpkR8xSNNjte7BBdwY3ZQgGfIMccdvr19OnWtcO8oVE=; b=TkgEAS1dsAN2TqJyU6bIN0FCcT0YgEjbaB5A2JwJdw/VBhO0jzP4xxpXnnGTNMK2Pv cWnVs6SUhr+wMoA3D9FTx9UCHLes2gQ02szS9FWKJptnWOtXaLPFthyfNlOXVNkc+sL7 NMqt4gWUBTzY5dKO0dSfQFtYu0hsqhGl8EWRZkeoWFCjMxvsJZ+OUpq0I5ZXKLlEncWY bUay/L3GL9O85XGtYL6RytPuIB+L0oCHdG20mbq945Ekx2MjE7BRlnxyvEgS3O8aacUT Kga/VB5qxX4JSenundVnLZvVw7HrDgeM5ttmaepGe/v4JredLao2GOBoVx6k6j/GCACN NaQw== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20130820; h=x-gm-message-state:mime-version:from:date:message-id:subject:to; bh=MpkR8xSNNjte7BBdwY3ZQgGfIMccdvr19OnWtcO8oVE=; b=L05NO3r/fRvoJF5jrph8+lRYpv8GvEeKznIWXmmWPINXtC3lFLOMFAgXzdraseSx/2 siWjos45A2j4n2Rsh/FBizH36lo7WkMchzJ+pjj1IV4E3sSDWBmDlNuYBhb7j/y1TL8A /kv5+2AxCoBp3w/CBTWbaTYGKzcjqpHercOqsgnTX5dxqfJ/UsLRrSsYe+YeB+49Jjte LLsmfY6bZQGRZ1l/oYzCcfvzZOyTxMcbDD8SoCM6airTMyOOGw8OY4XFir78pW7/e7QO DA1qN+2TkdtK0JJHyomEINg78ytcuwltc97S3rdDDvT6EhctLCpFH4T2GSdOShMrXR53 Nzjw== X-Gm-Message-State: AE9vXwOXAfZ8WLQmYAqLkoUUJ8wI6IPcblg9dPh6flPhfqULMmCRdOMPzFR7+PS9RKg1ZjtVAP0d+pBlpoqpnQ== X-Received: by 10.129.178.5 with SMTP id q5mr21332219ywh.246.1475009607896; Tue, 27 Sep 2016 13:53:27 -0700 (PDT) MIME-Version: 1.0 Received: by 10.129.18.213 with HTTP; Tue, 27 Sep 2016 13:53:27 -0700 (PDT) From: Ultima Date: Tue, 27 Sep 2016 16:53:27 -0400 Message-ID: Subject: zpool (online|replace|labelclear) issues, -f option also failing To: freebsd-current@freebsd.org, freebsd-fs@freebsd.org Content-Type: text/plain; charset=UTF-8 X-Content-Filtered-By: Mailman/MimeDel 2.1.23 X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.23 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 27 Sep 2016 20:53:29 -0000 Hello, I am currently trying to replace a disk that was offlined and getting the following error: # zpool replace tank 14989197580381994958 gptid/31be0527-84f0-11e6-bbbc-fcaa14edc6a6 invalid vdev specification use '-f' to override the following errors: /dev/gptid/31be0527-84f0-11e6-bbbc-fcaa14edc6a6 is part of active pool 'tank' # zpool replace -f tank 14989197580381994958 gptid/31be0527-84f0-11e6-bbbc-fcaa14edc6a6 invalid vdev specification the following errors must be manually repaired: /dev/gptid/31be0527-84f0-11e6-bbbc-fcaa14edc6a6 is part of active pool 'tank' # zpool status tank pool: tank state: DEGRADED status: One or more devices has been taken offline by the administrator. Sufficient replicas exist for the pool to continue functioning in a degraded state. action: Online the device using 'zpool online' or replace the device with 'zpool replace'. scan: resilvered 1.10T in 9h4m with 0 errors on Tue Sep 20 00:33:32 2016 config: NAME STATE READ WRITE CKSUM tank DEGRADED 0 0 0 raidz2-0 ONLINE 0 0 0 gptid/8bdbd180-f52a-11e5-90c5-fcaa14edc6a6 ONLINE 0 0 0 gptid/8c4df91d-f52a-11e5-90c5-fcaa14edc6a6 ONLINE 0 0 0 gptid/8ccf21a3-f52a-11e5-90c5-fcaa14edc6a6 ONLINE 0 0 0 gptid/8d5521cb-f52a-11e5-90c5-fcaa14edc6a6 ONLINE 0 0 0 gptid/8de13b47-f52a-11e5-90c5-fcaa14edc6a6 ONLINE 0 0 0 gptid/8e842f92-f52a-11e5-90c5-fcaa14edc6a6 ONLINE 0 0 0 raidz2-1 DEGRADED 0 0 0 gptid/8bba4a82-f52a-11e5-90c5-fcaa14edc6a6 ONLINE 0 0 0 gptid/8c26d491-f52a-11e5-90c5-fcaa14edc6a6 ONLINE 0 0 0 gptid/8ca3fea6-f52a-11e5-90c5-fcaa14edc6a6 ONLINE 0 0 0 14989197580381994958 OFFLINE 0 0 0 was /dev/diskid/DISK-********p2 gptid/8db26351-f52a-11e5-90c5-fcaa14edc6a6 ONLINE 0 0 0 gptid/8e4bfa70-f52a-11e5-90c5-fcaa14edc6a6 ONLINE 0 0 0 raidz2-2 ONLINE 0 0 0 gptid/8b957b47-f52a-11e5-90c5-fcaa14edc6a6 ONLINE 0 0 0 gptid/8c0340da-f52a-11e5-90c5-fcaa14edc6a6 ONLINE 0 0 0 gptid/8c77ddcb-f52a-11e5-90c5-fcaa14edc6a6 ONLINE 0 0 0 gptid/8cf6b7f1-f52a-11e5-90c5-fcaa14edc6a6 ONLINE 0 0 0 gptid/8d84b31e-f52a-11e5-90c5-fcaa14edc6a6 ONLINE 0 0 0 gptid/8e146dad-f52a-11e5-90c5-fcaa14edc6a6 ONLINE 0 0 0 raidz2-3 ONLINE 0 0 0 gptid/8ebb39df-f52a-11e5-90c5-fcaa14edc6a6 ONLINE 0 0 0 gptid/8ef49770-f52a-11e5-90c5-fcaa14edc6a6 ONLINE 0 0 0 gptid/2f94035d-7e9f-11e6-abe9-fcaa14edc6a6 ONLINE 0 0 0 gptid/8f69cf08-f52a-11e5-90c5-fcaa14edc6a6 ONLINE 0 0 0 gptid/8fa7c0a6-f52a-11e5-90c5-fcaa14edc6a6 ONLINE 0 0 0 gptid/8fe7816d-f52a-11e5-90c5-fcaa14edc6a6 ONLINE 0 0 0 logs gptid/683dc146-f531-11e5-90c5-fcaa14edc6a6 ONLINE 0 0 0 errors: No known data errors # glabel status | grep da14 gptid/24a57a9b-84f0-11e6-bbbc-fcaa14edc6a6 N/A da14p1 gptid/31be0527-84f0-11e6-bbbc-fcaa14edc6a6 N/A da14p2 diskid/DISK-******** N/A da14 # gpart show da13 da14 => 40 7814037088 da13 GPT (3.6T) 40 4194304 1 freebsd-swap (2.0G) 4194344 7809842784 2 freebsd-zfs (3.6T) => 40 7814037088 da14 GPT (3.6T) 40 4194304 1 freebsd-swap (2.0G) 4194344 7809842784 2 freebsd-zfs (3.6T) # uname -a FreeBSD S1 12.0-CURRENT FreeBSD 12.0-CURRENT #4 r306300: Sat Sep 24 14:24:23 EDT 2016 root@S1:/usr/src/head/obj/usr/src/head/src/sys/MYKERNEL-NODEBUG amd64 I recently offlined the device and after onlining it the label changed to geom. After a few reboots the pool started importing by diskid. After attempting to offline/online by gptid, would continue to fail with an error. I decided try to replace it and is also failing with the error above. I also wiped the first & last 2MB of the disk without success. Is they're a known issue or perhaps I'm missing something obvious? zpool labelclear is also providing a similar error. The -f options are not helping. Any ideas what my issue maybe? The error suggests it is currently active on the pool, however the offline should have changed that status correct? Ultima