From owner-freebsd-fs@freebsd.org Mon Oct 2 18:17:17 2017 Return-Path: Delivered-To: freebsd-fs@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 16457E23918 for ; Mon, 2 Oct 2017 18:17:17 +0000 (UTC) (envelope-from ben.rubson@gmail.com) Received: from mail-wr0-x22d.google.com (mail-wr0-x22d.google.com [IPv6:2a00:1450:400c:c0c::22d]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 99C02719E2 for ; Mon, 2 Oct 2017 18:17:16 +0000 (UTC) (envelope-from ben.rubson@gmail.com) Received: by mail-wr0-x22d.google.com with SMTP id u5so4475767wrc.5 for ; Mon, 02 Oct 2017 11:17:16 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=mime-version:subject:from:in-reply-to:date :content-transfer-encoding:message-id:references:to; bh=sFAbywXHJcT7ghnFkfVL6YLo3VuG3VRFWAPSrjd1T0s=; b=blyg8UR2vB5VTE+SPjIlzdjQfCeyh42LwxJtXKL0gY90tF6TxOeiJZm8VFuxTNmxbG vS0qQ1ugPid8ci1Z098QGPoX1BaikDuYYamSkxkX1zhTZnQdSWuO/emrMk3QJbgGArsH 9vSbKewUgncdRAM2dEEW+FKtwliW7wiYEAbbOBD5kERQ2MIhuxWAhXVWSobF9jV6z1Iz HjQSbZzFydzNhwOwUKXuok0QIa3jG4xIDash7iDBYLXSMinjIXu1eN7+lCx1tb8ITV32 wIkXcyRGJ41HKIAGuh7ZtxrZXZtZzG19CLQ1JLGB6pzlJxsi27ZrhM243Pg6Q4rdRyhi TBMA== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:subject:from:in-reply-to:date :content-transfer-encoding:message-id:references:to; bh=sFAbywXHJcT7ghnFkfVL6YLo3VuG3VRFWAPSrjd1T0s=; b=n+7pAE+ZWUg5PYaYlTPYpyyyA+KOMc15/CX6fbm9KqmkJIQx9IGzr9FKr/cwRDiOTZ 5KmqrOyeTju22RW24DAjbqxp1xr9fGO0zb85mFXPalxtdzgJ9k46IZ38WLX8nyXlSija uJfwuLYPCq69cwqoiFTqUQY3+wY/tr7DiMnreZcHrSi7Vm427RW9W3Kl/qmiHsEgyMXG zZ3Jh97KEpbZLV4R+uL+Ipog7Yh70dvI3Bgoyo7isgzLxIbWcH+5Wfo0IRtN4rkV3xyg xn+QHkTGuKdKA5og4MEdhtkbtZzmtJ2ECR0suYxO4gG9tAUZHdNRHiKZPxSm7HSKO1Tb FQhw== X-Gm-Message-State: AMCzsaVY/z0jlUBx1thcnGbf3nCzzGl0Reg4IFSwD5GLkprUndDCBuc/ Rb5ftmee66H7sa1Q1gJ+87G7NIed X-Google-Smtp-Source: AOwi7QCi2Hc6SyUZVB0QSIkuq2ryOa3UDYUQ65WoclpgWl/8FiQU6vggQwcB+a3PAQ1BlqF/Ms+cvw== X-Received: by 10.223.184.246 with SMTP id c51mr4140523wrg.250.1506968234692; Mon, 02 Oct 2017 11:17:14 -0700 (PDT) Received: from bens-mac.home (LFbn-MAR-1-445-220.w2-15.abo.wanadoo.fr. [2.15.38.220]) by smtp.gmail.com with ESMTPSA id 55sm22398478wrw.60.2017.10.02.11.17.13 for (version=TLS1 cipher=ECDHE-RSA-AES128-SHA bits=128/128); Mon, 02 Oct 2017 11:17:14 -0700 (PDT) Content-Type: text/plain; charset=us-ascii Mime-Version: 1.0 (Mac OS X Mail 9.3 \(3124\)) Subject: Re: ZFS stalled after some mirror disks were lost From: Ben RUBSON In-Reply-To: <71d4416a-3454-df36-adae-34c0b70cd84e@multiplay.co.uk> Date: Mon, 2 Oct 2017 20:17:13 +0200 Content-Transfer-Encoding: 7bit Message-Id: <8A189756-028A-465E-9962-D0181FAEBB79@gmail.com> References: <4A0E9EB8-57EA-4E76-9D7E-3E344B2037D2@gmail.com> <71d4416a-3454-df36-adae-34c0b70cd84e@multiplay.co.uk> To: Freebsd fs X-Mailer: Apple Mail (2.3124) X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.23 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 02 Oct 2017 18:17:17 -0000 Unfortunately the command stalls / does not return :/ > On 02 Oct 2017, at 20:15, Steven Hartland wrote: > > What does zpool status report when you have disconnected the iscsi targets? > > On 02/10/2017 19:12, Ben RUBSON wrote: >> Hi, >> >> On a FreeBSD 11 server, the following online/healthy zpool : >> >> home >> mirror-0 >> label/local1 >> label/local2 >> label/iscsi1 >> label/iscsi2 >> mirror-1 >> label/local3 >> label/local4 >> label/iscsi3 >> label/iscsi4 >> cache >> label/local5 >> label/local6 >> >> A sustained read throughput of 180 MB/s, 45 MB/s on each iscsi disk >> according to "zpool iostat", nothing on local disks (strange but I >> noticed that IOs always prefer iscsi disks to local disks). >> No write IOs. >> >> Let's disconnect all iSCSI disks : >> iscsictl -Ra >> >> Expected behavior : >> IO activity flawlessly continue on local disks. >> >> What happened : >> All IOs stalled, server only answers to IOs are made to its zroot pool. >> All commands related to the iSCSI disks (iscsictl), or to ZFS (zfs/zpool), >> don't return. >> >> Questions : >> Why this behavior ? >> How to know what happens ? (/var/log/messages says almost nothing) >> >> I already disconnected the iSCSI disks without any issue in the past, >> several times, but there were almost no IOs running. >> >> Thank you for your help ! >> >> Ben >> >> _______________________________________________ >> freebsd-fs@freebsd.org mailing list >> https://lists.freebsd.org/mailman/listinfo/freebsd-fs >> To unsubscribe, send any mail to "freebsd-fs-unsubscribe@freebsd.org" > > _______________________________________________ > freebsd-fs@freebsd.org mailing list > https://lists.freebsd.org/mailman/listinfo/freebsd-fs > To unsubscribe, send any mail to "freebsd-fs-unsubscribe@freebsd.org"