Date: Mon, 2 Oct 2017 19:41:56 +0100 From: Steven Hartland <killing@multiplay.co.uk> To: freebsd-fs@freebsd.org Subject: Re: ZFS stalled after some mirror disks were lost Message-ID: <4f725113-bac3-64bb-9858-690811e73153@multiplay.co.uk> In-Reply-To: <953DD379-C03A-4737-BAD8-14BB2DB4AB05@gmail.com> References: <4A0E9EB8-57EA-4E76-9D7E-3E344B2037D2@gmail.com> <71d4416a-3454-df36-adae-34c0b70cd84e@multiplay.co.uk> <8A189756-028A-465E-9962-D0181FAEBB79@gmail.com> <953DD379-C03A-4737-BAD8-14BB2DB4AB05@gmail.com>
next in thread | previous in thread | raw e-mail | index | archive | help
I'm guessing that the devices haven't disconnected cleanly so are just stalling all requests to them and hence the pool. I'm not that familiar with iscsi, does it still show under under camcontrol or geom? Does iscsid have any options on how to treat failed devices? On 02/10/2017 19:28, Ben RUBSON wrote: > Before disconnecting the targets the pool was online without any issue. > >> On 02 Oct 2017, at 20:17, Ben RUBSON <ben.rubson@gmail.com> wrote: >> >> Unfortunately the command stalls / does not return :/ >> >>> On 02 Oct 2017, at 20:15, Steven Hartland <killing@multiplay.co.uk> wrote: >>> >>> What does zpool status report when you have disconnected the iscsi targets? >>> >>> On 02/10/2017 19:12, Ben RUBSON wrote: >>>> Hi, >>>> >>>> On a FreeBSD 11 server, the following online/healthy zpool : >>>> >>>> home >>>> mirror-0 >>>> label/local1 >>>> label/local2 >>>> label/iscsi1 >>>> label/iscsi2 >>>> mirror-1 >>>> label/local3 >>>> label/local4 >>>> label/iscsi3 >>>> label/iscsi4 >>>> cache >>>> label/local5 >>>> label/local6 >>>> >>>> A sustained read throughput of 180 MB/s, 45 MB/s on each iscsi disk >>>> according to "zpool iostat", nothing on local disks (strange but I >>>> noticed that IOs always prefer iscsi disks to local disks). >>>> No write IOs. >>>> >>>> Let's disconnect all iSCSI disks : >>>> iscsictl -Ra >>>> >>>> Expected behavior : >>>> IO activity flawlessly continue on local disks. >>>> >>>> What happened : >>>> All IOs stalled, server only answers to IOs are made to its zroot pool. >>>> All commands related to the iSCSI disks (iscsictl), or to ZFS (zfs/zpool), >>>> don't return. >>>> >>>> Questions : >>>> Why this behavior ? >>>> How to know what happens ? (/var/log/messages says almost nothing) >>>> >>>> I already disconnected the iSCSI disks without any issue in the past, >>>> several times, but there were almost no IOs running. >>>> >>>> Thank you for your help ! >>>> >>>> Ben >>>> >>>> _______________________________________________ >>>> freebsd-fs@freebsd.org mailing list >>>> https://lists.freebsd.org/mailman/listinfo/freebsd-fs >>>> To unsubscribe, send any mail to "freebsd-fs-unsubscribe@freebsd.org" >>> _______________________________________________ >>> freebsd-fs@freebsd.org mailing list >>> https://lists.freebsd.org/mailman/listinfo/freebsd-fs >>> To unsubscribe, send any mail to "freebsd-fs-unsubscribe@freebsd.org" > _______________________________________________ > freebsd-fs@freebsd.org mailing list > https://lists.freebsd.org/mailman/listinfo/freebsd-fs > To unsubscribe, send any mail to "freebsd-fs-unsubscribe@freebsd.org"
Want to link to this message? Use this URL: <https://mail-archive.FreeBSD.org/cgi/mid.cgi?4f725113-bac3-64bb-9858-690811e73153>