From owner-freebsd-fs@freebsd.org Mon Oct 2 19:10:07 2017 Return-Path: Delivered-To: freebsd-fs@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 51AC9E24FFD for ; Mon, 2 Oct 2017 19:10:07 +0000 (UTC) (envelope-from ben.rubson@gmail.com) Received: from mail-wm0-x22a.google.com (mail-wm0-x22a.google.com [IPv6:2a00:1450:400c:c09::22a]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id D63E673EA7 for ; Mon, 2 Oct 2017 19:10:06 +0000 (UTC) (envelope-from ben.rubson@gmail.com) Received: by mail-wm0-x22a.google.com with SMTP id t69so12454508wmt.2 for ; Mon, 02 Oct 2017 12:10:06 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=mime-version:subject:from:in-reply-to:date :content-transfer-encoding:message-id:references:to; bh=I7Xjhiv7W1j5BOq6pc4eyND9LqaWGzTBa1+ylHQw2PY=; b=DCsn9VBPf+HKJGjpB0QGc+Wh1Zk3fbZMdZ+kGh5PMxqickSlQISQdAI9mL43U4lexH RBUMcaQJDDoZxBY0c1aeiG15JNSuMMg5/7EZP4sLjQuhtGy69T+fEI4gOoBuWeHvL/G8 8I+VohDFdEIt88L1HHUfM741QFGy8pd0Lw5Y2TlUeZXE09RjjThlv8Hc2mz+2RwBEFAs K9wvfcrgq3YIV42yK7H39+LhpzpNzf5KB5Cc8bFZMbTYO1pKMV0yF1D9SlPLSbNBUHRX UgKvly51A3eaZWzDvLFH1ulvzCj1lbSz7aRXuyd1lVG4nuMSEdVKqca8i14XcGQkGUOb CLDQ== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:subject:from:in-reply-to:date :content-transfer-encoding:message-id:references:to; bh=I7Xjhiv7W1j5BOq6pc4eyND9LqaWGzTBa1+ylHQw2PY=; b=fgPEAY/SQGr74hfEAk+8ehHG6fzdChh1XuFSQi9tuM5bjlF2yJcJTsujRcQHn4AT+g e9XOSbXTaCOJbLV0SF3iSgJpWb/KjQI4QQEg3NjoSLqucBVtaVzIWjSuh8+x6LZ35EiD cp4RrPp4x9pK++vEwZfLAEIDyC7dPixrjKQ6v35WGCWqyPeLZYkrtk454Cx8RYy7YeRV D+0x5THKfqyY+PgcgfNsMZ1M+EfAt0H0/9KtDlJmBPU4eE3DT7WwyHVHWaE8HfKQ2Hnz OyoRpuwYPL/n3RraE7kgRwllK2i4cVzcvCA67+mvwHQyzoTUKXXrSWrJSnvitPBrFhnj mLPA== X-Gm-Message-State: AMCzsaXyuCICUmGi1exlw+iLND6a3Rxmm3uFoNJkrYcKCq+XghjzH7ow WZazy/NmTYl6aemo76hy5qPLwbLR X-Google-Smtp-Source: AOwi7QC6604K+GZ7s34JRiIxfL8x7rxlTacFHGg2HEp1d9BX9xaBmZuGhXahRrym4V8qZOEvwpsgvQ== X-Received: by 10.28.17.207 with SMTP id 198mr10871399wmr.38.1506971405067; Mon, 02 Oct 2017 12:10:05 -0700 (PDT) Received: from bens-mac.home (LFbn-MAR-1-445-220.w2-15.abo.wanadoo.fr. [2.15.38.220]) by smtp.gmail.com with ESMTPSA id q81sm9074721wmd.27.2017.10.02.12.10.04 for (version=TLS1 cipher=ECDHE-RSA-AES128-SHA bits=128/128); Mon, 02 Oct 2017 12:10:04 -0700 (PDT) Content-Type: text/plain; charset=us-ascii Mime-Version: 1.0 (Mac OS X Mail 9.3 \(3124\)) Subject: Re: ZFS stalled after some mirror disks were lost From: Ben RUBSON In-Reply-To: <4f725113-bac3-64bb-9858-690811e73153@multiplay.co.uk> Date: Mon, 2 Oct 2017 21:10:03 +0200 Content-Transfer-Encoding: quoted-printable Message-Id: <54AD0000-AF0B-4682-9047-6E6C1B82506C@gmail.com> References: <4A0E9EB8-57EA-4E76-9D7E-3E344B2037D2@gmail.com> <71d4416a-3454-df36-adae-34c0b70cd84e@multiplay.co.uk> <8A189756-028A-465E-9962-D0181FAEBB79@gmail.com> <953DD379-C03A-4737-BAD8-14BB2DB4AB05@gmail.com> <4f725113-bac3-64bb-9858-690811e73153@multiplay.co.uk> To: Freebsd fs X-Mailer: Apple Mail (2.3124) X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.23 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 02 Oct 2017 19:10:07 -0000 > On 02 Oct 2017, at 20:41, Steven Hartland = wrote: >=20 > I'm guessing that the devices haven't disconnected cleanly so are just = stalling all requests to them and hence the pool. I even tried to ifconfig down the network interface serving the iscsi = targets, it did not help. > I'm not that familiar with iscsi, does it still show under under = camcontrol or geom? # geom disk list (...) Geom name: da13 Providers: 1. Name: da13 Mediasize: 3999688294912 (3.6T) Sectorsize: 512 Mode: r1w1e2 wither: (null) Geom name: da15 Providers: 1. Name: da15 Mediasize: 3999688294912 (3.6T) Sectorsize: 512 Mode: r1w1e2 wither: (null) Geom name: da16 Providers: 1. Name: da16 Mediasize: 3999688294912 (3.6T) Sectorsize: 512 Mode: r1w1e2 wither: (null) Geom name: da19 Providers: 1. Name: da19 Mediasize: 3999688294912 (3.6T) Sectorsize: 512 Mode: r1w1e2 wither: (null) # camcontrol devlist // does not show the above disks > Does iscsid have any options on how to treat failed devices? iSCSI has some tuning regarding how to treat failing devices, and I did = it : kern.iscsi.ping_timeout=3D5 kern.iscsi.iscsid_timeout=3D5 kern.iscsi.login_timeout=3D85 kern.iscsi.fail_on_disconnection=3D1 However, as I disconnected the targets from the server hosting the = zpool, they should not have been needed.