From owner-freebsd-fs@freebsd.org Sat Aug 19 03:31:18 2017 Return-Path: Delivered-To: freebsd-fs@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id DED4DDC8FBB for ; Sat, 19 Aug 2017 03:31:18 +0000 (UTC) (envelope-from cross+freebsd@distal.com) Received: from hydra.pix.net (hydra.pix.net [IPv6:2001:470:e254::4]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client CN "mail.pix.net", Issuer "Pix.Com Technologies LLC CA" (not verified)) by mx1.freebsd.org (Postfix) with ESMTPS id 7CF4E2FF7 for ; Sat, 19 Aug 2017 03:31:18 +0000 (UTC) (envelope-from cross+freebsd@distal.com) Received: from mail.distal.com (mail.distal.com [IPv6:2001:470:e24c:200:0:0:0:ae25]) (authenticated bits=0) by hydra.pix.net (8.16.0.19/8.15.2) with ESMTPSA id v7J3V7lK019037 (version=TLSv1.2 cipher=ECDHE-RSA-AES256-GCM-SHA384 bits=256 verify=FAIL) for ; Fri, 18 Aug 2017 23:31:15 -0400 (EDT) (envelope-from cross+freebsd@distal.com) Received: from magrathea.distal.com (magrathea.distal.com [IPv6:2001:470:e24c:200:ea06:88ff:feca:960e]) (authenticated bits=0) by mail.distal.com (8.15.2/8.15.2) with ESMTPSA id v7J3V2M7038641 (version=TLSv1 cipher=DHE-RSA-AES256-SHA bits=256 verify=NO); Fri, 18 Aug 2017 23:31:04 -0400 (EDT) (envelope-from cross+freebsd@distal.com) From: Chris Ross Content-Type: multipart/signed; boundary="Apple-Mail=_D603767F-7050-43CF-9222-ECBF7F44304E"; protocol="application/pgp-signature"; micalg=pgp-sha512 Subject: zfs recv went idle after 20+ hours Date: Fri, 18 Aug 2017 23:30:49 -0400 Message-Id: <4BCBA5DE-6AC7-4B0A-BF33-CFFE5A54B2DF@distal.com> To: FreeBSD FS Mime-Version: 1.0 (Mac OS X Mail 9.3 \(3124\)) X-Mailer: Apple Mail (2.3124) X-Greylist: Sender succeeded SMTP AUTH, not delayed by milter-greylist-4.6.2 (mail.distal.com [IPv6:2001:470:e24c:200:0:0:0:ae25]); Fri, 18 Aug 2017 23:31:04 -0400 (EDT) X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.23 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 19 Aug 2017 03:31:19 -0000 --Apple-Mail=_D603767F-7050-43CF-9222-ECBF7F44304E Content-Transfer-Encoding: quoted-printable Content-Type: text/plain; charset=utf-8 =46rom earlier posts on this list, many know I was dealing with an = issue on a zfs pool. I eventually got it running in an off way, and = backed it up (via zfs send to a file in UFS). I then destroyed and = recreated the pool as I wanted it. For the last 23 hours or so, I=E2=80=99= ve been running a =E2=80=9Czfs recv=E2=80=9D from the large send output = (~5.2T). It was cooking along, more slowly than I=E2=80=99d expected, = but moving. I looked in on it a short while ago, and the pv I=E2=80=99m using on = the input file was reporting 0.0 B/s, 77% complete. Looking at the = iostat I had running, I could see the raidz disks still seeing activity, = but less than a minute later that stopped. Now, all disks on the system = seem idle. The =E2=80=9Czfs recv=E2=80=9D process is idle according to = ps (STAT I+), and a ktrace on the zfs process shows no activity either. = The window in which I was running the commands look as follows: cross@hyrule[~](511): zpool list NAME SIZE ALLOC FREE EXPANDSZ FRAG CAP DEDUP HEALTH = ALTROOT tank 18.8T 949K 18.8T - 0% 0% 1.00x ONLINE - zroot 50.5G 34.7G 15.8G - 55% 68% 1.00x ONLINE - cross@hyrule[~](512): pv /mnt/tank@20170815| sudo zfs recv -Fvu tank receiving full stream of tank@20170815 into tank@20170815 received 46.3KB stream in 1 seconds (46.3KB/sec) receiving full stream of tank/deluge@20170815 into tank/deluge@20170815 received 2.87TB stream in 45452 seconds (66.3MB/sec) ] 55% ETA = 10:18:14 receiving full stream of tank/timecapsule@20170815 into = tank/timecapsule@20170815 3.99TiB 22:54:18 [0.00 B/s] [=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D= =3D=3D=3D=3D=3D=3D=3D=3D=3D> ] 76% ETA 7:04:49 The time-of-day and ETA value keep increasing, but other than that, = it=E2=80=99s just sitting. zfs list shows: hyrule# zfs list -t all | grep tank tank 3.89T 8.28T 73.3K none tank@20170815 0 - 73.3K - tank/deluge 2.86T 8.28T 2.86T /data/deluge tank/deluge@20170815 0 - 2.86T - tank/timecapsule 1024G 8.28T 1024G /data/timecapsule I=E2=80=99m going to leave it this way for a while, but it=E2=80=99s = already been about 10 minutes since it started, so I don=E2=80=99t = expect that it will free itself. Does anyone have a suggestion, or = something I should look at? Did I do something wrong? Thanks=E2=80=A6 - Chris --Apple-Mail=_D603767F-7050-43CF-9222-ECBF7F44304E Content-Transfer-Encoding: 7bit Content-Disposition: attachment; filename=signature.asc Content-Type: application/pgp-signature; name=signature.asc Content-Description: Message signed with OpenPGP using GPGMail -----BEGIN PGP SIGNATURE----- Comment: GPGTools - https://gpgtools.org iQIcBAEBCgAGBQJZl7D1AAoJEPFBDnXvoNg0As4P/igPoDSY1uGES5wStQFxc8Tx /0hDp0UlIbXruU1CF1j15rFIpu/SVzT8HU8sXF8ie+RCs8ZVzFAqa5p5zpO5LKVb YAFzUiXjXLK+LNDfS4TWMV546ayAy4uYnQZB+xaXQpzg6D+Z6GwdtLAbNtl5Y1vV jiPyqncVecVWHPHumAtkx3jsGKT8TJvoeifR1Z7ARsmS9ry4Lcc8sA6HcpT2azc2 b8pCfF5Uqrpt+EaDi8VSIyZz1ghFwwBTEboeIqYwEOuzSEFoMJppsw8YI5cJjZzZ i9yeUUn0EtGx4UvYOmaUiFaOABxGooa6EIfguFtsyizeUiIcadzW7GhN+b+JHQhk skYwV+pwaC+0HQqsrcv5WA3hkM17OLSeUDn+cMv7X1Sb1kDjd3fmdWlJw0lhS2sN tckVXSXsGuWkjT/942KyB1T7umSRaxyD39wd8c17E+3wyypH/BLHDla07CdxPpen R4NqzLnNLAAJb3+z50ui5427p2dBUVqU+LeoxWiXGvCwYycj1tJC2IMPyY7h30Jc Oatu6Nv74T4u+QmbWKBgpEvvxVwNsQA3YFQUlYTxudio3fzS1bhVCo5LWjOiHdXX 2xgidVBo++0s4HbARuK2ACMP74SLWWTddwXhqye54/pe+hMeMqlSgNjUcKWRO49W qpJ9xARJdg0XWGge/ecT =H4Dg -----END PGP SIGNATURE----- --Apple-Mail=_D603767F-7050-43CF-9222-ECBF7F44304E--