From nobody Thu Dec 14 22:05:58 2023 X-Original-To: freebsd-fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4Srmdh0mv5z53r3s for ; Thu, 14 Dec 2023 22:06:16 +0000 (UTC) (envelope-from lexi@le-fay.org) Received: from thyme.eden.le-Fay.ORG (THYME.EDEN.LE-FAY.ORG [81.187.47.194]) by mx1.freebsd.org (Postfix) with ESMTP id 4Srmdg4wYkz4v6H for ; Thu, 14 Dec 2023 22:06:15 +0000 (UTC) (envelope-from lexi@le-fay.org) Authentication-Results: mx1.freebsd.org; none Received: from iris.eden.le-Fay.ORG (IRIS.EDEN.LE-FAY.ORG [IPv6:2001:8b0:aab5:106::18]) by thyme.eden.le-Fay.ORG (Postfix) with ESMTP id BA34922B38; Thu, 14 Dec 2023 22:06:08 +0000 (GMT) DKIM-Signature: v=1; a=rsa-sha256; c=simple/simple; d=le-fay.org; s=thyme; t=1702591568; bh=2Mb+ZEQ/on1F9DbyMdpGidNRCs3eiH9wyygQIQ7dbGE=; h=Subject:From:In-Reply-To:Date:Cc:References:To; b=wYfRRFsGMiWC2yaxXROHAwqtP/w5Fz+ZkgunBcJpEWKwW0//kWPTnlWl+pzOmkoJY 00p9B0+eGixJk+/u6nJ+OLGicwaVono1449x33UIMKDCKdTO7t3pw6xUSKiHeANIAV KLsh4NcJ4FrIISFi7KvGWJzIQUpfkDEBCsWD4Lrw= Received: from smtpclient.apple (unknown [IPv6:2001:8b0:aab5:104:bdc0:5de2:bc0e:fba9]) (using TLSv1.2 with cipher ECDHE-ECDSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by iris.eden.le-Fay.ORG (Postfix) with ESMTPSA id A956BD150; Thu, 14 Dec 2023 22:06:08 +0000 (GMT) Content-Type: text/plain; charset=utf-8 List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org Mime-Version: 1.0 (Mac OS X Mail 16.0 \(3774.300.61.1.2\)) Subject: Re: unusual ZFS issue From: Lexi Winter In-Reply-To: Date: Thu, 14 Dec 2023 22:05:58 +0000 Cc: "freebsd-fs@freebsd.org" Content-Transfer-Encoding: quoted-printable Message-Id: References: <787CB64A-1687-49C3-9063-2CE3B6F957EF@le-fay.org> To: Pete Wright X-Mailer: Apple Mail (2.3774.300.61.1.2) X-Rspamd-Pre-Result: action=no action; module=replies; Message is reply to one we originated X-Spamd-Result: default: False [-4.00 / 15.00]; REPLY(-4.00)[]; ASN(0.00)[asn:20712, ipnet:81.187.0.0/16, country:GB] X-Spamd-Bar: ---- X-Rspamd-Queue-Id: 4Srmdg4wYkz4v6H On 14 Dec 2023, at 22:02, Pete Wright wrote: > On Thu, Dec 14, 2023 at 09:17:06PM +0000, Lexi Winter wrote: >> hi list, >>=20 >> i=E2=80=99ve just hit this ZFS error: >>=20 >> # zfs list -rt snapshot data/vm/media/disk1 >> cannot iterate filesystems: I/O error >=20 > hrm, i wonder if you see any errors in dmesg or /var/log/messages = about a > device failing? nothing that looks relevant in the last few days (the problem appeared = last night, Dec 13th): Dec 11 15:44:21 hemlock kernel: ix1: link state changed to DOWN Dec 11 15:44:21 hemlock kernel: ix1.107: link state changed to DOWN Dec 11 15:44:35 hemlock kernel: ix1: link state changed to UP Dec 11 15:44:35 hemlock kernel: ix1.107: link state changed to UP Dec 11 15:44:47 hemlock kernel: nfsrv_cache_session: no session = IPaddr=3D2001:8b0:aab5:ffff::2, check NFS clients for unique = /etc/hostid's Dec 11 15:44:47 hemlock syslogd: last message repeated 1 times Dec 11 17:00:48 hemlock kernel: tcp_vnet_init: WARNING: unable to = initialise TCP stats Dec 11 17:00:48 hemlock kernel: lo0: link state changed to UP Dec 12 06:17:23 hemlock ntpd[25836]: leapsecond file = ('/var/db/ntpd.leap-seconds.list'): will expire in less than 16 days Dec 13 06:17:23 hemlock ntpd[25836]: leapsecond file = ('/var/db/ntpd.leap-seconds.list'): will expire in less than 15 days Dec 14 06:17:23 hemlock ntpd[25836]: leapsecond file = ('/var/db/ntpd.leap-seconds.list'): will expire in less than 14 days Dec 14 16:30:12 hemlock smbd[98264]: [2023/12/14 16:30:12.404883, 0] = ../../source3/smbd/server.c:1741(main) Dec 14 16:30:12 hemlock smbd[98264]: smbd version 4.16.11 started. Dec 14 16:30:12 hemlock smbd[98264]: Copyright Andrew Tridgell and the = Samba Team 1992-2022 i=E2=80=99ve also checked the disks with smartctl and i didn=E2=80=99t = see any errors there. (a couple of devices have corrected read errors, = but that=E2=80=99s expected given their age - and if it *was* a disk = error i=E2=80=99d expect it to show up as a checksum error). thanks.=