From owner-freebsd-current@freebsd.org Thu Dec 13 09:47:19 2018 Return-Path: Delivered-To: freebsd-current@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 122211313CA8 for ; Thu, 13 Dec 2018 09:47:19 +0000 (UTC) (envelope-from gljennjohn@gmail.com) Received: from mail-wr1-x42b.google.com (mail-wr1-x42b.google.com [IPv6:2a00:1450:4864:20::42b]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 3E40577793 for ; Thu, 13 Dec 2018 09:47:18 +0000 (UTC) (envelope-from gljennjohn@gmail.com) Received: by mail-wr1-x42b.google.com with SMTP id l9so1253528wrt.13 for ; Thu, 13 Dec 2018 01:47:18 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=date:from:to:subject:message-id:reply-to:mime-version :content-transfer-encoding; bh=pINr+/VYOAwYsFlU4qewFYhz9PeU1ClDmmtEsWS9tsE=; b=QTmEwokpxiBf5wygwrYM2oLDrhFUJwP4W/CQg8Wa90Ked8OlNAEWq/MG/yuXSe5tFj LnjgEGXNME2hh+Gkh0Hk7Ug4GqIMuuFD036Upf1P4kxWxpW5Mil692qjGPB21KIyLXNQ w3sePnwC0UQGXNpOyUnmx9sZ9/KmlrEf+LhgiBD4g0QvWXaxYzZuRDfaoPJOACUmWI/r FmaF0Xc7SSq4wcZ4KRRsMLPUy5G0a6K30DTgIeIjQhKBlckEExVTLaqMW9NOJtYzF5Sa h1/RqVi592LTSx/V5cWdBYA0u8yLyPPgXvi0zEVEW7il+XDw94CJqBSTRFUneH7yhiIE X8Kg== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:date:from:to:subject:message-id:reply-to :mime-version:content-transfer-encoding; bh=pINr+/VYOAwYsFlU4qewFYhz9PeU1ClDmmtEsWS9tsE=; b=m9k1E50cNkcPf+BEjqwjn5Ht2G6XW+85mQMoDkmlNPu4kJdlgZsaPosYZ5H9LjvhAd IzBi/lAiKwrkM5D9NFUZsVg5OOXU6IJUYLPm+2npOfg0Ss1qLt+Y4Vbw3VF8qKQK7KJa qAZ5O31J8G+Y4nDS0Mx6qPwSaP0pnne0anMBOOBgnRbTp5UvFwqSrrYRZ/HcR0dQQ3NE So3BVYyEx7b5rzLvoLVaLf05gfYF3KT0oeJph1jeTiE0S7JZr0Su716KzmgeYwwmPWKZ eS9Svri7TEAW3QUCddjKLwWxINGMZ9vjTixeTLt+7DZOvOy40R447tlfRAzj+Kk2rqRz BkpQ== X-Gm-Message-State: AA+aEWZuy4ebPOraY8oTfNZ/5QUtih3g0BHsPEer7bfCkyLJi/NHDVVk Pt0zMGzSwNBwOo9zHAKLezUDz73g X-Google-Smtp-Source: AFSGD/Vx7++MkA+t/GvTTALnarxbL4skKdVIaDeASZ0zKRxDOnlSDTTiSZ3r3q8h32Zra4qIHseLhQ== X-Received: by 2002:a5d:45d0:: with SMTP id b16mr19250926wrs.86.1544694436704; Thu, 13 Dec 2018 01:47:16 -0800 (PST) Received: from ernst.home (p5B02380D.dip0.t-ipconnect.de. [91.2.56.13]) by smtp.gmail.com with ESMTPSA id b13sm954132wrn.28.2018.12.13.01.47.15 for (version=TLS1_2 cipher=ECDHE-RSA-CHACHA20-POLY1305 bits=256/256); Thu, 13 Dec 2018 01:47:16 -0800 (PST) Date: Thu, 13 Dec 2018 10:47:13 +0100 From: Gary Jennejohn To: freebsd-current@freebsd.org Subject: enabling inode hashes results in kernel panics Message-ID: <20181213104713.02a14912@ernst.home> Reply-To: gljennjohn@gmail.com X-Mailer: Claws Mail 3.16.0 (GTK+ 2.24.32; amd64-portbld-freebsd12.0) MIME-Version: 1.0 Content-Type: text/plain; charset=US-ASCII Content-Transfer-Encoding: 7bit X-Rspamd-Queue-Id: 3E40577793 X-Spamd-Bar: --- Authentication-Results: mx1.freebsd.org; dkim=pass header.d=gmail.com header.s=20161025 header.b=QTmEwokp; dmarc=pass (policy=none) header.from=gmail.com; spf=pass (mx1.freebsd.org: domain of gljennjohn@gmail.com designates 2a00:1450:4864:20::42b as permitted sender) smtp.mailfrom=gljennjohn@gmail.com X-Spamd-Result: default: False [-3.34 / 15.00]; RCVD_VIA_SMTP_AUTH(0.00)[]; HAS_REPLYTO(0.00)[gljennjohn@gmail.com]; R_SPF_ALLOW(-0.20)[+ip6:2a00:1450:4000::/36]; FREEMAIL_FROM(0.00)[gmail.com]; TO_DN_NONE(0.00)[]; REPLYTO_ADDR_EQ_FROM(0.00)[]; RCVD_COUNT_THREE(0.00)[3]; DKIM_TRACE(0.00)[gmail.com:+]; DMARC_POLICY_ALLOW(-0.50)[gmail.com,none]; MX_GOOD(-0.01)[cached: alt3.gmail-smtp-in.l.google.com]; NEURAL_HAM_SHORT(-0.76)[-0.762,0]; FROM_EQ_ENVFROM(0.00)[]; MIME_TRACE(0.00)[0:+]; FREEMAIL_ENVFROM(0.00)[gmail.com]; ASN(0.00)[asn:15169, ipnet:2a00:1450::/32, country:US]; RCVD_TLS_LAST(0.00)[]; DWL_DNSWL_NONE(0.00)[gmail.com.dwl.dnswl.org : 127.0.5.0]; ARC_NA(0.00)[]; NEURAL_HAM_MEDIUM(-0.99)[-0.988,0]; R_DKIM_ALLOW(-0.20)[gmail.com:s=20161025]; FROM_HAS_DN(0.00)[]; TO_MATCH_ENVRCPT_ALL(0.00)[]; MIME_GOOD(-0.10)[text/plain]; PREVIOUSLY_DELIVERED(0.00)[freebsd-current@freebsd.org]; FREEMAIL_REPLYTO(0.00)[gmail.com]; RCPT_COUNT_ONE(0.00)[1]; IP_SCORE(-0.58)[ipnet: 2a00:1450::/32(-1.49), asn: 15169(-1.30), country: US(-0.09)]; RCVD_IN_DNSWL_NONE(0.00)[b.2.4.0.0.0.0.0.0.0.0.0.0.0.0.0.0.2.0.0.4.6.8.4.0.5.4.1.0.0.a.2.list.dnswl.org : 127.0.5.0] X-BeenThere: freebsd-current@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: Discussions about the use of FreeBSD-current List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 13 Dec 2018 09:47:19 -0000 I just had two panics as a result of enabling inode hashes on a file system yesterday when I had to run fsck on it. The filesystem showed no problems at all yesterday, the problem didn't appear until I accessed it today. NOTE that my fsck was installed from r341840 yesterday morning, so it should be up-to-date. My kernel is also at r341840. I have run fsck on this filesystem six times. Although fsck claims to have repaired the inode-check hash every time, it in reality has not repaired anything. I know this because, after the first two fsck runs, I mounted the filesystem. Accessing it resulted in a immediate panic (the second of the two). The file system is located on a SSD with trim enabled. Whether that is relevant I cannot say, but this is the ONLY filesystem with inode hashes enabled. The inodes are all contiguous, from 122229888 thorugh 122229904. Strangely, MTIME=Sep 6 23:21 2002 on every one of them, but the SSD itslef is only a month old and the files on it only a few weeks old. The panic message is Inode 122229888: check-hash failed panic: softdep_update_inodeblock: bad link count It almost appears like the softdep code in the kernel is not aware of inode hashes and gets confused. I have the crash dumps and the core.txt files. It doesn't appear that I can disable the hashes using tunefs, so my only remedy will be to run fsdb and clear these inodes and lose quite a few rather large files. -- Gary Jennejohn