From owner-freebsd-current@freebsd.org Wed Apr 10 04:51:18 2019 Return-Path: Delivered-To: freebsd-current@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 41EEB1577A12 for ; Wed, 10 Apr 2019 04:51:18 +0000 (UTC) (envelope-from yaneurabeya@gmail.com) Received: from mail-pl1-x62f.google.com (mail-pl1-x62f.google.com [IPv6:2607:f8b0:4864:20::62f]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "GTS CA 1O1" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id A3AA18F24E; Wed, 10 Apr 2019 04:51:16 +0000 (UTC) (envelope-from yaneurabeya@gmail.com) Received: by mail-pl1-x62f.google.com with SMTP id cv12so598110plb.9; Tue, 09 Apr 2019 21:51:16 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=mime-version:subject:from:in-reply-to:date:cc :content-transfer-encoding:message-id:references:to; bh=Muegjs8qIve3FdahaphUW6anJqnKLtywqsF63huUaD0=; b=OSR+IKgaRdAZSdTIDhWLsi79dzb7ehn14nyzl2AhCbs1maIO7/wN3o08W9jluiO+uB lk1vBC0mpge2qs4OcHfyfeb39jufS9yO0UyMCSYCeNWQZKPPEHQ/qAyEfdNagXcqIerg 2fNvEISbUwhL2ywuuVHi0nM7cZ+MAdI/FFmtMYJ3IjwS7AfmanVQJCFNFOuQQon33IjV 80pl4NGIp2/JauG38oKUPkHSbWdCYbLMPDO7RS10cEn/5LnMKSuJmyKd6lDCUrnFZw0g ksGAcu2NYY3akXYwgnA5rZQkIl4w/x3G89hiQ1GJAC/dQh7FxGR8HqJm3DhNDHcFQnT0 BANQ== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:subject:from:in-reply-to:date:cc :content-transfer-encoding:message-id:references:to; bh=Muegjs8qIve3FdahaphUW6anJqnKLtywqsF63huUaD0=; b=jNBmBKLz/xzztsx2X9YEWTdZRV9OJvk/w67L37vsIopI5IRHg+8duGdjUfKcWBAf1r I4lxE6LleGHhlOwfiU135OriMzYkUaF+4mekmW7BP7sfftSkhvt/fHwzejWK3OrOP02T Ln0b6ytEyA/yVqngPmbFupDBjsDpV63K2yRqlbPrJ/uUIphPlROppbM6rf2+IxMSESKP M4flS+fsjZXFkfGgFhftBkr/m6vH9ZhL8auv6MkC+JTITswL2iu0/qlNVxW5kSo4qGcf s+58J+0Mtmzw3ni9QpjxWdz5pVgYvXZH3naWekniKkjFo0PkxJrQKX6+d2+piv8dHIZ/ X3ag== X-Gm-Message-State: APjAAAWS5mvId0qMyjs5LapynlblVO7NY0lRtJg4XA1McBoiqn63Hp9w V6Tb3c8hu7SvPmML3PftYyyBoCY9rqU= X-Google-Smtp-Source: APXvYqwR3hyyN62ynQnR9/tHZWXBzVgdLjHBPeyFItAiqHtoJxy1iaNHNlI0lBtr/DRMxriSOj0BGg== X-Received: by 2002:a17:902:e109:: with SMTP id cc9mr42385530plb.148.1554871874682; Tue, 09 Apr 2019 21:51:14 -0700 (PDT) Received: from [192.168.20.22] (c-73-19-52-228.hsd1.wa.comcast.net. [73.19.52.228]) by smtp.gmail.com with ESMTPSA id j67sm57666003pfc.72.2019.04.09.21.51.13 (version=TLS1_2 cipher=ECDHE-RSA-AES128-GCM-SHA256 bits=128/128); Tue, 09 Apr 2019 21:51:13 -0700 (PDT) Content-Type: text/plain; charset=utf-8 Mime-Version: 1.0 (1.0) Subject: Re: r346025: ZFS filesystems do not mount anymore From: Enji Cooper X-Mailer: iPhone Mail (16E227) In-Reply-To: <5c2f7554-5da2-e55b-4918-c7174fc091fe@protected-networks.net> Date: Tue, 9 Apr 2019 21:51:12 -0700 Cc: "O. Hartmann" , =?utf-8?Q?Trond_Endrest=C3=B8l?= , FreeBSD CURRENT , crees@freebsd.org Content-Transfer-Encoding: quoted-printable Message-Id: <4422B7AB-B398-472B-9F66-00624853EE3D@gmail.com> References: <20190408195800.37046b3c@thor.intern.walstatt.dynvpn.de> <20190409153014.5299494e@freyja> <5c2f7554-5da2-e55b-4918-c7174fc091fe@protected-networks.net> To: Michael Butler X-Rspamd-Queue-Id: A3AA18F24E X-Spamd-Bar: ------ Authentication-Results: mx1.freebsd.org; dkim=pass header.d=gmail.com header.s=20161025 header.b=OSR+IKga; dmarc=pass (policy=none) header.from=gmail.com; spf=pass (mx1.freebsd.org: domain of yaneurabeya@gmail.com designates 2607:f8b0:4864:20::62f as permitted sender) smtp.mailfrom=yaneurabeya@gmail.com X-Spamd-Result: default: False [-6.26 / 15.00]; RCVD_VIA_SMTP_AUTH(0.00)[]; TO_DN_SOME(0.00)[]; FREEMAIL_FROM(0.00)[gmail.com]; R_SPF_ALLOW(-0.20)[+ip6:2607:f8b0:4000::/36]; MV_CASE(0.50)[]; RCPT_COUNT_FIVE(0.00)[5]; RCVD_COUNT_THREE(0.00)[3]; DKIM_TRACE(0.00)[gmail.com:+]; MX_GOOD(-0.01)[cached: alt3.gmail-smtp-in.l.google.com]; DMARC_POLICY_ALLOW(-0.50)[gmail.com,none]; NEURAL_HAM_SHORT(-0.85)[-0.847,0]; FROM_EQ_ENVFROM(0.00)[]; RCVD_TLS_LAST(0.00)[]; MIME_TRACE(0.00)[0:+]; FREEMAIL_ENVFROM(0.00)[gmail.com]; ASN(0.00)[asn:15169, ipnet:2607:f8b0::/32, country:US]; MID_RHS_MATCH_FROM(0.00)[]; DWL_DNSWL_NONE(0.00)[gmail.com.dwl.dnswl.org : 127.0.5.0]; ARC_NA(0.00)[]; NEURAL_HAM_MEDIUM(-1.00)[-1.000,0]; R_DKIM_ALLOW(-0.20)[gmail.com:s=20161025]; FROM_HAS_DN(0.00)[]; NEURAL_HAM_LONG(-1.00)[-1.000,0]; MIME_GOOD(-0.10)[text/plain]; IP_SCORE(-2.90)[ip: (-9.32), ipnet: 2607:f8b0::/32(-2.94), asn: 15169(-2.18), country: US(-0.06)]; TO_MATCH_ENVRCPT_SOME(0.00)[]; RCVD_IN_DNSWL_NONE(0.00)[f.2.6.0.0.0.0.0.0.0.0.0.0.0.0.0.0.2.0.0.4.6.8.4.0.b.8.f.7.0.6.2.list.dnswl.org : 127.0.5.0] X-BeenThere: freebsd-current@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: Discussions about the use of FreeBSD-current List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 10 Apr 2019 04:51:18 -0000 > On Apr 9, 2019, at 18:29, Michael Butler wrot= e: >=20 >> On 2019-04-09 09:30, O. Hartmann wrote: >> On Tue, 9 Apr 2019 10:42:47 +0200 (CEST) >> Trond Endrest=C3=B8l wrote: >>=20 >>>> On Tue, 9 Apr 2019 10:06+0200, Trond Endrest=C3=B8l wrote: >>>>=20 >>>>> On Mon, 8 Apr 2019 19:58+0200, O. Hartmann wrote: >>>>>=20 >>>>> -----BEGIN PGP SIGNED MESSAGE----- >>>>> Hash: SHA256 >>>>>=20 >>>>> Hello, >>>>>=20 >>>>> after a bunch of updates this weekend, mounting ZFS filesystems on >>>>> CURRENT r346025 doesn't work anymore at boot time when ZFS is >>>>> built-in-kernel. zfs_enable=3D"YES" is set in /etc/rc.conf. >>>>>=20 >>>>> After the system has booted, mounting all ZFS filesystems via "zfs mou= nt >>>>> -a" operates as expected and all filesystems are available as usual. =20= >>>>=20 >>>> I blame r346017: >>>>=20 >>>> Trying to mount root from zfs:zroot/ROOT/20190409-r346017 [] >>>> Setting hostuuid: 7b624d1c-4bc3-e2cb-4ac2-6487a4b4774c. >>>> Setting hostid: 0xf9071336. >>>> interface zfsctrl.1 already present in the KLD 'kernel'! >>>> linker_load_file: /boot/kernel/zfs.ko - unsupported file type >>>> kldload: an error occurred while loading module zfs. Please check dmesg= (8) >>>> for more details. /etc/rc: WARNING: Unable to load kernel module zfs >>>> Starting file system checks: >>>> Mounting local filesystems:. >>>> interface zfsctrl.1 already present in the KLD 'kernel'! >>>> linker_load_file: /boot/kernel/zfs.ko - unsupported file type >>>> kldload: an error occurred while loading module zfs. Please check dmesg= (8) >>>> for more details. /etc/rc: WARNING: Unable to load kernel module zfs >>>> interface zfsctrl.1 already present in the KLD 'kernel'! >>>> linker_load_file: /boot/kernel/zfs.ko - unsupported file type >>>> kldload: an error occurred while loading module zfs. Please check dmesg= (8) >>>> for more details. /etc/rc: WARNING: Unable to load kernel module zfs >>>> ELF ldconfig path: /lib /usr/lib /usr/lib/compat >>>> 32-bit compatibility ldconfig path: /usr/lib32 >>>>=20 >>>> [...] >>>>=20 >>>> Creating and/or trimming log files. >>>> Starting syslogd. >>>> Apr 9 09:48:32 freebsd-head-zfs syslogd: /var/log/securit= y: >>>> No such file or directory Setting date via ntp. >>>> 9 Apr 09:48:38 ntpdate[1073]: step time server 2001:W:X:Y::Z offset >>>> -0.992370 sec No core dumps found. >>>> Clearing /tmp (X related). >>>> Updating motd:. >>>> Mounting late filesystems:mount: /usr/compat/linux: No such file or >>>> directory mount: /usr/compat/linux: No such file or directory >>>> mount: /usr/compat/linux: No such file or directory >>>> mount: /usr/compat/linux: No such file or directory >>>> . >>>> Mounting /etc/fstab filesystems failed, startup aborted >>>> ERROR: ABORTING BOOT (sending SIGTERM to parent)! >>>> Enter full pathname of shell or RETURN for /bin/sh: >>>> root@freebsd-head-zfs:/ # zfs mount -av >>>> root@freebsd-head-zfs:/ # mount -al >>>> root@freebsd-head-zfs:/ # exit >>>> Setting hostuuid: 7b624d1c-4bc3-e2cb-4ac2-6487a4b4774c. >>>> Setting hostid: 0xf9071336. >>>> interface zfsctrl.1 already present in the KLD 'kernel'! >>>> linker_load_file: /boot/kernel/zfs.ko - unsupported file type >>>> kldload: an error occurred while loading module zfs. Please check dmesg= (8) >>>> for more details. /etc/rc: WARNING: Unable to load kernel module zfs >>>> Fast boot: skipping disk checks. >>>> Mounting local filesystems:. >>>> interface zfsctrl.1 already present in the KLD 'kernel'! >>>> linker_load_file: /boot/kernel/zfs.ko - unsupported file type >>>> kldload: an error occurred while loading module zfs. Please check dmesg= (8) >>>> for more details. /etc/rc: WARNING: Unable to load kernel module zfs >>>> interface zfsctrl.1 already present in the KLD 'kernel'! >>>> linker_load_file: /boot/kernel/zfs.ko - unsupported file type >>>> kldload: an error occurred while loading module zfs. Please check dmesg= (8) >>>> for more details. /etc/rc: WARNING: Unable to load kernel module zfs >>>> ELF ldconfig >>>> path: /lib /usr/lib /usr/lib/compat /usr/local/lib /usr/local/lib/compa= t/pkg /usr/local/lib/compat/pkg /usr/local/lib/perl5/5.28/mach/CORE >>>> 32-bit compatibility ldconfig path: /usr/lib32 >>>>=20 >>>> [...] =20 >>>=20 >>> At a later point, this happens: >>>=20 >>> Starting syslogd. >>> usage: protect [-i] command >>> protect [-cdi] -g pgrp | -p pid >>> Setting date via ntp. >>>=20 >>> It looks like syslogd is no longer protected against the OOM killer. >>>=20 >>>> Once I manually mount the remaining filesystems, multiuser boot=20 >>>> proceeds as expected. My kernel has options ZFS, and the boot scripts=20= >>>> doesn't account for this scenario. =20 >>>=20 >>>=20 >>=20 >> Hello, >>=20 >> thank you for investigating! I think you're correct. I was wondering how t= his >> change could make it into the tree with this kind of impact. >>=20 >> Maybe filing a PR would be fine? >>=20 >=20 > I just confirmed that the change at SVN r346017 after 'mergemaster -U' > yields a (ZFS-based) system which can only be brought into normal > service through: >=20 > a single-user boot > mount -a > mount -u -o rw / > zfs mount -a >=20 > Reverting this change restores normal operation at start-up. >=20 > ZFS is also compiled into the kernel on my system, >=20 > imb CCing crees@, the author of r346017, for context. I will file a PR soon if o= ne hasn=E2=80=99t already been filed. -Enji=