From owner-freebsd-stable@freebsd.org Sun Dec 6 12:09:24 2020 Return-Path: Delivered-To: freebsd-stable@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 0458F47BCB5 for ; Sun, 6 Dec 2020 12:09:24 +0000 (UTC) (envelope-from pmc@citylink.dinoex.sub.org) Received: from uucp.dinoex.sub.de (uucp.dinoex.sub.de [IPv6:2001:1440:5001:1::2]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "uucp.dinoex.sub.de", Issuer "Let's Encrypt Authority X3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4Cplc26p0Rz3pKC for ; Sun, 6 Dec 2020 12:09:22 +0000 (UTC) (envelope-from pmc@citylink.dinoex.sub.org) Received: from uucp.dinoex.sub.de (uucp.dinoex.org [185.220.148.12]) by uucp.dinoex.org (8.16.0.50/8.16.0.50) with ESMTPS id 0B6C9480025545 (version=TLSv1.3 cipher=TLS_AES_256_GCM_SHA384 bits=256 verify=NO) for ; Sun, 6 Dec 2020 13:09:05 +0100 (CET) (envelope-from pmc@citylink.dinoex.sub.org) X-MDaemon-Deliver-To: X-Authentication-Warning: uucp.dinoex.sub.de: Host uucp.dinoex.org [185.220.148.12] claimed to be uucp.dinoex.sub.de Received: (from uucp@localhost) by uucp.dinoex.sub.de (8.16.0.50/8.16.0.50/Submit) with UUCP id 0B6C942B025541 for freebsd-stable@freebsd.org; Sun, 6 Dec 2020 13:09:04 +0100 (CET) (envelope-from pmc@citylink.dinoex.sub.org) Received: from gate.oper.dinoex.org (gate-e [192.168.98.2]) by citylink.dinoex.sub.de (8.15.2/8.15.2) with ESMTP id 0B6C07f4055521 for ; Sun, 6 Dec 2020 13:00:07 +0100 (CET) (envelope-from peter@gate.oper.dinoex.org) Received: from gate.oper.dinoex.org (gate-e [192.168.98.2]) by gate.oper.dinoex.org (8.15.2/8.15.2) with ESMTP id 0B6BvcLJ054462 for ; Sun, 6 Dec 2020 12:57:38 +0100 (CET) (envelope-from peter@gate.oper.dinoex.org) Received: (from peter@localhost) by gate.oper.dinoex.org (8.15.2/8.15.2/Submit) id 0B6BvcGx054461 for freebsd-stable@freebsd.org; Sun, 6 Dec 2020 12:57:38 +0100 (CET) (envelope-from peter) Date: Sun, 6 Dec 2020 12:57:38 +0100 From: Peter Sender: li-fbsd@citylink.dinoex.sub.org To: freebsd-stable@freebsd.org Subject: Help! 12.2 mem ctrl knob missing, might need 3 times more memory Message-ID: <20201206115738.GA51580@gate.oper.dinoex.org> MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline X-Milter: Spamilter (Reciever: uucp.dinoex.sub.de; Sender-ip: 185.220.148.12; Sender-helo: uucp.dinoex.sub.de; ) X-Greylist: Sender IP whitelisted, not delayed by milter-greylist-4.6.2 (uucp.dinoex.org [185.220.148.12]); Sun, 06 Dec 2020 13:09:08 +0100 (CET) X-Rspamd-Queue-Id: 4Cplc26p0Rz3pKC X-Spamd-Bar: / Authentication-Results: mx1.freebsd.org; dkim=none; dmarc=none; spf=none (mx1.freebsd.org: domain of pmc@citylink.dinoex.sub.org has no SPF policy when checking 2001:1440:5001:1::2) smtp.mailfrom=pmc@citylink.dinoex.sub.org X-Spamd-Result: default: False [-0.10 / 15.00]; ARC_NA(0.00)[]; RBL_DBL_DONT_QUERY_IPS(0.00)[2001:1440:5001:1::2:from]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; FROM_HAS_DN(0.00)[]; TO_MATCH_ENVRCPT_ALL(0.00)[]; NEURAL_HAM_LONG(-1.00)[-1.000]; MIME_GOOD(-0.10)[text/plain]; HAS_XAW(0.00)[]; PREVIOUSLY_DELIVERED(0.00)[freebsd-stable@freebsd.org]; AUTH_NA(1.00)[]; RCPT_COUNT_ONE(0.00)[1]; SPAMHAUS_ZRD(0.00)[2001:1440:5001:1::2:from:127.0.2.255]; RCVD_COUNT_THREE(0.00)[4]; TO_DN_NONE(0.00)[]; NEURAL_SPAM_SHORT(1.00)[1.000]; SUBJECT_HAS_EXCLAIM(0.00)[]; DMARC_NA(0.00)[sub.org]; R_SPF_NA(0.00)[no SPF record]; FROM_EQ_ENVFROM(0.00)[]; R_DKIM_NA(0.00)[]; MIME_TRACE(0.00)[0:+]; ASN(0.00)[asn:8469, ipnet:2001:1440::/32, country:DE]; RCVD_TLS_LAST(0.00)[]; MAILMAN_DEST(0.00)[freebsd-stable] X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.34 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 06 Dec 2020 12:09:24 -0000 Hiya, after upgrading 11.4 -> 12.2, I get this error: > sysctl: unknown oid 'vm.pageout_wakeup_thresh' at line 105 How do I adjust the paging now? The ARC is much too small: Mem: 1929M Active, 109M Inact, 178M Laundry, 1538M Wired, 37M Buf, 88M Free ARC: 729M Total, 428M MFU, 154M MRU, 196K Anon, 25M Header, 122M Other 118M Compressed, 533M Uncompressed, 4.52:1 Ratio Swap: 10G Total, 1672M Used, 8567M Free, 16% Inuse With 11.4 there was 200M active, 2500M wired, 4200M swap and the ARC stayed filled to the configured arc_max. And there are not even all applications loaded yet! Config: installed 4G ram, application footprint ~11G. vm.pageout_wakeup_thresh=11000 # default 6886 vm.v_inactive_target=48000 # default 1.5x vm.v_free_target vfs.zfs.arc_grow_retry=6 # override shrink-event from pageout (every 10sec.) I did this intentional: the ram is over-used with applications. These applications are rarely accessed, but should respond to the network. So they are best accomodated in paging space - taking a few seconds for page-in at first access does not matter, and not many of them are accessed at the same time. So, I want the machine to page out *before* shrinking the ARC, because pageout is a normal happening in this layout. The above tuning achieved exactly that, but now in 12.2 it seems missing. Without that I would need to install the full 12G RAM, which is just a waste. How do I get this behaviour back with 12.2? From owner-freebsd-stable@freebsd.org Mon Dec 7 13:00:22 2020 Return-Path: Delivered-To: freebsd-stable@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 880BB4AA29A for ; Mon, 7 Dec 2020 13:00:22 +0000 (UTC) (envelope-from pmc@citylink.dinoex.sub.org) Received: from uucp.dinoex.sub.de (uucp.dinoex.sub.de [IPv6:2001:1440:5001:1::2]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "uucp.dinoex.sub.de", Issuer "Let's Encrypt Authority X3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4CqNhP3SMQz4mPn for ; Mon, 7 Dec 2020 13:00:20 +0000 (UTC) (envelope-from pmc@citylink.dinoex.sub.org) Received: from uucp.dinoex.sub.de (uucp.dinoex.org [185.220.148.12]) by uucp.dinoex.org (8.16.0.50/8.16.0.50) with ESMTPS id 0B7D05u6091740 (version=TLSv1.3 cipher=TLS_AES_256_GCM_SHA384 bits=256 verify=NO) for ; Mon, 7 Dec 2020 14:00:05 +0100 (CET) (envelope-from pmc@citylink.dinoex.sub.org) X-MDaemon-Deliver-To: X-Authentication-Warning: uucp.dinoex.sub.de: Host uucp.dinoex.org [185.220.148.12] claimed to be uucp.dinoex.sub.de Received: (from uucp@localhost) by uucp.dinoex.sub.de (8.16.0.50/8.16.0.50/Submit) with UUCP id 0B7D05ix091739 for freebsd-stable@freebsd.org; Mon, 7 Dec 2020 14:00:05 +0100 (CET) (envelope-from pmc@citylink.dinoex.sub.org) Received: from gate.oper.dinoex.org (gate-e [192.168.98.2]) by citylink.dinoex.sub.de (8.16.1/8.16.1) with ESMTP id 0B7CsurN019060 for ; Mon, 7 Dec 2020 13:54:56 +0100 (CET) (envelope-from peter@gate.oper.dinoex.org) Received: from gate.oper.dinoex.org (gate-e [192.168.98.2]) by gate.oper.dinoex.org (8.16.1/8.16.1) with ESMTP id 0B7CspW0019055 for ; Mon, 7 Dec 2020 13:54:51 +0100 (CET) (envelope-from peter@gate.oper.dinoex.org) Received: (from peter@localhost) by gate.oper.dinoex.org (8.16.1/8.16.1/Submit) id 0B7CspLK019054 for freebsd-stable@freebsd.org; Mon, 7 Dec 2020 13:54:51 +0100 (CET) (envelope-from peter) Date: Mon, 7 Dec 2020 13:54:51 +0100 From: Peter Sender: li-fbsd@citylink.dinoex.sub.org To: freebsd-stable@freebsd.org Subject: Panic: 12.2 fails to use VIMAGE jails Message-ID: <20201207125451.GA11406@gate.oper.dinoex.org> MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline X-Milter: Spamilter (Reciever: uucp.dinoex.sub.de; Sender-ip: 185.220.148.12; Sender-helo: uucp.dinoex.sub.de; ) X-Greylist: Sender IP whitelisted, not delayed by milter-greylist-4.6.2 (uucp.dinoex.org [185.220.148.12]); Mon, 07 Dec 2020 14:00:08 +0100 (CET) X-Rspamd-Queue-Id: 4CqNhP3SMQz4mPn X-Spamd-Bar: / Authentication-Results: mx1.freebsd.org; dkim=none; dmarc=none; spf=none (mx1.freebsd.org: domain of pmc@citylink.dinoex.sub.org has no SPF policy when checking 2001:1440:5001:1::2) smtp.mailfrom=pmc@citylink.dinoex.sub.org X-Spamd-Result: default: False [-0.10 / 15.00]; ARC_NA(0.00)[]; RBL_DBL_DONT_QUERY_IPS(0.00)[2001:1440:5001:1::2:from]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; FROM_HAS_DN(0.00)[]; TO_MATCH_ENVRCPT_ALL(0.00)[]; NEURAL_HAM_LONG(-1.00)[-1.000]; MIME_GOOD(-0.10)[text/plain]; HAS_XAW(0.00)[]; TO_DN_NONE(0.00)[]; AUTH_NA(1.00)[]; RCPT_COUNT_ONE(0.00)[1]; SPAMHAUS_ZRD(0.00)[2001:1440:5001:1::2:from:127.0.2.255]; RCVD_COUNT_THREE(0.00)[4]; PREVIOUSLY_DELIVERED(0.00)[freebsd-stable@freebsd.org]; NEURAL_SPAM_SHORT(1.00)[1.000]; DMARC_NA(0.00)[sub.org]; R_SPF_NA(0.00)[no SPF record]; FROM_EQ_ENVFROM(0.00)[]; R_DKIM_NA(0.00)[]; MIME_TRACE(0.00)[0:+]; ASN(0.00)[asn:8469, ipnet:2001:1440::/32, country:DE]; RCVD_TLS_LAST(0.00)[]; MAILMAN_DEST(0.00)[freebsd-stable] X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.34 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 07 Dec 2020 13:00:22 -0000 After clean upgrade (from source) from 11.4 to 12.2-p1 my jails do no longer work correctly. Old-fashioned jails seem to work, but most are VIMAGE+NETGRAPH style, and do not work properly. All did work flawlessly for nearly a year with Rel.11. If I start 2-3 jails, and then stop them again, there is always a panic. Also reproducible with GENERIC kernel. Can this be fixed, or do I need to revert to 11.4? The backtrace looks like this: #4 0xffffffff810bbadf at trap_pfault+0x4f #5 0xffffffff810bb23f at trap+0x4cf #6 0xffffffff810933f8 at calltrap+0x8 #7 0xffffffff80cdd555 at _if_delgroup_locked+0x465 #8 0xffffffff80cdbfbe at if_detach_internal+0x24e #9 0xffffffff80ce305c at if_vmove+0x3c #10 0xffffffff80ce3010 at vnet_if_return+0x50 #11 0xffffffff80d0e696 at vnet_destroy+0x136 #12 0xffffffff80ba781d at prison_deref+0x27d #13 0xffffffff80c3e38a at taskqueue_run_locked+0x14a #14 0xffffffff80c3f799 at taskqueue_thread_loop+0xb9 #15 0xffffffff80b9fd52 at fork_exit+0x82 #16 0xffffffff8109442e at fork_trampoline+0xe This is my typical jail config, designed and tested with Rel.11: rail { jid = 10; devfs_ruleset = 11; host.hostname = "xxx.xxx.xxx.org"; vnet = "new"; sysvshm; $ifname1l = nge_${name}_1l; $ifname1l_mac = 00:1d:92:01:01:0a; vnet.interface = "$ifname1l"; exec.prestart = " echo -e \"mkpeer eiface crhook ether\nname .:crhook $ifname1l\" \ | /usr/sbin/ngctl -f - /usr/sbin/ngctl connect ${ifname1l}: svcswitch: ether link2 ifname=`/usr/sbin/ngctl msg ${ifname1l}: getifname | \ awk '$1 == \"Args:\" { print substr($2, 2, length($2)-2)}'` /sbin/ifconfig \$ifname name $ifname1l /sbin/ifconfig $ifname1l link $ifname1l_mac "; exec.poststart = " /usr/sbin/jexec $name /sbin/sysctl kern.securelevel=3 ; "; exec.poststop = "/usr/sbin/ngctl shutdown ${ifname1l}:"; } From owner-freebsd-stable@freebsd.org Mon Dec 7 19:54:20 2020 Return-Path: Delivered-To: freebsd-stable@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id E5ECA4B4944 for ; Mon, 7 Dec 2020 19:54:20 +0000 (UTC) (envelope-from pmc@citylink.dinoex.sub.org) Received: from uucp.dinoex.sub.de (uucp.dinoex.sub.de [IPv6:2001:1440:5001:1::2]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "uucp.dinoex.sub.de", Issuer "Let's Encrypt Authority X3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4CqYt36PT6z3lY8 for ; Mon, 7 Dec 2020 19:54:19 +0000 (UTC) (envelope-from pmc@citylink.dinoex.sub.org) Received: from uucp.dinoex.sub.de (uucp.dinoex.org [185.220.148.12]) by uucp.dinoex.org (8.16.0.50/8.16.0.50) with ESMTPS id 0B7Js53F035949 (version=TLSv1.3 cipher=TLS_AES_256_GCM_SHA384 bits=256 verify=NO) for ; Mon, 7 Dec 2020 20:54:05 +0100 (CET) (envelope-from pmc@citylink.dinoex.sub.org) X-MDaemon-Deliver-To: X-Authentication-Warning: uucp.dinoex.sub.de: Host uucp.dinoex.org [185.220.148.12] claimed to be uucp.dinoex.sub.de Received: (from uucp@localhost) by uucp.dinoex.sub.de (8.16.0.50/8.16.0.50/Submit) with UUCP id 0B7Js5wj035948 for freebsd-stable@freebsd.org; Mon, 7 Dec 2020 20:54:05 +0100 (CET) (envelope-from pmc@citylink.dinoex.sub.org) Received: from gate.oper.dinoex.org (gate-e [192.168.98.2]) by citylink.dinoex.sub.de (8.16.1/8.16.1) with ESMTP id 0B7JgrpF011981 for ; Mon, 7 Dec 2020 20:42:53 +0100 (CET) (envelope-from peter@gate.oper.dinoex.org) Received: from gate.oper.dinoex.org (gate-e [192.168.98.2]) by gate.oper.dinoex.org (8.16.1/8.16.1) with ESMTP id 0B7JfRFc011829 for ; Mon, 7 Dec 2020 20:41:27 +0100 (CET) (envelope-from peter@gate.oper.dinoex.org) Received: (from peter@localhost) by gate.oper.dinoex.org (8.16.1/8.16.1/Submit) id 0B7JfRtP011828 for freebsd-stable@freebsd.org; Mon, 7 Dec 2020 20:41:27 +0100 (CET) (envelope-from peter) Date: Mon, 7 Dec 2020 20:41:27 +0100 From: Peter Sender: li-fbsd@citylink.dinoex.sub.org To: freebsd-stable@freebsd.org Subject: Analyzing kernel panic from VIMAGE/Netgraph takedown Message-ID: <20201207194127.GA10031@gate.oper.dinoex.org> MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline X-Milter: Spamilter (Reciever: uucp.dinoex.sub.de; Sender-ip: 185.220.148.12; Sender-helo: uucp.dinoex.sub.de; ) X-Greylist: Sender IP whitelisted, not delayed by milter-greylist-4.6.2 (uucp.dinoex.org [185.220.148.12]); Mon, 07 Dec 2020 20:54:08 +0100 (CET) X-Rspamd-Queue-Id: 4CqYt36PT6z3lY8 X-Spamd-Bar: -- Authentication-Results: mx1.freebsd.org; dkim=none; dmarc=none; spf=none (mx1.freebsd.org: domain of pmc@citylink.dinoex.sub.org has no SPF policy when checking 2001:1440:5001:1::2) smtp.mailfrom=pmc@citylink.dinoex.sub.org X-Spamd-Result: default: False [-2.10 / 15.00]; ARC_NA(0.00)[]; RBL_DBL_DONT_QUERY_IPS(0.00)[2001:1440:5001:1::2:from]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; FROM_HAS_DN(0.00)[]; TO_MATCH_ENVRCPT_ALL(0.00)[]; NEURAL_HAM_LONG(-1.00)[-1.000]; MIME_GOOD(-0.10)[text/plain]; HAS_XAW(0.00)[]; TO_DN_NONE(0.00)[]; AUTH_NA(1.00)[]; RCPT_COUNT_ONE(0.00)[1]; SPAMHAUS_ZRD(0.00)[2001:1440:5001:1::2:from:127.0.2.255]; RCVD_COUNT_THREE(0.00)[4]; PREVIOUSLY_DELIVERED(0.00)[freebsd-stable@freebsd.org]; NEURAL_HAM_SHORT(-1.00)[-1.000]; DMARC_NA(0.00)[sub.org]; R_SPF_NA(0.00)[no SPF record]; FROM_EQ_ENVFROM(0.00)[]; R_DKIM_NA(0.00)[]; MIME_TRACE(0.00)[0:+]; ASN(0.00)[asn:8469, ipnet:2001:1440::/32, country:DE]; RCVD_TLS_LAST(0.00)[]; MAILMAN_DEST(0.00)[freebsd-stable] X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.34 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 07 Dec 2020 19:54:21 -0000 Stopping a VIMAGE+Netgraph jail in 12.2 in the same way as it did work with Rel. 11.4, crashes the kernel after 2 or 3 start/stop iterations. Specifically. this does not work: exec.poststop = "/usr/sbin/ngctl shutdown ${ifname1l}:"; Also this new option from Rel.12 does not work either, it just gives a few more iterations: exec.release = "/usr/sbin/ngctl shutdown ${ifname1l}:"; What seems to work is adding a delay: exec.poststop = " sleep 2 ; /usr/sbin/ngctl shutdown ${ifname1l}: ; "; The big question now is: how long should the delay be? This example did run a test with 100 start/stop iterations. But then, on a loaded machine stopping a jail that had been running for a few months, is an entirely different matter: in such a case the jail will spend hours in "dying" state, while in this test the jid became instantly free for restart. In any case, as all this did work flawlessly with Rel. 11.4, there is now something broken in the code, and should be fixed. PMc From owner-freebsd-stable@freebsd.org Mon Dec 7 20:11:38 2020 Return-Path: Delivered-To: freebsd-stable@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id AF3984B4CDF for ; Mon, 7 Dec 2020 20:11:38 +0000 (UTC) (envelope-from kp@FreeBSD.org) Received: from smtp.freebsd.org (smtp.freebsd.org [IPv6:2610:1c1:1:606c::24b:4]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "smtp.freebsd.org", Issuer "Let's Encrypt Authority X3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4CqZG24fvqz3mK9; Mon, 7 Dec 2020 20:11:38 +0000 (UTC) (envelope-from kp@FreeBSD.org) Received: from venus.codepro.be (venus.codepro.be [5.9.86.228]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client CN "mx1.codepro.be", Issuer "Let's Encrypt Authority X3" (verified OK)) (Authenticated sender: kp) by smtp.freebsd.org (Postfix) with ESMTPSA id 7921677D0; Mon, 7 Dec 2020 20:11:38 +0000 (UTC) (envelope-from kp@FreeBSD.org) Received: by venus.codepro.be (Postfix, authenticated sender kp) id B5F5C4AA88; Mon, 7 Dec 2020 21:11:36 +0100 (CET) From: "Kristof Provost" To: Peter Cc: freebsd-stable@freebsd.org Subject: Re: Panic: 12.2 fails to use VIMAGE jails Date: Mon, 07 Dec 2020 21:11:32 +0100 X-Mailer: MailMate (1.13.2r5673) Message-ID: <39DBEA53-960F-4D70-86D7-847E6DFA437D@FreeBSD.org> In-Reply-To: <20201207125451.GA11406@gate.oper.dinoex.org> References: <20201207125451.GA11406@gate.oper.dinoex.org> MIME-Version: 1.0 Content-Type: text/plain; charset="UTF-8"; format=flowed Content-Transfer-Encoding: 8bit X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.34 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 07 Dec 2020 20:11:38 -0000 On 7 Dec 2020, at 13:54, Peter wrote: > After clean upgrade (from source) from 11.4 to 12.2-p1 my jails do > no longer work correctly. > > Old-fashioned jails seem to work, but most are VIMAGE+NETGRAPH style, > and do not work properly. > All did work flawlessly for nearly a year with Rel.11. > > If I start 2-3 jails, and then stop them again, there is always a > panic. > Also reproducible with GENERIC kernel. > > Can this be fixed, or do I need to revert to 11.4? > > The backtrace looks like this: > > #4 0xffffffff810bbadf at trap_pfault+0x4f > #5 0xffffffff810bb23f at trap+0x4cf > #6 0xffffffff810933f8 at calltrap+0x8 > #7 0xffffffff80cdd555 at _if_delgroup_locked+0x465 > #8 0xffffffff80cdbfbe at if_detach_internal+0x24e > #9 0xffffffff80ce305c at if_vmove+0x3c > #10 0xffffffff80ce3010 at vnet_if_return+0x50 > #11 0xffffffff80d0e696 at vnet_destroy+0x136 > #12 0xffffffff80ba781d at prison_deref+0x27d > #13 0xffffffff80c3e38a at taskqueue_run_locked+0x14a > #14 0xffffffff80c3f799 at taskqueue_thread_loop+0xb9 > #15 0xffffffff80b9fd52 at fork_exit+0x82 > #16 0xffffffff8109442e at fork_trampoline+0xe > > This is my typical jail config, designed and tested with Rel.11: > That smells a lot like the epair/vnet issues in bugs 238870, 234985, 244703, 250870. I pushed a fix for that in CURRENT in r368237. It’s scheduled to go into stable/12 sometime next week, but it’d be good to know that it fixes your problem too before I merge it. In other words: can you test a recent CURRENT? It’s likely fixed there, and if it’s not I may be able to fix it quickly. Best regards, Kristof From owner-freebsd-stable@freebsd.org Mon Dec 7 23:45:24 2020 Return-Path: Delivered-To: freebsd-stable@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 14CAD4BA661 for ; Mon, 7 Dec 2020 23:45:24 +0000 (UTC) (envelope-from pmc@citylink.dinoex.sub.org) Received: from uucp.dinoex.sub.de (uucp.dinoex.sub.de [IPv6:2001:1440:5001:1::2]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "uucp.dinoex.sub.de", Issuer "Let's Encrypt Authority X3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4Cqg0g5fR3z4VDv; Mon, 7 Dec 2020 23:45:22 +0000 (UTC) (envelope-from pmc@citylink.dinoex.sub.org) Received: from uucp.dinoex.sub.de (uucp.dinoex.org [185.220.148.12]) by uucp.dinoex.org (8.16.0.50/8.16.0.50) with ESMTPS id 0B7Nj4kL016068 (version=TLSv1.3 cipher=TLS_AES_256_GCM_SHA384 bits=256 verify=NO); Tue, 8 Dec 2020 00:45:05 +0100 (CET) (envelope-from pmc@citylink.dinoex.sub.org) X-Authentication-Warning: uucp.dinoex.sub.de: Host uucp.dinoex.org [185.220.148.12] claimed to be uucp.dinoex.sub.de Received: (from uucp@localhost) by uucp.dinoex.sub.de (8.16.0.50/8.16.0.50/Submit) with UUCP id 0B7Nj4Wn016058; Tue, 8 Dec 2020 00:45:04 +0100 (CET) (envelope-from pmc@citylink.dinoex.sub.org) Received: from gate.oper.dinoex.org (gate-e [192.168.98.2]) by citylink.dinoex.sub.de (8.16.1/8.16.1) with ESMTP id 0B7NbFtc012291; Tue, 8 Dec 2020 00:37:15 +0100 (CET) (envelope-from peter@gate.oper.dinoex.org) Received: from gate.oper.dinoex.org (gate-e [192.168.98.2]) by gate.oper.dinoex.org (8.16.1/8.16.1) with ESMTP id 0B7NYndi011295; Tue, 8 Dec 2020 00:34:50 +0100 (CET) (envelope-from peter@gate.oper.dinoex.org) Received: (from peter@localhost) by gate.oper.dinoex.org (8.16.1/8.16.1/Submit) id 0B7NYnqo011294; Tue, 8 Dec 2020 00:34:49 +0100 (CET) (envelope-from peter) Date: Tue, 8 Dec 2020 00:34:49 +0100 From: Peter Sender: li-fbsd@citylink.dinoex.sub.org To: Kristof Provost Cc: Peter , freebsd-stable@freebsd.org Subject: Re: Panic: 12.2 fails to use VIMAGE jails Message-ID: <20201207233449.GA11025@gate.oper.dinoex.org> References: <20201207125451.GA11406@gate.oper.dinoex.org> <39DBEA53-960F-4D70-86D7-847E6DFA437D@FreeBSD.org> MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Disposition: inline Content-Transfer-Encoding: quoted-printable In-Reply-To: <39DBEA53-960F-4D70-86D7-847E6DFA437D@FreeBSD.org> X-Milter: Spamilter (Reciever: uucp.dinoex.sub.de; Sender-ip: 185.220.148.12; Sender-helo: uucp.dinoex.sub.de; ) X-Greylist: Sender IP whitelisted, not delayed by milter-greylist-4.6.2 (uucp.dinoex.org [185.220.148.12]); Tue, 08 Dec 2020 00:45:07 +0100 (CET) X-Rspamd-Queue-Id: 4Cqg0g5fR3z4VDv X-Spamd-Bar: ---- Authentication-Results: mx1.freebsd.org; none X-Spamd-Result: default: False [-4.00 / 15.00]; REPLY(-4.00)[] X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.34 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 07 Dec 2020 23:45:24 -0000 Hi Kristof, it's great to read You! =20 On Mon, Dec 07, 2020 at 09:11:32PM +0100, Kristof Provost wrote: ! That smells a lot like the epair/vnet issues in bugs 238870, 234985, 2447= 03, ! 250870. epair? No. It is purely Netgraph here. ! I pushed a fix for that in CURRENT in r368237. It=E2=80=99s scheduled to = go into ! stable/12 sometime next week, but it=E2=80=99d be good to know that it fi= xes your ! problem too before I merge it. ! In other words: can you test a recent CURRENT? It=E2=80=99s likely fixed = there, and ! if it=E2=80=99s not I may be able to fix it quickly. Oh my Gods. No offense meant, but this is not really a good time for that. This is the most horrible upgrade I experienced in 25 years FreeBSD (and it was prepared, 12.2 did run fine on the other machine). I have issue with mem config https://forums.freebsd.org/threads/fun-with-upgrading-sysctl-unknown-oid-vm= -pageout_wakeup_thresh.77955/ I have issue with damaged filesystem, for no apparent reason https://forums.freebsd.org/threads/no-longer-fun-with-upgrading-file-offlin= e.77959/ Then I have this issue here which is now gladly workarounded https://forums.freebsd.org/threads/panic-12-2-does-not-work-with-jails.7796= 2/post-486365 and when I then dare to have a look at my applications, they look like sheer horror, segfaults all over, and I don't even know where to begin with these. Other option: can you make this fix so that I can patch it into 12.2 source and just redeploy? I tried to apply the changes from r368237 into my 12.2 source, that seemed to be quite obvious, but it doesn't work; jails fail to remove entirely: # service jail stop rail Stopping jails: rail. # jexec rail jexec: jail "rail" not found -> it works once. # service jail start rail Starting jails: rail. # service jail stop rail Stopping jails: rail. # jexec rail root@rail:/ # ps ax ps: empty file: Invalid argument -> And here it doesn't work anymore, and leaves a skull of a jail one cannot get rid of. Cheerio, PMc From owner-freebsd-stable@freebsd.org Tue Dec 8 15:50:03 2020 Return-Path: Delivered-To: freebsd-stable@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id B4B184A3FBC for ; Tue, 8 Dec 2020 15:50:03 +0000 (UTC) (envelope-from kp@FreeBSD.org) Received: from smtp.freebsd.org (smtp.freebsd.org [96.47.72.83]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "smtp.freebsd.org", Issuer "Let's Encrypt Authority X3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4Cr4Pl3M2Xz4WTg; Tue, 8 Dec 2020 15:50:03 +0000 (UTC) (envelope-from kp@FreeBSD.org) Received: from venus.codepro.be (venus.codepro.be [5.9.86.228]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client CN "mx1.codepro.be", Issuer "Let's Encrypt Authority X3" (verified OK)) (Authenticated sender: kp) by smtp.freebsd.org (Postfix) with ESMTPSA id 4B2A720A49; Tue, 8 Dec 2020 15:50:03 +0000 (UTC) (envelope-from kp@FreeBSD.org) Received: by venus.codepro.be (Postfix, authenticated sender kp) id EC4804C7BB; Tue, 8 Dec 2020 16:50:01 +0100 (CET) From: "Kristof Provost" To: Peter Cc: freebsd-stable@freebsd.org Subject: Re: Panic: 12.2 fails to use VIMAGE jails Date: Tue, 08 Dec 2020 16:50:00 +0100 X-Mailer: MailMate (1.13.2r5673) Message-ID: In-Reply-To: <20201207233449.GA11025@gate.oper.dinoex.org> References: <20201207125451.GA11406@gate.oper.dinoex.org> <39DBEA53-960F-4D70-86D7-847E6DFA437D@FreeBSD.org> <20201207233449.GA11025@gate.oper.dinoex.org> MIME-Version: 1.0 Content-Type: text/plain; charset="UTF-8"; format=flowed Content-Transfer-Encoding: quoted-printable X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.34 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 08 Dec 2020 15:50:03 -0000 On 8 Dec 2020, at 0:34, Peter wrote: > Hi Kristof, > it's great to read You! > > On Mon, Dec 07, 2020 at 09:11:32PM +0100, Kristof Provost wrote: > > ! That smells a lot like the epair/vnet issues in bugs 238870, 234985, = > 244703, > ! 250870. > > epair? No. It is purely Netgrh here. > Yeah, the bug is not exclusive to epair but that=E2=80=99s where it=E2=80= =99s most = easily seen. > ! I pushed a fix for that in CURRENT in r368237. It=E2=80=99s scheduled= to = > go into > ! stable/12 sometime next week, but it=E2=80=99d be good to know that i= t = > fixes your > ! problem too before I merge it. > ! In other words: can you test a recent CURRENT? It=E2=80=99s likely fi= xed = > there, and > ! if it=E2=80=99s not I may be able to fix it quickly. > > > Oh my Gods. No offense meant, but this is not really a good time > for that. This is the most horrible upgrade I experienced in 25 years > FreeBSD (and it was prepared, 12.2 did run fine on the other machine). > > I have issue with mem config > https://forums.freebsd.org/threads/fun-with-upgrading-sysctl-unknown-oi= d-vm-pageout_wakeup_thresh.77955/ > I have issue with damaged filesystem, for no apparent reason > https://forums.freebsd.org/threads/no-longer-fun-with-upgrading-file-of= fline.77959/ > > Then I have this issue here which is now gladly workarounded > https://forums.freebsd.org/threads/panic-12-2-does-not-work-with-jails.= 77962/post-486365 > > and when I then dare to have a look at my applications, they look like > sheer horror, segfaults all over, and I don't even know where to begin > with these. > > > Other option: can you make this fix so that I can patch it into 12.2 > source and just redeploy? > Try = http://people.freebsd.org/~kp/0001-if-Fix-panic-when-destroying-vnet-and-= epair-simultan.patch That=E2=80=99s currently running the regression tests that used to provok= e the = panic nearly instantly, and no panics so far. Best regards. Kristof From owner-freebsd-stable@freebsd.org Tue Dec 8 16:43:16 2020 Return-Path: Delivered-To: freebsd-stable@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 258114A5AE3 for ; Tue, 8 Dec 2020 16:43:16 +0000 (UTC) (envelope-from marcnarc@gmail.com) Received: from mail-qk1-x72a.google.com (mail-qk1-x72a.google.com [IPv6:2607:f8b0:4864:20::72a]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "GTS CA 1O1" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4Cr5b73T4Zz4cjb for ; Tue, 8 Dec 2020 16:43:15 +0000 (UTC) (envelope-from marcnarc@gmail.com) Received: by mail-qk1-x72a.google.com with SMTP id z11so7317628qkj.7 for ; Tue, 08 Dec 2020 08:43:15 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=to:from:subject:message-id:date:user-agent:mime-version :content-language:content-transfer-encoding; bh=YytRdD85C9ManGpAzdLWDM4WgH1h1HGBRz9Jyf9+ES8=; b=dap/CiL/qZWBw5TVqvogBs95ejPXN2mosC7SD1UI6ATGh3BH/U/TFzr28i728tDk4O Z6+bb8N/iJa/TCbfCZVoy/Se5GmRyX/d+fPNzUUbUeWQlkuVrALJC4vHvH3wyXGaxpeq WxnK0agqASTg5qR0SnkweXj2kXb1qH+Wnwgw36RiV0q88uXIpSlwLk/BSxHg6bQKEr6p uUSWhSf0445dBAgLxSPsNf9vkiYoaU0+Qkx0fvLoxqtoDxUdUytWKulI5++IZA/4gHm9 KtaxHj1VYC3FpdRYL5A6KBKWr3Azsu42rRloBI5fKMkfz/BgV3BfHfcWg6jJKV+fA5YB lRcA== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:to:from:subject:message-id:date:user-agent :mime-version:content-language:content-transfer-encoding; bh=YytRdD85C9ManGpAzdLWDM4WgH1h1HGBRz9Jyf9+ES8=; b=hiBoGJUnR5uZ/xUW/07vAgHk2IsllcctlcYfBwIFD4AlfuvSi8j7LIgZzJUDqmNLvB PCz4bROOGOYRPeOq8UGOdyeT/miw0GvT5rg8IHM6YJ9TAAUJFN2kMxGPfnNBbUZ15QjK XECFB35e/VxpZc0aucfwhGEOm7uhLxwejsH8a94GWVwQ46jbEBq0l77GOa4DBwQNx22P lvUqPsXZjIDBia/vXZhJieVkcxdL0XX0GWruNb2T3bLHjoJvyoAeSWy2Vi/MnJdM59NB 5vKy8XZSmB4qbgOwgv5I0kSZ1nTiyvNDEjgmJC23M3fs7bhIR4y73JuMhGZDVkrlCxtr 7S9A== X-Gm-Message-State: AOAM531+wcfE6gvX+XR3QwFd/F+pKm9rL8ndc2RUn8E++ycbmvf0ePRy ag/gxufF4BFpVVsbRNLLAc4= X-Google-Smtp-Source: ABdhPJzvslje8tFAA38RSJZSTzMISnrb5i4SM4fkkabI63iU0NcVIlaYcq7ANLLfyDp+tJP2XM6QZA== X-Received: by 2002:a37:7ac3:: with SMTP id v186mr31198380qkc.75.1607445794548; Tue, 08 Dec 2020 08:43:14 -0800 (PST) Received: from [192.168.222.18] (192-222-183-158.qc.cable.ebox.net. [192.222.183.158]) by smtp.gmail.com with ESMTPSA id d11sm15047489qta.64.2020.12.08.08.43.13 (version=TLS1_3 cipher=TLS_AES_128_GCM_SHA256 bits=128/128); Tue, 08 Dec 2020 08:43:13 -0800 (PST) To: freebsd-stable@freebsd.org From: Marc Branchaud Subject: virtio-9p support in bhyve coming to 12? Message-ID: <98ad1373-d6ea-6433-e64e-768ed630c2b2@gmail.com> Date: Tue, 8 Dec 2020 11:43:12 -0500 User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:78.0) Gecko/20100101 Thunderbird/78.5.0 MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8; format=flowed Content-Language: en-US Content-Transfer-Encoding: 7bit X-Rspamd-Queue-Id: 4Cr5b73T4Zz4cjb X-Spamd-Bar: - Authentication-Results: mx1.freebsd.org; dkim=pass header.d=gmail.com header.s=20161025 header.b=dap/CiL/; dmarc=pass (policy=none) header.from=gmail.com; spf=pass (mx1.freebsd.org: domain of marcnarc@gmail.com designates 2607:f8b0:4864:20::72a as permitted sender) smtp.mailfrom=marcnarc@gmail.com X-Spamd-Result: default: False [-1.00 / 15.00]; RCVD_VIA_SMTP_AUTH(0.00)[]; FREEMAIL_FROM(0.00)[gmail.com]; R_SPF_ALLOW(-0.20)[+ip6:2607:f8b0:4000::/36]; TO_DN_NONE(0.00)[]; RCVD_COUNT_THREE(0.00)[3]; DKIM_TRACE(0.00)[gmail.com:+]; DMARC_POLICY_ALLOW(-0.50)[gmail.com,none]; FROM_EQ_ENVFROM(0.00)[]; SUBJECT_ENDS_QUESTION(1.00)[]; MIME_TRACE(0.00)[0:+]; FREEMAIL_ENVFROM(0.00)[gmail.com]; MID_RHS_MATCH_FROM(0.00)[]; RBL_DBL_DONT_QUERY_IPS(0.00)[2607:f8b0:4864:20::72a:from]; ASN(0.00)[asn:15169, ipnet:2607:f8b0::/32, country:US]; DWL_DNSWL_NONE(0.00)[gmail.com:dkim]; ARC_NA(0.00)[]; R_DKIM_ALLOW(-0.20)[gmail.com:s=20161025]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; FROM_HAS_DN(0.00)[]; TO_MATCH_ENVRCPT_ALL(0.00)[]; NEURAL_HAM_LONG(-1.00)[-1.000]; MIME_GOOD(-0.10)[text/plain]; PREVIOUSLY_DELIVERED(0.00)[freebsd-stable@freebsd.org]; RCPT_COUNT_ONE(0.00)[1]; SPAMHAUS_ZRD(0.00)[2607:f8b0:4864:20::72a:from:127.0.2.255]; NEURAL_SPAM_SHORT(1.00)[1.000]; RCVD_IN_DNSWL_NONE(0.00)[2607:f8b0:4864:20::72a:from]; RCVD_TLS_ALL(0.00)[]; MAILMAN_DEST(0.00)[freebsd-stable] X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.34 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 08 Dec 2020 16:43:16 -0000 Hi all, Any chance of the virtio-9p support in bhyve (to mount a host directory directly inside a VM) landing in 12.3? I ask mainly because r366413 from October says "MFC after: 1 month" (and I'd like to avoid setting up local NFS shares if I can help it). Thanks! M. From owner-freebsd-stable@freebsd.org Tue Dec 8 19:00:20 2020 Return-Path: Delivered-To: freebsd-stable@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id A0EF04A93CB for ; Tue, 8 Dec 2020 19:00:20 +0000 (UTC) (envelope-from pmc@citylink.dinoex.sub.org) Received: from uucp.dinoex.sub.de (uucp.dinoex.sub.de [IPv6:2001:1440:5001:1::2]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "uucp.dinoex.sub.de", Issuer "Let's Encrypt Authority X3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4Cr8dJ2RvSz4msr; Tue, 8 Dec 2020 19:00:19 +0000 (UTC) (envelope-from pmc@citylink.dinoex.sub.org) Received: from uucp.dinoex.sub.de (uucp.dinoex.org [185.220.148.12]) by uucp.dinoex.org (8.16.0.50/8.16.0.50) with ESMTPS id 0B8J04Rw024394 (version=TLSv1.3 cipher=TLS_AES_256_GCM_SHA384 bits=256 verify=NO); Tue, 8 Dec 2020 20:00:05 +0100 (CET) (envelope-from pmc@citylink.dinoex.sub.org) X-Authentication-Warning: uucp.dinoex.sub.de: Host uucp.dinoex.org [185.220.148.12] claimed to be uucp.dinoex.sub.de Received: (from uucp@localhost) by uucp.dinoex.sub.de (8.16.0.50/8.16.0.50/Submit) with UUCP id 0B8J04KB024392; Tue, 8 Dec 2020 20:00:04 +0100 (CET) (envelope-from pmc@citylink.dinoex.sub.org) Received: from gate.oper.dinoex.org (gate-e [192.168.98.2]) by citylink.dinoex.sub.de (8.16.1/8.16.1) with ESMTP id 0B8IpnNQ021187; Tue, 8 Dec 2020 19:51:49 +0100 (CET) (envelope-from peter@gate.oper.dinoex.org) Received: from gate.oper.dinoex.org (gate-e [192.168.98.2]) by gate.oper.dinoex.org (8.16.1/8.16.1) with ESMTP id 0B8InJuQ020755; Tue, 8 Dec 2020 19:49:20 +0100 (CET) (envelope-from peter@gate.oper.dinoex.org) Received: (from peter@localhost) by gate.oper.dinoex.org (8.16.1/8.16.1/Submit) id 0B8InJ2l020754; Tue, 8 Dec 2020 19:49:19 +0100 (CET) (envelope-from peter) Date: Tue, 8 Dec 2020 19:49:19 +0100 From: Peter Sender: li-fbsd@citylink.dinoex.sub.org To: Kristof Provost Cc: freebsd-stable@freebsd.org Subject: Re: Panic: 12.2 fails to use VIMAGE jails Message-ID: References: <20201207125451.GA11406@gate.oper.dinoex.org> <39DBEA53-960F-4D70-86D7-847E6DFA437D@FreeBSD.org> <20201207233449.GA11025@gate.oper.dinoex.org> MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Disposition: inline Content-Transfer-Encoding: quoted-printable In-Reply-To: X-Milter: Spamilter (Reciever: uucp.dinoex.sub.de; Sender-ip: 185.220.148.12; Sender-helo: uucp.dinoex.sub.de; ) X-Greylist: Sender IP whitelisted, not delayed by milter-greylist-4.6.2 (uucp.dinoex.org [185.220.148.12]); Tue, 08 Dec 2020 20:00:08 +0100 (CET) X-Rspamd-Queue-Id: 4Cr8dJ2RvSz4msr X-Spamd-Bar: ---- Authentication-Results: mx1.freebsd.org; none X-Spamd-Result: default: False [-4.00 / 15.00]; REPLY(-4.00)[] X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.34 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 08 Dec 2020 19:00:20 -0000 On Tue, Dec 08, 2020 at 04:50:00PM +0100, Kristof Provost wrote: ! Yeah, the bug is not exclusive to epair but that=E2=80=99s where it=E2=80= =99s most easily ! seen. Ack. ! Try http://people.freebsd.org/~kp/0001-if-Fix-panic-when-destroying-vnet-= and-epair-simultan.patch Great, thanks a lot. Now I have bad news: when playing yoyo with the next-best three application jails (with all their installed stuff) it took about ten up and down's then I got this one: Fatal trap 12: page fault while in kernel mode cpuid =3D 1; apic id =3D 02 fault virtual address =3D 0x10 fault code =3D supervisor read data, page not present instruction pointer =3D 0x20:0xffffffff80aad73c stack pointer =3D 0x28:0xfffffe003f80e810 frame pointer =3D 0x28:0xfffffe003f80e810 code segment =3D base 0x0, limit 0xfffff, type 0x1b =3D DPL 0, pres 1, long 1, def32 0, gran 1 processor eflags =3D interrupt enabled, resume, IOPL =3D 0 current process =3D 15486 (ifconfig) trap number =3D 12 panic: page fault cpuid =3D 1 time =3D 1607450838 KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe003f80e= 4d0 vpanic() at vpanic+0x17b/frame 0xfffffe003f80e520 panic() at panic+0x43/frame 0xfffffe003f80e580 trap_fatal() at trap_fatal+0x391/frame 0xfffffe003f80e5e0 trap_pfault() at trap_pfault+0x4f/frame 0xfffffe003f80e630 trap() at trap+0x4cf/frame 0xfffffe003f80e740 calltrap() at calltrap+0x8/frame 0xfffffe003f80e740 --- trap 0xc, rip =3D 0xffffffff80aad73c, rsp =3D 0xfffffe003f80e810, rbp = =3D 0xfffffe003f80e810 --- ng_eiface_mediastatus() at ng_eiface_mediastatus+0xc/frame 0xfffffe003f80e8= 10 ifmedia_ioctl() at ifmedia_ioctl+0x174/frame 0xfffffe003f80e850 ifhwioctl() at ifhwioctl+0x639/frame 0xfffffe003f80e8d0 ifioctl() at ifioctl+0x448/frame 0xfffffe003f80e990 kern_ioctl() at kern_ioctl+0x275/frame 0xfffffe003f80e9f0 sys_ioctl() at sys_ioctl+0x101/frame 0xfffffe003f80eac0 amd64_syscall() at amd64_syscall+0x380/frame 0xfffffe003f80ebf0 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe003f80ebf0 --- syscall (54, FreeBSD ELF64, sys_ioctl), rip =3D 0x800475b2a, rsp =3D 0x= 7fffffffe358, rbp =3D 0x7fffffffe450 --- Uptime: 9m51s Dumping 899 out of 3959 MB: I decided to give it a second try, and this is what I did: root@edge:/var/crash # jls JID IP Address Hostname Path 1 1*********** gate.***********.org /j/gate 3 1*********** raix.***********.org /j/raix 4 oper.***********.org /j/oper 5 admn.***********.org /j/admn 6 data.***********.org /j/data 7 conn.***********.org /j/conn 8 kerb.***********.org /j/kerb 9 tele.***********.org /j/tele 10 rail.***********.org /j/rail root@edge:/var/crash # service jail stop rail Stopping jails: rail. root@edge:/var/crash # service jail stop tele Stopping jails: tele. root@edge:/var/crash # service jail stop kerb Stopping jails: kerb. root@edge:/var/crash # jls JID IP Address Hostname Path 1 1*********** gate.***********.org /j/gate 3 1*********** raix.***********.org /j/raix 4 oper.***********.org /j/oper 5 admn.***********.org /j/admn 6 data.***********.org /j/data 7 conn.***********.org /j/conn root@edge:/var/crash # jls -d JID IP Address Hostname Path 1 1*********** gate.***********.org /j/gate 3 1*********** raix.***********.org /j/raix 4 oper.***********.org /j/oper 5 admn.***********.org /j/admn 6 data.***********.org /j/data 7 conn.***********.org /j/conn 9 tele.***********.org /j/tele 10 rail.***********.org /j/rail root@edge:/var/crash # service jail start kerb Starting jails:Fssh_packet_write_wait: Connection to 1*********** port 22: = Broken pipe Fatal trap 12: page fault while in kernel mode cpuid =3D 1; apic id =3D 02 fault virtual address =3D 0x0 fault code =3D supervisor read instruction, page not present instruction pointer =3D 0x20:0x0 stack pointer =3D 0x28:0xfffffe00540ea658 frame pointer =3D 0x28:0xfffffe00540ea670 code segment =3D base 0x0, limit 0xfffff, type 0x1b =3D DPL 0, pres 1, long 1, def32 0, gran 1 processor eflags =3D interrupt enabled, resume, IOPL =3D 0 current process =3D 13420 (ifconfig) trap number =3D 12 panic: page fault cpuid =3D 1 time =3D 1607451910 KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe00540ea= 310 vpanic() at vpanic+0x17b/frame 0xfffffe00540ea360 panic() at panic+0x43/frame 0xfffffe00540ea3c0 trap_fatal() at trap_fatal+0x391/frame 0xfffffe00540ea420 trap_pfault() at trap_pfault+0x4f/frame 0xfffffe00540ea470 trap() at trap+0x4cf/frame 0xfffffe00540ea580 calltrap() at calltrap+0x8/frame 0xfffffe00540ea580 --- trap 0xc, rip =3D 0, rsp =3D 0xfffffe00540ea658, rbp =3D 0xfffffe00540e= a670 --- ??() at 0/frame 0xfffffe00540ea670 sysctl_rtsock() at sysctl_rtsock+0x3d5/frame 0xfffffe00540ea8a0 sysctl_root_handler_locked() at sysctl_root_handler_locked+0x90/frame 0xfff= ffe00540ea8e0 sysctl_root() at sysctl_root+0x248/frame 0xfffffe00540ea960 userland_sysctl() at userland_sysctl+0x178/frame 0xfffffe00540eaa10 sys___sysctl() at sys___sysctl+0x5f/frame 0xfffffe00540eaac0 amd64_syscall() at amd64_syscall+0x380/frame 0xfffffe00540eabf0 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe00540eabf0 --- syscall (202, FreeBSD ELF64, sys___sysctl), rip =3D 0x80047646a, rsp = =3D 0x7fffffffe378, rbp =3D 0x7fffffffe3b0 --- Uptime: 16m48s Dumping 938 out of 3959 MB: Sorry for the bad news. cheerio & best regards PMc From owner-freebsd-stable@freebsd.org Tue Dec 8 19:02:49 2020 Return-Path: Delivered-To: freebsd-stable@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 7B2034A95D1 for ; Tue, 8 Dec 2020 19:02:49 +0000 (UTC) (envelope-from kp@FreeBSD.org) Received: from smtp.freebsd.org (smtp.freebsd.org [IPv6:2610:1c1:1:606c::24b:4]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "smtp.freebsd.org", Issuer "Let's Encrypt Authority X3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4Cr8h938gBz4n12; Tue, 8 Dec 2020 19:02:49 +0000 (UTC) (envelope-from kp@FreeBSD.org) Received: from venus.codepro.be (venus.codepro.be [5.9.86.228]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client CN "mx1.codepro.be", Issuer "Let's Encrypt Authority X3" (verified OK)) (Authenticated sender: kp) by smtp.freebsd.org (Postfix) with ESMTPSA id 34FA22218E; Tue, 8 Dec 2020 19:02:49 +0000 (UTC) (envelope-from kp@FreeBSD.org) Received: by venus.codepro.be (Postfix, authenticated sender kp) id D656A4CC4D; Tue, 8 Dec 2020 20:02:47 +0100 (CET) From: "Kristof Provost" To: Peter Cc: freebsd-stable@freebsd.org Subject: Re: Panic: 12.2 fails to use VIMAGE jails Date: Tue, 08 Dec 2020 20:02:47 +0100 X-Mailer: MailMate (1.13.2r5673) Message-ID: <1AAE98C9-ADF9-4869-B863-601542CEBB67@FreeBSD.org> In-Reply-To: References: <20201207125451.GA11406@gate.oper.dinoex.org> <39DBEA53-960F-4D70-86D7-847E6DFA437D@FreeBSD.org> <20201207233449.GA11025@gate.oper.dinoex.org> MIME-Version: 1.0 Content-Type: text/plain; charset="UTF-8"; format=flowed Content-Transfer-Encoding: quoted-printable X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.34 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 08 Dec 2020 19:02:49 -0000 On 8 Dec 2020, at 19:49, Peter wrote: > On Tue, Dec 08, 2020 at 04:50:00PM +0100, Kristof Provost wrote: > ! Yeah, the bug is not exclusive to epair but that=E2=80=99s where it=E2= =80=99s = > most easily > ! seen. > > Ack. > > ! Try = > http://people.freebsd.org/~kp/0001-if-Fix-panic-when-destroying-vnet-an= d-epair-simultan.patch > > Great, thanks a lot. > > Now I have bad news: when playing yoyo with the next-best three > application jails (with all their installed stuff) it took about > ten up and down's then I got this one: > > Fatal trap 12: page fault while in kernel mode > cpuid =3D 1; apic id =3D 02 > fault virtual address =3D 0x10 > fault code =3D supervisor read data, page not present > instruction pointer =3D 0x20:0xffffffff80aad73c > stack pointer =3D 0x28:0xfffffe003f80e810 > frame pointer =3D 0x28:0xfffffe003f80e810 > code segment =3D base 0x0, limit 0xfffff, type 0x1b > =3D DPL 0, pres 1, long 1, def32 0, gran 1 > processor eflags =3D interrupt enabled, resume, IOPL =3D 0 > current process =3D 15486 (ifconfig) > trap number =3D 12 > panic: page fault > cpuid =3D 1 > time =3D 1607450838 > KDB: stack backtrace: > db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame = > 0xfffffe003f80e4d0 > vpanic() at vpanic+0x17b/frame 0xfffffe003f80e520 > panic() at panic+0x43/frame 0xfffffe003f80e580 > trap_fatal() at trap_fatal+0x391/frame 0xfffffe003f80e5e0 > trap_pfault() at trap_pfault+0x4f/frame 0xfffffe003f80e630 > trap() at trap+0x4cf/frame 0xfffffe003f80e740 > calltrap() at calltrap+0x8/frame 0xfffffe003f80e740 > --- trap 0xc, rip =3D 0xffffffff80aad73c, rsp =3D 0xfffffe003f80e810, r= bp = > =3D 0xfffffe003f80e810 --- > ng_eiface_mediastatus() at ng_eiface_mediastatus+0xc/frame = > 0xfffffe003f80e810 > ifmedia_ioctl() at ifmedia_ioctl+0x174/frame 0xfffffe003f80e850 > ifhwioctl() at ifhwioctl+0x639/frame 0xfffffe003f80e8d0 > ifioctl() at ifioctl+0x448/frame 0xfffffe003f80e990 > kern_ioctl() at kern_ioctl+0x275/frame 0xfffffe003f80e9f0 > sys_ioctl() at sys_ioctl+0x101/frame 0xfffffe003f80eac0 > amd64_syscall() at amd64_syscall+0x380/frame 0xfffffe003f80ebf0 > fast_syscall_common() at fast_syscall_common+0xf8/frame = > 0xfffffe003f80ebf0 > --- syscall (54, FreeBSD ELF64, sys_ioctl), rip =3D 0x800475b2a, rsp =3D= = > 0x7fffffffe358, rbp =3D 0x7fffffffe450 --- > Uptime: 9m51s > Dumping 899 out of 3959 MB: > > I decided to give it a second try, and this is what I did: > > root@edge:/var/crash # jls > JID IP Address Hostname Path > 1 1*********** gate.***********.org /j/gate > 3 1*********** raix.***********.org /j/raix > 4 oper.***********.org /j/oper > 5 admn.***********.org /j/admn > 6 data.***********.org /j/data > 7 conn.***********.org /j/conn > 8 kerb.***********.org /j/kerb > 9 tele.***********.org /j/tele > 10 rail.***********.org /j/rail > root@edge:/var/crash # service jail stop rail > Stopping jails: rail. > root@edge:/var/crash # service jail stop tele > Stopping jails: tele. > root@edge:/var/crash # service jail stop kerb > Stopping jails: kerb. > root@edge:/var/crash # jls > JID IP Address Hostname Path > 1 1*********** gate.***********.org /j/gate > 3 1*********** raix.***********.org /j/raix > 4 oper.***********.org /j/oper > 5 admn.***********.org /j/admn > 6 data.***********.org /j/data > 7 conn.***********.org /j/conn > root@edge:/var/crash # jls -d > JID IP Address Hostname Path > 1 1*********** gate.***********.org /j/gate > 3 1*********** raix.***********.org /j/raix > 4 oper.***********.org /j/oper > 5 admn.***********.org /j/admn > 6 data.***********.org /j/data > 7 conn.***********.org /j/conn > 9 tele.***********.org /j/tele > 10 rail.***********.org /j/rail > root@edge:/var/crash # service jail start kerb > Starting jails:Fssh_packet_write_wait: Connection to 1*********** port = > 22: Broken pipe > > Fatal trap 12: page fault while in kernel mode > cpuid =3D 1; apic id =3D 02 > fault virtual address =3D 0x0 > fault code =3D supervisor read instruction, page not = > present > instruction pointer =3D 0x20:0x0 > stack pointer =3D 0x28:0xfffffe00540ea658 > frame pointer =3D 0x28:0xfffffe00540ea670 > code segment =3D base 0x0, limit 0xfffff, type 0x1b > =3D DPL 0, pres 1, long 1, def32 0, gran 1 > processor eflags =3D interrupt enabled, resume, IOPL =3D 0 > current process =3D 13420 (ifconfig) > trap number =3D 12 > panic: page fault > cpuid =3D 1 > time =3D 1607451910 > KDB: stack backtrace: > db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame = > 0xfffffe00540ea310 > vpanic() at vpanic+0x17b/frame 0xfffffe00540ea360 > panic() at panic+0x43/frame 0xfffffe00540ea3c0 > trap_fatal() at trap_fatal+0x391/frame 0xfffffe00540ea420 > trap_pfault() at trap_pfault+0x4f/frame 0xfffffe00540ea470 > trap() at trap+0x4cf/frame 0xfffffe00540ea580 > calltrap() at calltrap+0x8/frame 0xfffffe00540ea580 > --- trap 0xc, rip =3D 0, rsp =3D 0xfffffe00540ea658, rbp =3D = > 0xfffffe00540ea670 --- > ??() at 0/frame 0xfffffe00540ea670 > sysctl_rtsock() at sysctl_rtsock+0x3d5/frame 0xfffffe00540ea8a0 > sysctl_root_handler_locked() at sysctl_root_handler_locked+0x90/frame = > 0xfffffe00540ea8e0 > sysctl_root() at sysctl_root+0x248/frame 0xfffffe00540ea960 > userland_sysctl() at userland_sysctl+0x178/frame 0xfffffe00540eaa10 > sys___sysctl() at sys___sysctl+0x5f/frame 0xfffffe00540eaac0 > amd64_syscall() at amd64_syscall+0x380/frame 0xfffffe00540eabf0 > fast_syscall_common() at fast_syscall_common+0xf8/frame = > 0xfffffe00540eabf0 > --- syscall (202, FreeBSD ELF64, sys___sysctl), rip =3D 0x80047646a, rs= p = > =3D 0x7fffffffe378, rbp =3D 0x7fffffffe3b0 --- > Uptime: 16m48s > Dumping 938 out of 3959 MB: > > > Sorry for the bad news. > You appear to be triggering two or three different bugs there. Can you reduce your netgraph use case to a small test case that can = trigger the problem? I=E2=80=99m not likely to be able to do anything unl= ess I = can reproduce the problem(s). Best regards, Kristof From owner-freebsd-stable@freebsd.org Wed Dec 9 00:09:22 2020 Return-Path: Delivered-To: freebsd-stable@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 248814AFAD6 for ; Wed, 9 Dec 2020 00:09:22 +0000 (UTC) (envelope-from pmc@citylink.dinoex.sub.org) Received: from uucp.dinoex.sub.de (uucp.dinoex.sub.de [IPv6:2001:1440:5001:1::2]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "uucp.dinoex.sub.de", Issuer "Let's Encrypt Authority X3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4CrHTs6BnQz3LSc; Wed, 9 Dec 2020 00:09:20 +0000 (UTC) (envelope-from pmc@citylink.dinoex.sub.org) Received: from uucp.dinoex.sub.de (uucp.dinoex.org [185.220.148.12]) by uucp.dinoex.org (8.16.0.50/8.16.0.50) with ESMTPS id 0B9094Kg067148 (version=TLSv1.3 cipher=TLS_AES_256_GCM_SHA384 bits=256 verify=NO); Wed, 9 Dec 2020 01:09:05 +0100 (CET) (envelope-from pmc@citylink.dinoex.sub.org) X-Authentication-Warning: uucp.dinoex.sub.de: Host uucp.dinoex.org [185.220.148.12] claimed to be uucp.dinoex.sub.de Received: (from uucp@localhost) by uucp.dinoex.sub.de (8.16.0.50/8.16.0.50/Submit) with UUCP id 0B9094mf067147; Wed, 9 Dec 2020 01:09:04 +0100 (CET) (envelope-from pmc@citylink.dinoex.sub.org) Received: from gate.oper.dinoex.org (gate-e [192.168.98.2]) by citylink.dinoex.sub.de (8.16.1/8.16.1) with ESMTP id 0B8NwJo3013165; Wed, 9 Dec 2020 00:58:19 +0100 (CET) (envelope-from peter@gate.oper.dinoex.org) Received: from gate.oper.dinoex.org (gate-e [192.168.98.2]) by gate.oper.dinoex.org (8.16.1/8.16.1) with ESMTP id 0B8Nw7fP012819; Wed, 9 Dec 2020 00:58:07 +0100 (CET) (envelope-from peter@gate.oper.dinoex.org) Received: (from peter@localhost) by gate.oper.dinoex.org (8.16.1/8.16.1/Submit) id 0B8Nw7fE012818; Wed, 9 Dec 2020 00:58:07 +0100 (CET) (envelope-from peter) Date: Wed, 9 Dec 2020 00:58:07 +0100 From: Peter Sender: li-fbsd@citylink.dinoex.sub.org To: Kristof Provost Cc: freebsd-stable@freebsd.org Subject: Re: Panic: 12.2 fails to use VIMAGE jails Message-ID: References: <20201207125451.GA11406@gate.oper.dinoex.org> <39DBEA53-960F-4D70-86D7-847E6DFA437D@FreeBSD.org> <20201207233449.GA11025@gate.oper.dinoex.org> MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: X-Milter: Spamilter (Reciever: uucp.dinoex.sub.de; Sender-ip: 185.220.148.12; Sender-helo: uucp.dinoex.sub.de; ) X-Greylist: Sender IP whitelisted, not delayed by milter-greylist-4.6.2 (uucp.dinoex.org [185.220.148.12]); Wed, 09 Dec 2020 01:09:07 +0100 (CET) X-Rspamd-Queue-Id: 4CrHTs6BnQz3LSc X-Spamd-Bar: ---- Authentication-Results: mx1.freebsd.org; none X-Spamd-Result: default: False [-4.00 / 15.00]; REPLY(-4.00)[] X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.34 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 09 Dec 2020 00:09:22 -0000 Here is the next funny crashdump - I obtained this one twice and also the sysctl_rtsock() again. I can reproduce this by just starting and stopping a most simple jail that does only exec.start = "/bin/sleep 4 &"; (And as usual, when I let it time out, nothing bad happens.) Fatal trap 9: general protection fault while in kernel mode cpuid = 1; apic id = 02 instruction pointer = 0x20:0xffffffff80a2ac45 stack pointer = 0x28:0xfffffe0047cf2890 frame pointer = 0x28:0xfffffe0047cf2890 code segment = base 0x0, limit 0xfffff, type 0x1b = DPL 0, pres 1, long 1, def32 0, gran 1 processor eflags = interrupt enabled, resume, IOPL = 0 current process = 13557 (ifconfig) trap number = 9 panic: general protection fault cpuid = 1 time = 1607469295 KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe0047cf25a0 vpanic() at vpanic+0x17b/frame 0xfffffe0047cf25f0 panic() at panic+0x43/frame 0xfffffe0047cf2650 trap_fatal() at trap_fatal+0x391/frame 0xfffffe0047cf26b0 trap() at trap+0x67/frame 0xfffffe0047cf27c0 calltrap() at calltrap+0x8/frame 0xfffffe0047cf27c0 --- trap 0x9, rip = 0xffffffff80a2ac45, rsp = 0xfffffe0047cf2890, rbp = 0xfffffe0047cf2890 --- strncmp() at strncmp+0x15/frame 0xfffffe0047cf2890 ifunit_ref() at ifunit_ref+0x59/frame 0xfffffe0047cf28d0 ifioctl() at ifioctl+0x427/frame 0xfffffe0047cf2990 kern_ioctl() at kern_ioctl+0x275/frame 0xfffffe0047cf29f0 sys_ioctl() at sys_ioctl+0x101/frame 0xfffffe0047cf2ac0 amd64_syscall() at amd64_syscall+0x380/frame 0xfffffe0047cf2bf0 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe0047cf2bf0 --- syscall (54, FreeBSD ELF64, sys_ioctl), rip = 0x800475b2a, rsp = 0x7fffffffe3b8, rbp = 0x7fffffffe450 --- Uptime: 8m54s Dumping 880 out of 3959 MB: From owner-freebsd-stable@freebsd.org Wed Dec 9 01:45:15 2020 Return-Path: Delivered-To: freebsd-stable@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 04D604B24FC for ; Wed, 9 Dec 2020 01:45:15 +0000 (UTC) (envelope-from raul.munoz@custos.es) Received: from mail3.custos.es (mail3.custos.es [5.2.90.130]) by mx1.freebsd.org (Postfix) with ESMTP id 4CrKcT67tQz3hN7 for ; Wed, 9 Dec 2020 01:45:13 +0000 (UTC) (envelope-from raul.munoz@custos.es) Received: from plank.b2n.org (plank.b2n.org [185.150.100.31]) by mail3.custos.es (Postfix) with ESMTP id B80A6125F1B for ; Wed, 9 Dec 2020 02:45:06 +0100 (CET) Received: from [10.1.2.113] (183.190.94.90.dynamic.jazztel.es [90.94.190.183]) by plank.b2n.org (Postfix) with ESMTPSA id 6BCE28E49 for ; Wed, 9 Dec 2020 02:45:05 +0100 (CET) To: freebsd-stable@freebsd.org From: =?UTF-8?B?UmHDumwgTXXDsW96IC0gQ1VTVE9T?= Subject: 'ifconfig lagg0.300 create' fails with 'SIOIFCREATE2: Device not configured' on r368459 Message-ID: <932bc19b-40d2-f8a9-59e1-a22809ec3ae6@custos.es> Date: Wed, 9 Dec 2020 02:45:04 +0100 User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:78.0) Gecko/20100101 Thunderbird/78.4.3 MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Language: en-US Content-Transfer-Encoding: 8bit X-Rspamd-Queue-Id: 4CrKcT67tQz3hN7 X-Spamd-Bar: -- X-Spamd-Result: default: False [-2.69 / 15.00]; RCVD_VIA_SMTP_AUTH(0.00)[]; R_SPF_ALLOW(-0.20)[+ip4:5.2.90.130]; TO_DN_NONE(0.00)[]; RCVD_COUNT_THREE(0.00)[3]; DKIM_TRACE(0.00)[custos.es:+]; NEURAL_HAM_SHORT(-1.00)[-1.000]; RCVD_NO_TLS_LAST(0.10)[]; FROM_EQ_ENVFROM(0.00)[]; MIME_TRACE(0.00)[0:+]; RBL_DBL_DONT_QUERY_IPS(0.00)[5.2.90.130:from]; R_MIXED_CHARSET(0.71)[subject]; ASN(0.00)[asn:198432, ipnet:5.2.90.0/24, country:ES]; MID_RHS_MATCH_FROM(0.00)[]; RECEIVED_SPAMHAUS_PBL(0.00)[90.94.190.183:received]; ARC_NA(0.00)[]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; R_DKIM_ALLOW(-0.20)[custos.es:s=dkim]; FROM_HAS_DN(0.00)[]; TO_MATCH_ENVRCPT_ALL(0.00)[]; NEURAL_HAM_LONG(-1.00)[-1.000]; MIME_GOOD(-0.10)[text/plain]; PREVIOUSLY_DELIVERED(0.00)[freebsd-stable@freebsd.org]; DMARC_NA(0.00)[custos.es]; RCPT_COUNT_ONE(0.00)[1]; SPAMHAUS_ZRD(0.00)[5.2.90.130:from:127.0.2.255]; MAILMAN_DEST(0.00)[freebsd-stable] X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.34 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 09 Dec 2020 01:45:15 -0000 But works on r368184 no problem on regular, not aggregated interfaces can anyone give it a try? maybe related to: https://svnweb.freebsd.org/base?view=revision&revision=368346 From owner-freebsd-stable@freebsd.org Wed Dec 9 01:45:24 2020 Return-Path: Delivered-To: freebsd-stable@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 7A6FE4B254A for ; Wed, 9 Dec 2020 01:45:24 +0000 (UTC) (envelope-from pmc@citylink.dinoex.sub.org) Received: from uucp.dinoex.sub.de (uucp.dinoex.sub.de [IPv6:2001:1440:5001:1::2]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "uucp.dinoex.sub.de", Issuer "Let's Encrypt Authority X3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4CrKch1Ycyz3hfv; Wed, 9 Dec 2020 01:45:23 +0000 (UTC) (envelope-from pmc@citylink.dinoex.sub.org) Received: from uucp.dinoex.sub.de (uucp.dinoex.org [185.220.148.12]) by uucp.dinoex.org (8.16.0.50/8.16.0.50) with ESMTPS id 0B91j4g1039246 (version=TLSv1.3 cipher=TLS_AES_256_GCM_SHA384 bits=256 verify=NO); Wed, 9 Dec 2020 02:45:05 +0100 (CET) (envelope-from pmc@citylink.dinoex.sub.org) X-Authentication-Warning: uucp.dinoex.sub.de: Host uucp.dinoex.org [185.220.148.12] claimed to be uucp.dinoex.sub.de Received: (from uucp@localhost) by uucp.dinoex.sub.de (8.16.0.50/8.16.0.50/Submit) with UUCP id 0B91j4Xt039243; Wed, 9 Dec 2020 02:45:04 +0100 (CET) (envelope-from pmc@citylink.dinoex.sub.org) Received: from gate.oper.dinoex.org (gate-e [192.168.98.2]) by citylink.dinoex.sub.de (8.16.1/8.16.1) with ESMTP id 0B91YKni035114; Wed, 9 Dec 2020 02:34:20 +0100 (CET) (envelope-from peter@gate.oper.dinoex.org) Received: from gate.oper.dinoex.org (gate-e [192.168.98.2]) by gate.oper.dinoex.org (8.16.1/8.16.1) with ESMTP id 0B91VaK4034715; Wed, 9 Dec 2020 02:31:37 +0100 (CET) (envelope-from peter@gate.oper.dinoex.org) Received: (from peter@localhost) by gate.oper.dinoex.org (8.16.1/8.16.1/Submit) id 0B91VaoZ034714; Wed, 9 Dec 2020 02:31:36 +0100 (CET) (envelope-from peter) Date: Wed, 9 Dec 2020 02:31:36 +0100 From: Peter Sender: li-fbsd@citylink.dinoex.sub.org To: Kristof Provost Cc: freebsd-stable@freebsd.org Subject: Re: Panic: 12.2 fails to use VIMAGE jails Message-ID: References: <20201207125451.GA11406@gate.oper.dinoex.org> <39DBEA53-960F-4D70-86D7-847E6DFA437D@FreeBSD.org> <20201207233449.GA11025@gate.oper.dinoex.org> <1AAE98C9-ADF9-4869-B863-601542CEBB67@FreeBSD.org> MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Disposition: inline Content-Transfer-Encoding: quoted-printable In-Reply-To: <1AAE98C9-ADF9-4869-B863-601542CEBB67@FreeBSD.org> X-Milter: Spamilter (Reciever: uucp.dinoex.sub.de; Sender-ip: 185.220.148.12; Sender-helo: uucp.dinoex.sub.de; ) X-Greylist: Sender IP whitelisted, not delayed by milter-greylist-4.6.2 (uucp.dinoex.org [185.220.148.12]); Wed, 09 Dec 2020 02:45:08 +0100 (CET) X-Rspamd-Queue-Id: 4CrKch1Ycyz3hfv X-Spamd-Bar: ---- Authentication-Results: mx1.freebsd.org; none X-Spamd-Result: default: False [-4.00 / 15.00]; REPLY(-4.00)[] X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.34 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 09 Dec 2020 01:45:24 -0000 On Tue, Dec 08, 2020 at 08:02:47PM +0100, Kristof Provost wrote: ! > Sorry for the bad news. ! >=20 ! You appear to be triggering two or three different bugs there. That is possible. Then there are two or three different bugs in the production code. In any case, my current workaround, i.e. delaying in the exec.poststop > exec.poststop =3D " > sleep 6 ; > /usr/sbin/ngctl shutdown ${ifname1l}: ; > "; helps for it all and makes the system behave solid. This is true with and without Your patch. ! Can you reduce your netgraph use case to a small test case that can trigg= er ! the problem? I'm sorry, I fear I don't get Your point. Assumed there are actually two or three bugs here, You are asking me to reduce config so that it will trigger only one of them? Is that correct? Then let me put this different: assuming this is the OS for the life support system of the manned Jupiter mission. Then, which one of the bugs do You want to get fixed, and which would You prefer to keep and make Your oxygen supply cut off? https://www.youtube.com/watch?v=3DBEo2g-w545A ! I=E2=80=99m not likely to be able to do anything unless I can reproduce ! the problem(s). I understand that. =46rom Your former mail I get the impression that you prefer to rely on tests. I consider this a bad habit[1] and prefer logical thinking. So lets try that: We know that there is a problem with taking down an interface from a VIMAGE, in the way it is done by "jail -r". We know this problem can be solidly workarounded by delaying the interface takedown for a short time. Now with Your patch, we do not get the typical crash at interface takedown. Instead, all of a sudden, there are strange crashes from various other places. And, interestingly, we get these also when STARTING a jail. I think this is not an additional problem, it is instead a valuable information (albeit not the one You might like to get). Furthermore, we get these new crashes always invoked by "ifconfig", and they seem to have in common that somebody tries to obtain information about some interface configuration and receives some bogus. I might conclude, just out of the belly without looking into details, that either - your patch achieves to garble some internal interface data, instead of what it is intended to do, or - the original problem manages to garble internal interface data (leading to the usual crash), and Your patch does not achieve to solve this, but only protects from the immediate consequence. It might also be worth consideration, that, while the problem may be more easy to reproduce with epair, this effect may or may not be a netgraph specific one[2]. Now lets keep in mind that a successful test means EXACTLY NOTHING. By which other means can we confirm that Your patch fully achieves what it is intended for? (E.g. something like dumping and verifying the respective internal tables in-vivo) (Background: It is not that I would be unwilling to create clean and precisely reproducible scenarious, But, one of my problems is currently, I only have two machines availabe: the graphical one where I'm just typing, and the backend server with the jails that does practically everything. Therefore, experimenting on any of them creates considerable pain. I'm working on that issue, trying to get a real server board for the backend so to get the current one free for testing - but what I would like to use, e.g. ASUS Z10PE+cores+regECC, is not something one would easily find on yardsales - and seldom for an acceptable price.) cheerio, PMc [1] Rationale: a failing test tells us that either the test or the application has a bug (50/50 chance). A succeeding test tells us that 1 equals 1, which we knew already before. In fact, tests tell us *nothing at all* about the state of our code, and specifically, 'successful' outcomes do NOT mean that things are all correct. The only true usefulness of tests is to protect against re-introducing a fault that was already fixed before, i.e. regressions. [2] My netgraph configuration consists of bringing up some bridges and then attaching the jails to them. Here is the bridge starter (only respective component, there are more of these populated, but probably not influencing the issue): ------------------------------------------------ #! /bin/sh # PROVIDE: netgraphs # REQUIRE: netwait # BEFORE: NETWORKING =2E /etc/rc.subr name=3D"netgraphs" start_cmd=3D"${name}_start" stop_cmd=3D"${name}_stop" load_rc_config $name netgraphs_graphs=3D"svc" netgraphs_svc_if1_name=3D"nge_svc_1u" netgraphs_svc_if1_mac=3D"00:1d:92:01:02:01" netgraphs_svc_if1_addr=3D"***.***.***.***/29" netgraphs_svc_start() { local _ifname if ngctl info svcswitch: > /dev/null 2>&1; then netgraphs_svc_stop fi =20 echo "Creating SVC Switch" ngctl -f - < Delivered-To: freebsd-stable@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id C3C3A4B25F3 for ; Wed, 9 Dec 2020 01:51:19 +0000 (UTC) (envelope-from kevans@freebsd.org) Received: from smtp.freebsd.org (smtp.freebsd.org [IPv6:2610:1c1:1:606c::24b:4]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "smtp.freebsd.org", Issuer "Let's Encrypt Authority X3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4CrKlW59hpz3j05; Wed, 9 Dec 2020 01:51:19 +0000 (UTC) (envelope-from kevans@freebsd.org) Received: from mail-qk1-f175.google.com (mail-qk1-f175.google.com [209.85.222.175]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "GTS CA 1O1" (verified OK)) (Authenticated sender: kevans) by smtp.freebsd.org (Postfix) with ESMTPSA id 9FCDE240E5; Wed, 9 Dec 2020 01:51:19 +0000 (UTC) (envelope-from kevans@freebsd.org) Received: by mail-qk1-f175.google.com with SMTP id z11so647231qkj.7; Tue, 08 Dec 2020 17:51:19 -0800 (PST) X-Gm-Message-State: AOAM531+zol1augTZuTD9uCtbPOVVFOfyr74STow4fYTeNVtrLgK65yL v6ezp1ch4+SV+tpx75ERye5RKCwMs1WT5LgNyaU= X-Google-Smtp-Source: ABdhPJy002Gu0+TQwAkCHN3zvhXtfYG5Nca7nUj1MlL0CQVSNgPYGP6np8wc3j7eZvQss5vqrsWJyBzV4nIpV3QMncQ= X-Received: by 2002:a05:620a:14a:: with SMTP id e10mr165053qkn.103.1607478679027; Tue, 08 Dec 2020 17:51:19 -0800 (PST) MIME-Version: 1.0 References: <20201207125451.GA11406@gate.oper.dinoex.org> <39DBEA53-960F-4D70-86D7-847E6DFA437D@FreeBSD.org> <20201207233449.GA11025@gate.oper.dinoex.org> <1AAE98C9-ADF9-4869-B863-601542CEBB67@FreeBSD.org> In-Reply-To: From: Kyle Evans Date: Tue, 8 Dec 2020 19:51:07 -0600 X-Gmail-Original-Message-ID: Message-ID: Subject: Re: Panic: 12.2 fails to use VIMAGE jails To: Peter Cc: Kristof Provost , FreeBSD-STABLE Mailing List Content-Type: text/plain; charset="UTF-8" X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.34 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 09 Dec 2020 01:51:19 -0000 On Tue, Dec 8, 2020 at 7:45 PM Peter wrote: > > > On Tue, Dec 08, 2020 at 08:02:47PM +0100, Kristof Provost wrote: > > Can you reduce your netgraph use case to a small test case that can trigger > ? the problem? > > I'm sorry, I fear I don't get Your point. > Assumed there are actually two or three bugs here, You are asking me > to reduce config so that it will trigger only one of them? Is that > correct? > > Then let me put this different: assuming this is the OS for the life > support system of the manned Jupiter mission. Then, which one of the > bugs do You want to get fixed, and which would You prefer to keep and > make Your oxygen supply cut off? > > https://www.youtube.com/watch?v=BEo2g-w545A You seem to have misinterpreted this; he doesn't want to narrow it down to one bug, he wants simple steps that he can follow to reproduce any failure, preferably steps that can actually be followed by just about anyone and don't require immense amounts of setup time or additional hardware. Unfortunately, your tone following the misunderstanding was pretty discouraging. Thanks, Kyle Evans From owner-freebsd-stable@freebsd.org Wed Dec 9 01:56:03 2020 Return-Path: Delivered-To: freebsd-stable@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 0B92A4B29C8 for ; Wed, 9 Dec 2020 01:56:03 +0000 (UTC) (envelope-from raul.munoz@custos.es) Received: from mail3.custos.es (mail3.custos.es [5.2.90.130]) by mx1.freebsd.org (Postfix) with ESMTP id 4CrKry1xK4z3jW6 for ; Wed, 9 Dec 2020 01:56:01 +0000 (UTC) (envelope-from raul.munoz@custos.es) Received: from plank.b2n.org (plank.b2n.org [185.150.100.31]) by mail3.custos.es (Postfix) with ESMTP id 0963A125ED7 for ; Wed, 9 Dec 2020 02:56:02 +0100 (CET) Received: from [10.1.2.113] (183.190.94.90.dynamic.jazztel.es [90.94.190.183]) by plank.b2n.org (Postfix) with ESMTPSA id A9F4D8E4D for ; Wed, 9 Dec 2020 02:56:00 +0100 (CET) Subject: Re: 'ifconfig lagg0.300 create' fails with 'SIOIFCREATE2: Device not configured' on r368459 To: freebsd-stable@freebsd.org References: <932bc19b-40d2-f8a9-59e1-a22809ec3ae6@custos.es> From: =?UTF-8?B?UmHDumwgTXXDsW96IC0gQ1VTVE9T?= Message-ID: Date: Wed, 9 Dec 2020 02:55:59 +0100 User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:78.0) Gecko/20100101 Thunderbird/78.4.3 MIME-Version: 1.0 In-Reply-To: <932bc19b-40d2-f8a9-59e1-a22809ec3ae6@custos.es> Content-Type: text/plain; charset=utf-8 Content-Language: en-US Content-Transfer-Encoding: 8bit X-Rspamd-Queue-Id: 4CrKry1xK4z3jW6 X-Spamd-Bar: -- X-Spamd-Result: default: False [-2.73 / 15.00]; RCVD_VIA_SMTP_AUTH(0.00)[]; R_SPF_ALLOW(-0.20)[+ip4:5.2.90.130]; TO_DN_NONE(0.00)[]; RCVD_COUNT_THREE(0.00)[3]; DKIM_TRACE(0.00)[custos.es:+]; NEURAL_HAM_SHORT(-1.00)[-1.000]; RCVD_NO_TLS_LAST(0.10)[]; FROM_EQ_ENVFROM(0.00)[]; MIME_TRACE(0.00)[0:+]; RBL_DBL_DONT_QUERY_IPS(0.00)[5.2.90.130:from]; R_MIXED_CHARSET(0.67)[subject]; ASN(0.00)[asn:198432, ipnet:5.2.90.0/24, country:ES]; MID_RHS_MATCH_FROM(0.00)[]; RECEIVED_SPAMHAUS_PBL(0.00)[90.94.190.183:received]; ARC_NA(0.00)[]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; R_DKIM_ALLOW(-0.20)[custos.es:s=dkim]; FROM_HAS_DN(0.00)[]; TO_MATCH_ENVRCPT_ALL(0.00)[]; NEURAL_HAM_LONG(-1.00)[-1.000]; MIME_GOOD(-0.10)[text/plain]; PREVIOUSLY_DELIVERED(0.00)[freebsd-stable@freebsd.org]; DMARC_NA(0.00)[custos.es]; RCPT_COUNT_ONE(0.00)[1]; SPAMHAUS_ZRD(0.00)[5.2.90.130:from:127.0.2.255]; MAILMAN_DEST(0.00)[freebsd-stable] X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.34 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 09 Dec 2020 01:56:03 -0000 El 9/12/20 a las 2:45, Raúl Muñoz - CUSTOS via freebsd-stable escribió: [....] > maybe related to: > https://svnweb.freebsd.org/base?view=revision&revision=368346 Excuse me, I meant this one: https://svnweb.freebsd.org/base?view=revision&revision=368297 From owner-freebsd-stable@freebsd.org Wed Dec 9 06:48:39 2020 Return-Path: Delivered-To: freebsd-stable@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 2ABDE471E24 for ; Wed, 9 Dec 2020 06:48:39 +0000 (UTC) (envelope-from kp@FreeBSD.org) Received: from smtp.freebsd.org (smtp.freebsd.org [96.47.72.83]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "smtp.freebsd.org", Issuer "Let's Encrypt Authority X3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4CrSLb0ndfz4WJG; Wed, 9 Dec 2020 06:48:39 +0000 (UTC) (envelope-from kp@FreeBSD.org) Received: from venus.codepro.be (venus.codepro.be [5.9.86.228]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client CN "mx1.codepro.be", Issuer "Let's Encrypt Authority X3" (verified OK)) (Authenticated sender: kp) by smtp.freebsd.org (Postfix) with ESMTPSA id E854627693; Wed, 9 Dec 2020 06:48:38 +0000 (UTC) (envelope-from kp@FreeBSD.org) Received: by venus.codepro.be (Postfix, authenticated sender kp) id 12CE24DA69; Wed, 9 Dec 2020 07:48:35 +0100 (CET) From: "Kristof Provost" To: Peter Cc: freebsd-stable@freebsd.org Subject: Re: Panic: 12.2 fails to use VIMAGE jails Date: Wed, 09 Dec 2020 07:48:35 +0100 X-Mailer: MailMate (1.13.2r5673) Message-ID: <36BBA671-835F-435B-AF79-0E82FE57C6E8@FreeBSD.org> In-Reply-To: References: <20201207125451.GA11406@gate.oper.dinoex.org> <39DBEA53-960F-4D70-86D7-847E6DFA437D@FreeBSD.org> <20201207233449.GA11025@gate.oper.dinoex.org> <1AAE98C9-ADF9-4869-B863-601542CEBB67@FreeBSD.org> MIME-Version: 1.0 Content-Type: text/plain; charset="UTF-8"; format=flowed Content-Transfer-Encoding: 8bit X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.34 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 09 Dec 2020 06:48:39 -0000 On 9 Dec 2020, at 2:31, Peter wrote: > On Tue, Dec 08, 2020 at 08:02:47PM +0100, Kristof Provost wrote: > > ! > Sorry for the bad news. > ! > > ! You appear to be triggering two or three different bugs there. > > That is possible. Then there are two or three different bugs in the > production code. > > In any case, my current workaround, i.e. delaying in the exec.poststop > >> exec.poststop = " >> sleep 6 ; >> /usr/sbin/ngctl shutdown ${ifname1l}: ; >> "; > > helps for it all and makes the system behave solid. This is true > with and without Your patch. > > ! Can you reduce your netgraph use case to a small test case that can > trigger > ! the problem? > > I'm sorry, I fear I don't get Your point. > Assumed there are actually two or three bugs here, You are asking me > to reduce config so that it will trigger only one of them? Is that > correct? > No, we need a simple case to reproduce these problems. It’s fine if that test case triggers multiple issues. > Then let me put this different: assuming this is the OS for the life > support system of the manned Jupiter mission. Then, which one of the > bugs do You want to get fixed, and which would You prefer to keep and > make Your oxygen supply cut off? > > https://www.youtube.com/watch?v=BEo2g-w545A > Happily we’re not in space. > > ! I’m not likely to be able to do anything unless I can reproduce > ! the problem(s). > > I understand that. > From Your former mail I get the impression that you prefer to rely > on tests. I consider this a bad habit[1] and prefer logical thinking. > > (Background: It is not that I would be unwilling to create clean and > precisely reproducible scenarious, But, one of my problems is > currently, I only have two machines availabe: the graphical one where > I'm just typing, and the backend server with the jails that does > practically everything. > These issues should trigger just fine in VMs. There’s no need for hardware pain. Regards, Kristof From owner-freebsd-stable@freebsd.org Wed Dec 9 11:00:36 2020 Return-Path: Delivered-To: freebsd-stable@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 11AE347786A for ; Wed, 9 Dec 2020 11:00:36 +0000 (UTC) (envelope-from pmc@citylink.dinoex.sub.org) Received: from uucp.dinoex.sub.de (uucp.dinoex.sub.de [IPv6:2001:1440:5001:1::2]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "uucp.dinoex.sub.de", Issuer "Let's Encrypt Authority X3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4CrYxH5yT2z4kyC; Wed, 9 Dec 2020 11:00:35 +0000 (UTC) (envelope-from pmc@citylink.dinoex.sub.org) Received: from uucp.dinoex.sub.de (uucp.dinoex.org [185.220.148.12]) by uucp.dinoex.org (8.16.0.50/8.16.0.50) with ESMTPS id 0B9B049D063929 (version=TLSv1.3 cipher=TLS_AES_256_GCM_SHA384 bits=256 verify=NO); Wed, 9 Dec 2020 12:00:05 +0100 (CET) (envelope-from pmc@citylink.dinoex.sub.org) X-Authentication-Warning: uucp.dinoex.sub.de: Host uucp.dinoex.org [185.220.148.12] claimed to be uucp.dinoex.sub.de Received: (from uucp@localhost) by uucp.dinoex.sub.de (8.16.0.50/8.16.0.50/Submit) with UUCP id 0B9B04Zl063926; Wed, 9 Dec 2020 12:00:04 +0100 (CET) (envelope-from pmc@citylink.dinoex.sub.org) Received: from gate.oper.dinoex.org (gate-e [192.168.98.2]) by citylink.dinoex.sub.de (8.16.1/8.16.1) with ESMTP id 0B9AtKWZ003094; Wed, 9 Dec 2020 11:55:20 +0100 (CET) (envelope-from peter@gate.oper.dinoex.org) Received: from gate.oper.dinoex.org (gate-e [192.168.98.2]) by gate.oper.dinoex.org (8.16.1/8.16.1) with ESMTP id 0B9AsS6K002885; Wed, 9 Dec 2020 11:54:28 +0100 (CET) (envelope-from peter@gate.oper.dinoex.org) Received: (from peter@localhost) by gate.oper.dinoex.org (8.16.1/8.16.1/Submit) id 0B9AsSkd002884; Wed, 9 Dec 2020 11:54:28 +0100 (CET) (envelope-from peter) Date: Wed, 9 Dec 2020 11:54:28 +0100 From: Peter Sender: li-fbsd@citylink.dinoex.sub.org To: Kyle Evans Cc: Kristof Provost , FreeBSD-STABLE Mailing List Subject: Re: Panic: 12.2 fails to use VIMAGE jails Message-ID: References: <20201207125451.GA11406@gate.oper.dinoex.org> <39DBEA53-960F-4D70-86D7-847E6DFA437D@FreeBSD.org> <20201207233449.GA11025@gate.oper.dinoex.org> <1AAE98C9-ADF9-4869-B863-601542CEBB67@FreeBSD.org> MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: X-Milter: Spamilter (Reciever: uucp.dinoex.sub.de; Sender-ip: 185.220.148.12; Sender-helo: uucp.dinoex.sub.de; ) X-Greylist: Sender IP whitelisted, not delayed by milter-greylist-4.6.2 (uucp.dinoex.org [185.220.148.12]); Wed, 09 Dec 2020 12:00:07 +0100 (CET) X-Rspamd-Queue-Id: 4CrYxH5yT2z4kyC X-Spamd-Bar: ---- Authentication-Results: mx1.freebsd.org; none X-Spamd-Result: default: False [-4.00 / 15.00]; REPLY(-4.00)[] X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.34 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 09 Dec 2020 11:00:36 -0000 On Tue, Dec 08, 2020 at 07:51:07PM -0600, Kyle Evans wrote: ! You seem to have misinterpreted this; he doesn't want to narrow it ! down to one bug, he wants simple steps that he can follow to reproduce Maybe I did misinterpret, but then I don't really understand it. I would suppose, when testing a proposed fix, the fact that it does break under the exact same conditions as before, is all the information needed at that point. Put in simple words: that it does not work. ! any failure, preferably steps that can actually be followed by just ! about anyone and don't require immense amounts of setup time or ! additional hardware. Engineering does not normally work that way. I'll try to explain: when a bug is first encountered, it is necessary to isolate it insofar that somebody who is knowledgeable of the code, can actually reproduce it, in order to have a look at it and analyze what causes the mis-happening. If then a remedy is devised, and that does not work as expected, then the flaw is in the analysis, and we just start over from there. In fact, I would have expected somebody who is trying to fix such kind of bug, to already have testing tools available and tell me exactly which kind of data I might retrieve from the dumps. The open question now is: am I the only one seeing these failures? Might they be attributed to a faulty configuration or maybe hardware issues or whatever? We cannot know this, we can only watch out what happens at other sites. And that is why I sent out all these backtraces - because they appear weird and might be difficult to associate with this issue. I don't think there is much more we can do at this point, unless we were willing to actually look into the details. Am I discouraging? Indeed, I think, engineering is discouraging by it's very nature, and that's the fun of it: to overcome odds and finally maybe make things better. And when we start to forget about that, bad things begin to happen (anybody remember Apollo 13?). But talking about disencouragement: I usually try to track down defects I encounter, and, if possible, do a viable root-cause analysis. I tended to be very willing to share the outcomes and. if a solution arises, by all means make that get back into the code base; but I found that even ready made patches for easy matters would linger forever in the sendbug system without anybody caring, or, in more complex cases where I would need some feedback from the original writer, if only to clarify the purpose of some defaults or verify than an approach is viable, that communication is very difficult to establish. And that is what I would call disencouraging, and I for my part have accepted to just leave the developers in their ivory tower and tend to my own business. cheerio, PMc From owner-freebsd-stable@freebsd.org Wed Dec 9 11:03:37 2020 Return-Path: Delivered-To: freebsd-stable@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 2232B477C81 for ; Wed, 9 Dec 2020 11:03:37 +0000 (UTC) (envelope-from kp@FreeBSD.org) Received: from smtp.freebsd.org (smtp.freebsd.org [IPv6:2610:1c1:1:606c::24b:4]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "smtp.freebsd.org", Issuer "Let's Encrypt Authority X3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4CrZ0n0Wsdz4lN5; Wed, 9 Dec 2020 11:03:37 +0000 (UTC) (envelope-from kp@FreeBSD.org) Received: from venus.codepro.be (venus.codepro.be [5.9.86.228]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client CN "mx1.codepro.be", Issuer "Let's Encrypt Authority X3" (verified OK)) (Authenticated sender: kp) by smtp.freebsd.org (Postfix) with ESMTPSA id E49D4283D8; Wed, 9 Dec 2020 11:03:36 +0000 (UTC) (envelope-from kp@FreeBSD.org) Received: by venus.codepro.be (Postfix, authenticated sender kp) id 3B7624DD69; Wed, 9 Dec 2020 12:03:35 +0100 (CET) From: "Kristof Provost" To: Peter Cc: "Kyle Evans" , "FreeBSD-STABLE Mailing List" Subject: Re: Panic: 12.2 fails to use VIMAGE jails Date: Wed, 09 Dec 2020 12:03:34 +0100 X-Mailer: MailMate (1.13.2r5673) Message-ID: <5AC3DABA-E556-469C-926B-13484E75E64B@FreeBSD.org> In-Reply-To: References: <20201207125451.GA11406@gate.oper.dinoex.org> <39DBEA53-960F-4D70-86D7-847E6DFA437D@FreeBSD.org> <20201207233449.GA11025@gate.oper.dinoex.org> <1AAE98C9-ADF9-4869-B863-601542CEBB67@FreeBSD.org> MIME-Version: 1.0 Content-Type: text/plain; charset="UTF-8"; format=flowed; markup=markdown Content-Transfer-Encoding: 8bit X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.34 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 09 Dec 2020 11:03:37 -0000 Peter, I’m not interested in discussing software development methodology here. Please drop me from this thread. Let me know if/when you have a test case I can work from. Regards, Kristof On 9 Dec 2020, at 11:54, Peter wrote: > On Tue, Dec 08, 2020 at 07:51:07PM -0600, Kyle Evans wrote: > > ! You seem to have misinterpreted this; he doesn't want to narrow it > ! down to one bug, he wants simple steps that he can follow to > reproduce > > Maybe I did misinterpret, but then I don't really understand it. > I would suppose, when testing a proposed fix, the fact that it > does break under the exact same conditions as before, is all the > information needed at that point. Put in simple words: that it does > not work. > > ! any failure, preferably steps that can actually be followed by just > ! about anyone and don't require immense amounts of setup time or > ! additional hardware. > > Engineering does not normally work that way. > > I'll try to explain: when a bug is first encountered, it is necessary > to isolate it insofar that somebody who is knowledgeable of the code, > can actually reproduce it, in order to have a look at it and analyze > what causes the mis-happening. > > If then a remedy is devised, and that does not work as expected, then > the flaw is in the analysis, and we just start over from there. > > In fact, I would have expected somebody who is trying to fix such > kind of bug, to already have testing tools available and tell me > exactly which kind of data I might retrieve from the dumps. > > The open question now is: am I the only one seeing these failures? > Might they be attributed to a faulty configuration or maybe hardware > issues or whatever? > We cannot know this, we can only watch out what happens at other > sites. And that is why I sent out all these backtraces - because they > appear weird and might be difficult to associate with this issue. > > I don't think there is much more we can do at this point, unless we > were willing to actually look into the details. > > > Am I discouraging? Indeed, I think, engineering is discouraging by > it's very nature, and that's the fun of it: to overcome odds and > finally maybe make things better. And when we start to forget about > that, bad things begin to happen (anybody remember Apollo 13?). > > But talking about disencouragement: I usually try to track down > defects I encounter, and, if possible, do a viable root-cause > analysis. I tended to be very willing to share the outcomes and. if > a solution arises, by all means make that get back into the code base; > but I found that even ready made patches for easy matters would > linger forever in the sendbug system without anybody caring, or, in > more complex cases where I would need some feedback from the original > writer, if only to clarify the purpose of some defaults or verify > than an approach is viable, that communication is very difficult to > establish. And that is what I would call disencouraging, and I for > my part have accepted to just leave the developers in their ivory > tower and tend to my own business. > > > cheerio, > PMc From owner-freebsd-stable@freebsd.org Wed Dec 9 11:18:37 2020 Return-Path: Delivered-To: freebsd-stable@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 70B26478B99 for ; Wed, 9 Dec 2020 11:18:37 +0000 (UTC) (envelope-from pmc@citylink.dinoex.sub.org) Received: from uucp.dinoex.sub.de (uucp.dinoex.sub.de [IPv6:2001:1440:5001:1::2]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "uucp.dinoex.sub.de", Issuer "Let's Encrypt Authority X3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4CrZL44ckLz4mPP for ; Wed, 9 Dec 2020 11:18:35 +0000 (UTC) (envelope-from pmc@citylink.dinoex.sub.org) Received: from uucp.dinoex.sub.de (uucp.dinoex.org [185.220.148.12]) by uucp.dinoex.org (8.16.0.50/8.16.0.50) with ESMTPS id 0B9BI4jQ077658 (version=TLSv1.3 cipher=TLS_AES_256_GCM_SHA384 bits=256 verify=NO); Wed, 9 Dec 2020 12:18:04 +0100 (CET) (envelope-from pmc@citylink.dinoex.sub.org) X-Authentication-Warning: uucp.dinoex.sub.de: Host uucp.dinoex.org [185.220.148.12] claimed to be uucp.dinoex.sub.de Received: (from uucp@localhost) by uucp.dinoex.sub.de (8.16.0.50/8.16.0.50/Submit) with UUCP id 0B9BI4UB077657; Wed, 9 Dec 2020 12:18:04 +0100 (CET) (envelope-from pmc@citylink.dinoex.sub.org) Received: from gate.oper.dinoex.org (gate-e [192.168.98.2]) by citylink.dinoex.sub.de (8.16.1/8.16.1) with ESMTP id 0B9B7Kn1005466; Wed, 9 Dec 2020 12:07:20 +0100 (CET) (envelope-from peter@gate.oper.dinoex.org) Received: from gate.oper.dinoex.org (gate-e [192.168.98.2]) by gate.oper.dinoex.org (8.16.1/8.16.1) with ESMTP id 0B9B5NWp005088; Wed, 9 Dec 2020 12:05:23 +0100 (CET) (envelope-from peter@gate.oper.dinoex.org) Received: (from peter@localhost) by gate.oper.dinoex.org (8.16.1/8.16.1/Submit) id 0B9B5NuG005087; Wed, 9 Dec 2020 12:05:23 +0100 (CET) (envelope-from peter) Date: Wed, 9 Dec 2020 12:05:23 +0100 From: Peter Sender: li-fbsd@citylink.dinoex.sub.org To: Dewayne Geraghty Cc: freebsd-stable@freebsd.org Subject: Re: Panic: 12.2 fails to use VIMAGE jails Message-ID: References: <20201207125451.GA11406@gate.oper.dinoex.org> <39DBEA53-960F-4D70-86D7-847E6DFA437D@FreeBSD.org> <20201207233449.GA11025@gate.oper.dinoex.org> MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: X-Milter: Spamilter (Reciever: uucp.dinoex.sub.de; Sender-ip: 185.220.148.12; Sender-helo: uucp.dinoex.sub.de; ) X-Greylist: Sender IP whitelisted, not delayed by milter-greylist-4.6.2 (uucp.dinoex.org [185.220.148.12]); Wed, 09 Dec 2020 12:18:07 +0100 (CET) X-Rspamd-Queue-Id: 4CrZL44ckLz4mPP X-Spamd-Bar: -- Authentication-Results: mx1.freebsd.org; dkim=none; dmarc=none; spf=none (mx1.freebsd.org: domain of pmc@citylink.dinoex.sub.org has no SPF policy when checking 2001:1440:5001:1::2) smtp.mailfrom=pmc@citylink.dinoex.sub.org X-Spamd-Result: default: False [-2.10 / 15.00]; ARC_NA(0.00)[]; RBL_DBL_DONT_QUERY_IPS(0.00)[2001:1440:5001:1::2:from]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; FROM_HAS_DN(0.00)[]; TO_DN_SOME(0.00)[]; NEURAL_HAM_LONG(-1.00)[-1.000]; MIME_GOOD(-0.10)[text/plain]; HAS_XAW(0.00)[]; DMARC_NA(0.00)[sub.org]; AUTH_NA(1.00)[]; SPAMHAUS_ZRD(0.00)[2001:1440:5001:1::2:from:127.0.2.255]; RCVD_COUNT_THREE(0.00)[4]; TO_MATCH_ENVRCPT_SOME(0.00)[]; NEURAL_HAM_SHORT(-1.00)[-1.000]; RCPT_COUNT_TWO(0.00)[2]; R_SPF_NA(0.00)[no SPF record]; FROM_EQ_ENVFROM(0.00)[]; R_DKIM_NA(0.00)[]; MIME_TRACE(0.00)[0:+]; ASN(0.00)[asn:8469, ipnet:2001:1440::/32, country:DE]; RCVD_TLS_LAST(0.00)[]; MAILMAN_DEST(0.00)[freebsd-stable] X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.34 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 09 Dec 2020 11:18:37 -0000 On Wed, Dec 09, 2020 at 02:00:37PM +1100, Dewayne Geraghty wrote: ! On a jail with config: ! exec.start = "/bin/sh -x /etc/rc"; ! exec.stop = "/bin/sh /etc/rc.shutdown"; ! exec.clean; ! ! test_prod { jid=7; persist; ip4.addr = ! "10.0.7.96,10.0.5.96,127.0.5.96"; devfs_ruleset = "6"; ! host.hostuuid=00000000-0000-0000-0001-000000000302; host.hostid=000302; } ! ! I successfully performed ! for i in `seq 10`; do jail -vc test_prod; sleep 3; jail -vr test_prod; done But, this is not a VIMAGE jail, is it? Old-style jails are unaffected by this issue. Only VIMAGE jails, using epair or netgraph, might be affected. (In that case, you would not have an "ip4.addr" configured, and rather a "vnet.interface".) ! I think the normal use of jail.conf is to NOT explicitly use a jid in ! the definition, which may be why this may not have been picked up? ! (Maybe a clue). This is an interesting point. When you stop a jail, it may stay for a more or less long time in a "dying" state (visible with "jls -d"), keeping the jid occupied. During that time, the jail cannot be restarted with that same jid. Once ago, I read people complaining about this, and the advice was to just not define the jid in the definition, so that the jail can be restarted immediately (and will probably grab another jid). I did not find a solid explanation for what is happening in that "dying" state (and why it does take more or less long), even less an approach to fix that. I found some theories circling the net, but these don't really figure. So I would need to look into the source myself - and I did postpone that indefinitely. ;) But what I found out, with the VIMAGE jails (those that can carry their own network interfaces), when you make a slight mistake with managing and handling the interfaces, then the jail will stay in the dying state forever. If you don't make a mistake, then it will finally die within some time. So I decided to keep the jid, so that rightaway nothing is allowed to linger from misconfigured unnoticed. (The tradeoff is obviousely that one might have to wait before restarting.) cheerio, PMc P.S. 41 celsius is phantastic! I envy You! :) From owner-freebsd-stable@freebsd.org Thu Dec 10 11:46:50 2020 Return-Path: Delivered-To: freebsd-stable@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id B43C447D6FC for ; Thu, 10 Dec 2020 11:46:50 +0000 (UTC) (envelope-from raul.munoz@custos.es) Received: from mail3.custos.es (mail3.custos.es [5.2.90.130]) by mx1.freebsd.org (Postfix) with ESMTP id 4CsBw95Pqsz3pD3 for ; Thu, 10 Dec 2020 11:46:49 +0000 (UTC) (envelope-from raul.munoz@custos.es) Received: from plank.b2n.org (plank.b2n.org [185.150.100.31]) by mail3.custos.es (Postfix) with ESMTP id BEC3B125ED4 for ; Thu, 10 Dec 2020 12:46:41 +0100 (CET) Received: from [10.10.10.15] (183.190.94.90.dynamic.jazztel.es [90.94.190.183]) by plank.b2n.org (Postfix) with ESMTPSA id 7E96191E6 for ; Thu, 10 Dec 2020 12:46:41 +0100 (CET) To: freebsd-stable@freebsd.org References: <932bc19b-40d2-f8a9-59e1-a22809ec3ae6@custos.es> From: =?UTF-8?B?UmHDumwgTXXDsW96IC0gQ1VTVE9T?= Subject: [SOLVED] 'ifconfig lagg0.300 create' fails with 'SIOIFCREATE2: Device not configured' on r368459 Message-ID: <6d6e7fe4-22e1-ff66-b4ac-ea5ca52641c3@custos.es> Date: Thu, 10 Dec 2020 12:46:41 +0100 User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:78.0) Gecko/20100101 Thunderbird/78.4.3 MIME-Version: 1.0 In-Reply-To: <932bc19b-40d2-f8a9-59e1-a22809ec3ae6@custos.es> Content-Type: text/plain; charset=utf-8; format=flowed Content-Language: en-US Content-Transfer-Encoding: 8bit X-Rspamd-Queue-Id: 4CsBw95Pqsz3pD3 X-Spamd-Bar: -- X-Spamd-Result: default: False [-2.73 / 15.00]; RCVD_VIA_SMTP_AUTH(0.00)[]; R_SPF_ALLOW(-0.20)[+ip4:5.2.90.130]; TO_DN_NONE(0.00)[]; RCVD_COUNT_THREE(0.00)[3]; DKIM_TRACE(0.00)[custos.es:+]; NEURAL_HAM_SHORT(-1.00)[-1.000]; RCVD_NO_TLS_LAST(0.10)[]; FROM_EQ_ENVFROM(0.00)[]; MIME_TRACE(0.00)[0:+]; RBL_DBL_DONT_QUERY_IPS(0.00)[5.2.90.130:from]; R_MIXED_CHARSET(0.67)[subject]; ASN(0.00)[asn:198432, ipnet:5.2.90.0/24, country:ES]; MID_RHS_MATCH_FROM(0.00)[]; RECEIVED_SPAMHAUS_PBL(0.00)[90.94.190.183:received]; ARC_NA(0.00)[]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; R_DKIM_ALLOW(-0.20)[custos.es:s=dkim]; FROM_HAS_DN(0.00)[]; TO_MATCH_ENVRCPT_ALL(0.00)[]; NEURAL_HAM_LONG(-1.00)[-1.000]; MIME_GOOD(-0.10)[text/plain]; PREVIOUSLY_DELIVERED(0.00)[freebsd-stable@freebsd.org]; DMARC_NA(0.00)[custos.es]; RCPT_COUNT_ONE(0.00)[1]; SPAMHAUS_ZRD(0.00)[5.2.90.130:from:127.0.2.255]; MAILMAN_DEST(0.00)[freebsd-stable] X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.34 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 10 Dec 2020 11:46:50 -0000 So accurate, so fast awesome people here Good day everyone ;) https://svnweb.freebsd.org/base?view=revision&revision=368502 From owner-freebsd-stable@freebsd.org Fri Dec 11 16:57:19 2020 Return-Path: Delivered-To: freebsd-stable@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 166ED4B5381; Fri, 11 Dec 2020 16:57:19 +0000 (UTC) (envelope-from ali.abdallah@suse.com) Received: from mx2.suse.de (mx2.suse.de [195.135.220.15]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client CN "smtp2.suse.de", Issuer "Let's Encrypt Authority X3" (not verified)) by mx1.freebsd.org (Postfix) with ESMTPS id 4Csxlx75dHz4cXf; Fri, 11 Dec 2020 16:57:17 +0000 (UTC) (envelope-from ali.abdallah@suse.com) X-Virus-Scanned: by amavisd-new at test-mx.suse.de Received: from relay2.suse.de (unknown [195.135.221.27]) by mx2.suse.de (Postfix) with ESMTP id ED013ACF1; Fri, 11 Dec 2020 16:57:14 +0000 (UTC) Date: Fri, 11 Dec 2020 17:57:13 +0100 From: Ali Abdallah To: freebsd-fs@freebsd.org Cc: freebsd-stable@freebsd.org Subject: Consistency of pkg db on UFS Message-ID: <20201211165713.syvzamtdtrbrgx44@frix230> MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Disposition: inline X-Rspamd-Queue-Id: 4Csxlx75dHz4cXf X-Spamd-Bar: ---- X-Spamd-Result: default: False [-4.20 / 15.00]; ARC_NA(0.00)[]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; R_DKIM_ALLOW(-0.20)[suse.com:s=susede1]; FROM_HAS_DN(0.00)[]; DWL_DNSWL_MED(-2.00)[suse.com:dkim]; TO_MATCH_ENVRCPT_ALL(0.00)[]; R_SPF_ALLOW(-0.20)[+ip4:195.135.220.15]; MIME_GOOD(-0.10)[text/plain]; TO_DN_NONE(0.00)[]; RCVD_DKIM_ARC_DNSWL_MED(-0.50)[]; RWL_MAILSPIKE_GOOD(0.00)[195.135.220.15:from]; RCVD_IN_DNSWL_MED(-0.20)[195.135.220.15:from]; RCPT_COUNT_TWO(0.00)[2]; DMARC_POLICY_ALLOW(-0.50)[suse.com,quarantine]; DKIM_TRACE(0.00)[suse.com:+]; NEURAL_SPAM_LONG(1.00)[1.000]; NEURAL_HAM_SHORT(-1.00)[-1.000]; FROM_EQ_ENVFROM(0.00)[]; MID_RHS_NOT_FQDN(0.50)[]; MIME_TRACE(0.00)[0:+]; ASN(0.00)[asn:29298, ipnet:195.135.220.0/22, country:DE]; RCVD_TLS_LAST(0.00)[]; MAILMAN_DEST(0.00)[freebsd-fs,freebsd-stable]; RCVD_COUNT_TWO(0.00)[2] X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.34 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 11 Dec 2020 16:57:19 -0000 Hello, I've came across the following issues on a freshly installed system with a UFS SU+j root partition. # pkg install -y some_package The package management tool is not yet installed on your system. Do you want to fetch and install it now? [y/N]: y # kldload SOME_MODULE -> crash happens here (due to drm for example) On next boot any attempt to use pkg results in the following message: # pkg install nano The package management tool is not yet installed on your system. Do you want to fetch and install it now? [y/N]: y Bootstrapping pkg from pkg+http://pkg.FreeBSD.org/FreeBSD:12:amd64/quarterly, please wait... Verifying signature with trusted certificate pkg.freebsd.org.2013102301... done Installing pkg-1.15.10... the most recent version of pkg-1.15.10 is already installed It seems that /var/db/pkg/local.sqlite contains entry for the installed packages, but those packages didn't make it to the filesystem. Is this because the db is fsynced while the actual package data is not? The issue is very easy to reproduce (on a VM for instance). (I was not able to reproduce on a ZFS root filesystem). Regards, Ali From owner-freebsd-stable@freebsd.org Fri Dec 11 18:26:29 2020 Return-Path: Delivered-To: freebsd-stable@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id B9DCB4B6E37; Fri, 11 Dec 2020 18:26:29 +0000 (UTC) (envelope-from ludovit.koren@gmail.com) Received: from mail-ed1-x52b.google.com (mail-ed1-x52b.google.com [IPv6:2a00:1450:4864:20::52b]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "GTS CA 1O1" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4Cszkr68N7z4jv1; Fri, 11 Dec 2020 18:26:28 +0000 (UTC) (envelope-from ludovit.koren@gmail.com) Received: by mail-ed1-x52b.google.com with SMTP id dk8so10374397edb.1; Fri, 11 Dec 2020 10:26:28 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=from:to:subject:user-mail-address:date:message-id:user-agent :mime-version; bh=9rFmM/nxORrZ2TNK7kFnsb8b0706Zz7UPyyR7ru78Mc=; b=I+Zl7HSPkLcIUzDbh+91i97gZoBCBIYEKjKWchaN0TD2HXrnpVSX6qV5OxsYK/Vpz2 APrTiv0qkfwLv7CJQm5Cqx/SJq6VD3fcGaicAzOUKImg2UvrgTw6PEY0pFFs720ZrZ0P +EQskR17hPbByS+ow9lGeR8jIK4RXZkrDhr38RiS7583+dWvOx689Oru24mEQyfWSbNq N7eyvpOmWwVrkfOcHy5C0dhZ5UaPzVzi2yIYtOM53NzCIJccgS2z4V7VrHvR23Y7AxwD yZScCYqdqmi43R+2SfU3BeaBjVP1mowmvmrmxkpRXWlF+dESzNXQIF0EoYuQyaePF+4x JOcQ== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:from:to:subject:user-mail-address:date :message-id:user-agent:mime-version; bh=9rFmM/nxORrZ2TNK7kFnsb8b0706Zz7UPyyR7ru78Mc=; b=qMJlyws/dYidBvYxhmATzuHXxP9fophYAW7ByVeyaoJDBUrZSl+jvUuwCkKXxUkMd/ lkHzIWaoz3BaXE0krBzOGnVrH6rs9I6zLSprSyHdmcSG0JwkD4/fR4YJyNhqlPJCwrpN 5dFMDwigyW3gJkaijZNc3LeQg3I5JCYmp90+yDOTltbt6CzBWKB6fvtN8qIVGN4AAW25 dtEp1rEcSI939dItSIL5AP2yyBCouh4FNU4CAjzScubBAb9VTTKElSe2wJmqEmzwsyxX Wi+zIQ6499HsUaQAzkrrSKqyF5rtk5aBIZAwToXBTRxBBP0LP9XrKIeMAhC0zg6ld9As 2ysw== X-Gm-Message-State: AOAM532mh/WSZ/OfA0y7qngnBJJ5uGAPLssxcxrk99W0rVP9oavipWmF L8cg4GFCr7z8fZDw9GwNQBu02p5/jhI= X-Google-Smtp-Source: ABdhPJzp7Bvek+e0zgDfy/qv4RkF/luiQXL1tXNE+SWIgUv1fdoPAmwN7c0ZSCxFHpwnEc7l91Jz3A== X-Received: by 2002:a50:fd10:: with SMTP id i16mr13263480eds.331.1607711186423; Fri, 11 Dec 2020 10:26:26 -0800 (PST) Received: from jedi.localdomain (adsl-dyn-169.95-102-30.t-com.sk. [95.102.30.169]) by smtp.gmail.com with ESMTPSA id z26sm8342066edl.71.2020.12.11.10.26.23 (version=TLS1_3 cipher=TLS_AES_256_GCM_SHA384 bits=256/256); Fri, 11 Dec 2020 10:26:24 -0800 (PST) Received: by jedi.localdomain (Postfix, from userid 1001) id 98BF5158359; Fri, 11 Dec 2020 19:26:22 +0100 (CET) From: Ludovit Koren To: freebsd-stable@freebsd.org, freebsd-current@freebsd.org Subject: HP Elitebook 830 G7 User-Mail-Address: ludovit.koren@gmail.com Date: Fri, 11 Dec 2020 19:26:22 +0100 Message-ID: <86360c9p2p.fsf@gmail.com> User-Agent: Gnus/5.13 (Gnus v5.13) Emacs/28.0.50 (berkeley-unix) MIME-Version: 1.0 Content-Type: text/plain X-Rspamd-Queue-Id: 4Cszkr68N7z4jv1 X-Spamd-Bar: - Authentication-Results: mx1.freebsd.org; dkim=pass header.d=gmail.com header.s=20161025 header.b=I+Zl7HSP; dmarc=pass (policy=none) header.from=gmail.com; spf=pass (mx1.freebsd.org: domain of ludovitkoren@gmail.com designates 2a00:1450:4864:20::52b as permitted sender) smtp.mailfrom=ludovitkoren@gmail.com X-Spamd-Result: default: False [-2.00 / 15.00]; RCVD_VIA_SMTP_AUTH(0.00)[]; FREEMAIL_FROM(0.00)[gmail.com]; R_SPF_ALLOW(-0.20)[+ip6:2a00:1450:4000::/36]; TO_DN_NONE(0.00)[]; RCVD_COUNT_THREE(0.00)[3]; DKIM_TRACE(0.00)[gmail.com:+]; RCPT_COUNT_TWO(0.00)[2]; DMARC_POLICY_ALLOW(-0.50)[gmail.com,none]; NEURAL_HAM_SHORT(-1.00)[-1.000]; FROM_EQ_ENVFROM(0.00)[]; MIME_TRACE(0.00)[0:+]; RBL_DBL_DONT_QUERY_IPS(0.00)[2a00:1450:4864:20::52b:from]; FREEMAIL_ENVFROM(0.00)[gmail.com]; MID_RHS_MATCH_FROM(0.00)[]; TAGGED_FROM(0.00)[]; ASN(0.00)[asn:15169, ipnet:2a00:1450::/32, country:US]; DWL_DNSWL_NONE(0.00)[gmail.com:dkim]; ARC_NA(0.00)[]; R_DKIM_ALLOW(-0.20)[gmail.com:s=20161025]; RECEIVED_SPAMHAUS_PBL(0.00)[95.102.30.169:received]; FROM_HAS_DN(0.00)[]; TO_MATCH_ENVRCPT_ALL(0.00)[]; MIME_GOOD(-0.10)[text/plain]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; SPAMHAUS_ZRD(0.00)[2a00:1450:4864:20::52b:from:127.0.2.255]; NEURAL_SPAM_LONG(1.00)[1.000]; RCVD_IN_DNSWL_NONE(0.00)[2a00:1450:4864:20::52b:from]; RCVD_TLS_ALL(0.00)[]; MAILMAN_DEST(0.00)[freebsd-current,freebsd-stable] X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.34 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 11 Dec 2020 18:26:29 -0000 Hi, I am trying to install FreeBSD-12.2-RELEASE, FreeBSD-13.0-CURRENT-amd64-20201203-f659bf1d31c The image starts booting and it hangs in: .... Loading kernel... /boot/kernel/kernel text=0x16bdcc4 data 0x140 data 0x75fe80 .... Loading configured modules... can't find '/etc/hostid' can't find '/boot/entropy' Start @ 0xffffffff80373000 ... EFI framebuffer information: addr, size 0xa0000000, 0x7e9000 dimensions 1920 x 1080 stride 1920 masks 0x00ff0000, 0x0000ff00, 0x000000ff, 0xff000000 _ Any hints greatly appreciated. Regards, lk From owner-freebsd-stable@freebsd.org Sat Dec 12 08:44:44 2020 Return-Path: Delivered-To: freebsd-stable@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 3F4464AE220; Sat, 12 Dec 2020 08:44:44 +0000 (UTC) (envelope-from techynotes@gmail.com) Received: from mail-ej1-x62e.google.com (mail-ej1-x62e.google.com [IPv6:2a00:1450:4864:20::62e]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "GTS CA 1O1" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4CtLn71LLPz4f75; Sat, 12 Dec 2020 08:44:42 +0000 (UTC) (envelope-from techynotes@gmail.com) Received: by mail-ej1-x62e.google.com with SMTP id w1so10970884ejf.11; Sat, 12 Dec 2020 00:44:42 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=mime-version:subject:from:in-reply-to:date:cc :content-transfer-encoding:message-id:references:to; bh=y5NL2hEJFqijWk2HV4pjKa48gP1sW18Ri4bpNzJSj/0=; b=uVV4IJrCn5oH5O7Fq6vm0Kbg7jX8d2CZ1h6z8XUj0B7TH7lHcGzQspCwv1NmIf5HWb EXpsKJhnf+vGwCy9TNM2k5WkMpWyIqYH09iuzfZyC8kftL6SjF8yKEi38u/2m89p3i40 lN0bVOkUrPesQYJmK0uH/ZG1cQFmhzTXpvE/dE2Lvd/Bh1HN4vpD9/l59WKtt1h24Aj+ fT3+AwvG95hdsFyn5qXV0hql6/hjTKH+Ak7YSKoVFkl+eFNcy5h/ISpS9fRP8UubBXW0 tHQuUd+PU4gU4F9Nvt05Q8j8oaERiRcFddBIQB9Tuyr3ywE3aApsf4zAMxjnDKBtdzGC RsyA== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:subject:from:in-reply-to:date:cc :content-transfer-encoding:message-id:references:to; bh=y5NL2hEJFqijWk2HV4pjKa48gP1sW18Ri4bpNzJSj/0=; b=VCP9SGcIf6WU+4lp8ty/MCCY0+tiX+e1AzLYHdBt/bZgnH+Ixa7X7P9puy9HH96VCO tOVKc7p37yh1XLht82bbZ+Lo58AmJwPW88xm2OsiSatzt7G3QALPAY6/P+mU7KoOcqiQ h34sKbsA0I/6ToXRYDjGpmK4gxL9H07BOu+2D2wyVaehQBFZamQqvqoWnHthvYrJqOhm 6pr+PCRDCjLqPXA0D6GMJKMCnG6qHrpLVvzX2cbqwsQw8QBRMv0nsMN6t6pYJG7Q3KoO jAQy7dVjceavdPXLQIO3U+LPYPy8OPEXWJI1FEazpjKhmWT62Xdpmc3PDvBsujukG1Rl EIjw== X-Gm-Message-State: AOAM533IMdoHQnvAmEnQHyPFzh58FyU3k6URqJCkF1Z83GReAWMkCANm CvG/A1Eeu6FYR0eMAxA41aWrPQjIpDYxFQ== X-Google-Smtp-Source: ABdhPJwqFhpMXeJMOhy/YbKOcBx3Oo2QqH7V6xa74mG6OAmb6R578hunFbyxhdXte4Yd8KF7nHos1A== X-Received: by 2002:a17:906:7f10:: with SMTP id d16mr14334886ejr.104.1607762681060; Sat, 12 Dec 2020 00:44:41 -0800 (PST) Received: from ?IPv6:2001:1715:4e2a:9550:298f:3309:710a:74ec? ([2001:1715:4e2a:9550:298f:3309:710a:74ec]) by smtp.gmail.com with ESMTPSA id e18sm8589909ejr.3.2020.12.12.00.44.39 (version=TLS1_2 cipher=ECDHE-ECDSA-AES128-GCM-SHA256 bits=128/128); Sat, 12 Dec 2020 00:44:40 -0800 (PST) Content-Type: text/plain; charset=us-ascii Mime-Version: 1.0 (Mac OS X Mail 14.0 \(3654.20.0.2.21\)) Subject: Re: Consistency of pkg db on UFS From: techyNotes In-Reply-To: <20201211165713.syvzamtdtrbrgx44@frix230> Date: Sat, 12 Dec 2020 09:44:39 +0100 Cc: freebsd-fs@freebsd.org, freebsd-stable@freebsd.org Content-Transfer-Encoding: quoted-printable Message-Id: References: <20201211165713.syvzamtdtrbrgx44@frix230> To: Ali Abdallah X-Mailer: Apple Mail (2.3654.20.0.2.21) X-Rspamd-Queue-Id: 4CtLn71LLPz4f75 X-Spamd-Bar: - Authentication-Results: mx1.freebsd.org; dkim=pass header.d=gmail.com header.s=20161025 header.b=uVV4IJrC; dmarc=pass (policy=none) header.from=gmail.com; spf=pass (mx1.freebsd.org: domain of techynotes@gmail.com designates 2a00:1450:4864:20::62e as permitted sender) smtp.mailfrom=techynotes@gmail.com X-Spamd-Result: default: False [-1.50 / 15.00]; RCVD_VIA_SMTP_AUTH(0.00)[]; TO_DN_SOME(0.00)[]; FREEMAIL_FROM(0.00)[gmail.com]; MV_CASE(0.50)[]; R_SPF_ALLOW(-0.20)[+ip6:2a00:1450:4000::/36]; RCVD_COUNT_THREE(0.00)[3]; DKIM_TRACE(0.00)[gmail.com:+]; DMARC_POLICY_ALLOW(-0.50)[gmail.com,none]; NEURAL_HAM_SHORT(-1.00)[-1.000]; FROM_EQ_ENVFROM(0.00)[]; MIME_TRACE(0.00)[0:+]; RBL_DBL_DONT_QUERY_IPS(0.00)[2a00:1450:4864:20::62e:from]; FREEMAIL_ENVFROM(0.00)[gmail.com]; MID_RHS_MATCH_FROM(0.00)[]; ASN(0.00)[asn:15169, ipnet:2a00:1450::/32, country:US]; ARC_NA(0.00)[]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; R_DKIM_ALLOW(-0.20)[gmail.com:s=20161025]; FROM_HAS_DN(0.00)[]; RCPT_COUNT_THREE(0.00)[3]; MIME_GOOD(-0.10)[text/plain]; DWL_DNSWL_NONE(0.00)[gmail.com:dkim]; SPAMHAUS_ZRD(0.00)[2a00:1450:4864:20::62e:from:127.0.2.255]; TO_MATCH_ENVRCPT_SOME(0.00)[]; NEURAL_SPAM_LONG(1.00)[1.000]; RCVD_IN_DNSWL_NONE(0.00)[2a00:1450:4864:20::62e:from]; RCVD_TLS_ALL(0.00)[]; MAILMAN_DEST(0.00)[freebsd-fs,freebsd-stable] X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.34 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 12 Dec 2020 08:44:44 -0000 Hi Ali I had a similar problem with my HP Elitebook couple of days ago with UFS = option. I had been experimenting with various modes and setup options = including the file system ZFS and UFS. I would have installed and = reinstalled Freebsd 12.2 more than 20 times!=20 I guess the issue lies in the Installation process. Just before the = final step of rebooting it takes sometime (more than when installing = with ZFS option) to complete the installation closure tasks. This was = not completed or you did not wait until the point the message popped up = to reboot the system! To verify if this is the case, check your loader.conf and/or rc.conf it = would be empty. The options you selected during the install process = would not be recorded in these files. SOLUTION: I just reinstalled again with the option of UFS and waited on = the last before step patiently and then finally rebooted upon the alter = message of REBOOT option from the installer. BTW, I have noticed, if you go back on installer steps on any options = already selected and try to reconfigure or change, then something goes = upside down in my experience so far:-=20 1.You can check - try changing more than 2 times on the wireless Region = Code ->Result: after the reboot, wpa_supplicant.conf may be messed up. 2.You can check - try changing the Boot parameters / System Hardening in = the last before step of the installer, the options you had already = selected during the install process may not be shown and would show = unselected for all available options. Something, maybe messed up post = install. The above-mentioned is only my experience so far. However, the installer = is very stable if you have a straight through selection in one go and = wait until you get the REBOOT Alert. Best regards, Sny > On 11 Dec 2020, at 17:57, Ali Abdallah via freebsd-stable = wrote: >=20 > Hello, >=20 > I've came across the following issues on a freshly installed system = with > a UFS SU+j root partition. >=20 > # pkg install -y some_package > The package management tool is not yet installed on your system. > Do you want to fetch and install it now? [y/N]: y > # kldload SOME_MODULE > -> crash happens here (due to drm for example) >=20 > On next boot any attempt to use pkg results in the following message: >=20 > # pkg install nano > The package management tool is not yet installed on your system. > Do you want to fetch and install it now? [y/N]: y > Bootstrapping pkg from > pkg+http://pkg.FreeBSD.org/FreeBSD:12:amd64/quarterly, please wait... > Verifying signature with trusted certificate > pkg.freebsd.org.2013102301... done > Installing pkg-1.15.10... > the most recent version of pkg-1.15.10 is already installed >=20 > It seems that /var/db/pkg/local.sqlite contains entry for the = installed > packages, but those packages didn't make it to the filesystem. >=20 > Is this because the db is fsynced while the actual package data is = not? >=20 > The issue is very easy to reproduce (on a VM for instance). > (I was not able to reproduce on a ZFS root filesystem). >=20 > Regards, > Ali >=20 > _______________________________________________ > freebsd-stable@freebsd.org mailing list > https://lists.freebsd.org/mailman/listinfo/freebsd-stable > To unsubscribe, send any mail to = "freebsd-stable-unsubscribe@freebsd.org"