From owner-freebsd-stable@freebsd.org Sat Mar 6 18:39:11 2021 Return-Path: Delivered-To: freebsd-stable@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 5538756F14D for ; Sat, 6 Mar 2021 18:39:11 +0000 (UTC) (envelope-from gonzo@bluezbox.com) Received: from mailman.nyi.freebsd.org (mailman.nyi.freebsd.org [IPv6:2610:1c1:1:606c::50:13]) by mx1.freebsd.org (Postfix) with ESMTP id 4DtD0G6V1Vz4gfj for ; Sat, 6 Mar 2021 18:39:10 +0000 (UTC) (envelope-from gonzo@bluezbox.com) Received: by mailman.nyi.freebsd.org (Postfix) id DA2F956F14C; Sat, 6 Mar 2021 18:39:10 +0000 (UTC) Delivered-To: stable@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id D972A56EFFB; Sat, 6 Mar 2021 18:39:10 +0000 (UTC) (envelope-from gonzo@bluezbox.com) Received: from id.bluezbox.com (id.bluezbox.com [45.55.20.155]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4DtD0G5gL4z4gRT; Sat, 6 Mar 2021 18:39:10 +0000 (UTC) (envelope-from gonzo@bluezbox.com) DKIM-Signature: v=1; a=rsa-sha256; q=dns/txt; c=relaxed/relaxed; d=bluezbox.com; s=mail; h=In-Reply-To:Content-Type:MIME-Version:References: Message-ID:Subject:Cc:To:From:Date:Sender:Reply-To:Content-Transfer-Encoding: Content-ID:Content-Description:Resent-Date:Resent-From:Resent-Sender: Resent-To:Resent-Cc:Resent-Message-ID:List-Id:List-Help:List-Unsubscribe: List-Subscribe:List-Post:List-Owner:List-Archive; bh=b/pb8IkyJlyeTcex6lzZ6L0PFf4FxMf2emZoSSBPKeI=; b=NoqSckVt/U0mWHDSW1Z+UxtK+q UuPguiR1mtR7CvoSnozOP4lWW/aRquNItq7Q7cId0FkUAQWK5hcSjgiRqutWBZarI8LaY+xFI/yD0 g6J8nEnkftI50UIc9VfkwseX52dZINQ+sFUeVA/tCU0joa0bgRZ0S7Tqk4PuxrFE5Css=; Received: from localhost ([127.0.0.1] helo=id.bluezbox.com) by id.bluezbox.com with esmtps (TLS1.2) tls TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384 (Exim 4.94 (FreeBSD)) (envelope-from ) id 1lIbpO-0006uU-QL; Sat, 06 Mar 2021 10:39:03 -0800 Received: (from gonzo@localhost) by id.bluezbox.com (8.15.2/8.15.2/Submit) id 126Id29N026565; Sat, 6 Mar 2021 10:39:02 -0800 (PST) (envelope-from gonzo@bluezbox.com) X-Authentication-Warning: id.bluezbox.com: gonzo set sender to gonzo@bluezbox.com using -f Date: Sat, 6 Mar 2021 10:39:02 -0800 From: Oleksandr Tymoshenko To: Peter Jeremy Cc: stable@freebsd.org, current@freebsd.org, arm@freebsd.org Subject: Re: geli broken in 13.0-BETA4 and later on armv8 Message-ID: <20210306183901.GA26556@bluezbox.com> References: MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: X-Operating-System: FreeBSD/11.2-RELEASE-p10 (amd64) X-Spam-Level: -- X-Spam-Report: Spam detection software, running on the system "id.bluezbox.com", has NOT identified this incoming email as spam. The original message has been attached to this so you can view it or label similar future email. If you have any questions, see The administrator of that system for details. Content preview: Peter Jeremy via freebsd-current (freebsd-current@freebsd.org) wrote: > [Adding arm@ and making it clearer that this is armv8-only] > > On 2021-Mar-06 20:26:19 +1100, Peter Jeremy List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 06 Mar 2021 18:39:11 -0000 Peter Jeremy via freebsd-current (freebsd-current@freebsd.org) wrote: > [Adding arm@ and making it clearer that this is armv8-only] > > On 2021-Mar-06 20:26:19 +1100, Peter Jeremy wrote: > >On 2021-Mar-06 19:18:37 +1100, Peter Jeremy via freebsd-stable wrote: > >>Somewhere between 13.0-ALPHA2 (c256201-g02611ef8ee9) and 13.0-BETA4 > >>(releng/13.0-n244592-e32bc253629), geli (at least on my RockPro64 - > >>RK3399, arm64) has changed so that a geli-encrypted partition (using > >>AES-XTS 128) that was readable on 13.0-ALPHA2 becomes garbage on > >>13.0-BETA4. > > > >I've confirmed that the problem is f76393a6305b - reverting that > >commit fixes the problem in releng/13.0. > > > >I've further verified that the bug is still present in main (14.x) > >at 028616d0dd69. Could you test this patch and let me know if it fixes the issue? https://people.freebsd.org/~gonzo/patches/armv8crypto-xts-fix.diff Thanks -- gonzo From owner-freebsd-stable@freebsd.org Sun Mar 7 09:06:18 2021 Return-Path: Delivered-To: freebsd-stable@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 5F64355EF1B for ; Sun, 7 Mar 2021 09:06:18 +0000 (UTC) (envelope-from freebsd@gndrsh.dnsmgr.net) Received: from gndrsh.dnsmgr.net (br1.CN84in.dnsmgr.net [69.59.192.140]) (using TLSv1 with cipher DHE-RSA-AES256-SHA (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4DtbDn3W7Tz4Y6n; Sun, 7 Mar 2021 09:06:16 +0000 (UTC) (envelope-from freebsd@gndrsh.dnsmgr.net) Received: from gndrsh.dnsmgr.net (localhost [127.0.0.1]) by gndrsh.dnsmgr.net (8.13.3/8.13.3) with ESMTP id 12796EtO067616; Sun, 7 Mar 2021 01:06:14 -0800 (PST) (envelope-from freebsd@gndrsh.dnsmgr.net) Received: (from freebsd@localhost) by gndrsh.dnsmgr.net (8.13.3/8.13.3/Submit) id 12796EXp067615; Sun, 7 Mar 2021 01:06:14 -0800 (PST) (envelope-from freebsd) From: "Rodney W. Grimes" Message-Id: <202103070906.12796EXp067615@gndrsh.dnsmgr.net> Subject: FreeBSD-13.0-RC1-amd64-disc1.iso unbootable on memstick To: gjb@freebsd.org Date: Sun, 7 Mar 2021 01:06:14 -0800 (PST) CC: freebsd-stable@freebsd.org Reply-To: rgrimes@freebsd.org X-Mailer: ELM [version 2.4ME+ PL121h (25)] MIME-Version: 1.0 Content-Transfer-Encoding: 7bit Content-Type: text/plain; charset=US-ASCII X-Rspamd-Queue-Id: 4DtbDn3W7Tz4Y6n X-Spamd-Bar: -- Authentication-Results: mx1.freebsd.org; dkim=none; dmarc=none; spf=none (mx1.freebsd.org: domain of freebsd@gndrsh.dnsmgr.net has no SPF policy when checking 69.59.192.140) smtp.mailfrom=freebsd@gndrsh.dnsmgr.net X-Spamd-Result: default: False [-2.09 / 15.00]; HAS_REPLYTO(0.00)[rgrimes@freebsd.org]; ARC_NA(0.00)[]; MID_RHS_MATCH_FROM(0.00)[]; FROM_HAS_DN(0.00)[]; RBL_DBL_DONT_QUERY_IPS(0.00)[69.59.192.140:from]; TO_MATCH_ENVRCPT_ALL(0.00)[]; NEURAL_HAM_LONG(-1.00)[-1.000]; MIME_GOOD(-0.10)[text/plain]; TO_DN_NONE(0.00)[]; REPLYTO_DOM_NEQ_FROM_DOM(0.00)[]; AUTH_NA(1.00)[]; DMARC_NA(0.00)[dnsmgr.net]; SPAMHAUS_ZRD(0.00)[69.59.192.140:from:127.0.2.255]; RCVD_TLS_LAST(0.00)[]; NEURAL_HAM_SHORT(-1.00)[-1.000]; RCPT_COUNT_TWO(0.00)[2]; NEURAL_HAM_MEDIUM(-0.99)[-0.993]; R_SPF_NA(0.00)[no SPF record]; FROM_EQ_ENVFROM(0.00)[]; R_DKIM_NA(0.00)[]; MIME_TRACE(0.00)[0:+]; ASN(0.00)[asn:13868, ipnet:69.59.192.0/19, country:US]; RCVD_COUNT_TWO(0.00)[2]; MAILMAN_DEST(0.00)[freebsd-stable] X-Mailman-Approved-At: Sun, 07 Mar 2021 09:46:48 +0000 X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.34 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 07 Mar 2021 09:06:18 -0000 Glen, Things get worse... I could at least boot the BETA4 .iso when I wrote it to a memstick. I can NOT boot the RC1. I have checked the sha512 of my image, wrote it twice, same results, I get: CD Loader 1.2 Bulding the boot loader arguments Looking up /BOOT/LOADER... File not found Looking up /boot/loader... File not found Boot failed I have tried 2 different systems, all known to have booted and installed many many many FreeBSD's from prior .iso written to memstick. Regards, -- Rod Grimes rgrimes@freebsd.org From owner-freebsd-stable@freebsd.org Sun Mar 7 10:55:44 2021 Return-Path: Delivered-To: freebsd-stable@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id C55CA56298C for ; Sun, 7 Mar 2021 10:55:44 +0000 (UTC) (envelope-from junchoon@dec.sakura.ne.jp) Received: from www121.sakura.ne.jp (www121.sakura.ne.jp [153.125.133.21]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4Dtdg42ktPz4f6l; Sun, 7 Mar 2021 10:55:43 +0000 (UTC) (envelope-from junchoon@dec.sakura.ne.jp) Received: from kalamity.joker.local (115-38-180-10.area1c.commufa.jp [115.38.180.10]) (authenticated bits=0) by www121.sakura.ne.jp (8.16.1/8.16.1/[SAKURA-WEB]/20201212) with ESMTPA id 127AtXce044230; Sun, 7 Mar 2021 19:55:34 +0900 (JST) (envelope-from junchoon@dec.sakura.ne.jp) Date: Sun, 7 Mar 2021 19:55:33 +0900 From: Tomoaki AOKI To: freebsd-stable@freebsd.org Cc: rgrimes@freebsd.org Subject: Re: FreeBSD-13.0-RC1-amd64-disc1.iso unbootable on memstick Message-Id: <20210307195533.f92a0573c77213d1d41eb24d@dec.sakura.ne.jp> In-Reply-To: <202103070906.12796EXp067615@gndrsh.dnsmgr.net> References: <202103070906.12796EXp067615@gndrsh.dnsmgr.net> Reply-To: junchoon@dec.sakura.ne.jp Organization: Junchoon corps X-Mailer: Sylpheed 3.7.0 (GTK+ 2.24.33; amd64-portbld-freebsd13.0) Mime-Version: 1.0 Content-Type: text/plain; charset=US-ASCII Content-Transfer-Encoding: 7bit X-Rspamd-Queue-Id: 4Dtdg42ktPz4f6l X-Spamd-Bar: ---- Authentication-Results: mx1.freebsd.org; none X-Spamd-Result: default: False [-4.00 / 15.00]; REPLY(-4.00)[] X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.34 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 07 Mar 2021 10:55:44 -0000 Hi. Are you shure you're using *.memstick.img? *.iso are for optical drives. If your memstick can perfectly (or at least enough for CD loader and kernel) mimic optical drive, maybe with help by firmware, it would be able to boot. Otherwise, you should write FreeBSD-13.0-RC1-*-memstick.img with dd. If you are using enough-sized memstick and amd64 arch PC, FreeBSD-13.0-RC1-amd64-mrmstick.img should be preferred. Note that if you downloaded smaller xz compressed image, you shoule decompress it before writing. If you are using *-memstick.img, something should need fixed. On Sun, 7 Mar 2021 01:06:14 -0800 (PST) "Rodney W. Grimes" wrote: > Glen, > Things get worse... I could at least boot the BETA4 .iso when > I wrote it to a memstick. I can NOT boot the RC1. I have checked > the sha512 of my image, wrote it twice, same results, I get: > > CD Loader 1.2 > > Bulding the boot loader arguments > Looking up /BOOT/LOADER... File not found > Looking up /boot/loader... File not found > Boot failed > > I have tried 2 different systems, all known to have booted and > installed many many many FreeBSD's from prior .iso written to > memstick. > > Regards, > -- > Rod Grimes rgrimes@freebsd.org > _______________________________________________ > freebsd-stable@freebsd.org mailing list > https://lists.freebsd.org/mailman/listinfo/freebsd-stable > To unsubscribe, send any mail to "freebsd-stable-unsubscribe@freebsd.org" -- Tomoaki AOKI From owner-freebsd-stable@freebsd.org Sun Mar 7 11:18:46 2021 Return-Path: Delivered-To: freebsd-stable@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id AB7CB5636F4 for ; Sun, 7 Mar 2021 11:18:46 +0000 (UTC) (envelope-from freebsd@gndrsh.dnsmgr.net) Received: from gndrsh.dnsmgr.net (br1.CN84in.dnsmgr.net [69.59.192.140]) (using TLSv1 with cipher DHE-RSA-AES256-SHA (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4Dtf9f27xtz4grW; Sun, 7 Mar 2021 11:18:45 +0000 (UTC) (envelope-from freebsd@gndrsh.dnsmgr.net) Received: from gndrsh.dnsmgr.net (localhost [127.0.0.1]) by gndrsh.dnsmgr.net (8.13.3/8.13.3) with ESMTP id 127BIdtP068338; Sun, 7 Mar 2021 03:18:39 -0800 (PST) (envelope-from freebsd@gndrsh.dnsmgr.net) Received: (from freebsd@localhost) by gndrsh.dnsmgr.net (8.13.3/8.13.3/Submit) id 127BId2B068337; Sun, 7 Mar 2021 03:18:39 -0800 (PST) (envelope-from freebsd) From: "Rodney W. Grimes" Message-Id: <202103071118.127BId2B068337@gndrsh.dnsmgr.net> Subject: Re: FreeBSD-13.0-RC1-amd64-disc1.iso unbootable on memstick In-Reply-To: <20210307195533.f92a0573c77213d1d41eb24d@dec.sakura.ne.jp> To: junchoon@dec.sakura.ne.jp Date: Sun, 7 Mar 2021 03:18:39 -0800 (PST) CC: freebsd-stable@freebsd.org, rgrimes@freebsd.org Reply-To: rgrimes@freebsd.org X-Mailer: ELM [version 2.4ME+ PL121h (25)] MIME-Version: 1.0 Content-Transfer-Encoding: 7bit Content-Type: text/plain; charset=US-ASCII X-Rspamd-Queue-Id: 4Dtf9f27xtz4grW X-Spamd-Bar: ---- Authentication-Results: mx1.freebsd.org; none X-Spamd-Result: default: False [-4.00 / 15.00]; REPLY(-4.00)[] X-Mailman-Approved-At: Sun, 07 Mar 2021 16:49:25 +0000 X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.34 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 07 Mar 2021 11:18:46 -0000 > Hi. > > Are you shure you're using *.memstick.img? I am shure I am NOT using memstick, as the subject says I am using: FreeBSD-13.0-RC1-amd64-disc1.iso > *.iso are for optical drives. Ah, not since 12.0, these are now "hybrid" type images that are designed to be written to either a dvd or memstick. > If your memstick can perfectly (or at least enough for CD loader and > kernel) mimic optical drive, maybe with help by firmware, it would be > able to boot. > > Otherwise, you should write FreeBSD-13.0-RC1-*-memstick.img with > dd. If you are using enough-sized memstick and amd64 arch PC, > FreeBSD-13.0-RC1-amd64-mrmstick.img should be preferred. > > Note that if you downloaded smaller xz compressed image, you shoule > decompress it before writing. > > If you are using *-memstick.img, something should need fixed. I have tested the memstick image it works fine. I have also done further investigation and this appears to be a Legacy/bios vs EFI mode issue. All legacy only machines fail to boot with the above error, all dual mode machines must be forced into either EFI only, or dual mode/EFI first inorder to boot these images. EFI only machines boot fine. Is what it looks like is we have lost the ability to boot the .iso images in bios mode from a memory stick. I have NOT done any testing on dvd media. Further note all of this works fine upto and including BETA4 on all my legacy bios machines, though I do see another environment that fails at BETA4 and continues to, but that is rather special, called ventoy: https://www.ventoy.net/ that environment is probably looking very much like a legacy BIOS system as to the way I have my ventoy setup. > On Sun, 7 Mar 2021 01:06:14 -0800 (PST) > "Rodney W. Grimes" wrote: > > > Glen, > > Things get worse... I could at least boot the BETA4 .iso when > > I wrote it to a memstick. I can NOT boot the RC1. I have checked > > the sha512 of my image, wrote it twice, same results, I get: I have now had Michael Dexter duplicate my findings, if he sets his machines to either legacy first, or legacy only he gets the same boot failures that I do when using the FreeBSD-13.0-RC1-amd64-disc1.iso image. > > > > CD Loader 1.2 > > > > Bulding the boot loader arguments > > Looking up /BOOT/LOADER... File not found > > Looking up /boot/loader... File not found > > Boot failed > > > > I have tried 2 different systems, all known to have booted and > > installed many many many FreeBSD's from prior .iso written to > > memstick. Now expanded to 4 systems, 2 of which can do dual mode Legacy/EFI. > > > > Regards, > > -- > > Rod Grimes rgrimes@freebsd.org > > _______________________________________________ > > freebsd-stable@freebsd.org mailing list > > https://lists.freebsd.org/mailman/listinfo/freebsd-stable > > To unsubscribe, send any mail to "freebsd-stable-unsubscribe@freebsd.org" > > > -- > Tomoaki AOKI > -- Rod Grimes rgrimes@freebsd.org From owner-freebsd-stable@freebsd.org Sun Mar 7 17:33:37 2021 Return-Path: Delivered-To: freebsd-stable@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id E692A56D851 for ; Sun, 7 Mar 2021 17:33:37 +0000 (UTC) (envelope-from wlosh@bsdimp.com) Received: from mail-qk1-x72b.google.com (mail-qk1-x72b.google.com [IPv6:2607:f8b0:4864:20::72b]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "GTS CA 1O1" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4DtpV962Tdz3Jm9 for ; Sun, 7 Mar 2021 17:33:37 +0000 (UTC) (envelope-from wlosh@bsdimp.com) Received: by mail-qk1-x72b.google.com with SMTP id z190so7136706qka.9 for ; Sun, 07 Mar 2021 09:33:37 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=bsdimp-com.20150623.gappssmtp.com; s=20150623; h=mime-version:references:in-reply-to:from:date:message-id:subject:to :cc; bh=SGl6IbjJo7eLOnDvjWVrHNDD247E9pmmpb9/CU49grk=; b=HE5D23HysNRS+K5RwiTS251IOLOPgtnkGp9eKW5FVYMjNFUtakNORbYkyLiCvtHM0D vODBZJZZyA56PHNOf9Wq+r4Kycipr+39ONdjOUlzWi7SezWVpW4FmMSsdqO6rU0knfEY Lc2a/RTT9s+j/eCKdSRqfBRU/KJKgv5knRcIS8fB/YWGOcBUeg7vfk6708XlMbVWSp2A Ul8roLwT0skaxX1fCjD+T+zNcnVEyEbnFoUtmX1vkP+YohLUZSXVsLApDktFt9FqJ7L6 B5HphsKePoC2w9gyH8/AD3lXMyYC/BwsQYHUgw3tWbFLlBaONObWTfwbsXob2fegiwPq MnVA== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:references:in-reply-to:from:date :message-id:subject:to:cc; bh=SGl6IbjJo7eLOnDvjWVrHNDD247E9pmmpb9/CU49grk=; b=rPduySwYmJRH23Yo6W8oQNz2w1fp/jC2vbuQJQYZBwZ0WB5SB2XnvJxFuKqyas0bYX 3ftXvPT4Xeq7jXGxJaJ1SH+nnVBjWoz272rGLhpfDLhZAx8My0HRTVZWGhnQ8fWtoCwn xR07vOlruxFY7+i5z+xGX5dSC6SpTJVbjkedjV/fmkJTDwdOTEt6WlKo4QmCIsUYAxsZ uwlxSB8vR1Ozs8l6LQWXdHqJ3VWMyq1MqHQi7z4OoVAXQZISR6AvnpU4f1Tga9D4/RZH aGoyYcRYIYSuVLHjegH+/NwOBm/Rf2RFWC3j1KmaR5UirFPrWPJ4a6T1xjTJI53jYt25 HuVA== X-Gm-Message-State: AOAM531qlq8mfitjOeQOwwFQlWWeUatHb7xvpO8e2AcLZUUJL+7FYu78 WiQkeIwsjBpfQw7vcgrQebtSe9EE+KHBz0GDTWT9BvOuUwI= X-Google-Smtp-Source: ABdhPJxurRgiHDucTLy856Yuu4gOUylJQmbqQgm2jbsNpX43w0PuxLovKk8+EtjuK/Sf2fecG8wm/HWAWeF7K7W1D9w= X-Received: by 2002:a37:a48a:: with SMTP id n132mr16812285qke.359.1615138416793; Sun, 07 Mar 2021 09:33:36 -0800 (PST) MIME-Version: 1.0 References: <20210307195533.f92a0573c77213d1d41eb24d@dec.sakura.ne.jp> <202103071118.127BId2B068337@gndrsh.dnsmgr.net> In-Reply-To: <202103071118.127BId2B068337@gndrsh.dnsmgr.net> From: Warner Losh Date: Sun, 7 Mar 2021 10:33:24 -0700 Message-ID: Subject: Re: FreeBSD-13.0-RC1-amd64-disc1.iso unbootable on memstick To: "Rodney W. Grimes" Cc: Tomoaki AOKI , FreeBSD-STABLE Mailing List X-Rspamd-Queue-Id: 4DtpV962Tdz3Jm9 X-Spamd-Bar: ---- Authentication-Results: mx1.freebsd.org; none X-Spamd-Result: default: False [-4.00 / 15.00]; REPLY(-4.00)[] Content-Type: text/plain; charset="UTF-8" X-Content-Filtered-By: Mailman/MimeDel 2.1.34 X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.34 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 07 Mar 2021 17:33:38 -0000 On Sun, Mar 7, 2021, 9:49 AM Rodney W. Grimes wrote: > > Hi. > > > > Are you shure you're using *.memstick.img? > > I am shure I am NOT using memstick, as the subject says > I am using: > FreeBSD-13.0-RC1-amd64-disc1.iso > > > > *.iso are for optical drives. > > Ah, not since 12.0, these are now "hybrid" type images that > are designed to be written to either a dvd or memstick. > > > If your memstick can perfectly (or at least enough for CD loader and > > kernel) mimic optical drive, maybe with help by firmware, it would be > > able to boot. > > > > Otherwise, you should write FreeBSD-13.0-RC1-*-memstick.img with > > dd. If you are using enough-sized memstick and amd64 arch PC, > > FreeBSD-13.0-RC1-amd64-mrmstick.img should be preferred. > > > > Note that if you downloaded smaller xz compressed image, you shoule > > decompress it before writing. > > > > If you are using *-memstick.img, something should need fixed. > > I have tested the memstick image it works fine. > > I have also done further investigation and this appears to be > a Legacy/bios vs EFI mode issue. All legacy only machines > fail to boot with the above error, all dual mode machines > must be forced into either EFI only, or dual mode/EFI first > inorder to boot these images. EFI only machines boot fine. > > Is what it looks like is we have lost the ability to boot > the .iso images in bios mode from a memory stick. I have > NOT done any testing on dvd media. > > Further note all of this works fine upto and including BETA4 > on all my legacy bios machines, though I do see another > environment that fails at BETA4 and continues to, but that > is rather special, called ventoy: > https://www.ventoy.net/ > that environment is probably looking very much like a > legacy BIOS system as to the way I have my ventoy setup. > By chance, have you tried this with qemu or bhyve? If it is reproducible there, it's a lot easier to investigate. Bisecting changes on the releng/13.0 branch becomes possible quickly then.... Warner > > On Sun, 7 Mar 2021 01:06:14 -0800 (PST) > > "Rodney W. Grimes" wrote: > > > > > Glen, > > > Things get worse... I could at least boot the BETA4 .iso when > > > I wrote it to a memstick. I can NOT boot the RC1. I have checked > > > the sha512 of my image, wrote it twice, same results, I get: > > I have now had Michael Dexter duplicate my findings, if he > sets his machines to either legacy first, or legacy only > he gets the same boot failures that I do when using the > FreeBSD-13.0-RC1-amd64-disc1.iso > image. > > > > > > > CD Loader 1.2 > > > > > > Bulding the boot loader arguments > > > Looking up /BOOT/LOADER... File not found > > > Looking up /boot/loader... File not found > > > Boot failed > > > > > > I have tried 2 different systems, all known to have booted and > > > installed many many many FreeBSD's from prior .iso written to > > > memstick. > > Now expanded to 4 systems, 2 of which can do dual mode Legacy/EFI. > > > > > > > Regards, > > > -- > > > Rod Grimes > rgrimes@freebsd.org > > > _______________________________________________ > > > freebsd-stable@freebsd.org mailing list > > > https://lists.freebsd.org/mailman/listinfo/freebsd-stable > > > To unsubscribe, send any mail to " > freebsd-stable-unsubscribe@freebsd.org" > > > > > > -- > > Tomoaki AOKI > > > > -- > Rod Grimes > rgrimes@freebsd.org > _______________________________________________ > freebsd-stable@freebsd.org mailing list > https://lists.freebsd.org/mailman/listinfo/freebsd-stable > To unsubscribe, send any mail to "freebsd-stable-unsubscribe@freebsd.org" > From owner-freebsd-stable@freebsd.org Mon Mar 8 03:54:26 2021 Return-Path: Delivered-To: freebsd-stable@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 994A85638D9 for ; Mon, 8 Mar 2021 03:54:26 +0000 (UTC) (envelope-from ota@j.email.ne.jp) Received: from mailman.nyi.freebsd.org (unknown [127.0.1.3]) by mx1.freebsd.org (Postfix) with ESMTP id 4Dv4GV37jZz3Lcg for ; Mon, 8 Mar 2021 03:54:26 +0000 (UTC) (envelope-from ota@j.email.ne.jp) Received: by mailman.nyi.freebsd.org (Postfix) id 694E05638D8; Mon, 8 Mar 2021 03:54:26 +0000 (UTC) Delivered-To: stable@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 691275638D7 for ; Mon, 8 Mar 2021 03:54:26 +0000 (UTC) (envelope-from ota@j.email.ne.jp) Received: from mail01.asahi-net.or.jp (mail01.asahi-net.or.jp [202.224.55.13]) by mx1.freebsd.org (Postfix) with ESMTP id 4Dv4GS47Cpz3Lfd; Mon, 8 Mar 2021 03:54:23 +0000 (UTC) (envelope-from ota@j.email.ne.jp) Received: from vmware12.advok.com (cpe-184-152-96-96.nj.res.rr.com [184.152.96.96]) (Authenticated sender: NR2Y-OOT) by mail01.asahi-net.or.jp (Postfix) with ESMTPSA id 7E7F112ED6E; Mon, 8 Mar 2021 12:54:20 +0900 (JST) Date: Sun, 7 Mar 2021 22:24:41 -0500 From: Yoshihiro Ota To: Andriy Gapon , stable@freebsd.org Subject: Re: kldload zfs spins the system after upgrading from 12.2 to 13-BETA Message-Id: <20210307222441.02755e7396cd329edd15df15@j.email.ne.jp> In-Reply-To: <9f9db150-ee5d-e74e-7f24-74d1fa687a48@FreeBSD.org> References: <20210306130913.dae1fb546e68bcaec882cdbe@j.email.ne.jp> <9f9db150-ee5d-e74e-7f24-74d1fa687a48@FreeBSD.org> X-Mailer: Sylpheed 3.7.0 (GTK+ 2.24.32; i386-portbld-freebsd12.1) Mime-Version: 1.0 Content-Type: text/plain; charset=US-ASCII Content-Transfer-Encoding: 7bit X-Rspamd-Queue-Id: 4Dv4GS47Cpz3Lfd X-Spamd-Bar: / Authentication-Results: mx1.freebsd.org; dkim=none; dmarc=none; spf=pass (mx1.freebsd.org: domain of ota@j.email.ne.jp designates 202.224.55.13 as permitted sender) smtp.mailfrom=ota@j.email.ne.jp X-Spamd-Result: default: False [0.92 / 15.00]; RCVD_VIA_SMTP_AUTH(0.00)[]; TO_DN_SOME(0.00)[]; MV_CASE(0.50)[]; R_SPF_ALLOW(0.00)[+ip4:202.224.55.0/24]; RCPT_COUNT_TWO(0.00)[2]; RCVD_NO_TLS_LAST(0.10)[]; RECEIVED_SPAMHAUS_PBL(0.00)[184.152.96.96:received]; MIME_TRACE(0.00)[0:+]; RBL_DBL_DONT_QUERY_IPS(0.00)[202.224.55.13:from]; FROM_EQ_ENVFROM(0.00)[]; R_DKIM_NA(0.00)[]; MID_RHS_MATCH_FROM(0.00)[]; ASN(0.00)[asn:4685, ipnet:202.224.32.0/19, country:JP]; ARC_NA(0.00)[]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; RCVD_IN_DNSWL_LOW(-0.10)[202.224.55.13:from]; FROM_HAS_DN(0.00)[]; TO_MATCH_ENVRCPT_ALL(0.00)[]; NEURAL_HAM_LONG(-1.00)[-1.000]; MIME_GOOD(-0.10)[text/plain]; DMARC_NA(0.00)[email.ne.jp]; BAD_REP_POLICIES(0.10)[]; SPAMHAUS_ZRD(0.00)[202.224.55.13:from:127.0.2.255]; NEURAL_SPAM_SHORT(0.42)[0.422]; RWL_MAILSPIKE_POSSIBLE(0.00)[202.224.55.13:from]; RBL_SENDERSCORE(2.00)[202.224.55.13:from]; RCVD_COUNT_TWO(0.00)[2]; MAILMAN_DEST(0.00)[stable] X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.34 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 08 Mar 2021 03:54:26 -0000 On Sun, 7 Mar 2021 00:09:33 +0200 Andriy Gapon wrote: > On 06/03/2021 20:09, Yoshihiro Ota wrote: > > Hi all, > > > > I'm upgrading fron 12.2-RELEASE to 13-BETA/RC one by one. > > > > After upgrading one in VMWare, 'zfs mount -a' hangs the system. > > I don't have boottime zfs mount on nor don't have zfsroot. > > I just simply ran install world/kernel and mergemaster. > > Please use procstat -kk to capture a kernel stack trace of the hung process. Actually, spining was 'kldload zfs'. Console doesn't response but ping and sshd sessions still work. procstat output is below. In addition, this doesn't happen to systems that I've been following 13-CURRENT but rather happen only wiht a system upgraded from 12.2-RELEASE to 13-RC. # procstat -kk 1049 PID TID COMM TDNAME KSTACK 1049 100215 kldload - spa_init+0xc6 zfs_kmod_init+0x1a zfs_modevent+0x34 module_register_init+0x8c linker_load_module+0xaab kern_kldload+0xc1 sys_kldload+0x50 syscall+0x17d g_ctx+0xe280bf29 From owner-freebsd-stable@freebsd.org Mon Mar 8 08:52:44 2021 Return-Path: Delivered-To: freebsd-stable@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 4929756AE00; Mon, 8 Mar 2021 08:52:44 +0000 (UTC) (envelope-from garbytrash@gmail.com) Received: from mail-io1-xd29.google.com (mail-io1-xd29.google.com [IPv6:2607:f8b0:4864:20::d29]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "GTS CA 1O1" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4DvBtg569Tz3qsV; Mon, 8 Mar 2021 08:52:43 +0000 (UTC) (envelope-from garbytrash@gmail.com) Received: by mail-io1-xd29.google.com with SMTP id 81so9067146iou.11; Mon, 08 Mar 2021 00:52:43 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=mime-version:from:date:message-id:subject:to:cc; bh=Kw2CV4jQinlrPs0sLG99V6cE/RkktfR8YkKjEKN671U=; b=PFQ9y9y8VCxgIt+rts4r5aL9jSjjs3oVAfxEp3+4u6JqViq52xVSStAjI3kJJrQ6F2 D9wuYHf6512SYjdJiMiFyFZ00jQM3TabA7iMLUDdceWqUGQ5kYmUVKh84c7Z+oMgha4C QPTTEt6l0lkGp4nqJMJ7y7Ik/vMKppSh/uQVIjtOjKe4hTzL7JiuY0y+ShklojlCDx/S ResNBgqCaNSYvJFH71iNKHTqg72DPRnaIn7LzHgm/QTYSTsfEEwD6Nxp7cJeg49viaQa hOtcKnIrDprfJoOa9kfgp7kI8I6nyyiqhyBNxw3cVg8avHQ9vgW0YWI/vlt+VN1nDfWI 2ChQ== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:from:date:message-id:subject:to:cc; bh=Kw2CV4jQinlrPs0sLG99V6cE/RkktfR8YkKjEKN671U=; b=gA0Gol+VcDaYtHDw/9wcceWR5ua5l4nYbO685OsypoF4A6qrcQuH2a+X9SJvkZMo+x Uyk0KPyEXoRRPvUMqsDb7+Lqr4zUsmlsNTMeIH3NHUwsZ+sd0ACi8OpLYHkwNbQ9dG+E ZVgdVuetqSL6rcvVhv58eS6ZPZ3PRbvgRn0V+8PfILwSdx0LnjPElhgRMY7/B58GaSv6 9RF8ALL51ZkSvaiLdzv+NX7tki9WOcNBa3IopuOJ8uozvV6SnPnn+TP62OioO9fUpQhT 4C0UzHqrzpFrCRysm9eMw+pwoeIQGM84nAtWpMxn/EiNl8k1ekRloc6YqYuUhhCR1lwG Fn0w== X-Gm-Message-State: AOAM532dBSuxq2WRYUcqyX6Z6CaI2eS/86ERMoJaYFRt6uJuqXpDIRHq GzGnUb5i23IrpEBp23Nm3aUUSRzqCRofQnX+a5Lwh6ofbq4= X-Google-Smtp-Source: ABdhPJwAPE/IokyI3EuSYCLFIgyA2+K7aUu0UCorGRxZHvr8WnKXUpJ5SYNl4axRpR6+r204LqTjKfPToIt6XsmbHOg= X-Received: by 2002:a05:6602:2be1:: with SMTP id d1mr17272055ioy.148.1615193562813; Mon, 08 Mar 2021 00:52:42 -0800 (PST) MIME-Version: 1.0 Received: by 2002:a5d:878f:0:0:0:0:0 with HTTP; Mon, 8 Mar 2021 00:52:42 -0800 (PST) From: Zenny Date: Mon, 8 Mar 2021 09:52:42 +0100 Message-ID: Subject: netgraph issues FBSD13.0-ALLSERIES To: freebsd-current Cc: freebsd-stable Content-Type: text/plain; charset="UTF-8" X-Rspamd-Queue-Id: 4DvBtg569Tz3qsV X-Spamd-Bar: -- Authentication-Results: mx1.freebsd.org; dkim=pass header.d=gmail.com header.s=20161025 header.b=PFQ9y9y8; dmarc=pass (policy=none) header.from=gmail.com; spf=pass (mx1.freebsd.org: domain of garbytrash@gmail.com designates 2607:f8b0:4864:20::d29 as permitted sender) smtp.mailfrom=garbytrash@gmail.com X-Spamd-Result: default: False [-2.00 / 15.00]; ARC_NA(0.00)[]; RBL_DBL_DONT_QUERY_IPS(0.00)[2607:f8b0:4864:20::d29:from]; R_DKIM_ALLOW(-0.20)[gmail.com:s=20161025]; RCVD_TLS_ALL(0.00)[]; FROM_HAS_DN(0.00)[]; R_SPF_ALLOW(-0.20)[+ip6:2607:f8b0:4000::/36:c]; FREEMAIL_FROM(0.00)[gmail.com]; MIME_GOOD(-0.10)[text/plain]; TO_MATCH_ENVRCPT_ALL(0.00)[]; NEURAL_HAM_LONG(-1.00)[-1.000]; NEURAL_SPAM_SHORT(1.00)[1.000]; SPAMHAUS_ZRD(0.00)[2607:f8b0:4864:20::d29:from:127.0.2.255]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; TO_DN_ALL(0.00)[]; DKIM_TRACE(0.00)[gmail.com:+]; RCPT_COUNT_TWO(0.00)[2]; DMARC_POLICY_ALLOW(-0.50)[gmail.com,none]; RCVD_IN_DNSWL_NONE(0.00)[2607:f8b0:4864:20::d29:from]; FROM_EQ_ENVFROM(0.00)[]; MIME_TRACE(0.00)[0:+]; FREEMAIL_ENVFROM(0.00)[gmail.com]; ASN(0.00)[asn:15169, ipnet:2607:f8b0::/32, country:US]; RCVD_COUNT_TWO(0.00)[2]; MAILMAN_DEST(0.00)[freebsd-current,freebsd-stable]; DWL_DNSWL_NONE(0.00)[gmail.com:dkim] X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.34 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 08 Mar 2021 08:52:44 -0000 Hi, netgraph fails on concurrent node rename as I raised in https://github.com/genneko/freebsd-vimage-jails/issues/2. In summary, it gives an error that reads: "ng_ether_ifnet_arrival_event: can't re-name node vi0_v1" for each interface. Which is similar to bug reported in https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=241954 Any clue? Thanks! -- Cheers, /z -.. .. ... -.-. .-.. .- .. -- . .-. | -.. .. ... -.-. .-.. .- .. -- . .-. CONFIDENTIALITY NOTICE AND DISCLAIMER: Access to this e-mail and its contents by anyone other than the intended recipient is unauthorized as it contains privileged and confidential information, and is subject to legal privilege. Please do not re/distribute it. If you are not the intended recipient (or responsible for delivery of the message to such person), you may not use, copy, distribute or deliver the email and part of its contents to anyone this message (or any part of its contents or take any action in connection to it. In such case, you should destroy this message, and notify the sender immediately. If you have received this email in error, please notify the sender or your sysadmin immediately by e-mail or telephone, and delete the e-mail from any computer. If you or your employer does not consent to internet e-mail messages of this kind, please notify the sender immediately. All reasonable precautions have been taken to ensure no viruses are present in this e-mail and attachments included. As the sender cannot accept responsibility for any loss or damage arising from the use of this e-mail or attachments it is recommended that you are responsible to follow your virus checking procedures prior to use. The views, opinions, conclusions and other informations expressed in this electronic mail are not given or endorsed by any company including the network providers unless otherwise indicated by an authorized representative independent of this message. -.. .. ... -.-. .-.. .- .. -- . .-. | -.. .. ... -.-. .-.. .- .. -- . .-. From owner-freebsd-stable@freebsd.org Mon Mar 8 09:12:22 2021 Return-Path: Delivered-To: freebsd-stable@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 5284356B2B8 for ; Mon, 8 Mar 2021 09:12:22 +0000 (UTC) (envelope-from garbytrash@gmail.com) Received: from mail-io1-xd32.google.com (mail-io1-xd32.google.com [IPv6:2607:f8b0:4864:20::d32]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "GTS CA 1O1" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4DvCKK47d0z3sGK for ; Mon, 8 Mar 2021 09:12:21 +0000 (UTC) (envelope-from garbytrash@gmail.com) Received: by mail-io1-xd32.google.com with SMTP id o9so9148581iow.6 for ; Mon, 08 Mar 2021 01:12:21 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=mime-version:from:date:message-id:subject:to; bh=nIwSHYFBUkiWUABSwkFMoGaUc6tV8+5UtHd21CdFxbY=; b=KvhMJdNPRAFA7Wfo+RYRJi4YgwReRtM9Or/5fsf9Rd/xH6q+3g7MF7OcgEgmHC1RSR BIkxIJJT6S3id1vP/2lcPcDEdtYPl7NiUccq5OTwURdBzg3kL2ZSnDufHCWdxRTzxUQn t5K6fjfnnMwqj5MqDPAypaAiRDewNaqV8y8iDFdWwOiz4KixJBKM60wmp23fQ/XiDhqE DAlDTzcP5DbXnIQU+he/P2GuwMoTWUte86JKdt0mNt8hXsbfxz3zq59PE3YJNRujcze2 ZVSSMJ0xktUQn9WvPegZ/znWCajCNP59CdV3Cmz/B0RNXOjMN/EjlVrd4YbRlEKWpgZs AuWw== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:from:date:message-id:subject:to; bh=nIwSHYFBUkiWUABSwkFMoGaUc6tV8+5UtHd21CdFxbY=; b=h8KDuYVw2zWi6EvTmp3IItqLEF12536/FV8Hovs6qi8pzBzLcSfiJ5jreAcKtqIOWB Ssq2/6B7WZjhdFYk11ZJVadXaNdc5KnSVwTLwtE/w4vi6RVu4gxKK5eyX0C4wnIzALwo c2dlCp8FI3bUYZTLKJhHRH6Stn1NuO9QLt1U01OMkMpAZ+HkFG5TxJlUOl45kbffNyn7 pILyXdK1hwRJiT3qbZyLz2U3S7PMExEjObx4KMaI0iIRzsY6+/b2YHEBos1wlFJ19kOi efmNvEG8/K1FDYci4IPqkB9Pws+4xxSwKCF7f9gOPEXZp4JKeFAL3j/+fO+pRbv/0g/B BLDA== X-Gm-Message-State: AOAM530s5M3z3BhwSCaS1lygD5/CL7R7qsy6VCiBzonO5nqb8Ktv9YyE ngprOvyhjpGkBqRu9ouGNsQqlQB4YyIB4S91aoAvd9Jr/fM= X-Google-Smtp-Source: ABdhPJwPjx3DbbpHYLEBnkYSts0PhENMt/kJvIpahXKdFZ7LwVF582+BQDy4o/HTe+6xb25EAURTxgmT0I09R4pG6Dk= X-Received: by 2002:a02:9986:: with SMTP id a6mr22488324jal.46.1615194740111; Mon, 08 Mar 2021 01:12:20 -0800 (PST) MIME-Version: 1.0 Received: by 2002:a5d:878f:0:0:0:0:0 with HTTP; Mon, 8 Mar 2021 01:12:19 -0800 (PST) From: Zenny Date: Mon, 8 Mar 2021 10:12:19 +0100 Message-ID: Subject: Isolate NATted netgraph vlans To: freebsd-stable X-Rspamd-Queue-Id: 4DvCKK47d0z3sGK X-Spamd-Bar: --- Authentication-Results: mx1.freebsd.org; dkim=pass header.d=gmail.com header.s=20161025 header.b=KvhMJdNP; dmarc=pass (policy=none) header.from=gmail.com; spf=pass (mx1.freebsd.org: domain of garbytrash@gmail.com designates 2607:f8b0:4864:20::d32 as permitted sender) smtp.mailfrom=garbytrash@gmail.com X-Spamd-Result: default: False [-4.00 / 15.00]; R_SPF_ALLOW(-0.20)[+ip6:2607:f8b0:4000::/36:c]; FREEMAIL_FROM(0.00)[gmail.com]; HAS_ATTACHMENT(0.00)[]; TO_DN_ALL(0.00)[]; DKIM_TRACE(0.00)[gmail.com:+]; DMARC_POLICY_ALLOW(-0.50)[gmail.com,none]; NEURAL_HAM_SHORT(-1.00)[-1.000]; FROM_EQ_ENVFROM(0.00)[]; MIME_TRACE(0.00)[0:+,1:+,2:~]; RBL_DBL_DONT_QUERY_IPS(0.00)[2607:f8b0:4864:20::d32:from]; FREEMAIL_ENVFROM(0.00)[gmail.com]; ASN(0.00)[asn:15169, ipnet:2607:f8b0::/32, country:US]; DWL_DNSWL_NONE(0.00)[gmail.com:dkim]; ARC_NA(0.00)[]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; R_DKIM_ALLOW(-0.20)[gmail.com:s=20161025]; FROM_HAS_DN(0.00)[]; TO_MATCH_ENVRCPT_ALL(0.00)[]; NEURAL_HAM_LONG(-1.00)[-1.000]; MIME_GOOD(-0.10)[multipart/mixed,text/plain]; PREVIOUSLY_DELIVERED(0.00)[freebsd-stable@freebsd.org]; RCPT_COUNT_ONE(0.00)[1]; SPAMHAUS_ZRD(0.00)[2607:f8b0:4864:20::d32:from:127.0.2.255]; RCVD_IN_DNSWL_NONE(0.00)[2607:f8b0:4864:20::d32:from]; RCVD_COUNT_TWO(0.00)[2]; RCVD_TLS_ALL(0.00)[]; MAILMAN_DEST(0.00)[freebsd-stable] Content-Type: text/plain; charset="UTF-8" X-Content-Filtered-By: Mailman/MimeDel 2.1.34 X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.34 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 08 Mar 2021 09:12:22 -0000 HI, Any suggestion to restrict any transaction or interaction between NATted netgraph vlans (vi0 and vi1) in this case , but not with the bridged external nic ($extif in pf) in a setup (digraph) as of below (netdiagram is attached). I appreciate if anyone can suggest some inputs to isolate two netgraph vlans which cannot reach each other, but is accessible to and from the internet via NATted external NIC. I use pf, fyi. Cheers and stay safe! /z digraph "netgraph" { graph [ fontsize = "14" fontname = "Times-Roman" fontcolor = "black" ] node [ fontsize = "12" fontname = "Times-Roman" fontcolor = "black" shape = "record" style = "solid" ] edge [ fontsize = "10" fontname = "Times-Roman" fontcolor = "black" dir = "none" style = "solid" ] "1" [ fontsize = "12" fontname = "Times-Roman" fontcolor = "black" label = "{em0:|{ether|[1]:}}" shape = "record" style = "solid" ] "c5" [ fontsize = "12" fontname = "Times-Roman" fontcolor = "black" label = "{vi1_c2:|{eiface|[c5]:}}" shape = "record" style = "solid" ] "86" [ fontsize = "12" fontname = "Times-Roman" fontcolor = "black" label = "{vi0_v2:|{eiface|[86]:}}" shape = "record" style = "solid" ] "a8" [ fontsize = "12" fontname = "Times-Roman" fontcolor = "black" label = "{vi1:|{eiface|[a8]:}}" shape = "record" style = "solid" ] "69" [ fontsize = "12" fontname = "Times-Roman" fontcolor = "black" label = "{vi0:|{eiface|[69]:}}" shape = "record" style = "solid" ] "eb" [ fontsize = "12" fontname = "Times-Roman" fontcolor = "black" label = "{ngctl15171:|{socket|[eb]:}}" shape = "record" style = "solid" ] "ae" [ fontsize = "12" fontname = "Times-Roman" fontcolor = "black" label = "{vi1br:|{bridge|[ae]:}}" shape = "record" style = "solid" ] "6f" [ fontsize = "12" fontname = "Times-Roman" fontcolor = "black" label = "{vi0br:|{bridge|[6f]:}}" shape = "record" style = "solid" ] "b3" [ fontsize = "12" fontname = "Times-Roman" fontcolor = "black" label = "{vi1_c1:|{eiface|[b3]:}}" shape = "record" style = "solid" ] "74" [ fontsize = "12" fontname = "Times-Roman" fontcolor = "black" label = "{vi0_v1:|{eiface|[74]:}}" shape = "record" style = "solid" ] "d8" [ fontsize = "12" fontname -- Cheers, /z = "Times-Roman" fontcolor = "black" label = "{vi1_c3:|{eiface|[d8]:}}" shape = "record" style = "solid" ] "99" [ fontsize = "12" fontname = "Times-Roman" fontcolor = "black" label = "{vi0_v3:|{eiface|[99]:}}" shape = "record" style = "solid" ] { graph [ fontsize = "14" fontname = "Times-Roman" fontcolor = "black" ] node [ fontsize = "12" fontname = "Times-Roman" fontcolor = "black" shape = "record" style = "solid" ] edge [ fontsize = "10" fontname = "Times-Roman" fontcolor = "black" dir = "none" style = "solid" ] "1" "c5" "86" "a8" "69" "eb" "ae" "6f" "b3" "74" "d8" "99" } subgraph "cluster_disconnected" { graph [ fontsize = "14" fontname = "Times-Roman" fontcolor = "black" bgcolor = "pink" ] node [ fontsize = "12" fontname = "Times-Roman" fontcolor = "black" shape = "record" style = "solid" ] edge [ fontsize = "10" fontname = "Times-Roman" fontcolor = "black" dir = "none" style = "solid" ] "1" "eb" } "ae" -> "c5" [ fontsize = "10" fontname = "Times-Roman" fontcolor = "black" dir = "none" headlabel = "ether" taillabel = "link2" style = "solid" ] "6f" -> "86" [ fontsize = "10" fontname = "Times-Roman" fontcolor = "black" dir = "none" headlabel = "ether" taillabel = "link2" style = "solid" ] "a8" -> "ae" [ fontsize = "10" fontname = "Times-Roman" fontcolor = "black" Is there a way to dir = "none" headlabel = "link0" taillabel = "ether" style = "solid" ] "69" -> "6f" [ fontsize = "10" fontname = "Times-Roman" fontcolor = "black" dir = "none" headlabel = "link0" taillabel = "ether" style = "solid" ] "ae" -> "b3" [ fontsize = "10" fontname = "Times-Roman" fontcolor = "black" dir = "none" headlabel = "ether" taillabel = "link1" style = "solid" ] "6f" -> "74" [ fontsize = "10" fontname = "Times-Roman" fontcolor = "black" dir = "none" headlabel = "ether" taillabel = "link1" style = "solid" ] "ae" -> "d8" [ fontsize = "10" fontname = "Times-Roman" fontcolor = "black" dir = "none" headlabel = "ether" taillabel = "link3" style = "solid" ] "6f" -> "99" [ fontsize = "10" fontname = "Times-Roman" fontcolor = "black" dir = "none" headlabel = "ether" taillabel = "link3" style = "solid" ] } -.. .. ... -.-. .-.. .- .. -- . .-. | -.. .. ... -.-. .-.. .- .. -- . .-. CONFIDENTIALITY NOTICE AND DISCLAIMER: Access to this e-mail and its contents by anyone other than the intended recipient is unauthorized as it contains privileged and confidential information, and is subject to legal privilege. Please do not re/distribute it. If you are not the intended recipient (or responsible for delivery of the message to such person), you may not use, copy, distribute or deliver the email and part of its contents to anyone this message (or any part of its contents or take any action in connection to it. In such case, you should destroy this message, and notify the sender immediately. If you have received this email in error, please notify the sender or your sysadmin immediately by e-mail or telephone, and delete the e-mail from any computer. If you or your employer does not consent to internet e-mail messages of this kind, please notify the sender immediately. All reasonable precautions have been taken to ensure no viruses are present in this e-mail and attachments included. As the sender cannot accept responsibility for any loss or damage arising from the use of this e-mail or attachments it is recommended that you are responsible to follow your virus checking procedures prior to use. The views, opinions, conclusions and other informations expressed in this electronic mail are not given or endorsed by any company including the network providers unless otherwise indicated by an authorized representative independent of this message. -.. .. ... -.-. .-.. .- .. -- . .-. | -.. .. ... -.-. .-.. .- .. -- . .-. From owner-freebsd-stable@freebsd.org Tue Mar 9 08:57:17 2021 Return-Path: Delivered-To: freebsd-stable@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 87AA556FB5A for ; Tue, 9 Mar 2021 08:57:17 +0000 (UTC) (envelope-from matpockuh@gmail.com) Received: from mail-ej1-x62c.google.com (mail-ej1-x62c.google.com [IPv6:2a00:1450:4864:20::62c]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "GTS CA 1O1" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4DvpxS43skz3Llg for ; Tue, 9 Mar 2021 08:57:16 +0000 (UTC) (envelope-from matpockuh@gmail.com) Received: by mail-ej1-x62c.google.com with SMTP id bm21so25849605ejb.4 for ; Tue, 09 Mar 2021 00:57:16 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=mime-version:from:date:message-id:subject:to; bh=QRQ1CdBuV4czNZTwcdqbqtaHtoaVRvgNVxuQnwEjGpI=; b=AlhkTjbWHj5Gou7tjm4Nx9Xh++R+wZlqgR8PqpNfZAULINKbMgXjyW6f4q+E3WFHTw NnaeNySaslvME8WbD5f8L7uSErU0XIbfcAkY/gT+DYadRZk3QIF0RAn8GU/iT820TTJi Gt87Ls1g/WgSSqlz3A5uFEeeq8Ihe0uXlTSkWELuSh6j304KQ7a0s4aiDu3QvvtSFZuu 1x67cr32nRt6X6i9uNUpVQi/CHzksT6YAy/5tgOVVT8xqM4dDy/P7iKIOwF2l6IoEGTL ew1zTd6NNuZvcerJg438u/rhwx0g1JejAIpdE/Q4UcLiQc8NE5bkrt2PmJlCgTVJ/QRa RnYQ== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:from:date:message-id:subject:to; bh=QRQ1CdBuV4czNZTwcdqbqtaHtoaVRvgNVxuQnwEjGpI=; b=R3OBaEg1PDOnHSF1Vp6pPwg8nIZQdSCKETc36EMEJpoVeYfT6g8no+qvVXcKs/6kzu 2SAx8xxoB6zWqobFdsyY2oCRx/BZ3zWTMNnAuznzfldXp6wC9IDi0CgXaNG9ScxHefWA 1AJ7WR63IV/5RoqwprcNCS4akHm3NMzDpXepl+/NsTaU566Xq0ILdro486S4J7Cx4KBm cIWcVLWuWjVBo4lKqSAgiFvndzDqZketrEFQJqxTiDuVx9x4RgPUl4CYJM4yeGuYFgD2 4We8RLNwZoHh4WlD9PEF76HxI7Zd+VEYdmdY5YMvIY3xSUd9PL0g5pYDIPLK9fnDch73 FDHA== X-Gm-Message-State: AOAM532W6SR/1X9bUKpPrNnDrcw4xrJN7c4kMQiccKvtipW5ZEodXj0w oc5PHFbwytJX2cjBljn4wu5p1cekDD0e1E/xjq80hN2bk5Q= X-Google-Smtp-Source: ABdhPJweSGgcmnbOmdPColZInyblbG0bV6gOR5dZPV/QRgxCs5cWYrDEx9IBTCvbdLngkolCAPhuTqUICTxfixVRZ/Y= X-Received: by 2002:a17:906:2818:: with SMTP id r24mr19197414ejc.472.1615280235029; Tue, 09 Mar 2021 00:57:15 -0800 (PST) MIME-Version: 1.0 From: KOT MATPOCKuH Date: Tue, 9 Mar 2021 11:57:04 +0300 Message-ID: Subject: Backporting if_wg to FreeBSD 12 To: freebsd-stable List X-Rspamd-Queue-Id: 4DvpxS43skz3Llg X-Spamd-Bar: --- Authentication-Results: mx1.freebsd.org; dkim=pass header.d=gmail.com header.s=20161025 header.b=AlhkTjbW; dmarc=pass (policy=none) header.from=gmail.com; spf=pass (mx1.freebsd.org: domain of matpockuh@gmail.com designates 2a00:1450:4864:20::62c as permitted sender) smtp.mailfrom=matpockuh@gmail.com X-Spamd-Result: default: False [-4.00 / 15.00]; R_SPF_ALLOW(-0.20)[+ip6:2a00:1450:4000::/36:c]; FREEMAIL_FROM(0.00)[gmail.com]; TO_DN_ALL(0.00)[]; DKIM_TRACE(0.00)[gmail.com:+]; DMARC_POLICY_ALLOW(-0.50)[gmail.com,none]; NEURAL_HAM_SHORT(-1.00)[-0.999]; FROM_EQ_ENVFROM(0.00)[]; MIME_TRACE(0.00)[0:+,1:+,2:~]; RBL_DBL_DONT_QUERY_IPS(0.00)[2a00:1450:4864:20::62c:from]; FREEMAIL_ENVFROM(0.00)[gmail.com]; ASN(0.00)[asn:15169, ipnet:2a00:1450::/32, country:US]; DWL_DNSWL_NONE(0.00)[gmail.com:dkim]; ARC_NA(0.00)[]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; R_DKIM_ALLOW(-0.20)[gmail.com:s=20161025]; FROM_HAS_DN(0.00)[]; TO_MATCH_ENVRCPT_ALL(0.00)[]; NEURAL_HAM_LONG(-1.00)[-1.000]; MIME_GOOD(-0.10)[multipart/alternative,text/plain]; PREVIOUSLY_DELIVERED(0.00)[freebsd-stable@freebsd.org]; RCPT_COUNT_ONE(0.00)[1]; SPAMHAUS_ZRD(0.00)[2a00:1450:4864:20::62c:from:127.0.2.255]; RCVD_IN_DNSWL_NONE(0.00)[2a00:1450:4864:20::62c:from]; RCVD_COUNT_TWO(0.00)[2]; RCVD_TLS_ALL(0.00)[]; MAILMAN_DEST(0.00)[freebsd-stable] Content-Type: text/plain; charset="UTF-8" X-Content-Filtered-By: Mailman/MimeDel 2.1.34 X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.34 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 09 Mar 2021 08:57:17 -0000 Hello to all! As I know, if_wg support was added into freebsd head. Are there any plans for backporting if_wg support to FreeBSD 12? -- MATPOCKuH From owner-freebsd-stable@freebsd.org Tue Mar 9 09:24:58 2021 Return-Path: Delivered-To: freebsd-stable@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 6C8CD570EA8 for ; Tue, 9 Mar 2021 09:24:58 +0000 (UTC) (envelope-from avg@FreeBSD.org) Received: from mailman.nyi.freebsd.org (mailman.nyi.freebsd.org [IPv6:2610:1c1:1:606c::50:13]) by mx1.freebsd.org (Postfix) with ESMTP id 4DvqYQ2dBfz3NrX for ; Tue, 9 Mar 2021 09:24:58 +0000 (UTC) (envelope-from avg@FreeBSD.org) Received: by mailman.nyi.freebsd.org (Postfix) id 5A238570DD3; Tue, 9 Mar 2021 09:24:58 +0000 (UTC) Delivered-To: stable@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 59EC257101B for ; Tue, 9 Mar 2021 09:24:58 +0000 (UTC) (envelope-from avg@FreeBSD.org) Received: from relay1-d.mail.gandi.net (relay1-d.mail.gandi.net [217.70.183.193]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4DvqYP6SQwz3NmV for ; Tue, 9 Mar 2021 09:24:57 +0000 (UTC) (envelope-from avg@FreeBSD.org) X-Originating-IP: 195.64.148.76 Received: from [192.168.0.88] (unknown [195.64.148.76]) (Authenticated sender: andriy.gapon@uabsd.com) by relay1-d.mail.gandi.net (Postfix) with ESMTPSA id 4FA0D24000A; Tue, 9 Mar 2021 09:24:54 +0000 (UTC) Subject: Re: kldload zfs spins the system after upgrading from 12.2 to 13-BETA To: Yoshihiro Ota , stable@freebsd.org References: <20210306130913.dae1fb546e68bcaec882cdbe@j.email.ne.jp> <9f9db150-ee5d-e74e-7f24-74d1fa687a48@FreeBSD.org> <20210307222441.02755e7396cd329edd15df15@j.email.ne.jp> From: Andriy Gapon Message-ID: Date: Tue, 9 Mar 2021 11:24:53 +0200 User-Agent: Mozilla/5.0 (X11; FreeBSD amd64; rv:78.0) Gecko/20100101 Firefox/78.0 Thunderbird/78.8.0 MIME-Version: 1.0 In-Reply-To: <20210307222441.02755e7396cd329edd15df15@j.email.ne.jp> Content-Type: text/plain; charset=utf-8 Content-Language: en-US Content-Transfer-Encoding: 7bit X-Rspamd-Queue-Id: 4DvqYP6SQwz3NmV X-Spamd-Bar: / Authentication-Results: mx1.freebsd.org; none X-Spamd-Result: default: False [0.00 / 15.00]; local_wl_from(0.00)[FreeBSD.org]; ASN(0.00)[asn:29169, ipnet:217.70.176.0/20, country:FR] X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.34 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 09 Mar 2021 09:24:58 -0000 On 08/03/2021 05:24, Yoshihiro Ota wrote: > On Sun, 7 Mar 2021 00:09:33 +0200 > Andriy Gapon wrote: > >> On 06/03/2021 20:09, Yoshihiro Ota wrote: >>> Hi all, >>> >>> I'm upgrading fron 12.2-RELEASE to 13-BETA/RC one by one. >>> >>> After upgrading one in VMWare, 'zfs mount -a' hangs the system. >>> I don't have boottime zfs mount on nor don't have zfsroot. >>> I just simply ran install world/kernel and mergemaster. >> >> Please use procstat -kk to capture a kernel stack trace of the hung process. > > Actually, spining was 'kldload zfs'. > Console doesn't response but ping and sshd sessions still work. > procstat output is below. > In addition, this doesn't happen to systems that I've been following 13-CURRENT > but rather happen only wiht a system upgraded from 12.2-RELEASE to 13-RC. > > > # procstat -kk 1049 > PID TID COMM TDNAME KSTACK > 1049 100215 kldload - spa_init+0xc6 zfs_kmod_init+0x1a zfs_modevent+0x34 module_register_init+0x8c linker_load_module+0xaab kern_kldload+0xc1 sys_kldload+0x50 syscall+0x17d g_ctx+0xe280bf29 > If you could use kgdb to find out what source code line spa_init+0xc6 corresponds to that may help to see what's going on. -- Andriy Gapon From owner-freebsd-stable@freebsd.org Tue Mar 9 15:56:44 2021 Return-Path: Delivered-To: freebsd-stable@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 24EBC5576ED for ; Tue, 9 Mar 2021 15:56:44 +0000 (UTC) (envelope-from ruben@verweg.com) Received: from erg.verweg.com (erg.verweg.com [IPv6:2a02:898:96::5e8e:f508]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4Dw0FQ3r4cz4cJ2 for ; Tue, 9 Mar 2021 15:56:42 +0000 (UTC) (envelope-from ruben@verweg.com) DKIM-Filter: OpenDKIM Filter v2.10.3 erg.verweg.com (unknown-jobid) Received: from [IPv6:2a10:3781:3e9:1:a9f6:8406:ff63:ae7f] ([IPv6:2a10:3781:3e9:1:a9f6:8406:ff63:ae7f]) (authenticated bits=0) by erg.verweg.com (8.16.1/8.15.2) with ESMTPSA id 129FudUY095555 (version=TLSv1.2 cipher=ECDHE-RSA-AES256-GCM-SHA384 bits=256 verify=NOT) for ; Tue, 9 Mar 2021 15:56:40 GMT (envelope-from ruben@verweg.com) From: Ruben van Staveren Content-Type: multipart/signed; boundary="Apple-Mail=_F75AFAC2-FA28-4666-8BA2-EE9F9BCE5A6F"; protocol="application/pgp-signature"; micalg=pgp-sha1 Mime-Version: 1.0 (Mac OS X Mail 14.0 \(3654.60.0.2.21\)) Subject: FreeBSD 13.0 RC1 UEFI RAID-10 boot problems under VMware Fusio Message-Id: <58352200-C53A-4B8F-9498-316FC852BD95@verweg.com> Date: Tue, 9 Mar 2021 16:56:39 +0100 To: freebsd-stable@freebsd.org X-Mailer: Apple Mail (2.3654.60.0.2.21) X-Rspamd-Queue-Id: 4Dw0FQ3r4cz4cJ2 X-Spamd-Bar: ---- X-Spamd-Result: default: False [-4.53 / 15.00]; RCVD_VIA_SMTP_AUTH(0.00)[]; MV_CASE(0.50)[]; R_SPF_ALLOW(-0.20)[+mx]; HAS_ATTACHMENT(0.00)[]; TO_DN_NONE(0.00)[]; DKIM_TRACE(0.00)[verweg.com:+]; DMARC_POLICY_ALLOW(-0.50)[verweg.com,reject]; SIGNED_PGP(-2.00)[]; FROM_EQ_ENVFROM(0.00)[]; MIME_TRACE(0.00)[0:+,1:+,2:+,3:+,4:~,5:~,6:~]; RBL_DBL_DONT_QUERY_IPS(0.00)[2a02:898:96::5e8e:f508:from]; ASN(0.00)[asn:8283, ipnet:2a02:898::/32, country:NL]; MID_RHS_MATCH_FROM(0.00)[]; ARC_NA(0.00)[]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; R_DKIM_ALLOW(-0.20)[verweg.com:s=verweg]; FROM_HAS_DN(0.00)[]; TO_MATCH_ENVRCPT_ALL(0.00)[]; NEURAL_HAM_LONG(-1.00)[-1.000]; MIME_GOOD(-0.20)[multipart/signed,multipart/alternative,text/plain,multipart/related]; PREVIOUSLY_DELIVERED(0.00)[freebsd-stable@freebsd.org]; RCPT_COUNT_ONE(0.00)[1]; SPAMHAUS_ZRD(0.00)[2a02:898:96::5e8e:f508:from:127.0.2.255]; NEURAL_SPAM_SHORT(0.07)[0.067]; RCVD_COUNT_TWO(0.00)[2]; RCVD_TLS_ALL(0.00)[]; MAILMAN_DEST(0.00)[freebsd-stable] X-Content-Filtered-By: Mailman/MimeDel 2.1.34 X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.34 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 09 Mar 2021 15:56:44 -0000 --Apple-Mail=_F75AFAC2-FA28-4666-8BA2-EE9F9BCE5A6F Content-Transfer-Encoding: quoted-printable Content-Type: text/plain; charset=utf-8 Hi List, With FreeBSD 13 getting near release I was trying out a new hardware = setup for a future upgrade, in where a zfs SATA RAID-10 array would be = accelated by some NVME devices for cache, log, and special meta data. However, booting the setup under VMWare fusion gives me a lot of = zio_read error: 5 / ZFS: i/o error - all block copies unavailable = whereas in VirtualBox using the same VMDKs the setup boots without = issue, both in UEFI mode I used the guided ZFS install, GPT UEFI only, and choose RAID-10 and = zero swap as I want to use the NVME devices for that later on. when on the loader prompt lsdev / lszfs / ls works through latter two = throw out zio_read error: 5 but show recognisable output (zfs = filesystems, files) disk0 through 4 are the SATA disks with only an EFI and ZFS GPT = partition each, disk4/5 is reserved for the special vdevs (but not in = use yet) and swap If I press escape and end up in VMWare=E2=80=99s UEFI setup screen I can = boot from any ada*p1 drive and continue as normal. Is UEFI with OpenZFS too new, or is this an issue in VMWare? Also, I=E2=80=99m missing /boot/*efifat* in FreeBSD13. What is the = procedure for updating EFI loaders? --Apple-Mail=_F75AFAC2-FA28-4666-8BA2-EE9F9BCE5A6F Content-Transfer-Encoding: 7bit Content-Disposition: attachment; filename=signature.asc Content-Type: application/pgp-signature; name=signature.asc Content-Description: Message signed with OpenPGP -----BEGIN PGP SIGNATURE----- iQIzBAEBAgAdFiEEJ5YXTZtFY5bgSLwXiG9r7NR3qT8FAmBHmrcACgkQiG9r7NR3 qT9mjA//Slof67Irm0cBAwULVKW5UFP0QN+L14nt2SzlFLaP2DKqFjsMsIaL+CpS UQ09H8wppifPwK6dU0uSdVzcbaumR62G7ZE9zQ2mh3zkS6Pps4GVZT8Un58R7ckR 5DsxagKIWYKoT0T8fjbCtbz9KSqGKFL77DaCd5d2JwCeYpiVoPpVlkb5EsdwVMfG WyyX3V0F5b1MmqM774ojjUwWnL07wBfy+yR2500Sc/QYmzmhUOaZd8On2KrrQmUu Pov3L8F+oPLbbxPUe0MGGmSgDhiPnB2CM1mVU5nKFJg+eXz9JstPrwFLukupZpQL k8VTHc4n24tfG8fnM1C3sPKMopNQERqivTf5YXzFgo2xS/wmkJgaYbDu6oZkwsi3 lUfri0F4Q1vH0ubtGDlGqx8rnLNNr4zLPsCMbbdwNQETU8HHCODhiBxnhXkDHD4x O6IueaT2yNXn0elzVXnItVtIV+aA0cYZfzRPkLLjeJeh7jply3sWzoB45yqpCYOs L2dXT6TVvYZzqIWDTVXKXvb/Uyntrifh0vnxRP6E2ZN+m5TWIfKIi7rbRIWJEl/5 E6p84h6iVbLF1ocYVrzJYMcI5VKlMjuPKfWBb0rBxgqAzJ/FzepP+CMm2W37vWid 5IzCDO1FWVRxPJbr7rsMR0TDxCDszyYZx+tF9DO6QIIuGGE9Gew= =xMXM -----END PGP SIGNATURE----- --Apple-Mail=_F75AFAC2-FA28-4666-8BA2-EE9F9BCE5A6F-- From owner-freebsd-stable@freebsd.org Tue Mar 9 21:00:45 2021 Return-Path: Delivered-To: freebsd-stable@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id CDE435709D4 for ; Tue, 9 Mar 2021 21:00:45 +0000 (UTC) (envelope-from wlosh@bsdimp.com) Received: from mail-qv1-xf2c.google.com (mail-qv1-xf2c.google.com [IPv6:2607:f8b0:4864:20::f2c]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "GTS CA 1O1" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4Dw70F0zQ0z3Fn5 for ; Tue, 9 Mar 2021 21:00:44 +0000 (UTC) (envelope-from wlosh@bsdimp.com) Received: by mail-qv1-xf2c.google.com with SMTP id bh3so7161765qvb.5 for ; Tue, 09 Mar 2021 13:00:44 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=bsdimp-com.20150623.gappssmtp.com; s=20150623; h=mime-version:references:in-reply-to:from:date:message-id:subject:to :cc; bh=icb5QrrOmbLmeaxzleOjt+l9w0a0XfSyuyLMg4rWYec=; b=rvFu5Mynt4DcNsPS+lrSsqW6L9NI2j7J1+1aJJavRCyrZ4dRsqJFCqP1ZK9Qx0YwC3 T6lObLiRwO6onc+9vw7fVgFQc4tZAYRkY5KlUFHym4WRKRkid6x2aym5Hfbui9Wo6sz7 lFFiL8KjmBtnmyzr3kYhqpuYj6GfrOpZvke//J9+AbHKGvVXGyqZ1ZpbjBAOdP3wsM+b k8cGXohj8OE3TyTCwD2/g7vwlD0/P+T/BmDpmPbv2tO5Cc4DsDi+/Gs5kQtg/PPF4hrM 3sJyGFX9mJmG9k1RatVTasL0PjUvj6ryAai6xUBmsUdUAN39jn85LeS+/wI8Qw6uDXE/ ur0w== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:references:in-reply-to:from:date :message-id:subject:to:cc; bh=icb5QrrOmbLmeaxzleOjt+l9w0a0XfSyuyLMg4rWYec=; b=f9pNlqQZXg1vg5UtB898tcUWwuQBfMECeEuUK4TeiPSDOchgVb32dgWxaI4ZzieIh0 +Oeh2tRwX9+CLB6VlbPUf54b2WtkrYphxIj85cB03rIomVmA2bghciVS257WvxLDdKpi RNxdzOYHP5Gve4Xqhljhds4EoE0JobRWsupdSiRVBP1zdxSozoQLaemreD3hCRIBdFu2 TWpZAsmoZ0yu80ut7L/xgQdbC/uhnQmwVdHeeCZNQyXx7WqD0oznGOImD2/uouUCZ5dW yqV9z8D1RHG1bIBaIQ5EjW0vQ/tI/WtkcOeZiX9+TrOzFZtaWqK92g2cj3tma1xn292H 7nRw== X-Gm-Message-State: AOAM533NMb5hZ10vwZFTG4M504GHjoX3h9KulU2DT3S96SSKOcdu9E8y RriCgjpCHYl4tyEMltH3gQUL99817n4ns2PP80IRsmnmpEVstQ== X-Google-Smtp-Source: ABdhPJx2C2DxRKMoMhj19oXwHfLSyQgqi6B7+2JTkfymkqKB/E224qge2KmcA1jvwXqcIOvnl0zNr9xFSSOzj6X+AOE= X-Received: by 2002:a0c:a954:: with SMTP id z20mr5622247qva.29.1615323644056; Tue, 09 Mar 2021 13:00:44 -0800 (PST) MIME-Version: 1.0 References: <58352200-C53A-4B8F-9498-316FC852BD95@verweg.com> In-Reply-To: <58352200-C53A-4B8F-9498-316FC852BD95@verweg.com> From: Warner Losh Date: Tue, 9 Mar 2021 14:00:31 -0700 Message-ID: Subject: Re: FreeBSD 13.0 RC1 UEFI RAID-10 boot problems under VMware Fusio To: Ruben van Staveren Cc: FreeBSD-STABLE Mailing List X-Rspamd-Queue-Id: 4Dw70F0zQ0z3Fn5 X-Spamd-Bar: --- Authentication-Results: mx1.freebsd.org; dkim=pass header.d=bsdimp-com.20150623.gappssmtp.com header.s=20150623 header.b=rvFu5Myn; dmarc=none; spf=none (mx1.freebsd.org: domain of wlosh@bsdimp.com has no SPF policy when checking 2607:f8b0:4864:20::f2c) smtp.mailfrom=wlosh@bsdimp.com X-Spamd-Result: default: False [-3.00 / 15.00]; ARC_NA(0.00)[]; MAILMAN_DEST(0.00)[freebsd-stable]; R_DKIM_ALLOW(-0.20)[bsdimp-com.20150623.gappssmtp.com:s=20150623]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; FROM_HAS_DN(0.00)[]; NEURAL_HAM_LONG(-1.00)[-1.000]; MIME_GOOD(-0.10)[multipart/alternative,text/plain]; PREVIOUSLY_DELIVERED(0.00)[freebsd-stable@freebsd.org]; DMARC_NA(0.00)[bsdimp.com]; SPAMHAUS_ZRD(0.00)[2607:f8b0:4864:20::f2c:from:127.0.2.255]; TO_MATCH_ENVRCPT_SOME(0.00)[]; TO_DN_ALL(0.00)[]; DKIM_TRACE(0.00)[bsdimp-com.20150623.gappssmtp.com:+]; RCPT_COUNT_TWO(0.00)[2]; RCVD_IN_DNSWL_NONE(0.00)[2607:f8b0:4864:20::f2c:from]; NEURAL_HAM_SHORT(-1.00)[-1.000]; R_SPF_NA(0.00)[no SPF record]; FORGED_SENDER(0.30)[imp@bsdimp.com,wlosh@bsdimp.com]; MIME_TRACE(0.00)[0:+,1:+,2:~]; RBL_DBL_DONT_QUERY_IPS(0.00)[2607:f8b0:4864:20::f2c:from]; RCVD_COUNT_TWO(0.00)[2]; RCVD_TLS_ALL(0.00)[]; FROM_NEQ_ENVFROM(0.00)[imp@bsdimp.com,wlosh@bsdimp.com]; ASN(0.00)[asn:15169, ipnet:2607:f8b0::/32, country:US] Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Content-Filtered-By: Mailman/MimeDel 2.1.34 X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.34 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 09 Mar 2021 21:00:45 -0000 On Tue, Mar 9, 2021 at 8:56 AM Ruben van Staveren via freebsd-stable < freebsd-stable@freebsd.org> wrote: > Hi List, > > With FreeBSD 13 getting near release I was trying out a new hardware setu= p > for a future upgrade, in where a zfs SATA RAID-10 array would be accelate= d > by some NVME devices for cache, log, and special meta data. > > However, booting the setup under VMWare fusion gives me a lot of zio_read > error: 5 / ZFS: i/o error - all block copies unavailable whereas in > VirtualBox using the same VMDKs the setup boots without issue, both in UE= FI > mode > > I used the guided ZFS install, GPT UEFI only, and choose RAID-10 and zero > swap as I want to use the NVME devices for that later on. > > when on the loader prompt lsdev / lszfs / ls works through latter two > throw out zio_read error: 5 but show recognisable output (zfs filesystems= , > files) > > > disk0 through 4 are the SATA disks with only an EFI and ZFS GPT partition > each, disk4/5 is reserved for the special vdevs (but not in use yet) and > swap > > If I press escape and end up in VMWare=E2=80=99s UEFI setup screen I can = boot from > any ada*p1 drive and continue as normal. > Is UEFI with OpenZFS too new, or is this an issue in VMWare? > > > > Also, I=E2=80=99m missing /boot/*efifat* in FreeBSD13. What is the proced= ure for > updating EFI loaders? > They have been removed because they are no longer needed (filesystem images for boot blocks trouble me too). mount -t msdos /dev/da0pX /mnt mv /mnt/efi/boot/bootx64.efi /mnt/efi/boot/bootx64-old.efi cp /boot/loader.efi /mnt/efi/boot/bootx64.efi The ESP on UEFI systems is just a FAT filesystem. One issue you may run into is the size of the partition. If it is tiny, you'll likely have to create a new ESP. Using /boot/boot1.efi may help and can be used in the last step instead of loader.efi, but it's much less flexible than loader.efi. Warner From owner-freebsd-stable@freebsd.org Tue Mar 9 21:16:02 2021 Return-Path: Delivered-To: freebsd-stable@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 8648C5715EC for ; Tue, 9 Mar 2021 21:16:02 +0000 (UTC) (envelope-from ruben@verweg.com) Received: from erg.verweg.com (erg.verweg.com [IPv6:2a02:898:96::5e8e:f508]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4Dw7Ks1Tv3z3HKS for ; Tue, 9 Mar 2021 21:16:00 +0000 (UTC) (envelope-from ruben@verweg.com) DKIM-Filter: OpenDKIM Filter v2.10.3 erg.verweg.com (unknown-jobid) Received: from [IPv6:2a10:3781:3e9:1:6dde:830f:7a36:9796] ([IPv6:2a10:3781:3e9:1:6dde:830f:7a36:9796]) (authenticated bits=0) by erg.verweg.com (8.16.1/8.15.2) with ESMTPSA id 129LFuL7028914 (version=TLSv1.2 cipher=ECDHE-RSA-AES256-GCM-SHA384 bits=256 verify=NOT); Tue, 9 Mar 2021 21:15:56 GMT (envelope-from ruben@verweg.com) From: Ruben van Staveren Message-Id: Content-Type: multipart/signed; boundary="Apple-Mail=_872D22E4-0E55-47AA-B677-A795E1367756"; protocol="application/pgp-signature"; micalg=pgp-sha1 Mime-Version: 1.0 (Mac OS X Mail 14.0 \(3654.60.0.2.21\)) Subject: Re: FreeBSD 13.0 RC1 UEFI RAID-10 boot problems under VMware Fusio Date: Tue, 9 Mar 2021 22:15:54 +0100 In-Reply-To: Cc: FreeBSD-STABLE Mailing List To: Warner Losh References: <58352200-C53A-4B8F-9498-316FC852BD95@verweg.com> X-Mailer: Apple Mail (2.3654.60.0.2.21) X-Rspamd-Queue-Id: 4Dw7Ks1Tv3z3HKS X-Spamd-Bar: ----- X-Spamd-Result: default: False [-5.60 / 15.00]; RCVD_VIA_SMTP_AUTH(0.00)[]; MV_CASE(0.50)[]; R_SPF_ALLOW(-0.20)[+mx]; HAS_ATTACHMENT(0.00)[]; TO_DN_ALL(0.00)[]; DKIM_TRACE(0.00)[verweg.com:+]; RCPT_COUNT_TWO(0.00)[2]; DMARC_POLICY_ALLOW(-0.50)[verweg.com,reject]; NEURAL_HAM_SHORT(-1.00)[-1.000]; SIGNED_PGP(-2.00)[]; FROM_EQ_ENVFROM(0.00)[]; MIME_TRACE(0.00)[0:+,1:+,2:+,3:~,4:~]; RBL_DBL_DONT_QUERY_IPS(0.00)[2a02:898:96::5e8e:f508:from]; ASN(0.00)[asn:8283, ipnet:2a02:898::/32, country:NL]; MID_RHS_MATCH_FROM(0.00)[]; ARC_NA(0.00)[]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; R_DKIM_ALLOW(-0.20)[verweg.com:s=verweg]; FROM_HAS_DN(0.00)[]; NEURAL_HAM_LONG(-1.00)[-1.000]; MIME_GOOD(-0.20)[multipart/signed,multipart/alternative,text/plain]; SPAMHAUS_ZRD(0.00)[2a02:898:96::5e8e:f508:from:127.0.2.255]; TO_MATCH_ENVRCPT_SOME(0.00)[]; RCVD_COUNT_TWO(0.00)[2]; RCVD_TLS_ALL(0.00)[]; MAILMAN_DEST(0.00)[freebsd-stable] X-Content-Filtered-By: Mailman/MimeDel 2.1.34 X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.34 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 09 Mar 2021 21:16:02 -0000 --Apple-Mail=_872D22E4-0E55-47AA-B677-A795E1367756 Content-Transfer-Encoding: quoted-printable Content-Type: text/plain; charset=utf-8 > Also, I=E2=80=99m missing /boot/*efifat* in FreeBSD13. What is the = procedure for updating EFI loaders? >=20 > They have been removed because they are no longer needed (filesystem = images for boot blocks trouble me too). Agree, but I=E2=80=99ve felt I=E2=80=99ve missed the memo >=20 > mount -t msdos /dev/da0pX /mnt > mv /mnt/efi/boot/bootx64.efi /mnt/efi/boot/bootx64-old.efi > cp /boot/loader.efi /mnt/efi/boot/bootx64.efi >=20 > The ESP on UEFI systems is just a FAT filesystem. Yes. I think it it noteworthy to have this in the release notes somewhere. = that is, if bootx64.efi needs updates every now and then >=20 > One issue you may run into is the size of the partition. If it is = tiny, you'll likely have to create a new ESP. Using /boot/boot1.efi may = help and can be used in the last step instead of loader.efi, but it's = much less flexible than loader.efi. >=20 > Warner Thanks, Ruben --Apple-Mail=_872D22E4-0E55-47AA-B677-A795E1367756 Content-Transfer-Encoding: 7bit Content-Disposition: attachment; filename=signature.asc Content-Type: application/pgp-signature; name=signature.asc Content-Description: Message signed with OpenPGP -----BEGIN PGP SIGNATURE----- iQIzBAEBAgAdFiEEJ5YXTZtFY5bgSLwXiG9r7NR3qT8FAmBH5YoACgkQiG9r7NR3 qT9isQ/6A35+wwmj7V7G/94NC4SXPeJxpJGxmoaZ+L96kkRts5GnplVOuf346c/T 0v/QUcX3Bc2oga5bJkUul/CMoHygPfkLkCQ2asBiQF61V7pVKSPfXCFWhCpMaaPF eUKrJwcxcY706SnJCerkCc8pLF+G5wIHzyGSOAF7kMlKm1FboEggyqmdGrL2MrEJ xsNIE0h/ueYxNrL+eSb474GZxx7GqaLxSnZTN6bYcaWw9obuUoJlefAGiik6X0mT ATtZOad85cyybfhu1xczNzlsBqehVnW3hGNfoTwTp2lcSaUeVEeJE4af/Sz5a+eR Cqbo2fFwVpyMSw3YBbYJy9k9vjoxtHFp9/lq4igRJugqQhVq3ARTVADC/aCpGKlT xXczo0pGvEM2p/0d7siSGNZUSu88vw7PrCDlvYv5jO3v3S9pLz6M7Gx4Beb5ZSTE kzrmvrx9tdn2LLPpoJeQGdsX9N1djn+fiiYPTuf7wDIbYwmLEM348eKts1lvc9u4 SBVZlDMCulx5kuLdnwb1QffPUcf06w1r8dLzEkbDiOV4SNg4m/nBdRdMf8/YtsQq qpw9A7D18rq7yoyKfAL64ggI//doY09MeS9ehIsbb9UJBbcAjZsaxROzilNBtGOj Pc/S5tw20LJ1AXjbDNoRHXgsiUb58ustRO+muK5o9qiJbJdwSWM= =7Ok+ -----END PGP SIGNATURE----- --Apple-Mail=_872D22E4-0E55-47AA-B677-A795E1367756-- From owner-freebsd-stable@freebsd.org Tue Mar 9 21:20:07 2021 Return-Path: Delivered-To: freebsd-stable@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id DF1BF571A4F for ; Tue, 9 Mar 2021 21:20:07 +0000 (UTC) (envelope-from wlosh@bsdimp.com) Received: from mail-qk1-x72b.google.com (mail-qk1-x72b.google.com [IPv6:2607:f8b0:4864:20::72b]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "GTS CA 1O1" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4Dw7Qb0gy4z3Hmv for ; Tue, 9 Mar 2021 21:20:06 +0000 (UTC) (envelope-from wlosh@bsdimp.com) Received: by mail-qk1-x72b.google.com with SMTP id d20so14689364qkc.2 for ; Tue, 09 Mar 2021 13:20:06 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=bsdimp-com.20150623.gappssmtp.com; s=20150623; h=mime-version:references:in-reply-to:from:date:message-id:subject:to :cc; bh=0gPXVmFR5la4spL5Bq2gxtUneN20DauBEjGMVKQB9Jg=; b=Sg34cxIZCicL+nV24mU0wJjf6viCUsRcyImN7zyEZVAd8677W8mGHufpr8Z8YJY1j3 mxjZCkILWRnRWL8Cgq2Y9DwHBw+cirSwo4t3jbtjnHFztcWhsPvAbdcm+GDkbdqWkgHD oBInZA4nI0M0QhbXGJDyF+ILC/3vsfhOE2ltavwuyqX2yvaM5SXmT3EfEK4tJ8LKs+7k lC7de3Tst1gh7InweX33ujqRypkpVh3kW97pYe3lJAPxD+kUd74xF4B/HHirxBEEavfa hEvnFw2d3evt1s4ymmTFVLcz/TlPSLPa33tR7HV0A16hecQpaj9e7yTyMEUCCYAr/pLx qS1w== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:references:in-reply-to:from:date :message-id:subject:to:cc; bh=0gPXVmFR5la4spL5Bq2gxtUneN20DauBEjGMVKQB9Jg=; b=rL5nFy86meMFpbwWDqaGiHu8u1+nClNxFcvXKyT27OhC0bASy+5Wmax3ZnzfLl9cU5 ZGGwRY/4m/goSgJRjlwnrRcs/6A9BZt/iYLvwihbM9D0DeF59DrTWaI+fqfDf2XzOqCo HwtkMgwHlMQHc/hh7eYV1K8KzJTAnsDcLGcY0dwJzniRUEaoY9QHYKjDrQUlrLUIDgb6 ITSVYyady8lCch7ZQSAlSWjDAe0p6T3flCw9WXzeOc7RjtAPorLfcXrDAgCvh4NkNLLz VP1ft9P1ouWTENYICMTSdfYmBf79aj5r1g/HZXfDWleK4U7gA5CD9iJ2imFHZuaei3GP kz8g== X-Gm-Message-State: AOAM530MF4eOKbX9wzVs6mnUxknL6bxU59FUqN9V3pnI89B0d28wOKFS 8xj+ecAv3tuKEgXEKhICAHQuVu7wZTdEB++Y3/aN6uvYczU0Vg== X-Google-Smtp-Source: ABdhPJzLf+aJD3q7grSCH39Fd4g1/VO7bKqSJFzhVabttdspJIuuaR1M2pllNul9td2FLz/FiWA7LOQJf6X4Yv4xN/A= X-Received: by 2002:a37:a48a:: with SMTP id n132mr26852755qke.359.1615324805959; Tue, 09 Mar 2021 13:20:05 -0800 (PST) MIME-Version: 1.0 References: <58352200-C53A-4B8F-9498-316FC852BD95@verweg.com> In-Reply-To: From: Warner Losh Date: Tue, 9 Mar 2021 14:19:54 -0700 Message-ID: Subject: Re: FreeBSD 13.0 RC1 UEFI RAID-10 boot problems under VMware Fusio To: Ruben van Staveren Cc: FreeBSD-STABLE Mailing List X-Rspamd-Queue-Id: 4Dw7Qb0gy4z3Hmv X-Spamd-Bar: --- Authentication-Results: mx1.freebsd.org; dkim=pass header.d=bsdimp-com.20150623.gappssmtp.com header.s=20150623 header.b=Sg34cxIZ; dmarc=none; spf=none (mx1.freebsd.org: domain of wlosh@bsdimp.com has no SPF policy when checking 2607:f8b0:4864:20::72b) smtp.mailfrom=wlosh@bsdimp.com X-Spamd-Result: default: False [-3.00 / 15.00]; RCVD_TLS_ALL(0.00)[]; ARC_NA(0.00)[]; R_DKIM_ALLOW(-0.20)[bsdimp-com.20150623.gappssmtp.com:s=20150623]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; FROM_HAS_DN(0.00)[]; NEURAL_HAM_LONG(-1.00)[-1.000]; MIME_GOOD(-0.10)[multipart/alternative,text/plain]; PREVIOUSLY_DELIVERED(0.00)[freebsd-stable@freebsd.org]; DMARC_NA(0.00)[bsdimp.com]; SPAMHAUS_ZRD(0.00)[2607:f8b0:4864:20::72b:from:127.0.2.255]; TO_MATCH_ENVRCPT_SOME(0.00)[]; TO_DN_ALL(0.00)[]; DKIM_TRACE(0.00)[bsdimp-com.20150623.gappssmtp.com:+]; RCPT_COUNT_TWO(0.00)[2]; RCVD_IN_DNSWL_NONE(0.00)[2607:f8b0:4864:20::72b:from]; NEURAL_HAM_SHORT(-1.00)[-1.000]; R_SPF_NA(0.00)[no SPF record]; FORGED_SENDER(0.30)[imp@bsdimp.com,wlosh@bsdimp.com]; MIME_TRACE(0.00)[0:+,1:+,2:~]; RBL_DBL_DONT_QUERY_IPS(0.00)[2607:f8b0:4864:20::72b:from]; ASN(0.00)[asn:15169, ipnet:2607:f8b0::/32, country:US]; FROM_NEQ_ENVFROM(0.00)[imp@bsdimp.com,wlosh@bsdimp.com]; MAILMAN_DEST(0.00)[freebsd-stable]; RCVD_COUNT_TWO(0.00)[2] Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Content-Filtered-By: Mailman/MimeDel 2.1.34 X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.34 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 09 Mar 2021 21:20:07 -0000 On Tue, Mar 9, 2021 at 2:15 PM Ruben van Staveren wrote: > > Also, I=E2=80=99m missing /boot/*efifat* in FreeBSD13. What is the proced= ure for >> updating EFI loaders? >> > > They have been removed because they are no longer needed (filesystem > images for boot blocks trouble me too). > > > Agree, but I=E2=80=99ve felt I=E2=80=99ve missed the memo > I did it long enough ago I had forgotten to make sure people upgrading from 12 knew. > > mount -t msdos /dev/da0pX /mnt > mv /mnt/efi/boot/bootx64.efi /mnt/efi/boot/bootx64-old.efi > cp /boot/loader.efi /mnt/efi/boot/bootx64.efi > > The ESP on UEFI systems is just a FAT filesystem. > > > Yes. > > I think it it noteworthy to have this in the release notes somewhere. tha= t > is, if bootx64.efi needs updates every now and then > That's a good suggestion. I'll make sure something is in the release notes. Warner > > One issue you may run into is the size of the partition. If it is tiny, > you'll likely have to create a new ESP. Using /boot/boot1.efi may help an= d > can be used in the last step instead of loader.efi, but it's much less > flexible than loader.efi. > > Warner > > > Thanks, > Ruben > > From owner-freebsd-stable@freebsd.org Tue Mar 9 21:22:38 2021 Return-Path: Delivered-To: freebsd-stable@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id A7D14571DB9 for ; Tue, 9 Mar 2021 21:22:38 +0000 (UTC) (envelope-from hausen@punkt.de) Received: from mail.punkt.de (mail.punkt.de [217.29.41.227]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4Dw7TT6QKcz3JB5 for ; Tue, 9 Mar 2021 21:22:37 +0000 (UTC) (envelope-from hausen@punkt.de) Received: from [217.29.46.74] (kagate.punkt.de [217.29.33.131]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by mail.punkt.de (Postfix) with ESMTPSA id 4A2B4318C3; Tue, 9 Mar 2021 22:22:30 +0100 (CET) From: "Patrick M. Hausen" Message-Id: Content-Type: multipart/signed; boundary="Apple-Mail=_BDA63B2A-CC81-4B83-A911-86A96E23EDF2"; protocol="application/pgp-signature"; micalg=pgp-sha256 Mime-Version: 1.0 (Mac OS X Mail 12.4 \(3445.104.17\)) Subject: Re: FreeBSD 13.0 RC1 UEFI RAID-10 boot problems under VMware Fusio Date: Tue, 9 Mar 2021 22:22:29 +0100 In-Reply-To: Cc: Ruben van Staveren , FreeBSD-STABLE Mailing List To: Warner Losh References: <58352200-C53A-4B8F-9498-316FC852BD95@verweg.com> X-Mailer: Apple Mail (2.3445.104.17) X-Rspamd-Queue-Id: 4Dw7TT6QKcz3JB5 X-Spamd-Bar: ---- Authentication-Results: mx1.freebsd.org; dkim=none; dmarc=none; spf=pass (mx1.freebsd.org: domain of hausen@punkt.de designates 217.29.41.227 as permitted sender) smtp.mailfrom=hausen@punkt.de X-Spamd-Result: default: False [-4.90 / 15.00]; RCVD_TLS_ALL(0.00)[]; RCVD_VIA_SMTP_AUTH(0.00)[]; MID_RHS_MATCH_FROM(0.00)[]; FROM_HAS_DN(0.00)[]; RCPT_COUNT_THREE(0.00)[3]; MV_CASE(0.50)[]; R_SPF_ALLOW(-0.20)[+ip4:217.29.32.0/20]; HAS_ATTACHMENT(0.00)[]; MIME_GOOD(-0.20)[multipart/signed,text/plain]; ARC_NA(0.00)[]; DMARC_NA(0.00)[punkt.de]; SPAMHAUS_ZRD(0.00)[217.29.41.227:from:127.0.2.255]; TO_MATCH_ENVRCPT_SOME(0.00)[]; TO_DN_ALL(0.00)[]; NEURAL_HAM_LONG(-1.00)[-1.000]; NEURAL_HAM_SHORT(-1.00)[-1.000]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; SIGNED_PGP(-2.00)[]; RBL_DBL_DONT_QUERY_IPS(0.00)[217.29.41.227:from]; FROM_EQ_ENVFROM(0.00)[]; R_DKIM_NA(0.00)[]; MIME_TRACE(0.00)[0:+,1:+,2:~]; ASN(0.00)[asn:16188, ipnet:217.29.32.0/20, country:DE]; RCVD_COUNT_TWO(0.00)[2]; MAILMAN_DEST(0.00)[freebsd-stable] X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.34 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 09 Mar 2021 21:22:38 -0000 --Apple-Mail=_BDA63B2A-CC81-4B83-A911-86A96E23EDF2 Content-Transfer-Encoding: quoted-printable Content-Type: text/plain; charset=utf-8 Hi Warner, > Am 09.03.2021 um 22:00 schrieb Warner Losh :One issue = you may run into is the size of the partition. If it is tiny, > you'll likely have to create a new ESP. Using /boot/boot1.efi may help = and > can be used in the last step instead of loader.efi, but it's much less > flexible than loader.efi. What precisely is the difference between boot1.efi and loader.efi? Practically from a sysadmin point of view? I have been using boot1.efi exclusively the last couple of years to boot EFI based systems with ZFS = ... Thanks! Patrick -- punkt.de GmbH Patrick M. Hausen .infrastructure Kaiserallee 13a 76133 Karlsruhe Tel. +49 721 9109500 https://infrastructure.punkt.de info@punkt.de AG Mannheim 108285 Gesch=C3=A4ftsf=C3=BChrer: J=C3=BCrgen Egeling, Daniel Lienert, Fabian = Stein --Apple-Mail=_BDA63B2A-CC81-4B83-A911-86A96E23EDF2 Content-Transfer-Encoding: 7bit Content-Disposition: attachment; filename=signature.asc Content-Type: application/pgp-signature; name=signature.asc Content-Description: Message signed with OpenPGP -----BEGIN PGP SIGNATURE----- iQEzBAEBCAAdFiEEgzqrjO/mj9CSsTg2kG8u4u3aiVwFAmBH5xUACgkQkG8u4u3a iVw8CAf+KxmB3dalxUPfXF7/dKZx6sBU3liiYP7pe64TkQINVw/a2BEzzZ3SylYh sq6GizkdvyvI8fPzaHxTnkdseSBl3mlseitH8DpAmOGi9yQ9RT2RT4I23g1Wn6rm ucjyav4+B1LDxVVhZUO703UOFuPuFac/KUnKTS8TR/pkI+TgYJTvWFvzxZvm+Mau WGiHsfV0E/uAf8/I5BinWp5O74AuLweRJgYkWxwgnGjjNlSetYiKggRU2HKT/rE1 CmZW5zsrx/UzyTiOisy4sAp3claQTpot88AOeBnUtYBOyLiIxIDWFDXmBuCoa6m7 eMqEkspsWGAiVr/EdvY1695p0vpvSg== =pOqg -----END PGP SIGNATURE----- --Apple-Mail=_BDA63B2A-CC81-4B83-A911-86A96E23EDF2-- From owner-freebsd-stable@freebsd.org Tue Mar 9 21:30:36 2021 Return-Path: Delivered-To: freebsd-stable@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 0FA71572502 for ; Tue, 9 Mar 2021 21:30:36 +0000 (UTC) (envelope-from wlosh@bsdimp.com) Received: from mail-qt1-x833.google.com (mail-qt1-x833.google.com [IPv6:2607:f8b0:4864:20::833]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "GTS CA 1O1" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4Dw7fg0xxZz3Jn6 for ; Tue, 9 Mar 2021 21:30:34 +0000 (UTC) (envelope-from wlosh@bsdimp.com) Received: by mail-qt1-x833.google.com with SMTP id d11so11414298qtx.9 for ; Tue, 09 Mar 2021 13:30:34 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=bsdimp-com.20150623.gappssmtp.com; s=20150623; h=mime-version:references:in-reply-to:from:date:message-id:subject:to :cc; bh=w4hGHpGHlRgN1spYArsYfpLGveI9XDhjmm8P5iuIOWk=; b=feBFn2Qhe5K5c+k1HX59i+p65NPxgbcV1B0Dc0Eww7CdJknAlktZMRoiw95UWdzIAA Wb5xOPaDCO3BczPlt8nEfvBlnyVAzjT2SKpCL7qCi4qWwRAMQEVHVszs7gcufjPcUA0e OCH8563slv/9Ct4pSFWqRKer1MqslX0dm66oQ9sjYS+jtEeSioTy+7O25xDIn2a1GfnM aeREHoFbFUGgvJZRQyz4rqCAi3C4Dm4G78QcEke45a4fek7laxIuKl8ZSXxYmM3mFzMP z4FGmg7hOeSCi/0rMNbBKaD7FMPxGgjTuldVq21lR3a/Vui53tPiqUKDLoJTCEG5iMrS KX5w== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:references:in-reply-to:from:date :message-id:subject:to:cc; bh=w4hGHpGHlRgN1spYArsYfpLGveI9XDhjmm8P5iuIOWk=; b=o94wS8YetaNhtSsoyc/nFdJGIX6WV+2OPxgUoylg0qibnMTEtMC4mRFLmXsVVwyfRY FEjwCXLX2BHB6IZc4uMqoCznH7lwhDWnjgUhH0UTcZCt3tJeasRMx1j0jvzkv7g2hlw5 VJiyD0qCM8/RlMskT8SsJBV/VDB/+j7lslVszYNTZxUf5y8BlSGeKge8EkeMNhpEFUvp p/7fPWr0J06WvbQslGmdQZawXMM7IvIEkXwtqRVyDOBzl7uiNcJrzhG7Cvd06K5Fa7xs 3IzOrsAbwlkX+UW42HY8f+TCSDgmbrc61y12MdvdlcI2Rw+g7KLHzoSjpFcI6T7ZU2j2 IExA== X-Gm-Message-State: AOAM532GOAHgZM0pg4+/HCfR7joiSgPYbAJiZOaWd7C7+g+4FdERQ5BU XR+ykbepwcgMlCTFPwUwhrTQ5/+U8hHWvSNIQ9To3waPoBEnpQ== X-Google-Smtp-Source: ABdhPJyHDYfERLm7HZ1cXTG4/Wp/VZeAAjxTcF9FYNKTUmPiI2VqFaCFsWfnPmmCx9vGGqP5EzrNm9s2M82Vy3B7rCE= X-Received: by 2002:a05:622a:1c9:: with SMTP id t9mr8430qtw.244.1615325433890; Tue, 09 Mar 2021 13:30:33 -0800 (PST) MIME-Version: 1.0 References: <58352200-C53A-4B8F-9498-316FC852BD95@verweg.com> In-Reply-To: From: Warner Losh Date: Tue, 9 Mar 2021 14:30:23 -0700 Message-ID: Subject: Re: FreeBSD 13.0 RC1 UEFI RAID-10 boot problems under VMware Fusio To: "Patrick M. Hausen" Cc: Ruben van Staveren , FreeBSD-STABLE Mailing List X-Rspamd-Queue-Id: 4Dw7fg0xxZz3Jn6 X-Spamd-Bar: --- Authentication-Results: mx1.freebsd.org; dkim=pass header.d=bsdimp-com.20150623.gappssmtp.com header.s=20150623 header.b=feBFn2Qh; dmarc=none; spf=none (mx1.freebsd.org: domain of wlosh@bsdimp.com has no SPF policy when checking 2607:f8b0:4864:20::833) smtp.mailfrom=wlosh@bsdimp.com X-Spamd-Result: default: False [-3.00 / 15.00]; RCVD_TLS_ALL(0.00)[]; ARC_NA(0.00)[]; R_DKIM_ALLOW(-0.20)[bsdimp-com.20150623.gappssmtp.com:s=20150623]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; FROM_HAS_DN(0.00)[]; RCPT_COUNT_THREE(0.00)[3]; NEURAL_HAM_LONG(-1.00)[-1.000]; MIME_GOOD(-0.10)[multipart/alternative,text/plain]; PREVIOUSLY_DELIVERED(0.00)[freebsd-stable@freebsd.org]; DMARC_NA(0.00)[bsdimp.com]; SPAMHAUS_ZRD(0.00)[2607:f8b0:4864:20::833:from:127.0.2.255]; TO_MATCH_ENVRCPT_SOME(0.00)[]; TO_DN_ALL(0.00)[]; DKIM_TRACE(0.00)[bsdimp-com.20150623.gappssmtp.com:+]; NEURAL_HAM_SHORT(-1.00)[-1.000]; RCVD_IN_DNSWL_NONE(0.00)[2607:f8b0:4864:20::833:from]; R_SPF_NA(0.00)[no SPF record]; FORGED_SENDER(0.30)[imp@bsdimp.com,wlosh@bsdimp.com]; MIME_TRACE(0.00)[0:+,1:+,2:~]; RBL_DBL_DONT_QUERY_IPS(0.00)[2607:f8b0:4864:20::833:from]; ASN(0.00)[asn:15169, ipnet:2607:f8b0::/32, country:US]; FROM_NEQ_ENVFROM(0.00)[imp@bsdimp.com,wlosh@bsdimp.com]; MAILMAN_DEST(0.00)[freebsd-stable]; RCVD_COUNT_TWO(0.00)[2] Content-Type: text/plain; charset="UTF-8" X-Content-Filtered-By: Mailman/MimeDel 2.1.34 X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.34 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 09 Mar 2021 21:30:36 -0000 On Tue, Mar 9, 2021 at 2:22 PM Patrick M. Hausen wrote: > Hi Warner, > > > Am 09.03.2021 um 22:00 schrieb Warner Losh :One issue > you may run into is the size of the partition. If it is tiny, > > > you'll likely have to create a new ESP. Using /boot/boot1.efi may help > and > > can be used in the last step instead of loader.efi, but it's much less > > flexible than loader.efi. > > What precisely is the difference between boot1.efi and loader.efi? > Practically from a sysadmin point of view? I have been using boot1.efi > exclusively the last couple of years to boot EFI based systems with ZFS ... > boot1.efi is a less fully functional version of loader.efi. It doesn't let you choose something else to boot. it doesn't have the ability to do some advanced security options. It has no scripting. The project, with FreeBSD 13, will be recommending that people move to loader.efi where possible. boot1.efi is still built, but likely should only be used for legacy purposes for people that have a far-too-tiny ESP for loader.efi. It will receive limited updates in the future and may be removed in the fullness of time. Due to the ZFS move to OpenZFS, boot1.efi needs to be updated anyway (well, technically only if you migrate the zpool to the latest version), and most installations would be better served by loader.efi being installed there and/or migrating to efibootmgr to set a specific thing to boot. Though, due to quality of BIOS implementation issues, efibootmgr's functionality varies from vendor to vendor depending on how well they adhere to the standards. I'm working on some text for the release notes to make all this clear and in one place. Warner From owner-freebsd-stable@freebsd.org Tue Mar 9 22:35:33 2021 Return-Path: Delivered-To: freebsd-stable@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id E3102574259 for ; Tue, 9 Mar 2021 22:35:33 +0000 (UTC) (envelope-from philippe.michel7@free.fr) Received: from smtp5-g21.free.fr (smtp5-g21.free.fr [IPv6:2a01:e0c:1:1599::14]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4Dw95c61dPz3Ndw for ; Tue, 9 Mar 2021 22:35:32 +0000 (UTC) (envelope-from philippe.michel7@free.fr) Received: from localhost (unknown [37.165.84.72]) (Authenticated sender: philippe.michel7@free.fr) by smtp5-g21.free.fr (Postfix) with ESMTPSA id B97C05FF9A; Tue, 9 Mar 2021 23:35:21 +0100 (CET) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/simple; d=free.fr; s=smtp-20201208; t=1615329328; bh=pzB30dv/eAiH3IHmzIUxqnBy1Qlja486nhsRWMrHKtU=; h=Date:From:To:Cc:Subject:References:In-Reply-To:From; b=Ph/Qept0FLDnN0y1wz0oT6GJ3xFgFDm8x45zv/6QMMlyeWC/zvmdfP47zNF90XaSP znJXBNdNEbmA+rtyiBWVwH1XWQ09ui1pBrGqw5JFBiI0v0lli0VIytvjxDwuRDSjEb obWSOQpsAo+KpuPkU3/hRVtPdtFbBKa8ZzeAYfYVPH+skhFVQoY265hxGaGVZb3Ot8 +W0Ng+oo1gMjqKKxAl06XGLngYRc2Tph861qjn1Tovw5SP4e8TG8pgB+9kEKgiAIw7 El/Uxy1za1FbDloX90kg2g/sQrEjJcj8ssx9jSGqPzGwJUX0DUnZiDGyk0C3kbtknJ uC6YihRYkKAIA== Date: Tue, 9 Mar 2021 23:34:53 +0100 From: Philippe Michel To: Warner Losh Cc: Ruben van Staveren , FreeBSD-STABLE Mailing List Subject: Re: FreeBSD 13.0 RC1 UEFI RAID-10 boot problems under VMware Fusio Message-ID: References: <58352200-C53A-4B8F-9498-316FC852BD95@verweg.com> MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: X-Rspamd-Queue-Id: 4Dw95c61dPz3Ndw X-Spamd-Bar: --- Authentication-Results: mx1.freebsd.org; dkim=pass header.d=free.fr header.s=smtp-20201208 header.b=Ph/Qept0; dmarc=pass (policy=none) header.from=free.fr; spf=pass (mx1.freebsd.org: domain of philippe.michel7@free.fr designates 2a01:e0c:1:1599::14 as permitted sender) smtp.mailfrom=philippe.michel7@free.fr X-Spamd-Result: default: False [-3.50 / 15.00]; RCVD_VIA_SMTP_AUTH(0.00)[]; R_SPF_ALLOW(-0.20)[+ip6:2a01:e0c:1:1599::14:c]; FREEMAIL_FROM(0.00)[free.fr]; TO_DN_ALL(0.00)[]; DKIM_TRACE(0.00)[free.fr:+]; DMARC_POLICY_ALLOW(-0.50)[free.fr,none]; NEURAL_HAM_SHORT(-1.00)[-1.000]; RECEIVED_SPAMHAUS_PBL(0.00)[37.165.84.72:received]; FROM_EQ_ENVFROM(0.00)[]; RBL_DBL_DONT_QUERY_IPS(0.00)[2a01:e0c:1:1599::14:from]; FREEMAIL_ENVFROM(0.00)[free.fr]; ASN(0.00)[asn:12322, ipnet:2a01:e00::/26, country:FR]; DWL_DNSWL_NONE(0.00)[free.fr:dkim]; ARC_NA(0.00)[]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; R_DKIM_ALLOW(-0.20)[free.fr:s=smtp-20201208]; FROM_HAS_DN(0.00)[]; RCPT_COUNT_THREE(0.00)[3]; NEURAL_HAM_LONG(-1.00)[-1.000]; MIME_GOOD(-0.10)[text/plain]; MIME_TRACE(0.00)[0:+]; SPAMHAUS_ZRD(0.00)[2a01:e0c:1:1599::14:from:127.0.2.255]; TO_MATCH_ENVRCPT_SOME(0.00)[]; RCVD_IN_DNSWL_NONE(0.00)[2a01:e0c:1:1599::14:from]; MID_RHS_NOT_FQDN(0.50)[]; RCVD_COUNT_TWO(0.00)[2]; RCVD_TLS_ALL(0.00)[]; MAILMAN_DEST(0.00)[freebsd-stable] X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.34 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 09 Mar 2021 22:35:33 -0000 On Tue, Mar 09, 2021 at 02:19:27PM -0700, Warner Losh wrote: > On Tue, Mar 9, 2021 at 2:15 PM Ruben van Staveren wrote: > > I think it it noteworthy to have this in the release notes somewhere. that > > is, if bootx64.efi needs updates every now and then > > > > That's a good suggestion. I'll make sure something is in the release notes. Not directly related to the need of updating the bootloader, but wouldn't it make sense to describe the creation of an ESP partition in the EXAMPLES section of gpart(8), similar to what is already there for legacy boot ? Then maybe add a few lines on how to populate it, even if it is not done with gpart subcommands. From owner-freebsd-stable@freebsd.org Wed Mar 10 10:07:19 2021 Return-Path: Delivered-To: freebsd-stable@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id F23EB5AB854 for ; Wed, 10 Mar 2021 10:07:19 +0000 (UTC) (envelope-from mr.xanto@gmail.com) Received: from mail-lj1-x236.google.com (mail-lj1-x236.google.com [IPv6:2a00:1450:4864:20::236]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "GTS CA 1O1" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4DwSRq1hQGz4pMF for ; Wed, 10 Mar 2021 10:07:19 +0000 (UTC) (envelope-from mr.xanto@gmail.com) Received: by mail-lj1-x236.google.com with SMTP id m11so24775133lji.10 for ; Wed, 10 Mar 2021 02:07:18 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=date:from:message-id:to:subject:mime-version :content-transfer-encoding; bh=qZF9b+l0NsbXG1P46PaLqwo4XHlWfuKmxW5hulvdq/0=; b=s76wfsvc373W4MUTjQkvgG5TVSy7TTZfbF0JmEbAORl16FZjkO6BU1MVbwLjdRNlqD t0hbf4UvoLQ4eIE84K0nAfpyKuNszXPtcO9P0SORw+W1IEXO1MIaTK0rQHa9EgK4HI2L eUeFEzEMnOerWFixQghQpkKaC8G4Oj5oQGOKmffE59X5uaTRB5FcrIVO+SQvJaBb3pX6 Fz4C1f+CPJl2fG6SnQsUPf4J/Rm7V1XZ5eIdyXi4B6dVueBfauTZOxhZKwjM3O0ZUUpn fLjOleRuAO3M1UaBd1B8OCotJYKMovCHl8g39STGPM/mBjzjqhflIc6QSR6OQwTTNlTK ucHw== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:date:from:message-id:to:subject:mime-version :content-transfer-encoding; bh=qZF9b+l0NsbXG1P46PaLqwo4XHlWfuKmxW5hulvdq/0=; b=QFCKHkvWC+z/TwLj/6X9wtRr6chtsfdLyL+6bgMEjFs8Ov4kN4iTjqKXKM6LENR2wA lV7RhH/u5UMA+bsXknu4hmOgQa9sJuu8qOPrhfz+P2z31x6kZPqCbSo/uuymxYiHwccY wWzLofHzF8lrTUT9KTKAwXH7h3G6i95lY4NMSsRlA2DO9/WFlRYTI4ucMls8t4Ux5PmN VREnXJo5eENBdY3Jo2G/rHO0jj8eL+4HkAt8SJuQCHIUbKBC7hJGYJ83rKQ5UTv4/PfW zlLkp43sIDxw5VSFgRWjqZ90SryQJ+7TZl6glze4cHNv5lN+6+00dyCqoVu2rLzNPaP9 jSOw== X-Gm-Message-State: AOAM532gpPg1LRBELAzh6nWaRhIh3VQZG/R5I3jBV9x7bS4JgX/2sdSk hFacnFkG+tLqHm2RdaU2QZXxxzArdbI= X-Google-Smtp-Source: ABdhPJyDt16NPNxc9MYcxFSagJFk8wx3IkgIU6+cdkLhjCsTl34sU/ZDBhTv1OpbeAu7sMh63RVqjg== X-Received: by 2002:a2e:535a:: with SMTP id t26mr1317652ljd.503.1615370837072; Wed, 10 Mar 2021 02:07:17 -0800 (PST) Received: from [192.168.70.66] ([37.235.174.147]) by smtp.gmail.com with ESMTPSA id h24sm1263047ljg.77.2021.03.10.02.07.15 for (version=TLS1_2 cipher=ECDHE-ECDSA-AES128-GCM-SHA256 bits=128/128); Wed, 10 Mar 2021 02:07:16 -0800 (PST) Date: Wed, 10 Mar 2021 13:07:15 +0300 From: Mamontov Roman Message-ID: <1903978782.20210310130715@gmail.com> To: FreeBSD-STABLE Mailing List Subject: Troubles with netdump(4) MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Transfer-Encoding: 7bit X-Rspamd-Queue-Id: 4DwSRq1hQGz4pMF X-Spamd-Bar: --- Authentication-Results: mx1.freebsd.org; dkim=pass header.d=gmail.com header.s=20161025 header.b=s76wfsvc; dmarc=pass (policy=none) header.from=gmail.com; spf=pass (mx1.freebsd.org: domain of mrxanto@gmail.com designates 2a00:1450:4864:20::236 as permitted sender) smtp.mailfrom=mrxanto@gmail.com X-Spamd-Result: default: False [-3.99 / 15.00]; RCVD_VIA_SMTP_AUTH(0.00)[]; R_SPF_ALLOW(-0.20)[+ip6:2a00:1450:4000::/36:c]; FREEMAIL_FROM(0.00)[gmail.com]; RCVD_COUNT_THREE(0.00)[3]; TO_DN_ALL(0.00)[]; DKIM_TRACE(0.00)[gmail.com:+]; DMARC_POLICY_ALLOW(-0.50)[gmail.com,none]; NEURAL_HAM_SHORT(-1.00)[-1.000]; RECEIVED_SPAMHAUS_PBL(0.00)[37.235.174.147:received]; FROM_EQ_ENVFROM(0.00)[]; MIME_TRACE(0.00)[0:+]; FREEMAIL_ENVFROM(0.00)[gmail.com]; MID_RHS_MATCH_FROM(0.00)[]; TAGGED_FROM(0.00)[]; ASN(0.00)[asn:15169, ipnet:2a00:1450::/32, country:US]; ARC_NA(0.00)[]; RBL_DBL_DONT_QUERY_IPS(0.00)[2a00:1450:4864:20::236:from]; R_DKIM_ALLOW(-0.20)[gmail.com:s=20161025]; NEURAL_HAM_MEDIUM(-0.99)[-0.992]; FROM_HAS_DN(0.00)[]; DWL_DNSWL_NONE(0.00)[gmail.com:dkim]; TO_MATCH_ENVRCPT_ALL(0.00)[]; NEURAL_HAM_LONG(-1.00)[-1.000]; MIME_GOOD(-0.10)[text/plain]; PREVIOUSLY_DELIVERED(0.00)[freebsd-stable@freebsd.org]; RCPT_COUNT_ONE(0.00)[1]; SPAMHAUS_ZRD(0.00)[2a00:1450:4864:20::236:from:127.0.2.255]; RCVD_IN_DNSWL_NONE(0.00)[2a00:1450:4864:20::236:from]; RCVD_TLS_ALL(0.00)[]; MAILMAN_DEST(0.00)[freebsd-stable] X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.34 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 10 Mar 2021 10:07:20 -0000 Hello. I try to use netdump(4) option for transmitting kernel dumps to a remote server. When I caused a kernel panic by sysctl debug.kdb.panic I found, that netdumping to remote server happens very slow: systat -ifstat on remote side show speed around 5KB/s. On netdump-client side I have: root@host-1:/home/roman # uname -mv FreeBSD 12.2-STABLE GENERIC amd64 root@host-1:/home/roman # root@host-1:/home/roman # dumpon -l em0 root@host-1:/home/roman # cat /etc/rc.local #!/bin/sh /sbin/dumpon -c 192.168.7.11 -s 192.168.7.12 em0 root@host-1:/home/roman # ifconfig em0 em0: flags=8943 metric 0 mtu 1500 options=81209b inet 192.168.7.11 netmask 0xffffff00 broadcast 192.168.7.255 media: Ethernet autoselect (1000baseT ) status: active nd6 options=29 root@solution:/home/roman # On netdumpd-side: root@host-2:/home/roman # uname -mv FreeBSD 12.2-STABLE GENERIC i386 root@host-2:/home/roman # ifconfig em0 em0: flags=8843 metric 0 mtu 1500 options=81209b inet 192.168.7.12 netmask 0xffffff00 broadcast 192.168.7.255 media: Ethernet autoselect (1000baseT ) status: active nd6 options=29 root@solution-old:/home/roman # Both (host-1 and host-2) have the same stable/12 revision: # cat /usr/src/.gituprevision stable/12:879039312 # When I try test network bandwith between host-1 and host-2 with iperf3, I see next results: root@host-1:/home/roman # iperf3 -u -b 0 -c 192.168.7.12 Connecting to host 192.168.7.12, port 5201 [ 5] local 192.168.7.11 port 37112 connected to 192.168.7.12 port 5201 [ ID] Interval Transfer Bitrate Total Datagrams [ 5] 0.00-1.00 sec 346 MBytes 2.90 Gbits/sec 248710 [ 5] 1.00-2.00 sec 345 MBytes 2.89 Gbits/sec 247750 [ 5] 2.00-3.00 sec 345 MBytes 2.90 Gbits/sec 247990 [ 5] 3.00-4.00 sec 331 MBytes 2.78 Gbits/sec 238020 [ 5] 4.00-5.00 sec 262 MBytes 2.20 Gbits/sec 188260 [ 5] 5.00-6.00 sec 345 MBytes 2.89 Gbits/sec 247560 [ 5] 6.00-7.00 sec 345 MBytes 2.89 Gbits/sec 247660 [ 5] 7.00-8.00 sec 345 MBytes 2.90 Gbits/sec 247980 [ 5] 8.00-9.00 sec 342 MBytes 2.87 Gbits/sec 245760 [ 5] 9.00-10.00 sec 344 MBytes 2.88 Gbits/sec 246830 - - - - - - - - - - - - - - - - - - - - - - - - - [ ID] Interval Transfer Bitrate Jitter Lost/Total Datagrams [ 5] 0.00-10.00 sec 3.27 GBytes 2.81 Gbits/sec 0.000 ms 0/2406520 (0%) sender [ 5] 0.00-10.07 sec 0.00 Bytes 0.00 bits/sec 0.000 ms 0/0 (0%) receiver iperf Done. root@host-1:/home/roman # Capturing traffic between host-1 and host-2 not show anything criminal (as I understand). Next I try netdumping to another FreeBSD-host (virtual machine on VMWare hypervisor): root@host-3:~ # uname -mv FreeBSD 12.2-STABLE r369412 GENERIC amd64 root@host-3:~ # ifconfig em0 em0: flags=8843 metric 0 mtu 1500 options=81009b inet 192.168.7.18 netmask 0xffffff00 broadcast 192.168.7.255 media: Ethernet autoselect (1000baseT ) status: active nd6 options=29 root@host-3:~ # And netdumping to this host are still slow (~the same 5KB/s). Next step another FreeBSD-host (virtual machine on VirtualBox hypevisor): root@host-4:~ # uname -mv FreeBSD 12.2-STABLE r369412 GENERIC amd64 root@host-4:~ # ifconfig em0 em0: flags=8843 metric 0 mtu 1500 options=81009b inet 192.168.7.19 netmask 0xffffff00 broadcast 192.168.7.255 media: Ethernet autoselect (1000baseT ) status: active nd6 options=29 root@host-4:~ # Both (host-3 and host-4) are installed from FreeBSD-12.2-STABLE-amd64-20210304-r369412-bootonly.iso When I caused a kernel panic by sysctl debug.kdb.panic on host-4, netdumping to host-3 show the same 5 KB/s. Is there an particularity in netdump, that can't transmitting crash dumps over network faster than 5KB/s? Or this is a "feature" of my test-suite? From owner-freebsd-stable@freebsd.org Wed Mar 10 11:22:14 2021 Return-Path: Delivered-To: freebsd-stable@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 042BC5AD34F for ; Wed, 10 Mar 2021 11:22:14 +0000 (UTC) (envelope-from ruben@verweg.com) Received: from erg.verweg.com (erg.verweg.com [IPv6:2a02:898:96::5e8e:f508]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4DwV6F19yMz4tTk for ; Wed, 10 Mar 2021 11:22:12 +0000 (UTC) (envelope-from ruben@verweg.com) DKIM-Filter: OpenDKIM Filter v2.10.3 erg.verweg.com (unknown-jobid) Received: from [IPv6:2a10:3781:3e9:1:4c11:91a:b616:340d] ([IPv6:2a10:3781:3e9:1:4c11:91a:b616:340d]) (authenticated bits=0) by erg.verweg.com (8.16.1/8.15.2) with ESMTPSA id 12ABM9sx066437 (version=TLSv1.3 cipher=TLS_AES_256_GCM_SHA384 bits=256 verify=NOT) for ; Wed, 10 Mar 2021 11:22:09 GMT (envelope-from ruben@verweg.com) Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: quoted-printable From: Ruben van Staveren Mime-Version: 1.0 (1.0) Subject: Re: FreeBSD 13.0 RC1 UEFI RAID-10 boot problems under VMware Fusion Date: Wed, 10 Mar 2021 12:22:08 +0100 Message-Id: References: <58352200-C53A-4B8F-9498-316FC852BD95@verweg.com> In-Reply-To: <58352200-C53A-4B8F-9498-316FC852BD95@verweg.com> To: freebsd-stable@freebsd.org X-Mailer: iPad Mail (18D61) X-Rspamd-Queue-Id: 4DwV6F19yMz4tTk X-Spamd-Bar: --- X-Spamd-Result: default: False [-3.50 / 15.00]; RCVD_TLS_ALL(0.00)[]; RCVD_VIA_SMTP_AUTH(0.00)[]; R_DKIM_ALLOW(-0.20)[verweg.com:s=verweg]; MID_RHS_MATCH_FROM(0.00)[]; FROM_HAS_DN(0.00)[]; MV_CASE(0.50)[]; TO_MATCH_ENVRCPT_ALL(0.00)[]; MIME_GOOD(-0.10)[text/plain]; PREVIOUSLY_DELIVERED(0.00)[freebsd-stable@freebsd.org]; TO_DN_NONE(0.00)[]; RCPT_COUNT_ONE(0.00)[1]; SPAMHAUS_ZRD(0.00)[2a02:898:96::5e8e:f508:from:127.0.2.255]; ARC_NA(0.00)[]; R_SPF_ALLOW(-0.20)[+mx]; DKIM_TRACE(0.00)[verweg.com:+]; DMARC_POLICY_ALLOW(-0.50)[verweg.com,reject]; NEURAL_HAM_SHORT(-1.00)[-1.000]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; NEURAL_HAM_LONG(-1.00)[-1.000]; FROM_EQ_ENVFROM(0.00)[]; MIME_TRACE(0.00)[0:+]; RBL_DBL_DONT_QUERY_IPS(0.00)[2a02:898:96::5e8e:f508:from]; ASN(0.00)[asn:8283, ipnet:2a02:898::/32, country:NL]; RCVD_COUNT_TWO(0.00)[2]; MAILMAN_DEST(0.00)[freebsd-stable] X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.34 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 10 Mar 2021 11:22:14 -0000 To continue on the subject of UEFI booting weirdness > On 9 Mar 2021, at 16:57, Ruben van Staveren wrote: >=20 > If I press escape and end up in VMWare=E2=80=99s UEFI setup screen I can b= oot from any ada*p1 drive and continue as normal.=20 > Is UEFI with OpenZFS too new, or is this an issue in VMWare? I got an off list tip to see whether this was also the case in bhyve, so I a= lso created the setup in there, using UEFI boot, and no problems even with t= he special/log/cache NVMe vdevs attached to the pool. So I=E2=80=99m starting to wonder whether the loader / VMware UEFI firmware= (??) interaction is a bug in VMware or an edge case that needs to be suppor= ted too. Btw, bhyve is looking nice these days! Cheers,=09 Ruben From owner-freebsd-stable@freebsd.org Sat Mar 13 00:11:13 2021 Return-Path: Delivered-To: freebsd-stable@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 681425B17F1; Sat, 13 Mar 2021 00:11:13 +0000 (UTC) (envelope-from gjb@freebsd.org) Received: from freefall.freebsd.org (freefall.freebsd.org [IPv6:2610:1c1:1:6074::16:84]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "freefall.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4Dy34d2CWVz3KvL; Sat, 13 Mar 2021 00:11:13 +0000 (UTC) (envelope-from gjb@freebsd.org) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1615594273; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:cc:mime-version:mime-version:content-type:content-type; bh=ZKcM9VX91av0PaPoa6eBHbhWreTHmk8uHX1plMJwKfI=; b=Fsy5bJrcuqdqaRyHp8NsP1Zk2K8TClg4ubsEUAUL3GvGcnkJGRj1oh4v55no8S0e33ME3q 7Gq5ltOwNqkX7VoAHx20PAunKx62vqqOXGFkGeeAS4nFqeiL+XeRiegocWh6QwJ7o1Gbch kBX+QCwM8PMoUOS776oJWoBURWQ3+tw3zibpNHLXlKHpLOfDet64oeUlXebW/ymMQEXkxV ZP1jyfc8ts8JIIrL7T78K9n0iYdDDejG4ulZuX75UB3COcdLYkp0CUMvVW2xTz0dQEimzc 97muW8suba4hV9D9epcyf0hPX2mHqGFeyCtM/CYO3d4/xgZhqEMbO6wcWG/ccg== Received: from FreeBSD.org (freefall.freebsd.org [IPv6:2610:1c1:1:6074::16:84]) (using TLSv1 with cipher ECDHE-RSA-AES256-SHA (256/256 bits)) (Client did not present a certificate) by freefall.freebsd.org (Postfix) with ESMTPS id D0D5A15202; Sat, 13 Mar 2021 00:11:12 +0000 (UTC) (envelope-from gjb@freebsd.org) Date: Sat, 13 Mar 2021 00:11:10 +0000 From: Glen Barber To: freebsd-current@freebsd.org, freebsd-stable@freebsd.org, freebsd-snapshots@freebsd.org Cc: FreeBSD Release Engineering Team Subject: FreeBSD 13.0-RC2 Now Available Message-ID: <20210313001110.GP92054@FreeBSD.org> MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii; x-action=pgp-signed ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1615594273; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:cc:mime-version:mime-version:content-type:content-type; bh=ZKcM9VX91av0PaPoa6eBHbhWreTHmk8uHX1plMJwKfI=; b=jLy7KAx0fhgmWc3A/6G2q8tr3V+eAZQSCMLzBwP7mOd6E323hNfeH3nLqVZNO4lfSPWC/C UGYMh6xLa8qwI7YDkNjIMNg7uyS1KLrbPyaWzV/86e07wzUpojE0AnF2r+sBy0u7QOBigg loCB6jdfv57VmRay94ov84+Jzq6dTjLx/LFKlSqMBiJA1jmeIrvAnTKj4gpxJ3NUJpmEsz tqKHzWU7MloJSVCzuOUIGSLDGNzcsgFD5v/cqkAhpC8qkNewfAy/rfTe+aVQsLgQcstId3 C6cFjeaeqm7jBC+LWZagRTOR7NT4BIZV54HzLQEvP+7S/iYBvBlw+uH0a7RRMQ== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1615594273; a=rsa-sha256; cv=none; b=TTXdN/4dfJlt5NSB4EHhPa1Lxs+itUlxc1qVY7M8WrPtDFG6J+w79tsx3JZDSd4T0l03e+ NvZ6upcJABHbDdY/dnbl3WI+JxHWACIFyRjoT/JTf49eAAsHWpAJq+IF5aOw0+dLl3rQfn XWN49ROsfyLc28742oeWK/oO6t8ff96TLy2sHkwMdR0RdFSON5yQLA9ZEyHg8LU+BT1SMF w0CuiuBr48oMc58O1KkBQOVEHh7Q38oRHKfxwftnuaUIWECbBP7K6vE+3c1z1/NnnvpcKO 7Q1HcTYzeOQjnZOO49oCJ3V+xWNrtwzpomE/200fEPaYInYuOEVsBU05z2xVWQ== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.34 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 13 Mar 2021 00:11:13 -0000 -----BEGIN PGP SIGNED MESSAGE----- Hash: SHA256 The second RC build of the 13.0-RELEASE release cycle is now available. Installation images are available for: o 13.0-RC2 amd64 GENERIC o 13.0-RC2 i386 GENERIC o 13.0-RC2 powerpc GENERIC o 13.0-RC2 powerpc64 GENERIC64 o 13.0-RC2 powerpc64le GENERIC64LE o 13.0-RC2 powerpcspe MPC85XXSPE o 13.0-RC2 armv6 RPI-B o 13.0-RC2 armv7 GENERICSD o 13.0-RC2 aarch64 GENERIC o 13.0-RC2 aarch64 RPI o 13.0-RC2 aarch64 PINE64 o 13.0-RC2 aarch64 PINE64-LTS o 13.0-RC2 aarch64 PINEBOOK o 13.0-RC2 aarch64 ROCK64 o 13.0-RC2 aarch64 ROCKPRO64 o 13.0-RC2 riscv64 GENERIC o 13.0-RC2 riscv64 GENERICSD Note regarding arm SD card images: For convenience for those without console access to the system, a freebsd user with a password of freebsd is available by default for ssh(1) access. Additionally, the root user password is set to root. It is strongly recommended to change the password for both users after gaining access to the system. Installer images and memory stick images are available here: https://download.freebsd.org/ftp/releases/ISO-IMAGES/13.0/ The image checksums follow at the end of this e-mail. If you notice problems you can report them through the Bugzilla PR system or on the -stable mailing list. If you would like to use Git to do a source based update of an existing system, use the "releng/13.0" branch. A summary of changes since 13.0-RC1 includes: o Miscellaneous loader fixes. o Fixes to if_wg(4) have been added. o The growfs(8) utility has been updated to allow operating on read/write filesystems. o Several ZFS fixes. o Several TCP fixes. o The bc(1) utility has been updated to version 3.3.3. o An arm64 AES-XTS regression has been fixed. o A fix for VLAN hardware filtering in ixl(4) has been fixed. o The ice(4) driver has been updated to version 0.28.1-k. A list of changes since 12.2-RELEASE is available in the releng/13.0 release notes: https://www.freebsd.org/releases/13.0R/relnotes.html Please note, the release notes page is not yet complete, and will be updated on an ongoing basis as the 13.0-RELEASE cycle progresses. === Virtual Machine Disk Images === VM disk images are available for the amd64, i386, and aarch64 architectures. Disk images may be downloaded from the following URL (or any of the FreeBSD download mirrors): https://download.freebsd.org/ftp/releases/VM-IMAGES/13.0-RC2/ The partition layout is: ~ 16 kB - freebsd-boot GPT partition type (bootfs GPT label) ~ 1 GB - freebsd-swap GPT partition type (swapfs GPT label) ~ 20 GB - freebsd-ufs GPT partition type (rootfs GPT label) The disk images are available in QCOW2, VHD, VMDK, and raw disk image formats. The image download size is approximately 135 MB and 165 MB respectively (amd64/i386), decompressing to a 21 GB sparse image. Note regarding arm64/aarch64 virtual machine images: a modified QEMU EFI loader file is needed for qemu-system-aarch64 to be able to boot the virtual machine images. See this page for more information: https://wiki.freebsd.org/arm64/QEMU To boot the VM image, run: % qemu-system-aarch64 -m 4096M -cpu cortex-a57 -M virt \ -bios QEMU_EFI.fd -serial telnet::4444,server -nographic \ -drive if=none,file=VMDISK,id=hd0 \ -device virtio-blk-device,drive=hd0 \ -device virtio-net-device,netdev=net0 \ -netdev user,id=net0 Be sure to replace "VMDISK" with the path to the virtual machine image. BASIC-CI images can be found at: https://download.freebsd.org/ftp/releases/CI-IMAGES/13.0-RC2/ === Amazon EC2 AMI Images === FreeBSD/amd64 EC2 AMIs are available in the following regions: af-south-1 region: ami-075584d5b26000fb4 eu-north-1 region: ami-01bc9e74704057f84 ap-south-1 region: ami-0482a65377ea03c8e eu-west-3 region: ami-089013cf606c3cef0 eu-west-2 region: ami-074ec752c433390e3 eu-south-1 region: ami-0fa2b27853fc18f1c eu-west-1 region: ami-08e5c85eec858fe9c ap-northeast-3 region: ami-0cd8f0feba156c1b8 ap-northeast-2 region: ami-0f407f222ea20777f me-south-1 region: ami-0752247a4f4b7f1c5 ap-northeast-1 region: ami-062b0b3b7c9be696d sa-east-1 region: ami-07ef18e5aa3e4b373 ca-central-1 region: ami-064103ca013b74ee3 ap-east-1 region: ami-0c86834fdbbd272aa ap-southeast-1 region: ami-07791074bad9e30f5 ap-southeast-2 region: ami-0f9d5ee9afd3c9166 eu-central-1 region: ami-036260c2bf5ffaab0 us-east-1 region: ami-06df356662db1c1c0 us-east-2 region: ami-0b81e7e91a55d8a44 us-west-1 region: ami-0293a117e598e5d79 us-west-2 region: ami-047216a21fe30e18f FreeBSD/aarch64 EC2 AMIs are available in the following regions: af-south-1 region: ami-0f24d089d2383ba32 eu-north-1 region: ami-06368e4701f2a8732 ap-south-1 region: ami-0186094ac26aaab14 eu-west-3 region: ami-0297345102a342c4c eu-west-2 region: ami-02ad08dcf7eb46940 eu-south-1 region: ami-02c217018c44903b0 eu-west-1 region: ami-0a13bb7013c52966d ap-northeast-3 region: ami-0f3492211bdf21572 ap-northeast-2 region: ami-0c4cb857f15dbcded me-south-1 region: ami-039cf70b6a94eb021 ap-northeast-1 region: ami-0a0f327c3011be6ed sa-east-1 region: ami-0a648f8fcf60c6550 ca-central-1 region: ami-0d1c97dccc085cc92 ap-east-1 region: ami-09728de5d6589231f ap-southeast-1 region: ami-0f7557b725c8ea743 ap-southeast-2 region: ami-0e9dd1ed03dbbe2cd eu-central-1 region: ami-0c15e0a54e52ade93 us-east-1 region: ami-0a148ecd7853db173 us-east-2 region: ami-027783264e56f740e us-west-1 region: ami-014c3ef86fde1528c us-west-2 region: ami-075720b038e6e7c0c === Vagrant Images === FreeBSD/amd64 images are available on the Hashicorp Atlas site, and can be installed by running: % vagrant init freebsd/FreeBSD-13.0-RC2 % vagrant up === Upgrading === The freebsd-update(8) utility supports binary upgrades of amd64 and i386 systems running earlier FreeBSD releases. Systems running earlier FreeBSD releases can upgrade as follows: # freebsd-update upgrade -r 13.0-RC2 During this process, freebsd-update(8) may ask the user to help by merging some configuration files or by confirming that the automatically performed merging was done correctly. # freebsd-update install The system must be rebooted with the newly installed kernel before continuing. # shutdown -r now After rebooting, freebsd-update needs to be run again to install the new userland components: # freebsd-update install It is recommended to rebuild and install all applications if possible, especially if upgrading from an earlier FreeBSD release, for example, FreeBSD 11.x. Alternatively, the user can install misc/compat11x and other compatibility libraries, afterwards the system must be rebooted into the new userland: # shutdown -r now Finally, after rebooting, freebsd-update needs to be run again to remove stale files: # freebsd-update install == ISO CHECKSUMS == o 13.0-RC2 amd64 GENERIC: SHA512 (FreeBSD-13.0-RC2-amd64-bootonly.iso) = 54a73543cafc861c90ff1a72aa6c921c307d2af76800079aa1191bad89339076a9680a430c939d0d4d052888bbedcabe7aa8f2bcdb5e228a4704460351513d56 SHA512 (FreeBSD-13.0-RC2-amd64-bootonly.iso.xz) = 530811c49445a0985036863f88d03e4753cf6ebd19452f39d6230fbf582ff6ac4d5d90817cc5af22bf85dc85683302e12f154e6827f272e51e727773f7336f25 SHA512 (FreeBSD-13.0-RC2-amd64-disc1.iso) = 7414ee64ba2fe3192cf4b4e9daa93925433bc04074e869d71696c086eb7d0691478ea359cf3471f7c626bf2834c10ed1910f0d5bc41a83b12fe128c13dd31bdc SHA512 (FreeBSD-13.0-RC2-amd64-disc1.iso.xz) = 99a876e2b2c1d1c6752ceadafc70a6745ad8e9136526d23826ce5922b628ca76ba27159c74feea174b6cec2f5b06d48829f639967522eb6196725086f66b2f6d SHA512 (FreeBSD-13.0-RC2-amd64-dvd1.iso) = 5cd73bccc7d653760bc816e3922d74b034c4652d58a94bb6bba2cf53c261ea19b5f54acf7023170c6af79b07d0fdc618b5529ecdbd86d047e3a56cabdf49176f SHA512 (FreeBSD-13.0-RC2-amd64-dvd1.iso.xz) = 55026fe23d2ab135bbd88096cfde02310a3ec2ecebed0625b896924bca8c028bdd56d6d05178a613cf9e479ad36dcc29f3cbb988df65a63e43e2c16b822fc2d4 SHA512 (FreeBSD-13.0-RC2-amd64-memstick.img) = 850c82bb99435e8467b8e54893b4e39ee3d304797e69b795938b3e00e2e59b8baedf65f86e40e14a6631d80bf669417169d14ddaf7ae0bed69a20a3cb3563bdf SHA512 (FreeBSD-13.0-RC2-amd64-memstick.img.xz) = 6500796c500dbfac1290db846e1d8882091a23b055cb034bf85fbc329183c70539db5f2b525468e53d8f023bd4cbd70c866e73ae8e2ed2934df1327d29386e4b SHA512 (FreeBSD-13.0-RC2-amd64-mini-memstick.img) = 1ad8816a50c5276dffa0be73d0fc753a5d72e4ef988daeeaefb47902a91e3dd672355ba2788bbb6559de4ab8201e9ef6c1af9001d2c04214e316082174270e21 SHA512 (FreeBSD-13.0-RC2-amd64-mini-memstick.img.xz) = fe5f1fb95910f71fb638caa06dcaaf16d06ae99fe2f11738deba9dc3afb58edda0d1af8c89c503c11a2057a028ec200d2c2f7aa5d2f64f230bcdf751a2dccda3 SHA256 (FreeBSD-13.0-RC2-amd64-bootonly.iso) = 58e43e0b092a268edf8533c9e1cebc41b58e69c7058cf563618ac455052daffd SHA256 (FreeBSD-13.0-RC2-amd64-bootonly.iso.xz) = 48a4ea3b60215fd095004832dff7f6195361be29014b6779b73803029da9ac98 SHA256 (FreeBSD-13.0-RC2-amd64-disc1.iso) = ab244a85e7acbadd5ea609934809f549302e911a68d6abfb784e4b83a6905cef SHA256 (FreeBSD-13.0-RC2-amd64-disc1.iso.xz) = 46ee6d455f60579e9ce3bfed19bc1abce6fb3ea4d1fbd9615e31a0f1ae7a6fd1 SHA256 (FreeBSD-13.0-RC2-amd64-dvd1.iso) = 371c629b2e1ffda6be07788e102b47d59ad3bf463ccd5ced24009d323fda1380 SHA256 (FreeBSD-13.0-RC2-amd64-dvd1.iso.xz) = d1c7beaaee2836ea88016af7db227f014cbdd07a311bae75da87ba013b0c71e9 SHA256 (FreeBSD-13.0-RC2-amd64-memstick.img) = b3433a608ade02ba4e5f7e20bde351bf5d803272e86b0102e3859026c6df1a69 SHA256 (FreeBSD-13.0-RC2-amd64-memstick.img.xz) = 9aad5873f1f4215570dab24abfca20d10f3bff91a48be76fb65768a738ee777e SHA256 (FreeBSD-13.0-RC2-amd64-mini-memstick.img) = 4571db996294b101f20b7f5ed4c6adf32fd96a87023baffe866ebf8d8032ad67 SHA256 (FreeBSD-13.0-RC2-amd64-mini-memstick.img.xz) = 3b8dd166da52e7d623d0109a240677173c580e17cb23d8e0c3458fb5d858e3ae o 13.0-RC2 i386 GENERIC: SHA512 (FreeBSD-13.0-RC2-i386-bootonly.iso) = 1ba5c7a299b7f2eda6229059263d44bb16e9a073ac7ac4e8412362d5a4778faf771949b8874825f429741b50418b142d3fa92b8c7d3ef51e37572eeecac31b28 SHA512 (FreeBSD-13.0-RC2-i386-bootonly.iso.xz) = 6443f547d670e4f58ba4828b1c38519063226438812679b97a90a8da7eb56c921364ee305d2bab885d9728437425d4172bd79f464833b00ba4313731b4ef39bf SHA512 (FreeBSD-13.0-RC2-i386-disc1.iso) = 0350e7505c042a4ce05dc192a7d2c38377371748f8ac3242e99c8684d3b6fd079198d13de996a08da6ea84fbfeb6c2bd3499d737b4abfa1ba83a5773b82e692e SHA512 (FreeBSD-13.0-RC2-i386-disc1.iso.xz) = a57aedf285f7b73652f72c68eb6c4816299f0ad92426e7ea51cde37e5a60a23f7d64f891444ffad679e3d581293c42b8e9250f77677ff883118a9491b37859c9 SHA512 (FreeBSD-13.0-RC2-i386-dvd1.iso) = b055fbcb611ed8ab5f50795b2db888e5108b7decff8ee0c54d7a6cd1c01f4228622962dbeb9578a3d9a2740ade342abbc4e294ea338e31f69e62c60fc3366b5d SHA512 (FreeBSD-13.0-RC2-i386-dvd1.iso.xz) = f0ec4d1b1dad9738542d1814fd1c96493482c0d0e23897ae899f7cffb11204eb709a7dd804f9423764ebd88f5db6f063e355eb6833b008acc8bfe3b1343b85e0 SHA512 (FreeBSD-13.0-RC2-i386-memstick.img) = 87102d85e592cf068720cde39a6e8844337bbc27ce50775e6715e5f90c53f2865ba17990c0f1d29f785d47235c1a18493184a8af73aedc7271743c5e9a38af27 SHA512 (FreeBSD-13.0-RC2-i386-memstick.img.xz) = 85053cbce49b99d8494ec80571bc5c4821510d7b4dfb3139b1af266323350bd7e78f7b2bfa09a92c7760c838e815df50f514b5bfaaae6a675cbfb10604ca52e3 SHA512 (FreeBSD-13.0-RC2-i386-mini-memstick.img) = 738f99a3e16e38bbcaecc1908ee548dab9d500d84921c3e6cc6b907717f31452929126080e15f385f7bca57b3e68ca09d5694642e5c256d9fd94bff12ee5b7a5 SHA512 (FreeBSD-13.0-RC2-i386-mini-memstick.img.xz) = c1136fe3f94b8d8ae8537260d3f09485d1284ab827f5889ef065cb9b780fde59474e8b80e5b801084b656d00bd40cac4e850528980b7a07565f98cca9365a951 SHA256 (FreeBSD-13.0-RC2-i386-bootonly.iso) = e8bf5eba663773299e1c39ce1c8727638d8ef53b153956a433e7da2b2c1dfcfd SHA256 (FreeBSD-13.0-RC2-i386-bootonly.iso.xz) = 756d1d9befc0a62bc77cae8695ae296f5945d6b151cff52e0ce8109dad475978 SHA256 (FreeBSD-13.0-RC2-i386-disc1.iso) = e473a649f8d385078a7f8385092d09628b14f83586c6ab7e3d504a8e3ac1bda5 SHA256 (FreeBSD-13.0-RC2-i386-disc1.iso.xz) = ba3dfd63f4a9a62077c849a0b6cd7b7c2516729a81c9e6fd3f75cead37a99ee0 SHA256 (FreeBSD-13.0-RC2-i386-dvd1.iso) = be42a76332ef59654a0f76e32b04f1b5cd8a8e7fa033e003d7986cfad1951c50 SHA256 (FreeBSD-13.0-RC2-i386-dvd1.iso.xz) = 158dfaa9f4406cf5c8ed432601cd2f9ca3c51b03eb1f8c158ff432dd34572328 SHA256 (FreeBSD-13.0-RC2-i386-memstick.img) = 3ccab85ca211a8900c29a0fc662f45e9986d1b8a01154ec289671a3d1069acf8 SHA256 (FreeBSD-13.0-RC2-i386-memstick.img.xz) = aa6bfacb77432b2c74528df15c188b8526fc13e7574853fd69074ed9b829f4df SHA256 (FreeBSD-13.0-RC2-i386-mini-memstick.img) = 33174aa878182832f6aa544be93237e4a804bf793053e0bfa19496afb1e714e5 SHA256 (FreeBSD-13.0-RC2-i386-mini-memstick.img.xz) = 09f9074c66be05dedc1fc9499b6a6d5da56435fba01861a5a18d59c26aa91880 o 13.0-RC2 powerpc GENERIC: SHA512 (FreeBSD-13.0-RC2-powerpc-bootonly.iso) = d930e203dcd48bda4dee8348a9e79d49cd40a86f67c5cf17ce948ab147e75a66d912994032920aa5231670b4b0561b71da19a09895f34435a8a9e26a896a3263 SHA512 (FreeBSD-13.0-RC2-powerpc-bootonly.iso.xz) = 80926ab6063e71e39485dbf6d2f4b3b1eabe2faa7011ddfdb2a9ac489deedd42f76619c3539e2c4afe2d1ae551c42c57cd0cf454fcc07c9d41aa489a49ea110b SHA512 (FreeBSD-13.0-RC2-powerpc-disc1.iso) = 07cfdbd1d041a73b520381903d5cb5c477bd8a6fd318d6405405638b4603a3679fb3c95a4a6d7763fd1395d2907837225a00c92f4babab9fc82a032c4b26260e SHA512 (FreeBSD-13.0-RC2-powerpc-disc1.iso.xz) = 1debf604d33ec0e1695dc31463988bbc87221744b11e595e2e3ebf817b5b4144ca87a9eb781c4e2fb946277a40cdb9411797b1d1e45b8e9e38a856a9dd44945e SHA512 (FreeBSD-13.0-RC2-powerpc-dvd1.iso) = 174e0ed0cf24e02f4ff2d89a3c4b00bf1ed2a8a815449df2efe05572835fc7f2e503e28ecc53a6f588ee6f9e27968b59d45fff255ab62e5c6db2c5f25436bd86 SHA512 (FreeBSD-13.0-RC2-powerpc-dvd1.iso.xz) = 98ccaa4d325a93e14edcbad10f88fc70742e216724fa0f6adcc40f98041113add5654313132a47d811a46b977a7a948edcc120fbc48742804295f61c96bf3fe3 SHA512 (FreeBSD-13.0-RC2-powerpc-memstick.img) = d1319c86b348804ed442a61d0277982157a8ab9d67336e55891a3852355de28f81f2f0eaa66b408b413802832f16f118a83dbe1280792345bb62cb9ee83abf66 SHA512 (FreeBSD-13.0-RC2-powerpc-memstick.img.xz) = 6c624758bd42e56206d07a0197ad51f6344445b1016c55c5db26ffd7f7b16e6e85377b7c8b9fb4c9fc782b3ec074ca0d0b62a6ed885773aea38240896b28c899 SHA512 (FreeBSD-13.0-RC2-powerpc-mini-memstick.img) = 3a09c380ce88749344f5c253b9c05207712981d53a6c16ff61f55f8fcbf3cf3e5e428d52c4ced9b914c3983a6eebb0aeb7d853a56d8466800d5d247b2376ce07 SHA512 (FreeBSD-13.0-RC2-powerpc-mini-memstick.img.xz) = fdf15c091404d20da8de47b269ff0de06ec82095ea4b2360414dab7091e01a0034e22bb7e4e77e540dd0b09dc0c8f4da6594e36ef086a107b3dbc67a06c018fe SHA256 (FreeBSD-13.0-RC2-powerpc-bootonly.iso) = 8573da6dfcc28ef51742f477b5a57a616f54d1e7e6dfb4e98bf01d3e5af63f91 SHA256 (FreeBSD-13.0-RC2-powerpc-bootonly.iso.xz) = 92853fac30c594f87cbea4eccdfa28dbe9a5cb6d5202ebc45076626c9f978a34 SHA256 (FreeBSD-13.0-RC2-powerpc-disc1.iso) = cbb6bcab279d0fb0118ff39e0cbfebb59cfe1e14d241a5e749266a14e444f447 SHA256 (FreeBSD-13.0-RC2-powerpc-disc1.iso.xz) = 6981e01022ade54cafd9e7378fc36928a01d182b2e92d3ab175229bdbecd2e96 SHA256 (FreeBSD-13.0-RC2-powerpc-dvd1.iso) = fc1d59afa1d6d006b22aeacdbd621d85295fc98152a8a898f9912fe5f4b05c7b SHA256 (FreeBSD-13.0-RC2-powerpc-dvd1.iso.xz) = f6683b3730e6e7fcd33f98390daf09bbd90afd062817ea0a304e11022f53d352 SHA256 (FreeBSD-13.0-RC2-powerpc-memstick.img) = 63907e8004e6fbcedb002be8797f5c87b014ca4f773b5f631fe9420055c59ef3 SHA256 (FreeBSD-13.0-RC2-powerpc-memstick.img.xz) = c1bad1a63a015c66ae463008f36881c9015d6b04a1e9d13d5aa098b1cd7ed247 SHA256 (FreeBSD-13.0-RC2-powerpc-mini-memstick.img) = bd705ed8b7f9cea0d6316b2c69200986ad084ea3923065c38586a2d2836882f6 SHA256 (FreeBSD-13.0-RC2-powerpc-mini-memstick.img.xz) = a77f2d7a77c14aeb500f442e43138a707a379b9a4eafa4f67673463da3e7e71c o 13.0-RC2 powerpc64 GENERIC64: SHA512 (FreeBSD-13.0-RC2-powerpc-powerpc64-bootonly.iso) = ed4192f27bae4b11fc0eaa3e1dddd182acb12bbc157355d2ffd1f2db81d61a960201aab30cb7a61530b22bfc43a724fb34ecc9dcea32f522daddc1803dd3e9ea SHA512 (FreeBSD-13.0-RC2-powerpc-powerpc64-bootonly.iso.xz) = 228741e31a653671431bd223e736014f917a9dcfa68ceb90c741214ef5a2e6b1c7203ef4eed6d75abd16c9814663cc75d91bcb9ef645cd0f5eed190cc03be847 SHA512 (FreeBSD-13.0-RC2-powerpc-powerpc64-disc1.iso) = e2c7a71ae205c83a4ca6bf02eb80424a99fd81847c8149c51cfea399ce363fa1bfa374d59ce09cae2c4a52939aa345f6e05f7ebc7c76d97c498fdcd771e18713 SHA512 (FreeBSD-13.0-RC2-powerpc-powerpc64-disc1.iso.xz) = 9991de3768ed5e9c06ad82dc5de526ad7efe79a75649ee037d48fde634afcd1aea6f3488ba03c57d9ce06d66a1adb2b8e0a7401116f73269dd4bcaaf4e7bf03d SHA512 (FreeBSD-13.0-RC2-powerpc-powerpc64-dvd1.iso) = f05b751d4943c6f5ddfe258bfac21206d5ffebf436f8658f047f3b755c737a595acd5aab2089f8f42aa58993d1738bf6d0174d1a53843fe36a9deb36f75d129f SHA512 (FreeBSD-13.0-RC2-powerpc-powerpc64-dvd1.iso.xz) = cc8b1a83f67b001b819ec90048ceb73e7deac8e4ecced15c32606b53f8af65b3a47296d67cbe37e5e3e0be9bbd6a032fa64574aa9b55ca7665c0cbd7982cb3d5 SHA512 (FreeBSD-13.0-RC2-powerpc-powerpc64-memstick.img) = e74474f60c809fb1904c42ffdf6d8a122ad5aa38688fe5ba508732cc59439a8bf96ef9322545b606b261d0a27976470f2ead74c4e714e044c6b0750b8e31c78c SHA512 (FreeBSD-13.0-RC2-powerpc-powerpc64-memstick.img.xz) = 88a958362add33d74624bf9605bf81d89259b39c9521510cc6dc3c1e250fcc629e3fe945b211a30c77ca966c0ced8ebd6e5a154f3d6c92fa10da236ed0f10187 SHA512 (FreeBSD-13.0-RC2-powerpc-powerpc64-mini-memstick.img) = c87da67cc2cd563caaf2042c4693682adf289365208ee5085ff70592ab748b5241bc4caf967eb9d1bb053aa5fc8689ac7b84617f73af4cd84439a77bf9aa3fc6 SHA512 (FreeBSD-13.0-RC2-powerpc-powerpc64-mini-memstick.img.xz) = 3d9a3987a12f9f2c51385feb09b065f6f1fcb9fd97b4cbdb122ae117d179de561f23ddfe250706211bc9b93ed4c1e3d42b34b156b0b6631a340d298394790945 SHA256 (FreeBSD-13.0-RC2-powerpc-powerpc64-bootonly.iso) = 0df9703ba834f543b4463a67f1f26f4581d04e6a4b6eccc1684e7e42f547b11c SHA256 (FreeBSD-13.0-RC2-powerpc-powerpc64-bootonly.iso.xz) = 3b6e6cb6945ef8573341ce46cdcbe33e9e8c63e1d33c6f6cc1fad08ea456a458 SHA256 (FreeBSD-13.0-RC2-powerpc-powerpc64-disc1.iso) = 734b4fcb73ea1ec28543c323c1f7a5dc20aa2b1657628654600fbfcf0f8e04b3 SHA256 (FreeBSD-13.0-RC2-powerpc-powerpc64-disc1.iso.xz) = 1963eb9cc40cce1b6eb67b345c62212de7e1b7a4114dda77c97eadad31ddc906 SHA256 (FreeBSD-13.0-RC2-powerpc-powerpc64-dvd1.iso) = 1e3375fa76d2646cb0f54c906aabd86c092a917d37437e8e0056b30357d271da SHA256 (FreeBSD-13.0-RC2-powerpc-powerpc64-dvd1.iso.xz) = fd0588dc4d90913a0562c49bae31b863ed0532e849dadd44095727790f746872 SHA256 (FreeBSD-13.0-RC2-powerpc-powerpc64-memstick.img) = c7857f21882b92c13dee8c4a64429b7535c79ee149eb7dda34607eda0844142c SHA256 (FreeBSD-13.0-RC2-powerpc-powerpc64-memstick.img.xz) = 9855ccca699274f8c33073878d771ae54fc7931cb3a1eba1beb6a75d8cb7177e SHA256 (FreeBSD-13.0-RC2-powerpc-powerpc64-mini-memstick.img) = e0e56da0ad6de77f7d8721deb98950e7ff4330a3b52a02ff072d029a96f3494c SHA256 (FreeBSD-13.0-RC2-powerpc-powerpc64-mini-memstick.img.xz) = 999edbd64584b4817f2d709c8186c0fbf9c853daa859ebd6c09034f67be6cdfe o 13.0-RC2 powerpc64le GENERIC64LE: SHA512 (FreeBSD-13.0-RC2-powerpc-powerpc64le-bootonly.iso) = 534c56211dcc1b5431ced1eb9613d05b54b6520a8b48e4c23452b450878870bf80b14814f25ea1841cabece0ed8e530aa34064779990953490e6b5a59b29518a SHA512 (FreeBSD-13.0-RC2-powerpc-powerpc64le-bootonly.iso.xz) = a5b976b496fc910f2de0efcd5420b08735506ed00df1c7e0e65c5c365b4163fad74ca14963c0bf912a14f31938d9f2a56e6813aae60ec0edb431bd933bf9b15e SHA512 (FreeBSD-13.0-RC2-powerpc-powerpc64le-disc1.iso) = ed4ea18ecdfada067dd966ae324622cdc47aa9ee68026f0906e78080947c6b991bec700619ea6e0364e13bc4f2f6f863e3f483a00a400c0bc8fc77e8dd78cca4 SHA512 (FreeBSD-13.0-RC2-powerpc-powerpc64le-disc1.iso.xz) = 0242dd853b93e1b646d92abdb2e3d25d2270da3aeb32d2596b530855f64d598529744e145059d6cd4e8aa9b7713414dbb189f57e6ee68a3c18414087f1d119c3 SHA512 (FreeBSD-13.0-RC2-powerpc-powerpc64le-dvd1.iso) = 0b3ed6c55ac6556aaaa112b2b31fd2c7cdf987b945e7a9979c82a4e6c4a74b8c94a1cec219b9eed196e02327f08c14ab77afe8dcec187b03a1b57c7c4d587cfe SHA512 (FreeBSD-13.0-RC2-powerpc-powerpc64le-dvd1.iso.xz) = e923ee67b96a95cf99e6a22478271a3bf411f8818496e09e9b4e732f65dd43f4395f441b62ff3cd2976de8c2600adf86032f080926db38910664364d79ddd6ac SHA512 (FreeBSD-13.0-RC2-powerpc-powerpc64le-memstick.img) = a0e5caedfcf3a01a2c1cbb6a5a318bcd4c5f73f4b6fc5d18f892866686216f8fa6222047bc938555e2bdfb11b0e9cb8e27ad9e103dc3955c20ae6317e6dc13ff SHA512 (FreeBSD-13.0-RC2-powerpc-powerpc64le-memstick.img.xz) = 5e948e9a4d07c16abc1257338b522d753743e4379c0fdab1c688de595e69fc9354380d94f9de065a105024ad7ca97f488b9980d566a1890569ad3c1b1041efeb SHA512 (FreeBSD-13.0-RC2-powerpc-powerpc64le-mini-memstick.img) = b086dc1d5c05dabdaeb29cd34a2702c62d90aa8de32a0ab0640abdfb56bb524392690b6d81e4dc322e30ff78be84f1be732ad9e9c10768113092a95eb15c4fdc SHA512 (FreeBSD-13.0-RC2-powerpc-powerpc64le-mini-memstick.img.xz) = fe5c7bbc77d8fbf7299c439c40532b8f7b30a20c3914b1a7cf22e21e185892d4a10bc61592922261496a8bae287236599b7f27d9125f4a115c8d456226bd618d SHA256 (FreeBSD-13.0-RC2-powerpc-powerpc64le-bootonly.iso) = 727433629962d3ce37a006bf17368aa9c3c34f10e8669869440410be6bc62be5 SHA256 (FreeBSD-13.0-RC2-powerpc-powerpc64le-bootonly.iso.xz) = a4aa1ebb4418dc51fdeeee3f9a2bab02577b7022a5eab8338922286b7cb7ebe5 SHA256 (FreeBSD-13.0-RC2-powerpc-powerpc64le-disc1.iso) = d78cdbd371494c5379582b8ce321a37bc9a984c9db4ecbf39de31d68ecfcd86f SHA256 (FreeBSD-13.0-RC2-powerpc-powerpc64le-disc1.iso.xz) = 7649cf94c43bff294d0efb8a9173f82a7a4bf5f1f0f4faeb8a0c9b80e7445bda SHA256 (FreeBSD-13.0-RC2-powerpc-powerpc64le-dvd1.iso) = 16e5ece2d2deef79213de2d8c0de264156e37a98ec54e711426a5d33bfb37b80 SHA256 (FreeBSD-13.0-RC2-powerpc-powerpc64le-dvd1.iso.xz) = 4716d4d5055bde9dfaf9b6a0c3e3acde50e7845c81276ad87a5378492221c218 SHA256 (FreeBSD-13.0-RC2-powerpc-powerpc64le-memstick.img) = 68d2beb5bd80c773fface906bba0c941b8e5984fb5146e16d605b5c227b9fbd8 SHA256 (FreeBSD-13.0-RC2-powerpc-powerpc64le-memstick.img.xz) = 293b3d3dc97c0338bc37bd83149ca178b1126ab14d86ba68a5d41b51f04135dd SHA256 (FreeBSD-13.0-RC2-powerpc-powerpc64le-mini-memstick.img) = 0dec7fafe00977ba79e27448c59b4b6f6d150bd19ab3490f7e234d89de91cda4 SHA256 (FreeBSD-13.0-RC2-powerpc-powerpc64le-mini-memstick.img.xz) = 3628eeda95e898965337acba9b046cc3b9cee752581653281d460e60e040de16 o 13.0-RC2 powerpcspe MPC85XXSPE: SHA512 (FreeBSD-13.0-RC2-powerpc-powerpcspe-bootonly.iso) = ad926a3153a2752dacfc9f9e9928c2dacdbd1b3332e10ebd2743adc387299c5e27d1d97b5f1f6cb98e615f8c3cadb9bb99ad656d9dcb5952b63c5403ef928996 SHA512 (FreeBSD-13.0-RC2-powerpc-powerpcspe-bootonly.iso.xz) = 8d4500fe3491dbf9cb8e5ab64ac45c8729a99c339bfeced8594d354f8f8c03631d7d8c3c343ee3837e53340be66bd19f347572ce1f8244cb877e13eb0bc41a21 SHA512 (FreeBSD-13.0-RC2-powerpc-powerpcspe-disc1.iso) = 4086601126196f121625c6b607335491aad9a7649044333e83c34bc4256a10861c442ff2cd1f517222c2885f6c63bb91bf0890ed128c9264709d1c83475e6e54 SHA512 (FreeBSD-13.0-RC2-powerpc-powerpcspe-disc1.iso.xz) = 62f97cf5fb70503de1b67526b028191e9bb4836d4cda20d8168a6a53395e258b5c7530403e07c3aa7d14e366dedbd393f82506d645b26b632c7e38733ddce52d SHA512 (FreeBSD-13.0-RC2-powerpc-powerpcspe-dvd1.iso) = 57b3cbae99b372743ac85cf4500a83ce64aa97931944cdeb7a180ae5f234476088f42d3a88de17e80ce6d0bd9a7251ab30dffd2c7c31b86ef026a5bcee197eaf SHA512 (FreeBSD-13.0-RC2-powerpc-powerpcspe-dvd1.iso.xz) = f3cf5d85dbe915c3ee2eac89ffbf184558e12335021176261d6f2ebe62d0c55b002584eb4da282f2c2d250a57f8068463cbcf4fa99a2787932f14cae1faf5f7d SHA512 (FreeBSD-13.0-RC2-powerpc-powerpcspe-memstick.img) = 1d7df97c2e835eea844c49ed7a0d047b4f7e1d5a85e6b41aad90bb3631cb9e50e51002f0d0b0714a0f56f00860cfb4a965ebfe6693a5e37dad5fad34da54ee60 SHA512 (FreeBSD-13.0-RC2-powerpc-powerpcspe-memstick.img.xz) = d84d530029234bb80e848b392a83152b64502e1518f94b8aa8797a88e3830cabebac3887d1232653e0ce521962ac3857c4dbea91aa4d789ff6180a74c18db02a SHA512 (FreeBSD-13.0-RC2-powerpc-powerpcspe-mini-memstick.img) = 4d2a35751ef8e17b0a776ab875bb962edf30debce3e6df27c26b3fea3cb3a4447871b9efca5a053699e138b68764974e8e77eaaec7e5b6ef44e86d91185a4b23 SHA512 (FreeBSD-13.0-RC2-powerpc-powerpcspe-mini-memstick.img.xz) = 762babec0c953137e5d7fc76f625e1f136b860e7cc2bd2457ed35dbbd747e4a31a5ae5b9e8171e1547aab71e13da35db7fd5d93dc5069ab603916ed0a160a301 SHA256 (FreeBSD-13.0-RC2-powerpc-powerpcspe-bootonly.iso) = 3257c9b09dee563f21056cccb87ba2bd888ec4079440d903d48cecd196f16731 SHA256 (FreeBSD-13.0-RC2-powerpc-powerpcspe-bootonly.iso.xz) = 146df7e141c3aee283cf22b774fe753ec9d36c60396c6c73ec8fe17d24bc3b30 SHA256 (FreeBSD-13.0-RC2-powerpc-powerpcspe-disc1.iso) = c00a0be5943a2f49bcb1494d457240b13d78ac47f41a3dafb928fbade790bdd0 SHA256 (FreeBSD-13.0-RC2-powerpc-powerpcspe-disc1.iso.xz) = f044544cdc8d1adac718b08b6d3915665b533850f8c1d0941568a9076817a126 SHA256 (FreeBSD-13.0-RC2-powerpc-powerpcspe-dvd1.iso) = 445258ea6f5912e79ebbedcb0453b7d21b33adac81f72129e0889ef0cbfe3f50 SHA256 (FreeBSD-13.0-RC2-powerpc-powerpcspe-dvd1.iso.xz) = 1379a9a668bdfc6e50a5bd2be28d69437d73a1c6a857a16ae5f1a80d8adf3ba8 SHA256 (FreeBSD-13.0-RC2-powerpc-powerpcspe-memstick.img) = ca8c69f4c5db8e5337514058e73cfc21c4bee413a7bd707363b51a2d867451f8 SHA256 (FreeBSD-13.0-RC2-powerpc-powerpcspe-memstick.img.xz) = 9a64d11dd09b86292bc0ec9cf9bf30e029e303be7eac763fbeb24bb2e2d4b920 SHA256 (FreeBSD-13.0-RC2-powerpc-powerpcspe-mini-memstick.img) = 25acf936313d4468464915be0bb9fc260cb2621ce1f5d4d7fdaf8c72ad6baf8b SHA256 (FreeBSD-13.0-RC2-powerpc-powerpcspe-mini-memstick.img.xz) = 4e8bd1fd810faac7e1c7aebe0a020fb7cda337ce5a01b9a1f2be6ebf82040040 o 13.0-RC2 armv6 RPI-B: SHA512 (FreeBSD-13.0-RC2-arm-armv6-RPI-B.img.xz) = fa0c63a19aef94fb8ded49ce1c0fd1c7f1148c47ae54bab91e67599dfa8d5982ee9b2e129a108b40cb0ff590ef263c1178e8421c90b7b998cc2daddaa3968bca SHA256 (FreeBSD-13.0-RC2-arm-armv6-RPI-B.img.xz) = 2fcb4b129c30b2b17701c8619838967a0c2ec53326c2a3509f551b89dcf59771 o 13.0-RC2 armv7 GENERICSD: SHA512 (FreeBSD-13.0-RC2-arm-armv7-GENERICSD.img.xz) = 01d65a3b02892a9f94733532556322600ce2b9320d0c4226df4dc4f225803a9675074c805be728e9b3a09d207e82f2065f86c9b14fabca18a55247ec830c715a SHA256 (FreeBSD-13.0-RC2-arm-armv7-GENERICSD.img.xz) = 2d68bbae1e34a911a36f0a519aefce4d20b9fd85de6df33ff06dd1fbb8803ec5 o 13.0-RC2 aarch64 GENERIC: SHA512 (FreeBSD-13.0-RC2-arm64-aarch64-bootonly.iso) = d8e64e798c208fe64354ef2eb23260dc62f9363064fd29eb2c4a93500cd472fcae0d7e323dee06990f6e67c4e3f105c7e737dcd7ba4670dd59afda1b1249f3f8 SHA512 (FreeBSD-13.0-RC2-arm64-aarch64-bootonly.iso.xz) = 283351025fbc622e9cffd28ee06083a16a72313a96e3c5bd562246e077b3e0c0f44a99b8cf1e811066d1f8a3456cecb771f2b254fd15089833708c3e5890439e SHA512 (FreeBSD-13.0-RC2-arm64-aarch64-disc1.iso) = beccb93e45470e2d16ba9ef659415939d5bb55ceaeea74c9a06f39025704cfc447b20adbe34ec2dc2b356d9a36f92984b20a84a6133c019ae22e11aa52c9b144 SHA512 (FreeBSD-13.0-RC2-arm64-aarch64-disc1.iso.xz) = 8603bf93dff8787da247462ebdec8330b520ce1a69270f9536735e6270ff70abd0bcdbedc8e4669464cf75a8358c7dc947f1b2eca345c01eab792c57ec5f3bdd SHA512 (FreeBSD-13.0-RC2-arm64-aarch64-dvd1.iso) = 9a850474bf7e75c0b4911e17acd58a2527156c471883e573122ffc1622990112f2583c4549ff68bd96e19460bf02c0cc7841de0428720a3a63ba287ae2460ce4 SHA512 (FreeBSD-13.0-RC2-arm64-aarch64-dvd1.iso.xz) = da33b882e02142ceebc4ca74b6e4bc11cb34c102b3455cf9341a645c55f4aad6ce3ea7caf5c5d22321dac75eb7d8b88b050345060bb3205e651072f5e88b916a SHA512 (FreeBSD-13.0-RC2-arm64-aarch64-memstick.img) = cf928599246c6d807dae56f976a8239be58dac59e46aa13fcf24cdb311e88a9e627c97cc1980505a736057d89846bed00368b5789703d4ee2e41c0c1f534432f SHA512 (FreeBSD-13.0-RC2-arm64-aarch64-memstick.img.xz) = 81d9b60e2f5c561aa22ed7a325eca87b0c80a9f0600f15c97f33c4cf270f437f68d5eb93e25bf52c76594c37fc4bc4365d4e210f9a15c525a21c9c686635ea88 SHA512 (FreeBSD-13.0-RC2-arm64-aarch64-mini-memstick.img) = 6f6cdd67aebb0db5d918db0d3fc1bf2eec653c6dfafdd70a216233344be73814b81c23e437873266c81ce2fe03186026b490ff98fc76501dd5cc020d96eeedbf SHA512 (FreeBSD-13.0-RC2-arm64-aarch64-mini-memstick.img.xz) = e32d21ad8b2344159656b9e13b6b87d8ffd96958507bf673190bcf4e0338592071816dfc37994d9791052ba2840886371c1776b2d2944daaf395a25c2e25d1e7 SHA256 (FreeBSD-13.0-RC2-arm64-aarch64-bootonly.iso) = 7c6fefd776c87c416eaff9e5b3fd37109e139c093375041b1f85ac59c0bcb6c2 SHA256 (FreeBSD-13.0-RC2-arm64-aarch64-bootonly.iso.xz) = 31a9dc6858fbdb1905b4e964b5a09482d3466e95533d40d2d554ee825f95f22a SHA256 (FreeBSD-13.0-RC2-arm64-aarch64-disc1.iso) = 6f448a1fd18ee42383eeb11302bd9186d2a831642c289fdd9da98ae46dfcedce SHA256 (FreeBSD-13.0-RC2-arm64-aarch64-disc1.iso.xz) = d871e45a7e8a72cb38eb011eb121b13687b2381ca939534d6badf7e0176d4e12 SHA256 (FreeBSD-13.0-RC2-arm64-aarch64-dvd1.iso) = dc51f1c30acdfa621303c994a7c19c994e6478913e3bf603410baf6cdd47416a SHA256 (FreeBSD-13.0-RC2-arm64-aarch64-dvd1.iso.xz) = a1ee44e3371599c97e8ea06a5a273f3bbe13525442e79db8f586dc6c01db1882 SHA256 (FreeBSD-13.0-RC2-arm64-aarch64-memstick.img) = a64cbe77c5df96b051f61da27b754ee39a3e529323bce0c56b3af7a8fcd59f5d SHA256 (FreeBSD-13.0-RC2-arm64-aarch64-memstick.img.xz) = 09b133a2a059ef30f036f001d5147164cc0893ff2144af694fbafda504284129 SHA256 (FreeBSD-13.0-RC2-arm64-aarch64-mini-memstick.img) = 26eb7dd67106908ae50a7330fcd59aadd32d8f54499f47f00960006373e02f0b SHA256 (FreeBSD-13.0-RC2-arm64-aarch64-mini-memstick.img.xz) = 41a8b1d3693dfda4c6488f8a2fb2672b06dd5d1bf072508eb068fcda465ea51a o 13.0-RC2 aarch64 RPI: SHA512 (FreeBSD-13.0-RC2-arm64-aarch64-RPI.img.xz) = 0606410160b549030d4d76e087ea94d03627832bab41a14a9df3d2bf8498d4e55d26a544f7aa928bfa576ec2fa45e3430a62ee7495dfe8d71158187aa79f8088 SHA256 (FreeBSD-13.0-RC2-arm64-aarch64-RPI.img.xz) = e7832f2e66583357d4f89b89127acea4eb9767807c105b8acefa68fd45ff0d7e o 13.0-RC2 aarch64 PINE64: SHA512 (FreeBSD-13.0-RC2-arm64-aarch64-PINE64.img.xz) = 773594a9806436038e95ebc0b71f3e022cf1201bd6700a3fcb5ee0fa498bab735b04900e9c166bbf80d8dcb2bd3098cb257e45ef789c4bb9d37610aa3749c305 SHA256 (FreeBSD-13.0-RC2-arm64-aarch64-PINE64.img.xz) = ac9a5340f208efdfba4ac02765326e4087537408c02b81a39b9ed8dd381e7f70 o 13.0-RC2 aarch64 PINE64-LTS: SHA512 (FreeBSD-13.0-RC2-arm64-aarch64-PINE64-LTS.img.xz) = bd2ba8b020b17f1935ed560f9020a3ba634e7822ef83c950934dd64eda9180aab6a9d42fe6782c09aa68bbb21aa9406a8b091271bc33ee2d4a5a95e942993ae7 SHA256 (FreeBSD-13.0-RC2-arm64-aarch64-PINE64-LTS.img.xz) = 4ac9f161cb7bde4e8ef01d20c2ed7163da48927d6e85d3c8ad477370d16c4cd4 o 13.0-RC2 aarch64 PINEBOOK: SHA512 (FreeBSD-13.0-RC2-arm64-aarch64-PINEBOOK.img.xz) = 40e71ac98457451664f75930f61ddaf1f2a990743410c0556c15b9493925da39c50a76a737b6083334fad5b432a241d7cfb7b2258a78c2577ea0aa86f23d9c4e SHA256 (FreeBSD-13.0-RC2-arm64-aarch64-PINEBOOK.img.xz) = acb6dc0784a635fc8c06f1b4e9a818c0036755ea77c8b99d1e42c0efe35e9667 o 13.0-RC2 aarch64 ROCK64: SHA512 (FreeBSD-13.0-RC2-arm64-aarch64-ROCK64.img.xz) = b58e344d03e002cd9518b9e69b6721acba3aa16cf0d44bfc7183ac8e69ccebdcaed3fe99cd08ae1df819535abdce9d58673b707e3fb5355b1b117c950161b948 SHA256 (FreeBSD-13.0-RC2-arm64-aarch64-ROCK64.img.xz) = 5ea9a59f1d4cfd62cb15a2a40dc2c77b88919e724aa5328e7fef639e713f7c7a o 13.0-RC2 aarch64 ROCKPRO64: SHA512 (FreeBSD-13.0-RC2-arm64-aarch64-ROCKPRO64.img.xz) = 4c4aa8151ddc9a27758e37e86cfde0f833f787c63fe7b5154783b446278d029bb1e7d2740277cfdf8966c6c6ed7d6c0cb5f9b4a86060d2caec2785024807ac13 SHA256 (FreeBSD-13.0-RC2-arm64-aarch64-ROCKPRO64.img.xz) = cee744f39642898f03ab9b137cfb6edda9f63424767ca10587799a1c8eedf5a7 o 13.0-RC2 riscv64 GENERIC: SHA512 (FreeBSD-13.0-RC2-riscv-riscv64-bootonly.iso) = c1be998a5bb2c93480e3fdfa5eeebc3a20ca3ca5b4870067d091ee73d70f3a1b97bd7a56248c54d0d17df2df80fdddcd1c00bd377e0eb101bb4f4bf818b2bbca SHA512 (FreeBSD-13.0-RC2-riscv-riscv64-bootonly.iso.xz) = d6524505078de5b90d570b9ae433bb3b44aadc01e7e2eda90921b24e5fe1e91ad9a4f1ac6cc22adfb8448f61bf502063f7181941aaef925fa19587165ff141a4 SHA512 (FreeBSD-13.0-RC2-riscv-riscv64-disc1.iso) = 8264285d9980f60083d94aad094f07e106b87448e53742dc74428432827413dd190d48d35c158f738fbb26b3a7d450ec94229726163f66f96f561bfa0c589ba0 SHA512 (FreeBSD-13.0-RC2-riscv-riscv64-disc1.iso.xz) = 2ff3974505884c0a11da855a0ae1ba99041d32253d0a4f58ab841f36b4227f23853a55b4d9f42f35b9ede11536a8b7b06b9a9bdd120088c0b5a1b13e8ec29b47 SHA512 (FreeBSD-13.0-RC2-riscv-riscv64-dvd1.iso) = 8e4513b4b60c64830ac1eaac4f0deed023feb03b3d9991bfc084fa451db899ed646148b0b01fa838724d599ae64591e3b617b7843bc61ae2cfaf37dac1e47e19 SHA512 (FreeBSD-13.0-RC2-riscv-riscv64-dvd1.iso.xz) = 366606b578621c0a939aafd7708890d0ef4208e64a59cc6a5f467f1bec138954b2e3fa476860a4abee235252989369184d0d73fb46bd0d669a5017bfc7550666 SHA512 (FreeBSD-13.0-RC2-riscv-riscv64-memstick.img) = 66a495b0008febb9b6d11aeedd093d81894b73ded1239281b872a96838ad41ec3834e8aca7b68ede2752bf3843ee7fe40435faa8e6bc1ca877a5af6dfa5f60e4 SHA512 (FreeBSD-13.0-RC2-riscv-riscv64-memstick.img.xz) = d23e9240f85b3d77a86add1bcd5fe16aafe29e163c26c54fa0ebe971b324721bb9e2d6d02bdc1f553c61960adaf0ed8179ba4cc181f3b1ce69a57834d8e034df SHA512 (FreeBSD-13.0-RC2-riscv-riscv64-mini-memstick.img) = 5431f62be580829d324d7ab1cffaeef1f929fc3ba96f15ae2b29eb7bd89a583e21b4ece7b2544af8f664bc0e9c8f3d7a5880a528eb2854180b54396345acc4e9 SHA512 (FreeBSD-13.0-RC2-riscv-riscv64-mini-memstick.img.xz) = 73ed71f9bd031d1c9fa715d750b77570967e7af02782a1924dab98256ebfa292c9619a766c818325e868366e4be01789b4ca646d00444dd87d15b75ac5670197 SHA256 (FreeBSD-13.0-RC2-riscv-riscv64-bootonly.iso) = 4293e27d8490015ac84f72f7ff76d555bbb4a743c1583dab1e757971866646bd SHA256 (FreeBSD-13.0-RC2-riscv-riscv64-bootonly.iso.xz) = 8abcf9ed54d1e3e0411c6a77f13a2c9e1c1a4a25e5e174472290a82feeb464e3 SHA256 (FreeBSD-13.0-RC2-riscv-riscv64-disc1.iso) = ef5990b171849675abc6251c41ae9915185d6a0750f8a619a4c6f7804066dbad SHA256 (FreeBSD-13.0-RC2-riscv-riscv64-disc1.iso.xz) = 5295efb9854a292a838d286323452eb08548965773af5e25170f2208e4a99944 SHA256 (FreeBSD-13.0-RC2-riscv-riscv64-dvd1.iso) = 460b99600f094e7163525d906669d63485be24010756ac87d73d43bc791f2b0e SHA256 (FreeBSD-13.0-RC2-riscv-riscv64-dvd1.iso.xz) = 74eac73be6226da03b0bf93be7bdf088fbd9315af0d5d51a0bc62dbc487f221b SHA256 (FreeBSD-13.0-RC2-riscv-riscv64-memstick.img) = fb2de2dde6f2bc845ab2ea9af032d7cfac9266d89845ea43effd586c700bd9ac SHA256 (FreeBSD-13.0-RC2-riscv-riscv64-memstick.img.xz) = 9dccf3ebf5b003bcf2cdb83e311a64a494b2793cfedba30e6cd80f07b8a00eb3 SHA256 (FreeBSD-13.0-RC2-riscv-riscv64-mini-memstick.img) = 15367e76249ee5ca71dfa8f80ed20d9f91cd56f24c0c7853fb531d1e217bf724 SHA256 (FreeBSD-13.0-RC2-riscv-riscv64-mini-memstick.img.xz) = 71c9aecfeb3c9647a0710db3786130f7a14d73a62a6ea2951f3fc659b5a21f46 o 13.0-RC2 riscv64 GENERICSD: SHA512 (FreeBSD-13.0-RC2-riscv-riscv64-GENERICSD.img.xz) = 766d55d0b13801d71f5a55c3df909d5d1704111228756d646952f8851580f1dcd88a87098c5fd6004b15abb2c52ddd0387568214e0bb3fa931ae4863e506169c SHA256 (FreeBSD-13.0-RC2-riscv-riscv64-GENERICSD.img.xz) = b2d1c96de2df8d7a9e90ee98212b0792a006544c767c5f17a1ce317de7107bd0 == VM IMAGE CHECKSUMS == o 13.0-RC2 amd64: SHA512 (FreeBSD-13.0-RC2-amd64.qcow2.xz) = eb8b3ba2178e167d4d52c7ff36e64bb2cd357470cfeda8b080ba70c6c040f30c97a11524293785f198d6cf53f9311fc1f054812087f630600bb76cc4501aebbb SHA512 (FreeBSD-13.0-RC2-amd64.raw.xz) = 92f3277786446ac633caad0558e05217f92369d1a0a76d698adca1524672cbe57dadea2569c0a093b3d259c1dfc4337ebabb55fe6adcded615bb26812df9116a SHA512 (FreeBSD-13.0-RC2-amd64.vhd.xz) = 2a0e943f3ba3ba24c8bf893f3999d6f967b955cdf12e156a40d2723c118053596a1dfb0a89b257c4b1f2f0b8bebbaec5618a5d81f958d9573dae683dde964ed3 SHA512 (FreeBSD-13.0-RC2-amd64.vmdk.xz) = 8879a8b608cce9bf1a95110a1464d1acae9371cc9caabb3e2c13e8884ca9b84fb91d1cae121f53704c089f0922467c49ee9e21896a399ec172baf7abf7c73e6b SHA256 (FreeBSD-13.0-RC2-amd64.qcow2.xz) = aa854ab8ec61514ab82973a703a91fe845daf7effff9596f588e26c5c4857248 SHA256 (FreeBSD-13.0-RC2-amd64.raw.xz) = 45ca10786b5631b1b27252a0696ccca74b891834e7fcbb244c80627e5f44e8bc SHA256 (FreeBSD-13.0-RC2-amd64.vhd.xz) = 2da3f3010bdc9c8f54fcfe506fb8ed8b27a569581a43f681280ef3a277313aa6 SHA256 (FreeBSD-13.0-RC2-amd64.vmdk.xz) = 51e5c70801b9be8fe36683d65bbb33695005557b42938d489d0cd430689c75f9 o 13.0-RC2 i386: SHA512 (FreeBSD-13.0-RC2-i386.qcow2.xz) = c93b3106b631ddd48672c53152611dff4ef78dd20f70afbf963a5e5c1f6595f40a20d6dec47ab4fd1089347a03c8094d12117d12a2946c16c0386f0114247009 SHA512 (FreeBSD-13.0-RC2-i386.raw.xz) = fe09498cc8836a271bb11777b8b15a33ab1085b907482350a85f457fe97d98ee7492640029a92d379c89a8297be7dff3ed00490a2437252b623b7a148c16fae9 SHA512 (FreeBSD-13.0-RC2-i386.vhd.xz) = 415ba863db8d018c57629d9dd16a28cc4aed14587a70f81fa01529e9e98e2233c677f6ab994bdf6b01d205b3293da248786f5b3b3c0f535af18ebf53993f4d19 SHA512 (FreeBSD-13.0-RC2-i386.vmdk.xz) = 376990553adcbba7a148aadef23e206454f4b8c4ff3c1b0ade416dc180e3d7d5d1ec4d15e8a5af714363a5e818804e729c69adf503c93ab65a7d54f8317bfd4e SHA256 (FreeBSD-13.0-RC2-i386.qcow2.xz) = be1917ee2f52043938fe0c9b7d017a58bbdb8e76162b16a67fd6bcc6bab81225 SHA256 (FreeBSD-13.0-RC2-i386.raw.xz) = 2b20462bd9cdf31a535696029f4afa2082fdd7ce2db7e577760be75e5444ce1a SHA256 (FreeBSD-13.0-RC2-i386.vhd.xz) = 84f51f7835d2a647c8b02ac9b482f2f84bc0dfeea43498419e05490d638ce843 SHA256 (FreeBSD-13.0-RC2-i386.vmdk.xz) = 303dcba1e14a96f7ac562290f6c4bca916c432d5f79893226b20efecdecf80f9 o 13.0-RC2 aarch64: SHA512 (FreeBSD-13.0-RC2-arm64-aarch64.qcow2.xz) = 4c50efa22d57006178a513772d944e788a899316f7fa43ee221ab5ec06ea4e71a8101fc41fa6c2dd94a2eeaa1dc36ff35b176477330b1858e89405865204685f SHA512 (FreeBSD-13.0-RC2-arm64-aarch64.raw.xz) = 76383bac800d589f575d54872a746a858ffdc3bf35d0663c9faac0d1f341675e0c31877263c98177b9430aafabddb4d47e063a48b77bee2fb4565407404b6bc3 SHA512 (FreeBSD-13.0-RC2-arm64-aarch64.vhd.xz) = 61b0fa96f60b562bd99af1b9bbaf8a9b31400982001f139ae55eed806af2b75a8469d00cfba25ac16fcdcc4b1ad559a7061e78286a5df1264ce1964904e3d7b8 SHA512 (FreeBSD-13.0-RC2-arm64-aarch64.vmdk.xz) = 5733b32e1d5eb4ec8ea976522cd41e2fce2ad5e1ea300f0c3ecd1a6247ca87f74c456f67f64edb90f6490a9cefbda70b67f6997f4a9a021b80d2b92a3f88e784 SHA256 (FreeBSD-13.0-RC2-arm64-aarch64.qcow2.xz) = 21a26d066a2673ffc3b1b29a3718bc4d47d82f56e6030dc607c2868cbdb24af1 SHA256 (FreeBSD-13.0-RC2-arm64-aarch64.raw.xz) = 891ed284dd66b382210925818f633b2f840d3f572d84a410a8961af829d63454 SHA256 (FreeBSD-13.0-RC2-arm64-aarch64.vhd.xz) = cca8b0b0736cc9e3af5364f9e9dad7b2756dcc7747283ef2f0a28d8bace66950 SHA256 (FreeBSD-13.0-RC2-arm64-aarch64.vmdk.xz) = 2781f5f0dea92964431d7af3cb74fef4837c5d3207aeca21296d9baf2b048cf2 o 13.0-RC2 riscv64: SHA512 (FreeBSD-13.0-RC2-riscv-riscv64.qcow2.xz) = 886c9aa8206b536f9734db1cfcec6b7a1f5adcb5410df0f8d7031547dc9f8e27e51400c3793523be9f3827b8c4cd1cdef57f3623faf6144d31a36d81c5cd62f6 SHA512 (FreeBSD-13.0-RC2-riscv-riscv64.raw.xz) = dc63e5a94a1129466bbd1702e986b712ebe900d859605c822fd24ad20365240747877d1bf1c9449e93ad985f31eb56feef3cc5206b1c3f2b8653893c76e151c9 SHA512 (FreeBSD-13.0-RC2-riscv-riscv64.vhd.xz) = 1ea1f2bc8f65d4fe57c844dde06bf604c45f2ee91f0b0d9207f2b7e68dfe509b2f2fc75b348ab1b651b6e34be156cf4f1e947069e92e76b79d599451474a3956 SHA512 (FreeBSD-13.0-RC2-riscv-riscv64.vmdk.xz) = 40d2db849f854966eb9f5a4b4f2d221c1cc4e255268bac2edd37f8f83b7144fd25607683a4e127e932de431a698f97a5ee01086d091fdaa07c1c51842076961b SHA256 (FreeBSD-13.0-RC2-riscv-riscv64.qcow2.xz) = 77268692d05047bb552a18c759bdcbc2431aae6745d38665681c936c8913a480 SHA256 (FreeBSD-13.0-RC2-riscv-riscv64.raw.xz) = 4123a1c73c057a86d7c7784e517a70dddc472235630c8ca0cdeedb3eb1b662cb SHA256 (FreeBSD-13.0-RC2-riscv-riscv64.vhd.xz) = 6928668e824e9926ee17e0204d3036c278c26ca27a77b846bf943b071f4abd2d SHA256 (FreeBSD-13.0-RC2-riscv-riscv64.vmdk.xz) = 8f07c1e86a9b772d213eddf312f8db6672047a3be73e2287094d78c7a776142f o 13.0-RC2 amd64 BASIC-CI: SHA512 (FreeBSD-13.0-RC2-amd64-BASIC-CI.raw.xz) = e26b78dac694d28451713375af5b246df7e3e6581a63c6016b6743c09c3959cad55ac47696c32fced0648bb8349723c4ca61a32b6bd3cf9797d85a98033445d6 SHA256 (FreeBSD-13.0-RC2-amd64-BASIC-CI.raw.xz) = ad5998c2975cd873af7a05db7eac2c9a4cd7c1c5c2dda6c1656063b840b5d1af Regards, Glen Love FreeBSD? Support this and future releases with a donation to the FreeBSD Foundation! https://www.freebsdfoundation.org/donate/ -----BEGIN PGP SIGNATURE----- iQIzBAEBCAAdFiEEjRJAPC5sqwhs9k2jAxRYpUeP4pMFAmBMAx4ACgkQAxRYpUeP 4pNR0xAAlF5tUhtiuRsBxJhCK9KM2K2VC1eQnhPedcvrOTYIxOvbuVCDU4N4VrVC 08GalLuhzmVpQibprXFLQzxCKJuYKNT3HQ6xSuZb3ntqOOkGKmgVkzzA4k0dzU/D /PrrI7feZKY3ZqSjmsMV3K+tlUtmTSnlid2IBwkja+MfiS2wIqYMQ+lV9usgASel xTvymz7tNGAg3SrZowR7op8rF3kBHdER0zXjlFpETxFZc+J8WAq1Xvq5mI5IZPQj jFBpH0rWRcn2fmYx0rUHgod72QPVP6tAI1NRgB3RWVWEv5i2BTdykRbAtf4xIVqb 4LdOr5AS+wKGkpSWpDkkB3q8HvzFdgPZj2hUfsXhXC85PJc68GSJOG8PpZpjSWsN QQTVlkM9rO+YG4rvPGQBdUJB3gIgiBQIIR2kwisKE3DsO4+ljNuq90nlfV2DLWWk 1A+eK2mSBTE7RfrhmaSot+I5BEB11YbzDt6GrJzxtbxal0OU3e5raLnRIvL6OOU5 uwxuFetu5KOg2xA2vKWlaKh1L2H44i0LcbIVLxVk40pscBTTXYxCrS3wq8FCwz9Q UWKSagqk+rrBszQmadtMpH7/2UupH6rGn8JXeJRdpkX/+t9XQJwFq9vVmD+XWjbY HUJJGhl/e93PrRWu6Xr7tvrnbfLR9cULucjbWoEGC5yVvss4RuY= =l7V8 -----END PGP SIGNATURE----- From owner-freebsd-stable@freebsd.org Sat Mar 13 04:01:07 2021 Return-Path: Delivered-To: freebsd-stable@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id E1BDB568AE0 for ; Sat, 13 Mar 2021 04:01:07 +0000 (UTC) (envelope-from ota@j.email.ne.jp) Received: from mailman.nyi.freebsd.org (mailman.nyi.freebsd.org [IPv6:2610:1c1:1:606c::50:13]) by mx1.freebsd.org (Postfix) with ESMTP id 4Dy89v5GR5z3r6g for ; Sat, 13 Mar 2021 04:01:07 +0000 (UTC) (envelope-from ota@j.email.ne.jp) Received: by mailman.nyi.freebsd.org (Postfix) id B4ADA568CC1; Sat, 13 Mar 2021 04:01:07 +0000 (UTC) Delivered-To: stable@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id B476F568C32 for ; Sat, 13 Mar 2021 04:01:07 +0000 (UTC) (envelope-from ota@j.email.ne.jp) Received: from mail01.asahi-net.or.jp (mail01.asahi-net.or.jp [202.224.55.13]) by mx1.freebsd.org (Postfix) with ESMTP id 4Dy89s1Jkbz3qsW; Sat, 13 Mar 2021 04:01:04 +0000 (UTC) (envelope-from ota@j.email.ne.jp) Received: from vmware12.advok.com (cpe-184-152-96-96.nj.res.rr.com [184.152.96.96]) (Authenticated sender: NR2Y-OOT) by mail01.asahi-net.or.jp (Postfix) with ESMTPSA id C3E8625072; Sat, 13 Mar 2021 13:00:59 +0900 (JST) Date: Fri, 12 Mar 2021 22:48:56 -0500 From: Yoshihiro Ota To: Andriy Gapon Cc: stable@freebsd.org Subject: Re: kldload zfs spins the system after upgrading from 12.2 to 13-BETA Message-Id: <20210312224856.9c1fe47904546bc82f73d334@j.email.ne.jp> In-Reply-To: References: <20210306130913.dae1fb546e68bcaec882cdbe@j.email.ne.jp> <9f9db150-ee5d-e74e-7f24-74d1fa687a48@FreeBSD.org> <20210307222441.02755e7396cd329edd15df15@j.email.ne.jp> X-Mailer: Sylpheed 3.7.0 (GTK+ 2.24.32; i386-portbld-freebsd12.1) Mime-Version: 1.0 Content-Type: text/plain; charset=US-ASCII Content-Transfer-Encoding: 7bit X-Rspamd-Queue-Id: 4Dy89s1Jkbz3qsW X-Spamd-Bar: -- Authentication-Results: mx1.freebsd.org; dkim=none; dmarc=none; spf=pass (mx1.freebsd.org: domain of ota@j.email.ne.jp designates 202.224.55.13 as permitted sender) smtp.mailfrom=ota@j.email.ne.jp X-Spamd-Result: default: False [-2.80 / 15.00]; RCVD_VIA_SMTP_AUTH(0.00)[]; RBL_DBL_DONT_QUERY_IPS(0.00)[202.224.55.13:from]; MID_RHS_MATCH_FROM(0.00)[]; FROM_HAS_DN(0.00)[]; TO_DN_SOME(0.00)[]; MV_CASE(0.50)[]; TO_MATCH_ENVRCPT_ALL(0.00)[]; MIME_GOOD(-0.10)[text/plain]; R_SPF_ALLOW(-0.20)[+ip4:202.224.55.0/24]; ARC_NA(0.00)[]; DMARC_NA(0.00)[email.ne.jp]; SPAMHAUS_ZRD(0.00)[202.224.55.13:from:127.0.2.255]; RECEIVED_SPAMHAUS_PBL(0.00)[184.152.96.96:received]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; NEURAL_HAM_LONG(-1.00)[-1.000]; RCPT_COUNT_TWO(0.00)[2]; NEURAL_HAM_SHORT(-1.00)[-1.000]; RCVD_NO_TLS_LAST(0.10)[]; FROM_EQ_ENVFROM(0.00)[]; R_DKIM_NA(0.00)[]; MIME_TRACE(0.00)[0:+]; ASN(0.00)[asn:4685, ipnet:202.224.32.0/19, country:JP]; RCVD_COUNT_TWO(0.00)[2]; MAILMAN_DEST(0.00)[stable]; RCVD_IN_DNSWL_LOW(-0.10)[202.224.55.13:from] X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.34 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 13 Mar 2021 04:01:07 -0000 On Tue, 9 Mar 2021 11:24:53 +0200 Andriy Gapon wrote: > On 08/03/2021 05:24, Yoshihiro Ota wrote: > > On Sun, 7 Mar 2021 00:09:33 +0200 > > Andriy Gapon wrote: > > > >> On 06/03/2021 20:09, Yoshihiro Ota wrote: > >>> Hi all, > >>> > >>> I'm upgrading fron 12.2-RELEASE to 13-BETA/RC one by one. > >>> > >>> After upgrading one in VMWare, 'zfs mount -a' hangs the system. > >>> I don't have boottime zfs mount on nor don't have zfsroot. > >>> I just simply ran install world/kernel and mergemaster. > >> > >> Please use procstat -kk to capture a kernel stack trace of the hung process. > > > > Actually, spining was 'kldload zfs'. > > Console doesn't response but ping and sshd sessions still work. > > procstat output is below. > > In addition, this doesn't happen to systems that I've been following 13-CURRENT > > but rather happen only wiht a system upgraded from 12.2-RELEASE to 13-RC. > > > > > > # procstat -kk 1049 > > PID TID COMM TDNAME KSTACK > > 1049 100215 kldload - spa_init+0xc6 zfs_kmod_init+0x1a > > zfs_modevent+0x34 module_register_init+0x8c linker_load_module+0xaab kern_kldload+0xc1 > > sys_kldload+0x50 syscall+0x17d g_ctx+0xe280bf29 > > > > If you could use kgdb to find out what source code line spa_init+0xc6 > corresponds to that may help to see what's going on. Hi Andriy, Could you teach me what command can show such address in kgdb? Thanks, Hiro From owner-freebsd-stable@freebsd.org Sat Mar 13 10:21:22 2021 Return-Path: Delivered-To: freebsd-stable@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 8E3825719CD for ; Sat, 13 Mar 2021 10:21:22 +0000 (UTC) (envelope-from ashish@FreeBSD.org) Received: from smtp.freebsd.org (smtp.freebsd.org [96.47.72.83]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "smtp.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4DyJcf2mmhz4gSw for ; Sat, 13 Mar 2021 10:21:22 +0000 (UTC) (envelope-from ashish@FreeBSD.org) Received: from [172.16.0.15] (unknown [182.64.6.163]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) (Authenticated sender: ashish/mail) by smtp.freebsd.org (Postfix) with ESMTPSA id AE7F9126F for ; Sat, 13 Mar 2021 10:21:21 +0000 (UTC) (envelope-from ashish@FreeBSD.org) Subject: TCP BBR in 13.0-RC2 not playing well with pf firewall X-Apple-Base-Url: x-msg://1/ X-Apple-Mail-Remote-Attachments: YES From: Ashish SHUKLA X-Apple-Mail-Plain-Text-Draft: yes X-Apple-Auto-Saved: 1 X-Apple-Windows-Friendly: 1 Date: Sat, 13 Mar 2021 15:50:09 +0530 X-Apple-Mail-Signature: SKIP_SIGNATURE Message-Id: <2DB6816A-FE78-47DC-B84B-14645C6B89DD@FreeBSD.org> X-Uniform-Type-Identifier: com.apple.mail-draft To: freebsd-stable@freebsd.org X-Mailer: Apple Mail (2.3654.60.0.2.21) MIME-Version: 1.0 Content-Type: text/plain; charset="utf-8" X-Content-Filtered-By: Mailman/MimeDel 2.1.34 X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.34 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 13 Mar 2021 10:21:22 -0000 From owner-freebsd-stable@freebsd.org Sat Mar 13 10:25:58 2021 Return-Path: Delivered-To: freebsd-stable@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id A3336572029 for ; Sat, 13 Mar 2021 10:25:58 +0000 (UTC) (envelope-from ashish@FreeBSD.org) Received: from smtp.freebsd.org (smtp.freebsd.org [96.47.72.83]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "smtp.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4DyJjy4LT5z4h2s for ; Sat, 13 Mar 2021 10:25:58 +0000 (UTC) (envelope-from ashish@FreeBSD.org) Received: from [172.16.0.15] (unknown [182.64.6.163]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) (Authenticated sender: ashish/mail) by smtp.freebsd.org (Postfix) with ESMTPSA id DEB7023DF for ; Sat, 13 Mar 2021 10:25:57 +0000 (UTC) (envelope-from ashish@FreeBSD.org) From: Ashish SHUKLA Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: quoted-printable Mime-Version: 1.0 (Mac OS X Mail 14.0 \(3654.60.0.2.21\)) Subject: TCP BBR in 13.0-RC2 not playing well with pf firewall Message-Id: Date: Sat, 13 Mar 2021 15:55:54 +0530 To: freebsd-stable@freebsd.org X-Mailer: Apple Mail (2.3654.60.0.2.21) X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.34 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 13 Mar 2021 10:25:58 -0000 [sorry for some reason, the previous message is showing as empty in = archives :(] Hi, I just wanted to try TCP BBR functionality available in FreeBSD 13.0-RC2 = and noticed that it=E2=80=99s not usable, if FreeBSD pf is enabled. I=E2=80=99m using following pf rules: =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D block drop all block drop in quick on em0 from to any block drop in quick on em0 from to any label "ssh bruteforce" pass in on em0 proto udp from any to any port =3D domain keep state pass in on em0 proto udp from any to any port =3D 2015 keep state pass in on em0 proto udp from any to any port =3D 5001 keep state pass in on em0 proto udp from any to any port =3D 6881 keep state pass in on em0 proto udp from any to any port =3D 51234 keep state pass in on em0 proto udp from any to any port 54000:54322 keep state pass in on em0 proto udp from any to any port 60000:61000 keep state pass in on em0 proto tcp from any to any port =3D ssh flags S/SA keep = state pass in on em0 proto tcp from any to any port =3D xmpp-client flags S/SA = keep state pass in on em0 proto tcp from any to any port =3D xmpp-server flags S/SA = keep state pass in on em0 proto tcp from any to any port 54000:54322 flags S/SA = keep state pass in on em0 proto icmp all keep state pass in on em0 proto ipv6-icmp all keep state pass out on em0 all flags S/SA keep state =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D Following is how I tried to reproduce (same with IPv6): =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D % wget -4 -O /dev/null = https://cdn.kernel.org/pub/linux/kernel/v5.x/linux-5.11.3.tar.xz --2021-03-13 09:26:23-- = https://cdn.kernel.org/pub/linux/kernel/v5.x/linux-5.11.3.tar.xz Resolving cdn.kernel.org (cdn.kernel.org)... 151.101.113.176 Connecting to cdn.kernel.org (cdn.kernel.org)|151.101.113.176|:443... = connected. HTTP request sent, awaiting response... 200 OK Length: 117629864 (112M) [application/x-xz] Saving to: =E2=80=98/dev/null=E2=80=99 /dev/null 0%[ = ] 137.44K --.-KB/s in 10s =20 2021-03-13 09:26:33 (13.8 KB/s) - Read error at byte 140737/117629864 = (Network is down). Retrying. --2021-03-13 09:26:34-- (try: 2) = https://cdn.kernel.org/pub/linux/kernel/v5.x/linux-5.11.3.tar.xz Connecting to cdn.kernel.org (cdn.kernel.org)|151.101.113.176|:443... = connected. HTTP request sent, awaiting response... 206 Partial Content Length: 117629864 (112M), 117489127 (112M) remaining [application/x-xz] Saving to: =E2=80=98/dev/null=E2=80=99 /dev/null 0%[ = ] 243.21K --.-KB/s in 10s =20 2021-03-13 09:26:44 (10.6 KB/s) - Read error at byte 249046/117629864 = (Network is down). Retrying. =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D A copy of tcpdump output (tcpdump -i em0 -nv port 443 and host = 151.101.113.176) is uploaded[1]. Since TCP BBR requires custom kernel, following is the diff: =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D --- GENERIC 2021-02-23 10:55:03.397376000 +0000 +++ MYKERNEL 2021-02-23 10:58:39.442981000 +0000 @@ -19,7 +19,7 @@ # $FreeBSD$ cpu HAMMER -ident GENERIC +ident MYKERNEL makeoptions DEBUG=3D-g # Build kernel with gdb(1) = debug symbols makeoptions WITH_CTF=3D1 # Run ctfconvert(1) for DTrace = support @@ -382,3 +382,6 @@ options HID_DEBUG # enable debug msgs device hid # Generic HID support options IICHID_SAMPLING # Workaround missing GPIO INTR = support + +options ROUTETABLES=3D12 +options TCPHPTS =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D And following src.conf: =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D WITH_EXTRA_TCP_STACKS=3D yes =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D sysctl.conf(5) is empty, except following sysctl knob set to switch to = BBR stack: =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D net.inet.tcp.functions_default=3Dbbr =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D Following are the contents of loader.conf(5): =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D kern.geom.label.disk_ident.enable=3D"0" kern.geom.label.gptid.enable=3D"0" opensolaris_load=3D"YES" zfs_load=3D"YES" debug.acpi.disabled=3D"thermal" coretemp_load=3DYES vm.pmap.pti=3D0 cpu_microcode_load=3D"YES" cpu_microcode_name=3D"/boot/firmware/intel-ucode.bin" aesni_load=3DYES nullfs_load=3D"YES" vfs.zfs.prefetch_disable=3D1 vfs.zfs.write_limit_override=3D1073741824 vfs.zfs.min_auto_ashift=3D12 vfs.zfs.arc_max=3D"17179869184" vfs.zfs.compressed_arc_enabled=3D1 =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D Following is the output of kldstat: =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D Id Refs Address Size Name 1 33 0xffffffff80200000 1f12e50 kernel 2 1 0xffffffff82113000 b7b8 opensolaris.ko 3 1 0xffffffff8211f000 9ac0 nullfs.ko 4 1 0xffffffff8249d000 67fbc8 zfs.ko 5 1 0xffffffff82b1d000 4128 coretemp.ko 6 1 0xffffffff82d20000 3378 acpi_wmi.ko 7 1 0xffffffff82d24000 3250 ichsmb.ko 8 1 0xffffffff82d28000 2180 smbus.ko 9 1 0xffffffff82d2b000 2110 pchtherm.ko 10 1 0xffffffff82d2e000 2a08 mac_ntpd.ko 11 1 0xffffffff82d31000 29bc8 tcp_bbr.ko 12 1 0xffffffff82d5b000 36f70 pf.ko =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D Host is running kernel from git revision = =E2=80=9C13c22f7495305f5b92874128b088ab47d9512c20=E2=80=9D, while rest = of the userland is from "freebsd-update upgrade -r 13.0-RC2=E2=80=9D. After disabling pf firewall, it becomes usable again: =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D --2021-03-13 09:42:50-- = https://cdn.kernel.org/pub/linux/kernel/v5.x/linux-5.11.3.tar.xz Resolving cdn.kernel.org (cdn.kernel.org)... 151.101.113.176 Connecting to cdn.kernel.org (cdn.kernel.org)|151.101.113.176|:443... = connected. HTTP request sent, awaiting response... 200 OK Length: 117629864 (112M) [application/x-xz] Saving to: =E2=80=98/dev/null=E2=80=99 /dev/null = 100%[=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D= =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D= =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D= =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D= =3D=3D=3D=3D>] 112.18M 20.2MB/s in 6.9s =20 2021-03-13 09:42:57 (16.3 MB/s) - =E2=80=98/dev/null=E2=80=99 saved = [117629864/117629864] =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D Please let me know if I overlooked something with TCP BBR configuration. References: [1] = https://people.freebsd.org/~ashish/tcpdump-cdn-kernel-org-20210313.txt Thanks! -- Ashish | GPG: F682 CDCC 39DC 0FEA E116 20B6 C746 CFA9 E74F A4B0 =E2=80=9CSometimes even to live is an act of courage.=E2=80=9D (Seneca) From owner-freebsd-stable@freebsd.org Sat Mar 13 11:48:55 2021 Return-Path: Delivered-To: freebsd-stable@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id AFE305740BE for ; Sat, 13 Mar 2021 11:48:55 +0000 (UTC) (envelope-from melifaro@ipfw.ru) Received: from forward100p.mail.yandex.net (forward100p.mail.yandex.net [77.88.28.100]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4DyLYf1924z4ljl for ; Sat, 13 Mar 2021 11:48:53 +0000 (UTC) (envelope-from melifaro@ipfw.ru) Received: from iva4-c9485a9ab4a2.qloud-c.yandex.net (iva4-c9485a9ab4a2.qloud-c.yandex.net [IPv6:2a02:6b8:c0c:788c:0:640:c948:5a9a]) by forward100p.mail.yandex.net (Yandex) with ESMTP id A43EC5980676; Sat, 13 Mar 2021 14:48:44 +0300 (MSK) Received: from iva8-174eb672ffa9.qloud-c.yandex.net (iva8-174eb672ffa9.qloud-c.yandex.net [2a02:6b8:c0c:b995:0:640:174e:b672]) by iva4-c9485a9ab4a2.qloud-c.yandex.net (mxback/Yandex) with ESMTP id aTThDM7j1T-miISWRxF; Sat, 13 Mar 2021 14:48:44 +0300 DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=ipfw.ru; s=mail; t=1615636124; bh=a4+khaZvmo9FzqxSeblpX1wAHtvjCRroqp/1XoOSSLU=; h=To:In-Reply-To:Subject:Cc:From:Message-Id:References:Date; b=uZWLKglMceqhDnkHhygP8X92SuNUiLO+T6Xh6v7M2vUrPHuxAcLYNsj8jN3FvqOnK JsG5xD0GpxGLRGW/siftWMtMODjXKuR6L3k5Oqk0IhPrWrOWDVth7GQDi2zed6ZOo+ Gn35ND/r9k6dlEfwv6f6Z5/QwWiPQoSK/w8RbTt0= Received: by iva8-174eb672ffa9.qloud-c.yandex.net (smtp/Yandex) with ESMTPSA id WkzzPsfhbi-mhJODlpW; Sat, 13 Mar 2021 14:48:43 +0300 (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client certificate not present) Content-Type: text/plain; charset=us-ascii Mime-Version: 1.0 (Mac OS X Mail 13.4 \(3608.120.23.2.4\)) Subject: Re: Troubles with netdump(4) From: "Alexander V. Chernikov" In-Reply-To: <1903978782.20210310130715@gmail.com> Date: Sat, 13 Mar 2021 11:48:42 +0000 Cc: FreeBSD-STABLE Mailing List Content-Transfer-Encoding: quoted-printable Message-Id: <44FCBDFB-8962-4F5D-BFCE-682662524245@ipfw.ru> References: <1903978782.20210310130715@gmail.com> To: Mamontov Roman X-Mailer: Apple Mail (2.3608.120.23.2.4) X-Rspamd-Queue-Id: 4DyLYf1924z4ljl X-Spamd-Bar: -- Authentication-Results: mx1.freebsd.org; dkim=pass header.d=ipfw.ru header.s=mail header.b=uZWLKglM; dmarc=none; spf=pass (mx1.freebsd.org: domain of melifaro@ipfw.ru designates 77.88.28.100 as permitted sender) smtp.mailfrom=melifaro@ipfw.ru X-Spamd-Result: default: False [-3.00 / 15.00]; MV_CASE(0.50)[]; R_SPF_ALLOW(-0.20)[+ip4:77.88.0.0/18]; RCVD_COUNT_THREE(0.00)[3]; TO_DN_ALL(0.00)[]; DKIM_TRACE(0.00)[ipfw.ru:+]; RCPT_COUNT_TWO(0.00)[2]; NEURAL_HAM_SHORT(-1.00)[-1.000]; FREEMAIL_TO(0.00)[gmail.com]; FROM_EQ_ENVFROM(0.00)[]; RCVD_TLS_LAST(0.00)[]; RBL_DBL_DONT_QUERY_IPS(0.00)[77.88.28.100:from]; ASN(0.00)[asn:13238, ipnet:77.88.0.0/18, country:RU]; MIME_TRACE(0.00)[0:+]; MID_RHS_MATCH_FROM(0.00)[]; ARC_NA(0.00)[]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; R_DKIM_ALLOW(-0.20)[ipfw.ru:s=mail]; FREEFALL_USER(0.00)[melifaro]; FROM_HAS_DN(0.00)[]; NEURAL_HAM_LONG(-1.00)[-1.000]; TAGGED_RCPT(0.00)[]; MIME_GOOD(-0.10)[text/plain]; DMARC_NA(0.00)[ipfw.ru]; SPAMHAUS_ZRD(0.00)[77.88.28.100:from:127.0.2.255]; TO_MATCH_ENVRCPT_SOME(0.00)[]; RWL_MAILSPIKE_POSSIBLE(0.00)[77.88.28.100:from]; MAILMAN_DEST(0.00)[freebsd-stable] X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.34 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 13 Mar 2021 11:48:55 -0000 > On 10 Mar 2021, at 10:07, Mamontov Roman wrote: >=20 > Hello. >=20 > I try to use netdump(4) option for transmitting kernel dumps to a = remote server.=20 > When I caused a kernel panic by sysctl debug.kdb.panic I found, that = netdumping=20 > to remote server happens very slow: systat -ifstat on remote side = show speed=20 > around 5KB/s. >=20 > On netdump-client side I have: > root@host-1:/home/roman # uname -mv > FreeBSD 12.2-STABLE GENERIC amd64 > root@host-1:/home/roman #=20 > root@host-1:/home/roman # dumpon -l > em0 > root@host-1:/home/roman # cat /etc/rc.local > #!/bin/sh > /sbin/dumpon -c 192.168.7.11 -s 192.168.7.12 em0 > root@host-1:/home/roman # ifconfig em0 > em0: flags=3D8943 = metric 0 mtu 1500 > = options=3D81209b > inet 192.168.7.11 netmask 0xffffff00 broadcast 192.168.7.255 > media: Ethernet autoselect (1000baseT ) > status: active > nd6 options=3D29 > root@solution:/home/roman # >=20 > On netdumpd-side: > root@host-2:/home/roman # uname -mv > FreeBSD 12.2-STABLE GENERIC i386 > root@host-2:/home/roman # ifconfig em0 > em0: flags=3D8843 metric 0 mtu = 1500 > = options=3D81209b > inet 192.168.7.12 netmask 0xffffff00 broadcast 192.168.7.255 > media: Ethernet autoselect (1000baseT ) > status: active > nd6 options=3D29 > root@solution-old:/home/roman # >=20 > Both (host-1 and host-2) have the same stable/12 revision: > # cat /usr/src/.gituprevision > stable/12:879039312 > # >=20 > When I try test network bandwith between host-1 and host-2 with = iperf3, I see=20 > next results: > root@host-1:/home/roman # iperf3 -u -b 0 -c 192.168.7.12 > Connecting to host 192.168.7.12, port 5201 > [ 5] local 192.168.7.11 port 37112 connected to 192.168.7.12 port = 5201 > [ ID] Interval Transfer Bitrate Total Datagrams > [ 5] 0.00-1.00 sec 346 MBytes 2.90 Gbits/sec 248710 > [ 5] 1.00-2.00 sec 345 MBytes 2.89 Gbits/sec 247750 > [ 5] 2.00-3.00 sec 345 MBytes 2.90 Gbits/sec 247990 > [ 5] 3.00-4.00 sec 331 MBytes 2.78 Gbits/sec 238020 > [ 5] 4.00-5.00 sec 262 MBytes 2.20 Gbits/sec 188260 > [ 5] 5.00-6.00 sec 345 MBytes 2.89 Gbits/sec 247560 > [ 5] 6.00-7.00 sec 345 MBytes 2.89 Gbits/sec 247660 > [ 5] 7.00-8.00 sec 345 MBytes 2.90 Gbits/sec 247980 > [ 5] 8.00-9.00 sec 342 MBytes 2.87 Gbits/sec 245760 > [ 5] 9.00-10.00 sec 344 MBytes 2.88 Gbits/sec 246830 > - - - - - - - - - - - - - - - - - - - - - - - - - > [ ID] Interval Transfer Bitrate Jitter = Lost/Total Datagrams > [ 5] 0.00-10.00 sec 3.27 GBytes 2.81 Gbits/sec 0.000 ms = 0/2406520 (0%) sender > [ 5] 0.00-10.07 sec 0.00 Bytes 0.00 bits/sec 0.000 ms 0/0 (0%) = receiver >=20 > iperf Done. > root@host-1:/home/roman # >=20 > Capturing traffic between host-1 and host-2 not show anything = criminal (as I=20 > understand). >=20 > Next I try netdumping to another FreeBSD-host (virtual machine = on VMWare=20 > hypervisor): > root@host-3:~ # uname -mv > FreeBSD 12.2-STABLE r369412 GENERIC amd64 > root@host-3:~ # ifconfig em0 > em0: flags=3D8843 metric 0 mtu = 1500 > = options=3D81009b > inet 192.168.7.18 netmask 0xffffff00 broadcast 192.168.7.255 > media: Ethernet autoselect (1000baseT ) > status: active > nd6 options=3D29 > root@host-3:~ # >=20 > And netdumping to this host are still slow (~the same 5KB/s).=20 >=20 > Next step another FreeBSD-host (virtual machine on VirtualBox = hypevisor): > root@host-4:~ # uname -mv > FreeBSD 12.2-STABLE r369412 GENERIC amd64 > root@host-4:~ # ifconfig em0 > em0: flags=3D8843 metric 0 mtu = 1500 > = options=3D81009b > inet 192.168.7.19 netmask 0xffffff00 broadcast 192.168.7.255 > media: Ethernet autoselect (1000baseT ) > status: active > nd6 options=3D29 > root@host-4:~ # >=20 > Both (host-3 and host-4) are installed from = FreeBSD-12.2-STABLE-amd64-20210304-r369412-bootonly.iso > When I caused a kernel panic by sysctl debug.kdb.panic on host-4, = netdumping to=20 > host-3 show the same 5 KB/s. netdump requires explicit acks from the other side. Could you try dumping the exchange between the dumping host and the = server to verify that acks are sent immediately after receiving the next = chunk? >=20 > Is there an particularity in netdump, that can't transmitting crash = dumps over=20 > network faster than 5KB/s? Or this is a "feature" of my test-suite? >=20 > _______________________________________________ > freebsd-stable@freebsd.org mailing list > https://lists.freebsd.org/mailman/listinfo/freebsd-stable > To unsubscribe, send any mail to = "freebsd-stable-unsubscribe@freebsd.org" From owner-freebsd-stable@freebsd.org Sat Mar 13 16:09:24 2021 Return-Path: Delivered-To: freebsd-stable@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 7D1A057B253 for ; Sat, 13 Mar 2021 16:09:24 +0000 (UTC) (envelope-from joh.hendriks@gmail.com) Received: from mail-ej1-x62d.google.com (mail-ej1-x62d.google.com [IPv6:2a00:1450:4864:20::62d]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "GTS CA 1O1" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4DySLC3KD1z52Vp for ; Sat, 13 Mar 2021 16:09:23 +0000 (UTC) (envelope-from joh.hendriks@gmail.com) Received: by mail-ej1-x62d.google.com with SMTP id mj10so59143600ejb.5 for ; Sat, 13 Mar 2021 08:09:23 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=to:from:subject:message-id:date:user-agent:mime-version :content-transfer-encoding:content-language; bh=DRS/kQwPjSp6wUZFbcCowLZ9MZU5P4fEN83rKAI4qKU=; b=nebMy4L+N1DhWYmdaeMaHiBqvdmFlhHw4wh3g/DV6DJ3IiJlcVVEwLlzKl275JO8Qz Zz20nfcNVreoh9RWLKI3xXHen9hZhS1WPJYFbom6uaAdZbM/HvgBTiCnHKiUcWQ7KkZd TNHbx9xEMILqYaz9a09DHNiVJxUvhGRdRDxdSdug/Goxm6lT3PtWLgcHhaA8TFnMTmgC KIBFpAr1qgyf+UQrK4SUcFz3KLxsm8R91m02xhdpwfrbfq1xlr+KFoOOjLTV84NZvZBg Vuftrs/MHlWjutUzRN3VfcAJgcw4VTU8jYR49buf8YADM1yLvQhKT5oKtAwC12qFw74T t/jw== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:to:from:subject:message-id:date:user-agent :mime-version:content-transfer-encoding:content-language; bh=DRS/kQwPjSp6wUZFbcCowLZ9MZU5P4fEN83rKAI4qKU=; b=d0Bql2DmLuWeGVWTtxiFYTUX9JMQkp5il7Fd5SXJpM2r1Ppgt1aH0CjL72UT/7NlMo AaXEaWbnEq+JvttcVvYT92qt7ZtXUDyktnUPjKPiBT/lP5t48l4X266RyizyjCzFBaBy w2m0rb7+mEm+PfT0tJ4Os9/6w7x+nHbak4jabcegK/OPl/lb//xq8/66R/4EPRCw4f/v PBaAF+vH+ja9njYgDfzd0UYoC4ddnkHaY6/B1z0fjk2rUoZC6yRnBBMauNTbDIJD7u+g FbeSKIuRBmfBGwQOolny7I64vJzKSDCIpIW9Keztjnurp/w9byjpp+yGXd+yuL7/4zAd Q+VA== X-Gm-Message-State: AOAM532/WqAvLkLBmXghgdb95mnbdoE9nsMmyScfPILOCpAwMv8G0U0Y I+pIxART94T4phzab3j1/TZwx38QKlM= X-Google-Smtp-Source: ABdhPJxrgKE6J5DtshgBwHgtkWPZoF0RpZ4GBxyZdE3MFbOm23GVS2N12c6dMLDJCI8jrQQ/5Z5ZJA== X-Received: by 2002:a17:906:a86:: with SMTP id y6mr14914572ejf.354.1615651761164; Sat, 13 Mar 2021 08:09:21 -0800 (PST) Received: from MBP-van-Johan.lan (85-147-130-226.cable.dynamic.v4.ziggo.nl. [85.147.130.226]) by smtp.gmail.com with ESMTPSA id g21sm4325938ejd.6.2021.03.13.08.09.20 for (version=TLS1_3 cipher=TLS_AES_128_GCM_SHA256 bits=128/128); Sat, 13 Mar 2021 08:09:20 -0800 (PST) To: FreeBSD-STABLE Mailing List From: Johan Hendriks Subject: Second pool not mounted automaticly on 13.0-RC2 Message-ID: Date: Sat, 13 Mar 2021 17:09:19 +0100 User-Agent: Mozilla/5.0 (Macintosh; Intel Mac OS X 10.16; rv:78.0) Gecko/20100101 Thunderbird/78.8.0 MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8; format=flowed Content-Transfer-Encoding: 8bit Content-Language: en-US X-Rspamd-Queue-Id: 4DySLC3KD1z52Vp X-Spamd-Bar: --- Authentication-Results: mx1.freebsd.org; dkim=pass header.d=gmail.com header.s=20161025 header.b=nebMy4L+; dmarc=pass (policy=none) header.from=gmail.com; spf=pass (mx1.freebsd.org: domain of johhendriks@gmail.com designates 2a00:1450:4864:20::62d as permitted sender) smtp.mailfrom=johhendriks@gmail.com X-Spamd-Result: default: False [-3.46 / 15.00]; RCVD_VIA_SMTP_AUTH(0.00)[]; R_SPF_ALLOW(-0.20)[+ip6:2a00:1450:4000::/36:c]; FREEMAIL_FROM(0.00)[gmail.com]; RCVD_COUNT_THREE(0.00)[3]; TO_DN_ALL(0.00)[]; DKIM_TRACE(0.00)[gmail.com:+]; DMARC_POLICY_ALLOW(-0.50)[gmail.com,none]; NEURAL_HAM_SHORT(-0.46)[-0.457]; FROM_EQ_ENVFROM(0.00)[]; MIME_TRACE(0.00)[0:+]; FREEMAIL_ENVFROM(0.00)[gmail.com]; ASN(0.00)[asn:15169, ipnet:2a00:1450::/32, country:US]; TAGGED_FROM(0.00)[]; MID_RHS_MATCH_FROM(0.00)[]; DWL_DNSWL_NONE(0.00)[gmail.com:dkim]; ARC_NA(0.00)[]; RBL_DBL_DONT_QUERY_IPS(0.00)[2a00:1450:4864:20::62d:from]; R_DKIM_ALLOW(-0.20)[gmail.com:s=20161025]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; FROM_HAS_DN(0.00)[]; TO_MATCH_ENVRCPT_ALL(0.00)[]; NEURAL_HAM_LONG(-1.00)[-1.000]; MIME_GOOD(-0.10)[text/plain]; PREVIOUSLY_DELIVERED(0.00)[freebsd-stable@freebsd.org]; RCPT_COUNT_ONE(0.00)[1]; SPAMHAUS_ZRD(0.00)[2a00:1450:4864:20::62d:from:127.0.2.255]; RCVD_IN_DNSWL_NONE(0.00)[2a00:1450:4864:20::62d:from]; RCVD_TLS_ALL(0.00)[]; MAILMAN_DEST(0.00)[freebsd-stable] X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.34 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 13 Mar 2021 16:09:24 -0000 Hello all, i just upgrade my test server from 12.1 to 13.0-RC2. This is a baremetal server. It has two ssd's on ada0 and ada1 using zfs. Also there is a 6 disk pool named storage. After the update the storage pool is not imported any more. I have updated the pool, thinking it was necessary, but the result is the same, after a reboot the storage pool is not imported. root@test-server:~ # zpool list NAME    SIZE  ALLOC   FREE  CKPOINT  EXPANDSZ   FRAG    CAP DEDUP    HEALTH  ALTROOT zroot   107G  1.60G   105G        -         -     0%     1% 1.00x    ONLINE  - root@test-server:~ # zpool import    pool: storage      id: 17039452293665227158   state: ONLINE  action: The pool can be imported using its name or numeric identifier.  config:     storage         ONLINE       mirror-0      ONLINE         gpt/disk00  ONLINE         gpt/disk01  ONLINE       mirror-1      ONLINE         gpt/disk02  ONLINE         gpt/disk03  ONLINE       mirror-2      ONLINE         gpt/disk04  ONLINE         gpt/disk05  ONLINE root@test-server:~ # After importing the pool all is fine but after a reboot it needs to be imported again. Did something change? I observed this earlier on a HEAD which was 13 at that time (around januari) but did not have the time to look at it. That was a baremetal server also. From owner-freebsd-stable@freebsd.org Sat Mar 13 16:44:31 2021 Return-Path: Delivered-To: freebsd-stable@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id BEA4557C04A for ; Sat, 13 Mar 2021 16:44:31 +0000 (UTC) (envelope-from joh.hendriks@gmail.com) Received: from mail-ej1-x632.google.com (mail-ej1-x632.google.com [IPv6:2a00:1450:4864:20::632]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "GTS CA 1O1" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4DyT6k6LPVz54ml for ; Sat, 13 Mar 2021 16:44:30 +0000 (UTC) (envelope-from joh.hendriks@gmail.com) Received: by mail-ej1-x632.google.com with SMTP id p7so47919976eju.6 for ; Sat, 13 Mar 2021 08:44:30 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=subject:from:to:references:message-id:date:user-agent:mime-version :in-reply-to:content-transfer-encoding:content-language; bh=4o+9DM6swTlxJaF/621VonZWHxjSk6iz9/f5Mtyae1c=; b=r8Of5Qn6kha38purhkhjPW9B4zrXt1ickgxp3crK0ijZpzpK3MEnk7Yb5XJsvAMNlH ttVXm5jmle0L4/ExeEApIduZTfUK7g4zuzZqJdcSnkTabCYyR/YlrHFRAvsZQcAqwp2E v6m7eOwfsz5HOnsHOxuEvRBR7eNdsyXm0Dq2dVjxTDHTNPUwpjQt8NIPTnXRl4/qFg46 BJyoPIK6SdB1n5nl1jfc8O2ymtNGUWfMgrC9nXH12VZx5aa9DHMvtzZuv9qDBYpVr4Ai SbMxSlkvbcUPVvJgYZLoR9oEszX1RbhySJdvqZK/VrB1olduHaipi4ZlR1GznpE45uWB dzJw== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:subject:from:to:references:message-id:date :user-agent:mime-version:in-reply-to:content-transfer-encoding :content-language; bh=4o+9DM6swTlxJaF/621VonZWHxjSk6iz9/f5Mtyae1c=; b=AzZ9Irrk+8sjkBV6usDjjCNYchY1JoK5RbOopt0erZNNpqGNMxV07L2NvrlzqAyeBx IJIFWU/R1/HVVwtF81FsRcs38MOQ4AIRLcdK6cOWfO6BfEsr+ZqzNnllRDFlvGGoPz/W s4vSzadLyDM2nImleYNKHOFtGIMboC1jNjmdzlULxFUxT4L4MVGjeZgWGDu/WZndKWz6 gXfM0La4+ktzoehjT3pjjRJB8jl5YqTX5rI6Imwwx+yw5nciNTERtJhqOIL62k13ymh3 yuluJVUCL1wWSoxafysYaMzaJ4ey7qmv/9PY/+xAVdOCYZZ26mChoxYtD8JOh0MgFUwQ Kn3g== X-Gm-Message-State: AOAM532iUaTkqCvMZZpYIy0wgJ7/bCYugz32JY3RnEZBx4PXr3iY3xYc 5/Ns282QfB8IUphKHoDMYg9wI6WChtg= X-Google-Smtp-Source: ABdhPJx7KMLfTEjlvda+bpOktwgxX5pl3CSYX1jQwU4M8oZtFYi58/tsiqbRs5pzpTS/J60ygrIlfg== X-Received: by 2002:a17:906:f2d2:: with SMTP id gz18mr14619971ejb.454.1615653869071; Sat, 13 Mar 2021 08:44:29 -0800 (PST) Received: from MBP-van-Johan.lan (85-147-130-226.cable.dynamic.v4.ziggo.nl. [85.147.130.226]) by smtp.gmail.com with ESMTPSA id i2sm4969524edy.72.2021.03.13.08.44.28 for (version=TLS1_3 cipher=TLS_AES_128_GCM_SHA256 bits=128/128); Sat, 13 Mar 2021 08:44:28 -0800 (PST) Subject: Re: Second pool not mounted automaticly on 13.0-RC2 From: Johan Hendriks To: FreeBSD-STABLE Mailing List References: Message-ID: <43641178-f07c-9f73-4d7a-e3cb6c28d9ee@gmail.com> Date: Sat, 13 Mar 2021 17:44:27 +0100 User-Agent: Mozilla/5.0 (Macintosh; Intel Mac OS X 10.16; rv:78.0) Gecko/20100101 Thunderbird/78.8.0 MIME-Version: 1.0 In-Reply-To: Content-Type: text/plain; charset=utf-8; format=flowed Content-Transfer-Encoding: 8bit Content-Language: en-US X-Rspamd-Queue-Id: 4DyT6k6LPVz54ml X-Spamd-Bar: --- Authentication-Results: mx1.freebsd.org; dkim=pass header.d=gmail.com header.s=20161025 header.b=r8Of5Qn6; dmarc=pass (policy=none) header.from=gmail.com; spf=pass (mx1.freebsd.org: domain of johhendriks@gmail.com designates 2a00:1450:4864:20::632 as permitted sender) smtp.mailfrom=johhendriks@gmail.com X-Spamd-Result: default: False [-3.99 / 15.00]; RCVD_VIA_SMTP_AUTH(0.00)[]; R_SPF_ALLOW(-0.20)[+ip6:2a00:1450:4000::/36:c]; FREEMAIL_FROM(0.00)[gmail.com]; RCVD_COUNT_THREE(0.00)[3]; TO_DN_ALL(0.00)[]; DKIM_TRACE(0.00)[gmail.com:+]; DMARC_POLICY_ALLOW(-0.50)[gmail.com,none]; NEURAL_HAM_SHORT(-0.99)[-0.989]; FROM_EQ_ENVFROM(0.00)[]; MIME_TRACE(0.00)[0:+]; FREEMAIL_ENVFROM(0.00)[gmail.com]; ASN(0.00)[asn:15169, ipnet:2a00:1450::/32, country:US]; MID_RHS_MATCH_FROM(0.00)[]; TAGGED_FROM(0.00)[]; DWL_DNSWL_NONE(0.00)[gmail.com:dkim]; ARC_NA(0.00)[]; RBL_DBL_DONT_QUERY_IPS(0.00)[2a00:1450:4864:20::632:from]; R_DKIM_ALLOW(-0.20)[gmail.com:s=20161025]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; FROM_HAS_DN(0.00)[]; TO_MATCH_ENVRCPT_ALL(0.00)[]; NEURAL_HAM_LONG(-1.00)[-1.000]; MIME_GOOD(-0.10)[text/plain]; PREVIOUSLY_DELIVERED(0.00)[freebsd-stable@freebsd.org]; RCPT_COUNT_ONE(0.00)[1]; SPAMHAUS_ZRD(0.00)[2a00:1450:4864:20::632:from:127.0.2.255]; RCVD_IN_DNSWL_NONE(0.00)[2a00:1450:4864:20::632:from]; RCVD_TLS_ALL(0.00)[]; MAILMAN_DEST(0.00)[freebsd-stable] X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.34 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 13 Mar 2021 16:44:31 -0000 On 13/03/2021 17:09, Johan Hendriks wrote: > Hello all, i just upgrade my test server from 12.1 to 13.0-RC2. This > is a baremetal server. > It has two ssd's on ada0 and ada1 using zfs. Also there is a 6 disk > pool named storage. > > After the update the storage pool is not imported any more. I have > updated the pool, thinking it was necessary, but the result is the > same, after a reboot the storage pool is not imported. > > root@test-server:~ # zpool list > NAME    SIZE  ALLOC   FREE  CKPOINT  EXPANDSZ   FRAG    CAP DEDUP    > HEALTH  ALTROOT > zroot   107G  1.60G   105G        -         -     0%     1% 1.00x    > ONLINE  - > root@test-server:~ # zpool import >    pool: storage >      id: 17039452293665227158 >   state: ONLINE >  action: The pool can be imported using its name or numeric identifier. >  config: > >     storage         ONLINE >       mirror-0      ONLINE >         gpt/disk00  ONLINE >         gpt/disk01  ONLINE >       mirror-1      ONLINE >         gpt/disk02  ONLINE >         gpt/disk03  ONLINE >       mirror-2      ONLINE >         gpt/disk04  ONLINE >         gpt/disk05  ONLINE > root@test-server:~ # > > After importing the pool all is fine but after a reboot it needs to be > imported again. > > Did something change? > I observed this earlier on a HEAD which was 13 at that time (around > januari) but did not have the time to look at it. That was a baremetal > server also. > For the completeness, i have the following related settings in /boot/loader.conf. # ZFS zfs_load="YES" And in my /etc/rc.conf the following. # ZFS zfs_enable="YES" From owner-freebsd-stable@freebsd.org Sat Mar 13 18:44:00 2021 Return-Path: Delivered-To: freebsd-stable@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id BEBE757EADC for ; Sat, 13 Mar 2021 18:44:00 +0000 (UTC) (envelope-from wlosh@bsdimp.com) Received: from mail-qk1-x72d.google.com (mail-qk1-x72d.google.com [IPv6:2607:f8b0:4864:20::72d]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "GTS CA 1O1" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4DyWmb6dNNz3DPg for ; Sat, 13 Mar 2021 18:43:59 +0000 (UTC) (envelope-from wlosh@bsdimp.com) Received: by mail-qk1-x72d.google.com with SMTP id f124so27832559qkj.5 for ; Sat, 13 Mar 2021 10:43:59 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=bsdimp-com.20150623.gappssmtp.com; s=20150623; h=mime-version:references:in-reply-to:from:date:message-id:subject:to :cc; bh=TpDWKjRZ8szE5MgTOH3cG569BUoqWXZzUs6STsbM9XU=; b=eNBqlGynw/Z5N+6CMKvPgbjOUyBZ9zNqO27tstxzQfdqEay5+w14HYCsGCzt7f4cuv shVescPOnkXbHrQjBiv1PhTmpJWIo2iYh1zabNTH9YgRUkt0vcFzVnVCt2845+MDlGeN l89qrPrPIL6wEdroH2aFj9Enh9I2CXuZ4fPj+EQjFAPzAkSyB6O+Yph29us9a8hVpN7Y 0hwAAVhj0Ju1i/SZEmlY51l8lC6a6L/7HvpJY9e9I6lyk/ae42+kxcEa9wP/1HjrHdvS bUAUL1oBBlALEzb6nCUokvvFbp05JLc1ThFTL0of4OSps+usRUWu1orebvZjbcfNtT+3 /ywQ== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:references:in-reply-to:from:date :message-id:subject:to:cc; bh=TpDWKjRZ8szE5MgTOH3cG569BUoqWXZzUs6STsbM9XU=; b=STpfmvPUtrW8d5uFw22Vg8bAEKhM17wcNppBgDe6nBGyQta9Er/OR+YycyNgeBj8d+ W+MzMDSlT8rvKfyg4wZmXUb0GrK6T2FGtY/yLS47j5cW2ru0mOvLxNAYn3jCmB7KCfkg sohetcsjhkVVL+pE1CF5FccopzuTXpTZ0YXCb9gKkEnkCTW8Wf9rCsn+VGljO2ApCkrH v1+T44tfLUWWNa3v94CjZCygXqWlQCMbM5qHayHq47S1w/IMkT/Tcrm8U7u+k02RxTPU J89Npbg5YZdpXNyLn/rHsvpJrBbpYgld5gl1SaAPLhdOh6L0A8YlY8GSmIq6GJCM8caD uVkg== X-Gm-Message-State: AOAM531cENpsYGzqQ4QaFsyCYblQCPF+B/HEffFtFUJMYfbKCpi/c8ah E9UDw4v2mFOAhYOL8URh7cz+HCC9L/3VXrMMoaXyNZ+GGNK10w== X-Google-Smtp-Source: ABdhPJyzYaQoUkNOT54Wg6ql0+gAZUK6Jw3kVpah65nQOCfuzKNLrHArKeP5+UAHsoowrAbvJkrRokTPjQCavpN28Hs= X-Received: by 2002:a37:a085:: with SMTP id j127mr17474012qke.206.1615661038890; Sat, 13 Mar 2021 10:43:58 -0800 (PST) MIME-Version: 1.0 References: <43641178-f07c-9f73-4d7a-e3cb6c28d9ee@gmail.com> In-Reply-To: <43641178-f07c-9f73-4d7a-e3cb6c28d9ee@gmail.com> From: Warner Losh Date: Sat, 13 Mar 2021 11:43:47 -0700 Message-ID: Subject: Re: Second pool not mounted automaticly on 13.0-RC2 To: Johan Hendriks Cc: FreeBSD-STABLE Mailing List X-Rspamd-Queue-Id: 4DyWmb6dNNz3DPg X-Spamd-Bar: -- Authentication-Results: mx1.freebsd.org; dkim=pass header.d=bsdimp-com.20150623.gappssmtp.com header.s=20150623 header.b=eNBqlGyn; dmarc=none; spf=none (mx1.freebsd.org: domain of wlosh@bsdimp.com has no SPF policy when checking 2607:f8b0:4864:20::72d) smtp.mailfrom=wlosh@bsdimp.com X-Spamd-Result: default: False [-3.00 / 15.00]; TO_DN_ALL(0.00)[]; DKIM_TRACE(0.00)[bsdimp-com.20150623.gappssmtp.com:+]; RCPT_COUNT_TWO(0.00)[2]; NEURAL_HAM_SHORT(-1.00)[-0.999]; FREEMAIL_TO(0.00)[gmail.com]; FORGED_SENDER(0.30)[imp@bsdimp.com,wlosh@bsdimp.com]; MIME_TRACE(0.00)[0:+,1:+,2:~]; RBL_DBL_DONT_QUERY_IPS(0.00)[2607:f8b0:4864:20::72d:from]; ASN(0.00)[asn:15169, ipnet:2607:f8b0::/32, country:US]; FROM_NEQ_ENVFROM(0.00)[imp@bsdimp.com,wlosh@bsdimp.com]; ARC_NA(0.00)[]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; R_DKIM_ALLOW(-0.20)[bsdimp-com.20150623.gappssmtp.com:s=20150623]; FROM_HAS_DN(0.00)[]; NEURAL_HAM_LONG(-1.00)[-1.000]; TAGGED_RCPT(0.00)[]; MIME_GOOD(-0.10)[multipart/alternative,text/plain]; PREVIOUSLY_DELIVERED(0.00)[freebsd-stable@freebsd.org]; DMARC_NA(0.00)[bsdimp.com]; SPAMHAUS_ZRD(0.00)[2607:f8b0:4864:20::72d:from:127.0.2.255]; TO_MATCH_ENVRCPT_SOME(0.00)[]; RCVD_IN_DNSWL_NONE(0.00)[2607:f8b0:4864:20::72d:from]; R_SPF_NA(0.00)[no SPF record]; RCVD_COUNT_TWO(0.00)[2]; RCVD_TLS_ALL(0.00)[]; MAILMAN_DEST(0.00)[freebsd-stable] Content-Type: text/plain; charset="UTF-8" X-Content-Filtered-By: Mailman/MimeDel 2.1.34 X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.34 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 13 Mar 2021 18:44:00 -0000 On Sat, Mar 13, 2021 at 9:44 AM Johan Hendriks wrote: > On 13/03/2021 17:09, Johan Hendriks wrote: > > Hello all, i just upgrade my test server from 12.1 to 13.0-RC2. This > > is a baremetal server. > > It has two ssd's on ada0 and ada1 using zfs. Also there is a 6 disk > > pool named storage. > > > > After the update the storage pool is not imported any more. I have > > updated the pool, thinking it was necessary, but the result is the > > same, after a reboot the storage pool is not imported. > > > > root@test-server:~ # zpool list > > NAME SIZE ALLOC FREE CKPOINT EXPANDSZ FRAG CAP DEDUP > > HEALTH ALTROOT > > zroot 107G 1.60G 105G - - 0% 1% 1.00x > > ONLINE - > > root@test-server:~ # zpool import > > pool: storage > > id: 17039452293665227158 > > state: ONLINE > > action: The pool can be imported using its name or numeric identifier. > > config: > > > > storage ONLINE > > mirror-0 ONLINE > > gpt/disk00 ONLINE > > gpt/disk01 ONLINE > > mirror-1 ONLINE > > gpt/disk02 ONLINE > > gpt/disk03 ONLINE > > mirror-2 ONLINE > > gpt/disk04 ONLINE > > gpt/disk05 ONLINE > > root@test-server:~ # > > > > After importing the pool all is fine but after a reboot it needs to be > > imported again. > > > > Did something change? > > I observed this earlier on a HEAD which was 13 at that time (around > > januari) but did not have the time to look at it. That was a baremetal > > server also. > > > For the completeness, i have the following related settings in > /boot/loader.conf. > > # ZFS > zfs_load="YES" > > And in my /etc/rc.conf the following. > # ZFS > zfs_enable="YES" Have you updated your rc scripts? I had the same problem a while ago until I did that. Warner From owner-freebsd-stable@freebsd.org Sat Mar 13 19:18:20 2021 Return-Path: Delivered-To: freebsd-stable@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 2EF4A57FFC9 for ; Sat, 13 Mar 2021 19:18:20 +0000 (UTC) (envelope-from fjwcash@gmail.com) Received: from mail-qk1-x729.google.com (mail-qk1-x729.google.com [IPv6:2607:f8b0:4864:20::729]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "GTS CA 1O1" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4DyXXC3H9qz3GxH for ; Sat, 13 Mar 2021 19:18:19 +0000 (UTC) (envelope-from fjwcash@gmail.com) Received: by mail-qk1-x729.google.com with SMTP id t4so27942663qkp.1 for ; Sat, 13 Mar 2021 11:18:19 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=mime-version:references:in-reply-to:from:date:message-id:subject:to :cc; bh=dcqaZ6PywaFYEVXOz0rF75rty1ivmzC1nUW1eJS2XUs=; b=l8Sbi7+nKJar5qXf+01Hi70nywyPjMnribAjeLcbQ9xLkzl3ESVXr3HokonFK0eCLf roX7AjZDzYzxD55SeAZ/T2WCRyF5Whc+dE5qEDN6+OayBgNsL54RNTKYClMiS2K9H8Ti 81GHjgsfktWk1/kZQq9hF56q+csTm/4YhDT+b64XvokiRJ6cjvZKSzxZrZWlFRE1ZjRY iHi2i3g4U2Q0HpcjOPjPTpC/UwXsLsAFgKg2LBB3FISOPhmBZqinB4uWo3zBQdPw8T3Z 57ana5D7iuaCemchaLfmkiA0slNKwNSZImzpMW02yugc+fabVvGIc1F3dqaQWG/YzTEn 9sOw== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:references:in-reply-to:from:date :message-id:subject:to:cc; bh=dcqaZ6PywaFYEVXOz0rF75rty1ivmzC1nUW1eJS2XUs=; b=JhMeVnbb7QiCVoHhcb1/RkkB+mG7X872fQLBVB5eXwmBjnqRBgV6jBcND1wqmNTVFh HRFBIIYPTqCH9q3ToPD2BwKYbq8tR7LdXWDcM4+Wyl9hqMqlRd+RQb5AIA6O+T8GUuHo 6anEradDn7W430aFNdyWhgl8GcI2DZkVOdkD1wPLQSU2Rx4o++OOvq0vCFi20rKePZn+ m0IalCgXgsw+Evxuhran1Xe1BHe+M0lp44qxoeiL1d4LJuU1ZYNV977vFgbnhMHpgpNT 0gETp6tdYzfC12J4lOL1Wt9UzO/StHs7XBesD/VynYjH/PqATLRJ9swFBz92NdNufOOE lLqQ== X-Gm-Message-State: AOAM530iFw5cYltNX73cxcEISfk/M2jeSA4NwUSHuUsLr7oyLMVxm2xy jyNMtMGTkD8COUgdsJIpLH8H+Kv8bo7SimyyluNfgndS X-Google-Smtp-Source: ABdhPJwzSTjGeaJJczVHZmJFtUwxk+pEoi3JfR7mUMQy9V6noU7ieoCr6QtKZhKd7SNX136gxuuYGQReAAyBpT+RPL0= X-Received: by 2002:a37:596:: with SMTP id 144mr19049563qkf.387.1615663098336; Sat, 13 Mar 2021 11:18:18 -0800 (PST) MIME-Version: 1.0 References: <43641178-f07c-9f73-4d7a-e3cb6c28d9ee@gmail.com> In-Reply-To: <43641178-f07c-9f73-4d7a-e3cb6c28d9ee@gmail.com> From: Freddie Cash Date: Sat, 13 Mar 2021 11:18:07 -0800 Message-ID: Subject: Re: Second pool not mounted automaticly on 13.0-RC2 To: Johan Hendriks Cc: FreeBSD-STABLE Mailing List X-Rspamd-Queue-Id: 4DyXXC3H9qz3GxH X-Spamd-Bar: -- Authentication-Results: mx1.freebsd.org; dkim=pass header.d=gmail.com header.s=20161025 header.b=l8Sbi7+n; dmarc=pass (policy=none) header.from=gmail.com; spf=pass (mx1.freebsd.org: domain of fjwcash@gmail.com designates 2607:f8b0:4864:20::729 as permitted sender) smtp.mailfrom=fjwcash@gmail.com X-Spamd-Result: default: False [-2.27 / 15.00]; FREEMAIL_FROM(0.00)[gmail.com]; R_SPF_ALLOW(-0.20)[+ip6:2607:f8b0:4000::/36]; TO_DN_ALL(0.00)[]; DKIM_TRACE(0.00)[gmail.com:+]; RCPT_COUNT_TWO(0.00)[2]; DMARC_POLICY_ALLOW(-0.50)[gmail.com,none]; FREEMAIL_TO(0.00)[gmail.com]; FROM_EQ_ENVFROM(0.00)[]; MIME_TRACE(0.00)[0:+,1:+,2:~]; RBL_DBL_DONT_QUERY_IPS(0.00)[2607:f8b0:4864:20::729:from]; FREEMAIL_ENVFROM(0.00)[gmail.com]; ASN(0.00)[asn:15169, ipnet:2607:f8b0::/32, country:US]; DWL_DNSWL_NONE(0.00)[gmail.com:dkim]; ARC_NA(0.00)[]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; R_DKIM_ALLOW(-0.20)[gmail.com:s=20161025]; FROM_HAS_DN(0.00)[]; NEURAL_SPAM_SHORT(0.73)[0.732]; NEURAL_HAM_LONG(-1.00)[-1.000]; TAGGED_RCPT(0.00)[]; MIME_GOOD(-0.10)[multipart/alternative,text/plain]; PREVIOUSLY_DELIVERED(0.00)[freebsd-stable@freebsd.org]; SPAMHAUS_ZRD(0.00)[2607:f8b0:4864:20::729:from:127.0.2.255]; TO_MATCH_ENVRCPT_SOME(0.00)[]; RCVD_IN_DNSWL_NONE(0.00)[2607:f8b0:4864:20::729:from]; RCVD_COUNT_TWO(0.00)[2]; RCVD_TLS_ALL(0.00)[]; MAILMAN_DEST(0.00)[freebsd-stable] Content-Type: text/plain; charset="UTF-8" X-Content-Filtered-By: Mailman/MimeDel 2.1.34 X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.34 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 13 Mar 2021 19:18:20 -0000 On Sat., Mar. 13, 2021, 8:44 a.m. Johan Hendriks, wrote: > On 13/03/2021 17:09, Johan Hendriks wrote: > > Hello all, i just upgrade my test server from 12.1 to 13.0-RC2. This > > is a baremetal server. > > It has two ssd's on ada0 and ada1 using zfs. Also there is a 6 disk > > pool named storage. > > > > After the update the storage pool is not imported any more. I have > > updated the pool, thinking it was necessary, but the result is the > > same, after a reboot the storage pool is not imported. > > > > root@test-server:~ # zpool list > > NAME SIZE ALLOC FREE CKPOINT EXPANDSZ FRAG CAP DEDUP > > HEALTH ALTROOT > > zroot 107G 1.60G 105G - - 0% 1% 1.00x > > ONLINE - > > root@test-server:~ # zpool import > > pool: storage > > id: 17039452293665227158 > > state: ONLINE > > action: The pool can be imported using its name or numeric identifier. > > config: > > > > storage ONLINE > > mirror-0 ONLINE > > gpt/disk00 ONLINE > > gpt/disk01 ONLINE > > mirror-1 ONLINE > > gpt/disk02 ONLINE > > gpt/disk03 ONLINE > > mirror-2 ONLINE > > gpt/disk04 ONLINE > > gpt/disk05 ONLINE > > root@test-server:~ # > > > > After importing the pool all is fine but after a reboot it needs to be > > imported again. > > > > Did something change? > > I observed this earlier on a HEAD which was 13 at that time (around > > januari) but did not have the time to look at it. That was a baremetal > > server also. > > > For the completeness, i have the following related settings in > /boot/loader.conf. > > # ZFS > zfs_load="YES" > > And in my /etc/rc.conf the following. > # ZFS > zfs_enable="YES" > I have a 12.2 system where I installed the OpenZFS port and switched over to using that for my pools (boot pool has not been upgraded, storage pool is using draid). Boot pool is imported at boot time as per normal. Storage pool doesn't get imported until it login and do it manually. Played around with cache file settings to no avail. Have a system I've upgraded to 13.0-RC1 that we're testing different pool arrangements for the storage pool. Haven't rebooted it yet with the second pool created so not sure if it's going to be imported automatically or not. Cheers, Freddie >