From nobody Mon May 6 13:59:33 2024 X-Original-To: freebsd-stable@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4VY31k4dKbz5KH91 for ; Mon, 06 May 2024 13:59:38 +0000 (UTC) (envelope-from christos@freebsd.org) Received: from smtp.freebsd.org (smtp.freebsd.org [IPv6:2610:1c1:1:606c::24b:4]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "smtp.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4VY31k41C4z4LkB; Mon, 6 May 2024 13:59:38 +0000 (UTC) (envelope-from christos@freebsd.org) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1715003978; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:cc:mime-version:mime-version:content-type:content-type; bh=RprJFmfz854TpWiZgsNpkudRrid+ytU/5o/zvxgKSxk=; b=g7tuPlCVkoJi3ANhfcQVz51vDG4x0B5pKL1M6IYviOh+ZdoGPT+cW+hwc6jyYj5tQk7nGS 8qFlsJVqR90k8BDPAV0ls8xmpbhNmMx+fjxc5lMtxlpu3P3uWk/HegsJ/EJ1RtP1d7li/W OA2zJZxl5riwxm1f2tUSyFRMONtK95eH61K4blPKA3nMpToU955tvpp9XlcyQGvqyIWbD+ MgCZ5+WarPi3tA22myhcHgy9pC85srLbDWb4cU8QCVHrgglm/Z6m5SZlTjQNVxGhnW5g0h D7XjCX1f5iwrJDQc3XuwoFWOpK7guKcMwXtzvGGyhrBjKHbRc6UAsDfNWBp9OA== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1715003978; a=rsa-sha256; cv=none; b=cxa5RX/ViNYdLgUNgHy48W2LzBhLRHWT0xeSPy9x2XDoHejpdffOZH/1obAgCI3whE0gHu XmEIW+kIXwnlAWQTbNVl1lj8WTFQYketzeNL5uJ1UwJNYGn5qtTllLi7ZYfy4GWHMZDmkm lvTPwn87lE4gAIc6CvItpK0r5vS/jgDfbh2U7WBJIGlGMhIjkwxVpMYGur1gu/aqSneK7w bUA93WoxzrmrIjRaHuwj6mP+JY8vI6ihfc4g0Wqd4cGNBDXFdnvtRpq2Qyu/xj09F80Ly3 O57DfKOrT+G0rEqbiHm1AeHr0xsmI/eCYglIHqc+auz+bf6iJXcO32gUUBlVBw== ARC-Authentication-Results: i=1; mx1.freebsd.org; none ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1715003978; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:cc:mime-version:mime-version:content-type:content-type: dkim-signature; bh=RprJFmfz854TpWiZgsNpkudRrid+ytU/5o/zvxgKSxk=; b=N8m8NKWJCPqbmfcHcTDIzo/Lk37ACDjO8YOrzlj1OjtqH3Ebssias+jjRdgPmAkI4HkTl6 ondYhr6sR5jdJH7vd2Lj+/xXAIN5j64x6jCuRK4dCxdrWKJE3PK2C5aouhq6hk+7fAqzal T2FVglgnmBF1XwPegteqj1MZXoNvEUwPsSJi3nTEzOdibv4Th2fCW8FEI2n3VDTRV36TaQ ejFTbp/G3k6TqNdRwhcDBiiazVF4099Dg+AoqTHDRu1Pq6EED31+vgNzKdF7fCBJSLq2lQ ndjlN66I89RjS0yPx9E2ILBTGacjsJDXeDBcE0F6mYrBk6pgtkD24Qbn5P1vfQ== Received: from margiolis.net (mail.margiolis.net [95.179.159.8]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA512) (Client did not present a certificate) (Authenticated sender: christos/mail) by smtp.freebsd.org (Postfix) with ESMTPSA id 4VY31k0j57z1FrF; Mon, 6 May 2024 13:59:37 +0000 (UTC) (envelope-from christos@freebsd.org) DKIM-Signature: v=1; a=rsa-sha256; c=simple/simple; s=mail; bh=RprJFmfz854TpWi ZgsNpkudRrid+ytU/5o/zvxgKSxk=; h=subject:cc:to:from:date; d=margiolis.net; b=d7wCRAU3/4FptJgOoH2wGGBx59RlQnQ/vCfJOyPgVtlwO52ot9x bW34lQxBk6ha9wgVCeB3WS3BSmYBpHJN/cd1g2uP1vOCxCP6AVdEVz2jcKF4A6/xy4RDlH rLH/UGx+xUw4ySR2TcSSAzljLsiAXKhcc863V/NyFeQg/AaVnw= Received: from tpad (ip-45-81-121-44.ask4internet.com [45.81.121.44]) by margiolis.net (OpenSMTPD) with ESMTPSA id ce8e7522 (TLSv1.3:AEAD-AES256-GCM-SHA384:256:NO); Mon, 6 May 2024 13:59:34 +0000 (UTC) Date: Mon, 6 May 2024 15:59:33 +0200 From: Christos Margiolis To: freebsd-stable@freebsd.org Cc: emaste@freebsd.org, jrm@freebsd.org Subject: Call-for-testing: Asynchronous audio device detach Message-ID: <5kwrpbpb5ymmukxx55wjow772yqvkzzfowjpjsb47xm6lh7ij7@jleot7xzeh7h> List-Id: Production branch of FreeBSD source code List-Archive: https://lists.freebsd.org/archives/freebsd-stable List-Help: List-Post: List-Subscribe: List-Unsubscribe: X-BeenThere: freebsd-stable@freebsd.org Sender: owner-freebsd-stable@FreeBSD.org MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline Hello, A few weeks I added support for asynchronous device detach for audio devices [1][2], something that many people with detachable audio devices (e.g USB) have been asking for for years [3][4][5][6][7][many more...]. Now that 14.1-BETA1 is out, I would like to ask you to give it a try and let me know if everything works properly. Christos [1] https://cgit.freebsd.org/src/commit/?id=44e128fe9d92c1a544b801cb56e907a66ef34691 [2] https://cgit.freebsd.org/src/commit/?id=03614fcba25b9de99e69819bc4690f66a3d24438 [3] https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=194727 [4] https://forums.freebsd.org/threads/not-entering-sleep-state-due-to-audio.82597/ [5] https://forums.freebsd.org/threads/forcing-off-the-computer-endlessly-waiting-for-sound-application-to-exit-at-sleep-suspend-time.80412/ [6] https://www.davidschlachter.com/misc/freebsd-usb-audio [7] https://randomnixfix.wordpress.com/2021/10/23/why-the-freebsd-desktop-and-my-linux-rant/ From nobody Mon May 6 18:17:47 2024 X-Original-To: freebsd-stable@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4VY8lt6X9jz5J15C; Mon, 06 May 2024 18:18:02 +0000 (UTC) (envelope-from bsd-lists@bsdforge.com) Received: from udns.ultimatedns.net (udns.ultimatedns.net [24.113.41.81]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "ultimatedns.net", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4VY8ls5L0Dz4q3D; Mon, 6 May 2024 18:18:01 +0000 (UTC) (envelope-from bsd-lists@bsdforge.com) Authentication-Results: mx1.freebsd.org; none Received: from ultimatedns.net (localhost [127.0.0.1]) by udns.ultimatedns.net (8.16.1/8.16.1) with ESMTP id 446IHm9u053304; Mon, 6 May 2024 11:17:54 -0700 (PDT) (envelope-from bsd-lists@bsdforge.com) DKIM-Signature: v=1; a=rsa-sha256; c=simple/simple; d=ultimatedns.net; s=mx99; t=1715019474; x=1715020074; r=y; bh=ft2fYlM/jbfwU1aGZAqbahCT0rvCD20/DXk5PKPJAVA=; h=Date:From:To:Cc:Subject:In-Reply-To:References; b=UP8OeCIH6wsOaYMqM1WrMedsrcaEpynDdC29v7ge2ZSR/GOLv6QLX8C2/BOP0AjJe yFS4dcB0zYCcGOOx1ChU+6dUosLOBog9ha/y3QP2tStUreZTwJWXc7vcPo4R4Y/h3T UWOyVEMeBfNK5gjRgPQOtoOLZvmvF9BHGeurnlE5stnFLlTXyjHLQSZBDGyY3flVdA Th3yzui6yIxLewP9IhCvhlH38six0bSwBZ4YojyUB1pduoVHpMqK9uDIEuNCVue6HP wDLQQ1salD9FCd2VIBGemPYGXU90MJKQnSVoeXegoMsngX9U2clZkt3/TRSMML6Tfq GemyKrVbKmXOw== List-Id: Production branch of FreeBSD source code List-Archive: https://lists.freebsd.org/archives/freebsd-stable List-Help: List-Post: List-Subscribe: List-Unsubscribe: X-BeenThere: freebsd-stable@freebsd.org Sender: owner-freebsd-stable@FreeBSD.org MIME-Version: 1.0 Date: Mon, 06 May 2024 11:17:47 -0700 From: Chris To: FreeBSD Release Engineering Team Cc: freebsd-snapshots@freebsd.org, freebsd-stable@freebsd.org Subject: Re: FreeBSD 14.1-BETA1 Now Available In-Reply-To: <20240505223241.0EF64E626@freefall.freebsd.org> References: <20240505223241.0EF64E626@freefall.freebsd.org> User-Agent: UDNSMS/17.0 Message-ID: <35b7dce83566f61c425175514ac30f42@bsdforge.com> X-Sender: bsd-lists@bsdforge.com Content-Type: text/plain; charset=US-ASCII; format=flowed Content-Transfer-Encoding: 7bit X-Spamd-Bar: ---- X-Rspamd-Pre-Result: action=no action; module=replies; Message is reply to one we originated X-Spamd-Result: default: False [-4.00 / 15.00]; REPLY(-4.00)[]; ASN(0.00)[asn:11404, ipnet:24.113.0.0/16, country:US] X-Rspamd-Queue-Id: 4VY8ls5L0Dz4q3D On 2024-05-05 15:32, Colin Percival wrote: > The first BETA build of the 14.1-RELEASE release cycle is now available. ... > > https://www.freebsd.org/releases/14.1R/relnotes/ > Apologies; as I'm not subscribed to the docs list. But when making a trip to the hardware page via the release notes. I encountered this from disc controllers onward: &hwlist.aac; &hwlist.aacraid; &hwlist.adv; &hwlist.adw; &hwlist.aha; &hwlist.ahc; &hwlist.ahci; &hwlist.ahd; &hwlist.man4.i386/aic; &hwlist.amr; &hwlist.arcmsr; &hwlist.ata; &hwlist.bt; ... It appears the hardware page has been corrupted. :( --Chris From nobody Tue May 7 08:50:40 2024 X-Original-To: stable@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4VYX6v2B7Rz5KP3N for ; Tue, 07 May 2024 08:50:47 +0000 (UTC) (envelope-from fm-134872-20240507085041870aa12ab8a268ea44-P51eKT@rts-flowmailer.siemens.com) Received: from mta-65-227.siemens.flowmailer.net (mta-65-227.siemens.flowmailer.net [185.136.65.227]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4VYX6s5MZwz4YQ6 for ; Tue, 7 May 2024 08:50:45 +0000 (UTC) (envelope-from fm-134872-20240507085041870aa12ab8a268ea44-P51eKT@rts-flowmailer.siemens.com) Authentication-Results: mx1.freebsd.org; dkim=pass header.d=siemens.com header.s=fm1 header.b=LpI1EbZG; dmarc=pass (policy=reject) header.from=siemens.com; spf=pass (mx1.freebsd.org: domain of fm-134872-20240507085041870aa12ab8a268ea44-P51eKT@rts-flowmailer.siemens.com designates 185.136.65.227 as permitted sender) smtp.mailfrom=fm-134872-20240507085041870aa12ab8a268ea44-P51eKT@rts-flowmailer.siemens.com Received: by mta-65-227.siemens.flowmailer.net with ESMTPSA id 20240507085041870aa12ab8a268ea44 for ; Tue, 07 May 2024 10:50:41 +0200 DKIM-Signature: v=1; a=rsa-sha256; q=dns/txt; c=relaxed/relaxed; s=fm1; d=siemens.com; i=Andre.Albsmeier@siemens.com; h=Date:From:Subject:To:Message-ID:MIME-Version:Content-Type:Cc:References:In-Reply-To; bh=294Jl75DksMqCWvRQ4cnd7eiKxkxhyNeKtFa1xtB778=; b=LpI1EbZGpGuqXr71/cgFS5TagTRibblA+EKzebR3HRiOs7L/3YWw1LxAx4ZVgKVdjq8Fqq mTU1RxswQBL9nXrvR0Tkz0c10gZsAdUo/Qs5+Cz9OIgN+kTNIT9GwOCcdOS79/FUJZ0/JAG+ gAAo54x0GRNuAbYr49DoaDYFoDTKw=; Date: Tue, 7 May 2024 10:50:40 +0200 From: Andre Albsmeier To: stable@freebsd.org Cc: Andre.Albsmeier@siemens.com Subject: Re: 14-STABLE crashes when using geli from automountd executable maps Message-ID: References: List-Id: Production branch of FreeBSD source code List-Archive: https://lists.freebsd.org/archives/freebsd-stable List-Help: List-Post: List-Subscribe: List-Unsubscribe: X-BeenThere: freebsd-stable@freebsd.org Sender: owner-freebsd-stable@FreeBSD.org MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: document_confidentiality: Restricted X-Flowmailer-Platform: Siemens Feedback-ID: 519:519-134872:519-21489:flowmailer X-Spamd-Bar: ----- X-Spamd-Result: default: False [-5.90 / 15.00]; DWL_DNSWL_MED(-2.00)[siemens.com:dkim]; NEURAL_HAM_LONG(-1.00)[-1.000]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; NEURAL_HAM_SHORT(-1.00)[-1.000]; DMARC_POLICY_ALLOW(-0.50)[siemens.com,reject]; FORGED_SENDER(0.30)[Andre.Albsmeier@siemens.com,fm-134872-20240507085041870aa12ab8a268ea44-P51eKT@rts-flowmailer.siemens.com]; R_DKIM_ALLOW(-0.20)[siemens.com:s=fm1]; R_SPF_ALLOW(-0.20)[+ip4:185.136.65.224/29]; RWL_MAILSPIKE_VERYGOOD(-0.20)[185.136.65.227:from]; MIME_GOOD(-0.10)[text/plain]; RCVD_VIA_SMTP_AUTH(0.00)[]; ASN(0.00)[asn:50018, ipnet:185.136.65.0/24, country:NL]; MIME_TRACE(0.00)[0:+]; RCVD_COUNT_ONE(0.00)[1]; MISSING_XM_UA(0.00)[]; RCVD_TLS_ALL(0.00)[]; RCPT_COUNT_TWO(0.00)[2]; MLMMJ_DEST(0.00)[stable@freebsd.org]; FROM_NEQ_ENVFROM(0.00)[Andre.Albsmeier@siemens.com,fm-134872-20240507085041870aa12ab8a268ea44-P51eKT@rts-flowmailer.siemens.com]; FROM_HAS_DN(0.00)[]; ARC_NA(0.00)[]; TO_DN_NONE(0.00)[]; PREVIOUSLY_DELIVERED(0.00)[stable@freebsd.org]; TO_MATCH_ENVRCPT_SOME(0.00)[]; DKIM_TRACE(0.00)[siemens.com:+] X-Rspamd-Queue-Id: 4VYX6s5MZwz4YQ6 Replying to myself (just for the records)... I have digged further into this: It has nothing to do with autofs -- autofs only reveals the problem since g_eli_ctl_attach() is called (again!) during the ls (which does the mount actually). The problem appears if we call g_eli_ctl_attach() twice. For details see https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=278828 On Sun, 05-May-2024 at 19:10:58 +0200, Andre Albsmeier wrote: > Before opening a PR, let's see if I'm doing something bad here (shouldn't > be that bad as it worked on FreeBSD-12 :-)). > > I can reliably crash 14-STABLE by running "geli attach" from an automountd > executable map if > > a) there is no other geli device in use > b) the mount is done r/w. > > To reproduce: > > 0. Prerequisite: > ---------------- > > We assume there is a working autofs environment and /etc/auto_master is the > master map. The must be no geli device in use. > > > 1. Do this once: > ---------------- > > cat << EOF > /etc/autocrash > #!/bin/sh > > case "x\$1" in > > xno_geli) > exec echo "-fstype=ufs,noatime,async :/dev/md0.eli" > ;; > > xgeli_ro) > geli attach -k /bin/ls -p /dev/md0 > exec echo "-fstype=ufs,noatime,async,ro :/dev/md0.eli" > ;; > > xgeli_rw) > geli attach -k /bin/ls -p /dev/md0 > exec echo "-fstype=ufs,noatime,async :/dev/md0.eli" > ;; > > esac > EOF > > chmod 755 /etc/autocrash > > echo "/autocrash autocrash" >> /etc/auto_master > > automount > > > 2. Do this each time you want to crash the box: > ----------------------------------------------- > > kldload geom_eli.ko > > dd if=/dev/zero of=/tmp/testcrash bs=64k count=160 > mdconfig -a -t vnode -f /tmp/testcrash > geli init -P -K /bin/ls /dev/md0 > geli attach -k /bin/ls -p /dev/md0 > newfs /dev/md0.eli > > # this works w/o crashing (as md0.eli is still attached) > cd /autocrash/no_geli ; ls -la > cd / && umount /autocrash/no_geli > geli detach /dev/md0 > > # crash it: > cd /autocrash/geli_rw > ls -la > > # this also works w/o crashing (as we mount it readonly) > cd /autocrash/geli_ro ; ls -la > cd / && umount /autocrash/geli_ro > geli detach /dev/md0 > > > > For some reasons, the box crashes when "geli attach" is executed from within > the /etc/autocrash script. It does not crash when we attach it before and do > only the mount from /etc/autocrash. It also does not crash if there is at > least one more geli device in use. > > Debugging the crash gives us this: > > Fatal trap 12: page fault while in kernel mode > cpuid = 1; apic id = 01 > fault virtual address = 0x218 > fault code = supervisor read data, page not present > instruction pointer = 0x20:0xffffffff8071a20a > stack pointer = 0x28:0xfffffe00743d5da0 > frame pointer = 0x28:0xfffffe00743d5dd0 > code segment = base 0x0, limit 0xfffff, type 0x1b > = DPL 0, pres 1, long 1, def32 0, gran 1 > processor eflags = interrupt enabled, resume, IOPL = 0 > current process = 1246 (g_eli[1] md0) > rdi: 0000000000000000 rsi: 0000000000000200 rdx: 0000000000000001 > rcx: 0000000000000080 r8: 0000000000000001 r9: 0000000000010000 > rax: fffff80006da5000 rbx: fffff800063904b0 rbp: fffffe00743d5dd0 > r10: 0000000000000001 r11: 0000000000010000 r12: 0000000000000200 > r13: 0000000000000008 r14: 0000000000000000 r15: 0000000000000000 > trap number = 12 > panic: page fault > cpuid = 1 > time = 1714666291 > KDB: stack backtrace: > db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe00743d5b80 > vpanic() at vpanic+0xfa/frame 0xfffffe00743d5bb0 > panic() at panic+0x43/frame 0xfffffe00743d5c10 > trap_fatal() at trap_fatal+0x40c/frame 0xfffffe00743d5c70 > trap_pfault() at trap_pfault+0xab/frame 0xfffffe00743d5cd0 > calltrap() at calltrap+0x8/frame 0xfffffe00743d5cd0 > --- trap 0xc, rip = 0xffffffff8071a20a, rsp = 0xfffffe00743d5da0, rbp = 0xfffffe00743d5dd0 --- > uma_zalloc_arg() at uma_zalloc_arg+0x3a/frame 0xfffffe00743d5dd0 > g_eli_alloc_data() at g_eli_alloc_data+0x49/frame 0xfffffe00743d5df0 > g_eli_crypto_run() at g_eli_crypto_run+0x97/frame 0xfffffe00743d5e90 > g_eli_worker() at g_eli_worker+0x369/frame 0xfffffe00743d5ef0 > fork_exit() at fork_exit+0x82/frame 0xfffffe00743d5f30 > fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00743d5f30 > --- trap 0, rip = 0, rsp = 0, rbp = 0 --- > Uptime: 31s > Dumping 212 out of 3438 MB:..8%..16%..23%..31%..46%..53%..61%..76%..83%..91 > __curthread () at /src/src-14/sys/amd64/include/pcpu_aux.h:57 > 57 __asm("movq %%gs:%P1,%0" : "=r" (td) : "n" (offsetof(struct pcpu, > (kgdb) where > #0 __curthread () at /src/src-14/sys/amd64/include/pcpu_aux.h:57 > #1 doadump (textdump=textdump@entry=1) at /src/src-14/sys/kern/kern_shutdown.c:405 > #2 0xffffffff804f4e40 in kern_reboot (howto=260) at /src/src-14/sys/kern/kern_shutdown.c:523 > #3 0xffffffff804f5307 in vpanic (fmt=0xffffffff8081968d "%s", ap=ap@entry=0xfffffe00743d5bf0) at /src/src-14/sys/kern/kern_shutdown.c:967 > #4 0xffffffff804f50e3 in panic (fmt=) at /src/src-14/sys/kern/kern_shutdown.c:891 > #5 0xffffffff807b0d7c in trap_fatal (frame=0xfffffe00743d5ce0, eva=536) at /src/src-14/sys/amd64/amd64/trap.c:952 > #6 0xffffffff807b0e2b in trap_pfault (frame=0xfffffe00743d5ce0, usermode=false, signo=, ucode=0x0) > at /src/src-14/sys/amd64/amd64/trap.c:760 > #7 > #8 uma_zalloc_arg (zone=0x0, udata=udata@entry=0x0, flags=1) at /src/src-14/sys/vm/uma_core.c:3738 > #9 0xffffffff8045a7b9 in uma_zalloc (zone=0x0, zone@entry=0xfffff800063904b0, flags=1) at /src/src-14/sys/vm/uma.h:367 > #10 g_eli_alloc_data (bp=bp@entry=0xfffff800063904b0, sz=4096) at /src/src-14/sys/geom/eli/g_eli.c:958 > #11 0xffffffff80463c27 in g_eli_crypto_run (wr=wr@entry=0xfffff800068c4880, bp=bp@entry=0xfffff800063904b0) > at /src/src-14/sys/geom/eli/g_eli_privacy.c:282 > #12 0xffffffff8045c6a9 in g_eli_worker (arg=arg@entry=0xfffff800068c4880) at /src/src-14/sys/geom/eli/g_eli.c:752 > #13 0xffffffff804b6b02 in fork_exit (callout=0xffffffff8045c340 , arg=0xfffff800068c4880, frame=0xfffffe00743d5f40) > at /src/src-14/sys/kern/kern_fork.c:1159 > #14 > (kgdb) up 10 > #10 g_eli_alloc_data (bp=bp@entry=0xfffff800063904b0, sz=4096) at /src/src-14/sys/geom/eli/g_eli.c:958 > 958 bp->bio_driver2 = uma_zalloc(g_eli_uma, M_NOWAIT | > (kgdb) p g_eli_uma > $1 = (uma_zone_t) 0x0 > (kgdb) > > g_eli_uma being NULL is probably wrong. Probably it got free'ed but shouldn't > or some initialisation is missing. But why is it NULL when called from > /etc/autocrash and not when run manually or if another geli device already > exists? From nobody Tue May 7 19:54:45 2024 X-Original-To: freebsd-stable@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4VYpsH1q5Sz5JY6B for ; Tue, 07 May 2024 19:54:59 +0000 (UTC) (envelope-from rick.macklem@gmail.com) Received: from mail-pf1-x42c.google.com (mail-pf1-x42c.google.com [IPv6:2607:f8b0:4864:20::42c]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "GTS CA 1D4" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4VYpsG3x1Kz4yKv for ; Tue, 7 May 2024 19:54:58 +0000 (UTC) (envelope-from rick.macklem@gmail.com) Authentication-Results: mx1.freebsd.org; dkim=pass header.d=gmail.com header.s=20230601 header.b=LMqvQUBN; dmarc=pass (policy=none) header.from=gmail.com; spf=pass (mx1.freebsd.org: domain of rick.macklem@gmail.com designates 2607:f8b0:4864:20::42c as permitted sender) smtp.mailfrom=rick.macklem@gmail.com Received: by mail-pf1-x42c.google.com with SMTP id d2e1a72fcca58-6f44881ad9eso2868953b3a.3 for ; Tue, 07 May 2024 12:54:58 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20230601; t=1715111697; x=1715716497; darn=freebsd.org; h=to:subject:message-id:date:from:mime-version:from:to:cc:subject :date:message-id:reply-to; bh=RcQuBmg66kjxWUklbvctRXTkeUblvkmD9MtpiZwqHNk=; b=LMqvQUBN3Ms0oTbWywhGLgvTV0tBaWQSyAuSYNgnknJgwzDDa8mP79Rth1VNKd/Fyq JnVVWBFI5iEjWCuLB83ym8+W/cbUkmOuthcJ94YjceuTJRaZdAzC+WOr12m3tqoq6Z8/ p7lO2/wdFuT/bnS1FXxUCR7YLQr1n5o9E24ljBehyJzBCNd6GN30rH22NWKl0GpbvP6C 6BnWEWXOXtPEDxxjKGARVRVZj11/Bsv4bZis1v/X9txD98iwMH5CvyaUoWWnrkr4mYRS JtzpdxoUp7UCuOGHPw+cQTJyZ9+5hIE+UqMT0hEMpaMj1sxofNrzh0GQsO+lFuR0UHpC 1qCQ== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20230601; t=1715111697; x=1715716497; h=to:subject:message-id:date:from:mime-version:x-gm-message-state :from:to:cc:subject:date:message-id:reply-to; bh=RcQuBmg66kjxWUklbvctRXTkeUblvkmD9MtpiZwqHNk=; b=pG3GQxaaTkcl6t9sgESLbB1ui/sJVTl65b7raoz5gFX5Dvp42ErrwLPL25Xfuqs6r/ HmqbvQeK06olbpvUa9mqWXDN2VEbADJkI5AgnTlALYPErJfFnTqQItvPnDRkpRWbxn6w lcnlbwFATb7qfzTGu4s9hkX1iyIjlTbiApseledbDPo1AZEZD9PC2Id9WKWEFcI+Ko9J 3hFQ1+6gwCjBWZNRMwX+K+egByE3uqCb+N9wr7+JUHQUkewYch2eU2MI3LSQcViEcmz2 DhA5rucRLbTXJUZXQAiaDydaupKj6MAGTPs6X5NqIBo7xXevu4O6Df9WeK+PxbG0ERiQ oHxw== X-Gm-Message-State: AOJu0YzLla72ZaB9Ft1LpOinJVZ20M3z1gu5LrP18FTEnYllnmrU1eLi oSrL4aIWQ3spuUIivmxIJjvRqAUxQwMxro4kFpN64gTqv9sE//CscKWA82uX4nvkN30dbf9SAzs 7atAklG5aKExEBXekDVgEqD+WO0Xl X-Google-Smtp-Source: AGHT+IHqwNh1FNWJkiH68JRrwgcBT9vdFR+FiopVEJw4RtPGEdAeu2OkelEYMnWvEyCnC+STM7Pq0NNx+G90FyzPY6s= X-Received: by 2002:a05:6a00:1387:b0:6ea:d7b6:f4b4 with SMTP id d2e1a72fcca58-6f49c292487mr812632b3a.21.1715111697015; Tue, 07 May 2024 12:54:57 -0700 (PDT) List-Id: Production branch of FreeBSD source code List-Archive: https://lists.freebsd.org/archives/freebsd-stable List-Help: List-Post: List-Subscribe: List-Unsubscribe: X-BeenThere: freebsd-stable@freebsd.org Sender: owner-freebsd-stable@FreeBSD.org MIME-Version: 1.0 From: Rick Macklem Date: Tue, 7 May 2024 12:54:45 -0700 Message-ID: Subject: Warning: do not enable NFSv4 delegations for a 13.3 NFS server To: freebsd-stable@freebsd.org Content-Type: text/plain; charset="UTF-8" X-Spamd-Bar: --- X-Spamd-Result: default: False [-3.95 / 15.00]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; NEURAL_HAM_LONG(-1.00)[-0.999]; NEURAL_HAM_SHORT(-0.95)[-0.948]; DMARC_POLICY_ALLOW(-0.50)[gmail.com,none]; R_SPF_ALLOW(-0.20)[+ip6:2607:f8b0:4000::/36]; R_DKIM_ALLOW(-0.20)[gmail.com:s=20230601]; MIME_GOOD(-0.10)[text/plain]; RCVD_TLS_LAST(0.00)[]; TO_MATCH_ENVRCPT_ALL(0.00)[]; ARC_NA(0.00)[]; RCPT_COUNT_ONE(0.00)[1]; FREEMAIL_ENVFROM(0.00)[gmail.com]; TAGGED_FROM(0.00)[]; FREEMAIL_FROM(0.00)[gmail.com]; MIME_TRACE(0.00)[0:+]; FROM_HAS_DN(0.00)[]; MISSING_XM_UA(0.00)[]; DWL_DNSWL_NONE(0.00)[gmail.com:dkim]; PREVIOUSLY_DELIVERED(0.00)[freebsd-stable@freebsd.org]; TO_DN_NONE(0.00)[]; FROM_EQ_ENVFROM(0.00)[]; DKIM_TRACE(0.00)[gmail.com:+]; MID_RHS_MATCH_FROMTLD(0.00)[]; ASN(0.00)[asn:15169, ipnet:2607:f8b0::/32, country:US]; MLMMJ_DEST(0.00)[freebsd-stable@freebsd.org]; RCVD_COUNT_ONE(0.00)[1]; RCVD_IN_DNSWL_NONE(0.00)[2607:f8b0:4864:20::42c:from] X-Rspamd-Queue-Id: 4VYpsG3x1Kz4yKv Hi, I boned up and, when wireshark reported that a NFSv4 packet was incorrectly constructed, I changed the NFSv4 code the "fix" the problem. I found out recently (at a IETF NFSv4 testing event) that wireshark was buggy and the code was actually broken by the "fix". I have now corrected this in main, stable/14 and stable/13. (Commit 54c3aa02e926 in main.) However, FreeBSD 13.3 shipped with this broken. The bug only affects the NFSv4 server if delegations are enabled, which is not the default. As such, so long as "vfs.nfsd.issue_delegations == 0". you should be fine. rick ps: Since few enable delegations, I do not feel this needs an errata for FreeBSD 13.3. . From nobody Wed May 8 12:54:52 2024 X-Original-To: stable@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4VZFVK1n8sz5J4ff for ; Wed, 08 May 2024 12:55:05 +0000 (UTC) (envelope-from mike@sentex.net) Received: from smarthost1.sentex.ca (smarthost1.sentex.ca [IPv6:2607:f3e0:0:1::12]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smarthost1.sentex.ca", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4VZFVJ1SsJz4NsN for ; Wed, 8 May 2024 12:55:04 +0000 (UTC) (envelope-from mike@sentex.net) Authentication-Results: mx1.freebsd.org; dkim=none; dmarc=none; spf=pass (mx1.freebsd.org: domain of mike@sentex.net designates 2607:f3e0:0:1::12 as permitted sender) smtp.mailfrom=mike@sentex.net Received: from pyroxene2a.sentex.ca (pyroxene19.sentex.ca [199.212.134.19]) by smarthost1.sentex.ca (8.17.1/8.16.1) with ESMTPS id 448CsuUK074176 (version=TLSv1.3 cipher=TLS_AES_256_GCM_SHA384 bits=256 verify=FAIL); Wed, 8 May 2024 08:54:56 -0400 (EDT) (envelope-from mike@sentex.net) Received: from [IPV6:2607:f3e0:0:4:847a:c543:8f4:d9fd] ([IPv6:2607:f3e0:0:4:847a:c543:8f4:d9fd]) by pyroxene2a.sentex.ca (8.18.1/8.15.2) with ESMTPS id 448CsqYM004329 (version=TLSv1.3 cipher=TLS_AES_128_GCM_SHA256 bits=128 verify=NO); Wed, 8 May 2024 08:54:55 -0400 (EDT) (envelope-from mike@sentex.net) Content-Type: multipart/alternative; boundary="------------eLPL2RN0VjwmH2GZki0qyOfy" Message-ID: <6e959ce7-b6f5-4776-99f6-df1c161b666d@sentex.net> Date: Wed, 8 May 2024 08:54:52 -0400 List-Id: Production branch of FreeBSD source code List-Archive: https://lists.freebsd.org/archives/freebsd-stable List-Help: List-Post: List-Subscribe: List-Unsubscribe: X-BeenThere: freebsd-stable@freebsd.org Sender: owner-freebsd-stable@FreeBSD.org MIME-Version: 1.0 User-Agent: Mozilla Thunderbird Subject: Re: how to tell if TRIM is working To: Warner Losh Cc: Matthew Grooms , stable@freebsd.org References: <5e1b5097-c1c0-4740-a491-63c709d01c25@sentex.net> <67721332-fa1d-4b3c-aa57-64594ad5d77a@shrew.net> <77e203b3-c555-408b-9634-c452cb3a57ac@sentex.net> Content-Language: en-US From: mike tancsa Autocrypt: addr=mike@sentex.net; keydata= xsBNBFywzOMBCACoNFpwi5MeyEREiCeHtbm6pZJI/HnO+wXdCAWtZkS49weOoVyUj5BEXRZP xflV2ib2hflX4nXqhenaNiia4iaZ9ft3I1ebd7GEbGnsWCvAnob5MvDZyStDAuRxPJK1ya/s +6rOvr+eQiXYNVvfBhrCfrtR/esSkitBGxhUkBjOti8QwzD71JVF5YaOjBAs7jZUKyLGj0kW yDg4jUndudWU7G2yc9GwpHJ9aRSUN8e/mWdIogK0v+QBHfv/dsI6zVB7YuxCC9Fx8WPwfhDH VZC4kdYCQWKXrm7yb4TiVdBh5kgvlO9q3js1yYdfR1x8mjK2bH2RSv4bV3zkNmsDCIxjABEB AAHNHW1pa2UgdGFuY3NhIDxtaWtlQHNlbnRleC5uZXQ+wsCOBBMBCAA4FiEEmuvCXT0aY6hs 4SbWeVOEFl5WrMgFAl+pQfkCGwMFCwkIBwIGFQoJCAsCBBYCAwECHgECF4AACgkQeVOEFl5W rMiN6ggAk3H5vk8QnbvGbb4sinxZt/wDetgk0AOR9NRmtTnPaW+sIJEfGBOz47Xih+f7uWJS j+uvc9Ewn2Z7n8z3ZHJlLAByLVLtcNXGoRIGJ27tevfOaNqgJHBPbFOcXCBBFTx4MYMM4iAZ cDT5vsBTSaM36JZFtHZBKkuFEItbA/N8ZQSHKdTYMIA7A3OCLGbJBqloQ8SlW4MkTzKX4u7R yefAYQ0h20x9IqC5Ju8IsYRFacVZconT16KS81IBceO42vXTN0VexbVF2rZIx3v/NT75r6Vw 0FlXVB1lXOHKydRA2NeleS4NEG2vWqy/9Boj0itMfNDlOhkrA/0DcCurMpnpbM7ATQRcsMzk AQgA1Dpo/xWS66MaOJLwA28sKNMwkEk1Yjs+okOXDOu1F+0qvgE8sVmrOOPvvWr4axtKRSG1 t2QUiZ/ZkW/x/+t0nrM39EANV1VncuQZ1ceIiwTJFqGZQ8kb0+BNkwuNVFHRgXm1qzAJweEt RdsCMohB+H7BL5LGCVG5JaU0lqFU9pFP40HxEbyzxjsZgSE8LwkI6wcu0BLv6K6cLm0EiHPO l5G8kgRi38PS7/6s3R8QDsEtbGsYy6O82k3zSLIjuDBwA9GRaeigGppTxzAHVjf5o9KKu4O7 gC2KKVHPegbXS+GK7DU0fjzX57H5bZ6komE5eY4p3oWT/CwVPSGfPs8jOwARAQABwsB2BBgB CAAgFiEEmuvCXT0aY6hs4SbWeVOEFl5WrMgFAl+pQfkCGwwACgkQeVOEFl5WrMiVqwf9GwU8 c6cylknZX8QwlsVudTC8xr/L17JA84wf03k3d4wxP7bqy5AYy7jboZMbgWXngAE/HPQU95NM aukysSnknzoIpC96XZJ0okLBXVS6Y0ylZQ+HrbIhMpuQPoDweoF5F9wKrsHRoDaUK1VR706X rwm4HUzh7Jk+auuMYfuCh0FVlFBEuiJWMLhg/5WCmcRfiuB6F59ZcUQrwLEZeNhF2XJV4KwB Tlg7HCWO/sy1foE5noaMyACjAtAQE9p5kGYaj+DuRhPdWUTsHNuqrhikzIZd2rrcMid+ktb0 NvtvswzMO059z1YGMtGSqQ4srCArju+XHIdTFdiIYbd7+jeehg== In-Reply-To: X-Scanned-By: MIMEDefang 2.86 X-Spamd-Bar: --- X-Spamd-Result: default: False [-3.36 / 15.00]; NEURAL_HAM_LONG(-1.00)[-1.000]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; NEURAL_HAM_SHORT(-0.97)[-0.971]; R_SPF_ALLOW(-0.20)[+ip6:2607:f3e0::/32]; RCVD_IN_DNSWL_LOW(-0.10)[199.212.134.19:received]; MIME_GOOD(-0.10)[multipart/alternative,text/plain]; XM_UA_NO_VERSION(0.01)[]; ARC_NA(0.00)[]; TO_DN_SOME(0.00)[]; ASN(0.00)[asn:11647, ipnet:2607:f3e0::/32, country:CA]; MIME_TRACE(0.00)[0:+,1:+,2:~]; FREEFALL_USER(0.00)[mike]; RCVD_TLS_ALL(0.00)[]; MLMMJ_DEST(0.00)[stable@freebsd.org]; R_DKIM_NA(0.00)[]; FROM_EQ_ENVFROM(0.00)[]; FROM_HAS_DN(0.00)[]; MID_RHS_MATCH_FROM(0.00)[]; RCVD_COUNT_TWO(0.00)[2]; DMARC_NA(0.00)[sentex.net]; TO_MATCH_ENVRCPT_SOME(0.00)[]; RCPT_COUNT_THREE(0.00)[3] X-Rspamd-Queue-Id: 4VZFVJ1SsJz4NsN This is a multi-part message in MIME format. --------------eLPL2RN0VjwmH2GZki0qyOfy Content-Type: text/plain; charset=UTF-8; format=flowed Content-Transfer-Encoding: 8bit On 5/2/2024 10:34 AM, Warner Losh wrote: > > > On Thu, May 2, 2024 at 8:19 AM mike tancsa wrote: > > On 5/2/2024 10:16 AM, Warner Losh wrote: >> >> When trims are fast, you want to send them to the drive as soon >> as you >> know the blocks are freed. UFS always does this (if trim is >> enabled at all). >> ZFS has a lot of knobs to control when / how / if this is done. >> >> vfs.zfs.vdev.trim_min_active: 1 >> vfs.zfs.vdev.trim_max_active: 2 >> vfs.zfs.trim.queue_limit: 10 >> vfs.zfs.trim.txg_batch: 32 >> vfs.zfs.trim.metaslab_skip: 0 >> vfs.zfs.trim.extent_bytes_min: 32768 >> vfs.zfs.trim.extent_bytes_max: 134217728 >> vfs.zfs.l2arc.trim_ahead: 0 >> >> I've not tried to tune these in the past, but you can see how they affect things. >> > Thanks Warner, I will try and play around with these values to see > if they impact things.  BTW, do you know what / why things would > be "skipped" during trim events ? > > kstat.zfs.zrootoffs.misc.iostats.trim_bytes_failed: 0 > kstat.zfs.zrootoffs.misc.iostats.trim_extents_failed: 0 > kstat.zfs.zrootoffs.misc.iostats.trim_bytes_skipped: 5968330752 > kstat.zfs.zrootoffs.misc.iostats.trim_extents_skipped: 503986 > kstat.zfs.zrootoffs.misc.iostats.trim_bytes_written: 181593186304 > kstat.zfs.zrootoffs.misc.iostats.trim_extents_written: 303115 > > > A quick look at the code suggests that it is when the extent to be > trimmed is smaller than the extent_bytes_min parameter. > > The minimum seems to be a trade off between too many trims to the > drive and making sure that the trims that you do send are maximally > effective. By specifying a smaller size, you'll be freeing up more > holes in the underlying NAND blocks. In some drives, this triggers > more data copying (and more write amp), so you want to set it a bit > higher for those. In other drivers, it improves the efficiency of the > GC algorithm, allowing each underlying block groomed to recover more > space for future writes. In the past, I've found that ZFS' defaults > are decent for 2018ish level of SATA SSDs, but a bit too trim avoidy > for newer nvme drives, even the cheap consumer ones. Though that's > just a coarse generalization from my buildworld workload. Other work > loads will have other data patterns, ymmv, so you need to measure it. > OK some updates.  Since a new version of zfs was MFC'd into RELENG14 I thought I would try again. And to my pleasant surprise, it is working *really* well.  My test of zfs send ${a} | zfs recv ${a}2  | zfs destroy ${a}2,  followed by a zpool -w trim where ${a}= a ~ 300G dataset with millions of files of various sizes, is now very predictable over the course of a dozen loops. Previously, this would start to slow down by a factor of 3 or 4 after 3 iterations which corresponded roughly to the 1TB sized drives. zfs-2.2.4-FreeBSD_g256659204 zfs-kmod-2.2.4-FreeBSD_g256659204 FreeBSD r-14mfitest 14.1-STABLE FreeBSD 14.1-STABLE stable/14-45764d1d4 GENERIC amd64 same hardware as before, same zfs datasets.  One thing that did seems to change and I am not sure if thats an issue or not is that I had booted TruNas' Linux variant to run the tests which also worked as expected.  But looking at zpool history I dont see anything obvious that would change the behaviour when I re-ran the tests. zpool history shows 2024-04-25.10:16:35 zpool export quirk-test 2024-04-25.10:16:48 zpool import quirk-test 2024-04-26.11:44:25 zpool export quirk-test 2024-04-26.13:11:18 py-libzfs: zpool import 13273111966766428207 quirk-test 2024-04-26.13:11:22 py-libzfs: zfs inherit -r quirk-test/junk 2024-04-26.13:11:23 py-libzfs: zfs inherit -r quirk-test/bull1 2024-04-26.13:11:27 py-libzfs: zfs create -o mountpoint=legacy -o readonly=off -o snapdir=hidden -o xattr=sa quirk-test/.system 2024-04-26.13:11:27 py-libzfs: zfs create -o mountpoint=legacy -o readonly=off -o snapdir=hidden -o quota=1G -o xattr=sa quirk-test/.system/cores 2024-04-26.13:11:27 py-libzfs: zfs create -o mountpoint=legacy -o readonly=off -o snapdir=hidden -o xattr=sa quirk-test/.system/samba4 2024-04-26.13:11:27 py-libzfs: zfs create -o mountpoint=legacy -o readonly=off -o snapdir=hidden -o xattr=sa quirk-test/.system/configs-ae32c386e13840b2bf9c0083275e7941 2024-04-26.13:11:27 py-libzfs: zfs create -o mountpoint=legacy -o readonly=off -o snapdir=hidden -o xattr=sa quirk-test/.system/netdata-ae32c386e13840b2bf9c0083275e7941 2024-04-26.13:22:10 zfs snapshot quirk-test/bull1@snap1 Nothing else seems to have been done to the pool params.  I tried the tests with the defaults of vfs.zfs.trim.extent_bytes_min as well with it divided by 2 but that didnt seems to make any difference.  I have a stack of fresh WD 1 and 2TB blue SSDs that I might pop into the test box later this week and see if all is still good in case Linux did something to these disks although the output of camcontrol identify doesnt show any difference prior to the import/export so nothing seems to have changed with the drives.     ---Mike --------------eLPL2RN0VjwmH2GZki0qyOfy Content-Type: text/html; charset=UTF-8 Content-Transfer-Encoding: 8bit
On 5/2/2024 10:34 AM, Warner Losh wrote:


On Thu, May 2, 2024 at 8:19 AM mike tancsa <mike@sentex.net> wrote:
On 5/2/2024 10:16 AM, Warner Losh wrote:

When trims are fast, you want to send them to the drive as soon as you
know the blocks are freed. UFS always does this (if trim is enabled at all).
ZFS has a lot of knobs to control when / how / if this is done.

vfs.zfs.vdev.trim_min_active: 1
vfs.zfs.vdev.trim_max_active: 2
vfs.zfs.trim.queue_limit: 10
vfs.zfs.trim.txg_batch: 32
vfs.zfs.trim.metaslab_skip: 0
vfs.zfs.trim.extent_bytes_min: 32768
vfs.zfs.trim.extent_bytes_max: 134217728
vfs.zfs.l2arc.trim_ahead: 0


I've not tried to tune these in the past, but you can see how they affect things.

Thanks Warner, I will try and play around with these values to see if they impact things.  BTW, do you know what / why things would be "skipped" during trim events ?

kstat.zfs.zrootoffs.misc.iostats.trim_bytes_failed: 0
kstat.zfs.zrootoffs.misc.iostats.trim_extents_failed: 0
kstat.zfs.zrootoffs.misc.iostats.trim_bytes_skipped: 5968330752
kstat.zfs.zrootoffs.misc.iostats.trim_extents_skipped: 503986
kstat.zfs.zrootoffs.misc.iostats.trim_bytes_written: 181593186304
kstat.zfs.zrootoffs.misc.iostats.trim_extents_written: 303115


A quick look at the code suggests that it is when the extent to be trimmed is smaller than the extent_bytes_min parameter.

The minimum seems to be a trade off between too many trims to the drive and making sure that the trims that you do send are maximally effective. By specifying a smaller size, you'll be freeing up more holes in the underlying NAND blocks. In some drives, this triggers more data copying (and more write amp), so you want to set it a bit higher for those. In other drivers, it improves the efficiency of the GC algorithm, allowing each underlying block groomed to recover more space for future writes. In the past, I've found that ZFS' defaults are decent for 2018ish level of SATA SSDs, but a bit too trim avoidy for newer nvme drives, even the cheap consumer ones. Though that's just a coarse generalization from my buildworld workload. Other work loads will have other data patterns, ymmv, so you need to measure it.

OK some updates.  Since a new version of zfs was MFC'd into RELENG14 I thought I would try again. And to my pleasant surprise, it is working *really* well.  My test of zfs send ${a} | zfs recv ${a}2  | zfs destroy ${a}2,  followed by a zpool -w trim where ${a}= a ~ 300G dataset with millions of files of various sizes, is now very predictable over the course of a dozen loops.  Previously, this would start to slow down by a factor of 3 or 4 after 3 iterations which corresponded roughly to the 1TB sized drives.


zfs-2.2.4-FreeBSD_g256659204
zfs-kmod-2.2.4-FreeBSD_g256659204

FreeBSD r-14mfitest 14.1-STABLE FreeBSD 14.1-STABLE stable/14-45764d1d4 GENERIC amd64

same hardware as before, same zfs datasets.  One thing that did seems to change and I am not sure if thats an issue or not is that I had booted TruNas' Linux variant to run the tests which also worked as expected.  But looking at zpool history I dont see anything obvious that would change the behaviour when I re-ran the tests. zpool history shows

2024-04-25.10:16:35 zpool export quirk-test
2024-04-25.10:16:48 zpool import quirk-test
2024-04-26.11:44:25 zpool export quirk-test
2024-04-26.13:11:18 py-libzfs: zpool import 13273111966766428207  quirk-test
2024-04-26.13:11:22 py-libzfs: zfs inherit -r quirk-test/junk
2024-04-26.13:11:23 py-libzfs: zfs inherit -r quirk-test/bull1
2024-04-26.13:11:27 py-libzfs: zfs create -o mountpoint=legacy -o readonly=off -o snapdir=hidden -o xattr=sa quirk-test/.system
2024-04-26.13:11:27 py-libzfs: zfs create -o mountpoint=legacy -o readonly=off -o snapdir=hidden -o quota=1G -o xattr=sa quirk-test/.system/cores
2024-04-26.13:11:27 py-libzfs: zfs create -o mountpoint=legacy -o readonly=off -o snapdir=hidden -o xattr=sa quirk-test/.system/samba4
2024-04-26.13:11:27 py-libzfs: zfs create -o mountpoint=legacy -o readonly=off -o snapdir=hidden -o xattr=sa quirk-test/.system/configs-ae32c386e13840b2bf9c0083275e7941
2024-04-26.13:11:27 py-libzfs: zfs create -o mountpoint=legacy -o readonly=off -o snapdir=hidden -o xattr=sa quirk-test/.system/netdata-ae32c386e13840b2bf9c0083275e7941
2024-04-26.13:22:10 zfs snapshot quirk-test/bull1@snap1

Nothing else seems to have been done to the pool params.  I tried the tests with the defaults of vfs.zfs.trim.extent_bytes_min as well with it divided by 2 but that didnt seems to make any difference.  I have a stack of fresh WD 1 and 2TB blue SSDs that I might pop into the test box later this week and see if all is still good in case Linux did something to these disks although the output of camcontrol identify doesnt show any difference prior to the import/export so nothing seems to have changed with the drives.

    ---Mike




--------------eLPL2RN0VjwmH2GZki0qyOfy-- From nobody Fri May 10 02:53:55 2024 X-Original-To: freebsd-stable@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4VbD403C67z5Kcjr for ; Fri, 10 May 2024 02:54:08 +0000 (UTC) (envelope-from ota@j.email.ne.jp) Received: from hsmtpd-fgn.xspmail.jp (hsmtpd-fgn.xspmail.jp [210.130.137.25]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4VbD3x3FMjz4WBD for ; Fri, 10 May 2024 02:54:04 +0000 (UTC) (envelope-from ota@j.email.ne.jp) Authentication-Results: mx1.freebsd.org; dkim=pass header.d=j.email.ne.jp header.s=x01 header.b=0kBnAEyc; dmarc=pass (policy=none) header.from=j.email.ne.jp; spf=pass (mx1.freebsd.org: domain of ota@j.email.ne.jp designates 210.130.137.25 as permitted sender) smtp.mailfrom=ota@j.email.ne.jp DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; t=1715309636; d=j.email.ne.jp; s=x01; i=ota@j.email.ne.jp; h=content-transfer-encoding:content-type:mime-version:message-id:subject:to: from:date:from; bh=M2KJuf3XZsQC4xjYEhGv3hJRtBJcZ0CO573bAIq/cf4=; b=0kBnAEycgWqvxGnfSA8/cSMLp1H7BMnWznGl//WMTWgWCc1wilp72qdq0b5qTRr009uyU5zbJAIRg kuKp646WHLJNXQC4wOtnYY/K3CyGZ7Yaek9Oh9BWESwAj5RJerqB9wGZCtcriA++zAcZvLsxeE+7+O sNVyySSkibZjeNFZWe8DBfeFbNWJqgyCCzgihS5xfwwt7YKu5y8juLrp1qRsbozi1An+JfyuI5PO95 rrKgY7Vo6lM2Bwox1vcZ82eH77Ch3yevuN9RiPbzYvSB2+Q4cmqx2rkhe5R9iN+IeHhoqfAFaDUU24 5AxTbZSisyT4vDLVUeOQ/iTl5gybD9g== X-Country-Code: US Received: from a315-53.myfiosgateway.com (pool-173-63-93-67.nwrknj.fios.verizon.net [173.63.93.67]) by hsmtpd-out-1.asahinet.cluster.xspmail.jp (Halon) with ESMTPA id 36a64677-99c9-429b-81ac-974651bf6205; Fri, 10 May 2024 11:53:55 +0900 (JST) Date: Thu, 9 May 2024 22:53:55 -0400 From: Yoshihiro Ota To: freebsd-stable@FreeBSD.org Subject: 14.1-BETA arm64 kernel uses 100% CPU swapin'g after zpool import Message-Id: <20240509225355.50e8b6efd6935c6e83f553f3@j.email.ne.jp> X-Mailer: Sylpheed 3.7.0 (GTK+ 2.24.33; amd64-portbld-freebsd12.2) List-Id: Production branch of FreeBSD source code List-Archive: https://lists.freebsd.org/archives/freebsd-stable List-Help: List-Post: List-Subscribe: List-Unsubscribe: X-BeenThere: freebsd-stable@freebsd.org Sender: owner-freebsd-stable@FreeBSD.org Mime-Version: 1.0 Content-Type: text/plain; charset=US-ASCII Content-Transfer-Encoding: 7bit X-Spamd-Bar: --- X-Spamd-Result: default: False [-3.49 / 15.00]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; NEURAL_HAM_LONG(-1.00)[-1.000]; NEURAL_HAM_SHORT(-0.99)[-0.995]; MV_CASE(0.50)[]; DMARC_POLICY_ALLOW(-0.50)[j.email.ne.jp,none]; R_DKIM_ALLOW(-0.20)[j.email.ne.jp:s=x01]; R_SPF_ALLOW(-0.20)[+ip4:210.130.137.0/27]; MIME_GOOD(-0.10)[text/plain]; RCVD_VIA_SMTP_AUTH(0.00)[]; MIME_TRACE(0.00)[0:+]; ASN(0.00)[asn:2497, ipnet:210.130.0.0/16, country:JP]; RCVD_COUNT_ONE(0.00)[1]; RCPT_COUNT_ONE(0.00)[1]; MLMMJ_DEST(0.00)[freebsd-stable@freebsd.org]; ARC_NA(0.00)[]; FROM_EQ_ENVFROM(0.00)[]; FROM_HAS_DN(0.00)[]; MID_RHS_MATCH_FROM(0.00)[]; TO_DN_NONE(0.00)[]; RCVD_TLS_LAST(0.00)[]; TO_MATCH_ENVRCPT_ALL(0.00)[]; DKIM_TRACE(0.00)[j.email.ne.jp:+] X-Rspamd-Queue-Id: 4VbD3x3FMjz4WBD Hi, I'm posting here to get some attension to https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=278726 I've been testing 14.1-BETA/PRERELEASE. Short description: FreeBSD kernel uses 100% CPU with "swapin"g. It uses 100% CPU but no IOs occur. This happens with arm64 while amd64 works fine. Long description: I use zfs with an external device and only when needed. So, I don't have ENABLE_ZFS. After booting the system, system operates fine. After "zpool import ", kernel starts spining. "top" shows kernel is in "swapin" status. On the other hand, no disk activities are happening. "zpool expot " doesn't stop swapin activities Hiro From nobody Sat May 11 13:56:58 2024 X-Original-To: freebsd-stable@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4Vc6kZ4Wqlz5K9fC for ; Sat, 11 May 2024 13:57:10 +0000 (UTC) (envelope-from rosti.bsd@gmail.com) Received: from mail-vs1-xe32.google.com (mail-vs1-xe32.google.com [IPv6:2607:f8b0:4864:20::e32]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "GTS CA 1D4" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4Vc6kY72n5z4qTJ for ; Sat, 11 May 2024 13:57:09 +0000 (UTC) (envelope-from rosti.bsd@gmail.com) Authentication-Results: mx1.freebsd.org; dkim=pass header.d=gmail.com header.s=20230601 header.b=Nav5hCAt; dmarc=pass (policy=none) header.from=gmail.com; spf=pass (mx1.freebsd.org: domain of rosti.bsd@gmail.com designates 2607:f8b0:4864:20::e32 as permitted sender) smtp.mailfrom=rosti.bsd@gmail.com Received: by mail-vs1-xe32.google.com with SMTP id ada2fe7eead31-47f0e565a8bso245629137.3 for ; Sat, 11 May 2024 06:57:09 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20230601; t=1715435829; x=1716040629; darn=freebsd.org; h=to:subject:message-id:date:from:mime-version:from:to:cc:subject :date:message-id:reply-to; bh=MnuQY1luI9TIZ4AW6AORIuURxOn7J3Y7EdCIGVjGOfI=; b=Nav5hCAtOPnZ9uM7o7kkhHiZRp9p/Cqw35U/BfgtiLhQ+EbgXww8NaKsd6kQ1p5u1X LdI/dbr81BJCmgRoEgON21ZUIOtHQUwgOG2bsp4Y+xROmmIMgyHif/euuCAmJaBRf37T Op7M34onisMAH4mulcZBWyBPVHgclacAIetxWHIUb9YwG3q0fXojUYhEYLEzDKD/femW 4CeH8XrRt/RDO/GFC6Ivzjk61njjAP5pzkAbp2rTzA8P/cmiSGuYhkT4wPLGyAlvIQMz af5+9tl+KwA2aVaUsMF/HlKgOM8m7wogz2/fvH1xl6zgWcegISGxmrVyp7UWYWeTpmTV ZcsA== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20230601; t=1715435829; x=1716040629; h=to:subject:message-id:date:from:mime-version:x-gm-message-state :from:to:cc:subject:date:message-id:reply-to; bh=MnuQY1luI9TIZ4AW6AORIuURxOn7J3Y7EdCIGVjGOfI=; b=e2SXU9wciqhPk41cn2bfwaR6ZzcqClQucXYdXbbYTPdGkiTLSahiJVQpK3D7HedfOS PntAMAeMyFftviSAqyMRuBC6naiphGQlk99dRjJu3bHrOJaJ21gnpDQeICoNJUAuDrc2 kkXiT8D+dr2Z4B2dAWNT7I7zBqH/6MA4pqqpArqy1riff6VpkX5VOZRxRT2zMxR4bX/h PNR4PEwgDAZCXJD/GRlx8RtnHyXeH1aAfCZGcTmUXQDKBxmuoqdxvJTG4yeLI02R4Q+q vHgmuQbYzbYAndk+S7SGc9qfknSdYXRNVHNNUZ0AGG2uLJCo09hC4Nh2/Mq+aZdNqhgd nXfQ== X-Gm-Message-State: AOJu0YyWFOgYMPNQkxhKL2dQh+PwAj549bE9fOkcEIilaZ+1PfexGsQ4 wuGtPgwM0R5/xgmVbY3NqFsecybILizx43csNuYov7TANfx+29c1e5Kq0x7wtQhGIZXFO9DMHN6 shLCKmJN0q8IaU09my3pmlVA+Jy0d/PFe X-Google-Smtp-Source: AGHT+IFzRdL+F1PQd6dAKTccojcY8Gf/rVPNGCB9RcSjhyWpV/rRTSPrP05YUgpvMQUNEin5jFiMVYCEWfDBPdawva8= X-Received: by 2002:a67:c785:0:b0:47e:d83:3baa with SMTP id ada2fe7eead31-48077db29ddmr5449299137.1.1715435829055; Sat, 11 May 2024 06:57:09 -0700 (PDT) List-Id: Production branch of FreeBSD source code List-Archive: https://lists.freebsd.org/archives/freebsd-stable List-Help: List-Post: List-Subscribe: List-Unsubscribe: X-BeenThere: freebsd-stable@freebsd.org Sender: owner-freebsd-stable@FreeBSD.org MIME-Version: 1.0 From: Rostislav Krasny Date: Sat, 11 May 2024 16:56:58 +0300 Message-ID: Subject: [14.1-BETA2] Cannot run any Desktop Environment To: freebsd-stable Content-Type: text/plain; charset="UTF-8" X-Spamd-Bar: --- X-Spamd-Result: default: False [-3.96 / 15.00]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; NEURAL_HAM_LONG(-1.00)[-1.000]; NEURAL_HAM_SHORT(-0.96)[-0.962]; DMARC_POLICY_ALLOW(-0.50)[gmail.com,none]; R_DKIM_ALLOW(-0.20)[gmail.com:s=20230601]; R_SPF_ALLOW(-0.20)[+ip6:2607:f8b0:4000::/36:c]; MIME_GOOD(-0.10)[text/plain]; RCVD_TLS_LAST(0.00)[]; TO_MATCH_ENVRCPT_ALL(0.00)[]; RCPT_COUNT_ONE(0.00)[1]; FROM_HAS_DN(0.00)[]; MIME_TRACE(0.00)[0:+]; ARC_NA(0.00)[]; FREEMAIL_ENVFROM(0.00)[gmail.com]; FREEMAIL_FROM(0.00)[gmail.com]; TO_DN_ALL(0.00)[]; DKIM_TRACE(0.00)[gmail.com:+]; DWL_DNSWL_NONE(0.00)[gmail.com:dkim]; MID_RHS_MATCH_FROMTLD(0.00)[]; PREVIOUSLY_DELIVERED(0.00)[freebsd-stable@freebsd.org]; FROM_EQ_ENVFROM(0.00)[]; TAGGED_FROM(0.00)[]; MLMMJ_DEST(0.00)[freebsd-stable@freebsd.org]; RCVD_COUNT_ONE(0.00)[1]; ASN(0.00)[asn:15169, ipnet:2607:f8b0::/32, country:US]; MISSING_XM_UA(0.00)[]; RCVD_IN_DNSWL_NONE(0.00)[2607:f8b0:4864:20::e32:from] X-Rspamd-Queue-Id: 4Vc6kY72n5z4qTJ Hi, I wanted to try FreeBSD 14.1-BETA2 on my desktop computer and installed it from the official FreeBSD-14.1-BETA2-amd64-mini-memstick.img image file and network. The base system has been installed and seems to be working properly. Then I wanted to install some Desktop Environment and installed LXQT as described in the 8.2.6 section of the Handbook (but without setting the sddm_lang, since I'm fine with English). Then I installed xorg and drm-kmod, as described in the 5.2 and 5.3 sections of the Handbook. I have i7-4790 CPU with integrated graphics, From nobody Sat May 11 14:23:37 2024 X-Original-To: freebsd-stable@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4Vc7KN2bWLz5KD9Y for ; Sat, 11 May 2024 14:23:52 +0000 (UTC) (envelope-from rosti.bsd@gmail.com) Received: from mail-vs1-xe36.google.com (mail-vs1-xe36.google.com [IPv6:2607:f8b0:4864:20::e36]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "GTS CA 1D4" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4Vc7KM1y5vz4vHP for ; Sat, 11 May 2024 14:23:51 +0000 (UTC) (envelope-from rosti.bsd@gmail.com) Authentication-Results: mx1.freebsd.org; dkim=pass header.d=gmail.com header.s=20230601 header.b=Zr8JpAcU; dmarc=pass (policy=none) header.from=gmail.com; spf=pass (mx1.freebsd.org: domain of rosti.bsd@gmail.com designates 2607:f8b0:4864:20::e36 as permitted sender) smtp.mailfrom=rosti.bsd@gmail.com Received: by mail-vs1-xe36.google.com with SMTP id ada2fe7eead31-480808cb230so117324137.2 for ; Sat, 11 May 2024 07:23:51 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20230601; t=1715437430; x=1716042230; darn=freebsd.org; h=to:subject:message-id:date:from:in-reply-to:references:mime-version :from:to:cc:subject:date:message-id:reply-to; bh=tzT++ntmWz9B9DHRt6JTGA9ALmOiIXcMwEdJnFlD/lY=; b=Zr8JpAcUaIZIwEGhsR8ajirDVvnm/iTrEtaBEaJ4FHRT2v3JMmBuw/gSkuX8mq+cPX bbq+AdZrHNMj41v2L/2Wv5kEJAgLoUnASDyk56BA1PcJMOHwAfs5TogyXaiEV7di+724 g3eo3Wm78f4tgibqTLItZS6NP3I/0SHChoAd1Zz3Yep1p+O952VO+cx0k6VeSKUkbK+p HccSzBo0BZNmJ0RinNkVKFWTyJDekgwf4Yr3kR/iP0Z1PZbs4BNmQfp60NMbNg8PfNN/ /qbxfWaThb3s8+CompnAgcSkyeXmlfaU8iZNTGy47HpG2oRkQtQ5hbhW9ouMkYYgFeUv Q0Fg== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20230601; t=1715437430; x=1716042230; h=to:subject:message-id:date:from:in-reply-to:references:mime-version :x-gm-message-state:from:to:cc:subject:date:message-id:reply-to; bh=tzT++ntmWz9B9DHRt6JTGA9ALmOiIXcMwEdJnFlD/lY=; b=ou60viWOZ1c49f1OPmV2vr69SJGLnEq2RMT/8VlHjwgsxEtyZhF/xHFxY6YTeCVqb9 +6n+52gvSI+9h7U837YV+Iq5FpSR0h0eG9Uw9jq3jSLvYQlEMWts3re0tFw8w3y9qHpd OFv2H8E+wXIt1rVPPwxx+N9K/dMZ+CMpLir0vyMiNO7ru7PV9AsBMoFntVR1iVQjjfEn rP8CufzJXJck1937Ix4njyAKlqT4fXReWQrKn5AU/+8WCgyjVr15eKeEe4o22N93nZNd bxsfVCifpTHzMbPvBF/6rNXa3+qro6jw2LzCv0B7cefKz/ORq4JTI9dJDiYTsPKzexxh tqlQ== X-Gm-Message-State: AOJu0YyIBSKIAI+DZnNUyxWLwBYnL0vU92LmI8u7+L5eYdaKihEsAjbq x/Nrd0o/aJkz7Rub6omyS56w0Q+PtXMvaUAGS0TryMVhHv0WaIWmTLdtHy737H0agl4gA58/O0/ +DHP4x65upRgxvjnPKr+9rDD056uPL8xs X-Google-Smtp-Source: AGHT+IGJAPDK+M5uMe8z6a3JXNQe/yebZqvNVgpSEDsqIcKOMZqWfzwtTmjXkS0z/l2ztiWeSgxDVkYQNXoaVmcAHi4= X-Received: by 2002:a67:f88f:0:b0:47f:227:430b with SMTP id ada2fe7eead31-48077ce6ff9mr5777267137.0.1715437429609; Sat, 11 May 2024 07:23:49 -0700 (PDT) List-Id: Production branch of FreeBSD source code List-Archive: https://lists.freebsd.org/archives/freebsd-stable List-Help: List-Post: List-Subscribe: List-Unsubscribe: X-BeenThere: freebsd-stable@freebsd.org Sender: owner-freebsd-stable@FreeBSD.org MIME-Version: 1.0 References: In-Reply-To: From: Rostislav Krasny Date: Sat, 11 May 2024 17:23:37 +0300 Message-ID: Subject: Re: [14.1-BETA2] Cannot run any Desktop Environment To: freebsd-stable Content-Type: text/plain; charset="UTF-8" X-Spamd-Bar: --- X-Spamd-Result: default: False [-3.96 / 15.00]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; NEURAL_HAM_LONG(-1.00)[-0.999]; NEURAL_HAM_SHORT(-0.96)[-0.959]; DMARC_POLICY_ALLOW(-0.50)[gmail.com,none]; R_DKIM_ALLOW(-0.20)[gmail.com:s=20230601]; R_SPF_ALLOW(-0.20)[+ip6:2607:f8b0:4000::/36:c]; MIME_GOOD(-0.10)[text/plain]; RCVD_TLS_LAST(0.00)[]; TO_MATCH_ENVRCPT_ALL(0.00)[]; RCPT_COUNT_ONE(0.00)[1]; FROM_HAS_DN(0.00)[]; MIME_TRACE(0.00)[0:+]; ARC_NA(0.00)[]; FREEMAIL_ENVFROM(0.00)[gmail.com]; FREEMAIL_FROM(0.00)[gmail.com]; TO_DN_ALL(0.00)[]; DKIM_TRACE(0.00)[gmail.com:+]; DWL_DNSWL_NONE(0.00)[gmail.com:dkim]; MID_RHS_MATCH_FROMTLD(0.00)[]; PREVIOUSLY_DELIVERED(0.00)[freebsd-stable@freebsd.org]; FROM_EQ_ENVFROM(0.00)[]; TAGGED_FROM(0.00)[]; MLMMJ_DEST(0.00)[freebsd-stable@freebsd.org]; RCVD_COUNT_ONE(0.00)[1]; ASN(0.00)[asn:15169, ipnet:2607:f8b0::/32, country:US]; MISSING_XM_UA(0.00)[]; RCVD_IN_DNSWL_NONE(0.00)[2607:f8b0:4864:20::e36:from] X-Rspamd-Queue-Id: 4Vc7KM1y5vz4vHP The previous email was accidentally sent before I finished writing it. My apologies. Please read this one instead: Hi, I wanted to try FreeBSD 14.1-BETA2 on my desktop computer and installed it from the official FreeBSD-14.1-BETA2-amd64-mini-memstick.img image file and network. The base system has been installed and seems to be working properly. Then I wanted to install some Desktop Environment and installed LXQT as described in the 8.2.6 section of the Handbook (but without setting the sddm_lang, since I'm fine with English). Then I installed xorg and drm-kmod, as described in the 5.2 and 5.3 sections of the Handbook. I have the i7-4790 CPU with integrated graphics that is the only graphic card that I have, so I enabled the i915kms kernel module in /etc/rc.conf After reboot the xorg and sddm seem to be working properly and I was able even pass the login stage but after about 5 seconds later my screen was completely _blank_ and I was not able switching into any other console (Ctrl+Alt+F1 or F2 or any other Fn). The base system was not stuck because pressing on the "power" button initiated the normal shutdown process. Yet another observation, I noticed that after sddm login and before the screen got blank most of the desktop icons are not shown but only their titles. Since this system is still usable before DE login I tried to use XFCE with lightdm instead of the LXQT sddm. Then I commented out the sddm_enable="YES" line in the /etc/rc.conf and installed xfce, lightdm and lightdm-gtk-greeter packages as described in the 8.2.3.3 section of the Handbook, including lightdm_enable="YES" in the /etc/rc.conf and rebooted. The result was very similar to the previous one with LXQT. The lightdm and xorg seemed to work properly and I was able to pass the login stage and see the XFCE desktop but without most of the desktop icons and after about 5 seconds (or maybe after the first time I clicked on some of those icons place) my screen got blank and no other console was available. Is it a known issue? Did I do something wrong? And yet another problem. Section 5.4.3 offers to add the following video card configuration (in my case) into the /usr/local/etc/X11/xorg.conf.d/20-intel.conf Section "Device" Identifier "Card0" Driver "intel" EndSection If I add it with either tab or spaces indentation the sddm can't start. Didn't try the the lightdm yet but almost sure it will not work too. Is that 20-intel.conf configuration file necessary? From nobody Sun May 12 07:04:59 2024 X-Original-To: freebsd-stable@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4VcYXw09CNz5KSTd for ; Sun, 12 May 2024 07:05:20 +0000 (UTC) (envelope-from rosti.bsd@gmail.com) Received: from mail-vs1-xe29.google.com (mail-vs1-xe29.google.com [IPv6:2607:f8b0:4864:20::e29]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "GTS CA 1D4" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4VcYXt2xf4z4XZ4 for ; Sun, 12 May 2024 07:05:18 +0000 (UTC) (envelope-from rosti.bsd@gmail.com) Authentication-Results: mx1.freebsd.org; dkim=pass header.d=gmail.com header.s=20230601 header.b=aiZWiQhD; dmarc=pass (policy=none) header.from=gmail.com; spf=pass (mx1.freebsd.org: domain of rosti.bsd@gmail.com designates 2607:f8b0:4864:20::e29 as permitted sender) smtp.mailfrom=rosti.bsd@gmail.com Received: by mail-vs1-xe29.google.com with SMTP id ada2fe7eead31-47bc3e1e797so295832137.0 for ; Sun, 12 May 2024 00:05:18 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20230601; t=1715497517; x=1716102317; darn=freebsd.org; h=content-transfer-encoding:to:subject:message-id:date:from :in-reply-to:references:mime-version:from:to:cc:subject:date :message-id:reply-to; bh=JMrb0urmC7nQYyFE6vy/1c/iNcw0q1HVPZ6f+xLMPHA=; b=aiZWiQhDsLyzJsEpINpOukfL6GMewf8NRLym8eL/PSHelMYJZ9u5mit7gjZm7zLjB/ qsk817OIZI6KrpcWu/qUOvqPJMvf0S+2yo+EICftKqnZayKHhzcx4leV8rn+EDtyPHNK 6qNmuML38Cmz9xfVRzCeN2WDV3ahywOhGTbCHCXsFeJNKEz8fISsN5KZmQSROjQrlIJT xoHdGzfMzQ+78UxlmFBFYaAiiQxEwATokNBPCe/WvMfuDVl9p+zoQgdcbvXv7LJ92YWo LeBCs9DTRJdgTZvw+sUNs0RoDN2PIarAJAuMwDJTDQ0gBdcdmFoK8yI2MaY7cMCjLWdO dkJA== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20230601; t=1715497517; x=1716102317; h=content-transfer-encoding:to:subject:message-id:date:from :in-reply-to:references:mime-version:x-gm-message-state:from:to:cc :subject:date:message-id:reply-to; bh=JMrb0urmC7nQYyFE6vy/1c/iNcw0q1HVPZ6f+xLMPHA=; b=umCx/3Zj4z1Y5Vcz8MLg8j8JXGhFa17ygsIhqobZB3r7mZZW18qdMBmLviOTpQjYn5 svjdHLX+/3NDUdtg7H2M/1hFBSdCj1GrehcJBaTunoN+L2s6OphioegmDpgaxRG6WqIZ maQ+wxYmnXM+XskjXR3vAtcDe5vDeGp/xzTeKUPxh3ZVsXtyzHWkMkQwm4COyoO+KuMt dPMlYpg17Ok6TiW2fdROXmMmYK9t/oNKq36C0+I7s5m2Jq5lp5Mj4YFwHwM8K12Mf5bw UD6Bzx6VY6AzFXHwKfKDVLn6p/6wQwcoNJvqi6Rwe9W1O4fGwOCbZmrLq8Wfnxr1Q02M tYBQ== X-Gm-Message-State: AOJu0YxFCWbHIbUT9v1lGD/zoh9oOolk6Xw+a3ysDsxbx3ejAy6FZIFW +s4b4jgK9GS4szRn7gAxGa/mogp+DQTIHQ1E1vF8eXPwBW6cXekEc7q7+d7uk/VU/8KEzf0BjTz Fb+a6UImEv5ypXdfJC0Bz3Ju78excb3to X-Google-Smtp-Source: AGHT+IGZiwR/CqvZwRoYWmze5mn9A7Gm/Xj5SKdYCNlg7vvwB/xN1FG+4JFuvdPopsyoAniPRhbS6ID0yjTFB9pGGy4= X-Received: by 2002:a05:6102:5882:b0:47f:2ddc:e610 with SMTP id ada2fe7eead31-48077cc1f22mr6461161137.0.1715497515433; Sun, 12 May 2024 00:05:15 -0700 (PDT) List-Id: Production branch of FreeBSD source code List-Archive: https://lists.freebsd.org/archives/freebsd-stable List-Help: List-Post: List-Subscribe: List-Unsubscribe: X-BeenThere: freebsd-stable@freebsd.org Sender: owner-freebsd-stable@FreeBSD.org MIME-Version: 1.0 References: In-Reply-To: From: Rostislav Krasny Date: Sun, 12 May 2024 10:04:59 +0300 Message-ID: Subject: Re: [14.1-BETA2] Cannot run any Desktop Environment To: freebsd-stable Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Spamd-Bar: --- X-Spamd-Result: default: False [-4.00 / 15.00]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; NEURAL_HAM_SHORT(-1.00)[-1.000]; NEURAL_HAM_LONG(-1.00)[-0.999]; DMARC_POLICY_ALLOW(-0.50)[gmail.com,none]; R_DKIM_ALLOW(-0.20)[gmail.com:s=20230601]; R_SPF_ALLOW(-0.20)[+ip6:2607:f8b0:4000::/36]; MIME_GOOD(-0.10)[text/plain]; RCVD_TLS_LAST(0.00)[]; TO_MATCH_ENVRCPT_ALL(0.00)[]; ARC_NA(0.00)[]; FROM_HAS_DN(0.00)[]; MIME_TRACE(0.00)[0:+]; RCPT_COUNT_ONE(0.00)[1]; FREEMAIL_ENVFROM(0.00)[gmail.com]; FREEMAIL_FROM(0.00)[gmail.com]; TO_DN_ALL(0.00)[]; DKIM_TRACE(0.00)[gmail.com:+]; DWL_DNSWL_NONE(0.00)[gmail.com:dkim]; MID_RHS_MATCH_FROMTLD(0.00)[]; PREVIOUSLY_DELIVERED(0.00)[freebsd-stable@freebsd.org]; FROM_EQ_ENVFROM(0.00)[]; TAGGED_FROM(0.00)[]; MLMMJ_DEST(0.00)[freebsd-stable@freebsd.org]; RCVD_COUNT_ONE(0.00)[1]; ASN(0.00)[asn:15169, ipnet:2607:f8b0::/32, country:US]; MISSING_XM_UA(0.00)[]; RCVD_IN_DNSWL_NONE(0.00)[2607:f8b0:4864:20::e29:from] X-Rspamd-Queue-Id: 4VcYXt2xf4z4XZ4 On Sat, May 11, 2024 at 5:23=E2=80=AFPM Rostislav Krasny wrote: > > The previous email was accidentally sent before I finished writing it. > My apologies. Please read this one instead: > > Hi, > > I wanted to try FreeBSD 14.1-BETA2 on my desktop computer and > installed it from the official > FreeBSD-14.1-BETA2-amd64-mini-memstick.img image file and network. > The base system has been installed and seems to be working properly. > > Then I wanted to install some Desktop Environment and installed LXQT > as described in the 8.2.6 section of the Handbook (but without setting > the sddm_lang, since I'm fine with English). > > Then I installed xorg and drm-kmod, as described in the 5.2 and 5.3 > sections of the Handbook. I have the i7-4790 CPU with integrated > graphics that is the only graphic card that I have, so I enabled the > i915kms kernel module in /etc/rc.conf > > After reboot the xorg and sddm seem to be working properly and I was > able even pass the login stage but after about 5 seconds later my > screen was completely _blank_ and I was not able switching into any > other console (Ctrl+Alt+F1 or F2 or any other Fn). The base system was > not stuck because pressing on the "power" button initiated the normal > shutdown process. Yet another observation, I noticed that after sddm > login and before the screen got blank most of the desktop icons are > not shown but only their titles. > > Since this system is still usable before DE login I tried to use XFCE > with lightdm instead of the LXQT sddm. Then I commented out the > sddm_enable=3D"YES" line in the /etc/rc.conf and installed xfce, lightdm > and lightdm-gtk-greeter packages as described in the 8.2.3.3 section > of the Handbook, including lightdm_enable=3D"YES" in the /etc/rc.conf > and rebooted. The result was very similar to the previous one with > LXQT. The lightdm and xorg seemed to work properly and I was able to > pass the login stage and see the XFCE desktop but without most of the > desktop icons and after about 5 seconds (or maybe after the first time > I clicked on some of those icons place) my screen got blank and no > other console was available. > > Is it a known issue? Did I do something wrong? > > And yet another problem. Section 5.4.3 offers to add the following > video card configuration (in my case) into the > /usr/local/etc/X11/xorg.conf.d/20-intel.conf > > Section "Device" > Identifier "Card0" > Driver "intel" > EndSection > > If I add it with either tab or spaces indentation the sddm can't > start. Didn't try the the lightdm yet but almost sure it will not work > too. > Is that 20-intel.conf configuration file necessary? After further investigation it turned out that the problem is that Xorg in FreeBSD doesn't support the DisplayPort 1.2 specification. After I disabled the DisplayPort 1.2 in the configuration menu of my Dell U2414H monitor Xfce started to work. At the same time Windows 10 in this hardware supports DisplayPort 1.2 properly. Is it a known limitation and is support of DisplayPort 1.2 going to be implemented? From nobody Sun May 12 15:38:50 2024 X-Original-To: freebsd-stable@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4VcmxQ63dPz5KDkG; Sun, 12 May 2024 15:38:50 +0000 (UTC) (envelope-from cperciva@FreeBSD.org) Received: from freefall.freebsd.org (freefall.freebsd.org [IPv6:2610:1c1:1:6074::16:84]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "freefall.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4VcmxQ5p55z4LYm; Sun, 12 May 2024 15:38:50 +0000 (UTC) (envelope-from cperciva@FreeBSD.org) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1715528330; h=from:from:reply-to:reply-to:subject:subject:date:date: message-id:message-id:to:to:cc:cc; bh=nZvoWOb4NczoYPOWiWVESc9ATCpiHWl1v1OEQmcKTo8=; b=vP/BUwYcSyNe0k5LFm2e11f/MRTK91fyjo+1WOvIY78wb0O8/fVmYbTO3fgG+UOTl7UEMm /uFuUBtCP76re21E7vni3kpulPCtM6Oj5JOW5a6XHx4pBzVIU6OBUr57v9NFLvTTx/Wtzs 48kBS+VaP5OEXrBqHXG9wseetnL8gC0OpvZIU68mdu+vaPwuZND6+80TCGRK33E7ZMTnbK B8uXRPLJrt4Yy3E4CguV4iiZw+XPDSOxCW1hEUcmZyUWH9YTsYrHD4tM0FJwfg3hU8F2fi gKRc1X5uMd1j7TRG2Bs9ZUqzDkmm5Ma76xnAdZ2KpIwJycLBLBzSxm+RZI+jyw== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1715528330; a=rsa-sha256; cv=none; b=oYaGBMpRTjoQEPCElzSneb5A6iS0iD7mmH9plgqbcI2NmpJ11ai5R2y2DisbYXhzD5THw9 NTFC8YvW9wHX2ap5t01Nvk4BesRwGjrlN1WG3lTpdsz8Sdk/KJNnPgSB/xFZFJZplgV+Xl 6h4mHmIkeBnmKlxLrFJOO4TzKWkSu87rRUAeifllC8L1MOYUFE1ow9APgW6rHrIwG4/lXC x4IOG1rMtF08Ah0GaXDj34sPBOElgc7KfLLV75yLltCCT3mHnkYG+9fANWQpZ5Cc6gjn9a DX626eqFB3pHwlomQ+Z7IPmwu7FCWyQNvl4EfnoZ6tfgr9GkI4EXZSzE2s6EpQ== ARC-Authentication-Results: i=1; mx1.freebsd.org; none ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1715528330; h=from:from:reply-to:reply-to:subject:subject:date:date: message-id:message-id:to:to:cc:cc; bh=nZvoWOb4NczoYPOWiWVESc9ATCpiHWl1v1OEQmcKTo8=; b=XtlWZjHrcJiJ94Toyf7lwSE2k9IjBFyBnbKyBdQWfHnWRuSrlCJQSV+bhLj8+T6dBPfOxZ Jt3AkcN2C79c/rFGD03tN5Sw5YA6Bc6/gTvD0LKDIxEZo5eZwbmSYBBVmzpqQWd6YYY1m0 DfEiozVGffWdxNbnW1G3/SCI98zpCrbRebmEjqNUHSSBCo5+c/CqNCygxeZxm5dVq4gkC+ pUnasXTfXd1XK2+J3Mnd+pOFtXC6qz8pAmpV8dMfCguHDd7ETWoWgtKfbm4R5N4+8RYh39 zVYkEN7vLWUG3D7IZIZuOPSeXEG9tXY5Ni7KLTrY43I1jBDcfXG6HEm7ZcjEAA== Received: by freefall.freebsd.org (Postfix, from userid 1002) id B0D01257D9; Sun, 12 May 2024 15:38:50 +0000 (UTC) To: freebsd-snapshots@FreeBSD.org, freebsd-stable@FreeBSD.org Cc: FreeBSD Release Engineering Team Reply-To: FreeBSD Release Engineering Team Subject: FreeBSD 14.1-BETA2 Now Available Message-Id: <20240512153850.B0D01257D9@freefall.freebsd.org> Date: Sun, 12 May 2024 15:38:50 +0000 (UTC) From: Colin Percival List-Id: Production branch of FreeBSD source code List-Archive: https://lists.freebsd.org/archives/freebsd-stable List-Help: List-Post: List-Subscribe: List-Unsubscribe: X-BeenThere: freebsd-stable@freebsd.org Sender: owner-freebsd-stable@FreeBSD.org -----BEGIN PGP SIGNED MESSAGE----- Hash: SHA512 The second BETA build of the 14.1-RELEASE release cycle is now available. Installation images are available for: o 14.1-BETA2 amd64 GENERIC o 14.1-BETA2 i386 GENERIC o 14.1-BETA2 powerpc GENERIC o 14.1-BETA2 powerpc64 GENERIC64 o 14.1-BETA2 powerpc64le GENERIC64LE o 14.1-BETA2 powerpcspe MPC85XXSPE o 14.1-BETA2 armv7 GENERICSD o 14.1-BETA2 aarch64 GENERIC o 14.1-BETA2 aarch64 RPI o 14.1-BETA2 aarch64 PINE64 o 14.1-BETA2 aarch64 PINE64-LTS o 14.1-BETA2 aarch64 PINEBOOK o 14.1-BETA2 aarch64 ROCK64 o 14.1-BETA2 aarch64 ROCKPRO64 o 14.1-BETA2 riscv64 GENERIC o 14.1-BETA2 riscv64 GENERICSD Note regarding arm SD card images: For convenience for those without console access to the system, a freebsd user with a password of freebsd is available by default for ssh(1) access. Additionally, the root user password is set to root. It is strongly recommended to change the password for both users after gaining access to the system. Installer images and memory stick images are available here: https://download.freebsd.org/releases/ISO-IMAGES/14.1/ The image checksums follow at the end of this e-mail. If you notice problems you can report them through the Bugzilla PR system or on the -stable mailing list. If you would like to use Git to do a source based update of an existing system, use the "releng/14.1" branch. A summary of changes since BETA1 includes: o LLVM/clang/etc update to 18.1.5 o OpenZFS update to 2.2.4 o Bug fix to the adduser utility o Removal of remnants of portsnap o Kernels are now built reproducibly. A list of changes since 14.0 is available in the releng/14.1 release notes: https://www.freebsd.org/releases/14.1R/relnotes/ Please note, the release notes page is not yet complete, and will be updated on an ongoing basis as the 14.1-RELEASE cycle progresses. === Virtual Machine Disk Images === VM disk images are available for the amd64, i386, aarch64, and riscv64 architectures. Disk images may be downloaded from the following URL (or any of the FreeBSD download mirrors): https://download.freebsd.org/releases/VM-IMAGES/14.1-BETA2/ BASIC-CI images can be found at: https://download.freebsd.org/releases/CI-IMAGES/14.1-BETA2/ The partition layout is: ~ 16 kB - freebsd-boot GPT partition type (bootfs GPT label) ~ 1 GB - freebsd-swap GPT partition type (swapfs GPT label) ~ 20 GB - freebsd-ufs GPT partition type (rootfs GPT label) The disk images are available in QCOW2, VHD, VMDK, and raw disk image formats. The image download size is approximately 135 MB and 165 MB respectively (amd64/i386), decompressing to a 21 GB sparse image. Note regarding arm64/aarch64 virtual machine images: a modified QEMU EFI loader file is needed for qemu-system-aarch64 to be able to boot the virtual machine images. See this page for more information: https://wiki.freebsd.org/arm64/QEMU To boot the VM image, run: % qemu-system-aarch64 -m 4096M -cpu cortex-a57 -M virt \ -bios QEMU_EFI.fd -serial telnet::4444,server -nographic \ -drive if=none,file=VMDISK,id=hd0 \ -device virtio-blk-device,drive=hd0 \ -device virtio-net-device,netdev=net0 \ -netdev user,id=net0 Be sure to replace "VMDISK" with the path to the virtual machine image. === Amazon EC2 AMI Images === FreeBSD/amd64 EC2 AMI IDs can be retrieved from the Systems Manager Parameter Store in each region using the keys: /aws/service/freebsd/amd64/base/ufs/14.1/BETA2 /aws/service/freebsd/amd64/base/zfs/14.1/BETA2 /aws/service/freebsd/amd64/cloud-init/ufs/14.1/BETA2 /aws/service/freebsd/amd64/cloud-init/zfs/14.1/BETA2 FreeBSD/aarch64 EC2 AMI IDs can be retrieved from the Systems Manager Parameter Store in each region using the keys: /aws/service/freebsd/arm64/base/ufs/14.1/BETA2 /aws/service/freebsd/arm64/base/zfs/14.1/BETA2 /aws/service/freebsd/arm64/cloud-init/ufs/14.1/BETA2 /aws/service/freebsd/arm64/cloud-init/zfs/14.1/BETA2 === Vagrant Images === FreeBSD/amd64 images are available on the Hashicorp Atlas site, and can be installed by running: % vagrant init freebsd/FreeBSD-14.1-BETA2 % vagrant up === Upgrading === The freebsd-update(8) utility supports binary upgrades of amd64, i386, and aarch64 systems running earlier FreeBSD releases. Systems running earlier FreeBSD releases can upgrade by first installing any updates for the currently running release: # freebsd-update fetch # freebsd-update install and then downloading the new release: # freebsd-update upgrade -r 14.1-BETA2 During this process, freebsd-update(8) may ask the user to help by merging some configuration files or by confirming that the automatically performed merging was done correctly. # freebsd-update install The system must be rebooted with the newly installed kernel before continuing. # shutdown -r now After rebooting, freebsd-update needs to be run again to install the new userland components: # freebsd-update install It is recommended to rebuild and install all applications if possible, especially if upgrading from an earlier FreeBSD release, for example, FreeBSD 12.x. Alternatively, the user can install misc/compat12x and other compatibility libraries, afterwards the system must be rebooted into the new userland: # shutdown -r now Finally, after rebooting, freebsd-update needs to be run again to remove stale files: # freebsd-update install == ISO CHECKSUMS == o 14.1-BETA2 amd64 GENERIC: SHA512 (FreeBSD-14.1-BETA2-amd64-bootonly.iso) = 507271c88dc80c9b2d149a9b1abf5d2b4b4b737db0d3ee2806365386b7d04efcb1cd91c8cb75e6ee80d195fdc8ef1566c66dd4ed0e0f909be679d54af2a4e3f8 SHA512 (FreeBSD-14.1-BETA2-amd64-bootonly.iso.xz) = 24fa73875f53d77e0c5f2d00e736a1b497ed3bf70aa45e0042f84a61d0eb1f0310f849f43d9bb098ee739b0616e992862f99ce049f9bef3da12f43285fc1a941 SHA512 (FreeBSD-14.1-BETA2-amd64-disc1.iso) = 5a9f55eefa6ccf77e059956cf4f26a1248e5d236dcb2dff5611a5a917c0716f418030b1b65794aefed82823abf95e54b48c607aa8effa056271a16fe103af5b7 SHA512 (FreeBSD-14.1-BETA2-amd64-disc1.iso.xz) = 89a96851b109319fbdd86f932bda5b675e290cead4cae80f61b0b46a2511eb4f9fc6f28987dc30562c156333f4e497385da7828e402e632d5687235bea2e1a5d SHA512 (FreeBSD-14.1-BETA2-amd64-dvd1.iso) = 8266281d808d374b31dbd0559bbb2e10c5ba17573692cffa2401c1dc0bcd65318baf25f8b1f93a867a3bacee710b79d904fe7847c07d81ddfb0e5a2ec3cc360c SHA512 (FreeBSD-14.1-BETA2-amd64-dvd1.iso.xz) = 23fb99f7c2c22e9c5142a9df93f92eca12fa53a7fb1e9830c39ab8d5f77d11206199ccb679741cc6e8ac7727dfdb29cbf658bfea808825780aecf33d06b75ea9 SHA512 (FreeBSD-14.1-BETA2-amd64-memstick.img) = 2c5d38828b6ae5b299e5bc1fad1def961029ab2821dd5ff42989f24dcfe3be856a4dd3095157e558344613c4f0f374c899b522000090f9419fd8bbf2b43c8285 SHA512 (FreeBSD-14.1-BETA2-amd64-memstick.img.xz) = d640b233b2044aefdbee20ae5d7ecbf4a3c2cb5e42fd9ce0108143cdbc0d8f234821ee73f14d678241f85affbfe67b0b307da1e1ce099630382f1f725e394758 SHA512 (FreeBSD-14.1-BETA2-amd64-mini-memstick.img) = eefdfeea07c6a3076a3e7bd372b83e11ef821a9f0f2971d5862ac27e7737575327b9b4e226b0d251feffaddc11b0e398eef7b4537f9ff3bf78e2ffd6bbc2763a SHA512 (FreeBSD-14.1-BETA2-amd64-mini-memstick.img.xz) = 767bb63f84041c061c3ee875b16e8dc2bcbeef175b5afad4fd2a6b4259db6ddde57e11c8390af396cb6ef2399f7c6a0d08685be57d9788ddfcf4011a3eb6501f SHA256 (FreeBSD-14.1-BETA2-amd64-bootonly.iso) = 25a9ab0ecee19f794e41fe10d117a49ffb469d52eb6e7506c4cc71d20eee6b4a SHA256 (FreeBSD-14.1-BETA2-amd64-bootonly.iso.xz) = d5d26f3bd915398f6520ab0323da18bf0a31a39754440d88cecd4574b2c94862 SHA256 (FreeBSD-14.1-BETA2-amd64-disc1.iso) = 9083b6c793fbc1bc62935e9a6de6aefc8e73a7b9d89099542d87eed03a9126f5 SHA256 (FreeBSD-14.1-BETA2-amd64-disc1.iso.xz) = c3c22115ed54397f4ea3fa90908ce6283223d8a66c3353c6f042ea45e7d72cbf SHA256 (FreeBSD-14.1-BETA2-amd64-dvd1.iso) = 415caa0d79f6509bbe9a1d5c0b7886488b2d3036c6eb79f6d5be3b8bcebb4430 SHA256 (FreeBSD-14.1-BETA2-amd64-dvd1.iso.xz) = c6ba02231cdf2f225e2d97fc078fbdcd94b20e96f894f162094747edaccc98d8 SHA256 (FreeBSD-14.1-BETA2-amd64-memstick.img) = 4ec169338618f5e838d5680c15335e03c127fc96396ea26a1593373ea29c090e SHA256 (FreeBSD-14.1-BETA2-amd64-memstick.img.xz) = 5d2a61d3888105f429e3b98d140f56f69b54790d5025bae256fc8586fc7f2f99 SHA256 (FreeBSD-14.1-BETA2-amd64-mini-memstick.img) = be647e158b99aeec5f489f4f29a098c3b0710663626722bcff5a79116b8a49ad SHA256 (FreeBSD-14.1-BETA2-amd64-mini-memstick.img.xz) = 723bdb799aad3125f91554e0f3d88401dd2b88a28c5880aee31134f79af419a4 o 14.1-BETA2 i386 GENERIC: SHA512 (FreeBSD-14.1-BETA2-i386-bootonly.iso) = ea693f9122a8cd40b97222a329d8fa5068565899cbcada1d00fe339c568f1fa74ab6ca0cee88bb0583dfebb01d3973b833e916eacc7fe79e5895589c4ab2885e SHA512 (FreeBSD-14.1-BETA2-i386-bootonly.iso.xz) = 16686c2803ab1053f175baac87b0bc4f3cf3bbbadf48d597bd6e054c03ab7ebc64d80de4a08e534cc01415a0ef3f9940fbc2066f00bfdd6bc9db30ac57966bfa SHA512 (FreeBSD-14.1-BETA2-i386-disc1.iso) = d6fe98a8334c587ed216f8d7fb3b157dfcc9b529ead01c1decd7ce494cd5212f4b4e7aa353a1c879e189d6e731120ed61bd33d7069db7e0c89c800784957cf81 SHA512 (FreeBSD-14.1-BETA2-i386-disc1.iso.xz) = adbdd2f76e59e73bced98f85c7a76489847b492fdd2a430a51950d7bc4beba45ea232663809002c06559c63d95fe98c0dd3a7afa51420d11c5c47c490a1dbd6c SHA512 (FreeBSD-14.1-BETA2-i386-dvd1.iso) = 32184fb455b792e37ce5cb2f7bff4abd557c0f86b97d56328c033502fed9a716d9da0df029cac6e126dd5bed17e984b1cac3672e8f8cab2b82cce9c165f5963b SHA512 (FreeBSD-14.1-BETA2-i386-dvd1.iso.xz) = 2072a2f5db85a4ccaa6cef416899135cfc861c102963114261dadcab717747e53d05253a46ebc8ae0b8411154a378ae3eac4486da4a186adb9c1309b88833630 SHA512 (FreeBSD-14.1-BETA2-i386-memstick.img) = 762c11bff79b4a042504aa3ee99073f5851da21c2b2efdac17ffe9aec382180c37415296e2a3666302affe1a725c5cca625a5a48173d5f461664e38c1f7ef89c SHA512 (FreeBSD-14.1-BETA2-i386-memstick.img.xz) = 90a500b38e4e6d4cb4afdcb6c2b74cd4a3e5713f31bbfd575449230b2aa1e5ba3d8f2057aee321f53b87685c0a4e48018ac9b3e35dae8a1b415f30ab813db31f SHA512 (FreeBSD-14.1-BETA2-i386-mini-memstick.img) = 2ace30474ceae3249e010607964e674033253b150673fb7696bcc8de1b92e6b92e07e172aaa7b5bce2030f224f77810f0519f98caeade4d159ed6128b632f011 SHA512 (FreeBSD-14.1-BETA2-i386-mini-memstick.img.xz) = 8e3395bf3b1e6eb3e222a8b3152670d6da934055e2771e03a007712cfd5425df1597efb62d2171e7cfc6215cd17fd12f5535700f87cd5e63c447fb2c657b0f78 SHA256 (FreeBSD-14.1-BETA2-i386-bootonly.iso) = fc2e1f38c030008444bf2c56c2ff5a7b78574b234820d7b7212cc98dcf2fc128 SHA256 (FreeBSD-14.1-BETA2-i386-bootonly.iso.xz) = ad2b1236a312a974efd524f32464569887d8006091ba4fcb1426c9918c7a2e65 SHA256 (FreeBSD-14.1-BETA2-i386-disc1.iso) = 8f8494296db0f00a12db9d00bbfaa499ee18dd1083cc68d3974d561f3443c228 SHA256 (FreeBSD-14.1-BETA2-i386-disc1.iso.xz) = 96dc0fbc29169b5e6d3a807c5b63012a8f4dbe9e5a6373b69763b4e2fd0fde7a SHA256 (FreeBSD-14.1-BETA2-i386-dvd1.iso) = 3c56f2bc1a0c6e06d8e5d657611f3636825f8051fffaefbb8dd031ac49d8b37d SHA256 (FreeBSD-14.1-BETA2-i386-dvd1.iso.xz) = 3b0058f325fac9749a790bd506a44e0a1d279aeaa6abd8e6a4108fb9719d4567 SHA256 (FreeBSD-14.1-BETA2-i386-memstick.img) = b762cf59e8cef95d4055b55bb03d5947ca77202759ff6f38e385e0bb4e7b91f5 SHA256 (FreeBSD-14.1-BETA2-i386-memstick.img.xz) = af24db901033c159fff2f12ee5d5e077e1ea64a4867baeb42d45e81ce5773c16 SHA256 (FreeBSD-14.1-BETA2-i386-mini-memstick.img) = 6d572045b811443591d62b97ca731357bed28d0bc410e20d383c7c10e38e2acb SHA256 (FreeBSD-14.1-BETA2-i386-mini-memstick.img.xz) = 26d5dac9dc50a57585cb68c69e33a6063a1fa2fa04001317efd834aa9db68f73 o 14.1-BETA2 powerpc GENERIC: SHA512 (FreeBSD-14.1-BETA2-powerpc-bootonly.iso) = 534bc9722e0849df59d9fa70cca05f61738f543c3074c67c790d598c4ea2093ec828503398b83701b178fd3df3ee33d5befefa8ae6a2ef2c23a53bdd737ee118 SHA512 (FreeBSD-14.1-BETA2-powerpc-bootonly.iso.xz) = b76d2630fcd589475fcbc3dd2990222482ab7f19483fe807a0a655a87308cb62409bbb958978190d0b1a63e09fef5e9ac5bf24865b08a7a22e97a82b3f356827 SHA512 (FreeBSD-14.1-BETA2-powerpc-disc1.iso) = 9293636d86696b0febb71f558ff3b387fde611e59fdc9266176c76f10c0257ec9347f96772c4707d9c6fe90bb8aa467e68b79991c2cb8a49f839f6b1a0f2a48b SHA512 (FreeBSD-14.1-BETA2-powerpc-disc1.iso.xz) = 5581a4e7ffdcfbe1b055ec64565bc629d5270fa9ad2b74ad499b98e4a53963cd5c15fcba406cf602bea8c4e49726027c395428347a998a619433dfe9e7395faf SHA512 (FreeBSD-14.1-BETA2-powerpc-dvd1.iso) = 0631e5e15cfe4cd5a2fb42c2c9c3bd3f66c0c532e4bbfcc6b9492394dc87b0f6c97739bc63911f8a84b0730481e1f62fc5fdccfbd1d5f5f8272427763dfe1fe3 SHA512 (FreeBSD-14.1-BETA2-powerpc-dvd1.iso.xz) = 09ecd2529fc32eaa1d7e5562ff513ef058185068c744242f94dc0b414d93599480557df32f984ade09c3fedd8ee0f98de42a04dffb89a35b96e38938288c54c4 SHA256 (FreeBSD-14.1-BETA2-powerpc-bootonly.iso) = 87031baeccb754245eb16c31f88f3c768a28b9933286875c17acfe699043b3e0 SHA256 (FreeBSD-14.1-BETA2-powerpc-bootonly.iso.xz) = a5a337fa1f2199664d31614154ba79183a558e463ee1b33ab086c43165de82a0 SHA256 (FreeBSD-14.1-BETA2-powerpc-disc1.iso) = a1e91c83771bb699d8a49281b77911e88026f29c92c05d5639bb6ed4c4ba1be5 SHA256 (FreeBSD-14.1-BETA2-powerpc-disc1.iso.xz) = f669721889df30de3aea6ecbf7f65046a8bf58de884cc2f89c492a4b6110b58d SHA256 (FreeBSD-14.1-BETA2-powerpc-dvd1.iso) = 4c1f1611a71c403ce5249933eecb22deb1cef14323c335766eb46b7a832e876b SHA256 (FreeBSD-14.1-BETA2-powerpc-dvd1.iso.xz) = a443fcde9ef34551be5739fa7efb2c1754384113ef8132eb21c286810674f351 o 14.1-BETA2 powerpc64 GENERIC64: SHA512 (FreeBSD-14.1-BETA2-powerpc-powerpc64-bootonly.iso) = 323c4cd6699c71820cfed9e2ff88396dbe549b08c0d6a1d0f30967e425a3e2682818f1dda5636a515d4e9b0e1c7f58ecbfa8d488833ac8837743ff4940914aff SHA512 (FreeBSD-14.1-BETA2-powerpc-powerpc64-bootonly.iso.xz) = c2173e82e809a4f095ff0cace055acbff60a73f10b493426ceb7175aa53efbc959d3db8aad9c86e0ad50fbcc38139a7b7f48e7538d2327676f35569928fa5a5d SHA512 (FreeBSD-14.1-BETA2-powerpc-powerpc64-disc1.iso) = c83378db4fa8d30592882790fb364be88c516e531954f8135a4c7d763d0b7c768810c480d57b3cadc5a36f70584cc4ceb5011f91016cab2dd08010b72e79cc9a SHA512 (FreeBSD-14.1-BETA2-powerpc-powerpc64-disc1.iso.xz) = af40af2fafa5650b74a87b1dfb046aadd8833c856bb564f03373903bf8ad7b4a9c6fecec8b7edb4143a8403427910ee586bf1eaf6a7f878e6fcab86fd01531ed SHA512 (FreeBSD-14.1-BETA2-powerpc-powerpc64-dvd1.iso) = a709c909c7512bfe0b26012a932ca8bc00c9577ac80d61fb395030e66cb2b30dd39b6f43ec4847b076d7bcff630021409a5a5728699e2c7a109f8532652a0e51 SHA512 (FreeBSD-14.1-BETA2-powerpc-powerpc64-dvd1.iso.xz) = 698a0ee4c4f7f708739385768fba030c078b82cb112d3d55941f8eaa1e1a1ede0dc6ec4d3e70bdf27d16d2232fa56b141a87e85ff1944f2358989502bf676140 SHA256 (FreeBSD-14.1-BETA2-powerpc-powerpc64-bootonly.iso) = 0cbfe1f6e7fbc63292c83621583a422bee17f20534e80b53b58f343dde9638b4 SHA256 (FreeBSD-14.1-BETA2-powerpc-powerpc64-bootonly.iso.xz) = 0d0afebe5022b20e28ee2aefdce352b69c01a3159af88a637cbb3f6f998f8cbf SHA256 (FreeBSD-14.1-BETA2-powerpc-powerpc64-disc1.iso) = 22b5a005a2e1b4c108a9fd727b25d2d64c2c789a6b69e1aa286ccf28e455bf9c SHA256 (FreeBSD-14.1-BETA2-powerpc-powerpc64-disc1.iso.xz) = 0008a701f8120f0db0be232410372f4537e91fd1239d4ed51291a65cb7f957d1 SHA256 (FreeBSD-14.1-BETA2-powerpc-powerpc64-dvd1.iso) = bb8d3e7289fee97ae74bc2e56dfe51369f941ccfdd7256e1d066018f2ff80013 SHA256 (FreeBSD-14.1-BETA2-powerpc-powerpc64-dvd1.iso.xz) = 0471a6bc86877409370a30b82a1d4e4d0c719d87a4c32ce7409b8c1c11a76143 o 14.1-BETA2 powerpc64le GENERIC64LE: SHA512 (FreeBSD-14.1-BETA2-powerpc-powerpc64le-bootonly.iso) = 71fcf94abedf23db4f507b404848282b651c8192104541eb403c768a5744d376da78661fbaff846b1a40221bc9f91738e4105c0803dce8aaff5ef02eb041635e SHA512 (FreeBSD-14.1-BETA2-powerpc-powerpc64le-bootonly.iso.xz) = 93474906c8773b1afc5dd5beae50b54d0cb19a6e6793c6bd52156920162e1ce2baed7d90b24bcbd240a6c402f265660166abfb4a1f2ce48962aba68f749ba3a4 SHA512 (FreeBSD-14.1-BETA2-powerpc-powerpc64le-disc1.iso) = 603e5c8eaceddab9cd95b4c330fe4e29df49d17bb1bf503d8b55cffd4c7ed5b1bc7e70b5b8dd10be1a5816195a5d3e7cb839631ffe65d4f9c1275ee0cbfc8353 SHA512 (FreeBSD-14.1-BETA2-powerpc-powerpc64le-disc1.iso.xz) = 92a2b59c3b358dc3710bb0b21e45e7d8973648c1c95ea3bcbb5a14d39547f59fa6b3e7774aa37cd0c19a46e33674fca563758e1daac9e0f38ed9f2231284b6d9 SHA512 (FreeBSD-14.1-BETA2-powerpc-powerpc64le-dvd1.iso) = 72f5e84eb5cbf39c48fadbc7442b4969ca356b70a39960cd7c6ca569ca632687799594275899b48c0926039dfe7228080838bf6b6dec394292324042a52946f1 SHA512 (FreeBSD-14.1-BETA2-powerpc-powerpc64le-dvd1.iso.xz) = 8be58ed16f325742d63e955609ec207d31e8bab9590076f467a9d1d65324cbf01b8fe56c8a84ee588703361220ef4d01991c47cc4d5df1eff0d25c81e85a0452 SHA256 (FreeBSD-14.1-BETA2-powerpc-powerpc64le-bootonly.iso) = 3fcf923dd9128bf89e81e4bdbc685f0a97cc606c00f4d81109f9ccd18d1a270a SHA256 (FreeBSD-14.1-BETA2-powerpc-powerpc64le-bootonly.iso.xz) = a89930b05680e980a492328b0ecf6c8e5ec6fd1926d8c2986d92376993689097 SHA256 (FreeBSD-14.1-BETA2-powerpc-powerpc64le-disc1.iso) = e7881b6a4dde6e1086004cf0455d2ce96f9e21168dd0ebe3af5b5097986dd163 SHA256 (FreeBSD-14.1-BETA2-powerpc-powerpc64le-disc1.iso.xz) = 1632f2c322cd58a627d3160826bc062576e92307bf8ee8d8365bf30fcec6a24f SHA256 (FreeBSD-14.1-BETA2-powerpc-powerpc64le-dvd1.iso) = 3e51dd49edcee529700bbe71f484382b12a1416349dfcda119cd4098e35a63e6 SHA256 (FreeBSD-14.1-BETA2-powerpc-powerpc64le-dvd1.iso.xz) = 4951ba826f10414d0a0da71184d20512a946e87a6f905f6d6a0b6dc8ee5cf5f5 o 14.1-BETA2 powerpcspe MPC85XXSPE: SHA512 (FreeBSD-14.1-BETA2-powerpc-powerpcspe-bootonly.iso) = eb15e825a844aa019deeba56071b604cb47e6b066f1899b9cf63cf0fec0496a3673446d447ca8fa380e99ca518a0928fb724429e6bd35568020161c08929d7bb SHA512 (FreeBSD-14.1-BETA2-powerpc-powerpcspe-bootonly.iso.xz) = b4e1b26cd389ee5e9d3ff3309cb9e3f877e771eb36e0ebf098257cdbe5faa745e4562492b426afd5e99f3e6e19cea4c7c62f25a613bab84d7836d95b68044fca SHA512 (FreeBSD-14.1-BETA2-powerpc-powerpcspe-disc1.iso) = c8008223a75e1f37bf80c0b2bbbab728297f5364e8c9d7b1fd20509652d566de752a1e406e463c069eee572b0ba5fe92220a059197adc76de30da4c7592748a9 SHA512 (FreeBSD-14.1-BETA2-powerpc-powerpcspe-disc1.iso.xz) = 334401dc6f86528c88e55bd4f327980fdb9b2bde5c0468715c91cbee5c53fb432608c090e59892ce0ea682809bab9490d111f6e8a2738cd83f5cba963db3728c SHA512 (FreeBSD-14.1-BETA2-powerpc-powerpcspe-dvd1.iso) = ee9c3e131d1227c77793922271a7d161b9f530942db945b4b56629c1a62ebb72e82cd3f81570dbce905b3d7b03c84ae197b623f15838eefecf4d45180585d8cb SHA512 (FreeBSD-14.1-BETA2-powerpc-powerpcspe-dvd1.iso.xz) = 15ea26ec8b01700d6af593ba3757fb800506e071310f9b92f2fa3247bb9b6f5b9e97a19a5ba763426314be69152232d191f355d7962345765457288e389e8936 SHA256 (FreeBSD-14.1-BETA2-powerpc-powerpcspe-bootonly.iso) = 74c6fd0da6713016fbaf6e9a2bb5aeb0fa88294b771ed393942ed50641ccdca1 SHA256 (FreeBSD-14.1-BETA2-powerpc-powerpcspe-bootonly.iso.xz) = c5b488ca0e5d31aaa5c4811653a81ce6358cc6c146f417addab64a362e9238c7 SHA256 (FreeBSD-14.1-BETA2-powerpc-powerpcspe-disc1.iso) = f6e6c40056319940ce41aac9bb4549f29afd7685594117289556fe4de56073a4 SHA256 (FreeBSD-14.1-BETA2-powerpc-powerpcspe-disc1.iso.xz) = 4564c38e9f68c41ebbf40067ac65d06c872fc260ab0a2125d6f599f9f699dfff SHA256 (FreeBSD-14.1-BETA2-powerpc-powerpcspe-dvd1.iso) = 4a3576f20282be80736d6ed47ccdf200ea7ab6e7113da67502d2326b57947457 SHA256 (FreeBSD-14.1-BETA2-powerpc-powerpcspe-dvd1.iso.xz) = 2aa1f7964730bd422e5b252a7a8aa6ec91fac5336b59827849a50fc7897772ae o 14.1-BETA2 armv7 GENERICSD: SHA512 (FreeBSD-14.1-BETA2-arm-armv7-GENERICSD.img.xz) = 116d4b79c5d2537000d72b85930b7537e7c80f6d8f09844894be754bd468a4a612d4b8d9553a663fbeea844caf0aff3e1b3548a62228682599fbef4173a0f26e SHA256 (FreeBSD-14.1-BETA2-arm-armv7-GENERICSD.img.xz) = dbee8b37092a3f37e727d207ffd29c80643786067e90b76b8940573b75e335c3 o 14.1-BETA2 aarch64 GENERIC: SHA512 (FreeBSD-14.1-BETA2-arm64-aarch64-bootonly.iso) = 436fada357b2d575a8ec5f7c8678159867764d254973a7f4a60d92a296b083e124076754b19696914eeb4903febb3c28a072b7f2cf39482863cc13f778896415 SHA512 (FreeBSD-14.1-BETA2-arm64-aarch64-bootonly.iso.xz) = 450985f2a89a5d48b4337da70b55b79892e09df0b0d0ec2a0e5e0920bbabf13cd002499249f4799ed9dc7218995583cb0846dd299548f14d4c1d2a4939700375 SHA512 (FreeBSD-14.1-BETA2-arm64-aarch64-disc1.iso) = ef405728986820dafca61e717b45a386f42068ad1d41a8c10c3a82c1060b7dd38c51ed9cfe0c9e0a63061246f4b34c046cbb1847024ffdc3464628dd6fa17ee4 SHA512 (FreeBSD-14.1-BETA2-arm64-aarch64-disc1.iso.xz) = 5a574b83271e90a2d36637b85ccae2177fd69433c2fbcc3ab8d427aa1c22204536afd152cb71cad7e1029b0e9a1a039d9ee24fdf5c9ef55b5781c62b949104f6 SHA512 (FreeBSD-14.1-BETA2-arm64-aarch64-dvd1.iso) = 9a78c7e32fe277eef8cb7f01c648945fbfec54ada1e9692a6e8328459c6b417cce77a019adf513617edab84eae7b368fd36ddb130b6b17aa8e22d07e2bcf5e31 SHA512 (FreeBSD-14.1-BETA2-arm64-aarch64-dvd1.iso.xz) = ea29444a6643686f760c0f03233140a7fafb0651b56225b4aa8f3912540a2cdb9e0cdfbf5c1440bee01679fd5adc674a1f44e557425d63b02e1c47d8f15aa29e SHA512 (FreeBSD-14.1-BETA2-arm64-aarch64-memstick.img) = 5136072afaec16dc0dec0aa8be019b1183f671f3275653d9f84194699bded87eac74f33ad7fd131060ff2baa2d783cf7416781db473b4539681a54bd96f967ba SHA512 (FreeBSD-14.1-BETA2-arm64-aarch64-memstick.img.xz) = e5b3b59f789f505e2378073d339c271498893d41b90caeaefe10e2dc844cc4d9ab6b7cc4af3133fb567c1c6da13e4d20d9cd39f05620a0f85f4cce3f809782c4 SHA512 (FreeBSD-14.1-BETA2-arm64-aarch64-mini-memstick.img) = 6fe3006b96edc37082f2a5b15850a6234f1267bd71359714a90a73bf4c410ca6543394a934b9899aaf7b77ef51d19cb22cdb464a3c690124945a4b4b45089c25 SHA512 (FreeBSD-14.1-BETA2-arm64-aarch64-mini-memstick.img.xz) = 491998f4b3e1349491ae16c506d4a65b9e94c4d269dac3ad79369ca99add3289df0a090592723baf4c103b27b2c639998ef299e52d45d5580ac0005e2758fe65 SHA256 (FreeBSD-14.1-BETA2-arm64-aarch64-bootonly.iso) = c8e9c5b08b7da0ccb4079746ad28f9a26b18198fd98c27555b2a87f617f71d6e SHA256 (FreeBSD-14.1-BETA2-arm64-aarch64-bootonly.iso.xz) = eccc40313657987c120533a66962366b9109f8b217f4bff162a06528bf3e0b81 SHA256 (FreeBSD-14.1-BETA2-arm64-aarch64-disc1.iso) = 5f67ca3e8607e1498665fa18969a63f1d772212fd8d0d0128c4e4fed634e1759 SHA256 (FreeBSD-14.1-BETA2-arm64-aarch64-disc1.iso.xz) = b65c603c4ef3e9d5dae84183904057e3d69aa98f6ebf8447171230681c84e1d9 SHA256 (FreeBSD-14.1-BETA2-arm64-aarch64-dvd1.iso) = 28a7d0c0ffaac6690114c76e3d285c65df05834553972a078f10caa110d84d51 SHA256 (FreeBSD-14.1-BETA2-arm64-aarch64-dvd1.iso.xz) = 4d04f4699ad37c57cb53e8d8c070a0fbe11a3c14f0204f2260b00394277e09c4 SHA256 (FreeBSD-14.1-BETA2-arm64-aarch64-memstick.img) = e3a02171c602d6ee5e6e502301861a347972f315e131733474c58b704c74296b SHA256 (FreeBSD-14.1-BETA2-arm64-aarch64-memstick.img.xz) = d361e5014496a0afa84624e3b756141bb4d939e3bcc25312484c63d07563e3b4 SHA256 (FreeBSD-14.1-BETA2-arm64-aarch64-mini-memstick.img) = bd25e5da183faeffd8f87226c2557feaaf56b7c61698596db76d6fa0ef6db4db SHA256 (FreeBSD-14.1-BETA2-arm64-aarch64-mini-memstick.img.xz) = 2d5aa7107e1ec1c8ec17f0d6726ed37823302005f54c9b895bb5d31773b8e7c6 o 14.1-BETA2 aarch64 RPI: SHA512 (FreeBSD-14.1-BETA2-arm64-aarch64-RPI.img.xz) = a39d9235775b205d0a1264724b9bc22f6c279a57958d1edb556c72f0bcff1118a0cc4819acd57482262acb9c9aff5492538f87d017a460c18429db140408564b SHA256 (FreeBSD-14.1-BETA2-arm64-aarch64-RPI.img.xz) = 8b2ad2a3ef3e4c6b715244434606b8593e85925935498a775f6e3c4be5421c72 o 14.1-BETA2 aarch64 PINE64: SHA512 (FreeBSD-14.1-BETA2-arm64-aarch64-PINE64.img.xz) = 962ccec812fd995707b3275ff62eadc1d8bf6ff991eed71a045258490a898f1848254e188ff2934a9d36dde325a40d39373737281e439167986904c22462e823 SHA256 (FreeBSD-14.1-BETA2-arm64-aarch64-PINE64.img.xz) = 7c5f1fd4d36d3f4abb759d54d030a614238ccc3252a3be47aa42e42eec1df64f o 14.1-BETA2 aarch64 PINE64-LTS: SHA512 (FreeBSD-14.1-BETA2-arm64-aarch64-PINE64-LTS.img.xz) = 6d38caeaa34585e70201a51c785fc0bb90a3bd8920f2426f99ccf9f11cd4445ecac9b84e02c91fcb9755a8b63dbc009d3cff3fb7b6ad7308b28cd3e31bc67101 SHA256 (FreeBSD-14.1-BETA2-arm64-aarch64-PINE64-LTS.img.xz) = e6b1727d659d224a23fb3e8bf847d1f5c1c63c9028cc4cd231aaabd0db06d1e4 o 14.1-BETA2 aarch64 PINEBOOK: SHA512 (FreeBSD-14.1-BETA2-arm64-aarch64-PINEBOOK.img.xz) = cb14f9f21e48dd41f3121d7210495eaa157ea72a6588e6c46efa1ce9ae429f478ef319d8fcc7342ee2bb7fa69c5caa9c46ef7e117e160783004a4f0564b88615 SHA256 (FreeBSD-14.1-BETA2-arm64-aarch64-PINEBOOK.img.xz) = c5c125a2525018d1f4469e7b720c130137957fde36b8f5382e9ee620f3499958 o 14.1-BETA2 aarch64 ROCK64: SHA512 (FreeBSD-14.1-BETA2-arm64-aarch64-ROCK64.img.xz) = 5390f9efaab559fcbf58a0198754c78675b6a748aa3c490a5cb3ceba29287512788664a20cd11591d203c707c52e4fab6a3ba458ba0daa034f7e3312c0224775 SHA256 (FreeBSD-14.1-BETA2-arm64-aarch64-ROCK64.img.xz) = 980df1a434a2a51e2b01435ec77da5f3ecc471d595b958ada77d4689ce75280a o 14.1-BETA2 aarch64 ROCKPRO64: SHA512 (FreeBSD-14.1-BETA2-arm64-aarch64-ROCKPRO64.img.xz) = f9dd9d2ecd73157b844c93ae25f73ab89059dc5fbd1c5df3eda708882655c6c4cbb0d3413176603b6bb5166109ecd68a8be2d71dcbc54b0b8647ef13959dfd1b SHA256 (FreeBSD-14.1-BETA2-arm64-aarch64-ROCKPRO64.img.xz) = d3de0f8f0bd22d6a0fdba80275285f4610204ccc1a8f44a485430cfe79c861a8 o 14.1-BETA2 riscv64 GENERIC: SHA512 (FreeBSD-14.1-BETA2-riscv-riscv64-bootonly.iso) = be7015e62ca5a26ed11228be868ea2be061abe42bc335a3a8470c60bc520bdc0b0871b110034b4e32b3d86802eaf5194995fae460ffbca09aba357ed6b446548 SHA512 (FreeBSD-14.1-BETA2-riscv-riscv64-bootonly.iso.xz) = 073a4c4b79b9afd807dc1f1a82190f6bedbceec1db22e9d987a5bc1e7991b867e9bd670c9a61b66b62330d33e19481353190452724d539bd5d8863bb5b478d44 SHA512 (FreeBSD-14.1-BETA2-riscv-riscv64-disc1.iso) = 0a065d9a17e3eb782627562620e7357b53708e4d665644a6438c30ef80e045e52166e0710727becdfe05fc3bf584b6acc1c3dcdf61a9ada09565b4d0bf3bb875 SHA512 (FreeBSD-14.1-BETA2-riscv-riscv64-disc1.iso.xz) = 84c4109afb307690e99a1163eeffa4f09158e378f23ccdcbe16f8a2ec9e0f3b4c57ec12e794072be3152373e52659b4363fb9efcb31ea1e519c7fa3c04ca3b8d SHA512 (FreeBSD-14.1-BETA2-riscv-riscv64-memstick.img) = be0e042ac46954cab46c510cffb133925f3e655d0fcbc5140cb1200733341e438e2c2525472658fd8c6072a161cd108d87fa36bef6b6ae8eaea5d213c96e9eff SHA512 (FreeBSD-14.1-BETA2-riscv-riscv64-memstick.img.xz) = 39b2029b4c64bde0a5c9744defb65a57951efcdd21ae831ebcb173514c15546e2b311bf3a0c071e036cbfe267ea64ad138e37a07bd849c6c0a5defa4ca92791f SHA512 (FreeBSD-14.1-BETA2-riscv-riscv64-mini-memstick.img) = a7dd619019c169cdbf1f7fc1c4b094a8c86623bed8c2a3b092082901a5d2931d5907cbcdb1d392f769cfbbe228bda5bbe6bae83dad121ab306e3251d443ac156 SHA512 (FreeBSD-14.1-BETA2-riscv-riscv64-mini-memstick.img.xz) = 8d8a68f4edeb9a956346e9d9109d1819a710b2c8761291483634a3835039e3b8aff7b26ffb90425736d6aede98814c0220e064dc3ebaac252de88272172b6c58 SHA256 (FreeBSD-14.1-BETA2-riscv-riscv64-bootonly.iso) = 2e8846bf4c7d35b009dddd5527e57b96744735a29f05b389f3a19d484d4de158 SHA256 (FreeBSD-14.1-BETA2-riscv-riscv64-bootonly.iso.xz) = 1300f3f77fdf286a496d44e9505050fa72a5ca9ab1d7276afc725922ef8886ce SHA256 (FreeBSD-14.1-BETA2-riscv-riscv64-disc1.iso) = af9fd323fbeb080cec2bf0c379b4d43ac926cc6d29caa47dcdd738cb6c1d75ac SHA256 (FreeBSD-14.1-BETA2-riscv-riscv64-disc1.iso.xz) = 2255da24c4a129d726165fded915f89e8d78c8a7b6435d29137d47e0d944a20a SHA256 (FreeBSD-14.1-BETA2-riscv-riscv64-memstick.img) = 59b5525779f4b73c47ce6093dccab94f1f74b3d059035a81424b88e5d4c72ab9 SHA256 (FreeBSD-14.1-BETA2-riscv-riscv64-memstick.img.xz) = 2ae4d1ed1d45b69e554f3c07a002d38af3c90e4952e49a8e8a46abb83042df9c SHA256 (FreeBSD-14.1-BETA2-riscv-riscv64-mini-memstick.img) = fae43cbfbc646244c8a96c18e9d8940f62909e63e10d9df8d2df266639a39af5 SHA256 (FreeBSD-14.1-BETA2-riscv-riscv64-mini-memstick.img.xz) = e6895142eb5804f8c6fb0aedbda11a4c90385571eefc038bbc8081d8ebc16fe5 o 14.1-BETA2 riscv64 GENERICSD: SHA512 (FreeBSD-14.1-BETA2-riscv-riscv64-GENERICSD.img.xz) = 52738f01255c848e2763a0449805fedf204786b3a05f3cf89922b81535dc3adfa9e5e8374dd94bba32c14d21d0689b07df49f2807e2a1cc25a567403fe01e60a SHA256 (FreeBSD-14.1-BETA2-riscv-riscv64-GENERICSD.img.xz) = b16a69d8e07ede3aa0a782763168ab3bc39ce09f6dfc901c0c6b4f450d1c936a == VM IMAGE CHECKSUMS == o 14.1-BETA2 amd64: SHA512 (FreeBSD-14.1-BETA2-amd64-BASIC-CLOUDINIT-ufs.qcow2.xz) = d2d0d0a7145a3ce5570f2ea1fa2f4642f4b92f4e26bee49aebc8a2c19fa44a2a263204f10ca45244bac24cc64f7a790fee84c3bdbe92fdd4797383e8d61f8d45 SHA512 (FreeBSD-14.1-BETA2-amd64-BASIC-CLOUDINIT-ufs.raw.xz) = e942a881020692a3b43a8ef828f1b19fd701b740cb4a6c0a2f1a3842e7e2d114488ae63543b05385a240dcb20459f57d36f3a312e94f4eda3de3dd5c5d1052ae SHA512 (FreeBSD-14.1-BETA2-amd64-BASIC-CLOUDINIT-zfs.qcow2.xz) = 60564f686d47ad9cba1345ad8ba14fc6b4aca74fe9564cdd97e92b7739a86faf08c053d97f8cbb2379c2da171fdcdc848e7e91b64dcba1c65ed8add7256b406e SHA512 (FreeBSD-14.1-BETA2-amd64-BASIC-CLOUDINIT-zfs.raw.xz) = b0defccbdac1b9c2e59fb043bf09087bc2c7413711d296b9f7422a3cfdcec98140f53fcf4566b035a1dc508981905bd990b21be645dbb9677a8fbb0fd6526360 SHA512 (FreeBSD-14.1-BETA2-amd64.qcow2.xz) = a1930328b4b081195ca84a8a42a8447a62c613de2bc516e6c0b3c6775d82df6d219279ce62f15cbf40f07929416e5f5b26becba937c85937f77b1abc04f1e0b2 SHA512 (FreeBSD-14.1-BETA2-amd64.raw.xz) = e8df32317a5f2bb86522cf3f53b2552584e5bcd2cd26bfbc3d61419966db0b239a7ba1d3b62c9e41dfd8c76345a6cbf7f38abcdebbe82a3a1959df5db79e73aa SHA512 (FreeBSD-14.1-BETA2-amd64.vhd.xz) = 3738590eac14d942bdd59ec1caf004513378f240c44ad85fa3abb20a0ad8637bb89d5a289fbd9e09fad0863667414550fca016a213f94980113ab5d3cc45dbea SHA512 (FreeBSD-14.1-BETA2-amd64.vmdk.xz) = 4b3a74da379c0240bd28ee9bdfe8c9523f239c2fb7817ded0c58fabca23a66611a3eff8a151a0f1ceaa1e7d46721130b1ce67ac01cb5c91442921ad1f191f18f SHA256 (FreeBSD-14.1-BETA2-amd64-BASIC-CLOUDINIT-ufs.qcow2.xz) = f0288df1019cb821b620af98df29809c126d429c55683a9b5939a70d30320d50 SHA256 (FreeBSD-14.1-BETA2-amd64-BASIC-CLOUDINIT-ufs.raw.xz) = b38146202d60d5fd476da702e4a70d0d37ddfc9c5c5bd0e30e99425eaeea3993 SHA256 (FreeBSD-14.1-BETA2-amd64-BASIC-CLOUDINIT-zfs.qcow2.xz) = 2b764d7dd26a4fe27b16558f05ce4d47112fb07e87779f5e6d93635e05dca55c SHA256 (FreeBSD-14.1-BETA2-amd64-BASIC-CLOUDINIT-zfs.raw.xz) = 195c6ce2ed961e945b8358b4b056b553b7f1edb95e7e5cff141a14a1ed4b4261 SHA256 (FreeBSD-14.1-BETA2-amd64.qcow2.xz) = 3ec54814bd0849c23070061a4cb190ac9f61e442ca6d7813505edc451e904818 SHA256 (FreeBSD-14.1-BETA2-amd64.raw.xz) = 88802a79e765c669c3b25747b98bd01cfb3babeb7c8b3f44580df2b19f31cd08 SHA256 (FreeBSD-14.1-BETA2-amd64.vhd.xz) = f07d5aeb0300ce5f627fe8cacba7ea18a84b03f753396a12d8b21212b651ab22 SHA256 (FreeBSD-14.1-BETA2-amd64.vmdk.xz) = 1abc89bc1d9ca32efba7370acae3b8448230f813f25f43c54a5faa1f164bdb7c o 14.1-BETA2 i386: SHA512 (FreeBSD-14.1-BETA2-i386-ufs.qcow2.xz) = 343939ce0fe1dadc509db2223661ac57da3689309dd04536dcfd61b7739cc7c98504e06c7d4923c374dc018173e97f080da1706da7ebb1ff1551b95a64eb4257 SHA512 (FreeBSD-14.1-BETA2-i386-ufs.raw.xz) = f464d8f64a2673953ab8f7a194225cacbdb239663767d8be9fa55024ab489e1ba99b183e103f2a2ac9dd6645d112e55fd3ada2b89ca4b0cd1b62be038a3b9438 SHA512 (FreeBSD-14.1-BETA2-i386-ufs.vhd.xz) = 90cd9a24fdc39cf76005b7072b8bd6d12cf4eea5fbc15a9d5a94cafc554826aa734c9ab34fd1939a77808677634771d7d694f3ad97bf28337ede0918247d94df SHA512 (FreeBSD-14.1-BETA2-i386-ufs.vmdk.xz) = c4d968eb5be9490b9e3f756ff5820af2f7dc0b9c3a7d6c6c8d4b665e2ff4ce0612bfd79aa4feac9c8431c1ed8b486d1c2b497e09cfdf3bb0244674ba5f087ee8 SHA512 (FreeBSD-14.1-BETA2-i386-zfs.qcow2.xz) = 9f1a00b2b90c66c19ac7063e907757eec8beee77035b07f75862572d69183b205e1f9234a2e41b2b3faae07202383d04063e119fbce6f6194779125b4d83cd4b SHA512 (FreeBSD-14.1-BETA2-i386-zfs.raw.xz) = a5dc39afab44cd76d2dfb9e9a43161deb85cf9ff5151a2a49cf5a010945ff1aeabeb87722d211877dc43e46a53aeb598242afb4d9e15c09c8d1a37a5486987d0 SHA512 (FreeBSD-14.1-BETA2-i386-zfs.vhd.xz) = 804aa8b4e4d5dc43d50b048c0d361ebd4a2c88a4125b9c8ac5b298014c9d09aaea0955da13b1a7ceef9b03beabf5f1893ed5cd8c53aab9c881b94f38e4d56297 SHA512 (FreeBSD-14.1-BETA2-i386-zfs.vmdk.xz) = 1a3f13c7748f34dce225651210d32a6da874440847e1a0a816e42c71446b7135d164b70266ba3ea5de2adbb64c5f20ba788c31cc64ef63d881b2e5b6a8fd0a51 SHA512 (FreeBSD-14.1-BETA2-i386.qcow2.xz) = 343939ce0fe1dadc509db2223661ac57da3689309dd04536dcfd61b7739cc7c98504e06c7d4923c374dc018173e97f080da1706da7ebb1ff1551b95a64eb4257 SHA512 (FreeBSD-14.1-BETA2-i386.raw.xz) = f464d8f64a2673953ab8f7a194225cacbdb239663767d8be9fa55024ab489e1ba99b183e103f2a2ac9dd6645d112e55fd3ada2b89ca4b0cd1b62be038a3b9438 SHA512 (FreeBSD-14.1-BETA2-i386.vhd.xz) = 90cd9a24fdc39cf76005b7072b8bd6d12cf4eea5fbc15a9d5a94cafc554826aa734c9ab34fd1939a77808677634771d7d694f3ad97bf28337ede0918247d94df SHA512 (FreeBSD-14.1-BETA2-i386.vmdk.xz) = c4d968eb5be9490b9e3f756ff5820af2f7dc0b9c3a7d6c6c8d4b665e2ff4ce0612bfd79aa4feac9c8431c1ed8b486d1c2b497e09cfdf3bb0244674ba5f087ee8 SHA256 (FreeBSD-14.1-BETA2-i386-ufs.qcow2.xz) = 51a771e93c870ade923acd785b0f8f7aa3773b4be8d46dacd9ed7cc593c2e97f SHA256 (FreeBSD-14.1-BETA2-i386-ufs.raw.xz) = e54e1f13d3b1eca84eaa52b7835f1de62ee0e81164ef5f0f033da956d4eb85b0 SHA256 (FreeBSD-14.1-BETA2-i386-ufs.vhd.xz) = 57ac62b3975e03382700d628e9f37b12197324c39f46042e6621e10d366b4a8e SHA256 (FreeBSD-14.1-BETA2-i386-ufs.vmdk.xz) = f588c169bfa52d08601dd93883ec61a0e61aed79c6bbf112b107bd5aea304143 SHA256 (FreeBSD-14.1-BETA2-i386-zfs.qcow2.xz) = c6c801e9c60062a0be33894c4b0feb6a185ab74f78314e9f3fb57ee72d19280f SHA256 (FreeBSD-14.1-BETA2-i386-zfs.raw.xz) = 07c70cf1041fadfd3cbce0814dcc3259bf04078fd6f941534dfe89f571c80d9c SHA256 (FreeBSD-14.1-BETA2-i386-zfs.vhd.xz) = 21d22cfcfe8800f6925e84a2f81b7940d848d265533594235d2dc54d1f0a0637 SHA256 (FreeBSD-14.1-BETA2-i386-zfs.vmdk.xz) = 7f4601043695efd6f026744ee82ec954d76a577a2256937dbd546f116e90459e SHA256 (FreeBSD-14.1-BETA2-i386.qcow2.xz) = 51a771e93c870ade923acd785b0f8f7aa3773b4be8d46dacd9ed7cc593c2e97f SHA256 (FreeBSD-14.1-BETA2-i386.raw.xz) = e54e1f13d3b1eca84eaa52b7835f1de62ee0e81164ef5f0f033da956d4eb85b0 SHA256 (FreeBSD-14.1-BETA2-i386.vhd.xz) = 57ac62b3975e03382700d628e9f37b12197324c39f46042e6621e10d366b4a8e SHA256 (FreeBSD-14.1-BETA2-i386.vmdk.xz) = f588c169bfa52d08601dd93883ec61a0e61aed79c6bbf112b107bd5aea304143 o 14.1-BETA2 aarch64: SHA512 (FreeBSD-14.1-BETA2-arm64-aarch64-ufs.qcow2.xz) = 6f3b79118c5668576d6e786840d9e7bcf2a4da26c96ca84eb992b83844c6fa3b71ab0529fd056e16392df925111754f6421582a41ea49a906cab68817de69b7b SHA512 (FreeBSD-14.1-BETA2-arm64-aarch64-ufs.raw.xz) = 4e8cd4a54cf6b27622382951e20b8bd9810154cc8bd5a064fa408c4405d900448743548ca6e3a625b4263a1636a4bfda44732e7870cdac187da5a37dd2fa3f52 SHA512 (FreeBSD-14.1-BETA2-arm64-aarch64-ufs.vhd.xz) = d9c3db239f4c22ca583917bb8f49a3193524ddf302d6305cf2be76983fdbf7d556436b960d257367d39191e07d13b04d2d0657c99ee0569cf5b393f3725cf3d7 SHA512 (FreeBSD-14.1-BETA2-arm64-aarch64-ufs.vmdk.xz) = e9cf319958f339c163bf41a2c20abf9342272920e8f0a0273f86bc6b967a3114ec56ec3684cd51d0c6957b0c40393f3b5bc95276584a5055768e026ea8bed905 SHA512 (FreeBSD-14.1-BETA2-arm64-aarch64-zfs.qcow2.xz) = 251a6f529c2ff49c27b236da0fb2dcad7aae644d4642a584b2a40745e33baa823e5ee6cb87f6e678462c2c6d9ae50137263111601bd1b2c19fc09d944b0ce82f SHA512 (FreeBSD-14.1-BETA2-arm64-aarch64-zfs.raw.xz) = 4b66af4a37dfb8fda9687bc758385f6f2115c22b917d2c089cdafe587d42d6036b97e96d1792a2431e51a915746d1e2775887d0013e736a3bd43a84df14fe54b SHA512 (FreeBSD-14.1-BETA2-arm64-aarch64-zfs.vhd.xz) = 4e7975eaa2bcdf5f46e1fc16cd74b6088bfa7978c9173527eb50a0f784356b561bc006ae81e96a07e985cbaf8b4846c01148126cc07fe1eab4a6a97b9bd8586d SHA512 (FreeBSD-14.1-BETA2-arm64-aarch64-zfs.vmdk.xz) = f21a0a0195fdf7fdbcb0ef9c1a483ffaee425f108a3e2c611d3dd35e87be442c72f0ff05729f8864d05538c6e1c10a5fa6ac466bceda2cf5263d56c22276cad7 SHA512 (FreeBSD-14.1-BETA2-arm64-aarch64.qcow2.xz) = 6f3b79118c5668576d6e786840d9e7bcf2a4da26c96ca84eb992b83844c6fa3b71ab0529fd056e16392df925111754f6421582a41ea49a906cab68817de69b7b SHA512 (FreeBSD-14.1-BETA2-arm64-aarch64.raw.xz) = 4e8cd4a54cf6b27622382951e20b8bd9810154cc8bd5a064fa408c4405d900448743548ca6e3a625b4263a1636a4bfda44732e7870cdac187da5a37dd2fa3f52 SHA512 (FreeBSD-14.1-BETA2-arm64-aarch64.vhd.xz) = d9c3db239f4c22ca583917bb8f49a3193524ddf302d6305cf2be76983fdbf7d556436b960d257367d39191e07d13b04d2d0657c99ee0569cf5b393f3725cf3d7 SHA512 (FreeBSD-14.1-BETA2-arm64-aarch64.vmdk.xz) = e9cf319958f339c163bf41a2c20abf9342272920e8f0a0273f86bc6b967a3114ec56ec3684cd51d0c6957b0c40393f3b5bc95276584a5055768e026ea8bed905 SHA256 (FreeBSD-14.1-BETA2-arm64-aarch64-ufs.qcow2.xz) = ae4f3bbac00ec89e89806b1d31c7b49102a0c09503cb344ba386c7f7e69d842d SHA256 (FreeBSD-14.1-BETA2-arm64-aarch64-ufs.raw.xz) = 7ea290a6a2fcc9887a6afee4b3f700f0e3b08108d82bae5be418bb0d31863d05 SHA256 (FreeBSD-14.1-BETA2-arm64-aarch64-ufs.vhd.xz) = 599a15f799131bbc16d921e2debb344a15950c3a87612f40b215d7d0400dd976 SHA256 (FreeBSD-14.1-BETA2-arm64-aarch64-ufs.vmdk.xz) = 42f64850af84b90848c4357141b3655161674a45e5cbd2699817937c578b9e07 SHA256 (FreeBSD-14.1-BETA2-arm64-aarch64-zfs.qcow2.xz) = 92f17a52ebff5f703a032340a22bdf0cb4e0d3c6bff2c5d1e9352397e0e6ef36 SHA256 (FreeBSD-14.1-BETA2-arm64-aarch64-zfs.raw.xz) = 76d7ee06189796ab86331037225204f5412b46718d9ca9bb77e4eae34354ea5a SHA256 (FreeBSD-14.1-BETA2-arm64-aarch64-zfs.vhd.xz) = e76fde228bea463c698321b712ea1d526a0dfb3f376744b3e3ecb0d4b9fa92e0 SHA256 (FreeBSD-14.1-BETA2-arm64-aarch64-zfs.vmdk.xz) = 95a43ef2356e39ec81430cbfbd897437ca6da6747340e7dbff2d07a7ac6b459b SHA256 (FreeBSD-14.1-BETA2-arm64-aarch64.qcow2.xz) = ae4f3bbac00ec89e89806b1d31c7b49102a0c09503cb344ba386c7f7e69d842d SHA256 (FreeBSD-14.1-BETA2-arm64-aarch64.raw.xz) = 7ea290a6a2fcc9887a6afee4b3f700f0e3b08108d82bae5be418bb0d31863d05 SHA256 (FreeBSD-14.1-BETA2-arm64-aarch64.vhd.xz) = 599a15f799131bbc16d921e2debb344a15950c3a87612f40b215d7d0400dd976 SHA256 (FreeBSD-14.1-BETA2-arm64-aarch64.vmdk.xz) = 42f64850af84b90848c4357141b3655161674a45e5cbd2699817937c578b9e07 o 14.1-BETA2 riscv64: SHA512 (FreeBSD-14.1-BETA2-riscv-riscv64-ufs.qcow2.xz) = 034b32f1138322638c7a5b7949a3b184c6a4cdfd003360a496c08c56c2cc645c94fbe9cdf9d84c963af6dda6c442717cd61d7e1cecf7024bd463f6f5196c5527 SHA512 (FreeBSD-14.1-BETA2-riscv-riscv64-ufs.raw.xz) = 034b32f1138322638c7a5b7949a3b184c6a4cdfd003360a496c08c56c2cc645c94fbe9cdf9d84c963af6dda6c442717cd61d7e1cecf7024bd463f6f5196c5527 SHA512 (FreeBSD-14.1-BETA2-riscv-riscv64-ufs.vhd.xz) = 034b32f1138322638c7a5b7949a3b184c6a4cdfd003360a496c08c56c2cc645c94fbe9cdf9d84c963af6dda6c442717cd61d7e1cecf7024bd463f6f5196c5527 SHA512 (FreeBSD-14.1-BETA2-riscv-riscv64-ufs.vmdk.xz) = 034b32f1138322638c7a5b7949a3b184c6a4cdfd003360a496c08c56c2cc645c94fbe9cdf9d84c963af6dda6c442717cd61d7e1cecf7024bd463f6f5196c5527 SHA512 (FreeBSD-14.1-BETA2-riscv-riscv64-zfs.qcow2.xz) = 84b827acfe32a805b4f0d9bb5721e8692cc4375bd1e9fecbc54eca1f5ab7a966e9c20971df39641eddf3103e31d5513800b7c150fc898f461a2cd811acec8f48 SHA512 (FreeBSD-14.1-BETA2-riscv-riscv64-zfs.raw.xz) = aef908c2c640bde652431474737f1e7b669a5bd446fba7506868e59e2f06a962f8103c38168aeb5f102263f03c5315175905d95876f00245379e34ed0bb6ebdb SHA512 (FreeBSD-14.1-BETA2-riscv-riscv64-zfs.vhd.xz) = 84f10bb77fba2aebe9425f7a3dbfc428660eae968eccb7849b948d3ee614d576200dd23e7df01bf4b69698337f86ab0bbdfe19b817cb47bb64f33c4d72bb1461 SHA512 (FreeBSD-14.1-BETA2-riscv-riscv64-zfs.vmdk.xz) = e59535d100484906e840e65c2381c87f190d12c1132ce849a36cb55647eb6ffa627739435190954355efd9250b1182a14ef131edce1f3140f7095df194a0b691 SHA512 (FreeBSD-14.1-BETA2-riscv-riscv64.qcow2.xz) = 034b32f1138322638c7a5b7949a3b184c6a4cdfd003360a496c08c56c2cc645c94fbe9cdf9d84c963af6dda6c442717cd61d7e1cecf7024bd463f6f5196c5527 SHA512 (FreeBSD-14.1-BETA2-riscv-riscv64.raw.xz) = 034b32f1138322638c7a5b7949a3b184c6a4cdfd003360a496c08c56c2cc645c94fbe9cdf9d84c963af6dda6c442717cd61d7e1cecf7024bd463f6f5196c5527 SHA512 (FreeBSD-14.1-BETA2-riscv-riscv64.vhd.xz) = 034b32f1138322638c7a5b7949a3b184c6a4cdfd003360a496c08c56c2cc645c94fbe9cdf9d84c963af6dda6c442717cd61d7e1cecf7024bd463f6f5196c5527 SHA512 (FreeBSD-14.1-BETA2-riscv-riscv64.vmdk.xz) = 034b32f1138322638c7a5b7949a3b184c6a4cdfd003360a496c08c56c2cc645c94fbe9cdf9d84c963af6dda6c442717cd61d7e1cecf7024bd463f6f5196c5527 SHA256 (FreeBSD-14.1-BETA2-riscv-riscv64-ufs.qcow2.xz) = 0040f94d11d0039505328a90b2ff48968db873e9e7967307631bf40ef5679275 SHA256 (FreeBSD-14.1-BETA2-riscv-riscv64-ufs.raw.xz) = 0040f94d11d0039505328a90b2ff48968db873e9e7967307631bf40ef5679275 SHA256 (FreeBSD-14.1-BETA2-riscv-riscv64-ufs.vhd.xz) = 0040f94d11d0039505328a90b2ff48968db873e9e7967307631bf40ef5679275 SHA256 (FreeBSD-14.1-BETA2-riscv-riscv64-ufs.vmdk.xz) = 0040f94d11d0039505328a90b2ff48968db873e9e7967307631bf40ef5679275 SHA256 (FreeBSD-14.1-BETA2-riscv-riscv64-zfs.qcow2.xz) = 41f8007534a4543910508fe484cc504f3f60ee0bea5834358c5f8b31b0bf2bb3 SHA256 (FreeBSD-14.1-BETA2-riscv-riscv64-zfs.raw.xz) = e07a4be51d049266eae52e5b6e6b04106f794c7fc5716825a4f926e3fe872d83 SHA256 (FreeBSD-14.1-BETA2-riscv-riscv64-zfs.vhd.xz) = 71f561a0023f93f6d707d1f9bcb49878ddae413863ca646973ece044c4190cd0 SHA256 (FreeBSD-14.1-BETA2-riscv-riscv64-zfs.vmdk.xz) = 389778e146b61da1bc9c28d97a0fb69d141234fedcff0658a8d6ca52683e5550 SHA256 (FreeBSD-14.1-BETA2-riscv-riscv64.qcow2.xz) = 0040f94d11d0039505328a90b2ff48968db873e9e7967307631bf40ef5679275 SHA256 (FreeBSD-14.1-BETA2-riscv-riscv64.raw.xz) = 0040f94d11d0039505328a90b2ff48968db873e9e7967307631bf40ef5679275 SHA256 (FreeBSD-14.1-BETA2-riscv-riscv64.vhd.xz) = 0040f94d11d0039505328a90b2ff48968db873e9e7967307631bf40ef5679275 SHA256 (FreeBSD-14.1-BETA2-riscv-riscv64.vmdk.xz) = 0040f94d11d0039505328a90b2ff48968db873e9e7967307631bf40ef5679275 Love FreeBSD? Support this and future releases with a donation to the FreeBSD Foundation! https://www.freebsdfoundation.org/donate/ -----BEGIN PGP SIGNATURE----- iQIzBAEBCgAdFiEEglY7hNBiDtwN+4ZBOJfy4i5lrT8FAmZA4ncACgkQOJfy4i5l rT9ClA//ZkIYc+wSi1g2x+wORQjSMIxm79vDfXQIcvzxhpIzvk/C0mSXC7k99Cfk j/vLeag3pZqCvYABm1SSbMiBZDeXUiRZ1P2fNapvqQZ6j4SzPROTxI8o/1OFWKzz virkaS3vM0x9f4ormjAr85ZkMmowCZM0A9mrlz3TDrlVXWCyJqSYpT1Ghjytpj4z 0ti1eO0NScssAqO2ix67m1wlNELnNA4u2KNNn1Dm0lfIBU1rNhGl50MTdHcGKGLY Xg1qjUJEHcUEwKZ0Mx0gNYBb0hINByA5EwadGPapRAO22wfmHrlH2M3VjHTgsGQo asYbbrNZ5kZCmgQNfAu+HbEStMixpCrwxRhKQqQrV34PaTRdgZ+cNcbTW1Eas+G5 tkTqHT7DBSD/P+j4NYZ1Qezp1yRkZPUcQF7b7oisLIXhJ0cY5Zl2sZWjHMAgyBY3 ze1QhCeYCLjzxz7hZr8XdOzdDTcCZ/abjh6+n/E/9kdilii0sK2McqBiCzXsf2RO Y1IvtDZ1aZ/JPtBUH3Vkj01aRSVkQyup4LTkMhdg5QCYdk7iG7eFNc6zDJcFkiwr iyPEQJ9r1VnLdXzHe2SZ9L2wScYLJgL/bbmqYr7zwx8jB98eKq1c8qQT+gMkZFHa WOF8ikDRu6yejjoSCQGWmCqUAPLL/vitIReO5i3WGRHAHbrk5dg= =6c0T -----END PGP SIGNATURE-----