From nobody Sun Sep 17 00:39:50 2023 X-Original-To: freebsd-stable@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4Rp8GF1kQhz4tLcD for ; Sun, 17 Sep 2023 00:40:05 +0000 (UTC) (envelope-from junchoon@dec.sakura.ne.jp) Received: from www121.sakura.ne.jp (www121.sakura.ne.jp [153.125.133.21]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4Rp8G94072z3ZVh for ; Sun, 17 Sep 2023 00:40:00 +0000 (UTC) (envelope-from junchoon@dec.sakura.ne.jp) Authentication-Results: mx1.freebsd.org; dkim=none; spf=none (mx1.freebsd.org: domain of junchoon@dec.sakura.ne.jp has no SPF policy when checking 153.125.133.21) smtp.mailfrom=junchoon@dec.sakura.ne.jp; dmarc=none Received: from kalamity.joker.local (123-1-88-210.area1b.commufa.jp [123.1.88.210]) (authenticated bits=0) by www121.sakura.ne.jp (8.16.1/8.16.1/[SAKURA-WEB]/20201212) with ESMTPA id 38H0dpEY031471; Sun, 17 Sep 2023 09:39:51 +0900 (JST) (envelope-from junchoon@dec.sakura.ne.jp) Date: Sun, 17 Sep 2023 09:39:50 +0900 From: Tomoaki AOKI To: Jake Freeland , Warner Losh Cc: FreeBSD-STABLE Mailing List Subject: Re: Is there any plan for ZFS and timerfd updates on stable/14? Message-Id: <20230917093950.0dbe3eefb1c34d61dea8adef@dec.sakura.ne.jp> In-Reply-To: <20230903133328.54577b85b097da319ecde4ba@dec.sakura.ne.jp> References: <20230903123028.4ffceb705824f86d2efc21e3@dec.sakura.ne.jp> <20230903133328.54577b85b097da319ecde4ba@dec.sakura.ne.jp> Organization: Junchoon corps X-Mailer: Sylpheed 3.7.0 (GTK+ 2.24.33; amd64-portbld-freebsd14.0) List-Id: Production branch of FreeBSD source code List-Archive: https://lists.freebsd.org/archives/freebsd-stable List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-stable@freebsd.org X-BeenThere: freebsd-stable@freebsd.org Mime-Version: 1.0 Content-Type: multipart/mixed; boundary="Multipart=_Sun__17_Sep_2023_09_39_50_+0900_e5eQYjc5MKn/Pcke" X-Spamd-Bar: + X-Spamd-Result: default: False [1.35 / 15.00]; NEURAL_HAM_LONG(-1.00)[-1.000]; AUTH_NA(1.00)[]; SUBJECT_ENDS_QUESTION(1.00)[]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; NEURAL_SPAM_SHORT(0.85)[0.849]; MV_CASE(0.50)[]; ONCE_RECEIVED(0.10)[]; MIME_GOOD(-0.10)[multipart/mixed,text/plain,text/x-diff]; TO_MATCH_ENVRCPT_SOME(0.00)[]; ARC_NA(0.00)[]; DMARC_NA(0.00)[sakura.ne.jp]; RCPT_COUNT_THREE(0.00)[3]; FROM_HAS_DN(0.00)[]; R_DKIM_NA(0.00)[]; RCVD_VIA_SMTP_AUTH(0.00)[]; MID_RHS_MATCH_FROM(0.00)[]; TO_DN_ALL(0.00)[]; HAS_ORG_HEADER(0.00)[]; HAS_ATTACHMENT(0.00)[]; R_SPF_NA(0.00)[no SPF record]; RCVD_COUNT_ONE(0.00)[1]; RCVD_TLS_LAST(0.00)[]; FROM_EQ_ENVFROM(0.00)[]; ASN(0.00)[asn:7684, ipnet:153.125.128.0/18, country:JP]; MIME_TRACE(0.00)[0:+,1:+,2:+]; MLMMJ_DEST(0.00)[freebsd-stable@freebsd.org] X-Rspamd-Queue-Id: 4Rp8G94072z3ZVh This is a multi-part message in MIME format. --Multipart=_Sun__17_Sep_2023_09_39_50_+0900_e5eQYjc5MKn/Pcke Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: 8bit On Sun, 3 Sep 2023 13:33:28 +0900 Tomoaki AOKI wrote: > On Sat, 2 Sep 2023 22:47:53 -0500 > Jake Freeland wrote: > > > On Sat, Sep 2, 2023 at 10:40 PM Warner Losh wrote: > > > > > > > > > > > On Sat, Sep 2, 2023, 9:36 PM Jake Freeland > > > wrote: > > > > > >> On Sat, Sep 2, 2023 at 10:31 PM Tomoaki AOKI > > >> wrote: > > >> > > >>> Hi. > > >>> > > >>> There are discussions about deadlocks issue of ZFS on freebsd-current > > >>> ML, starting from [1] last month. > > >>> IIRC, at least some fixes (candidates?) are merged to main, but not yet > > >>> to stable/14. > > >>> > > >>> Upcoming (aleready released? or still rc3?) OpenZFS 2.2-release seems > > >>> to have most of them. So my 1st question is "Is there any plan to > > >>> import vendor/openzfs/zfs-2.2-release into stable/14 BEFORE BRANCHING > > >>> releng/14? > > >>> > > >>> And one more. timerfd is added at last-minutes BEFORE stable/14 is > > >>> branched, and already have not-yet-MFC'ed fixes [2], [3], [4] and > > >>> Differential revision D41600 on Phablicator [5] related to memory leaks > > >>> and locks. > > >>> Additionally, splitting out lib32 part to proper place is proposed > > >>> as D41640 [6]. Both [5] and [6] are accepted but not yet landed. > > >>> Also, D41641 [7] proposes namespace pollution adjustments. This can be > > >>> optional? > > >>> > > >>> Memory leaks and improper locks can lead system to security issues or > > >>> deadlocks, so it would be benefical if landed and MFC'ed BEFORE > > >>> releng/14 branches. > > >>> > > >>> Is there any plan to do so? At least, existing deadlocks should be > > >>> considered as SHOW-STOPPER and resolved. > > >>> > > >> > > >> The plan is to get all of those patches in before releng/14.0, I believe. > > >> > > >> What are your thoughts, Warner? > > >> > > > > > > Sounds like the reviews are done or nearly so. I've not had time to look > > > closely to be sure... I'd planned on making time Tuesday morning. > > > > > > > Yes. All reviews are good to go. > > > > Jake Freeland > > Glad to know. Thanks! > Looking forward to see them landed / MFC'ed before releng/14 branches. > > Regards. > > > > > > > > > > > Warner > > > > > > > > >> Thanks, > > >> Jake Freeland > > >> > > >> > > >>> > > >>> I myself am bitten by several deadlocks on poudriere full builds after > > >>> upgrading base from stable/13 to stable/14, finally finished with > > >>> increasing kern.maxvnodes after powercycle on each deadlock and > > >>> continue. > > >>> > > >>> > > >>> Thanks in advance! > > >>> > > >>> [1] > > >>> > > >>> https://lists.freebsd.org/archives/freebsd-current/2023-August/004162.html > > >>> > > >>> [2] > > >>> > > >>> https://cgit.freebsd.org/src/commit/?id=02f534b57f84d6f4f97c337b05b383c8b3aaf18c > > >>> > > >>> [3] > > >>> > > >>> https://cgit.freebsd.org/src/commit/?id=5eab523053db79b4bd4f926c7d7ac04444d9c1da > > >>> > > >>> [4] > > >>> > > >>> https://cgit.freebsd.org/src/commit/?id=f4296cfb409a48de00bfa60e76f686c2b031876f > > >>> > > >>> [5] https://reviews.freebsd.org/D41600 > > >>> > > >>> [6] https://reviews.freebsd.org/D41640 > > >>> > > >>> [7] https://reviews.freebsd.org/D41641 > > >>> > > >>> -- > > >>> Tomoaki AOKI > > -- > Tomoaki AOKI Hi. Thanks for your hard work on it. I could confirm commits to main as below, but they are not yet MFC'ed/MFS'/ed. It would be nice these commits to be incorporated at worst on first RC. Any plans for MFC and following MFS? commit 02f534b57f84d6f4f97c337b05b383c8b3aaf18c timerfd: fix up a memory leak and missing locking commit 5eab523053db79b4bd4f926c7d7ac04444d9c1da timerfd: compute fflags before calling falloc commit f4296cfb409a48de00bfa60e76f686c2b031876f timerfd: convert timerfd_list_lock from sx to mtx commit a1f506156c4db885d3cc177c93e9c8a28d535d30 timerfd: Define a locking regime commit 918966a27479b4fb7c4c8999c4926d83c2c081e5 timerfd: Relocate 32-bit compat code commit fb5daae920bae84e3eec8175bf9e46304c3b2ae6 timerfd: Namespace pollution adjustments Note that first 3 commits are authord/committed by mjg@. These are all I could confirm landed with commit histories of sys/kern/sys_timerfd.c and sys/sys/timerfd.c, excluding already-in-stable/14 one. I've found a related commit to sys/compat/linux/linux_event.c but intentionally excluded it, as it's already MFC'ed and MFS'ed. And I found another request on dev-commits-src-main ML archive [1], without any reply. Attached is the hand-merged patch to cherry pick them to stable/14, created before last 3 commits landed on main. HTH. [1] https://lists.freebsd.org/archives/dev-commits-src-main/2023-September/018407.html Regards. -- Tomoaki AOKI --Multipart=_Sun__17_Sep_2023_09_39_50_+0900_e5eQYjc5MKn/Pcke Content-Type: text/x-diff; name="MFC_git_02f534b57f84_5eab523053db_f4296cfb409a_D41600_D41640_D41641-Fix_up_memory_leak_and_missing_locking-kern_sys__timerfd.c.diff" Content-Disposition: attachment; filename="MFC_git_02f534b57f84_5eab523053db_f4296cfb409a_D41600_D41640_D41641-Fix_up_memory_leak_and_missing_locking-kern_sys__timerfd.c.diff" Content-Transfer-Encoding: 7bit author Mateusz Guzik 2023-08-25 14:21:39 +0000 committer Mateusz Guzik 2023-08-25 14:46:48 +0000 commit 02f534b57f84d6f4f97c337b05b383c8b3aaf18c (patch) tree 6fa7b496057ecf6bf50e6e3e90f59701784898c4 parent 1554ba03b651319ab0e1cde8492ea4516afc648b (diff) download src-02f534b57f84d6f4f97c337b05b383c8b3aaf18c.tar.gz src-02f534b57f84d6f4f97c337b05b383c8b3aaf18c.zip timerfd: fix up a memory leak and missing locking timerfd01 from ltp passes (and some other don't), but none of the tests crash the kernel. This is a bare minimum patch to fix up the immediate regression. Reported by: yasu Diffstat -rw-r--r-- sys/kern/sys_timerfd.c 31 1 files changed, 21 insertions, 10 deletions author Mateusz Guzik 2023-08-25 15:09:21 +0000 committer Mateusz Guzik 2023-08-25 15:09:21 +0000 commit 5eab523053db79b4bd4f926c7d7ac04444d9c1da (patch) tree f02acc2778545722abe65a35a9866b45d8912970 parent 02f534b57f84d6f4f97c337b05b383c8b3aaf18c (diff) download src-5eab523053db79b4bd4f926c7d7ac04444d9c1da.tar.gz src-5eab523053db79b4bd4f926c7d7ac04444d9c1da.zip timerfd: compute fflags before calling falloc While here dodge list locking in timerfd_adjust if empty. Diffstat -rw-r--r-- sys/kern/sys_timerfd.c 12 1 files changed, 8 insertions, 4 deletions Author Mateusz Guzik 2023-09-02 09:55:50 +0000 committer Mateusz Guzik 2023-09-02 09:55:50 +0000 commit f4296cfb409a48de00bfa60e76f686c2b031876f (patch) tree 0cc429e199d2e67c6067f668e277c3033c58b76d parent 07bc20e4740d09f554c3787bb1940fc503300822 (diff) download src-f4296cfb409a48de00bfa60e76f686c2b031876f.tar.gz src-f4296cfb409a48de00bfa60e76f686c2b031876f.zip timerfd: convert timerfd_list_lock from sx to mtx There was no good reason to use the former. This should prevent some head-scratching by an interested and qualified reader. Diffstat -rw-r--r-- sys/kern/sys_timerfd.c 16 1 files changed, 8 insertions, 8 deletions Define a locking regime for the members of struct timerfd and document it so future code can follow the standard. The lock legend can be found in a comment above struct timerfd. Additionally, * Add assertions based on locking regime. * Fill kn_data with the expiration count when EVFILT_READ is triggered. * Report st_ctim for stat(2). * Check if file has f_type == DTYPE_TIMERFD before assigning timerfd pointer to f_data. 32-bit compatibility code is conventionally stored in sys/compat/freebsd32. Move freebsd32_timerfd_gettime() and freebsd32_timerfd_settime() from sys/kern/sys_timerfd.c to sys/compat/freebsd32/freebsd32_misc.c. Do not pollute userspace with , instead declare struct thread when _KERNEL is defined. Include instead of . This causes intentional namespace pollution that mimics Linux. g/musl libcs include in their , exposing timerfd_gettime() and CLOCK_ macro constants. Ports like Chromium expect this namespace pollution and fail without it. diff --git a/sys/kern/sys_timerfd.c b/sys/kern/sys_timerfd.c index 6948fa059b8c..c8b45a926b02 100644 --- a/sys/kern/sys_timerfd.c +++ b/sys/kern/sys_timerfd.c @@ -43,6 +43,7 @@ #include #include #include +#include #include #include #include @@ -53,13 +54,12 @@ #include -#ifdef COMPAT_FREEBSD32 -#include -#include -#endif - static MALLOC_DEFINE(M_TIMERFD, "timerfd", "timerfd structures"); -static LIST_HEAD(, timerfd) timerfd_head; + +static struct mtx timerfd_list_lock; +static LIST_HEAD(, timerfd) timerfd_list; +MTX_SYSINIT(timerfd, &timerfd_list_lock, "timerfd_list_lock", MTX_DEF); + static struct unrhdr64 tfdino_unr; #define TFD_NOJUMP 0 /* Realtime clock has not jumped. */ @@ -68,28 +68,36 @@ #define TFD_CANCELED 4 /* Jumped, CANCEL_ON_SET=true. */ #define TFD_JUMPED (TFD_ZREAD | TFD_CANCELED) +/* + * One structure allocated per timerfd descriptor. + * + * Locking semantics: + * (t) locked by tfd_lock mtx + * (l) locked by timerfd_list_lock sx + * (c) const until freeing + */ struct timerfd { /* User specified. */ - struct itimerspec tfd_time; /* tfd timer */ - clockid_t tfd_clockid; /* timing base */ - int tfd_flags; /* creation flags */ - int tfd_timflags; /* timer flags */ + struct itimerspec tfd_time; /* (t) tfd timer */ + clockid_t tfd_clockid; /* (c) timing base */ + int tfd_flags; /* (c) creation flags */ + int tfd_timflags; /* (t) timer flags */ /* Used internally. */ - timerfd_t tfd_count; /* expiration count since last read */ - bool tfd_expired; /* true upon initial expiration */ - struct mtx tfd_lock; /* mtx lock */ - struct callout tfd_callout; /* expiration notification */ - struct selinfo tfd_sel; /* I/O alerts */ - struct timespec tfd_boottim; /* cached boottime */ - int tfd_jumped; /* timer jump status */ - LIST_ENTRY(timerfd) entry; /* entry in list */ + timerfd_t tfd_count; /* (t) expiration count since read */ + bool tfd_expired; /* (t) true upon initial expiration */ + struct mtx tfd_lock; /* tfd mtx lock */ + struct callout tfd_callout; /* (t) expiration notification */ + struct selinfo tfd_sel; /* (t) I/O alerts */ + struct timespec tfd_boottim; /* (t) cached boottime */ + int tfd_jumped; /* (t) timer jump status */ + LIST_ENTRY(timerfd) entry; /* (l) entry in list */ /* For stat(2). */ - ino_t tfd_ino; /* inode number */ - struct timespec tfd_atim; /* time of last read */ - struct timespec tfd_mtim; /* time of last settime */ - struct timespec tfd_birthtim; /* creation time */ + ino_t tfd_ino; /* (c) inode number */ + struct timespec tfd_atim; /* (t) time of last read */ + struct timespec tfd_mtim; /* (t) time of last settime */ + struct timespec tfd_birthtim; /* (c) creation time */ }; static void @@ -104,6 +112,7 @@ timerfd_getboottime(struct timespec *ts) { struct timeval tv; + getboottime(&tv); TIMEVAL_TO_TIMESPEC(&tv, ts); } @@ -124,8 +133,12 @@ timerfd_jumped(void) struct timerfd *tfd; struct timespec boottime, diff; + if (LIST_EMPTY(&timerfd_list)) + return; + timerfd_getboottime(&boottime); - LIST_FOREACH(tfd, &timerfd_head, entry) { + mtx_lock(&timerfd_list_lock); + LIST_FOREACH(tfd, &timerfd_list, entry) { mtx_lock(&tfd->tfd_lock); if (tfd->tfd_clockid != CLOCK_REALTIME || (tfd->tfd_timflags & TFD_TIMER_ABSTIME) == 0 || @@ -160,6 +170,7 @@ timerfd_jumped(void) tfd->tfd_boottim = boottime; mtx_unlock(&tfd->tfd_lock); } + mtx_unlock(&timerfd_list_lock); } static int @@ -264,6 +273,8 @@ { struct timerfd *tfd = kn->kn_hook; + mtx_assert(&tfd->tfd_lock, MA_OWNED); + kn->kn_data = (int64_t)tfd->tfd_count; return (tfd->tfd_count > 0); } @@ -298,13 +309,13 @@ sb->st_uid = fp->f_cred->cr_uid; sb->st_gid = fp->f_cred->cr_gid; sb->st_blksize = PAGE_SIZE; - mtx_lock(&tfd->tfd_lock); - sb->st_ino = tfd->tfd_ino; sb->st_atim = tfd->tfd_atim; sb->st_mtim = tfd->tfd_mtim; - sb->st_birthtim = tfd->tfd_birthtim; mtx_unlock(&tfd->tfd_lock); + sb->st_ctim = sb->st_mtim; + sb->st_ino = tfd->tfd_ino; + sb->st_birthtim = tfd->tfd_birthtim; return (0); } @@ -314,11 +325,14 @@ timerfd_close(struct file *fp, struct thread *td) { struct timerfd *tfd = fp->f_data; + mtx_lock(&timerfd_list_lock); + LIST_REMOVE(tfd, entry); + mtx_unlock(&timerfd_list_lock); + callout_drain(&tfd->tfd_callout); seldrain(&tfd->tfd_sel); knlist_destroy(&tfd->tfd_sel.si_note); mtx_destroy(&tfd->tfd_lock); - LIST_REMOVE(tfd, entry); free(tfd, M_TIMERFD); fp->f_ops = &badfileops; @@ -329,15 +340,12 @@ timerfd_fill_kinfo(struct file *fp, struct kinfo_file *kif, struct filedesc *fdp) { - struct timerfd *tfd = fp->f_data; kif->kf_type = KF_TYPE_TIMERFD; - mtx_lock(&tfd->tfd_lock); kif->kf_un.kf_timerfd.kf_timerfd_clockid = tfd->tfd_clockid; kif->kf_un.kf_timerfd.kf_timerfd_flags = tfd->tfd_flags; kif->kf_un.kf_timerfd.kf_timerfd_addr = (uintptr_t)tfd; - mtx_unlock(&tfd->tfd_lock); return (0); } @@ -363,6 +371,7 @@ { struct timespec curr_value; + mtx_assert(&tfd->tfd_lock, MA_OWNED); *old_value = tfd->tfd_time; if (timespecisset(&tfd->tfd_time.it_value)) { nanouptime(&curr_value); @@ -408,7 +426,7 @@ kern_timerfd_create(struct thread *td, int clockid, int flags) { struct file *fp; struct timerfd *tfd; - int error, fd, fflags = 0; + int error, fd, fflags; AUDIT_ARG_VALUE(clockid); AUDIT_ARG_FFLAGS(flags); @@ -417,12 +431,18 @@ kern_timerfd_create(struct thread *td, int clockid, int flags) return (EINVAL); if ((flags & ~(TFD_CLOEXEC | TFD_NONBLOCK)) != 0) return (EINVAL); + + fflags = FREAD; if ((flags & TFD_CLOEXEC) != 0) fflags |= O_CLOEXEC; + if ((flags & TFD_NONBLOCK) != 0) + fflags |= FNONBLOCK; + error = falloc(td, &fp, &fd, fflags); + if (error != 0) + return (error); + tfd = malloc(sizeof(*tfd), M_TIMERFD, M_WAITOK | M_ZERO); - if (tfd == NULL) - return (ENOMEM); tfd->tfd_clockid = (clockid_t)clockid; tfd->tfd_flags = flags; tfd->tfd_ino = alloc_unr64(&tfdino_unr); @@ -431,16 +447,12 @@ kern_timerfd_create(struct thread *td, int clockid, int flags) knlist_init_mtx(&tfd->tfd_sel.si_note, &tfd->tfd_lock); timerfd_getboottime(&tfd->tfd_boottim); getnanotime(&tfd->tfd_birthtim); - LIST_INSERT_HEAD(&timerfd_head, tfd, entry); + mtx_lock(&timerfd_list_lock); + LIST_INSERT_HEAD(&timerfd_list, tfd, entry); + mtx_unlock(&timerfd_list_lock); - error = falloc(td, &fp, &fd, fflags); - if (error != 0) - return (error); - fflags = FREAD; - if ((flags & TFD_NONBLOCK) != 0) - fflags |= FNONBLOCK; - finit(fp, fflags, DTYPE_TIMERFD, tfd, &timerfdops); + fdrop(fp, td); td->td_retval[0] = fd; @@ -457,11 +466,11 @@ error = fget(td, fd, &cap_write_rights, &fp); if (error != 0) return (error); - tfd = fp->f_data; - if (tfd == NULL || fp->f_type != DTYPE_TIMERFD) { + if (fp->f_type != DTYPE_TIMERFD) { fdrop(fp, td); return (EINVAL); } + tfd = fp->f_data; mtx_lock(&tfd->tfd_lock); timerfd_curval(tfd, curr_value); @@ -489,11 +498,11 @@ error = fget(td, fd, &cap_write_rights, &fp); if (error != 0) return (error); - tfd = fp->f_data; - if (tfd == NULL || fp->f_type != DTYPE_TIMERFD) { + if (fp->f_type != DTYPE_TIMERFD) { fdrop(fp, td); return (EINVAL); } + tfd = fp->f_data; mtx_lock(&tfd->tfd_lock); getnanotime(&tfd->tfd_mtim); @@ -574,59 +570,3 @@ } return (error); } - -#ifdef COMPAT_FREEBSD32 -int -freebsd32_timerfd_gettime(struct thread *td, - struct freebsd32_timerfd_gettime_args *uap) -{ - struct itimerspec curr_value; - struct itimerspec32 curr_value32; - int error; - - error = kern_timerfd_gettime(td, uap->fd, &curr_value); - if (error == 0) { - CP(curr_value, curr_value32, it_value.tv_sec); - CP(curr_value, curr_value32, it_value.tv_nsec); - CP(curr_value, curr_value32, it_interval.tv_sec); - CP(curr_value, curr_value32, it_interval.tv_nsec); - error = copyout(&curr_value32, uap->curr_value, - sizeof(curr_value32)); - } - - return (error); -} - -int -freebsd32_timerfd_settime(struct thread *td, - struct freebsd32_timerfd_settime_args *uap) -{ - struct itimerspec new_value, old_value; - struct itimerspec32 new_value32, old_value32; - int error; - - error = copyin(uap->new_value, &new_value32, sizeof(new_value32)); - if (error != 0) - return (error); - CP(new_value32, new_value, it_value.tv_sec); - CP(new_value32, new_value, it_value.tv_nsec); - CP(new_value32, new_value, it_interval.tv_sec); - CP(new_value32, new_value, it_interval.tv_nsec); - if (uap->old_value == NULL) { - error = kern_timerfd_settime(td, uap->fd, uap->flags, - &new_value, NULL); - } else { - error = kern_timerfd_settime(td, uap->fd, uap->flags, - &new_value, &old_value); - if (error == 0) { - CP(old_value, old_value32, it_value.tv_sec); - CP(old_value, old_value32, it_value.tv_nsec); - CP(old_value, old_value32, it_interval.tv_sec); - CP(old_value, old_value32, it_interval.tv_nsec); - error = copyout(&old_value32, uap->old_value, - sizeof(old_value32)); - } - } - return (error); -} -#endif diff --git a/sys/sys/timerfd.h b/sys/sys/timerfd.h --- a/sys/sys/timerfd.h +++ b/sys/sys/timerfd.h @@ -30,8 +30,7 @@ #include #include -#include -#include +#include typedef uint64_t timerfd_t; @@ -54,6 +53,8 @@ #else /* _KERNEL */ +struct thread; + int kern_timerfd_create(struct thread *td, int clockid, int flags); int kern_timerfd_gettime(struct thread *td, int fd, struct itimerspec *curr_value); diff --git a/sys/compat/freebsd32/freebsd32_misc.c b/sys/compat/freebsd32/freebsd32_misc.c --- a/sys/compat/freebsd32/freebsd32_misc.c +++ b/sys/compat/freebsd32/freebsd32_misc.c @@ -82,6 +82,7 @@ #include #include #include +#include #include #include #include @@ -3138,6 +3139,60 @@ return (error); } +int +freebsd32_timerfd_gettime(struct thread *td, + struct freebsd32_timerfd_gettime_args *uap) +{ + struct itimerspec curr_value; + struct itimerspec32 curr_value32; + int error; + + error = kern_timerfd_gettime(td, uap->fd, &curr_value); + if (error == 0) { + CP(curr_value, curr_value32, it_value.tv_sec); + CP(curr_value, curr_value32, it_value.tv_nsec); + CP(curr_value, curr_value32, it_interval.tv_sec); + CP(curr_value, curr_value32, it_interval.tv_nsec); + error = copyout(&curr_value32, uap->curr_value, + sizeof(curr_value32)); + } + + return (error); +} + +int +freebsd32_timerfd_settime(struct thread *td, + struct freebsd32_timerfd_settime_args *uap) +{ + struct itimerspec new_value, old_value; + struct itimerspec32 new_value32, old_value32; + int error; + + error = copyin(uap->new_value, &new_value32, sizeof(new_value32)); + if (error != 0) + return (error); + CP(new_value32, new_value, it_value.tv_sec); + CP(new_value32, new_value, it_value.tv_nsec); + CP(new_value32, new_value, it_interval.tv_sec); + CP(new_value32, new_value, it_interval.tv_nsec); + if (uap->old_value == NULL) { + error = kern_timerfd_settime(td, uap->fd, uap->flags, + &new_value, NULL); + } else { + error = kern_timerfd_settime(td, uap->fd, uap->flags, + &new_value, &old_value); + if (error == 0) { + CP(old_value, old_value32, it_value.tv_sec); + CP(old_value, old_value32, it_value.tv_nsec); + CP(old_value, old_value32, it_interval.tv_sec); + CP(old_value, old_value32, it_interval.tv_nsec); + error = copyout(&old_value32, uap->old_value, + sizeof(old_value32)); + } + } + return (error); +} + int freebsd32_clock_getcpuclockid2(struct thread *td, struct freebsd32_clock_getcpuclockid2_args *uap) --Multipart=_Sun__17_Sep_2023_09_39_50_+0900_e5eQYjc5MKn/Pcke-- From nobody Sun Sep 17 15:09:13 2023 X-Original-To: freebsd-stable@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4RpWYL1FNHz4t2Gd for ; Sun, 17 Sep 2023 15:09:26 +0000 (UTC) (envelope-from wlosh@bsdimp.com) Received: from mail-ed1-x52b.google.com (mail-ed1-x52b.google.com [IPv6:2a00:1450:4864:20::52b]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "GTS CA 1D4" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4RpWYL0WZMz4HKw for ; Sun, 17 Sep 2023 15:09:26 +0000 (UTC) (envelope-from wlosh@bsdimp.com) Authentication-Results: mx1.freebsd.org; none Received: by mail-ed1-x52b.google.com with SMTP id 4fb4d7f45d1cf-530ab2d9e89so1962505a12.2 for ; Sun, 17 Sep 2023 08:09:26 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=bsdimp-com.20230601.gappssmtp.com; s=20230601; t=1694963364; x=1695568164; darn=freebsd.org; h=cc:to:subject:message-id:date:from:in-reply-to:references :mime-version:from:to:cc:subject:date:message-id:reply-to; bh=bB7Bzhdc50PXZxTJMoqT7XB6LdMH3F2CQS9gQD4jYhM=; b=AP9TUnDGP5A5GIhvPTVEvox80taIeQZoQUaGA37s267vJTWqNc6HUQQzvE60sazzlL SXUJyKR/11xBFdwaqzdZRH48QZvfnKPaTXbx4xbSi+/pLrEZ0suxrip4N1wn5v1sfXpJ 3D0BybOgAEjfjjo3Zu9B1cX64hONyAsnw5WAzbIXO9OOW4YYWbw0JvtPFydafOXINWyg 8CafsmVQdSOWwxEqmdTkivf7q4h+QaE6cZa0Q5aUBkvwXhFFvJ8+a6oFK0cYIeXTjJak cPLVikS9CyDye2O4I4guB+3qqYAwKkou9mMoy5AUZb7DnCAxtsa9N6VZnpE3Vs2IxTKO sbaw== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20230601; t=1694963364; x=1695568164; h=cc:to:subject:message-id:date:from:in-reply-to:references :mime-version:x-gm-message-state:from:to:cc:subject:date:message-id :reply-to; bh=bB7Bzhdc50PXZxTJMoqT7XB6LdMH3F2CQS9gQD4jYhM=; b=jLty5WrP81/rfZ80icLKi6I9IZ+BaR4isGE6dbBWwywPM9ngo+gfbv17B57UCKiILt fQBF8hvrl+i9zeMrleP3XbK8oh0G/HzXG0qS6jGYCol4mQ7sQTPL892ImpUBg9hW8lSs MwAZ7zbdroDClj4clmW5CC64wZ3D1s6LYk8aGUtqgitx1fM8NNY30zfPGVecgdK0MfPJ Zuc4BeODJACVAsnVBdf1FVXsvFP8CLCfpLH8TDrwFn20/AYrKxfSR5FZBpwRfmown3ab nG82qX4WudUlRGY/YkKzMTRKkVv8rSlu4Fmvqql+GAf7mRM9P7EX01uBpRjbUW+SCmqE BaZg== X-Gm-Message-State: AOJu0YytZo/Ff7IsD1Q/0xwV1EUaXxxR5XlJb3k4OhGzlK6aGEHPPleF CMeeqNW0ENxEMF9Pw99sQpQpyGhv9g7smAorFF80wSqwta4V2wYX+J8= X-Google-Smtp-Source: AGHT+IFi4W7GLC3Cgb03p5GeiUVJ3C8Vzg4b3FTJngQBybmkqWJZW+M2zsT8d7s5H9awAZP8iKmduJ+LXPlom3ik11s= X-Received: by 2002:aa7:d905:0:b0:524:9564:4fee with SMTP id a5-20020aa7d905000000b0052495644feemr6158000edr.10.1694963364425; Sun, 17 Sep 2023 08:09:24 -0700 (PDT) List-Id: Production branch of FreeBSD source code List-Archive: https://lists.freebsd.org/archives/freebsd-stable List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-stable@freebsd.org X-BeenThere: freebsd-stable@freebsd.org MIME-Version: 1.0 References: <20230903123028.4ffceb705824f86d2efc21e3@dec.sakura.ne.jp> <20230903133328.54577b85b097da319ecde4ba@dec.sakura.ne.jp> <20230917093950.0dbe3eefb1c34d61dea8adef@dec.sakura.ne.jp> In-Reply-To: <20230917093950.0dbe3eefb1c34d61dea8adef@dec.sakura.ne.jp> From: Warner Losh Date: Sun, 17 Sep 2023 16:09:13 +0100 Message-ID: Subject: Re: Is there any plan for ZFS and timerfd updates on stable/14? To: Tomoaki AOKI Cc: Jake Freeland , FreeBSD-STABLE Mailing List Content-Type: multipart/alternative; boundary="0000000000003e854306058f6919" X-Spamd-Bar: ---- X-Rspamd-Pre-Result: action=no action; module=replies; Message is reply to one we originated X-Spamd-Result: default: False [-4.00 / 15.00]; REPLY(-4.00)[]; ASN(0.00)[asn:15169, ipnet:2a00:1450::/32, country:US] X-Rspamd-Queue-Id: 4RpWYL0WZMz4HKw --0000000000003e854306058f6919 Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable Hello AOKI-san Thanks for keeping on top of this issue. I had some, but not all of these, staged in my testing tree. Testing worked on it a while ago. I've gone ahead and pushed that branch just now. I've staged the rest of these and will push them after some light testing. My usual workflow is disrupted by travel to EuroBSDcon 2023 and having too much fun here seeing old friends. Please let me know if there's anything else. There is one test regression that needs to be sorted out to get back to where we were before my push. I hope to have that done by the end of next week since I'm taking a few days off after the conference to see a little of Portugal. Warner On Sun, Sep 17, 2023 at 1:39=E2=80=AFAM Tomoaki AOKI wrote: > On Sun, 3 Sep 2023 13:33:28 +0900 > Tomoaki AOKI wrote: > > > On Sat, 2 Sep 2023 22:47:53 -0500 > > Jake Freeland wrote: > > > > > On Sat, Sep 2, 2023 at 10:40=E2=80=AFPM Warner Losh = wrote: > > > > > > > > > > > > > > > On Sat, Sep 2, 2023, 9:36 PM Jake Freeland < > jake@technologyfriends.net> > > > > wrote: > > > > > > > >> On Sat, Sep 2, 2023 at 10:31=E2=80=AFPM Tomoaki AOKI < > junchoon@dec.sakura.ne.jp> > > > >> wrote: > > > >> > > > >>> Hi. > > > >>> > > > >>> There are discussions about deadlocks issue of ZFS on > freebsd-current > > > >>> ML, starting from [1] last month. > > > >>> IIRC, at least some fixes (candidates?) are merged to main, but > not yet > > > >>> to stable/14. > > > >>> > > > >>> Upcoming (aleready released? or still rc3?) OpenZFS 2.2-release > seems > > > >>> to have most of them. So my 1st question is "Is there any plan to > > > >>> import vendor/openzfs/zfs-2.2-release into stable/14 BEFORE > BRANCHING > > > >>> releng/14? > > > >>> > > > >>> And one more. timerfd is added at last-minutes BEFORE stable/14 i= s > > > >>> branched, and already have not-yet-MFC'ed fixes [2], [3], [4] and > > > >>> Differential revision D41600 on Phablicator [5] related to memory > leaks > > > >>> and locks. > > > >>> Additionally, splitting out lib32 part to proper place is propose= d > > > >>> as D41640 [6]. Both [5] and [6] are accepted but not yet landed. > > > >>> Also, D41641 [7] proposes namespace pollution adjustments. This > can be > > > >>> optional? > > > >>> > > > >>> Memory leaks and improper locks can lead system to security issue= s > or > > > >>> deadlocks, so it would be benefical if landed and MFC'ed BEFORE > > > >>> releng/14 branches. > > > >>> > > > >>> Is there any plan to do so? At least, existing deadlocks should b= e > > > >>> considered as SHOW-STOPPER and resolved. > > > >>> > > > >> > > > >> The plan is to get all of those patches in before releng/14.0, I > believe. > > > >> > > > >> What are your thoughts, Warner? > > > >> > > > > > > > > Sounds like the reviews are done or nearly so. I've not had time to > look > > > > closely to be sure... I'd planned on making time Tuesday morning. > > > > > > > > > > Yes. All reviews are good to go. > > > > > > Jake Freeland > > > > Glad to know. Thanks! > > Looking forward to see them landed / MFC'ed before releng/14 branches. > > > > Regards. > > > > > > > > > > > > > > > > Warner > > > > > > > > > > > >> Thanks, > > > >> Jake Freeland > > > >> > > > >> > > > >>> > > > >>> I myself am bitten by several deadlocks on poudriere full builds > after > > > >>> upgrading base from stable/13 to stable/14, finally finished with > > > >>> increasing kern.maxvnodes after powercycle on each deadlock and > > > >>> continue. > > > >>> > > > >>> > > > >>> Thanks in advance! > > > >>> > > > >>> [1] > > > >>> > > > >>> > https://lists.freebsd.org/archives/freebsd-current/2023-August/004162.htm= l > > > >>> > > > >>> [2] > > > >>> > > > >>> > https://cgit.freebsd.org/src/commit/?id=3D02f534b57f84d6f4f97c337b05b383c= 8b3aaf18c > > > >>> > > > >>> [3] > > > >>> > > > >>> > https://cgit.freebsd.org/src/commit/?id=3D5eab523053db79b4bd4f926c7d7ac04= 444d9c1da > > > >>> > > > >>> [4] > > > >>> > > > >>> > https://cgit.freebsd.org/src/commit/?id=3Df4296cfb409a48de00bfa60e76f686c= 2b031876f > > > >>> > > > >>> [5] https://reviews.freebsd.org/D41600 > > > >>> > > > >>> [6] https://reviews.freebsd.org/D41640 > > > >>> > > > >>> [7] https://reviews.freebsd.org/D41641 > > > >>> > > > >>> -- > > > >>> Tomoaki AOKI > > > > -- > > Tomoaki AOKI > > Hi. Thanks for your hard work on it. > > I could confirm commits to main as below, but they are not yet > MFC'ed/MFS'/ed. > It would be nice these commits to be incorporated at worst on first RC. > Any plans for MFC and following MFS? > > commit 02f534b57f84d6f4f97c337b05b383c8b3aaf18c > timerfd: fix up a memory leak and missing locking > > commit 5eab523053db79b4bd4f926c7d7ac04444d9c1da > timerfd: compute fflags before calling falloc > > commit f4296cfb409a48de00bfa60e76f686c2b031876f > timerfd: convert timerfd_list_lock from sx to mtx > > commit a1f506156c4db885d3cc177c93e9c8a28d535d30 > timerfd: Define a locking regime > > commit 918966a27479b4fb7c4c8999c4926d83c2c081e5 > timerfd: Relocate 32-bit compat code > > commit fb5daae920bae84e3eec8175bf9e46304c3b2ae6 > timerfd: Namespace pollution adjustments > > > Note that first 3 commits are authord/committed by mjg@. > These are all I could confirm landed with commit histories of > sys/kern/sys_timerfd.c and sys/sys/timerfd.c, excluding > already-in-stable/14 one. > > I've found a related commit to sys/compat/linux/linux_event.c but > intentionally excluded it, as it's already MFC'ed and MFS'ed. > > And I found another request on dev-commits-src-main ML archive [1], > without any reply. > > Attached is the hand-merged patch to cherry pick them to stable/14, > created before last 3 commits landed on main. HTH. > > [1] > > https://lists.freebsd.org/archives/dev-commits-src-main/2023-September/01= 8407.html > > Regards. > > -- > Tomoaki AOKI > --0000000000003e854306058f6919 Content-Type: text/html; charset="UTF-8" Content-Transfer-Encoding: quoted-printable
Hello AOKI-san

Thanks for keeping on to= p of this issue. I had some, but not all of these, staged in my testing tre= e.
Testing worked on it a while ago. I've gone ahead and push= ed that branch just now. I've staged the
rest of these and wi= ll push them after some light testing. My usual workflow is disrupted by tr= avel to
EuroBSDcon 2023 and having too much fun here seeing old f= riends.

Please let me know if there's anything= else. There is one test regression that needs to be sorted out
t= o get back to where we were before my push. I hope to have that done by the= end of next week since
I'm taking a few days off after the c= onference to see a little of Portugal.

Warner

On Sun, Sep 17, 2023 at 1:39=E2=80=AFAM Tomoaki AOKI <junchoon@dec.sakura.ne.jp> wrote:
On Sun, 3 Sep 2023 13:= 33:28 +0900
Tomoaki AOKI <junchoon@dec.sakura.ne.jp> wrote:

> On Sat, 2 Sep 2023 22:47:53 -0500
> Jake Freeland <jake@technologyfriends.net> wrote:
>
> > On Sat, Sep 2, 2023 at 10:40=E2=80=AFPM Warner Losh <imp@bsdimp.com> wrote:<= br> > >
> > >
> > >
> > > On Sat, Sep 2, 2023, 9:36 PM Jake Freeland <jake@technologyfriends.n= et>
> > > wrote:
> > >
> > >> On Sat, Sep 2, 2023 at 10:31=E2=80=AFPM Tomoaki AOKI <= ;junchoon@de= c.sakura.ne.jp>
> > >> wrote:
> > >>
> > >>> Hi.
> > >>>
> > >>> There are discussions about deadlocks issue of ZFS o= n freebsd-current
> > >>> ML, starting from [1] last month.
> > >>> IIRC, at least some fixes (candidates?) are merged t= o main, but not yet
> > >>> to stable/14.
> > >>>
> > >>> Upcoming (aleready released? or still rc3?) OpenZFS = 2.2-release seems
> > >>> to have most of them. So my 1st question is "Is= there any plan to
> > >>> import vendor/openzfs/zfs-2.2-release into stable/14= BEFORE BRANCHING
> > >>> releng/14?
> > >>>
> > >>> And one more. timerfd is added at last-minutes BEFOR= E stable/14 is
> > >>> branched, and already have not-yet-MFC'ed fixes = [2], [3], [4] and
> > >>> Differential revision D41600 on Phablicator [5] rela= ted to memory leaks
> > >>> and locks.
> > >>> Additionally, splitting out lib32 part to proper pla= ce is proposed
> > >>> as D41640 [6].=C2=A0 Both [5] and [6] are accepted b= ut not yet landed.
> > >>> Also, D41641 [7] proposes namespace pollution adjust= ments. This can be
> > >>> optional?
> > >>>
> > >>> Memory leaks and improper locks can lead system to s= ecurity issues or
> > >>> deadlocks, so it would be benefical if landed and MF= C'ed BEFORE
> > >>> releng/14 branches.
> > >>>
> > >>> Is there any plan to do so? At least, existing deadl= ocks should be
> > >>> considered as SHOW-STOPPER and resolved.
> > >>>
> > >>
> > >> The plan is to get all of those patches in before releng= /14.0, I believe.
> > >>
> > >> What are your thoughts, Warner?
> > >>
> > >
> > > Sounds like the reviews are done or nearly so. I've not = had time to look
> > > closely to be sure... I'd planned on making time Tuesday= morning.
> > >
> >
> > Yes. All reviews are good to go.
> >
> > Jake Freeland
>
> Glad to know. Thanks!
> Looking forward to see them landed / MFC'ed before releng/14 branc= hes.
>
> Regards.
>
> >
> >
> > >
> > > Warner
> > >
> > >
> > >> Thanks,
> > >> Jake Freeland
> > >>
> > >>
> > >>>
> > >>> I myself am bitten by several deadlocks on poudriere= full builds after
> > >>> upgrading base from stable/13 to stable/14, finally = finished with
> > >>> increasing kern.maxvnodes after powercycle on each d= eadlock and
> > >>> continue.
> > >>>
> > >>>
> > >>> Thanks in advance!
> > >>>
> > >>> [1]
> > >>>
> > >>> htt= ps://lists.freebsd.org/archives/freebsd-current/2023-August/004162.html=
> > >>>
> > >>> [2]
> > >>>
> > >>> https://cgit.freebsd.org/src/commit/?id=3D02f534b57f84d6f4f97c337b05= b383c8b3aaf18c
> > >>>
> > >>> [3]
> > >>>
> > >>> https://cgit.freebsd.org/src/commit/?id=3D5eab523053db79b4bd4f926c7d= 7ac04444d9c1da
> > >>>
> > >>> [4]
> > >>>
> > >>> https://cgit.freebsd.org/src/commit/?id=3Df4296cfb409a48de00bfa60e76= f686c2b031876f
> > >>>
> > >>> [5] https://reviews.freebsd.org/D41600<= br> > > >>>
> > >>> [6] https://reviews.freebsd.org/D41640<= br> > > >>>
> > >>> [7] https://reviews.freebsd.org/D41641<= br> > > >>>
> > >>> --
> > >>> Tomoaki AOKI=C2=A0 =C2=A0 <junchoon@dec.sakura.ne.jp><= br> >
> --
> Tomoaki AOKI=C2=A0 =C2=A0 <junchoon@dec.sakura.ne.jp>

Hi. Thanks for your hard work on it.

I could confirm commits to main as below, but they are not yet
MFC'ed/MFS'/ed.
It would be nice these commits to be incorporated at worst on first RC.
Any plans for MFC and following MFS?

commit=C2=A0 02f534b57f84d6f4f97c337b05b383c8b3aaf18c
=C2=A0 timerfd: fix up a memory leak and missing locking

commit=C2=A0 5eab523053db79b4bd4f926c7d7ac04444d9c1da
=C2=A0 timerfd: compute fflags before calling falloc

commit=C2=A0 f4296cfb409a48de00bfa60e76f686c2b031876f
=C2=A0 timerfd: convert timerfd_list_lock from sx to mtx

commit=C2=A0 a1f506156c4db885d3cc177c93e9c8a28d535d30
=C2=A0 timerfd: Define a locking regime

commit=C2=A0 918966a27479b4fb7c4c8999c4926d83c2c081e5
=C2=A0 timerfd: Relocate 32-bit compat code

commit=C2=A0 fb5daae920bae84e3eec8175bf9e46304c3b2ae6
=C2=A0 timerfd: Namespace pollution adjustments


Note that first 3 commits are authord/committed by mjg@.
These are all I could confirm landed with commit histories of
sys/kern/sys_timerfd.c and sys/sys/timerfd.c, excluding
already-in-stable/14 one.

I've found a related commit to sys/compat/linux/linux_event.c but
intentionally excluded it, as it's already MFC'ed and MFS'ed.
And I found another request on dev-commits-src-main ML archive [1],
without any reply.

Attached is the hand-merged patch to cherry pick them to stable/14,
created before last 3 commits landed on main. HTH.

[1]
https://lists.free= bsd.org/archives/dev-commits-src-main/2023-September/018407.html

Regards.

--
Tomoaki AOKI=C2=A0 =C2=A0 <junchoon@dec.sakura.ne.jp>
--0000000000003e854306058f6919-- From nobody Sun Sep 17 16:14:27 2023 X-Original-To: freebsd-stable@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4RpY0W1K20z4tCsP for ; Sun, 17 Sep 2023 16:14:35 +0000 (UTC) (envelope-from junchoon@dec.sakura.ne.jp) Received: from www121.sakura.ne.jp (www121.sakura.ne.jp [153.125.133.21]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4RpY0V2XJTz4Wg1 for ; Sun, 17 Sep 2023 16:14:33 +0000 (UTC) (envelope-from junchoon@dec.sakura.ne.jp) Authentication-Results: mx1.freebsd.org; none Received: from kalamity.joker.local (123-1-88-210.area1b.commufa.jp [123.1.88.210]) (authenticated bits=0) by www121.sakura.ne.jp (8.16.1/8.16.1/[SAKURA-WEB]/20201212) with ESMTPA id 38HGER4r061998; Mon, 18 Sep 2023 01:14:27 +0900 (JST) (envelope-from junchoon@dec.sakura.ne.jp) Date: Mon, 18 Sep 2023 01:14:27 +0900 From: Tomoaki AOKI To: Warner Losh Cc: Jake Freeland , FreeBSD-STABLE Mailing List Subject: Re: Is there any plan for ZFS and timerfd updates on stable/14? Message-Id: <20230918011427.857b7443306daa5c5fdf4dd0@dec.sakura.ne.jp> In-Reply-To: References: <20230903123028.4ffceb705824f86d2efc21e3@dec.sakura.ne.jp> <20230903133328.54577b85b097da319ecde4ba@dec.sakura.ne.jp> <20230917093950.0dbe3eefb1c34d61dea8adef@dec.sakura.ne.jp> Organization: Junchoon corps X-Mailer: Sylpheed 3.7.0 (GTK+ 2.24.33; amd64-portbld-freebsd14.0) List-Id: Production branch of FreeBSD source code List-Archive: https://lists.freebsd.org/archives/freebsd-stable List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-stable@freebsd.org X-BeenThere: freebsd-stable@freebsd.org Mime-Version: 1.0 Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: 8bit X-Spamd-Bar: ---- X-Rspamd-Pre-Result: action=no action; module=replies; Message is reply to one we originated X-Spamd-Result: default: False [-4.00 / 15.00]; REPLY(-4.00)[]; ASN(0.00)[asn:7684, ipnet:153.125.128.0/18, country:JP] X-Rspamd-Queue-Id: 4RpY0V2XJTz4Wg1 On Sun, 17 Sep 2023 16:09:13 +0100 Warner Losh wrote: > Hello AOKI-san > > Thanks for keeping on top of this issue. I had some, but not all of these, > staged in my testing tree. > Testing worked on it a while ago. I've gone ahead and pushed that branch > just now. I've staged the > rest of these and will push them after some light testing. My usual > workflow is disrupted by travel to > EuroBSDcon 2023 and having too much fun here seeing old friends. Nice to hear you had a good travel. :-) And thanks to your MFCs. Confirmed all commits in main related with timerfd which I've noticed of and not yet MFC'ed are now on stable/14, too. Next step shold be MFS to releng/14.0. > Please let me know if there's anything else. There is one test regression > that needs to be sorted out > to get back to where we were before my push. I hope to have that done by > the end of next week since > I'm taking a few days off after the conference to see a little of Portugal. > > Warner All others I've noticed of are: Differential revision D41640 [1] is not yet closed even though already landed and MFC'ed. But OK, it's not yet MFS'ed to releng/14.0. All others in phabricator which has word "timerfd" are closed. Bug 273373 [2] is not yet closed. Is this what you mentioned? [1] https://reviews.freebsd.org/D41640 [2] https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=273373 Thanks in advance and hope you have nice remaining travel. Regards. > On Sun, Sep 17, 2023 at 1:39 AM Tomoaki AOKI > wrote: > > > On Sun, 3 Sep 2023 13:33:28 +0900 > > Tomoaki AOKI wrote: > > > > > On Sat, 2 Sep 2023 22:47:53 -0500 > > > Jake Freeland wrote: > > > > > > > On Sat, Sep 2, 2023 at 10:40 PM Warner Losh wrote: > > > > > > > > > > > > > > > > > > > On Sat, Sep 2, 2023, 9:36 PM Jake Freeland < > > jake@technologyfriends.net> > > > > > wrote: > > > > > > > > > >> On Sat, Sep 2, 2023 at 10:31 PM Tomoaki AOKI < > > junchoon@dec.sakura.ne.jp> > > > > >> wrote: > > > > >> > > > > >>> Hi. > > > > >>> > > > > >>> There are discussions about deadlocks issue of ZFS on > > freebsd-current > > > > >>> ML, starting from [1] last month. > > > > >>> IIRC, at least some fixes (candidates?) are merged to main, but > > not yet > > > > >>> to stable/14. > > > > >>> > > > > >>> Upcoming (aleready released? or still rc3?) OpenZFS 2.2-release > > seems > > > > >>> to have most of them. So my 1st question is "Is there any plan to > > > > >>> import vendor/openzfs/zfs-2.2-release into stable/14 BEFORE > > BRANCHING > > > > >>> releng/14? > > > > >>> > > > > >>> And one more. timerfd is added at last-minutes BEFORE stable/14 is > > > > >>> branched, and already have not-yet-MFC'ed fixes [2], [3], [4] and > > > > >>> Differential revision D41600 on Phablicator [5] related to memory > > leaks > > > > >>> and locks. > > > > >>> Additionally, splitting out lib32 part to proper place is proposed > > > > >>> as D41640 [6]. Both [5] and [6] are accepted but not yet landed. > > > > >>> Also, D41641 [7] proposes namespace pollution adjustments. This > > can be > > > > >>> optional? > > > > >>> > > > > >>> Memory leaks and improper locks can lead system to security issues > > or > > > > >>> deadlocks, so it would be benefical if landed and MFC'ed BEFORE > > > > >>> releng/14 branches. > > > > >>> > > > > >>> Is there any plan to do so? At least, existing deadlocks should be > > > > >>> considered as SHOW-STOPPER and resolved. > > > > >>> > > > > >> > > > > >> The plan is to get all of those patches in before releng/14.0, I > > believe. > > > > >> > > > > >> What are your thoughts, Warner? > > > > >> > > > > > > > > > > Sounds like the reviews are done or nearly so. I've not had time to > > look > > > > > closely to be sure... I'd planned on making time Tuesday morning. > > > > > > > > > > > > > Yes. All reviews are good to go. > > > > > > > > Jake Freeland > > > > > > Glad to know. Thanks! > > > Looking forward to see them landed / MFC'ed before releng/14 branches. > > > > > > Regards. > > > > > > > > > > > > > > > > > > > > > Warner > > > > > > > > > > > > > > >> Thanks, > > > > >> Jake Freeland > > > > >> > > > > >> > > > > >>> > > > > >>> I myself am bitten by several deadlocks on poudriere full builds > > after > > > > >>> upgrading base from stable/13 to stable/14, finally finished with > > > > >>> increasing kern.maxvnodes after powercycle on each deadlock and > > > > >>> continue. > > > > >>> > > > > >>> > > > > >>> Thanks in advance! > > > > >>> > > > > >>> [1] > > > > >>> > > > > >>> > > https://lists.freebsd.org/archives/freebsd-current/2023-August/004162.html > > > > >>> > > > > >>> [2] > > > > >>> > > > > >>> > > https://cgit.freebsd.org/src/commit/?id=02f534b57f84d6f4f97c337b05b383c8b3aaf18c > > > > >>> > > > > >>> [3] > > > > >>> > > > > >>> > > https://cgit.freebsd.org/src/commit/?id=5eab523053db79b4bd4f926c7d7ac04444d9c1da > > > > >>> > > > > >>> [4] > > > > >>> > > > > >>> > > https://cgit.freebsd.org/src/commit/?id=f4296cfb409a48de00bfa60e76f686c2b031876f > > > > >>> > > > > >>> [5] https://reviews.freebsd.org/D41600 > > > > >>> > > > > >>> [6] https://reviews.freebsd.org/D41640 > > > > >>> > > > > >>> [7] https://reviews.freebsd.org/D41641 > > > > >>> > > > > >>> -- > > > > >>> Tomoaki AOKI > > > > > > -- > > > Tomoaki AOKI > > > > Hi. Thanks for your hard work on it. > > > > I could confirm commits to main as below, but they are not yet > > MFC'ed/MFS'/ed. > > It would be nice these commits to be incorporated at worst on first RC. > > Any plans for MFC and following MFS? > > > > commit 02f534b57f84d6f4f97c337b05b383c8b3aaf18c > > timerfd: fix up a memory leak and missing locking > > > > commit 5eab523053db79b4bd4f926c7d7ac04444d9c1da > > timerfd: compute fflags before calling falloc > > > > commit f4296cfb409a48de00bfa60e76f686c2b031876f > > timerfd: convert timerfd_list_lock from sx to mtx > > > > commit a1f506156c4db885d3cc177c93e9c8a28d535d30 > > timerfd: Define a locking regime > > > > commit 918966a27479b4fb7c4c8999c4926d83c2c081e5 > > timerfd: Relocate 32-bit compat code > > > > commit fb5daae920bae84e3eec8175bf9e46304c3b2ae6 > > timerfd: Namespace pollution adjustments > > > > > > Note that first 3 commits are authord/committed by mjg@. > > These are all I could confirm landed with commit histories of > > sys/kern/sys_timerfd.c and sys/sys/timerfd.c, excluding > > already-in-stable/14 one. > > > > I've found a related commit to sys/compat/linux/linux_event.c but > > intentionally excluded it, as it's already MFC'ed and MFS'ed. > > > > And I found another request on dev-commits-src-main ML archive [1], > > without any reply. > > > > Attached is the hand-merged patch to cherry pick them to stable/14, > > created before last 3 commits landed on main. HTH. > > > > [1] > > > > https://lists.freebsd.org/archives/dev-commits-src-main/2023-September/018407.html > > > > Regards. > > > > -- > > Tomoaki AOKI -- Tomoaki AOKI From nobody Sun Sep 17 18:15:08 2023 X-Original-To: freebsd-stable@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4Rpbgr4rXHz4tXSL for ; Sun, 17 Sep 2023 18:15:20 +0000 (UTC) (envelope-from fogti+fbsd@ytrizja.de) Received: from ytrizja.de (ytrizja.de [IPv6:2a01:4f8:c17:6316::1]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4Rpbgq45C7z4mQJ for ; Sun, 17 Sep 2023 18:15:19 +0000 (UTC) (envelope-from fogti+fbsd@ytrizja.de) Authentication-Results: mx1.freebsd.org; dkim=pass header.d=ytrizja.de header.s=2020 header.b=V2mGYlDU; spf=pass (mx1.freebsd.org: domain of fogti+fbsd@ytrizja.de designates 2a01:4f8:c17:6316::1 as permitted sender) smtp.mailfrom=fogti+fbsd@ytrizja.de; dmarc=pass (policy=reject) header.from=ytrizja.de Message-ID: <1a11ae16-7425-6d5a-c864-0005343b678c@ytrizja.de> DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=ytrizja.de; s=2020; t=1694974510; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding; bh=+H40a+xPy1MCBjKU8MzRoLpZHw+Q8e2jD/HV+1wKFQQ=; b=V2mGYlDUoNLGHEvJXYJjXsdtwmoebV2ETcSn7IIxOV5DgMN9hmjqoKnAcqWMHyQz6jKmNg W229nZ2+K5e7jZb7YpNrLWJOgMVwXSk0Q8QbCoE1NyF3K/1fT9lgAQmu4RnVAorCRUjROx RBZmrsuxc5wKpCfjqVc+nVYn9NZY3Ohmse/Sk5iJaPwkpQui4mTguUNLIY2JhdI+GKejJj eMbyJgMB87XbK/W5Tq9HG+QepT0aKf8/HZ61tdj8ORW9dvXvJe+qg3kG/mex2+1QHZalQh hFB/tAigZwr6m0SklroLkLCyA9AOe3OeVskp1btY2ZGPTex5DvoLH+iVSmDL0g== Date: Sun, 17 Sep 2023 20:15:08 +0200 List-Id: Production branch of FreeBSD source code List-Archive: https://lists.freebsd.org/archives/freebsd-stable List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-stable@freebsd.org X-BeenThere: freebsd-stable@freebsd.org MIME-Version: 1.0 Content-Language: en-US To: freebsd-stable@freebsd.org From: Alain Zscheile Subject: local-unbound stopped working after upgrade to 13.2 Content-Type: text/plain; charset=UTF-8; format=flowed Content-Transfer-Encoding: 7bit X-Spamd-Bar: --- X-Spamd-Result: default: False [-4.00 / 15.00]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; NEURAL_HAM_LONG(-1.00)[-1.000]; NEURAL_HAM_SHORT(-1.00)[-1.000]; DMARC_POLICY_ALLOW(-0.50)[ytrizja.de,reject]; R_DKIM_ALLOW(-0.20)[ytrizja.de:s=2020]; R_SPF_ALLOW(-0.20)[+mx]; MIME_GOOD(-0.10)[text/plain]; FROM_EQ_ENVFROM(0.00)[]; MLMMJ_DEST(0.00)[freebsd-stable@freebsd.org]; MIME_TRACE(0.00)[0:+]; RCVD_COUNT_ZERO(0.00)[0]; ASN(0.00)[asn:24940, ipnet:2a01:4f8::/32, country:DE]; ARC_NA(0.00)[]; RCPT_COUNT_ONE(0.00)[1]; TAGGED_FROM(0.00)[fbsd]; FROM_HAS_DN(0.00)[]; DKIM_TRACE(0.00)[ytrizja.de:+]; TO_MATCH_ENVRCPT_ALL(0.00)[]; TO_DN_NONE(0.00)[]; MID_RHS_MATCH_FROM(0.00)[] X-Rspamd-Queue-Id: 4Rpbgq45C7z4mQJ Hi, After upgrading from FreeBSD-13.1 to 13.2 I noticed that local-unbound doesn't appear to work anymore (doesn't return DNS responses for anything, although I don't have network traces). For now, I just disabled it on all my systems, but I believe this is a bug that should be fixed... Regards, Alain Zscheile From nobody Mon Sep 18 05:31:46 2023 X-Original-To: freebsd-stable@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4RpthY6cpLz4tXKg; Mon, 18 Sep 2023 05:31:57 +0000 (UTC) (envelope-from mm@FreeBSD.org) Received: from www541.your-server.de (www541.your-server.de [213.133.107.7]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4RpthY0g7Pz4Vd5; Mon, 18 Sep 2023 05:31:57 +0000 (UTC) (envelope-from mm@FreeBSD.org) Authentication-Results: mx1.freebsd.org; dkim=none; spf=softfail (mx1.freebsd.org: 213.133.107.7 is neither permitted nor denied by domain of mm@FreeBSD.org) smtp.mailfrom=mm@FreeBSD.org; dmarc=none Received: from sslproxy01.your-server.de ([78.46.139.224]) by www541.your-server.de with esmtpsa (TLS1.3) tls TLS_AES_256_GCM_SHA384 (Exim 4.94.2) (envelope-from ) id 1qi6rN-000OyY-1e; Mon, 18 Sep 2023 07:31:49 +0200 Received: from [188.167.171.2] (helo=[10.0.9.122]) by sslproxy01.your-server.de with esmtpsa (TLSv1.3:TLS_AES_256_GCM_SHA384:256) (Exim 4.92) (envelope-from ) id 1qi6rM-000O39-E7; Mon, 18 Sep 2023 07:31:48 +0200 Message-ID: <8e4e4000-4680-0550-6772-32a6a3101761@FreeBSD.org> Date: Mon, 18 Sep 2023 07:31:46 +0200 List-Id: Production branch of FreeBSD source code List-Archive: https://lists.freebsd.org/archives/freebsd-stable List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-stable@freebsd.org X-BeenThere: freebsd-stable@freebsd.org MIME-Version: 1.0 User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:102.0) Gecko/20100101 Thunderbird/102.15.1 Subject: Re: vfs.zfs.bclone_enabled (was: FreeBSD 14.0-BETA2 Now Available) Content-Language: en-US To: Alexander Motin , Graham Perrin , freebsd-current@freebsd.org Cc: freebsd-stable@freebsd.org References: <20230916002831.GU52318@FreeBSD.org> <02c53c2e-127b-33b4-e13d-f6f6589dd5fe@gmail.com> <7a6692de-f096-637d-fe48-d5fb93e54f8b@FreeBSD.org> From: Martin Matuska In-Reply-To: <7a6692de-f096-637d-fe48-d5fb93e54f8b@FreeBSD.org> Content-Type: text/plain; charset=UTF-8; format=flowed Content-Transfer-Encoding: 8bit X-Authenticated-Sender: martin@matuska.de X-Virus-Scanned: Clear (ClamAV 0.103.10/27034/Sun Sep 17 09:37:48 2023) X-Spamd-Bar: --- X-Spamd-Result: default: False [-3.19 / 15.00]; NEURAL_HAM_LONG(-1.00)[-1.000]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; NEURAL_HAM_SHORT(-0.99)[-0.991]; MIME_GOOD(-0.10)[text/plain]; RCVD_IN_DNSWL_LOW(-0.10)[78.46.139.224:received]; FROM_EQ_ENVFROM(0.00)[]; ASN(0.00)[asn:24940, ipnet:213.133.96.0/19, country:DE]; RCVD_COUNT_TWO(0.00)[2]; R_DKIM_NA(0.00)[]; MLMMJ_DEST(0.00)[freebsd-stable@freebsd.org,freebsd-current@freebsd.org]; TO_MATCH_ENVRCPT_SOME(0.00)[]; MIME_TRACE(0.00)[0:+]; FREEMAIL_TO(0.00)[FreeBSD.org,gmail.com,freebsd.org]; MID_RHS_MATCH_FROM(0.00)[]; R_SPF_SOFTFAIL(0.00)[~all:c]; FROM_HAS_DN(0.00)[]; FREEFALL_USER(0.00)[mm]; RCVD_VIA_SMTP_AUTH(0.00)[]; HAS_X_AS(0.00)[]; RCPT_COUNT_THREE(0.00)[4]; RCVD_TLS_ALL(0.00)[]; TO_DN_SOME(0.00)[]; DMARC_NA(0.00)[freebsd.org]; ARC_NA(0.00)[] X-Rspamd-Queue-Id: 4RpthY0g7Pz4Vd5 I vote for enabling block cloning on main :-) mm On 16. 9. 2023 19:14, Alexander Motin wrote: > On 16.09.2023 01:25, Graham Perrin wrote: >> On 16/09/2023 01:28, Glen Barber wrote: >>> o A fix for the ZFS block_cloning feature has been implemented. >> >> Thanks >> >> I see >> , >> with >> >> in stable/14. >> >> As vfs.zfs.bclone_enabled is still 0 (at least, with 15.0-CURRENT >> n265350-72d97e1dd9cc): should we assume that additional fixes, not >> necessarily in time for 14.0-RELEASE, will be required before >> vfs.zfs.bclone_enabled can default to 1? > > I am not aware of any block cloning issues now.  All this thread about > bclone_enabled actually started after I asked why it is still > disabled. Thanks to Mark Millard for spotting this issue I could fix, > but now we are back at the point of re-enabling it again.  Since the > tunable does not even exist anywhere outside of FreeBSD base tree, I'd > propose to give this code another try here too.  I see no point to > have it disabled at least in main unless somebody needs time to run > some specific tests first. > From nobody Mon Sep 18 10:49:10 2023 X-Original-To: freebsd-stable@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4Rq1kg4FJ5z4t0Wh; Mon, 18 Sep 2023 10:49:15 +0000 (UTC) (envelope-from markjdb@gmail.com) Received: from mail-wr1-x42d.google.com (mail-wr1-x42d.google.com [IPv6:2a00:1450:4864:20::42d]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "GTS CA 1D4" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4Rq1kg1yjTz3ZKD; Mon, 18 Sep 2023 10:49:15 +0000 (UTC) (envelope-from markjdb@gmail.com) Authentication-Results: mx1.freebsd.org; none Received: by mail-wr1-x42d.google.com with SMTP id ffacd0b85a97d-31ff985e292so2545311f8f.1; Mon, 18 Sep 2023 03:49:15 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20230601; t=1695034153; x=1695638953; darn=freebsd.org; h=in-reply-to:content-transfer-encoding:content-disposition :mime-version:references:message-id:subject:cc:to:from:date:sender :from:to:cc:subject:date:message-id:reply-to; bh=Gmrp47G/YOPEzz8CTt1sBfFO8OyhTt3ZuT52gzlE1qM=; b=D04yMUB7hbblzlKz8NBFC+UT+S4QMtSuJZevnJxFxq8wsOAgA2Btm6nWaM6iFC0c8R 5WmPw7z8eH3rbz+G74QXX3eu1FYy2N6oluR5b3NqEOaE1yRqqYd+4vuXz/Ruhy5Q6y2n TiNPEWcKihvL/wripLvQOlpjH6K36lbbTtKwMwykuUq2UNyRb8B/tS5/4eirIiGsrHaV P4ovATJ7twNYPQb4HuWqpXYN2JaSwjTcHmRG/G9U6DO7o5mt0EhWKC4d8Xy/v2tbJ1WK ovMyMRIwiEpZL6Nn892vRvbOHKdDP9lgL1AGSH9l0exHS80aoqmWD1u+4t+8Ldko25P1 VjnA== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20230601; t=1695034153; x=1695638953; h=in-reply-to:content-transfer-encoding:content-disposition :mime-version:references:message-id:subject:cc:to:from:date:sender :x-gm-message-state:from:to:cc:subject:date:message-id:reply-to; bh=Gmrp47G/YOPEzz8CTt1sBfFO8OyhTt3ZuT52gzlE1qM=; b=IRjnBfH9TWHm2NA10f69BwpURT8n6/Yq/cc4+5sfSYYxmdc5kTYn+vrpp7osyKv5HW io55lHIrfnKI8nclIv3KHS4EjBcffdp6x6kT4YMiuZ0adHna0CrO4S9uNG+oqnG6XiTX 6+VBv8V6/DCGahlWuhBJeFhk/AtWOu148hHBjwKn3XDLsMFS81u7DkFWkv1Yvk1oK4Y6 mkc+jNk5ipT3hdilleznevEsJCEDd+pKUJZQNsBdX0/oMHNNQLXfzvmvdP7x9WoopdDI FkIyJadCPjLnK7345277u3ZKFGQnEgCEJaTINVs9CD20JtLGo6j2Vnx9pWtUxV8eJOtf XTTw== X-Gm-Message-State: AOJu0YwnZyRBt2AssWK9Div2ASN/oHdoaszNuCi+5SU6zkYmk3CCvkkt er+MPI2PkRjZqlkmax8Vwfwk6FIFd1Y= X-Google-Smtp-Source: AGHT+IEKpOC0kdLgM63JtH9HQJ35+epuIykRzieP+uRygKc76zI6Zvfpvnli0nj4qAWUBTeuRp6X2A== X-Received: by 2002:a5d:4706:0:b0:319:7c14:b06b with SMTP id y6-20020a5d4706000000b003197c14b06bmr6745448wrq.47.1695034152723; Mon, 18 Sep 2023 03:49:12 -0700 (PDT) Received: from framework (91.76.114.89.rev.vodafone.pt. [89.114.76.91]) by smtp.gmail.com with ESMTPSA id z15-20020adff1cf000000b003179d5aee67sm12113560wro.94.2023.09.18.03.49.10 (version=TLS1_3 cipher=TLS_AES_256_GCM_SHA384 bits=256/256); Mon, 18 Sep 2023 03:49:11 -0700 (PDT) Date: Mon, 18 Sep 2023 06:49:10 -0400 From: Mark Johnston To: Martin Matuska Cc: Alexander Motin , Graham Perrin , freebsd-current@freebsd.org, freebsd-stable@freebsd.org Subject: Re: vfs.zfs.bclone_enabled (was: FreeBSD 14.0-BETA2 Now Available) Message-ID: References: <20230916002831.GU52318@FreeBSD.org> <02c53c2e-127b-33b4-e13d-f6f6589dd5fe@gmail.com> <7a6692de-f096-637d-fe48-d5fb93e54f8b@FreeBSD.org> <8e4e4000-4680-0550-6772-32a6a3101761@FreeBSD.org> List-Id: Production branch of FreeBSD source code List-Archive: https://lists.freebsd.org/archives/freebsd-stable List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-stable@freebsd.org X-BeenThere: freebsd-stable@freebsd.org MIME-Version: 1.0 Content-Type: text/plain; charset=iso-8859-1 Content-Disposition: inline Content-Transfer-Encoding: 8bit In-Reply-To: <8e4e4000-4680-0550-6772-32a6a3101761@FreeBSD.org> X-Spamd-Bar: ---- X-Rspamd-Pre-Result: action=no action; module=replies; Message is reply to one we originated X-Spamd-Result: default: False [-4.00 / 15.00]; REPLY(-4.00)[]; ASN(0.00)[asn:15169, ipnet:2a00:1450::/32, country:US] X-Rspamd-Queue-Id: 4Rq1kg1yjTz3ZKD On Mon, Sep 18, 2023 at 07:31:46AM +0200, Martin Matuska wrote: > I vote for enabling block cloning on main :-) Have you or anyone else run through the test suite with block cloning enabled? > On 16. 9. 2023 19:14, Alexander Motin wrote: > > On 16.09.2023 01:25, Graham Perrin wrote: > > > On 16/09/2023 01:28, Glen Barber wrote: > > > > o A fix for the ZFS block_cloning feature has been implemented. > > > > > > Thanks > > > > > > I see , > > > with > > > in stable/14. > > > > > > As vfs.zfs.bclone_enabled is still 0 (at least, with 15.0-CURRENT > > > n265350-72d97e1dd9cc): should we assume that additional fixes, not > > > necessarily in time for 14.0-RELEASE, will be required before > > > vfs.zfs.bclone_enabled can default to 1? > > > > I am not aware of any block cloning issues now.  All this thread about > > bclone_enabled actually started after I asked why it is still disabled. > > Thanks to Mark Millard for spotting this issue I could fix, but now we > > are back at the point of re-enabling it again.  Since the tunable does > > not even exist anywhere outside of FreeBSD base tree, I'd propose to > > give this code another try here too.  I see no point to have it disabled > > at least in main unless somebody needs time to run some specific tests > > first. > > > From nobody Mon Sep 18 11:22:04 2023 X-Original-To: freebsd-stable@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4Rq2Sl5qNzz4t2Gh; Mon, 18 Sep 2023 11:22:15 +0000 (UTC) (envelope-from junchoon@dec.sakura.ne.jp) Received: from www121.sakura.ne.jp (www121.sakura.ne.jp [153.125.133.21]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4Rq2Sl1TQ7z3fJV; Mon, 18 Sep 2023 11:22:15 +0000 (UTC) (envelope-from junchoon@dec.sakura.ne.jp) Authentication-Results: mx1.freebsd.org; none Received: from kalamity.joker.local (123-1-88-210.area1b.commufa.jp [123.1.88.210]) (authenticated bits=0) by www121.sakura.ne.jp (8.16.1/8.16.1/[SAKURA-WEB]/20201212) with ESMTPA id 38IBM4Td005456; Mon, 18 Sep 2023 20:22:04 +0900 (JST) (envelope-from junchoon@dec.sakura.ne.jp) Date: Mon, 18 Sep 2023 20:22:04 +0900 From: Tomoaki AOKI To: Martin Matuska Cc: Alexander Motin , freebsd-current@freebsd.org, freebsd-stable@freebsd.org Subject: Re: vfs.zfs.bclone_enabled (was: FreeBSD 14.0-BETA2 Now Available) Message-Id: <20230918202204.28e21a011a0a98e3fcda9f3a@dec.sakura.ne.jp> In-Reply-To: <8e4e4000-4680-0550-6772-32a6a3101761@FreeBSD.org> References: <20230916002831.GU52318@FreeBSD.org> <02c53c2e-127b-33b4-e13d-f6f6589dd5fe@gmail.com> <7a6692de-f096-637d-fe48-d5fb93e54f8b@FreeBSD.org> <8e4e4000-4680-0550-6772-32a6a3101761@FreeBSD.org> Organization: Junchoon corps X-Mailer: Sylpheed 3.7.0 (GTK+ 2.24.33; amd64-portbld-freebsd14.0) List-Id: Production branch of FreeBSD source code List-Archive: https://lists.freebsd.org/archives/freebsd-stable List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-stable@freebsd.org X-BeenThere: freebsd-stable@freebsd.org Mime-Version: 1.0 Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: 8bit X-Spamd-Bar: ---- X-Rspamd-Pre-Result: action=no action; module=replies; Message is reply to one we originated X-Spamd-Result: default: False [-4.00 / 15.00]; REPLY(-4.00)[]; ASN(0.00)[asn:7684, ipnet:153.125.128.0/18, country:JP] X-Rspamd-Queue-Id: 4Rq2Sl1TQ7z3fJV (Intentionally dropped @gmail.com recipients, as gmail refuses to accept emaif from my email domain, unfortunately.) Really OK? I cannot find block_cloning in array *features_for_read[] of stand/libsa/zfs/zfsimpl.c, which possibly mean boot codes (including loader) cannot boot from Root-on-ZFS pool having block_cloning active. Not sure adding '"com.fudosecurity:block_cloning",' here is sufficient or not. Possibly more works are needed. IMHO, all default-enabled features should be safe for booting. Implement features with disalded, impement boot codes to support them, then finally enable them by default should be the only valid route. [1] https://cgit.freebsd.org/src/tree/stand/libsa/zfs/zfsimpl.c On Mon, 18 Sep 2023 07:31:46 +0200 Martin Matuska wrote: > I vote for enabling block cloning on main :-) > > mm > > On 16. 9. 2023 19:14, Alexander Motin wrote: > > On 16.09.2023 01:25, Graham Perrin wrote: > >> On 16/09/2023 01:28, Glen Barber wrote: > >>> o A fix for the ZFS block_cloning feature has been implemented. > >> > >> Thanks > >> > >> I see > >> , > >> with > >> > >> in stable/14. > >> > >> As vfs.zfs.bclone_enabled is still 0 (at least, with 15.0-CURRENT > >> n265350-72d97e1dd9cc): should we assume that additional fixes, not > >> necessarily in time for 14.0-RELEASE, will be required before > >> vfs.zfs.bclone_enabled can default to 1? > > > > I am not aware of any block cloning issues now.  All this thread about > > bclone_enabled actually started after I asked why it is still > > disabled. Thanks to Mark Millard for spotting this issue I could fix, > > but now we are back at the point of re-enabling it again.  Since the > > tunable does not even exist anywhere outside of FreeBSD base tree, I'd > > propose to give this code another try here too.  I see no point to > > have it disabled at least in main unless somebody needs time to run > > some specific tests first. -- Tomoaki AOKI From nobody Mon Sep 18 13:26:56 2023 X-Original-To: freebsd-stable@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4Rq5FX6TtMz4tCDV; Mon, 18 Sep 2023 13:27:44 +0000 (UTC) (envelope-from mavbsd@gmail.com) Received: from mail-yw1-x112e.google.com (mail-yw1-x112e.google.com [IPv6:2607:f8b0:4864:20::112e]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "GTS CA 1D4" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4Rq5FX3jbHz4TCK; Mon, 18 Sep 2023 13:27:44 +0000 (UTC) (envelope-from mavbsd@gmail.com) Authentication-Results: mx1.freebsd.org; none Received: by mail-yw1-x112e.google.com with SMTP id 00721157ae682-59eb8ec5e20so5335107b3.3; Mon, 18 Sep 2023 06:27:44 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20230601; t=1695043664; x=1695648464; darn=freebsd.org; h=content-transfer-encoding:in-reply-to:subject:from:references:cc:to :content-language:user-agent:mime-version:date:message-id:sender :from:to:cc:subject:date:message-id:reply-to; bh=1Z7l643Yn4U0JvUDehwbKGT0tZjuvthQNYn4W2LON3w=; b=UYcxlvq/wjLbPe7DQAKfizx6qAM6wZX0NbRpvWTxpOzyWZFRxFVlCVIT3I0xnvAAA5 bg/o6RHi/xWzIkILmJ8zllYNBNNfn4lVTm6/Pc9KxZHKS2t7KdtGCMOF+ub/tIuOHOrV NmCSvk32jdFyNxTBYvx5cuNoG57+dXFdJzNaoi8d2exFZy0TKfwCRLQE3Gr0CcZ9ovb8 jQeP2D/irCWhaS9kUJZenYDrmTAIaVjxU3WzdhwbuMCGI0pmOrx4spJckf9T5xiqQjL/ 4l5cU91yOsX7ZyrciDVCeQgWVEhsCyRyyXK2UwoTAthQN6XJNap+XhxkoEatvtmNT1/u 9pfg== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20230601; t=1695043664; x=1695648464; h=content-transfer-encoding:in-reply-to:subject:from:references:cc:to :content-language:user-agent:mime-version:date:message-id:sender :x-gm-message-state:from:to:cc:subject:date:message-id:reply-to; bh=1Z7l643Yn4U0JvUDehwbKGT0tZjuvthQNYn4W2LON3w=; b=O1dCashp3wB7FE0mQghEAkdeBFquLEaZh1j/YyS40tK56EKTjDBHuQTWjvdj4+Kh0U XE21WU6GHc2NreAfqBw/R03VXFoclxwN3cZBZ6i5ZRJ/Xov1g7aAoHaorDOZIjQq+dtF cfpbr86EpFmocvqe42L8/Hwyxy2HLZ74WDZubDSnWHCJNAwh0vKGkSfFg7wVFzxruVYZ si+BZiA67XAIk13x92eoL9mXLpXwrAGWCBn2UCNdgfMlLAtAnd7xTBGCYezBueagoWja jlggugJfEu0GJwpyvnQWznXoeWAQjulYw4N0aWgd54JE1HpIC4bV7LgYc+9hpQeWg8Y7 44jQ== X-Gm-Message-State: AOJu0Yy/bxUMW68cS7PAKmwRwtRX81EuAQPybfIWcR0YsmjXWBUL3p8H Kzob8FxIZFnhA9Fg06elqgh/UNtdeGp7Mg== X-Google-Smtp-Source: AGHT+IGaBdroTsb4rijFVSTO10FO7CAbwubxKiPmKoV5uhcoNVpQb1NgwJNqOrKJV1eiWuLUbpSl4Q== X-Received: by 2002:a0d:f103:0:b0:59b:4ed2:a33 with SMTP id a3-20020a0df103000000b0059b4ed20a33mr8311350ywf.35.1695043663713; Mon, 18 Sep 2023 06:27:43 -0700 (PDT) Received: from [10.230.45.5] ([38.32.73.2]) by smtp.gmail.com with ESMTPSA id er4-20020a05690c2d8400b0057a0e5b18e0sm546832ywb.142.2023.09.18.06.27.42 (version=TLS1_3 cipher=TLS_AES_128_GCM_SHA256 bits=128/128); Mon, 18 Sep 2023 06:27:43 -0700 (PDT) Message-ID: Date: Mon, 18 Sep 2023 09:26:56 -0400 List-Id: Production branch of FreeBSD source code List-Archive: https://lists.freebsd.org/archives/freebsd-stable List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-stable@freebsd.org X-BeenThere: freebsd-stable@freebsd.org MIME-Version: 1.0 User-Agent: Mozilla/5.0 (X11; FreeBSD amd64; rv:102.0) Gecko/20100101 Thunderbird/102.11.0 Content-Language: en-US To: Tomoaki AOKI , Martin Matuska Cc: freebsd-current@freebsd.org, freebsd-stable@freebsd.org References: <20230916002831.GU52318@FreeBSD.org> <02c53c2e-127b-33b4-e13d-f6f6589dd5fe@gmail.com> <7a6692de-f096-637d-fe48-d5fb93e54f8b@FreeBSD.org> <8e4e4000-4680-0550-6772-32a6a3101761@FreeBSD.org> <20230918202204.28e21a011a0a98e3fcda9f3a@dec.sakura.ne.jp> From: Alexander Motin Subject: Re: vfs.zfs.bclone_enabled (was: FreeBSD 14.0-BETA2 Now Available) In-Reply-To: <20230918202204.28e21a011a0a98e3fcda9f3a@dec.sakura.ne.jp> Content-Type: text/plain; charset=UTF-8; format=flowed Content-Transfer-Encoding: 8bit X-Spamd-Bar: ---- X-Rspamd-Pre-Result: action=no action; module=replies; Message is reply to one we originated X-Spamd-Result: default: False [-4.00 / 15.00]; REPLY(-4.00)[]; ASN(0.00)[asn:15169, ipnet:2607:f8b0::/32, country:US] X-Rspamd-Queue-Id: 4Rq5FX3jbHz4TCK block_cloning feature is marked as READONLY_COMPAT. It should not require any special handling from the boot code. On 18.09.2023 07:22, Tomoaki AOKI wrote: > Really OK? > > I cannot find block_cloning in array *features_for_read[] of > stand/libsa/zfs/zfsimpl.c, which possibly mean boot codes (including > loader) cannot boot from Root-on-ZFS pool having block_cloning active. > > Not sure adding '"com.fudosecurity:block_cloning",' here is sufficient > or not. Possibly more works are needed. > > IMHO, all default-enabled features should be safe for booting. > Implement features with disalded, impement boot codes to support them, > then finally enable them by default should be the only valid route. > > > [1] https://cgit.freebsd.org/src/tree/stand/libsa/zfs/zfsimpl.c > > > On Mon, 18 Sep 2023 07:31:46 +0200 > Martin Matuska wrote: > >> I vote for enabling block cloning on main :-) >> >> mm >> >> On 16. 9. 2023 19:14, Alexander Motin wrote: >>> On 16.09.2023 01:25, Graham Perrin wrote: >>>> On 16/09/2023 01:28, Glen Barber wrote: >>>>> o A fix for the ZFS block_cloning feature has been implemented. >>>> >>>> Thanks >>>> >>>> I see >>>> , >>>> with >>>> >>>> in stable/14. >>>> >>>> As vfs.zfs.bclone_enabled is still 0 (at least, with 15.0-CURRENT >>>> n265350-72d97e1dd9cc): should we assume that additional fixes, not >>>> necessarily in time for 14.0-RELEASE, will be required before >>>> vfs.zfs.bclone_enabled can default to 1? >>> >>> I am not aware of any block cloning issues now.  All this thread about >>> bclone_enabled actually started after I asked why it is still >>> disabled. Thanks to Mark Millard for spotting this issue I could fix, >>> but now we are back at the point of re-enabling it again.  Since the >>> tunable does not even exist anywhere outside of FreeBSD base tree, I'd >>> propose to give this code another try here too.  I see no point to >>> have it disabled at least in main unless somebody needs time to run >>> some specific tests first. > -- Alexander Motin From nobody Mon Sep 18 15:14:21 2023 X-Original-To: freebsd-stable@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4Rq7cw0Wgyz4tLkk for ; Mon, 18 Sep 2023 15:14:40 +0000 (UTC) (envelope-from michael.proto@mailchimp.com) Received: from mail-vs1-xe30.google.com (mail-vs1-xe30.google.com [IPv6:2607:f8b0:4864:20::e30]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "GTS CA 1D4" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4Rq7ct6Y7nz3DL0 for ; Mon, 18 Sep 2023 15:14:38 +0000 (UTC) (envelope-from michael.proto@mailchimp.com) Authentication-Results: mx1.freebsd.org; dkim=pass header.d=mailchimp.com header.s=google header.b=jKGR7MJz; spf=pass (mx1.freebsd.org: domain of michael.proto@mailchimp.com designates 2607:f8b0:4864:20::e30 as permitted sender) smtp.mailfrom=michael.proto@mailchimp.com; dmarc=pass (policy=reject) header.from=mailchimp.com Received: by mail-vs1-xe30.google.com with SMTP id ada2fe7eead31-452527dded1so712687137.0 for ; Mon, 18 Sep 2023 08:14:38 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=mailchimp.com; s=google; t=1695050078; x=1695654878; darn=freebsd.org; h=cc:to:subject:message-id:date:from:in-reply-to:references :mime-version:from:to:cc:subject:date:message-id:reply-to; bh=Ci4zFveK7FOGt01cv7J3k0+AT1k10feX/y/sQRQGPoE=; b=jKGR7MJz1gGJhzp1ju25CEGke6riD0jgf0I+LjuNheoqYnnUphkxOloFBDCYoYyJC8 ecGdcPVwCyXOLnMl2bV5oqyzPkPpQkUYOQGxVVIX5bWtGGsvHlQXyNpWbV6ohL57rkzd oTQipMl2ECsL9DuGPCPKL+6hkShxRjFVnTRlw= X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20230601; t=1695050078; x=1695654878; h=cc:to:subject:message-id:date:from:in-reply-to:references :mime-version:x-gm-message-state:from:to:cc:subject:date:message-id :reply-to; bh=Ci4zFveK7FOGt01cv7J3k0+AT1k10feX/y/sQRQGPoE=; b=Q8bB8rG7CDWcoW1EgFSUzAZRduF2mBW6XgBE3cJgCBGyRwxvx+wbTV8Ov8DldT4ps9 roBeBsjuCzuV/uVpHqYYlLEYvUSHG0H/ZK22M9yMuKBqIITd49JjF7/NGCPLgxuf3z3z rUy0Dg8H8mVirEO4ea71D7yd3aEoCNnTwWzHHiI4a0nXcNAZQLXcG3Gp7uXHSXa1ZLET pbznznh0x5NnWz/wfNpEIl2fPB4GUqcuMDW7f8mr/I6j3zap4W7AnGMV3Z4cOtts49Kb +nTpTRY1SyH2oV3kHasyYNcDWDc23NOWHkqpH83SGkES7PTgTl+jFobj/dUw0M7FobbG bNfQ== X-Gm-Message-State: AOJu0YwIqwt3BR82lnoGaHP5enxZW+m1+Dy+xHWAb0xXpSnD0zwUn4sV tdLjwgvi5LcTdmPdfbtUbjLWixiB7djWFr/Q8wkA2XsADunkQkB0 X-Google-Smtp-Source: AGHT+IFhh3xKo8peZChjNLBh7+M90U+AQ1AX8Xn6eH5i56jxqwhwHurPBUaSYQyIQ2qquJT/IMxniZXqBGHTUxvkrRE= X-Received: by 2002:a05:6102:2cf:b0:44d:4f8f:d8e5 with SMTP id h15-20020a05610202cf00b0044d4f8fd8e5mr7778029vsh.20.1695050077531; Mon, 18 Sep 2023 08:14:37 -0700 (PDT) List-Id: Production branch of FreeBSD source code List-Archive: https://lists.freebsd.org/archives/freebsd-stable List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-stable@freebsd.org X-BeenThere: freebsd-stable@freebsd.org MIME-Version: 1.0 References: <1a11ae16-7425-6d5a-c864-0005343b678c@ytrizja.de> In-Reply-To: <1a11ae16-7425-6d5a-c864-0005343b678c@ytrizja.de> From: Michael Proto Date: Mon, 18 Sep 2023 11:14:21 -0400 Message-ID: Subject: Re: local-unbound stopped working after upgrade to 13.2 To: Alain Zscheile Cc: freebsd-stable@freebsd.org Content-Type: multipart/alternative; boundary="000000000000bfac2a0605a39991" X-Spamd-Bar: ------ X-Spamd-Result: default: False [-7.00 / 15.00]; WHITELIST_SPF_DKIM(-3.00)[mailchimp.com:d:+,mailchimp.com:s:+]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; NEURAL_HAM_LONG(-1.00)[-1.000]; NEURAL_HAM_SHORT(-1.00)[-0.998]; DMARC_POLICY_ALLOW(-0.50)[mailchimp.com,reject]; R_DKIM_ALLOW(-0.20)[mailchimp.com:s=google]; R_SPF_ALLOW(-0.20)[+ip6:2607:f8b0:4000::/36]; MIME_GOOD(-0.10)[multipart/alternative,text/plain]; MLMMJ_DEST(0.00)[freebsd-stable@freebsd.org]; RCVD_COUNT_ONE(0.00)[1]; ARC_NA(0.00)[]; MIME_TRACE(0.00)[0:+,1:+,2:~]; FROM_EQ_ENVFROM(0.00)[]; RCVD_TLS_LAST(0.00)[]; RCVD_IN_DNSWL_NONE(0.00)[2607:f8b0:4864:20::e30:from]; TO_MATCH_ENVRCPT_SOME(0.00)[]; DKIM_TRACE(0.00)[mailchimp.com:+]; TO_DN_SOME(0.00)[]; FROM_HAS_DN(0.00)[]; RCPT_COUNT_TWO(0.00)[2]; TAGGED_RCPT(0.00)[fbsd]; ASN(0.00)[asn:15169, ipnet:2607:f8b0::/32, country:US]; PREVIOUSLY_DELIVERED(0.00)[freebsd-stable@freebsd.org]; DWL_DNSWL_NONE(0.00)[mailchimp.com:dkim] X-Rspamd-Queue-Id: 4Rq7ct6Y7nz3DL0 --000000000000bfac2a0605a39991 Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable On Sun, Sep 17, 2023 at 2:15=E2=80=AFPM Alain Zscheile wrote: > Hi, > > After upgrading from FreeBSD-13.1 to 13.2 I noticed that local-unbound > doesn't appear to work anymore > (doesn't return DNS responses for anything, although I don't have network > traces). > > For now, I just disabled it on all my systems, but I believe this is a bu= g > that should be fixed... > > Regards, > Alain Zscheile > > > Any details on your configuration? I'm using it on an infrastructure host (with some config changes) that has gone the 13.1 -> 13.2 route and local-unbound is responding normally in my environment. -Proto --000000000000bfac2a0605a39991 Content-Type: text/html; charset="UTF-8" Content-Transfer-Encoding: quoted-printable


=
On Sun, Sep 17, 2023 at 2:15=E2=80=AF= PM Alain Zscheile <fogti+fbsd= @ytrizja.de> wrote:
Hi,

After upgrading from FreeBSD-13.1 to 13.2 I noticed that local-unbound does= n't appear to work anymore
(doesn't return DNS responses for anything, although I don't have n= etwork traces).

For now, I just disabled it on all my systems, but I believe this is a bug = that should be fixed...

Regards,
Alain Zscheile



Any details on your configuration? I&#= 39;m using it on an infrastructure host (with some config changes) that has= gone the 13.1 -> 13.2 route and local-unbound is responding normally in= my environment.


-Proto
=
--000000000000bfac2a0605a39991-- From nobody Mon Sep 18 15:21:22 2023 X-Original-To: freebsd-stable@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4Rq7mx2Vnrz4tMCj for ; Mon, 18 Sep 2023 15:21:37 +0000 (UTC) (envelope-from bsd-lists@bsdforge.com) Received: from udns.ultimatedns.net (udns.ultimatedns.net [24.113.41.81]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "ultimatedns.net", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4Rq7mw54FGz3Fm5 for ; Mon, 18 Sep 2023 15:21:36 +0000 (UTC) (envelope-from bsd-lists@bsdforge.com) Authentication-Results: mx1.freebsd.org; dkim=none; spf=none (mx1.freebsd.org: domain of bsd-lists@bsdforge.com has no SPF policy when checking 24.113.41.81) smtp.mailfrom=bsd-lists@bsdforge.com Received: from ultimatedns.net (localhost [127.0.0.1]) by udns.ultimatedns.net (8.16.1/8.16.1) with ESMTP id 38IFLNT2036886; Mon, 18 Sep 2023 08:21:29 -0700 (PDT) (envelope-from bsd-lists@bsdforge.com) List-Id: Production branch of FreeBSD source code List-Archive: https://lists.freebsd.org/archives/freebsd-stable List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-stable@freebsd.org X-BeenThere: freebsd-stable@freebsd.org MIME-Version: 1.0 Date: Mon, 18 Sep 2023 08:21:22 -0700 From: Chris To: Alain Zscheile Cc: freebsd-stable@freebsd.org Subject: Re: local-unbound stopped working after upgrade to 13.2 In-Reply-To: <1a11ae16-7425-6d5a-c864-0005343b678c@ytrizja.de> References: <1a11ae16-7425-6d5a-c864-0005343b678c@ytrizja.de> User-Agent: UDNSMS/17.0 Message-ID: X-Sender: bsd-lists@bsdforge.com Content-Type: text/plain; charset=US-ASCII; format=flowed Content-Transfer-Encoding: 7bit X-Spamd-Bar: / X-Rspamd-Pre-Result: action=no action; module=multimap; Matched map: local_wl_ip X-Spamd-Result: default: False [0.00 / 15.00]; ONCE_RECEIVED(0.10)[]; MIME_GOOD(-0.10)[text/plain]; ASN(0.00)[asn:11404, ipnet:24.113.0.0/16, country:US]; MIME_TRACE(0.00)[0:+]; local_wl_ip(0.00)[24.113.41.81]; R_DKIM_NA(0.00)[]; TAGGED_RCPT(0.00)[fbsd]; FROM_EQ_ENVFROM(0.00)[]; MLMMJ_DEST(0.00)[freebsd-stable@freebsd.org]; R_SPF_NA(0.00)[no SPF record]; FROM_HAS_DN(0.00)[] X-Rspamd-Queue-Id: 4Rq7mw54FGz3Fm5 On 2023-09-17 11:15, Alain Zscheile wrote: > Hi, > > After upgrading from FreeBSD-13.1 to 13.2 I noticed that local-unbound > doesn't > appear to work anymore > (doesn't return DNS responses for anything, although I don't have network > traces). > > For now, I just disabled it on all my systems, but I believe this is a bug > that > should be fixed... This is more likely a ports issue and would be better served on the ports@ list. If you believe this to be a bug. You will get better results filing a pr(1) at https://bugs.freebsd.org HTH --Chris > > Regards, > Alain Zscheile From nobody Mon Sep 18 15:26:00 2023 X-Original-To: stable@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4Rq7t66rS5z4tMZk for ; Mon, 18 Sep 2023 15:26:06 +0000 (UTC) (envelope-from yuri@aetern.org) Received: from wout5-smtp.messagingengine.com (wout5-smtp.messagingengine.com [64.147.123.21]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4Rq7t63fXYz3HBV for ; Mon, 18 Sep 2023 15:26:06 +0000 (UTC) (envelope-from yuri@aetern.org) Authentication-Results: mx1.freebsd.org; dkim=pass header.d=aetern.org header.s=fm1 header.b=qn+3EFp9; dkim=pass header.d=messagingengine.com header.s=fm2 header.b="L dGkfDm"; spf=pass (mx1.freebsd.org: domain of yuri@aetern.org designates 64.147.123.21 as permitted sender) smtp.mailfrom=yuri@aetern.org Received: from compute4.internal (compute4.nyi.internal [10.202.2.44]) by mailout.west.internal (Postfix) with ESMTP id 22CFE32000E5 for ; Mon, 18 Sep 2023 11:26:05 -0400 (EDT) Received: from mailfrontend2 ([10.202.2.163]) by compute4.internal (MEProxy); Mon, 18 Sep 2023 11:26:05 -0400 DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=aetern.org; h=cc :content-transfer-encoding:content-type:content-type:date:date :from:from:in-reply-to:in-reply-to:message-id:mime-version :references:reply-to:sender:subject:subject:to:to; s=fm1; t= 1695050764; x=1695137164; bh=sZuA0TUJ9bdPhtaYyTc7rQWBA/OxzKlxWNq HUeu2a1g=; b=qn+3EFp9V2YauVg6NNhxDtaQVEPXBizd6H0tLS1Iq22SlsHh6mq w9g9pmpYt/T1BX2vpeU7faINDoLl188sQzeFPDiD6Yf2bcS/rcEBwmcj9RpJ/Q+X Emw0tJqVXyO2XZaucxSQPJO0Vd/5yRBgHW8fuEYyuBhYBQYAqXR0yFOFVsA0yWtt FMXNgMJTtOpCCk6/+6SZXMeko03gbVACz5epxUQvPYEN3J7v19uw4xQ57QdVwdf6 UwSVqBmWB9jZJW4ECpl/mbK4LNn9vKqKmFqgW7J1ybbIy/iZHUWKOoMTJH807w1G d/AOWk/Tz98pMq8GxW+pA/zJ0dnhPpMnkRA== DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d= messagingengine.com; h=cc:content-transfer-encoding:content-type :content-type:date:date:feedback-id:feedback-id:from:from :in-reply-to:in-reply-to:message-id:mime-version:references :reply-to:sender:subject:subject:to:to:x-me-proxy:x-me-proxy :x-me-sender:x-me-sender:x-sasl-enc; s=fm2; t=1695050764; x= 1695137164; bh=sZuA0TUJ9bdPhtaYyTc7rQWBA/OxzKlxWNqHUeu2a1g=; b=L dGkfDmMtFzefdj58NoJibZPfhVriNcbd1bQX7cR0US5ov0SXGIpfjhTligoZcAW4 yKDXR+OXW8jrIzwxRzCtLKgduWsJMKkDe46w5H9h2wdLxaylyCtk8hpp5+a4Ej4+ d5eUjQcKU1aIAshhasdBGMlaw+OW1PwnipJj+9VYZhaJtDFnoIQrsUDuLFAQKkQU yU4Tcdw4SzuPfMqoKt7wCSxMrhQDWc+o2/sml1a9c20STBk4YrdUDv4Cd3gibBSj Irl5/1TznQnN03NFuWx3b0fV9ndxcVa6q7NS9006lDTLXKjFzAo8GCd/qh7yQCJv a63D7XT7yAisboPPwrCqg== X-ME-Sender: X-ME-Received: X-ME-Proxy-Cause: gggruggvucftvghtrhhoucdtuddrgedviedrudejkedgkeejucetufdoteggodetrfdotf fvucfrrhhofhhilhgvmecuhfgrshhtofgrihhlpdfqfgfvpdfurfetoffkrfgpnffqhgen uceurghilhhouhhtmecufedttdenucenucfjughrpefkffggfgfuvfhfhfgjtgfgsehtje ertddtvdejnecuhfhrohhmpegjuhhrihcuoeihuhhrihesrggvthgvrhhnrdhorhhgqeen ucggtffrrghtthgvrhhnpefgvdfhtdejgefgleefgfeggfegfffgteffleeigeefieehve fgudettdeuvdeuveenucevlhhushhtvghrufhiiigvpedtnecurfgrrhgrmhepmhgrihhl fhhrohhmpeihuhhrihesrggvthgvrhhnrdhorhhg X-ME-Proxy: Feedback-ID: i0d79475b:Fastmail Received: by mail.messagingengine.com (Postfix) with ESMTPA for ; Mon, 18 Sep 2023 11:26:03 -0400 (EDT) Message-ID: <82a8ed8b-c3e5-421a-b089-725a044b5ee4@aetern.org> Date: Mon, 18 Sep 2023 17:26:00 +0200 List-Id: Production branch of FreeBSD source code List-Archive: https://lists.freebsd.org/archives/freebsd-stable List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-stable@freebsd.org X-BeenThere: freebsd-stable@freebsd.org MIME-Version: 1.0 User-Agent: Mozilla Thunderbird Subject: Re: local-unbound stopped working after upgrade to 13.2 Content-Language: en-US To: stable@freebsd.org References: <1a11ae16-7425-6d5a-c864-0005343b678c@ytrizja.de> From: Yuri In-Reply-To: Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: 7bit X-Spamd-Bar: / X-Rspamd-Pre-Result: action=no action; module=multimap; Matched map: local_wl_from X-Spamd-Result: default: False [-0.39 / 15.00]; R_SPF_ALLOW(-0.20)[+ip4:64.147.123.21]; R_DKIM_ALLOW(-0.20)[aetern.org:s=fm1,messagingengine.com:s=fm2]; XM_UA_NO_VERSION(0.01)[]; DKIM_TRACE(0.00)[aetern.org:+,messagingengine.com:+]; PREVIOUSLY_DELIVERED(0.00)[stable@freebsd.org]; local_wl_from(0.00)[yuri@aetern.org]; FREEFALL_USER(0.00)[yuri]; MLMMJ_DEST(0.00)[stable@freebsd.org]; ASN(0.00)[asn:29838, ipnet:64.147.123.0/24, country:US] X-Rspamd-Queue-Id: 4Rq7t63fXYz3HBV Chris wrote: > On 2023-09-17 11:15, Alain Zscheile wrote: >> Hi, >> >> After upgrading from FreeBSD-13.1 to 13.2 I noticed that local-unbound >> doesn't >> appear to work anymore >> (doesn't return DNS responses for anything, although I don't have >> network traces). >> >> For now, I just disabled it on all my systems, but I believe this is a >> bug that >> should be fixed... > > This is more likely a ports issue and would be better served on the > ports@ list. local-unbound is in bsae. From nobody Mon Sep 18 15:44:45 2023 X-Original-To: stable@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4Rq8Ht6Wfbz4tNTd for ; Mon, 18 Sep 2023 15:44:58 +0000 (UTC) (envelope-from bsd-lists@bsdforge.com) Received: from udns.ultimatedns.net (udns.ultimatedns.net [24.113.41.81]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "ultimatedns.net", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4Rq8Ht4tD4z3Lcc for ; Mon, 18 Sep 2023 15:44:58 +0000 (UTC) (envelope-from bsd-lists@bsdforge.com) Authentication-Results: mx1.freebsd.org; none Received: from ultimatedns.net (localhost [127.0.0.1]) by udns.ultimatedns.net (8.16.1/8.16.1) with ESMTP id 38IFijv2087410; Mon, 18 Sep 2023 08:44:51 -0700 (PDT) (envelope-from bsd-lists@bsdforge.com) List-Id: Production branch of FreeBSD source code List-Archive: https://lists.freebsd.org/archives/freebsd-stable List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-stable@freebsd.org X-BeenThere: freebsd-stable@freebsd.org MIME-Version: 1.0 Date: Mon, 18 Sep 2023 08:44:45 -0700 From: Chris To: Yuri Cc: stable@freebsd.org Subject: Re: local-unbound stopped working after upgrade to 13.2 In-Reply-To: <82a8ed8b-c3e5-421a-b089-725a044b5ee4@aetern.org> References: <1a11ae16-7425-6d5a-c864-0005343b678c@ytrizja.de> <82a8ed8b-c3e5-421a-b089-725a044b5ee4@aetern.org> User-Agent: UDNSMS/17.0 Message-ID: <6285865612f654686892dfd2ff88aa24@bsdforge.com> X-Sender: bsd-lists@bsdforge.com Content-Type: text/plain; charset=US-ASCII; format=flowed Content-Transfer-Encoding: 7bit X-Spamd-Bar: ---- X-Rspamd-Pre-Result: action=no action; module=replies; Message is reply to one we originated X-Spamd-Result: default: False [-4.00 / 15.00]; REPLY(-4.00)[]; ASN(0.00)[asn:11404, ipnet:24.113.0.0/16, country:US] X-Rspamd-Queue-Id: 4Rq8Ht4tD4z3Lcc On 2023-09-18 08:26, Yuri wrote: > Chris wrote: >> On 2023-09-17 11:15, Alain Zscheile wrote: >>> Hi, >>> >>> After upgrading from FreeBSD-13.1 to 13.2 I noticed that local-unbound >>> doesn't >>> appear to work anymore >>> (doesn't return DNS responses for anything, although I don't have >>> network traces). >>> >>> For now, I just disabled it on all my systems, but I believe this is a >>> bug that >>> should be fixed... >> >> This is more likely a ports issue and would be better served on the >> ports@ list. > > local-unbound is in bsae. You mean base, right? ;-) Sure. But it's derived from the source in ports. Maybe CC ports@ ? --Chris From nobody Mon Sep 18 15:55:54 2023 X-Original-To: stable@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4Rq8Xb4CMsz4tP4d for ; Mon, 18 Sep 2023 15:55:59 +0000 (UTC) (envelope-from yuri@aetern.org) Received: from wout5-smtp.messagingengine.com (wout5-smtp.messagingengine.com [64.147.123.21]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4Rq8Xb1vtHz3NVv for ; Mon, 18 Sep 2023 15:55:59 +0000 (UTC) (envelope-from yuri@aetern.org) Authentication-Results: mx1.freebsd.org; dkim=pass header.d=aetern.org header.s=fm1 header.b=ezyNGrQu; dkim=pass header.d=messagingengine.com header.s=fm2 header.b="O vqWav0"; spf=pass (mx1.freebsd.org: domain of yuri@aetern.org designates 64.147.123.21 as permitted sender) smtp.mailfrom=yuri@aetern.org; dmarc=none Received: from compute3.internal (compute3.nyi.internal [10.202.2.43]) by mailout.west.internal (Postfix) with ESMTP id 5FFC7320046F for ; Mon, 18 Sep 2023 11:55:58 -0400 (EDT) Received: from mailfrontend2 ([10.202.2.163]) by compute3.internal (MEProxy); Mon, 18 Sep 2023 11:55:58 -0400 DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=aetern.org; h=cc :content-transfer-encoding:content-type:content-type:date:date :from:from:in-reply-to:in-reply-to:message-id:mime-version :references:reply-to:sender:subject:subject:to:to; s=fm1; t= 1695052557; x=1695138957; bh=6mUhd+8WfXLrb6iml0JxrBZ2SgbQ8AiVv0+ fu8ajyo0=; b=ezyNGrQuKCi2/xp9f5LFZ3WV8WBlZX+72SdpmbfcTxIEsGygA5f Le9/O/ohcrCc272vW2AAQ1UMyffeNuO+RqdyW2heHvABgvd8l9O4IFolkya+QdbK 7IXXWgYz+qFMsHXD2X5GByJcs7uaJUR4XpTImtLBsGyXHrpZe2HI+0KboH5DovZc x9OEVOaBw5+a0N+p4MuL/pqUVWCrs4fkEvzoUmZcevIrrRXDOBl1B2XP2NaEUJDT 43+NjWpzFxHjLV1rtNl5ugLurFRdwT+C6BdIy1QetgUQ0575IyHt1QRhNxG/XF1c tlHRGG31v0KWbsarkk6nscBHfjxXVy8EYBw== DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d= messagingengine.com; h=cc:content-transfer-encoding:content-type :content-type:date:date:feedback-id:feedback-id:from:from :in-reply-to:in-reply-to:message-id:mime-version:references :reply-to:sender:subject:subject:to:to:x-me-proxy:x-me-proxy :x-me-sender:x-me-sender:x-sasl-enc; s=fm2; t=1695052557; x= 1695138957; bh=6mUhd+8WfXLrb6iml0JxrBZ2SgbQ8AiVv0+fu8ajyo0=; b=O vqWav0eqG5x5MwN142a9S1nc1Q1aPZhES1r2RZvfQt2u34j7COw/cRFA/Edxtr55 80jE2ynEYtilXvcd1GGU7tks7Lw5YFF8uDV3ylYgFvuuyChTKVFRbe+WRTeiMitD FYfgAIT5MWXgNUaD6EHpY5xU5KelDRXOQt70PepX8qvcfVX5vQjjGUVdTbJ2CbwS afy+apAUfO01NkimZr+fxE3HqE+n0F4Pglj7YbqrO1W4G5oGMW3DQAAQTOJzwA9i Af/ZaxiUPz0laNzwZpXCHJWH1jcp2qwb+eM3WiAgGoUdyUHVbNVgdeXrmxImFCNv FdG0wN2LDcGrEQ7pT/c+g== X-ME-Sender: X-ME-Received: X-ME-Proxy-Cause: gggruggvucftvghtrhhoucdtuddrgedviedrudejkedgleefucetufdoteggodetrfdotf fvucfrrhhofhhilhgvmecuhfgrshhtofgrihhlpdfqfgfvpdfurfetoffkrfgpnffqhgen uceurghilhhouhhtmecufedttdenucenucfjughrpefkffggfgfuvfhfhfgjtgfgsehtje ertddtvdejnecuhfhrohhmpegjuhhrihcuoeihuhhrihesrggvthgvrhhnrdhorhhgqeen ucggtffrrghtthgvrhhnpefgvdfhtdejgefgleefgfeggfegfffgteffleeigeefieehve fgudettdeuvdeuveenucevlhhushhtvghrufhiiigvpedtnecurfgrrhgrmhepmhgrihhl fhhrohhmpeihuhhrihesrggvthgvrhhnrdhorhhg X-ME-Proxy: Feedback-ID: i0d79475b:Fastmail Received: by mail.messagingengine.com (Postfix) with ESMTPA for ; Mon, 18 Sep 2023 11:55:57 -0400 (EDT) Message-ID: Date: Mon, 18 Sep 2023 17:55:54 +0200 List-Id: Production branch of FreeBSD source code List-Archive: https://lists.freebsd.org/archives/freebsd-stable List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-stable@freebsd.org X-BeenThere: freebsd-stable@freebsd.org MIME-Version: 1.0 User-Agent: Mozilla Thunderbird Subject: Re: local-unbound stopped working after upgrade to 13.2 Content-Language: en-US To: stable@freebsd.org References: <1a11ae16-7425-6d5a-c864-0005343b678c@ytrizja.de> <82a8ed8b-c3e5-421a-b089-725a044b5ee4@aetern.org> <6285865612f654686892dfd2ff88aa24@bsdforge.com> From: Yuri In-Reply-To: <6285865612f654686892dfd2ff88aa24@bsdforge.com> Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: 7bit X-Spamd-Bar: - X-Rspamd-Pre-Result: action=no action; module=multimap; Matched map: local_wl_from X-Spamd-Result: default: False [-1.89 / 15.00]; DWL_DNSWL_LOW(-1.00)[messagingengine.com:dkim]; RWL_MAILSPIKE_EXCELLENT(-0.40)[64.147.123.21:from]; R_DKIM_ALLOW(-0.20)[aetern.org:s=fm1,messagingengine.com:s=fm2]; R_SPF_ALLOW(-0.20)[+ip4:64.147.123.21:c]; RCVD_IN_DNSWL_LOW(-0.10)[64.147.123.21:from]; XM_UA_NO_VERSION(0.01)[]; DKIM_TRACE(0.00)[aetern.org:+,messagingengine.com:+]; MLMMJ_DEST(0.00)[stable@freebsd.org]; ARC_NA(0.00)[]; PREVIOUSLY_DELIVERED(0.00)[stable@freebsd.org]; FREEFALL_USER(0.00)[yuri]; DMARC_NA(0.00)[aetern.org]; local_wl_from(0.00)[yuri@aetern.org]; ASN(0.00)[asn:29838, ipnet:64.147.123.0/24, country:US] X-Rspamd-Queue-Id: 4Rq8Xb1vtHz3NVv Chris wrote: > On 2023-09-18 08:26, Yuri wrote: >> Chris wrote: >>> On 2023-09-17 11:15, Alain Zscheile wrote: >>>> Hi, >>>> >>>> After upgrading from FreeBSD-13.1 to 13.2 I noticed that local-unbound >>>> doesn't >>>> appear to work anymore >>>> (doesn't return DNS responses for anything, although I don't have >>>> network traces). >>>> >>>> For now, I just disabled it on all my systems, but I believe this is a >>>> bug that >>>> should be fixed... >>> >>> This is more likely a ports issue and would be better served on the >>> ports@ list. >> >> local-unbound is in bsae. > You mean base, right? ;-) > Sure. But it's derived from the source in ports. Maybe CC ports@ ? No, the source is in contrib/unbound, has its own set of build rules and the changes between 13.1 and 13.2 can be easily seen using git, don't see how ports are related. From nobody Mon Sep 18 21:37:20 2023 X-Original-To: freebsd-stable@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4RqJ6Z3x1Kz4tnDQ; Mon, 18 Sep 2023 21:37:26 +0000 (UTC) (envelope-from junchoon@dec.sakura.ne.jp) Received: from www121.sakura.ne.jp (www121.sakura.ne.jp [153.125.133.21]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4RqJ6Y6RZqz4XPL; Mon, 18 Sep 2023 21:37:25 +0000 (UTC) (envelope-from junchoon@dec.sakura.ne.jp) Authentication-Results: mx1.freebsd.org; none Received: from kalamity.joker.local (123-1-88-210.area1b.commufa.jp [123.1.88.210]) (authenticated bits=0) by www121.sakura.ne.jp (8.16.1/8.16.1/[SAKURA-WEB]/20201212) with ESMTPA id 38ILbKTW077663; Tue, 19 Sep 2023 06:37:20 +0900 (JST) (envelope-from junchoon@dec.sakura.ne.jp) Date: Tue, 19 Sep 2023 06:37:20 +0900 From: Tomoaki AOKI To: Alexander Motin Cc: Martin Matuska , freebsd-current@freebsd.org, freebsd-stable@freebsd.org Subject: Re: vfs.zfs.bclone_enabled (was: FreeBSD 14.0-BETA2 Now Available) Message-Id: <20230919063720.e1e0b449863f2860ace51376@dec.sakura.ne.jp> In-Reply-To: References: <20230916002831.GU52318@FreeBSD.org> <02c53c2e-127b-33b4-e13d-f6f6589dd5fe@gmail.com> <7a6692de-f096-637d-fe48-d5fb93e54f8b@FreeBSD.org> <8e4e4000-4680-0550-6772-32a6a3101761@FreeBSD.org> <20230918202204.28e21a011a0a98e3fcda9f3a@dec.sakura.ne.jp> Organization: Junchoon corps X-Mailer: Sylpheed 3.7.0 (GTK+ 2.24.33; amd64-portbld-freebsd14.0) List-Id: Production branch of FreeBSD source code List-Archive: https://lists.freebsd.org/archives/freebsd-stable List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-stable@freebsd.org X-BeenThere: freebsd-stable@freebsd.org Mime-Version: 1.0 Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: 8bit X-Spamd-Bar: ---- X-Rspamd-Pre-Result: action=no action; module=replies; Message is reply to one we originated X-Spamd-Result: default: False [-4.00 / 15.00]; REPLY(-4.00)[]; ASN(0.00)[asn:7684, ipnet:153.125.128.0/18, country:JP] X-Rspamd-Queue-Id: 4RqJ6Y6RZqz4XPL At least, if I read the code correctly, "com.fudosecurity:block_cloning", should be added to array *features_for_read[] of stand/libsa/zfs/zfsimpl.c. There are check codes like below, so without it, boot codes would reject to boot from any pool having block_cloning feature enabled. Am I missing something? > for (i = 0; features_for_read[i] != NULL; i++) { > if (memcmp(nvp_name->nv_data, features_for_read[i], nvp_name->nv_size) == 0) { > found = 1; > break; > } > } > > if (!found) { > printf("ZFS: unsupported feature: %.*s\n", > nvp_name->nv_size, nvp_name->nv_data); > rc = EIO; > } Regards. On Mon, 18 Sep 2023 09:26:56 -0400 Alexander Motin wrote: > block_cloning feature is marked as READONLY_COMPAT. It should not > require any special handling from the boot code. > > On 18.09.2023 07:22, Tomoaki AOKI wrote: > > Really OK? > > > > I cannot find block_cloning in array *features_for_read[] of > > stand/libsa/zfs/zfsimpl.c, which possibly mean boot codes (including > > loader) cannot boot from Root-on-ZFS pool having block_cloning active. > > > > Not sure adding '"com.fudosecurity:block_cloning",' here is sufficient > > or not. Possibly more works are needed. > > > > IMHO, all default-enabled features should be safe for booting. > > Implement features with disalded, impement boot codes to support them, > > then finally enable them by default should be the only valid route. > > > > > > [1] https://cgit.freebsd.org/src/tree/stand/libsa/zfs/zfsimpl.c > > > > > > On Mon, 18 Sep 2023 07:31:46 +0200 > > Martin Matuska wrote: > > > >> I vote for enabling block cloning on main :-) > >> > >> mm > >> > >> On 16. 9. 2023 19:14, Alexander Motin wrote: > >>> On 16.09.2023 01:25, Graham Perrin wrote: > >>>> On 16/09/2023 01:28, Glen Barber wrote: > >>>>> o A fix for the ZFS block_cloning feature has been implemented. > >>>> > >>>> Thanks > >>>> > >>>> I see > >>>> , > >>>> with > >>>> > >>>> in stable/14. > >>>> > >>>> As vfs.zfs.bclone_enabled is still 0 (at least, with 15.0-CURRENT > >>>> n265350-72d97e1dd9cc): should we assume that additional fixes, not > >>>> necessarily in time for 14.0-RELEASE, will be required before > >>>> vfs.zfs.bclone_enabled can default to 1? > >>> > >>> I am not aware of any block cloning issues now.  All this thread about > >>> bclone_enabled actually started after I asked why it is still > >>> disabled. Thanks to Mark Millard for spotting this issue I could fix, > >>> but now we are back at the point of re-enabling it again.  Since the > >>> tunable does not even exist anywhere outside of FreeBSD base tree, I'd > >>> propose to give this code another try here too.  I see no point to > >>> have it disabled at least in main unless somebody needs time to run > >>> some specific tests first. > > > > -- > Alexander Motin -- Tomoaki AOKI From nobody Mon Sep 18 22:01:53 2023 X-Original-To: stable@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4RqJfq5p7Vz4tpSv for ; Mon, 18 Sep 2023 22:01:55 +0000 (UTC) (envelope-from kevans@FreeBSD.org) Received: from smtp.freebsd.org (smtp.freebsd.org [96.47.72.83]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "smtp.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4RqJfq46tVz3G9d for ; Mon, 18 Sep 2023 22:01:55 +0000 (UTC) (envelope-from kevans@FreeBSD.org) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1695074515; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=yoee9yRerSQ5Cknvvc4haJpH34Gh6xa8Y0fecK5JyfA=; b=Uo7/8KiXmJ+z5PNWEw5CDUzwFdqAK8hONv6oGSiLsn4sQaB9JSCrjSn7ekDGN6cA+U7xXi 1MIbJrslPoA5/9eb+xKopWvV0D0AkEdC9t8KlCUw+FueA64IUYtUvh3n0TolQUysYo2/NW bwkl3UqMvCCEcoiP0KmhljUeyiti5nRt+Em/4xi9kZrPYM4k6/ms3nrAPVQTpWKixvvhIJ BnU1OfG1zcqaQd41uTJCvssyEXED7OktWHhQBMsPToMbLlv3TncAaexJEO7gSwVFSJgty3 gq0TCwhCBEs+dKcoFhliWG8qy3mBv1F8pevJXKlpy6pb84YKD02Zi7PsfMjNvA== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1695074515; a=rsa-sha256; cv=none; b=DuGCs0bjQNhTRJCP+nanA2z8kVPhID7ZgyygilUA96zRY+ethYU4Gaj+F6z62pn0Tpc2PS LxZ3K+xxW7xyujwKRTBaMS2Gi9HvlkW9flr46/K3Qh/vq5Ib9PVvGSg6kH0Dng8KaICSjv zw7DfUGvFinidd7cSln9dFveOqINHnUY8Q3cZilmrLKQnLWcADUtOS+AtlfpQ/XtrN9bVn WDcVfu95Dg1pc0dunJKTE7NqngWZggZVlA+/VhydlmtVNVFokdEQ1FcphIDVBlK2krKdy/ 9jYrY4RS5Ba6wdxHd2GkTjE4QfIRvFjjEXT4d9QAtnYXxvXJaVKtz8ROQpICGw== ARC-Authentication-Results: i=1; mx1.freebsd.org; none ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1695074515; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=yoee9yRerSQ5Cknvvc4haJpH34Gh6xa8Y0fecK5JyfA=; b=QTyGqhLMB6IgxrpFaZYRvWDxCTCfUnEM9SE17v/53aAPEUMmTI3FfZwl5CEbHzZhf6oibm 0ms3orycCi/NRnvb8UGxXHA0xcrUHvjUzYV86Hn3DaxyXKcc7NHtEsVIrc6ssscRcOnWpJ sXZToQMCinBHeZKUkcxOPqsNgHB+0NWpmRIkA9vqiIGCI1YRC0/ZsujVTvZ3u4Je4JKnbQ S73+UesBANbNXnKJecLYBQ2pFGPV5N/P4ZjsQ8eL/w64YF7oSwyVA02IRDhBZ2QtuA3D32 3f+hbuCKd4Ir+ZLaGKCLGDmdQ3qAz14spdbC1w5msNO9xW5Mw3V9y/Sn3eMYcg== Received: from [10.9.4.95] (unknown [209.182.120.176]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) (Authenticated sender: kevans/mail) by smtp.freebsd.org (Postfix) with ESMTPSA id 4RqJfq244Lz1PCW for ; Mon, 18 Sep 2023 22:01:55 +0000 (UTC) (envelope-from kevans@FreeBSD.org) Message-ID: Date: Mon, 18 Sep 2023 17:01:53 -0500 List-Id: Production branch of FreeBSD source code List-Archive: https://lists.freebsd.org/archives/freebsd-stable List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-stable@freebsd.org X-BeenThere: freebsd-stable@freebsd.org MIME-Version: 1.0 User-Agent: Mozilla/5.0 (X11; FreeBSD amd64; rv:102.0) Gecko/20100101 Thunderbird/102.13.0 Subject: Re: vfs.zfs.bclone_enabled (was: FreeBSD 14.0-BETA2 Now Available) Content-Language: en-US To: stable@freebsd.org References: <20230916002831.GU52318@FreeBSD.org> <02c53c2e-127b-33b4-e13d-f6f6589dd5fe@gmail.com> <7a6692de-f096-637d-fe48-d5fb93e54f8b@FreeBSD.org> <8e4e4000-4680-0550-6772-32a6a3101761@FreeBSD.org> <20230918202204.28e21a011a0a98e3fcda9f3a@dec.sakura.ne.jp> <20230919063720.e1e0b449863f2860ace51376@dec.sakura.ne.jp> From: Kyle Evans In-Reply-To: <20230919063720.e1e0b449863f2860ace51376@dec.sakura.ne.jp> Content-Type: text/plain; charset=UTF-8; format=flowed Content-Transfer-Encoding: 8bit On 9/18/23 16:37, Tomoaki AOKI wrote: > At least, if I read the code correctly, > "com.fudosecurity:block_cloning", > should be added to array > *features_for_read[] > of stand/libsa/zfs/zfsimpl.c. > > There are check codes like below, so without it, boot codes would > reject to boot from any pool having block_cloning feature enabled. > Am I missing something? > >> for (i = 0; features_for_read[i] != NULL; i++) { >> if (memcmp(nvp_name->nv_data, > features_for_read[i], nvp_name->nv_size) == 0) { >> found = 1; >> break; >> } >> } >> >> if (!found) { >> printf("ZFS: unsupported feature: %.*s\n", >> nvp_name->nv_size, nvp_name->nv_data); >> rc = EIO; >> } > > Regards. > I'm pretty sure what he's trying to tell you is that this feature won't show up in the list to be compared against this in the first place. Presumably the inquiry it uses either just looks for `ZFEATURE_FLAG_MOS` or filters out `ZFEATURE_FLAG_READONLY_COMPAT`, which is described as: 90 /* Can open pool readonly even if this feature is not supported. */ Thanks, Kyle Evans > > On Mon, 18 Sep 2023 09:26:56 -0400 > Alexander Motin wrote: > >> block_cloning feature is marked as READONLY_COMPAT. It should not >> require any special handling from the boot code. >> >> On 18.09.2023 07:22, Tomoaki AOKI wrote: >>> Really OK? >>> >>> I cannot find block_cloning in array *features_for_read[] of >>> stand/libsa/zfs/zfsimpl.c, which possibly mean boot codes (including >>> loader) cannot boot from Root-on-ZFS pool having block_cloning active. >>> >>> Not sure adding '"com.fudosecurity:block_cloning",' here is sufficient >>> or not. Possibly more works are needed. >>> >>> IMHO, all default-enabled features should be safe for booting. >>> Implement features with disalded, impement boot codes to support them, >>> then finally enable them by default should be the only valid route. >>> >>> >>> [1] https://cgit.freebsd.org/src/tree/stand/libsa/zfs/zfsimpl.c >>> >>> >>> On Mon, 18 Sep 2023 07:31:46 +0200 >>> Martin Matuska wrote: >>> >>>> I vote for enabling block cloning on main :-) >>>> >>>> mm >>>> >>>> On 16. 9. 2023 19:14, Alexander Motin wrote: >>>>> On 16.09.2023 01:25, Graham Perrin wrote: >>>>>> On 16/09/2023 01:28, Glen Barber wrote: >>>>>>> o A fix for the ZFS block_cloning feature has been implemented. >>>>>> >>>>>> Thanks >>>>>> >>>>>> I see >>>>>> , >>>>>> with >>>>>> >>>>>> in stable/14. >>>>>> >>>>>> As vfs.zfs.bclone_enabled is still 0 (at least, with 15.0-CURRENT >>>>>> n265350-72d97e1dd9cc): should we assume that additional fixes, not >>>>>> necessarily in time for 14.0-RELEASE, will be required before >>>>>> vfs.zfs.bclone_enabled can default to 1? >>>>> >>>>> I am not aware of any block cloning issues now.  All this thread about >>>>> bclone_enabled actually started after I asked why it is still >>>>> disabled. Thanks to Mark Millard for spotting this issue I could fix, >>>>> but now we are back at the point of re-enabling it again.  Since the >>>>> tunable does not even exist anywhere outside of FreeBSD base tree, I'd >>>>> propose to give this code another try here too.  I see no point to >>>>> have it disabled at least in main unless somebody needs time to run >>>>> some specific tests first. >>> >> >> -- >> Alexander Motin > From nobody Mon Sep 18 23:47:37 2023 X-Original-To: stable@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4RqM0s4wk6z4twZM for ; Mon, 18 Sep 2023 23:47:41 +0000 (UTC) (envelope-from cy.schubert@cschubert.com) Received: from omta001.cacentral1.a.cloudfilter.net (omta001.cacentral1.a.cloudfilter.net [3.97.99.32]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client CN "Client", Issuer "CA" (not verified)) by mx1.freebsd.org (Postfix) with ESMTPS id 4RqM0s0p4Wz3TP3 for ; Mon, 18 Sep 2023 23:47:40 +0000 (UTC) (envelope-from cy.schubert@cschubert.com) Authentication-Results: mx1.freebsd.org; none Received: from shw-obgw-4004a.ext.cloudfilter.net ([10.228.9.227]) by cmsmtp with ESMTP id iCYRqdTuBLAoIiNxsq7aZ4; Mon, 18 Sep 2023 23:47:40 +0000 Received: from spqr.komquats.com ([70.66.152.170]) by cmsmtp with ESMTPA id iNxqqCztB3fOSiNxrq9dLg; Mon, 18 Sep 2023 23:47:40 +0000 X-Authority-Analysis: v=2.4 cv=J8G5USrS c=1 sm=1 tr=0 ts=6508e19c a=y8EK/9tc/U6QY+pUhnbtgQ==:117 a=y8EK/9tc/U6QY+pUhnbtgQ==:17 a=kj9zAlcOel0A:10 a=zNV7Rl7Rt7sA:10 a=VAHUpHMNAAAA:8 a=YxBL1-UpAAAA:8 a=6I5d2MoRAAAA:8 a=EkcXrb_YAAAA:8 a=wfWZUWH4dsjNhlk8UikA:9 a=CjuIK1q_8ugA:10 a=q20KtgJq_39pKEN4rN78:22 a=Ia-lj3WSrqcvXOmTRaiG:22 a=IjZwj45LgO3ly-622nXo:22 a=LK5xJRSDVpKd5WXXoEvA:22 Received: from slippy.cwsent.com (slippy [10.1.1.91]) by spqr.komquats.com (Postfix) with ESMTP id 22AD76FE; Mon, 18 Sep 2023 16:47:38 -0700 (PDT) Received: by slippy.cwsent.com (Postfix, from userid 1000) id E2AB41ED; Mon, 18 Sep 2023 16:47:37 -0700 (PDT) X-Mailer: exmh version 2.9.0 11/07/2018 with nmh-1.8+dev Reply-to: Cy Schubert From: Cy Schubert X-os: FreeBSD X-Sender: cy@cwsent.com X-URL: http://www.cschubert.com/ To: Yuri cc: stable@freebsd.org Subject: Re: local-unbound stopped working after upgrade to 13.2 In-reply-to: References: <1a11ae16-7425-6d5a-c864-0005343b678c@ytrizja.de> <82a8ed8b-c3e5-421a-b089-725a044b5ee4@aetern.org> <6285865612f654686892dfd2ff88aa24@bsdforge.com> Comments: In-reply-to Yuri message dated "Mon, 18 Sep 2023 17:55:54 +0200." List-Id: Production branch of FreeBSD source code List-Archive: https://lists.freebsd.org/archives/freebsd-stable List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-stable@freebsd.org X-BeenThere: freebsd-stable@freebsd.org Mime-Version: 1.0 Content-Type: text/plain; charset=us-ascii Date: Mon, 18 Sep 2023 16:47:37 -0700 Message-Id: <20230918234737.E2AB41ED@slippy.cwsent.com> X-CMAE-Envelope: MS4xfHfBo2LE4fQqakh21gijvPS9lAxAiEVV9JGaK0ZGKFmH2kyjUG9olXCClJ2e/0C28I4bG+JPJDUnLhZ6227SHicGFgosUmzhTA5KrUh82yPGFmsbuMJl a49GgJA08Es9FDzBZysWA48kqMZDEJFBhxYhvjRFkxQSzgi9FZBy/Bhq+zxxPpV3TbI7uTpMw47DbDHL2tPqp3RruTzNTbnCjSPmjDf6rEMenCsInnHT+tIi X-Spamd-Bar: ---- X-Rspamd-Pre-Result: action=no action; module=replies; Message is reply to one we originated X-Spamd-Result: default: False [-4.00 / 15.00]; REPLY(-4.00)[]; ASN(0.00)[asn:16509, ipnet:3.96.0.0/15, country:US] X-Rspamd-Queue-Id: 4RqM0s0p4Wz3TP3 In message , Yuri writes: > Chris wrote: > > On 2023-09-18 08:26, Yuri wrote: > >> Chris wrote: > >>> On 2023-09-17 11:15, Alain Zscheile wrote: > >>>> Hi, > >>>> > >>>> After upgrading from FreeBSD-13.1 to 13.2 I noticed that local-unbound > >>>> doesn't > >>>> appear to work anymore > >>>> (doesn't return DNS responses for anything, although I don't have > >>>> network traces). > >>>> > >>>> For now, I just disabled it on all my systems, but I believe this is a > >>>> bug that > >>>> should be fixed... > >>> > >>> This is more likely a ports issue and would be better served on the > >>> ports@ list. > >> > >> local-unbound is in bsae. > > You mean base, right? ;-) > > Sure. But it's derived from the source in ports. Maybe CC ports@ ? > > No, the source is in contrib/unbound, has its own set of build rules and > the changes between 13.1 and 13.2 can be easily seen using git, don't > see how ports are related. > This is correct. emaste@ refers to it as FreeBSD's bespoke build system. The word describes it succinctly. This reminds me that 15-CURRENT will get an update to 1.18.0 once make universe finishes building, probably by tomorrow. It built successfully on amd64 already. It will be MFCed to stable/* in a couple of weeks or so after that. -- Cheers, Cy Schubert FreeBSD UNIX: Web: https://FreeBSD.org NTP: Web: https://nwtime.org e^(i*pi)+1=0 From nobody Tue Sep 19 08:37:47 2023 X-Original-To: freebsd-stable@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4RqZmn1chHz4tcYm for ; Tue, 19 Sep 2023 08:38:01 +0000 (UTC) (envelope-from fogti+fbsd@ytrizja.de) Received: from ytrizja.de (ytrizja.de [IPv6:2a01:4f8:c17:6316::1]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4RqZmk6kLvz3LYR for ; Tue, 19 Sep 2023 08:37:58 +0000 (UTC) (envelope-from fogti+fbsd@ytrizja.de) Authentication-Results: mx1.freebsd.org; dkim=pass header.d=ytrizja.de header.s=2020 header.b=oYXLO0ow; spf=pass (mx1.freebsd.org: domain of fogti+fbsd@ytrizja.de designates 2a01:4f8:c17:6316::1 as permitted sender) smtp.mailfrom=fogti+fbsd@ytrizja.de; dmarc=pass (policy=reject) header.from=ytrizja.de Message-ID: <413c02d2-89bd-96c7-5999-ee789b6ed97b@ytrizja.de> DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=ytrizja.de; s=2020; t=1695112669; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=fJpmNdQeTDCE1j/pwmhtU7ZBihihJLil81vZTiZe014=; b=oYXLO0ow4ZxPS9XlSf0REPUwSlcVeeJrtWfjDSRlAioJyE7EyElwCjLLw/OqwPVXV+UkeM uxFs74LalfxIu02nA1HbASRsLP5C5/tot45NRxcZiZ+gql3uTwhVDXuZ0zdyIYzRmT+Nls /cIxWBiiGWOrLiwZ/wrP5NMh2wDlqUel8qxd+Za+CfQ+N4HtH5XZ1UR4EQlaAwzgN3riFt kXhq91ZbNsiuRulbkYmnlmLQq/cDOVZfp1y1HaveQRtvbqRHoR69N6ewByQ5bNfQP6D0z9 KNzM6aVD9BXUJXka19fxiX3BmB3o3XCeoqnJ+VqW8rfHFqqASDNmS8PSgqKuIg== Date: Tue, 19 Sep 2023 10:37:47 +0200 List-Id: Production branch of FreeBSD source code List-Archive: https://lists.freebsd.org/archives/freebsd-stable List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-stable@freebsd.org X-BeenThere: freebsd-stable@freebsd.org MIME-Version: 1.0 Subject: Re: local-unbound stopped working after upgrade to 13.2 To: freebsd-stable@freebsd.org References: <1a11ae16-7425-6d5a-c864-0005343b678c@ytrizja.de> Content-Language: en-US From: Alain Zscheile In-Reply-To: Content-Type: text/plain; charset=UTF-8; format=flowed Content-Transfer-Encoding: 7bit X-Spamd-Bar: --- X-Spamd-Result: default: False [-4.00 / 15.00]; NEURAL_HAM_LONG(-1.00)[-1.000]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; NEURAL_HAM_SHORT(-1.00)[-0.999]; DMARC_POLICY_ALLOW(-0.50)[ytrizja.de,reject]; R_SPF_ALLOW(-0.20)[+mx]; R_DKIM_ALLOW(-0.20)[ytrizja.de:s=2020]; MIME_GOOD(-0.10)[text/plain]; TO_MATCH_ENVRCPT_ALL(0.00)[]; ARC_NA(0.00)[]; FROM_HAS_DN(0.00)[]; MID_RHS_MATCH_FROM(0.00)[]; TAGGED_FROM(0.00)[fbsd]; ASN(0.00)[asn:24940, ipnet:2a01:4f8::/32, country:DE]; DKIM_TRACE(0.00)[ytrizja.de:+]; TO_DN_NONE(0.00)[]; RCPT_COUNT_ONE(0.00)[1]; RCVD_COUNT_ZERO(0.00)[0]; MIME_TRACE(0.00)[0:+]; FROM_EQ_ENVFROM(0.00)[]; MLMMJ_DEST(0.00)[freebsd-stable@freebsd.org] X-Rspamd-Queue-Id: 4RqZmk6kLvz3LYR On 2023-09-18 17:21, Chris wrote: > On 2023-09-17 11:15, Alain Zscheile wrote: >> After upgrading from FreeBSD-13.1 to 13.2 I noticed that local-unbound doesn't >> appear to work anymore >> (doesn't return DNS responses for anything, although I don't have network traces). >> >> For now, I just disabled it on all my systems, but I believe this is a bug that >> should be fixed... > > This is more likely a ports issue and would be better served on the ports@ list. > If you believe this to be a bug. You will get better results filing a pr(1) at > https://bugs.freebsd.org Based upon what I've heard from others, the issue doesn't appear to be present in ports' dns/unbound. From nobody Tue Sep 19 08:59:36 2023 X-Original-To: freebsd-stable@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4RqbFw39k9z4tdm2 for ; Tue, 19 Sep 2023 08:59:48 +0000 (UTC) (envelope-from bc979@lafn.org) Received: from mail.sermon-archive.info (sermon-archive.info [47.181.130.121]) by mx1.freebsd.org (Postfix) with ESMTP id 4RqbFv3s32z3Q1C for ; Tue, 19 Sep 2023 08:59:47 +0000 (UTC) (envelope-from bc979@lafn.org) Authentication-Results: mx1.freebsd.org; dkim=none; spf=pass (mx1.freebsd.org: domain of bc979@lafn.org designates 47.181.130.121 as permitted sender) smtp.mailfrom=bc979@lafn.org; dmarc=none Received: from smtpclient.apple (mini [10.0.1.251]) by mail.sermon-archive.info (Postfix) with ESMTPSA id 4RqbFt4YKzz2fjS9; Tue, 19 Sep 2023 01:59:46 -0700 (PDT) Content-Type: text/plain; charset=us-ascii List-Id: Production branch of FreeBSD source code List-Archive: https://lists.freebsd.org/archives/freebsd-stable List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-stable@freebsd.org X-BeenThere: freebsd-stable@freebsd.org Mime-Version: 1.0 (Mac OS X Mail 16.0 \(3731.700.6\)) Subject: Re: local-unbound stopped working after upgrade to 13.2 From: Doug Hardie In-Reply-To: <413c02d2-89bd-96c7-5999-ee789b6ed97b@ytrizja.de> Date: Tue, 19 Sep 2023 01:59:36 -0700 Cc: freebsd-stable@freebsd.org Content-Transfer-Encoding: quoted-printable Message-Id: <61C47FC1-43A5-4511-A034-D89E60DFF10E@sermon-archive.info> References: <1a11ae16-7425-6d5a-c864-0005343b678c@ytrizja.de> <413c02d2-89bd-96c7-5999-ee789b6ed97b@ytrizja.de> To: Alain Zscheile X-Mailer: Apple Mail (2.3731.700.6) X-Virus-Scanned: clamav-milter 1.1.2 at mail X-Virus-Status: Clean X-Spamd-Bar: -- X-Spamd-Result: default: False [-2.54 / 15.00]; NEURAL_HAM_LONG(-1.00)[-1.000]; NEURAL_HAM_MEDIUM(-1.00)[-0.999]; NEURAL_HAM_SHORT(-0.94)[-0.943]; MV_CASE(0.50)[]; R_SPF_ALLOW(-0.20)[+mx]; RCVD_NO_TLS_LAST(0.10)[]; MIME_GOOD(-0.10)[text/plain]; ONCE_RECEIVED(0.10)[]; TO_DN_SOME(0.00)[]; ARC_NA(0.00)[]; MLMMJ_DEST(0.00)[freebsd-stable@freebsd.org]; FROM_EQ_ENVFROM(0.00)[]; MIME_TRACE(0.00)[0:+]; R_DKIM_NA(0.00)[]; TAGGED_RCPT(0.00)[fbsd]; RCVD_COUNT_ONE(0.00)[1]; FROM_HAS_DN(0.00)[]; DMARC_NA(0.00)[lafn.org: no valid DMARC record]; RCPT_COUNT_TWO(0.00)[2]; ASN(0.00)[asn:5650, ipnet:47.181.128.0/18, country:US]; TO_MATCH_ENVRCPT_SOME(0.00)[]; RCVD_VIA_SMTP_AUTH(0.00)[] X-Rspamd-Queue-Id: 4RqbFv3s32z3Q1C > On Sep 19, 2023, at 01:37, Alain Zscheile = wrote: >=20 > On 2023-09-18 17:21, Chris wrote: >=20 >> On 2023-09-17 11:15, Alain Zscheile wrote: >>> After upgrading from FreeBSD-13.1 to 13.2 I noticed that = local-unbound doesn't >>> appear to work anymore >>> (doesn't return DNS responses for anything, although I don't have = network traces). >>>=20 >>> For now, I just disabled it on all my systems, but I believe this is = a bug that >>> should be fixed... >>=20 >> This is more likely a ports issue and would be better served on the = ports@ list. >> If you believe this to be a bug. You will get better results filing a = pr(1) at >> https://bugs.freebsd.org >=20 > Based upon what I've heard from others, the issue doesn't appear to be = present in ports' > dns/unbound. I have been running the unbound port (pkg) on FreeBSD-13.2 ever since = 13.2 became available. AMD64 with Intel processor. I have not = experienced any issues. It just works. Local unbound never worked for = what I needed. I don't know if that was a limitation of local unbound = or if there was an issue with it. The port worked so I stuck with it. -- Doug From nobody Tue Sep 19 10:01:28 2023 X-Original-To: freebsd-stable@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4Rqcd70WKJz4tjSH for ; Tue, 19 Sep 2023 10:01:31 +0000 (UTC) (envelope-from des@freebsd.org) Received: from smtp.freebsd.org (smtp.freebsd.org [IPv6:2610:1c1:1:606c::24b:4]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "smtp.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4Rqcd703PPz3VVZ; Tue, 19 Sep 2023 10:01:31 +0000 (UTC) (envelope-from des@freebsd.org) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1695117691; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=cuxQeMqeRZkqcyu6YtlOzN2kp3nBtPlfvtexevIdTGs=; b=MglqzHyTJ5+uwPegaPaLhzf2Xgs8myoelj1ZRgvotcJ8SuV2WsK2lZlDMychMeLxB4NY5S ortQx/R4kNbFG+q80mQI87ykEvO4wHvXQCR8Qv+7CkoqCXGYpN+XbhhvW9zh8Ck+HNzVFE JLpLQTn+fNayxmjjYh8oLXOdqQ1nifiryZCw9MbfchO8GLMBcyYgi8hHhy/Pa9JGHOQdbj bBg7vKBjZza3ZD/Ntmoca1NUEHj2lgUaNA5plnWHwLXBAYWa6SPrIvk7zqsU6KZNxRo+sp Xanjbb1kNVWsWZqjpGfqH8NqeH1BMplbAPnJq6fvisvqHeOL9U6UWRow4hvS/g== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1695117691; a=rsa-sha256; cv=none; b=i5EvxF/DpBADvB3SVksNUIKLKzf7uzrIQTyi//iUjjtBxnJYt0KP2UCi64uLU6Ld1g5xuv bro6DAm1+X8Y1CGldOkR1aut19bKmJdrbaZgA+SjVYS5meE4iJlD6J3zjUfC2d+y/aBVBI X+T2Qi74vKFd/fAbI6BAL56Lw2XoG924w7Z+QTPz+2mQEEc5JHZF4HUdG7ahTJro7soci7 YvSEq7KyUfRZE28Wd04juXekGNVOXtt5o9d6mlqez1m18+f17XqSdmZ9N5Bhv1fexXOKAO RxENE+zakTIV+MqzqCszguHikVVq368fvhLtw50RQ78tbn3b6A3j8pZLZ75KFg== ARC-Authentication-Results: i=1; mx1.freebsd.org; none ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1695117691; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=cuxQeMqeRZkqcyu6YtlOzN2kp3nBtPlfvtexevIdTGs=; b=xqJFoOTsBTQWagTYVzTJsX1Bepnv7QnlkHwF0pg7C86b19fyCqISEqhiiUngECGf1ur6kX Nwg3C5tbnHCR7J6KOJUIl4KexJ7DuNGcugQGDnGTymNv2bAd5mVse9XJgsyrtO7lvSj2L4 oU5z6qWv7cBiexeVRRApTgFI65zd9bt0vCrYxjxdg5Lduzl+kNjiAbKhuagZHmI/vJz3Dd HjldV5ruhc1A3HbJA3fdtEPLpyLL2nV7h0PihDDO16xd57nDu273sK37UlVxA0Roj6ux5f nURPZhjgFuBuKl3USyQ8GYdRLU50Ebf54WVoimkd6ak0PqBS9DroWAXivaUE6A== Received: from ltc.des.no (205.22.65.37.rev.sfr.net [37.65.22.205]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) (Authenticated sender: des) by smtp.freebsd.org (Postfix) with ESMTPSA id 4Rqcd65dmBz1cKs; Tue, 19 Sep 2023 10:01:30 +0000 (UTC) (envelope-from des@freebsd.org) Received: by ltc.des.no (Postfix, from userid 1001) id DCCEEC8486; Tue, 19 Sep 2023 12:01:28 +0200 (CEST) From: =?utf-8?Q?Dag-Erling_Sm=C3=B8rgrav?= To: Doug Hardie , Alain Zscheile Cc: freebsd-stable@freebsd.org Subject: Re: local-unbound stopped working after upgrade to 13.2 In-Reply-To: <61C47FC1-43A5-4511-A034-D89E60DFF10E@sermon-archive.info> (Doug Hardie's message of "Tue, 19 Sep 2023 01:59:36 -0700") References: <1a11ae16-7425-6d5a-c864-0005343b678c@ytrizja.de> <413c02d2-89bd-96c7-5999-ee789b6ed97b@ytrizja.de> <61C47FC1-43A5-4511-A034-D89E60DFF10E@sermon-archive.info> User-Agent: Gnus/5.13 (Gnus v5.13) Date: Tue, 19 Sep 2023 12:01:28 +0200 Message-ID: <867comscqv.fsf@ltc.des.no> List-Id: Production branch of FreeBSD source code List-Archive: https://lists.freebsd.org/archives/freebsd-stable List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-stable@freebsd.org X-BeenThere: freebsd-stable@freebsd.org MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: quoted-printable Alain Zscheile writes: > After upgrading from FreeBSD-13.1 to 13.2 I noticed that local-unbound do= esn't > appear to work anymore [...] Doug Hardie writes: > Local unbound never worked for what I needed. [...] Normally in a situation like this I'd just read your minds and diagnose the issue and commit a patch that fixes it and then remotely hack into your computers and apply the patch, but both my mind-reading hat and my hacker hoodie are at the dry cleaners right now, so perhaps you could do me a favor and describe the problem(s) you're experiencing? DES --=20 Dag-Erling Sm=C3=B8rgrav - des@FreeBSD.org From nobody Tue Sep 19 10:08:27 2023 X-Original-To: freebsd-stable@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4RqcnL4mpXz4tk2H for ; Tue, 19 Sep 2023 10:08:38 +0000 (UTC) (envelope-from bc979@lafn.org) Received: from mail.sermon-archive.info (sermon-archive.info [47.181.130.121]) by mx1.freebsd.org (Postfix) with ESMTP id 4RqcnL43t7z3XPs; Tue, 19 Sep 2023 10:08:38 +0000 (UTC) (envelope-from bc979@lafn.org) Authentication-Results: mx1.freebsd.org; none Received: from smtpclient.apple (mini [10.0.1.251]) by mail.sermon-archive.info (Postfix) with ESMTPSA id 4RqcnK4b0nz2fjRH; Tue, 19 Sep 2023 03:08:37 -0700 (PDT) Content-Type: text/plain; charset=utf-8 List-Id: Production branch of FreeBSD source code List-Archive: https://lists.freebsd.org/archives/freebsd-stable List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-stable@freebsd.org X-BeenThere: freebsd-stable@freebsd.org Mime-Version: 1.0 (Mac OS X Mail 16.0 \(3731.700.6\)) Subject: Re: local-unbound stopped working after upgrade to 13.2 From: Doug Hardie In-Reply-To: <867comscqv.fsf@ltc.des.no> Date: Tue, 19 Sep 2023 03:08:27 -0700 Cc: Alain Zscheile , freebsd-stable@freebsd.org Content-Transfer-Encoding: quoted-printable Message-Id: <86B400F5-01AB-4623-BAF0-6332E3B0CA2F@sermon-archive.info> References: <1a11ae16-7425-6d5a-c864-0005343b678c@ytrizja.de> <413c02d2-89bd-96c7-5999-ee789b6ed97b@ytrizja.de> <61C47FC1-43A5-4511-A034-D89E60DFF10E@sermon-archive.info> <867comscqv.fsf@ltc.des.no> To: =?utf-8?Q?Dag-Erling_Sm=C3=B8rgrav?= X-Mailer: Apple Mail (2.3731.700.6) X-Virus-Scanned: clamav-milter 1.1.2 at mail X-Virus-Status: Clean X-Spamd-Bar: ---- X-Rspamd-Pre-Result: action=no action; module=replies; Message is reply to one we originated X-Spamd-Result: default: False [-4.00 / 15.00]; REPLY(-4.00)[]; TAGGED_RCPT(0.00)[fbsd]; ASN(0.00)[asn:5650, ipnet:47.181.128.0/18, country:US] X-Rspamd-Queue-Id: 4RqcnL43t7z3XPs > On Sep 19, 2023, at 03:01, Dag-Erling Sm=C3=B8rgrav = wrote: >=20 > Alain Zscheile writes: >> After upgrading from FreeBSD-13.1 to 13.2 I noticed that = local-unbound doesn't >> appear to work anymore [...] >=20 > Doug Hardie writes: >> Local unbound never worked for what I needed. [...] >=20 > Normally in a situation like this I'd just read your minds and = diagnose > the issue and commit a patch that fixes it and then remotely hack into > your computers and apply the patch, but both my mind-reading hat and = my > hacker hoodie are at the dry cleaners right now, so perhaps you could = do > me a favor and describe the problem(s) you're experiencing? The only issue I encountered with local unbound some years ago was it = didn't support local-zone which I needed. I seem to recall that was an = intended limitation. That's why I switched to the port. -- Doug= From nobody Tue Sep 19 10:37:48 2023 X-Original-To: freebsd-stable@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4RqdR25y5Rz4tlQT for ; Tue, 19 Sep 2023 10:37:50 +0000 (UTC) (envelope-from des@freebsd.org) Received: from smtp.freebsd.org (smtp.freebsd.org [IPv6:2610:1c1:1:606c::24b:4]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "smtp.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4RqdR25Pn0z3cK5; Tue, 19 Sep 2023 10:37:50 +0000 (UTC) (envelope-from des@freebsd.org) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1695119870; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=1NyFzdhDH1K5R6d7/JVlY0DwQ3QZNba9LoMFvAR+b5c=; b=Vds14oGFvC7yVA4Luqy6I8KrzUXb/cJTaip4G4SW1S9PwnF3/pHklCNwU/jyxwyDgup0pt yOt/wV/IbzIv9ezUa08azKnNGLBTdtJ8xMpn4voxNj/PNFael++Auy66kLLvnU23bSYf/m 5bun8WU+IV9YtZJd7kCZqyoLks9DxxskoqMLDq9PA8Pn6FXUe7twIOJ8GjTpe+apulMRyB CpBf9HDdnYAYlc1SckgauhH9sBpCXLM2Df4VphljQsTNdba9qroNhS+kzZAQuT9k2lYEWV PNI3JMkmHetNpast02EkO+OLAKQ2j9U+OTGnuEj9WUF0IH3eFCdVR+2zu+tENw== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1695119870; a=rsa-sha256; cv=none; b=NvuHUFZyN3w3+COcN5xDFrabf5vHvvwfIj/6x7fnHKkRtl2t4+YYOy911nvG9vtekZ5wfB /+SWMGEObhp7XPhR9fR6bvVYRWpZNatoatpKTH6ZOcTCwZTIVnJV3psOdYqGfw2Onk6d7I GJd2DGKRJ7Yuyjspj6RPcY/H76aHlJTHP77GCg3x6I3EEhUwKg/79cKrkhhzmkzrExS5Wv yZ47QWVe/7H2AFpfJCU/rYJBUaDMraiqgdvrhykPrCU7gdJChUZH9qqNGGD1WQY2ix7/2E hDkgDSLHf6+SJQH0PkPG3vT1j9lHQCopM0zpI1quyjzghaDx3uKAIGdyp6/yJg== ARC-Authentication-Results: i=1; mx1.freebsd.org; none ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1695119870; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=1NyFzdhDH1K5R6d7/JVlY0DwQ3QZNba9LoMFvAR+b5c=; b=TdhsL4Ir2/IRdkDQy19nhKzOZfftBXA8NGrnSU6ozEgm+u+Ji2aqsAEIBayaN68Zx78huZ We/jYdi7oBquSIDk574Z8cA7XW6EKBQl4AeILiUnBAa2lgKikoDA+MW/t5x7Mc1XEeCdDW +dURtR+F/mRzwf95+jS1Aa4zR3+oqOyArDzitEFRi5BrBPC6wJ552zpJeWR4yzT+xfK8Qj mUcaTOxrCBeaaYHeq2w0x1cw25N1pw++TxGONNEsy1BgGTFXQoJufu7EBPSI2kRAJpaeZv zIXCMgx6nJ0zVh0FisjEnmpZwJMdSe4mHiDm5JHfR+neRt9ks81+ZQ2msMeYYw== Received: from ltc.des.no (2a02-8428-0993-f001-36e8-94ff-feca-9834.rev.sfr.net [IPv6:2a02:8428:993:f001:36e8:94ff:feca:9834]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) (Authenticated sender: des) by smtp.freebsd.org (Postfix) with ESMTPSA id 4RqdR23l7Jz1fXh; Tue, 19 Sep 2023 10:37:50 +0000 (UTC) (envelope-from des@freebsd.org) Received: by ltc.des.no (Postfix, from userid 1001) id 8C27CC8682; Tue, 19 Sep 2023 12:37:48 +0200 (CEST) From: =?utf-8?Q?Dag-Erling_Sm=C3=B8rgrav?= To: Doug Hardie Cc: Alain Zscheile , freebsd-stable@freebsd.org Subject: Re: local-unbound stopped working after upgrade to 13.2 In-Reply-To: <86B400F5-01AB-4623-BAF0-6332E3B0CA2F@sermon-archive.info> (Doug Hardie's message of "Tue, 19 Sep 2023 03:08:27 -0700") References: <1a11ae16-7425-6d5a-c864-0005343b678c@ytrizja.de> <413c02d2-89bd-96c7-5999-ee789b6ed97b@ytrizja.de> <61C47FC1-43A5-4511-A034-D89E60DFF10E@sermon-archive.info> <867comscqv.fsf@ltc.des.no> <86B400F5-01AB-4623-BAF0-6332E3B0CA2F@sermon-archive.info> User-Agent: Gnus/5.13 (Gnus v5.13) Date: Tue, 19 Sep 2023 12:37:48 +0200 Message-ID: <86v8c6qwhv.fsf@ltc.des.no> List-Id: Production branch of FreeBSD source code List-Archive: https://lists.freebsd.org/archives/freebsd-stable List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-stable@freebsd.org X-BeenThere: freebsd-stable@freebsd.org MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: quoted-printable Doug Hardie writes: > The only issue I encountered with local unbound some years ago was it > didn't support local-zone which I needed. It does. Just put it in a separate file in /var/unbound/conf.d/. You may need to adjust your access control settings as well. For instance, I use this to allow local-unbound on my desktop computer to also serve NATed bhyve VMs: % cat /var/unbound/conf.d/access-control.conf server: interface: 127.0.0.1 access-control: 127.0.0.0/24 allow interface: 192.168.144.1 access-control: 192.168.144.0/24 allow DES --=20 Dag-Erling Sm=C3=B8rgrav - des@FreeBSD.org From nobody Wed Sep 20 11:24:05 2023 X-Original-To: freebsd-stable@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4RrGQ72svZz4tX6M for ; Wed, 20 Sep 2023 11:24:15 +0000 (UTC) (envelope-from pete@twisted.org.uk) Received: from toybox.twisted.org.uk (toybox.twisted.org.uk [178.250.76.50]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4RrGQ567sjz4djf for ; Wed, 20 Sep 2023 11:24:13 +0000 (UTC) (envelope-from pete@twisted.org.uk) Authentication-Results: mx1.freebsd.org; dkim=pass header.d=twisted.org.uk header.s=tbx header.b=XcIDtp5n; spf=pass (mx1.freebsd.org: domain of pete@twisted.org.uk designates 178.250.76.50 as permitted sender) smtp.mailfrom=pete@twisted.org.uk; dmarc=pass (policy=none) header.from=twisted.org.uk DKIM-Signature: v=1; a=rsa-sha256; q=dns/txt; c=relaxed/relaxed; d=twisted.org.uk; s=tbx; h=Date:From:Message-Id:Subject:To:Sender:Reply-To:Cc :MIME-Version:Content-Type:Content-Transfer-Encoding:Content-ID: Content-Description:Resent-Date:Resent-From:Resent-Sender:Resent-To:Resent-Cc :Resent-Message-ID:In-Reply-To:References:List-Id:List-Help:List-Unsubscribe: List-Subscribe:List-Post:List-Owner:List-Archive; bh=MeLZPbhmnMnzB+z6XT0Lo6UXlnMBJFiXYraJeryfdmI=; t=1695209053; x=1696073053; b=XcIDtp5nP6yDpg0I8vdpGWLvQ5uZrpGbbI3Y/jcF6+ZCADHBneIawvLT9IMzlDOYNfhWW+AKlTc MsAGuLjsauDn7LsJFR3MzM7MwHjX6X8Pi9Y6zBEW3RcMKcMhea2O+hzwCSpaUG4i0nA8/KYb8FG8V xsaThXxLav3vCffQJSV30xKK2aTTTelyQ8ozyYXJqVojUfOnACRcAWPxJS6H5Js88UcTs898HmKTM 9VGIBRDee0UO9XROKTaq7rAo9/7rOYboSm9ltfxdu2oFGRrkElX3pcsWSZnMFlnrFtsSRa8CbKO4A ZR31UU7cBonR2DgdvkEkJThlDcgLxSFzF+Xw==; Received: from mailnull by toybox.twisted.org.uk with spamc-scanned (Exim 4.95 (FreeBSD)) (envelope-from ) id 1qivJN-0001ag-Om for freebsd-stable@freebsd.org; Wed, 20 Sep 2023 11:24:06 +0000 X-Spam-Checker-Version: SpamAssassin 3.4.5 (2021-03-20) on toybox.twisted.org.uk X-Spam-Level: X-Spam-Status: No, score=-0.0 required=5.0 tests=NO_RELAYS autolearn=unavailable autolearn_force=no version=3.4.5 X-Spam-Score: -0.0 () Received: from pete by toybox.twisted.org.uk with local (Exim 4.95 (FreeBSD)) (envelope-from ) id 1qivJN-0001ad-O0 for freebsd-stable@freebsd.org; Wed, 20 Sep 2023 11:24:05 +0000 To: freebsd-stable@freebsd.org Subject: Build of 14 on 13 creates a file which needs libdialog.so.9 Message-Id: From: Pete French Date: Wed, 20 Sep 2023 11:24:05 +0000 X-spamc-toybox: true X-transport-toybox: lookuphost X-Spamd-Bar: --- X-Spamd-Result: default: False [-3.99 / 15.00]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; NEURAL_HAM_LONG(-1.00)[-1.000]; NEURAL_HAM_SHORT(-0.99)[-0.993]; DMARC_POLICY_ALLOW(-0.50)[twisted.org.uk,none]; R_SPF_ALLOW(-0.20)[+ip4:178.250.76.50/32]; R_DKIM_ALLOW(-0.20)[twisted.org.uk:s=tbx]; MIME_GOOD(-0.10)[text/plain]; MLMMJ_DEST(0.00)[freebsd-stable@freebsd.org]; MIME_TRACE(0.00)[0:+]; RCVD_TLS_LAST(0.00)[]; FROM_EQ_ENVFROM(0.00)[]; ARC_NA(0.00)[]; RCPT_COUNT_ONE(0.00)[1]; MID_RHS_MATCH_FROMTLD(0.00)[]; FROM_HAS_DN(0.00)[]; DKIM_TRACE(0.00)[twisted.org.uk:+]; TO_MATCH_ENVRCPT_ALL(0.00)[]; ASN(0.00)[asn:12290, ipnet:178.250.72.0/21, country:GB]; TO_DN_NONE(0.00)[]; RCVD_COUNT_TWO(0.00)[2] X-Rspamd-Queue-Id: 4RrGQ567sjz4djf List-Id: Production branch of FreeBSD source code List-Archive: https://lists.freebsd.org/archives/freebsd-stable List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-stable@freebsd.org X-BeenThere: freebsd-stable@freebsd.org Am experimenting with stable/14 to see how it goes, but have an odd problem. I am compiling it on a stable/13 machine, as I was upgrading a 13 box to 14. But having done this, I now cannot don an installworld again with a slihtly more recent compile, as it fails, telling me that I need libdialog.so.9 The culprit appears to be /usr/src/amd64.amd64/tmp/legacy/bin/tzsetup which needs the shared object. It exists on 13 so my first installworld succeeds, but after installing 14 it then fails as 14 does not have this library Is what I am doing wrong? Is it true that once I have gone to 14, I can no longer install again a version which was compiled under 13 ? -pete. From nobody Wed Sep 20 11:43:03 2023 X-Original-To: stable@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4RrGqz0Jq1z4tXl8 for ; Wed, 20 Sep 2023 11:43:11 +0000 (UTC) (envelope-from yuri@aetern.org) Received: from out2-smtp.messagingengine.com (out2-smtp.messagingengine.com [66.111.4.26]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4RrGqy2LYkz3Dds for ; Wed, 20 Sep 2023 11:43:10 +0000 (UTC) (envelope-from yuri@aetern.org) Authentication-Results: mx1.freebsd.org; dkim=pass header.d=aetern.org header.s=fm1 header.b=Hk2k5Pmd; dkim=pass header.d=messagingengine.com header.s=fm2 header.b="p LhepB1"; spf=pass (mx1.freebsd.org: domain of yuri@aetern.org designates 66.111.4.26 as permitted sender) smtp.mailfrom=yuri@aetern.org Received: from compute3.internal (compute3.nyi.internal [10.202.2.43]) by mailout.nyi.internal (Postfix) with ESMTP id CA0785C00C2 for ; Wed, 20 Sep 2023 07:43:08 -0400 (EDT) Received: from mailfrontend2 ([10.202.2.163]) by compute3.internal (MEProxy); Wed, 20 Sep 2023 07:43:08 -0400 DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=aetern.org; h=cc :content-transfer-encoding:content-type:content-type:date:date :from:from:in-reply-to:in-reply-to:message-id:mime-version :references:reply-to:sender:subject:subject:to:to; s=fm1; t= 1695210188; x=1695296588; bh=bXtzKE2OpP+Lcw1es2rKG8KwT0ht3E7ZqxA AACo9v0I=; b=Hk2k5PmdKPf/vCk3toyN0/IA2RTsJnPuToYXBlwteNKuMOdyfGP VcX0rBbBQr3pr+YiY1J+0DucQT+2176L3Zo6iyGBh8YyTGtSeva3kneSBSh99FpV zsUZzXK/qS5l4dI77rjIieTerJ/7lI3xqWiaB4TMIKHGQ6V2uyJ0FmuiZT1YyvbP X9DpNTS+j1cBXKactvfjJzHOyZwz80invN9nELan4nnDRi8lQvdVu1l0yP1S6CuB bC8kipeYQvex0FYsI2FF8VaNA0YM4eDn78KERa8epUPkn/QkQ4QFtNo56rdxK8bM OjL8hIuvuqObs+0ldy7F5zowIFWgMRJyAWQ== DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d= messagingengine.com; h=cc:content-transfer-encoding:content-type :content-type:date:date:feedback-id:feedback-id:from:from :in-reply-to:in-reply-to:message-id:mime-version:references :reply-to:sender:subject:subject:to:to:x-me-proxy:x-me-proxy :x-me-sender:x-me-sender:x-sasl-enc; s=fm2; t=1695210188; x= 1695296588; bh=bXtzKE2OpP+Lcw1es2rKG8KwT0ht3E7ZqxAAACo9v0I=; b=p LhepB1gTgbyBoM5z0Yyi/0N7kK0N/RrB9aZl+9iDpeX1xXXXo5xdAFPLVpez7Ox0 wdHxW9v4hXdtWSP1NHoyWpEZ5EzVeCTjOb/7Gu/w0tPlsfBWfKkD/mP+qo4rUC57 quKhnTSerrqBD4v3j4jVzV9DiGi1GLCqM0DYm3g2l+i8fLrISm/GsHMxHmuNgcTy UTlcNqneCr42oyCKF8DKip3jxXbiJanqfULpIBrnwuC/VQi4n02m+iiSspQYrYYa 4w6P5p3EJYPE5d1BAM3zj6KtvHNef+LQOffNA+/jKmVhtWO/K6bpkPIegwI4uu8L 9y/Pxh/JUAGKe2pZiy9gQ== X-ME-Sender: X-ME-Received: X-ME-Proxy-Cause: gggruggvucftvghtrhhoucdtuddrgedviedrudekfedggeefucetufdoteggodetrfdotf fvucfrrhhofhhilhgvmecuhfgrshhtofgrihhlpdfqfgfvpdfurfetoffkrfgpnffqhgen uceurghilhhouhhtmecufedttdenucenucfjughrpefkffggfgfuvfhfhfgjtgfgsehtje ertddtvdejnecuhfhrohhmpegjuhhrihcuoeihuhhrihesrggvthgvrhhnrdhorhhgqeen ucggtffrrghtthgvrhhnpefgvdfhtdejgefgleefgfeggfegfffgteffleeigeefieehve fgudettdeuvdeuveenucevlhhushhtvghrufhiiigvpedtnecurfgrrhgrmhepmhgrihhl fhhrohhmpeihuhhrihesrggvthgvrhhnrdhorhhg X-ME-Proxy: Feedback-ID: i0d79475b:Fastmail Received: by mail.messagingengine.com (Postfix) with ESMTPA for ; Wed, 20 Sep 2023 07:43:08 -0400 (EDT) Message-ID: <8474d23f-8551-474d-94d0-3fb04183b01b@aetern.org> Date: Wed, 20 Sep 2023 13:43:03 +0200 List-Id: Production branch of FreeBSD source code List-Archive: https://lists.freebsd.org/archives/freebsd-stable List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-stable@freebsd.org X-BeenThere: freebsd-stable@freebsd.org MIME-Version: 1.0 User-Agent: Mozilla Thunderbird Subject: Re: Build of 14 on 13 creates a file which needs libdialog.so.9 Content-Language: en-US To: stable@freebsd.org References: From: Yuri In-Reply-To: Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: 7bit X-Spamd-Bar: / X-Rspamd-Pre-Result: action=no action; module=multimap; Matched map: local_wl_from X-Spamd-Result: default: False [-0.39 / 15.00]; R_SPF_ALLOW(-0.20)[+ip4:66.111.4.26]; R_DKIM_ALLOW(-0.20)[aetern.org:s=fm1,messagingengine.com:s=fm2]; XM_UA_NO_VERSION(0.01)[]; DKIM_TRACE(0.00)[aetern.org:+,messagingengine.com:+]; PREVIOUSLY_DELIVERED(0.00)[stable@freebsd.org]; local_wl_from(0.00)[yuri@aetern.org]; FREEFALL_USER(0.00)[yuri]; MLMMJ_DEST(0.00)[stable@freebsd.org]; ASN(0.00)[asn:19151, ipnet:66.111.4.0/24, country:US] X-Rspamd-Queue-Id: 4RrGqy2LYkz3Dds Pete French wrote: > Am experimenting with stable/14 to see how it goes, but have an odd problem. I > am compiling it on a stable/13 machine, as I was upgrading a 13 box to 14. But having > done this, I now cannot don an installworld again with a slihtly more recent compile, > as it fails, telling me that I need libdialog.so.9 > > The culprit appears to be /usr/src/amd64.amd64/tmp/legacy/bin/tzsetup which needs the > shared object. It exists on 13 so my first installworld succeeds, but after installing 14 > it then fails as 14 does not have this library > > Is what I am doing wrong? Is it true that once I have gone to 14, I can no longer install > again a version which was compiled under 13 ? I don't think I completely understand the procedure you are describing, just a note that guessing on the /tmp/legacy/ in path it's a "native" tool that runs on build system and was compiled against the libraries on the build system (unlike real binaries built against the libraries for the target system). From nobody Wed Sep 20 12:09:03 2023 X-Original-To: stable@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4RrHPr5JDFz4tZTq for ; Wed, 20 Sep 2023 12:09:04 +0000 (UTC) (envelope-from pete@twisted.org.uk) Received: from toybox.twisted.org.uk (toybox.twisted.org.uk [178.250.76.50]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4RrHPr4qF5z3HBc for ; Wed, 20 Sep 2023 12:09:04 +0000 (UTC) (envelope-from pete@twisted.org.uk) Authentication-Results: mx1.freebsd.org; none DKIM-Signature: v=1; a=rsa-sha256; q=dns/txt; c=relaxed/relaxed; d=twisted.org.uk; s=tbx; h=Date:From:Message-Id:In-Reply-To:Subject:To:Sender :Reply-To:Cc:MIME-Version:Content-Type:Content-Transfer-Encoding:Content-ID: Content-Description:Resent-Date:Resent-From:Resent-Sender:Resent-To:Resent-Cc :Resent-Message-ID:References:List-Id:List-Help:List-Unsubscribe: List-Subscribe:List-Post:List-Owner:List-Archive; bh=2s5fYtXsAIctyf/T5tb0Q1W1IzP86M4ejdoLlMe8/RA=; t=1695211744; x=1696075744; b=aKUtJTOw/dkz0wFCQyF8JV19HhDWg5iABtKZVRH/P4iMYACgRWnYJApqCUP9gYf6dZv++MzZIeK t4WRy+WDE7600s3FjZ+SCAyDurooqUe/L+Q8tJvs6Nev2+brZWeY4P/hh0gGpRVyEN4dAkLJKKbze AlZy11bGLNdqJRmgxVhIOyUYTv1fUhvFWcja5SdllE/QjMioCo3qdNeBjtyQllXxGWwVMoirt05U5 8EAHdBoDvp8ezybhoIIxtXOmqFE6hYLp0VsRAAu8/Iy8oezt6ksIv6ifjEHMaTchYUNMoIPOhkbwS UbJAi7d0qPuqKPiTem03w6axugoXM+2GNkig==; Received: from mailnull by toybox.twisted.org.uk with spamc-scanned (Exim 4.95 (FreeBSD)) (envelope-from ) id 1qiw0t-00048S-A5 for stable@freebsd.org; Wed, 20 Sep 2023 12:09:03 +0000 X-Spam-Checker-Version: SpamAssassin 3.4.5 (2021-03-20) on toybox.twisted.org.uk X-Spam-Level: X-Spam-Status: No, score=-0.0 required=5.0 tests=NO_RELAYS autolearn=unavailable autolearn_force=no version=3.4.5 X-Spam-Score: -0.0 () Received: from pete by toybox.twisted.org.uk with local (Exim 4.95 (FreeBSD)) (envelope-from ) id 1qiw0t-00048P-9E; Wed, 20 Sep 2023 12:09:03 +0000 To: stable@freebsd.org, yuri@aetern.org Subject: Re: Build of 14 on 13 creates a file which needs libdialog.so.9 In-Reply-To: <8474d23f-8551-474d-94d0-3fb04183b01b@aetern.org> Message-Id: From: Pete French Date: Wed, 20 Sep 2023 12:09:03 +0000 X-spamc-toybox: true X-transport-toybox: lookuphost X-Spamd-Bar: ---- X-Rspamd-Pre-Result: action=no action; module=replies; Message is reply to one we originated X-Spamd-Result: default: False [-4.00 / 15.00]; REPLY(-4.00)[]; ASN(0.00)[asn:12290, ipnet:178.250.72.0/21, country:GB] X-Rspamd-Queue-Id: 4RrHPr4qF5z3HBc List-Id: Production branch of FreeBSD source code List-Archive: https://lists.freebsd.org/archives/freebsd-stable List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-stable@freebsd.org X-BeenThere: freebsd-stable@freebsd.org > I don't think I completely understand the procedure you are describing, Ah, yes, sorry I did miss out a critical bit of what I am doing! I am compiling on a stable/13 box, and then using NFS to mount /usr/src and /usr/obj onto the test machine. On that machine I am doing installkernel and installworld to upgrade it. > just a note that guessing on the /tmp/legacy/ in path it's a "native" > tool that runs on build system and was compiled against the libraries on > the build system (unlike real binaries built against the libraries for > the target system). Yes, thast the conclusion I came to. I am also not sure that it ever actually runs that binary - the failure is right at the start of installworld where it checks to make sure all the shared libraries are here. Possibly what I am doing is not supported, but I am a bit surprised as my usual upgrade procedure is to build on one machine and then either NSF mount, or rsync, the files to the boxes on which I wish to install them. -pete. From nobody Wed Sep 20 13:55:07 2023 X-Original-To: stable@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4RrKmN1lZ2z4thkh for ; Wed, 20 Sep 2023 13:55:16 +0000 (UTC) (envelope-from wollman@hergotha.csail.mit.edu) Received: from hergotha.csail.mit.edu (tunnel82308-pt.tunnel.tserv4.nyc4.ipv6.he.net [IPv6:2001:470:1f06:ccb::2]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "garrett.wollman.name", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4RrKmM6bzXz3WTP for ; Wed, 20 Sep 2023 13:55:15 +0000 (UTC) (envelope-from wollman@hergotha.csail.mit.edu) Authentication-Results: mx1.freebsd.org; none Received: from hergotha.csail.mit.edu (localhost [127.0.0.1]) by hergotha.csail.mit.edu (8.17.1/8.17.1) with ESMTPS id 38KDt8TA066913 (version=TLSv1.3 cipher=TLS_AES_256_GCM_SHA384 bits=256 verify=NO); Wed, 20 Sep 2023 09:55:08 -0400 (EDT) (envelope-from wollman@hergotha.csail.mit.edu) Received: (from wollman@localhost) by hergotha.csail.mit.edu (8.17.1/8.17.1/Submit) id 38KDt8VP066912; Wed, 20 Sep 2023 09:55:08 -0400 (EDT) (envelope-from wollman) List-Id: Production branch of FreeBSD source code List-Archive: https://lists.freebsd.org/archives/freebsd-stable List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-stable@freebsd.org X-BeenThere: freebsd-stable@freebsd.org MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Transfer-Encoding: 7bit Message-ID: <25866.63931.709389.553955@hergotha.csail.mit.edu> Date: Wed, 20 Sep 2023 09:55:07 -0400 From: Garrett Wollman To: Pete French Cc: stable@freebsd.org Subject: Re: Build of 14 on 13 creates a file which needs libdialog.so.9 In-Reply-To: References: <8474d23f-8551-474d-94d0-3fb04183b01b@aetern.org> X-Mailer: VM 8.2.0b under 28.2 (amd64-portbld-freebsd13.2) X-Greylist: Sender IP whitelisted, not delayed by milter-greylist-4.6.4 (hergotha.csail.mit.edu [0.0.0.0]); Wed, 20 Sep 2023 09:55:08 -0400 (EDT) X-Spam-Status: No, score=-4.9 required=5.0 tests=ALL_TRUSTED, HEADER_FROM_DIFFERENT_DOMAINS,NICE_REPLY_A autolearn=disabled version=4.0.0 X-Spam-Checker-Version: SpamAssassin 4.0.0 (2022-12-14) on hergotha.csail.mit.edu X-Spamd-Bar: ---- X-Rspamd-Pre-Result: action=no action; module=replies; Message is reply to one we originated X-Spamd-Result: default: False [-4.00 / 15.00]; REPLY(-4.00)[]; ASN(0.00)[asn:6939, ipnet:2001:470::/32, country:US] X-Rspamd-Queue-Id: 4RrKmM6bzXz3WTP < said: > Possibly what I am doing is not supported, but I am a bit surprised as my > usual upgrade procedure is to build on one machine and then either NSF mount, > or rsync, the files to the boxes on which I wish to install them. This absolutely works, but only so long as all of the clients are running the same release as your build machine _was_ running during the most recent buildworld. I ran into this recently during our upgrade from 12.4 to 13.2, which saw a security update released while we were in the middle of rollout: I had to roll back /usr/src and /usr/obj to the 13.2-p1 state, roll out all the clients, and then I could (re)compile 13.2-p2 and deploy that -- by which point 13.2-p3 had come out, but by then we were over the hump. I think it's a bug in installworld that it depends on binaries from the build environment rather than the execution environment. -GAWollman From nobody Thu Sep 21 09:57:42 2023 X-Original-To: freebsd-stable@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4RrrS86GPzz4tsVD for ; Thu, 21 Sep 2023 09:58:00 +0000 (UTC) (envelope-from marklmi@yahoo.com) Received: from sonic317-22.consmr.mail.gq1.yahoo.com (sonic317-22.consmr.mail.gq1.yahoo.com [98.137.66.148]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4RrrS70Y0Nz4Xry for ; Thu, 21 Sep 2023 09:57:59 +0000 (UTC) (envelope-from marklmi@yahoo.com) Authentication-Results: mx1.freebsd.org; dkim=pass header.d=yahoo.com header.s=s2048 header.b=caizy12a; spf=pass (mx1.freebsd.org: domain of marklmi@yahoo.com designates 98.137.66.148 as permitted sender) smtp.mailfrom=marklmi@yahoo.com; dmarc=pass (policy=reject) header.from=yahoo.com DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=yahoo.com; s=s2048; t=1695290277; bh=neqnfMIz/wQGURizavgdgezXNHnSlbsZccTRnZ634rU=; h=From:Subject:Date:Cc:To:References:From:Subject:Reply-To; b=caizy12aZS1DqegX6Iqu76UI1HjZusNFUDpBxdwwEthuRy3hMv/uiTyCHPvGLjSmT/yYyxoJg8fHVLs3Kwp2kOtqLZe7ALomoxwp4qvd5ZFI7fog7GiVzsep8rXthfZV9O4YggzIcJ+Ts7kIx94BL0PRGGt5i0wfUjLbwe28lOG+q9QMKPFVs6H9KHoysnKlKOWaiFJCMT2Gkh7BJVqPOCSpHuJL8lnrD5F99mf5qbcm/FYbb73LLZ7C6DfPOT2F1AzL5pvOijS225KtZ3jGonMV+RIMlFc60B+qEV9vVCTk1SD9txRj14NXIoak5Uw2rKDhEJEKHX75XiGOu+hniA== X-SONIC-DKIM-SIGN: v=1; a=rsa-sha256; c=relaxed/relaxed; d=yahoo.com; s=s2048; t=1695290277; bh=0EWCQSLCU9ozBS4giVoEzmJZTbjnsL5aEinY8xeUASM=; h=X-Sonic-MF:From:Subject:Date:To:From:Subject; b=uTokKMaqNMUKIOY9uuG8EjxA4i3ab3SY+SpRLl8UQX+ttxehBklKCtVfhYmh1sQj2zH9gDViKzWRS4XlwQMknJhaJkOzx7OQ94DaP0c5FOBg8co/TDPdQFOpxzZ5wa5pvkOgHgKREViydpxyg//wrzicujehwaB/PGLPHxBsljtHNKW4+Qx0r5nIDFmqRZrkgxufpCxg9ar7/3hvd73heR1ftrDtfJHf7h28p2PPDpMmayekhVVkg9HR7ziqrcMgP+RUGY3DlhsRfrw74yPHf352VyugyIEZD+75z2UOpEHwNwzUANQ0lVZqoI2uWEtYozSRJ1h1KCHTJFFkECLi1A== X-YMail-OSG: HwMO_K4VM1mx7G6zhEOZO3qC6Taac5IIyJnvO0MnPQyuFZGtXM0E8BW0LFINUe_ g8ij_8z3K4RTTnY.v_8J6qF_wKfp1CqlkbKjL0zsg9smmSAeYw79BTTh2m59b3NnDhu2DChdfO3V Q3GNjMDcWGobhuwfMyxQZMFrZOEU00X_y2VbNrGzro1Wx3GmONPKNkx6I4kFkvhV1mq2yJ_On9GV VI7zrH0c.YZys0luqp_Q98Bwsj3qJeA09PEhKI0.9dPcU1PnJ0tXxA0NzSodBKDpPcnUoXmYrcHQ IJnwIq9pqMJjCAVbP5Z96I_lVE86RiXMCPs2glFmMWu.GSUGha2XmIQl.Rww0nDKdAI81KanNsYg vAz_qAsILPeNxBRS62Ml.3Hin133VAQSYnyiJgj7TB7dDUtH6_lgQOfO1L_x.28pnqmcvuh2SpAk pZC3bwOCz4t_OlmY0An9aRW7sfyzDRwBUGNf14nJOtoMv71XGx7dl9L5WlbIVZ1pCIx87p1gEFcX cSPAom0EdGYj95xTycYZjHMzddvjhf33X1CgdgQxJ0W3cP48cE4jmGnA1P4OwUm8cpv2ScnTW.In WJnF4dTUpTx.fLpxqognnTL5tZ.M77.acs3xtEgvcDqOle5k_uLrNIOd.mgYcN6msqtpxlEkBwwd U1wP89ruk1DMAUVLw0jAWLkDhyTExiwuWe5Oiw7UAPdeBxOtTtSz445z_BOYbGdC08DExDVC6Uai 6CmnrgGG1O6g7U5C2PdPPABxdFREGt95K2m.NdLGGwY2qSS7LJrv1dHta_Oa87kdbCs40olutQhh 9rEoP5fyTlRcenJPNBqAPDPv4Jr6FC.EFzu5raE1bxQXyv4q1FIkmrfeXbk05Y5ba9gmT6PlpTRL WIR0WEd0Xakjo_TVDQhE6gXAcTHdOXULhHiiiX_9.A_DIlqtSf9s.qM16nTCl8pwH5sv3Ku.uhv4 FMEHWDEjR2mWRYvFk2uYhdG1onMsqi.kIgpajTNGEW8lGjx1bJEVMRqhOh0xI97YtCZcXN79Mxop kE7tEKqeOSIbobW0aVAl0KSufa9GhBnvpghD2Rdg86.vsgQQ8fX9k_bVRQNMkTTqXCzBANwy4gfG ORCEFtv.avqGr6ujcy_dg06gytRAZzOo1SxkcVezZvH0j.z.ohFR_61Z7obmKQv.dOye3uNrE7fN EIiLQ6Bex0L5453zJR.u6EU2L5RkXjURno5Eq_QP5F8EspjdnzmxLtGvfMuMK5neJ2igiKvk9wje _tp57wjAmoaV7SmySfkkHg_WieQStTV7itymSCIwYLF6dpz.yR4NPWsuGTQn2hldeSjpAJA2m.bu nbpmxG6W9KkUxird1lJUwMZPyHJl1je31_SWIo3ccbs98.sHh4DDZV5XsSpXQIPmEPOD029ku3n2 VhH46eg8oU8bzjBjuiUArbp9VUKquWup.kMga9CO6nwY3lpw5wRM8PofFYIqcNGdv_RoBPq5JgNi Nvn7loevy07mD4g9Z1IUN.m_CM5YJCdFkQDnlw6T9fbSzIR.NgYRpkXVtGjlcbdfKgiIwu4eRwbk p539kDR9IifFF8xTIJYHrwFOKG5AXDCvFcfUlqNlKnpmnUzBRiCkoMIPoTGqKBYRzgITu9v6Ywmh 5LliHCvwbhoJg_h_Imc1Z91lxXiSP93s6FJZY0on0SeqET3vmGXeQ_aNuuGBv1pWlh7vE.9LaTMo s1UbXL8xLEk6tLiRqFG267n1UIr7w.1oLynLPDSJqjqXzBXXlDJZVTrYvkkQEFjBTUlATXRniP5n Bl0wYRQw3V9CYydloa5zMdGOCit1MpAFf3dSqb2aHW3DR5WMFLKbSwYpHO3zcNO3n_nzi6n0P0lj oGSNGxbuY0wpypYe8vHZGQEJoBoVw7nyOaHA71TqZfNJW3FIyCEvT3T4yfSPydM1QRyoM1HsXQLe dcHJwYJI2SCLp2HmLIBVxcN3J13DPe5v3BShTSeIq78672.OFH6R8Sb5aFhiYHpz2njVkQJqOgWa BYAxn3W.vxOcNbTRf51_IYIu0VOgH_Jwyy.LMA3OWU0A43iMuFOwvOj1GikoFZr5OSCQGggVsYZn 3FXHu0ymTGdkRwCbLTXiUREbUmgcNKLNLui02Z4W5mzqGCNolJ1Ipnkq.2ZaVSmYWllFrGgaphp6 8NxwAck8c4g4yKNoUGcFYQ5c5zrloMNAnaYbzkW41mnV6WpC3639NxRyAk3pcbMsmeViSVJQ2Arl 7.iujzjeL6Is07QGFuVsR0rRPKjY1Wsa.UTTd0MFCRpZHXK9yMFxz6fq7tDtP1qc7gkS7_Q7yTC1 UdWnlSQ-- X-Sonic-MF: X-Sonic-ID: fcf41f95-1766-482d-bd65-df051cc5a8a4 Received: from sonic.gate.mail.ne1.yahoo.com by sonic317.consmr.mail.gq1.yahoo.com with HTTP; Thu, 21 Sep 2023 09:57:57 +0000 Received: by hermes--production-bf1-678f64c47b-qxjnq (Yahoo Inc. Hermes SMTP Server) with ESMTPA ID 1a980f2e81b61cea83773212e982c329; Thu, 21 Sep 2023 09:57:54 +0000 (UTC) From: Mark Millard Content-Type: text/plain; charset=us-ascii Content-Transfer-Encoding: quoted-printable List-Id: Production branch of FreeBSD source code List-Archive: https://lists.freebsd.org/archives/freebsd-stable List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-stable@freebsd.org X-BeenThere: freebsd-stable@freebsd.org Mime-Version: 1.0 (Mac OS X Mail 16.0 \(3731.700.6\)) Subject: FYI: RPi4B via ACPI style boot suggests "armv8crypto0: CPU lacks AES instructions" can lead to a hung up boot sequence in 14.0-BETA2 Message-Id: Date: Thu, 21 Sep 2023 02:57:42 -0700 Cc: ykla To: Current FreeBSD , FreeBSD-STABLE Mailing List X-Mailer: Apple Mail (2.3731.700.6) References: X-Spamd-Bar: --- X-Spamd-Result: default: False [-3.50 / 15.00]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; NEURAL_HAM_LONG(-1.00)[-1.000]; NEURAL_HAM_SHORT(-1.00)[-1.000]; DMARC_POLICY_ALLOW(-0.50)[yahoo.com,reject]; MV_CASE(0.50)[]; R_DKIM_ALLOW(-0.20)[yahoo.com:s=s2048]; R_SPF_ALLOW(-0.20)[+ptr:yahoo.com]; MIME_GOOD(-0.10)[text/plain]; RCPT_COUNT_THREE(0.00)[3]; FROM_HAS_DN(0.00)[]; RCVD_VIA_SMTP_AUTH(0.00)[]; RCVD_IN_DNSWL_NONE(0.00)[98.137.66.148:from]; TO_MATCH_ENVRCPT_SOME(0.00)[]; RWL_MAILSPIKE_POSSIBLE(0.00)[98.137.66.148:from]; MLMMJ_DEST(0.00)[freebsd-stable@freebsd.org]; ARC_NA(0.00)[]; MID_RHS_MATCH_FROM(0.00)[]; FREEMAIL_CC(0.00)[gmail.com]; DKIM_TRACE(0.00)[yahoo.com:+]; TO_DN_ALL(0.00)[]; FREEMAIL_FROM(0.00)[yahoo.com]; DWL_DNSWL_NONE(0.00)[yahoo.com:dkim]; FROM_EQ_ENVFROM(0.00)[]; MIME_TRACE(0.00)[0:+]; RCVD_TLS_LAST(0.00)[]; ASN(0.00)[asn:36647, ipnet:98.137.64.0/20, country:US]; FREEMAIL_ENVFROM(0.00)[yahoo.com]; RCVD_COUNT_TWO(0.00)[2] X-Rspamd-Queue-Id: 4RrrS70Y0Nz4Xry See: = https://lists.freebsd.org/archives/freebsd-arm/2023-September/003071.html for details. (It is not my activity.) =3D=3D=3D Mark Millard marklmi at yahoo.com From nobody Thu Sep 21 18:08:52 2023 X-Original-To: freebsd-stable@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4Rs3Lc6MXfz4tmjP for ; Thu, 21 Sep 2023 18:08:56 +0000 (UTC) (envelope-from ltning-freebsd-stable@anduin.net) Received: from mail.anduin.net (mail.anduin.net [185.42.170.45]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4Rs3Lb3zVgz3HwD for ; Thu, 21 Sep 2023 18:08:55 +0000 (UTC) (envelope-from ltning-freebsd-stable@anduin.net) Authentication-Results: mx1.freebsd.org; dkim=pass header.d=anduin.net header.s=dkim2021 header.b=hhlT0qck; spf=pass (mx1.freebsd.org: domain of ltning-freebsd-stable@anduin.net designates 185.42.170.45 as permitted sender) smtp.mailfrom=ltning-freebsd-stable@anduin.net; dmarc=pass (policy=reject) header.from=anduin.net DKIM-Signature: v=1; a=rsa-sha256; q=dns/txt; c=relaxed/relaxed; d=anduin.net; s=dkim2021; h=Content-Transfer-Encoding:Content-Type:To:Subject:From: MIME-Version:Date:Message-ID:Sender:Reply-To:Cc:Content-ID: Content-Description:Resent-Date:Resent-From:Resent-Sender:Resent-To:Resent-Cc :Resent-Message-ID:In-Reply-To:References:List-Id:List-Help:List-Unsubscribe: List-Subscribe:List-Post:List-Owner:List-Archive; bh=xBBtyeqYdzVsGgUCDqZSktc0REfwNYfFyyOVHEcWRuM=; t=1695319735; x=1696183735; b=hhlT0qckd5XZuGUhFu6XCd/PKHbA+34PDpgN4KxhcZ7ca0Q07wNIU9AF0kIK0YLm/rDrLoH5roE 9ENRSDRlCnSeVFGMPDlvcazs/4XRL7MXFDqWVlzqhKfi3xO8NMhvznBIvoBYx5x6PDFul3wLyg9q2 uVh4LQDrDQQkh20grVGldznKZfwHLXpGPtX622yAsbjaGC/dpF1q5+MsykiEpIJ/k6iB87GRANncd 6ioQQjBDEExVYK+BcQrp3mK8wgP7FR2SY9i+BcGYqJJYDuQy9mfI1rIMVk1/3JlEVvjzLjx4wbKff +25dhNp4FcBCH1CX6R/JeYQindUnzFbse2Pg==; Received: by mail.anduin.net with esmtpsa (TLS1.3:TLS_AES_256_GCM_SHA384:256) (Exim 4.96 (FreeBSD)) (envelope-from ) id 1qjO6e-000Ggu-26 for freebsd-stable@freebsd.org; Thu, 21 Sep 2023 18:08:54 +0000 Message-ID: Date: Thu, 21 Sep 2023 20:08:52 +0200 List-Id: Production branch of FreeBSD source code List-Archive: https://lists.freebsd.org/archives/freebsd-stable List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-stable@freebsd.org X-BeenThere: freebsd-stable@freebsd.org MIME-Version: 1.0 User-Agent: Mozilla/5.0 (X11; FreeBSD amd64; rv:102.0) Gecko/20100101 Thunderbird/102.15.1 From: ltning-freebsd-stable@anduin.net Subject: Fusefs unionfs trouble with hardlinks? To: freebsd-stable@freebsd.org Content-Language: en-US Content-Type: text/plain; charset=UTF-8; format=flowed Content-Transfer-Encoding: 7bit X-SA-Authenticated: Yes X-Spam-Score: -1.9 X-Spam-Level: - X-Spam-Report: host: mail.modirum.com | contact: hostmaster@modirum.com | scores: BAYES_00=-1.9,NO_RELAYS=-0.001 | autolearn=no autolearn_force=no, score=0 X-Spamd-Bar: -- X-Spamd-Result: default: False [-2.99 / 15.00]; SUBJECT_ENDS_QUESTION(1.00)[]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; NEURAL_HAM_SHORT(-1.00)[-1.000]; NEURAL_HAM_LONG(-0.99)[-0.988]; DMARC_POLICY_ALLOW(-0.50)[anduin.net,reject]; R_SPF_ALLOW(-0.20)[+ip4:185.42.170.45/32:c]; R_DKIM_ALLOW(-0.20)[anduin.net:s=dkim2021]; MIME_GOOD(-0.10)[text/plain]; RCVD_COUNT_ONE(0.00)[1]; FROM_EQ_ENVFROM(0.00)[]; ARC_NA(0.00)[]; MIME_TRACE(0.00)[0:+]; MLMMJ_DEST(0.00)[freebsd-stable@freebsd.org]; ASN(0.00)[asn:62248, ipnet:185.42.170.0/24, country:EE]; BLOCKLISTDE_FAIL(0.00)[185.42.170.45:server fail]; DKIM_TRACE(0.00)[anduin.net:+]; RCVD_TLS_ALL(0.00)[]; RCVD_VIA_SMTP_AUTH(0.00)[]; FROM_NO_DN(0.00)[]; TO_MATCH_ENVRCPT_ALL(0.00)[]; RCPT_COUNT_ONE(0.00)[1]; TO_DN_NONE(0.00)[]; MID_RHS_MATCH_FROM(0.00)[] X-Rspamd-Queue-Id: 4Rs3Lb3zVgz3HwD Hi, I've been trying to prepare a NomadBSD stick for a raid at a nearby laptop store, and have upgraded it to 14-BETA2 using freebsd-update. However, when attempting to pkg upgrade it afterwards, I find that some ports cause problems; one example being libdeflate. NomadBSD has a uzip-backed /usr/local with a ZFS-backed fusefs-unionfs on top. Hence, installed/upgraded packages and other changes are applied to the ZFS dataset only, since the uzip device/filesystem is read-only. During package upgrade or installation, most packages behave fine, but e.g. libdeflate attempts to create hardlinks to itself within /usr/local/bin. This fails, with a "File exists"-complaint. I have not had any similar problems on NomadBSD installations I have elsewhere, but they are all on 13.2 - this leads me to believe there may be problems specific to 14. I'm using the standard "latest" FreeBSD package repo. And for clarity, I have *not* installed to another disk; this is all done directly on the USB stick created from the NomadBSD image. I can extract more logs/info as required, if anyone feels like looking into this. It does seem like a currently-working use case that no longer works, so perhaps of interest before 14 ships? Wbr /Eirik From nobody Fri Sep 22 22:22:38 2023 X-Original-To: freebsd-stable@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4RsmxF07G5z4tWvW for ; Fri, 22 Sep 2023 22:22:57 +0000 (UTC) (envelope-from marklmi@yahoo.com) Received: from sonic304-25.consmr.mail.gq1.yahoo.com (sonic304-25.consmr.mail.gq1.yahoo.com [98.137.68.206]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4RsmxC6lxyz3WN7 for ; Fri, 22 Sep 2023 22:22:55 +0000 (UTC) (envelope-from marklmi@yahoo.com) Authentication-Results: mx1.freebsd.org; dkim=pass header.d=yahoo.com header.s=s2048 header.b=cLDG9C58; spf=pass (mx1.freebsd.org: domain of marklmi@yahoo.com designates 98.137.68.206 as permitted sender) smtp.mailfrom=marklmi@yahoo.com; dmarc=pass (policy=reject) header.from=yahoo.com DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=yahoo.com; s=s2048; t=1695421374; bh=/fKhlzAKiWAQOpaQc8VGB6RSMtYqIk8WGUvRg9X2wR4=; h=Subject:From:In-Reply-To:Date:Cc:References:To:From:Subject:Reply-To; b=cLDG9C58mbhrMJyTlwNRO8EQEakp0HTVlufwYxvfEIekIdgZTHdQSSkGjoETDrDzQbO9Hv7jw2JqGrE6tSXsp82yCUDiSudgqvPUXENOJUhPYPPj2OU/I9zwdmRIUdvWooitVu75pBKJKKULXekokTD3rxsV/2V7qHSksdViBDo0ZqCM1dbd1MhhoudlKjIkhk6c+vqwRXQy8cFGwGopiOJV4Zzo2FpbckxfPHm4c9Jei6nvfQk97mhX+PdmFJWxMcPk6zoQu4lmoDdchE+Er3fgGmE+6gN3rOS0Ama+bZcvX0VU/b/qkM07fHD0+dQGUd+uM8kuSJH/KHVEsyuQgA== X-SONIC-DKIM-SIGN: v=1; a=rsa-sha256; c=relaxed/relaxed; d=yahoo.com; s=s2048; t=1695421374; bh=bTO+sHMs8bH+wzQ56HmwPaFw3rk6Z3aMXIgIMYSFoeR=; h=X-Sonic-MF:Subject:From:Date:To:From:Subject; b=stWPy+hgEkUw/myB5B6R6yyO3tsRuTA+Z8NNqlJza9y8vozkgeCvtYGrMHuir3JnZbkCkaRh14Hk9sS16lWK3r0koB+9StEGtyczO7dHAqrHmeFjVcSOjaIceq6CIjv1PHiq7fiP59d1q5AE61xvsV3kgZ0qL9/75v0KQp76bw1JRovAJpY8Gjphm8yF5up3JkGdxkjEN0BFNcNzECEGmJOxZoYuBVN+EZiEG78jH6+nBliYNkkF+WuPo/7VqyXfXUf2Vqh1+bFL5+FKSN6LJEBbQIMMEP6yAfk5uygPcoNC8PUgQhZy6DAZ/rL9Ui/anL75eSocTX07sRyqcycZjg== X-YMail-OSG: V7FoEfYVM1l1rsCEc._uBVYnEDywoECpOypEpNcZzZE4bIr1RgumZI8G_HC_Hao bd6zxbmBAnl3ZxK2JZyAIHDQw7f0rwsvMHPUX761F21oUiQ5FzSa3T5qEpN4bPAuH_JlRlVLxcdN NW5.cSORtuqbZFLWYwP0pdsYxrkplq1c1e1TS9kZx7bZ8scLlI_IHdh6aCqG4CmnhCyPcZUh9I2v y81_6KTqZSjbmhCSIIdUj4_vFoWGUJakNJ2Y9sDS_tpkhpydOYOGL9ulupvrf40sr0niCsZaaqn5 El3zYelf4ABXVwOIRrBXxsIQCFZ8IwoDBaiE8G6RNgpGrnyI7LkQvOLX214SRfdkMwGnzXEoYQpo B9t9BkxhQJgjJOzrItmCyIFEo17NsQiEVs0UknLRVmKDz858G1C5.T786jSoZi1FvloUXGubxPTZ b1G1CysKYc1e22sk0QiPUVlXXXZtdeBv.ZzYrlvnwRKoEEmn6TREvLu1omOSWdwwcgERtE6exZ6t P4W5wWDTJ.mmKuABMEW8qK0Pfx5.8kT8HXh0c.3egUUVqXCBOTRyiV9KkLA32PjZNtqAfRbruorj sKyXUvcEykadx1HO.BZTen454It1M5qtY6R5QRWoeOO5ABuQFhdQmdGwAeZQoTsMGIkgEv2Jb9bZ olrOHUAPiXEX_uwXoHFYRBKUUZjPFtqcLPr_YR14q.TzzFCfY9uW6mqty5S475y_TiBQ3Vm5DvUb 4_P1XmsgyYOqeYxRIZTmG7ID8zYQaeeynX.8voobfVhomJZaJHkk8LW3UeT7MIw64qGaNE5jKePH pipW_wly_lopIJFQu4xA3miEsHZXZcYti5dAK5.1an5n1l17YOkZmYWTJnsU4.iUeVQE_sxre94O _Wpphozyc5n3xCAjmTqw70HUNHm3NXoenhcYwodZQEp29oxY_e_neVqvpI_QPTX774CVuV6wvBba cYT86xy402R3ma3Y7IZslVKGMeMRzfr8hjYUCp.nMBvjUOQD2lDTrFkU.BHs_OrjcF..i9JKFE9E tbJNxQfqXhPML6Dr1jUNvMv7FL34MuT2AtAZ9au.eTJkbBynPpD9dXvHW0uguUxCb09ZRu5zkaFW 9x5DAiTZAcXcQNccNyhSjbMt9uOQAqb_Tn8arQRNVB9UtIBi5kWEYXGiZqyICHdEC.yGPY._tVzz fJ3e.Rqfdziai1hKs6tlOZBPEhJNNfw5UNuHI6XodxdxbdcIxVj85w3dr8yl8P22w.NJaz8qUNnW VeUfebZwnb1zshgyhNzZjs5CtKOM7Og0c4JEKe_R0.xZ9.JSQlGj7srLE37O_RmSuV7Rzi_WBz76 8AO_tMvyGdUheJcNGFHUXz3mlJbuD_Ew9p.70Ch5Mj6__DSOONmJbM5LpWaJnSv93jvfT921q.BS at0EwfZVI_cTC9o2TbjRSOO4vCam1gzvNbXacJnHXW.IX3IGZaM4Imol2FdzYJI25OMIKGU9ifjV r.VGOfKSpqQ1GxQqY0d3nuMKrTkY2Q7Zc0Q.efGxxPsA63znoFNRSwYlKYS52bVqsBFS0QX2sAOT 9Tg5u._IZK4jwV6mBPtKwS7_7iLO1a8TkMHs2G5zPx.LwvJk4UplBJwUwu0xrnge04y4kiQ1CQAG 0KA0SDpww7VZ7in1Jqc0ZW0ZqLkVEEcJ0vflKBiM4hvsuae9YzI9AWV_OKysYWyWi_n1Wi5aw1dE JFpQ3zNbhfru5P0kwuSg2sJGuVJIFw8CeAxyboUrA2.jSYqIZ5vtsdwHWdYUB.ZVB4LnhP_hEWWM DwwIYgaTsvt3WJUIv3QMWVFNBV4Vighfm6psxX.iSQa6PUDsKD5rrSZADCml6mx0q7XWoC92uSeZ OIiZPKYYIinoExkaBfwklGvsdC9VruJDwOgqF0KABCJgjWCN9r9f4zQr2_atbGBGNxxvD2iCV0S7 4h8WiqAHRt7IoWz9TYW36vq1ce5bWCrMZXoxO9UbeYV7LForlEJwFLhvbnDTk2Jn6zdUJ7TCB76O B2BEaUl5a9lFz0Bo3AGgHOHndNqLhWYFJc0Gh9eadYATRcZvNBVcp9AdxqVyqtxAw0v8jRxX3Zah fWHNiIY76RoHV_OVvliJaWsdffl9KYP1xQKYNKBHmtEaOXlM7SIYSdlPY9YJAOFe7DJ_R02XO7.N fPGsW0bJBdPfXi94F9Fl8MK2Wkc445hfkvhnpEUdWP1qVM1i3NQbwvvZRvzm8H8YcsMpCCwVxKRD YLSoB4wgawrqNXrEL.S9j7Zim_cwjJvP.H15nSbFTzIIGatYw6SFvZQSYfPfssPDFdrpMS6z26Q8 - X-Sonic-MF: X-Sonic-ID: 4b16753f-f968-4ee1-b02b-a58c97f0880a Received: from sonic.gate.mail.ne1.yahoo.com by sonic304.consmr.mail.gq1.yahoo.com with HTTP; Fri, 22 Sep 2023 22:22:54 +0000 Received: by hermes--production-ne1-6cbd549489-74r6r (Yahoo Inc. Hermes SMTP Server) with ESMTPA ID f11de988a9cbe429f0adff038f03f986; Fri, 22 Sep 2023 22:22:50 +0000 (UTC) Content-Type: text/plain; charset=us-ascii List-Id: Production branch of FreeBSD source code List-Archive: https://lists.freebsd.org/archives/freebsd-stable List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-stable@freebsd.org X-BeenThere: freebsd-stable@freebsd.org Mime-Version: 1.0 (Mac OS X Mail 16.0 \(3731.700.6\)) Subject: Re: How to Boot FreeBSD Using pftf/RPi4 UEFI (I got: "panic: ram_attach: resource 5 failed to attach" from FreeBSD-14.0-BETA3) From: Mark Millard In-Reply-To: <5E0F601D-CB6B-41EA-A811-B1D35AC19B5D@yahoo.com> Date: Fri, 22 Sep 2023 15:22:38 -0700 Cc: FreeBSD ARM List , Mitchell Horne , FreeBSD-STABLE Mailing List Content-Transfer-Encoding: quoted-printable Message-Id: <5A91A629-A1D5-45B4-AA1A-3159F4BB7E05@yahoo.com> References: <11D022AB-87B0-4271-B469-8D5BA6BD398A@mit.edu> <5E0F601D-CB6B-41EA-A811-B1D35AC19B5D@yahoo.com> To: ykla X-Mailer: Apple Mail (2.3731.700.6) X-Spamd-Bar: --- X-Spamd-Result: default: False [-3.50 / 15.00]; NEURAL_HAM_LONG(-1.00)[-1.000]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; NEURAL_HAM_SHORT(-1.00)[-0.999]; DMARC_POLICY_ALLOW(-0.50)[yahoo.com,reject]; MV_CASE(0.50)[]; R_SPF_ALLOW(-0.20)[+ptr:yahoo.com]; R_DKIM_ALLOW(-0.20)[yahoo.com:s=s2048]; MIME_GOOD(-0.10)[text/plain]; FROM_HAS_DN(0.00)[]; RCPT_COUNT_THREE(0.00)[4]; RCVD_VIA_SMTP_AUTH(0.00)[]; TO_MATCH_ENVRCPT_SOME(0.00)[]; ARC_NA(0.00)[]; MLMMJ_DEST(0.00)[freebsd-stable@freebsd.org]; RCVD_IN_DNSWL_NONE(0.00)[98.137.68.206:from]; DWL_DNSWL_NONE(0.00)[yahoo.com:dkim]; ASN(0.00)[asn:36647, ipnet:98.137.64.0/20, country:US]; RWL_MAILSPIKE_POSSIBLE(0.00)[98.137.68.206:from]; DKIM_TRACE(0.00)[yahoo.com:+]; TO_DN_ALL(0.00)[]; FREEMAIL_FROM(0.00)[yahoo.com]; MID_RHS_MATCH_FROM(0.00)[]; FREEMAIL_TO(0.00)[gmail.com]; RCVD_TLS_LAST(0.00)[]; FROM_EQ_ENVFROM(0.00)[]; FREEMAIL_ENVFROM(0.00)[yahoo.com]; MIME_TRACE(0.00)[0:+]; RCVD_COUNT_TWO(0.00)[2] X-Rspamd-Queue-Id: 4RsmxC6lxyz3WN7 [Mitchell H.: I think this has exposed a possibly general issue not specific to RPi*'s, despite the UEFI/ACPI booting of RPi*'s not being officially supported. See the "BOOT -V RELATED MATERIAL" section towards the end, skipping the earlier explorations.] On Sep 22, 2023, at 08:39, Mark Millard wrote: > On Sep 22, 2023, at 01:02, ykla wrote: >=20 >> But who test FreeBSD-14.0-BETA2-arm64-aarch64-disc1.iso on UEFI on = rpi4b? >=20 > I might get to this this weekend or tonight (local time). >=20 > But, as I do not normally deal with = FreeBSD-14.0-*-arm64-aarch64-disc1.iso > for RPi4B's, could you list step by step instructions so that I'm sure = to > test what you tested in reasonable detail? Please make the = step-by-step > instructions be for having the serial console working. >=20 > (My use of any FreeBSD-*.iso has been historically rare.) >=20 > Most likely FreeBSD-14.0-BETA3-arm64-aarch64-disc1.iso will be = available > by the time I get to this. So that is likely what I'd test. I'll also note that FreeBSD makes no claim to support pftf/RPi4 UEFI : official support is via the U-Boot port that is used for the aarch64 RPI specific images. I'll note that the RPi4B here is a 8 GiByte one, a modern "C0T" one that does not require the special bounce buffering that was used to avoid the wrapper logic error that limited some address ranges in "B0T" parts for specific types of activity. (But, bounce buffering should still work.) As for attempting to use pftf/RPi4 UEFI . . . (I've no clue how well this matches your procedure.) Prepare microsd card to have just pftf/RPi4 UEFI : # gpart show -p da3 =3D> 63 62521281 da3 MBR (30G) 63 40897 - free - (20M) 40960 102400 da3s1 fat32lba (50M) 143360 62377984 - free - (30G) # mount -onoatime -tmsdosfs /dev/da3s1 /mnt # ls -Tloa /mnt/ total 9 drwxr-xr-x 1 root wheel - 16384 Dec 31 16:00:00 1979 . drwxr-xr-x 63 root wheel uarch 70 Sep 21 10:15:27 2023 .. # tar -xpf RPi4_UEFI_Firmware_v1.35.zip -C /mnt/ RPI_EFI.fd: Can't set user=3D1001/group=3D123 for RPI_EFI.fd: Invalid = argument bcm2711-rpi-4-b.dtb: Can't set user=3D1001/group=3D123 for = bcm2711-rpi-4-b.dtb: Invalid argument bcm2711-rpi-400.dtb: Can't set user=3D1001/group=3D123 for = bcm2711-rpi-400.dtb: Invalid argument bcm2711-rpi-cm4.dtb: Can't set user=3D1001/group=3D123 for = bcm2711-rpi-cm4.dtb: Invalid argument config.txt: Can't set user=3D1001/group=3D123 for config.txt: Invalid = argument fixup4.dat: Can't set user=3D1001/group=3D123 for fixup4.dat: Invalid = argument start4.elf: Can't set user=3D1001/group=3D123 for start4.elf: Invalid = argument overlays/: Can't set user=3D1001/group=3D123 for overlays: Invalid = argument overlays/upstream-pi4.dtbo: Can't set user=3D1001/group=3D123 for = overlays/upstream-pi4.dtbo: Invalid argument overlays/miniuart-bt.dtbo: Can't set user=3D1001/group=3D123 for = overlays/miniuart-bt.dtbo: Invalid argument Readme.md: Can't set user=3D1001/group=3D123 for Readme.md: Invalid = argument firmware/: Can't set user=3D1001/group=3D123 for firmware: Invalid = argument firmware/Readme.txt: Can't set user=3D1001/group=3D123 for = firmware/Readme.txt: Invalid argument firmware/brcm/: Can't set user=3D1001/group=3D123 for firmware/brcm: = Invalid argument firmware/brcm/brcmfmac43455-sdio.txt: Can't set user=3D1001/group=3D123 = for firmware/brcm/brcmfmac43455-sdio.txt: Invalid argument firmware/brcm/brcmfmac43455-sdio.clm_blob: Can't set user=3D1001/group=3D1= 23 for firmware/brcm/brcmfmac43455-sdio.clm_blob: Invalid argument firmware/brcm/brcmfmac43455-sdio.bin: Can't set user=3D1001/group=3D123 = for firmware/brcm/brcmfmac43455-sdio.bin: Invalid argument firmware/brcm/brcmfmac43455-sdio.Raspberry: Can't set = user=3D1001/group=3D123 for firmware/brcm/brcmfmac43455-sdio.Raspberry: = Invalid argument firmware/LICENCE.txt: Can't set user=3D1001/group=3D123 for = firmware/LICENCE.txt: Invalid argument tar: Error exit delayed from previous errors. # find -s /mnt/ -print /mnt/ /mnt/RPI_EFI.fd /mnt/Readme.md /mnt/bcm2711-rpi-4-b.dtb /mnt/bcm2711-rpi-400.dtb /mnt/bcm2711-rpi-cm4.dtb /mnt/config.txt /mnt/firmware /mnt/firmware/LICENCE.txt /mnt/firmware/Readme.txt /mnt/firmware/brcm /mnt/firmware/brcm/brcmfmac43455-sdio.Raspberry /mnt/firmware/brcm/brcmfmac43455-sdio.bin /mnt/firmware/brcm/brcmfmac43455-sdio.clm_blob /mnt/firmware/brcm/brcmfmac43455-sdio.txt /mnt/fixup4.dat /mnt/overlays /mnt/overlays/miniuart-bt.dtbo /mnt/overlays/upstream-pi4.dtbo /mnt/start4.elf # umount /mnt/ Prepare separate USB3 media to hold the *.iso content: # dd if=3DFreeBSD-14.0-BETA3-arm64-aarch64-disc1.iso of=3D/dev/da0 bs=3D1m= conv=3Dfsync,sync status=3Dprogress 855638016 bytes (856 MB, 816 MiB) transferred 7.097s, 121 MB/s 933+0 records in 933+0 records out 978321408 bytes transferred in 7.956494 secs (122958854 bytes/sec) Note: the efi partition/file system from the .iso does not have room to hold the RPi4B firmware: # mount -onoatime -tmsdosfs /dev/da0p1 /mnt CA72-16Gp-ZFS aarch64 1500001 1500001 # df -m Filesystem 1M-blocks Used Avail = Capacity Mounted on . . . /dev/da0p1 1 0 1 42% = /mnt . . . # umount /mnt/ Thus the use of a microsd card for the pftf/RPi4 UEFI material in its own msdosfs. Also have USB3 media to install FreeBSD onto (different media): # gpart destroy -F da0 da0 destroyed # gpart create -s GPT da0 da0 created # gpart show da0 =3D> 40 468862048 da0 GPT (224G) 40 468862048 - free - (224G) Note: The FreeBSD installer would not deal with providing RPi* firmware or such on the target media. Such would be a separate, manual step if we got that far. Plugging in all 3 media into the RPi4B and powering on: . . . Autoboot in 8 seconds. [Space] to pause =20 Loading kernel... /boot/kernel/kernel text=3D0x2a8 text=3D0x9b1de0 text=3D0x25c154 = data=3D0x14cb38 data=3D0x 0+0x2c5000 0x8+0x14b770+0x8+0x173d90/ Loading configured modules... can't find '/etc/hostid' can't find '/boot/entropy' No valid device tree blob found! WARNING! Trying to fire up the kernel, but no device tree blob found! ---<>--- Copyright (c) 1992-2023 The FreeBSD Project. Copyright (c) 1979, 1980, 1983, 1986, 1988, 1989, 1991, 1992, 1993, 1994 The Regents of the University of California. All rights = reserved. FreeBSD is a registered trademark of The FreeBSD Foundation. FreeBSD 14.0-BETA3 #0 releng/14.0-n265111-c429a0425dc4: Fri Sep 22 = 05:48:41 UTC 2023 = root@releng1.nyi.freebsd.org:/usr/obj/usr/src/arm64.aarch64/sys/GENERIC = arm64 FreeBSD clang version 16.0.6 (https://github.com/llvm/llvm-project.git = llvmorg-16.0.6-0-g7cbf1a259152) VT: init without driver. module scmi already present! real memory =3D 3139194880 (2993 MB) avail memory =3D 3031814144 (2891 MB) Starting CPU 1 (1) Starting CPU 2 (2) Starting CPU 3 (3) FreeBSD/SMP: Multiprocessor System Detected: 4 CPUs random: unblocking device. random: entropy device external interface kbd0 at kbdmux0 acpi0: acpi0: Power Button (fixed) acpi0: Could not update all GPEs: AE_NOT_CONFIGURED psci0: on acpi0 gic0: iomem = 0xff841000-0xff841fff,0xff842000-0xff842fff on acpi0 gic0: pn 0x2, arch 0x2, rev 0x1, implementer 0x43b irqs 256 generic_timer0: irq 21,22,23 on acpi0 Timecounter "ARM MPCore Timecounter" frequency 54000000 Hz quality 1000 Event timer "ARM MPCore Eventtimer" frequency 54000000 Hz quality 1000 efirtc0: efirtc0: registered as a time-of-day clock, resolution 1.000000s panic: ram_attach: resource 5 failed to attach cpuid =3D 0 time =3D 1 KDB: stack backtrace: #0 0xffff00000050ccc0 at kdb_backtrace+0x58 #1 0xffff0000004b87dc at vpanic+0x19c #2 0xffff0000004b863c at panic+0x44 #3 0xffff000000868adc at ram_attach+0x1ac #4 0xffff0000004f984c at device_attach+0x3f8 #5 0xffff0000004fb9d8 at bus_generic_new_pass+0x120 #6 0xffff0000004fb968 at bus_generic_new_pass+0xb0 #7 0xffff0000004fdcc0 at root_bus_configure+0x40 #8 0xffff000000429778 at mi_startup+0xdc #9 0xffff0000000008ac at virtdone+0x70 Uptime: 1s NOTE: it automatically reboots here, no db> prompt. So, trying more typical media for a small aarch64 board: # dd if=3DFreeBSD-14.0-BETA3-arm64-aarch64-ROCK64.img of=3D/dev/da0 = bs=3D1m conv=3Dfsync,sync status=3Dprogress 5246025728 bytes (5246 MB, 5003 MiB) transferred 21.066s, 249 MB/s 5120+0 records in 5120+0 records out 5368709120 bytes transferred in 21.602018 secs (248528134 bytes/sec) # mount -onoatime -tmsdosfs /dev/da0p1 /mnt # tar -xpf RPi4_UEFI_Firmware_v1.35.zip -C /mnt/ RPI_EFI.fd: Can't set user=3D1001/group=3D123 for RPI_EFI.fd: Invalid = argument bcm2711-rpi-4-b.dtb: Can't set user=3D1001/group=3D123 for = bcm2711-rpi-4-b.dtb: Invalid argument bcm2711-rpi-400.dtb: Can't set user=3D1001/group=3D123 for = bcm2711-rpi-400.dtb: Invalid argument bcm2711-rpi-cm4.dtb: Can't set user=3D1001/group=3D123 for = bcm2711-rpi-cm4.dtb: Invalid argument config.txt: Can't set user=3D1001/group=3D123 for config.txt: Invalid = argument fixup4.dat: Can't set user=3D1001/group=3D123 for fixup4.dat: Invalid = argument start4.elf: Can't set user=3D1001/group=3D123 for start4.elf: Invalid = argument overlays/: Can't set user=3D1001/group=3D123 for overlays: Invalid = argument overlays/upstream-pi4.dtbo: Can't set user=3D1001/group=3D123 for = overlays/upstream-pi4.dtbo: Invalid argument overlays/miniuart-bt.dtbo: Can't set user=3D1001/group=3D123 for = overlays/miniuart-bt.dtbo: Invalid argument Readme.md: Can't set user=3D1001/group=3D123 for Readme.md: Invalid = argument firmware/: Can't set user=3D1001/group=3D123 for firmware: Invalid = argument firmware/Readme.txt: Can't set user=3D1001/group=3D123 for = firmware/Readme.txt: Invalid argument firmware/brcm/: Can't set user=3D1001/group=3D123 for firmware/brcm: = Invalid argument firmware/brcm/brcmfmac43455-sdio.txt: Can't set user=3D1001/group=3D123 = for firmware/brcm/brcmfmac43455-sdio.txt: Invalid argument firmware/brcm/brcmfmac43455-sdio.clm_blob: Can't set user=3D1001/group=3D1= 23 for firmware/brcm/brcmfmac43455-sdio.clm_blob: Invalid argument firmware/brcm/brcmfmac43455-sdio.bin: Can't set user=3D1001/group=3D123 = for firmware/brcm/brcmfmac43455-sdio.bin: Invalid argument firmware/brcm/brcmfmac43455-sdio.Raspberry: Can't set = user=3D1001/group=3D123 for firmware/brcm/brcmfmac43455-sdio.Raspberry: = Invalid argument firmware/LICENCE.txt: Can't set user=3D1001/group=3D123 for = firmware/LICENCE.txt: Invalid argument tar: Error exit delayed from previous errors. # ls -Tlod /mnt/* drwxr-xr-x 1 root wheel - 4096 Sep 22 02:57:32 2023 /mnt/EFI -rwxr-xr-x 1 root wheel uarch 2031616 Jun 5 04:12:52 2023 = /mnt/RPI_EFI.fd -rwxr-xr-x 1 root wheel uarch 5051 Jun 5 04:04:18 2023 = /mnt/Readme.md -rwxr-xr-x 1 root wheel uarch 54388 Jun 5 04:12:58 2023 = /mnt/bcm2711-rpi-4-b.dtb -rwxr-xr-x 1 root wheel uarch 54477 Jun 5 04:13:00 2023 = /mnt/bcm2711-rpi-400.dtb -rwxr-xr-x 1 root wheel uarch 54997 Jun 5 04:12:58 2023 = /mnt/bcm2711-rpi-cm4.dtb -rwxr-xr-x 1 root wheel uarch 243 Jun 5 04:04:18 2023 = /mnt/config.txt drwxr-xr-x 1 root wheel - 4096 Sep 22 02:57:32 2023 /mnt/dtb drwxr-xr-x 1 root wheel - 4096 Jun 5 04:04:18 2023 = /mnt/firmware -rwxr-xr-x 1 root wheel uarch 5397 Jun 5 04:12:56 2023 = /mnt/fixup4.dat drwxr-xr-x 1 root wheel - 4096 Jun 5 04:13:00 2023 = /mnt/overlays -rwxr-xr-x 1 root wheel uarch 2253088 Jun 5 04:12:58 2023 = /mnt/start4.elf # umount /mnt Attempting to boot that gets the same panic, so not specific to the .iso = : . . . Loading kernel... /boot/kernel/kernel text=3D0x2a8 text=3D0x9b1de0 text=3D0x25c154 = data=3D0x14cb38 data=3D0x 0+0x2c5000 0x8+0x14b770+0x8+0x173d90 Loading configured modules... can't find '/etc/hostid' /boot/kernel/umodem.ko text=3D0x2040 text=3D0x1350 data=3D0x6f8+0x4 = 0x8+0xeb8+0x8+0xb2 c loading required module 'ucom' /boot/kernel/ucom.ko text=3D0x249f text=3D0x3370 data=3D0x920+0x858 = 0x8+0x1170+0x8+0xb 13 can't find '/boot/entropy' Hit [Enter] to boot immediately, or any other key for command prompt. Booting [/boot/kernel/kernel]... =20 No valid device tree blob found! WARNING! Trying to fire up the kernel, but no device tree blob found! ---<>--- Copyright (c) 1992-2023 The FreeBSD Project. Copyright (c) 1979, 1980, 1983, 1986, 1988, 1989, 1991, 1992, 1993, 1994 The Regents of the University of California. All rights = reserved. FreeBSD is a registered trademark of The FreeBSD Foundation. FreeBSD 14.0-BETA3 #0 releng/14.0-n265111-c429a0425dc4: Fri Sep 22 = 08:52:35 UTC 2023 = root@releng1.nyi.freebsd.org:/usr/obj/usr/src/arm64.aarch64/sys/GENERIC = arm64 FreeBSD clang version 16.0.6 (https://github.com/llvm/llvm-project.git = llvmorg-16.0.6-0-g7cbf1a259152) VT: init without driver. module scmi already present! real memory =3D 3138154496 (2992 MB) avail memory =3D 3030900736 (2890 MB) Starting CPU 1 (1) Starting CPU 2 (2) Starting CPU 3 (3) FreeBSD/SMP: Multiprocessor System Detected: 4 CPUs arc4random: WARNING: initial seeding bypassed the cryptographic random = device because it was not yet seeded and the knob = 'bypass_before_seeding' was enabled. random: entropy device external interface kbd0 at kbdmux0 acpi0: acpi0: Power Button (fixed) acpi0: Could not update all GPEs: AE_NOT_CONFIGURED psci0: on acpi0 gic0: iomem = 0xff841000-0xff841fff,0xff842000-0xff842fff on acpi0 gic0: pn 0x2, arch 0x2, rev 0x1, implementer 0x43b irqs 256 generic_timer0: irq 21,22,23 on acpi0 Timecounter "ARM MPCore Timecounter" frequency 54000000 Hz quality 1000 Event timer "ARM MPCore Eventtimer" frequency 54000000 Hz quality 1000 efirtc0: efirtc0: registered as a time-of-day clock, resolution 1.000000s panic: ram_attach: resource 5 failed to attach cpuid =3D 0 time =3D 1 KDB: stack backtrace: #0 0xffff00000050ccc0 at kdb_backtrace+0x58 #1 0xffff0000004b87dc at vpanic+0x19c #2 0xffff0000004b863c at panic+0x44 #3 0xffff000000868adc at ram_attach+0x1ac #4 0xffff0000004f984c at device_attach+0x3f8 #5 0xffff0000004fb9d8 at bus_generic_new_pass+0x120 #6 0xffff0000004fb968 at bus_generic_new_pass+0xb0 #7 0xffff0000004fdcc0 at root_bus_configure+0x40 #8 0xffff000000429778 at mi_startup+0xdc #9 0xffff0000000008ac at virtdone+0x70 Uptime: 1s By contrast, using an official FreeBSD-14.0-BETA3 aarch64 RPI *.img (U-Boot UEFI/DeviceTree based): # dd if=3DFreeBSD-14.0-BETA3-arm64-aarch64-RPI.img of=3D/dev/da0 bs=3D1m = conv=3Dfsync,sync status=3Dprogress 5289017344 bytes (5289 MB, 5044 MiB) transferred 21.063s, 251 MB/s 5120+0 records in 5120+0 records out 5368709120 bytes transferred in 21.435878 secs (250454362 bytes/sec) and booting that FreeBSD-14.0-BETA3 media boots just fine. BOOT -V RELATED MATERIAL: Going back to the failing case, boot -v shows, for example: [Note the material that looks like: . . . Physical memory chunk(s): . . . 0x40000000 - 0xbfffffff, 2048 MB ( 524288 pages) . . . real memory =3D 3139190784 (2993 MB) Physical memory chunk(s): . . . 0x00000040000000 - 0x000000bb637fff, 2070118400 bytes (505400 pages) . . . ram0: reserving memory region: 40000000-c0000000 panic: ram_attach: resource 5 failed to attach cpuid =3D 0 time =3D 1 KDB: stack backtrace: #0 0xffff00000050ccc0 at kdb_backtrace+0x58 #1 0xffff0000004b87dc at vpanic+0x19c #2 0xffff0000004b863c at panic+0x44 #3 0xffff000000868adc at ram_attach+0x1ac #4 0xffff0000004f984c at device_attach+0x3f8 #5 0xffff0000004fb9d8 at bus_generic_new_pass+0x120 #6 0xffff0000004fb968 at bus_generic_new_pass+0xb0 #7 0xffff0000004fdcc0 at root_bus_configure+0x40 #8 0xffff000000429778 at mi_startup+0xdc #9 0xffff0000000008ac at virtdone+0x70 Uptime: 1s It looks like it sis not stay inside the range: 0x00000040000000 - 0x000000bb637fff but needed to and rejected the mismatch. ] Type '?' for a list of commands, 'help' for more detailed help. OK boot -v Loading kernel... /boot/kernel/kernel text=3D0x2a8 text=3D0x9b1de0 text=3D0x25c154 = data=3D0x14cb38 data=3D0x 0+0x2c5000 0x8+0x14b770+0x8+0x173d90/ Loading configured modules... can't find '/boot/entropy' can't find '/etc/hostid' No valid device tree blob found! WARNING! Trying to fire up the kernel, but no device tree blob found! ---<>--- Type Physical Virtual #Pages Attr Reserved 000000000000 000000000000 000001d0 WC WT WB=20 RuntimeServicesData 0000001d0000 0000001d0000 00000020 WC WT WB = RUNTIME Reserved 0000001f0000 000000000000 00000010 WC WT WB=20 ConventionalMemory 000000200000 000000000000 0002b68e WC WT WB=20 LoaderCode 00002b88e000 000000000000 00004000 WC WT WB=20 LoaderData 00002f88e000 000000000000 00004000 WC WT WB=20 LoaderCode 00003388e000 000000000000 000000d2 WC WT WB=20 RuntimeServicesData 000033960000 000033960000 00000060 WC WT WB = RUNTIME ConventionalMemory 0000339c0000 000000000000 00000003 WC WT WB=20 LoaderData 0000339c3000 000000000000 00000001 WC WT WB=20 Reserved 0000339c4000 000000000000 0000005c WC WT WB=20 RuntimeServicesCode 000033a20000 000033a20000 00000100 WC WT WB = RUNTIME ACPIReclaimMemory 000033b20000 000000000000 00000010 WC WT WB=20 ConventionalMemory 000033b30000 000000000000 00001876 WC WT WB=20 BootServicesData 0000353a6000 000000000000 00000001 WC WT WB=20 ConventionalMemory 0000353a7000 000000000000 00000008 WC WT WB=20 BootServicesData 0000353af000 000000000000 00001675 WC WT WB=20 ConventionalMemory 000036a24000 000000000000 00000186 WC WT WB=20 BootServicesCode 000036baa000 000000000000 00000456 WC WT WB=20 RuntimeServicesCode 000037000000 000037000000 00000190 WC WT WB = RUNTIME RuntimeServicesData 000037190000 000037190000 00000250 WC WT WB = RUNTIME ConventionalMemory 0000373e0000 000000000000 0000001f WC WT WB=20 BootServicesData 0000373ff000 000000000000 00000001 WC WT WB=20 ConventionalMemory 000037400000 000000000000 00002fb7 WC WT WB=20 BootServicesCode 00003a3b7000 000000000000 00000039 WC WT WB=20 BootServicesData 00003a3f0000 000000000000 00001010 WC WT WB=20 ConventionalMemory 000040000000 000000000000 00080000 WC WT WB=20 Physical memory chunk(s): 0x001d0000 - 0x001effff, 0 MB ( 32 pages) 0x00200000 - 0x339c3fff, 823 MB ( 210884 pages) 0x33a20000 - 0x3b3fffff, 121 MB ( 31200 pages) 0x40000000 - 0xbfffffff, 2048 MB ( 524288 pages) Excluded memory regions: 0x001d0000 - 0x001effff, 0 MB ( 32 pages) NoAlloc=20 0x2ba00000 - 0x2cfc9fff, 21 MB ( 5578 pages) NoAlloc=20 0x33960000 - 0x339bffff, 0 MB ( 96 pages) NoAlloc=20 0x33a20000 - 0x33b2ffff, 1 MB ( 272 pages) NoAlloc=20 0x37000000 - 0x373dffff, 3 MB ( 992 pages) NoAlloc=20 Found 4 CPUs in the ACPI tables Copyright (c) 1992-2023 The FreeBSD Project. Copyright (c) 1979, 1980, 1983, 1986, 1988, 1989, 1991, 1992, 1993, 1994 The Regents of the University of California. All rights = reserved. FreeBSD is a registered trademark of The FreeBSD Foundation. FreeBSD 14.0-BETA3 #0 releng/14.0-n265111-c429a0425dc4: Fri Sep 22 = 05:48:41 UTC 2023 = root@releng1.nyi.freebsd.org:/usr/obj/usr/src/arm64.aarch64/sys/GENERIC = arm64 FreeBSD clang version 16.0.6 (https://github.com/llvm/llvm-project.git = llvmorg-16.0.6-0-g7cbf1a259152) VT: init without driver. Preloaded elf kernel "/boot/kernel/kernel" at 0xffff000001395000. Preloaded boot_entropy_platform "efi_rng_seed" at 0xffff00000139e3f0. Preloaded TSLOG data "TSLOG" at 0xffff00000139e448. module scmi already present! real memory =3D 3139190784 (2993 MB) Physical memory chunk(s): 0x00000000200000 - 0x0000002b9fffff, 729808896 bytes (178176 pages) 0x0000002cfca000 - 0x0000003395ffff, 110714880 bytes (27030 pages) 0x000000339c0000 - 0x000000339c3fff, 16384 bytes (4 pages) 0x00000033b30000 - 0x00000036ffffff, 55377920 bytes (13520 pages) 0x000000373e0000 - 0x0000003b3fffff, 67239936 bytes (16416 pages) 0x00000040000000 - 0x000000bb637fff, 2070118400 bytes (505400 pages) avail memory =3D 3031789568 (2891 MB) Starting CPU 1 (1) Starting CPU 2 (2) Starting CPU 3 (3) FreeBSD/SMP: Multiprocessor System Detected: 4 CPUs random: no preloaded entropy cache random: read 2048 bytes from platform bootloader random: unblocking device. VIMAGE (virtualized network stack) enabled hostuuid: using 00000000-0000-0000-0000-000000000000 ULE: setup cpu 0 ULE: setup cpu 1 ULE: setup cpu 2 ULE: setup cpu 3 random: entropy device external interface snd_unit_init() u=3D0x00ff8000 [512] d=3D0x00007c00 [32] c=3D0x000003ff = [1024] feeder_register: snd_unit=3D-1 snd_maxautovchans=3D16 latency=3D2 = feeder_rate_min=3D1 feeder_rate_max=3D2016000 feeder_rate_round=3D25 firmware: 'tegra210_xusb_fw' version 0: 132608 bytes loaded at = 0xffff000000af5978 MAP 1d0000 mode 2 pages 32 MAP 33960000 mode 2 pages 96 MAP 33a20000 mode 2 pages 256 MAP 37000000 mode 2 pages 400 MAP 37190000 mode 2 pages 592 kbd0 at kbdmux0 mem: null: openfirm: tcp_log: tcp_log device crypto: ACPI: RSDP 0x0000000033B20018 000024 (v02 RPIFDN) ACPI: XSDT 0x0000000033B2FE98 00006C (v01 RPIFDN RPI4 00000200 = 01000013) ACPI: FACP 0x0000000033B2E998 000114 (v06 RPIFDN RPI4 00000200 EDK2 = 00000300) ACPI: DSDT 0x0000000033B27518 0022D9 (v02 RPIFDN RPI 00000002 INTL = 20200925) ACPI: CSRT 0x0000000033B2FA98 000169 (v00 RPIFDN RPI4 00000200 EDK2 = 00000300) ACPI: DBG2 0x0000000033B2FD18 000061 (v00 RPIFDN RPI4 00000200 EDK2 = 00000300) ACPI: GTDT 0x0000000033B2F998 000068 (v03 RPIFDN RPI4 00000200 EDK2 = 00000300) ACPI: APIC 0x0000000033B2F598 000184 (v05 RPIFDN RPI4 00000200 EDK2 = 00000300) ACPI: PPTT 0x0000000033B2EB18 000184 (v02 RPIFDN RPI4 00000200 EDK2 = 00000300) ACPI: SPCR 0x0000000033B2FE18 000050 (v02 RPIFDN RPI4 00000200 EDK2 = 00000300) ACPI: SSDT 0x0000000033B2ED98 000277 (v02 RPIFDN RPI4EMMC 00000002 INTL = 20200925) ACPI: SSDT 0x0000000033B2F198 000244 (v05 RPIFDN RPI4XHCI 00000002 INTL = 20200925) acpi0: ACPI: 3 ACPI AML tables successfully acquired and loaded acpi0: Power Button (fixed) acpi0: Could not update all GPEs: AE_NOT_CONFIGURED psci0: on acpi0 psci0: PSCI version 0.2 compatible Found SMCCC version 1.0 gic0: iomem = 0xff841000-0xff841fff,0xff842000-0xff842fff on acpi0 gic0: pn 0x2, arch 0x2, rev 0x1, implementer 0x43b irqs 256 generic_timer0: irq 21,22,23 on acpi0 generic_timer0: allocated irq for 'sec-phys' generic_timer0: allocated irq for 'phys' generic_timer0: allocated irq for 'virt' generic_timer0: could not allocate irq for optional interrupt 'hyp-phys' generic_timer0: could not allocate irq for optional interrupt 'hyp-virt' Timecounter "ARM MPCore Timecounter" frequency 54000000 Hz quality 1000 Event timer "ARM MPCore Eventtimer" frequency 54000000 Hz quality 1000 efirtc0: efirtc0: registered as a time-of-day clock, resolution 1.000000s ram0: reserving memory region: 200000-2ba00000 ram0: reserving memory region: 2cfca000-33960000 ram0: reserving memory region: 339c0000-339c4000 ram0: reserving memory region: 33b30000-37000000 ram0: reserving memory region: 373e0000-3b400000 ram0: reserving memory region: 40000000-c0000000 panic: ram_attach: resource 5 failed to attach cpuid =3D 0 time =3D 1 KDB: stack backtrace: #0 0xffff00000050ccc0 at kdb_backtrace+0x58 #1 0xffff0000004b87dc at vpanic+0x19c #2 0xffff0000004b863c at panic+0x44 #3 0xffff000000868adc at ram_attach+0x1ac #4 0xffff0000004f984c at device_attach+0x3f8 #5 0xffff0000004fb9d8 at bus_generic_new_pass+0x120 #6 0xffff0000004fb968 at bus_generic_new_pass+0xb0 #7 0xffff0000004fdcc0 at root_bus_configure+0x40 #8 0xffff000000429778 at mi_startup+0xdc #9 0xffff0000000008ac at virtdone+0x70 Uptime: 1s =3D=3D=3D Mark Millard marklmi at yahoo.com From nobody Fri Sep 22 22:50:08 2023 X-Original-To: freebsd-stable@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4RsnXg1Hvrz4tYQ6; Fri, 22 Sep 2023 22:50:11 +0000 (UTC) (envelope-from gjb@freebsd.org) Received: from freefall.freebsd.org (freefall.freebsd.org [96.47.72.132]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "freefall.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4RsnXg0bzdz3Z2D; Fri, 22 Sep 2023 22:50:11 +0000 (UTC) (envelope-from gjb@freebsd.org) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1695423011; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:cc:mime-version:mime-version:content-type:content-type; bh=DfNCsbtEnjVvlc/TpCjKh9s4ogNFQ4bGJFHS+Rukb+c=; b=DQ2JDEqc1uxQwerKVf86lsPyUW/5RQ3/Qd9u+1cHE9ZNojPfF1nlLrKMtMgeq6l6hZ86SS pr0XFjh02a9OBVXO+4Iy8D3YvTJGFo4xyLhVSb5F1jWCrbkvDR+8bv4gSqGDDPbkvHgyO8 KnzJsgIbBwJYzbDXJWheJf4KHWvfuAB9l+TL0eMxtq3J9kPZGW+O51aBZiWbVzOAlacSxM 2I8wd6h51KYkvnIlnpQM5sDYM9q8OhIM6zo1eWoAx05voa3JPIQaScFuq2UEh2F+IuX61A Bgp2CXpfHMIbb1L4+W/+BPVOjRfsYxQ41jPFKDuMh5Fs0OPyfEC2L0k8cux3IQ== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1695423011; a=rsa-sha256; cv=none; b=a6dyhRKsTWKtUq9ZOuOJUhsCGckGzhfocXxrwsEDjZPdWzJ+yYrAWHgvmX1wBBA/XoVRZl fIcFxjAJcbc5o5SHAIJDjBi4z7yLrcknzD160Tb3GF/rI1z5qnuqYLnaqQo559p6hHrbJ8 S2dYWRqRujkKY5UPDCBY3R8gP8+Xlxk1Am1NQsQctg28BIkFo7kCmZ2GsqF2+LYlLibkm9 2z/QBXxj5Pf4KtEyAhhgo9gFt+pRL7D7/dVNV3hFlD5HxaI4o+diqfIOrvstNYz8sLIwVk I0ocMbSAGGc0S5int7YLpAbSOA6ClgY7w1ycEILFyHgTiBQwfJjsK8NQNqSjIQ== ARC-Authentication-Results: i=1; mx1.freebsd.org; none ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1695423011; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:cc:mime-version:mime-version:content-type:content-type; bh=DfNCsbtEnjVvlc/TpCjKh9s4ogNFQ4bGJFHS+Rukb+c=; b=bHWusA3whtIobis1GvMOowJPiSimB//giLQlcWzi5lDw60Z+1XUxt12M1rXknwzvnUQkAX tMQ8dplUfrLK6YDSaUh3Xby2FmRDcccmeoe4woWRbg5xJW1zSy9wIHiJ2FB84zWxJn/Cas W7VX/rwEVAK8JzTR/mbK6jwa05rzdrMnEGu4H0kncgtwxZMh6aZfUpR9Wadd2UdO+qx0ip PyC4aeqE/2DrIAi/63IV626Y3ItJ9I+ZsbV//w9fJ05/SSrRPzzm24pggX2PQuWSoYkYzq +aVIjb5QEiDnVUrprYLXst/buwGCk0NSU7/w/eDqb8j/LRS6uBvLvWWa7m5OwQ== Received: from FreeBSD.org (freefall.freebsd.org [IPv6:2610:1c1:1:6074::16:84]) (using TLSv1 with cipher ECDHE-RSA-AES256-SHA (256/256 bits)) (Client did not present a certificate) by freefall.freebsd.org (Postfix) with ESMTPS id A31F08473; Fri, 22 Sep 2023 22:50:10 +0000 (UTC) (envelope-from gjb@freebsd.org) Date: Fri, 22 Sep 2023 22:50:08 +0000 From: Glen Barber To: freebsd-current@freebsd.org, freebsd-stable@freebsd.org Cc: FreeBSD Release Engineering Team Subject: FreeBSD 14.0-BETA3 Now Available Message-ID: <20230922225008.GQ4090@FreeBSD.org> List-Id: Production branch of FreeBSD source code List-Archive: https://lists.freebsd.org/archives/freebsd-stable List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-stable@freebsd.org X-BeenThere: freebsd-stable@freebsd.org MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii; x-action=pgp-signed -----BEGIN PGP SIGNED MESSAGE----- Hash: SHA256 The third BETA build of the 14.0-RELEASE release cycle is now available. Installation images are available for: o 14.0-BETA3 amd64 GENERIC o 14.0-BETA3 i386 GENERIC o 14.0-BETA3 powerpc GENERIC o 14.0-BETA3 powerpc64 GENERIC64 o 14.0-BETA3 powerpc64le GENERIC64LE o 14.0-BETA3 powerpcspe MPC85XXSPE o 14.0-BETA3 armv7 GENERICSD o 14.0-BETA3 aarch64 GENERIC o 14.0-BETA3 aarch64 RPI o 14.0-BETA3 aarch64 PINE64 o 14.0-BETA3 aarch64 PINE64-LTS o 14.0-BETA3 aarch64 PINEBOOK o 14.0-BETA3 aarch64 ROCK64 o 14.0-BETA3 aarch64 ROCKPRO64 o 14.0-BETA3 riscv64 GENERIC o 14.0-BETA3 riscv64 GENERICSD Note regarding arm SD card images: For convenience for those without console access to the system, a freebsd user with a password of freebsd is available by default for ssh(1) access. Additionally, the root user password is set to root. It is strongly recommended to change the password for both users after gaining access to the system. Installer images and memory stick images are available here: https://download.freebsd.org/releases/ISO-IMAGES/14.0/ The image checksums follow at the end of this e-mail. If you notice problems you can report them through the Bugzilla PR system or on the -stable mailing list. If you would like to use Git to do a source based update of an existing system, use the "releng/14.0" branch. A summary of changes since 14.0-BETA2 includes: o A fix to gve(4). o Several fixes related to Hyper-V. o Fixes to cxgbe(4). o A fix to zfsd(8). A list of changes since 13.x is available in the releng/14.0 release notes: https://www.freebsd.org/releases/14.0R/relnotes/ Please note, the release notes page is not yet complete, and will be updated on an ongoing basis as the 14.0-RELEASE cycle progresses. === Virtual Machine Disk Images === VM disk images are available for the amd64, i386, and aarch64 architectures. Disk images may be downloaded from the following URL (or any of the FreeBSD download mirrors): https://download.freebsd.org/releases/VM-IMAGES/14.0-BETA3/ BASIC-CI images can be found at: https://download.freebsd.org/releases/CI-IMAGES/14.0-BETA3/ The partition layout is: ~ 16 kB - freebsd-boot GPT partition type (bootfs GPT label) ~ 1 GB - freebsd-swap GPT partition type (swapfs GPT label) ~ 20 GB - freebsd-ufs GPT partition type (rootfs GPT label) The disk images are available in QCOW2, VHD, VMDK, and raw disk image formats. The image download size is approximately 135 MB and 165 MB respectively (amd64/i386), decompressing to a 21 GB sparse image. Note regarding arm64/aarch64 virtual machine images: a modified QEMU EFI loader file is needed for qemu-system-aarch64 to be able to boot the virtual machine images. See this page for more information: https://wiki.freebsd.org/arm64/QEMU To boot the VM image, run: % qemu-system-aarch64 -m 4096M -cpu cortex-a57 -M virt \ -bios QEMU_EFI.fd -serial telnet::4444,server -nographic \ -drive if=none,file=VMDISK,id=hd0 \ -device virtio-blk-device,drive=hd0 \ -device virtio-net-device,netdev=net0 \ -netdev user,id=net0 Be sure to replace "VMDISK" with the path to the virtual machine image. === Amazon EC2 AMI Images === FreeBSD/amd64 EC2 AMI IDs can be retrieved from the Systems Manager Parameter Store in each region using the keys: /aws/service/freebsd/amd64/base/ufs/14.0/BETA3 /aws/service/freebsd/amd64/base/zfs/14.0/BETA3 FreeBSD/aarch64 EC2 AMI IDs are unavailable for this build. The cause is being investigated. === Vagrant Images === FreeBSD/amd64 images are not available for this build. The cause is being investigated. === Upgrading === Due to a known delay, freebsd-update(8) binary update builds are not yet ready for BETA3. A separate email will be sent once they are available. == ISO CHECKSUMS == o 14.0-BETA3 amd64 GENERIC: SHA512 (FreeBSD-14.0-BETA3-amd64-bootonly.iso) = 628186fb7330caf217fdf81cd7b7f3f749785d9d9b565c2fb08f8ba4cfd7cac93fc0ae75aecfc672004e6ecffa634aaa67948312a05db110f330f3c60cefc176 SHA512 (FreeBSD-14.0-BETA3-amd64-bootonly.iso.xz) = f41f2e70214ef48042f899606e86cb9c23b8dbe43beb5c3b6a167e68766abeabc9ab9869ec1527f672f88ea55524c5cad9555ef607e7a7b5b598bb83ceb71af6 SHA512 (FreeBSD-14.0-BETA3-amd64-disc1.iso) = 5386bc3f0aba186b9f3f3dfc8f90d016fe670b7548cc75c3efbc9bf5b5151c323c8d15bada1dc0daa5f76ed587223b0afee6d686834987f35e51f90f6edc41f7 SHA512 (FreeBSD-14.0-BETA3-amd64-disc1.iso.xz) = 3a97aed101bd33e479308a738a26102eabd49fe1ec6279b3f765943eac5e96caf3bf3271c2281db82493cc42cdcbd59a3dba21d4a89aa1fde059561746b395df SHA512 (FreeBSD-14.0-BETA3-amd64-dvd1.iso) = 83d141f777343bbc5f96c46ba6d8ab0ab60dd72448f85d7e11fa803209ccb2fa35e83ef687854f246ee128c71ba35232c736d3bbcc41bdb98fa8a16a03e3a65e SHA512 (FreeBSD-14.0-BETA3-amd64-dvd1.iso.xz) = e34913b56eb402cbcac1945d66b715757439ec125794cd6fc36c9e686b1a406bd9ec82a4902a561e5f5b33e90b1db496c278dbe489ace921baab56411d04b405 SHA512 (FreeBSD-14.0-BETA3-amd64-memstick.img) = 0b71ea42856338d634f3085d641bd69b6071967b5f706cfba98ac35ece710a09c8b571225303b97f760b0d15395425b6cd21645081d58a225e222caebba8dc68 SHA512 (FreeBSD-14.0-BETA3-amd64-memstick.img.xz) = de4db57cf050f8f5591801d41b741e85425f515f1af30da31d3a9d8ca03762f6fa0fa3799ffa34b7a57143ff83839da75567c5bdb181182b81ee1d1f85f89a7d SHA512 (FreeBSD-14.0-BETA3-amd64-mini-memstick.img) = eb49a3d2f0d6a3067f5e3fcda422d0c7cc6b8e5a6c58b72ec37fad79fe869a877d366a0bf080c220b2063f4b97d9ea0b62d0ea3638884e1aed36a56d444f205f SHA512 (FreeBSD-14.0-BETA3-amd64-mini-memstick.img.xz) = f0e14312dbaea890ae004e38c2e66874c0b6b25c734d56a5a437b348cf5ecedf5e6fe3ae5436a26ba4eb1bd03cda3acb6bf4eca14e76e26eacf8d8268e053542 SHA256 (FreeBSD-14.0-BETA3-amd64-bootonly.iso) = 4c78228910db7302617dd3066b62149a6792b168274973ee32c0d3857f008d21 SHA256 (FreeBSD-14.0-BETA3-amd64-bootonly.iso.xz) = f35ebd79cea1e973b6f6d2d7135a7fbc098006a85723dede0a57061fd5c6b8b5 SHA256 (FreeBSD-14.0-BETA3-amd64-disc1.iso) = dd96b77fdc46c859298c4bec1cd340fda203f25039756fdd2d5d16f107a3f96d SHA256 (FreeBSD-14.0-BETA3-amd64-disc1.iso.xz) = 9406eee7f608c11c02a87abe42b6934bab5e79a76447381fe26dcddfeaac5f1e SHA256 (FreeBSD-14.0-BETA3-amd64-dvd1.iso) = 661c79db072d628d4ca20665d65252cb42133d62fa1da1103ff66bfced389a1d SHA256 (FreeBSD-14.0-BETA3-amd64-dvd1.iso.xz) = 3428ddce5aa62ce075be7bae9d1f133d5253971f08350aa6418e44a030b7763a SHA256 (FreeBSD-14.0-BETA3-amd64-memstick.img) = 89f9455dd626c2382fb6e302371f4d7adcbf978be284772b29761e1859e44e48 SHA256 (FreeBSD-14.0-BETA3-amd64-memstick.img.xz) = 4caf1f2500f9b76ac5f98d60ec91d124720b8abfc995dec3c95bca2b7d478bb4 SHA256 (FreeBSD-14.0-BETA3-amd64-mini-memstick.img) = 6a3821910989f26fd473c104add4a5eb2dac46dceb00d142f084f530f20fc723 SHA256 (FreeBSD-14.0-BETA3-amd64-mini-memstick.img.xz) = 87422322cf41c4fccf3950f7150c4b55a8c63625c31dd4a320ae52db8b7f3fbf o 14.0-BETA3 i386 GENERIC: SHA512 (FreeBSD-14.0-BETA3-i386-bootonly.iso) = efa5d71a0dd98c2dfa4be79b56cb697bbe1d2e3ca95cbe005bfd4ffc4ed81006ca6927bd5974ce7245dee102879b7924d0e1581ad953be2758969c9201dfbd2b SHA512 (FreeBSD-14.0-BETA3-i386-bootonly.iso.xz) = 511749145a14644e8bf746af4c584ee9d4b51f7101ab653f21eb2df311b058a94f1bc3f21872564f7c1c83c124fbcdf388c2cccd86fa4c55dcc2645c84efe82d SHA512 (FreeBSD-14.0-BETA3-i386-disc1.iso) = 1c725c593ab7b554b7d3359b1290e63324ec02c9ca4c9d7dfa3e09af3435e7d172f77703adcde490c16fa2f6449e55600fe3ca665901f07c916b83e921d5fef9 SHA512 (FreeBSD-14.0-BETA3-i386-disc1.iso.xz) = 1be3894653bd40fd036e8aec60fc7b64129d0b59bf349551ae3f9a754d58a7810485e1485ed8618c4a13169a2b58ef0d3e308e0747cc5afd0d7392aeeeef3b70 SHA512 (FreeBSD-14.0-BETA3-i386-dvd1.iso) = 1676357d34cdc5bd2c2c7e1a02018f21ca6882e95614405af87ed642bb02c9f44b443a7bfca7cd74aa49400b0abecc59ce0deebff7a6c46175a0bb793e4be3c6 SHA512 (FreeBSD-14.0-BETA3-i386-dvd1.iso.xz) = a3c44bd8b4d4a54d59a6165558d80184a1ec25a290e323c2ba4bb691be006827f4dee608b74c9e11072f1065289ad21eef3740357249de598c281ef1f07c7577 SHA512 (FreeBSD-14.0-BETA3-i386-memstick.img) = 735b377178b95446bbb61a416e7a4486ebd1936ea79085c129c1fb38c048dcf9c7709731ee6d54678ca6e6249782379aea299815e65890bbf82733a166f4197d SHA512 (FreeBSD-14.0-BETA3-i386-memstick.img.xz) = 0e7ac86525020897349d14540b1e076edb5651345f92d228fbc4f5d0a6f028f1e1e6cf164e7d9097dd81eb7d7696b58fb31c5f954927207910863bc964724155 SHA512 (FreeBSD-14.0-BETA3-i386-mini-memstick.img) = 0d00e05bcfc2a01b1624200dd614b5bf1650615b809d3d612a7d7f1d05cf384dc6471673c6dec37fb1410885146b536d6aee58b617f016458b4bd3a456ac0e6d SHA512 (FreeBSD-14.0-BETA3-i386-mini-memstick.img.xz) = a55321477849705ee4f41b2e2d6f4e1f60d101b84103969a3cd584d629a76e1f82e30b80821cb036c61dcb6e798ccb312c9d5e82f33bd72bbd3959e048552fc4 SHA256 (FreeBSD-14.0-BETA3-i386-bootonly.iso) = 5ccb294229a6880d7d81d85280d6ffb719e2d0e43138beee46034c99b27be2a2 SHA256 (FreeBSD-14.0-BETA3-i386-bootonly.iso.xz) = 609cc2b8175e72fb09277c3a95c4db80a825f2361da46a15d6506102e9a1a363 SHA256 (FreeBSD-14.0-BETA3-i386-disc1.iso) = 002c659df27eca30c67ddfea57169a5a8a13ceb77e4948128a6bf55bb3a2d587 SHA256 (FreeBSD-14.0-BETA3-i386-disc1.iso.xz) = 1ad6089cc5a96e5d92fa42d43c91088bc264d8a9d4f5a0537ae1c3356ac29a4d SHA256 (FreeBSD-14.0-BETA3-i386-dvd1.iso) = bd391043a8f37e3be842173e2e19bc48ccdd353af5a2f90dfddd03c3ff2e8c43 SHA256 (FreeBSD-14.0-BETA3-i386-dvd1.iso.xz) = c2c5e179192595dc37554ba03236d33b7205ebbcd0a78e71c2c148c3eeab615c SHA256 (FreeBSD-14.0-BETA3-i386-memstick.img) = d6119d164e403907be9c02d58a05b167b8fc3bbfbb712dfccb1c1300bcfc02e3 SHA256 (FreeBSD-14.0-BETA3-i386-memstick.img.xz) = 1239113cdbe20fcc0684290270037089c4a982c60cb21368f86d236574d25afc SHA256 (FreeBSD-14.0-BETA3-i386-mini-memstick.img) = a19e312d12d86427bc577ddfa1783209ea694ea2aa5af5d220a6d73149adbb12 SHA256 (FreeBSD-14.0-BETA3-i386-mini-memstick.img.xz) = bab95c8cb61e7c75a94afd6e135e0795ca2774b77d90ab2fd8e1d57cb76a0982 o 14.0-BETA3 powerpc GENERIC: SHA512 (FreeBSD-14.0-BETA3-powerpc-bootonly.iso) = 382a8d930a3b016e280fe1eb72b7006d9c5d3d8d8c6bdd4bb37849b7f1a947afeaf14db78fcb0b3351da38134f7ae6200180f702d66a18adda395bdfae5116e1 SHA512 (FreeBSD-14.0-BETA3-powerpc-bootonly.iso.xz) = e4fe8ca1ad54f0b9400fb4d055440b6d6f96851c7baa11999eee03092fdee567ed46b3f517fa6e9e597885fad33721c3cc884b7ae3e4385dddd287da15979a1e SHA512 (FreeBSD-14.0-BETA3-powerpc-disc1.iso) = 7186999f8f29af0c10f8319b4714cd160da76eab8767ebed30d1b11f0266d098d90ac4f006ea0ab2da7452ce9d9e11d9424fa8fd07472e929a16710440868a45 SHA512 (FreeBSD-14.0-BETA3-powerpc-disc1.iso.xz) = 1678fd822e61d62eefe80900a22c62a50c9831d49d8c8e0fa56ad35c4d4c45a41c64fe5d2422a873777393adf36e7cab4e40b9d77a04cfac0cfaec8c7dc6240c SHA256 (FreeBSD-14.0-BETA3-powerpc-bootonly.iso) = 025bda0dfa635b846f14622edaa6bbc6d63fa8cf30b782d190092de9b4122679 SHA256 (FreeBSD-14.0-BETA3-powerpc-bootonly.iso.xz) = 4ea2fb1c399f1cf389947ae31b6b41e168b2ca671214be4c18d88489cace67d5 SHA256 (FreeBSD-14.0-BETA3-powerpc-disc1.iso) = de313fbb340c42d30b6bdb8d9b2c3905883426f4f34d71ce8aac4e0afee24610 SHA256 (FreeBSD-14.0-BETA3-powerpc-disc1.iso.xz) = fb639afa769c481dd125bfe623bcdea7a73d7b09601c4a10d55d88d1d878aacd o 14.0-BETA3 powerpc64 GENERIC64: SHA512 (FreeBSD-14.0-BETA3-powerpc-powerpc64-bootonly.iso) = dced975c4f445c9f890b227c8fa3450d93dbb754c5f0ac7bdf242f8a96923681d2cf8a3e420560336016a5b479dc958daa3527d33b2fba1d3c3658a1b0a56c51 SHA512 (FreeBSD-14.0-BETA3-powerpc-powerpc64-bootonly.iso.xz) = 0f6f824e6ba29e554675bb8784a14467c6641576e64d4e6015541bec010a6a89c659a2f7e04afe96ccb0373812e802281ec0d8f12b7337abc89ef46646287506 SHA512 (FreeBSD-14.0-BETA3-powerpc-powerpc64-disc1.iso) = 5180e64c17126ff0519a7152119e5625f5d9d49e6d43b685a9a4b7e4e606b7d7e9f908f4703dbf102607d3bc5695566c1bcf943ed856e4d033097d8d16b0bf9c SHA512 (FreeBSD-14.0-BETA3-powerpc-powerpc64-disc1.iso.xz) = c609facb9257e71811687499a3fd496eeb9d6f8f3855ee7f7e4da0a1893de0427330a55d13ba32e58cad9346cd5f73c3672f1529d6597d587927ff8895a4904f SHA256 (FreeBSD-14.0-BETA3-powerpc-powerpc64-bootonly.iso) = 351e9d5fe85ae5a7d0f1f726e3b6da1100736bf656cbedc7b3e7f33678897c00 SHA256 (FreeBSD-14.0-BETA3-powerpc-powerpc64-bootonly.iso.xz) = 187db0d771876af7175b5b75cfc7d163c834118e54a6d1ce219460d6c5e9ba99 SHA256 (FreeBSD-14.0-BETA3-powerpc-powerpc64-disc1.iso) = d0dd9c34a330ab3818b441fe43587abbf425efe4411230746eba4c78c62ffbf8 SHA256 (FreeBSD-14.0-BETA3-powerpc-powerpc64-disc1.iso.xz) = 784d71f82ef24a94b2e1824e26b4e609415406b1f6543f716eb1ceb928903824 o 14.0-BETA3 powerpc64le GENERIC64LE: SHA512 (FreeBSD-14.0-BETA3-powerpc-powerpc64le-bootonly.iso) = cfa030ab6426780cfdd2b782145fdba1a567d77bfc5cfbac3a7ff2e8e5f5afad75c91e890b74bbb98b7ce4c7278f720fd6cf3b705f6387b85b0a8b0485bc4850 SHA512 (FreeBSD-14.0-BETA3-powerpc-powerpc64le-bootonly.iso.xz) = 32b5548f1ed1d2a2e1dcf039fd02ae4dd68d9ec477e23b2b6164f651be820c88791f927c38024191071dac0afc7f7b1c3051b88fc64da57c77a6669b4cec9314 SHA512 (FreeBSD-14.0-BETA3-powerpc-powerpc64le-disc1.iso) = 3fc78a11eeabc6a71c075294f4670502503aa64dec0858edcf17883437e83d5280f06e178d563fd6edac7c3ad69d59f7644eddbbc043b4a121160ed72cf8f7bc SHA512 (FreeBSD-14.0-BETA3-powerpc-powerpc64le-disc1.iso.xz) = 1dab8d32696e292b66694dc9d6c6c5c0a684b3a1536af434d6ffdb550be7d602b05dfa527cb908be59e0073bf687fb6223e02667db6e5af03739874b8dd8bcb8 SHA256 (FreeBSD-14.0-BETA3-powerpc-powerpc64le-bootonly.iso) = 23c58cd6b6de7f12fcd627da10781dab13bd39f7d1a9b1a68ee9058ae3fdbb15 SHA256 (FreeBSD-14.0-BETA3-powerpc-powerpc64le-bootonly.iso.xz) = bc6ed52b62e0054ab8ab318aef97a86bd97c832b4cf892d7c10680353b5a459e SHA256 (FreeBSD-14.0-BETA3-powerpc-powerpc64le-disc1.iso) = 71c10e89b01d288d490121bdbec97dbe53e48709398801be7f4c322e67991008 SHA256 (FreeBSD-14.0-BETA3-powerpc-powerpc64le-disc1.iso.xz) = fbf7ccb0ea435fce66f8abf683b73c55922f5b2e19b5e168be73853c8cf0674d o 14.0-BETA3 powerpcspe MPC85XXSPE: SHA512 (FreeBSD-14.0-BETA3-powerpc-powerpcspe-bootonly.iso) = efa55cf2427a250a0e7c135d436886d79dce3b5df495315557ef5f0b798f70fc9f0879e3972770bdd7b8c4b5cb61c9d2c7d51d01be59422cdbe7d6b33d7c12ed SHA512 (FreeBSD-14.0-BETA3-powerpc-powerpcspe-bootonly.iso.xz) = bb024a1124ec653dbdd267a360d53357430b44fc57526308a515af49079f27a6bfd5bc3419f1194f6c78bbc09d6f38a5a209bd8adca007a2851b117f854558e0 SHA512 (FreeBSD-14.0-BETA3-powerpc-powerpcspe-disc1.iso) = 5cc3e475739e1da01a08747c9d2d9c79cd8978387ef076a38cda7014901b8978902f668c44646e01892a225e9de8a781775c484dfbc26a7c0fc4c843b0cbc4ef SHA512 (FreeBSD-14.0-BETA3-powerpc-powerpcspe-disc1.iso.xz) = 5ec13a6e7a88dad17c8d9d48d4b4495408201b1e0d9c105c1138a5f9573135677c7af86b387e15596eba5da5d56e01252874e48fdd81adab9b4083b4e05a6e1b SHA256 (FreeBSD-14.0-BETA3-powerpc-powerpcspe-bootonly.iso) = 151b691e3f905830239640bfab547990b9e4d82e7441ba0d1535b20b2c723e42 SHA256 (FreeBSD-14.0-BETA3-powerpc-powerpcspe-bootonly.iso.xz) = 03f9db3673fa4c9fa3909e8970e59a4f0ca2f495093264b63bf1af1f2d2b62e7 SHA256 (FreeBSD-14.0-BETA3-powerpc-powerpcspe-disc1.iso) = b52b043dbe0a61d6d8bb26bdb5f070c1f9f8fd2f8e272b1faf6d46a1d183bf2e SHA256 (FreeBSD-14.0-BETA3-powerpc-powerpcspe-disc1.iso.xz) = 84c97883723cf8248d2f11891b58932f4a242d1b4ac8b1f69ffa7195f320a367 o 14.0-BETA3 armv7 GENERICSD: SHA512 (FreeBSD-14.0-BETA3-arm-armv7-GENERICSD.img.xz) = 83391e4464595377d2a61e258154c04d60495a096a7369e41381069e58116e28ab121ed534fab301d9e96d7997f88aaa3748cf148f09bbe20cc7732dae9cfbac SHA256 (FreeBSD-14.0-BETA3-arm-armv7-GENERICSD.img.xz) = 3b734670164536e77b23b6394c989a4013366d20eefc93d1926603da71c33eb5 o 14.0-BETA3 aarch64 GENERIC: SHA512 (FreeBSD-14.0-BETA3-arm64-aarch64-bootonly.iso) = 0621bd6ebc5e7719370bfe19a6cd4a145f64532c87f3c5f6968071670ffd0afb500919d44f59d5d8417c52935e1f4847f543a7d9c5ab3c0f67ba81cec054400b SHA512 (FreeBSD-14.0-BETA3-arm64-aarch64-bootonly.iso.xz) = b14236a13e9ec8f90b86a466ab7c8d7c266d05975a22d9c6107298b717f7d3fad84e7487ec29d02ce381600c517c941b231e2faf0d4e382fd700412f5801553b SHA512 (FreeBSD-14.0-BETA3-arm64-aarch64-disc1.iso) = 293476a2e39014642e587a0466c53d5d60e5f3f48a859c268f9f45548c716e1909310284e029043ceb8174e4f235ff163b561b2458c13e45d2ccc82e06aa8248 SHA512 (FreeBSD-14.0-BETA3-arm64-aarch64-disc1.iso.xz) = a3206acd753c92b71e84b727fb9f76898222a4bdc0b384b13198811544627a3368706889ae7dda31414c43c218579000896cb0ee9c26d870d5d46224830da4bd SHA512 (FreeBSD-14.0-BETA3-arm64-aarch64-dvd1.iso) = 5e3219d464cfe8209fe3bd13e613f89d1e5ec4aa3289107e24fe2ce1ff1e420f913964b532857f3d28c376cdd62307044c7823f7859575f6b19328c8de377606 SHA512 (FreeBSD-14.0-BETA3-arm64-aarch64-dvd1.iso.xz) = 5f1d3484e9baa077d68ab3c76ebba20aac19c7820ea53e8a2c9ecc4e90ee281be0b5e313b139bbdbae02a604db98c063f11afc46b3b80f2664700c1ecd669b75 SHA512 (FreeBSD-14.0-BETA3-arm64-aarch64-memstick.img) = 66c9f056eebc17845106d1ca2219cc21aa6614b9dbf37efddc8d83468a26b1e40aba29cf6d061d8660617e9434a9340c271b8d70769682fb0c58f315ceb31409 SHA512 (FreeBSD-14.0-BETA3-arm64-aarch64-memstick.img.xz) = 7bd01ae52827185dd971103ba1cb7d3fa18e88f1e2a20fb3f77b8b77e22bbffbb8c642d8bbcbfdb236a0bd9b2cff31e2888f22c29a76c236538eba392cc97817 SHA512 (FreeBSD-14.0-BETA3-arm64-aarch64-mini-memstick.img) = 43c5a8752218fbac4ec58dc091cddcbc39649627f0fa4483b2fde25cc4aa08e4cb1b02dda692e366bf98d7e16902ce42692021152aee7cc5e42b42975dddaf0f SHA512 (FreeBSD-14.0-BETA3-arm64-aarch64-mini-memstick.img.xz) = 2983f0a959df78a2b460369cf6bdf4dcc0dd59f1d43a23e1e36f3ebc5a33fd8884a752e5820394a8ad6684aa7be712dfaafd8817eb9824ec1457282beccfcce6 SHA256 (FreeBSD-14.0-BETA3-arm64-aarch64-bootonly.iso) = caa698cc1b6f427d49c5445d0742a880abed18751297243f5c2ba5d4d6bf0d21 SHA256 (FreeBSD-14.0-BETA3-arm64-aarch64-bootonly.iso.xz) = a089606492c509d4ab9862b95b2077d49f4a281b6f7417e9abd595c2e10fb387 SHA256 (FreeBSD-14.0-BETA3-arm64-aarch64-disc1.iso) = 54de81f55995a7827064e31447a1ebbd56e449919b8e28d77694854bc0cfaa01 SHA256 (FreeBSD-14.0-BETA3-arm64-aarch64-disc1.iso.xz) = 5dd27a15f3c973045aa8d9e6f32bef749e4f72f00ecf4fd713f44c554770a1c8 SHA256 (FreeBSD-14.0-BETA3-arm64-aarch64-dvd1.iso) = d3202372221837a116ec90d791e9bd4269badecfcfcad6f7eedbd1f69670d6f0 SHA256 (FreeBSD-14.0-BETA3-arm64-aarch64-dvd1.iso.xz) = 9cc668182634a6bd14563873800a09a7021e8dbcb51705aa00c34428b6e67cd1 SHA256 (FreeBSD-14.0-BETA3-arm64-aarch64-memstick.img) = 212913634921e46c13bc2214d570496daeaedf4769eaf456ad4f7768d5a0f60e SHA256 (FreeBSD-14.0-BETA3-arm64-aarch64-memstick.img.xz) = 42f0e4a3ac5e957a38de3a328d1c46c3de67639b8801d72cb5f096ee1dd80561 SHA256 (FreeBSD-14.0-BETA3-arm64-aarch64-mini-memstick.img) = e9353cdca6e9295decea956fe649c99e3854b38789ab2f9cf92014319777b9d3 SHA256 (FreeBSD-14.0-BETA3-arm64-aarch64-mini-memstick.img.xz) = 5134cde03baa5e386be62b48445755fab0d0cb8ecf3e175f536679e53a507963 o 14.0-BETA3 aarch64 RPI: SHA512 (FreeBSD-14.0-BETA3-arm64-aarch64-RPI.img.xz) = 3c21f627692e4f0dedd8bfb968c86f4b38714c7045603ec7ee1f80b53a66f3b9792fbe115da4013dd28bc6c774dacf323b18cc96e8f95dce1b2bb968ce42bb49 SHA256 (FreeBSD-14.0-BETA3-arm64-aarch64-RPI.img.xz) = 91524aa12232588787889022c10114e3234681e2a74fa89c78ff6d0fcef9485e o 14.0-BETA3 aarch64 PINE64: SHA512 (FreeBSD-14.0-BETA3-arm64-aarch64-PINE64.img.xz) = d5cf65ddb048c50d45220b83f756400dc6836d7acd2720aa58241c90b250f4db34dc3358c568b933db92c944f9d263a49b9c63a74855ed1d48a2f01daf40477d SHA256 (FreeBSD-14.0-BETA3-arm64-aarch64-PINE64.img.xz) = 58bae674f93510a15c25339f09f2498043b8dfe598fedf02d84d4dae955d894b o 14.0-BETA3 aarch64 PINE64-LTS: SHA512 (FreeBSD-14.0-BETA3-arm64-aarch64-PINE64-LTS.img.xz) = d0754a61056994b1ec36f4a52082c540308e83f811a6512c94ea47f7f02f4838a13e2013ee4cd1bef72aa6651a87a7767e3918e915313a848086c9a5562ff169 SHA256 (FreeBSD-14.0-BETA3-arm64-aarch64-PINE64-LTS.img.xz) = 643936c5223a2e84ab84236e737d719e66c32cc5cc0707682c228a512fea30d2 o 14.0-BETA3 aarch64 PINEBOOK: SHA512 (FreeBSD-14.0-BETA3-arm64-aarch64-PINEBOOK.img.xz) = 55a3f96d0075eca3398a1d8183d65e8e39ba6f14a70155be407e1f1e347a9b5942772019fa9f250dd00a1cc3ba3f293a7a1532a30855b612df5a2fbbb2fc62b9 SHA256 (FreeBSD-14.0-BETA3-arm64-aarch64-PINEBOOK.img.xz) = b6c1c28e9e9bedadf09a82fb561985ef2dada27154750ba2c21819e0558eb46c o 14.0-BETA3 aarch64 ROCK64: SHA512 (FreeBSD-14.0-BETA3-arm64-aarch64-ROCK64.img.xz) = 09b089792018830d376f49d51a22c70133b384590b9a17c5144410b8c62d08c69478871bb823fe9d273a77167a9108756ccc70957f3117d89d5be54a553679cb SHA256 (FreeBSD-14.0-BETA3-arm64-aarch64-ROCK64.img.xz) = 16226ac2947cb64cdd3a99c4b8d94632825d4b698c8b450781e6ed2b6015f181 o 14.0-BETA3 aarch64 ROCKPRO64: SHA512 (FreeBSD-14.0-BETA3-arm64-aarch64-ROCKPRO64.img.xz) = 965304372b9f00d9578eed5a8aafecd5b05b03265fb459860163da4fbfce79c6fce05820eeb76af0674a161e146cfdf206225731a64e60bd5f1112500a61fe8c SHA256 (FreeBSD-14.0-BETA3-arm64-aarch64-ROCKPRO64.img.xz) = 75700cba3ecdb0c60dba8840e2ab04de0eb66f62cdbb8bebcdf95893e851328d o 14.0-BETA3 riscv64 GENERIC: SHA512 (FreeBSD-14.0-BETA3-riscv-riscv64-bootonly.iso) = a0f08526d7abad1917eaaf4410fce3a849f1b4345791e8aba2d101f272bfd16ea2798f07f60bcab6ba90aec51e06c9c4ae06822757213f3ae3be61643a287e9d SHA512 (FreeBSD-14.0-BETA3-riscv-riscv64-bootonly.iso.xz) = 9aa84bd0439d325afbc74dea19b99536248c515c71c6838ae2889d936b61523a2ef6585899ceac9d114a5ca95c09750caf79624bbb093a0d2c26364d31963800 SHA512 (FreeBSD-14.0-BETA3-riscv-riscv64-disc1.iso) = 60fe291dc91b39df25dd00ea644a7f57697a77df22c4bfc0dd03dc9a555052ff859255647a7508828d3d3a662c25ebf182b6c89dc0156ab0442055e4c6381616 SHA512 (FreeBSD-14.0-BETA3-riscv-riscv64-disc1.iso.xz) = 6a4ea770e21184966ed37b693cdf3320f26362fcc60224be664772eb5a495fcafc74d43e70638f92ecce92446fa34db422ea239983b5858ea67a4c0997685cd9 SHA512 (FreeBSD-14.0-BETA3-riscv-riscv64-memstick.img) = 388f534a905e0c68e6abec53dca5335508c619bba60b6c1bc6e8c05d4144659286e3ccd425281473c4612ff8a4c49f98b1e43d774e33b7d7f3b3cfb5624aa01e SHA512 (FreeBSD-14.0-BETA3-riscv-riscv64-memstick.img.xz) = 0a5a83bf403fd6e19aad15606570135f5c2356bb8f67aeaa4762c14ed9796b62afb6fc30d9ead8d0b43de1e5ebfbf5f780eb7911f84bd81e07497e78fc5f7e2b SHA512 (FreeBSD-14.0-BETA3-riscv-riscv64-mini-memstick.img) = 075c16509844eabd89437379b4da9ebf364619e7ba0b0f98ecbc9dddd7a1d11dc308c370ed1720c43c7daf16d6d70c4488623a5cfd6cc1701586f9e88d995ddf SHA512 (FreeBSD-14.0-BETA3-riscv-riscv64-mini-memstick.img.xz) = c5355e0d715b89fb24c88e64d901f2e5b129d9084faf4a40af50b269bd6d374590d969d2b8c5c59d580a3d4a284fbc713d92d4e4d0679bc39173a638e7baae24 SHA256 (FreeBSD-14.0-BETA3-riscv-riscv64-bootonly.iso) = 5f1f3c5fffe34d6288a991a9072b5b67ba8b38dc4e06a7d8de1fc8cd3b607053 SHA256 (FreeBSD-14.0-BETA3-riscv-riscv64-bootonly.iso.xz) = 6d379a49ddc3c5dc825884a10d499f25b350bb44101e7cd12f5cf0a131dadcbb SHA256 (FreeBSD-14.0-BETA3-riscv-riscv64-disc1.iso) = 3059f3ff8ee253a5446bd8edac79619e5a6d45da70fdbd52353847cb06678c24 SHA256 (FreeBSD-14.0-BETA3-riscv-riscv64-disc1.iso.xz) = 3b940ccaebf271efec68e1ff2526b3b6bef20ccf886c59421b8eb12d78e05883 SHA256 (FreeBSD-14.0-BETA3-riscv-riscv64-memstick.img) = e904b60d63525ebc77e78a745b90de1dc0e24f92e2f7c17c2a6f3df41c4c28a7 SHA256 (FreeBSD-14.0-BETA3-riscv-riscv64-memstick.img.xz) = ea5b7fdcc4efee1d705858e8e306ce886c8f27ff849fd66f3e69729bd016210e SHA256 (FreeBSD-14.0-BETA3-riscv-riscv64-mini-memstick.img) = 9c40a451ace616780ab6b174666be78d703dc6c4d714ca2f71f53f6c21bce61b SHA256 (FreeBSD-14.0-BETA3-riscv-riscv64-mini-memstick.img.xz) = 109f9f3ae4bf8b4705a4dac091e71fa8fac4226a6edd87d1b36868c97101cb9f o 14.0-BETA3 riscv64 GENERICSD: SHA512 (FreeBSD-14.0-BETA3-riscv-riscv64-GENERICSD.img.xz) = 9ade14dfe19f533d940a4b5bb27126a3faab65274ea7a07883b202f80c369e3e31f9e062dd052468171a4cf0fa5f5af9a23b3ade74ade975746babdcc8241191 SHA256 (FreeBSD-14.0-BETA3-riscv-riscv64-GENERICSD.img.xz) = 0c990bb09ca041ee362b77185f128cb98abae6775828eadb9e8f210c4d9fc176 == VM IMAGE CHECKSUMS == o 14.0-BETA3 amd64: SHA512 (FreeBSD-14.0-BETA3-amd64-ufs.qcow2.xz) = edb73c6b62077f47df9ca9e98a9813b9850e202099ed41b1fcdad86ef73b1d15aecb93f51cc7a71e3224dd5d57c9c624c8a280161423b4c0f2f270033ec9d48b SHA512 (FreeBSD-14.0-BETA3-amd64-ufs.raw.xz) = 796e65a11197f8b8d9da9e0e7ec4c451391807f664a71d6d1c0ba543e7662d157ac03e24d126ccddfc400111994f6f876b98336086c00cba94ab4b459375e3dc SHA512 (FreeBSD-14.0-BETA3-amd64-ufs.vhd.xz) = 850436986687f2e25233bf0d4cad34d481e0a0085340b8d8bea0d2aceaeb178e653cd7e853d4e477b1d1f9d83f279c7cd3692aee11f67f9f0e69d2922a6be88e SHA512 (FreeBSD-14.0-BETA3-amd64-ufs.vmdk.xz) = 825641822884f9c49547c8ce5c62a599acd170c4c75e3fc7318672a9e039204abe436d5e7d77e6d789e31d5338a0834bf184a69821918219cb5ab9cd6ca0dfcc SHA512 (FreeBSD-14.0-BETA3-amd64-zfs.qcow2.xz) = c9b10ed8d2683c4a81a2092e0b38d356bc824e007c85eb576d1ba87bef64b46ae809440e111f6d1a3f24007927bc97d53d794bc859dcebd81e64997cb2fdb090 SHA512 (FreeBSD-14.0-BETA3-amd64-zfs.raw.xz) = 8ff976b83d1e146e81c49748d9c1a2deb674c449c07130f0d5c5fc402254eb730f3a5e9eff9227c184f7470fc6e93058240614bdad735c2a552fadded1576f0e SHA512 (FreeBSD-14.0-BETA3-amd64-zfs.vhd.xz) = f999c3b57307feb4fce94e8689b72dbedd9b0b97ae03e4eb586b6037db4f537b2e08a6a3916eafcf5ff83b6b5ab1ad5adadb77b8a7086deec3d7ce21789846c1 SHA512 (FreeBSD-14.0-BETA3-amd64-zfs.vmdk.xz) = 283406ede245fa3fde92bdc9afbd32aa60619df4fcc4633d68753ee5ef5831b5d1028b514edef5a379f2570cc6af65ca30788df49b233896ad4ae40de48cdbc0 SHA512 (FreeBSD-14.0-BETA3-amd64.qcow2.xz) = edb73c6b62077f47df9ca9e98a9813b9850e202099ed41b1fcdad86ef73b1d15aecb93f51cc7a71e3224dd5d57c9c624c8a280161423b4c0f2f270033ec9d48b SHA512 (FreeBSD-14.0-BETA3-amd64.raw.xz) = 796e65a11197f8b8d9da9e0e7ec4c451391807f664a71d6d1c0ba543e7662d157ac03e24d126ccddfc400111994f6f876b98336086c00cba94ab4b459375e3dc SHA512 (FreeBSD-14.0-BETA3-amd64.vhd.xz) = 850436986687f2e25233bf0d4cad34d481e0a0085340b8d8bea0d2aceaeb178e653cd7e853d4e477b1d1f9d83f279c7cd3692aee11f67f9f0e69d2922a6be88e SHA512 (FreeBSD-14.0-BETA3-amd64.vmdk.xz) = 825641822884f9c49547c8ce5c62a599acd170c4c75e3fc7318672a9e039204abe436d5e7d77e6d789e31d5338a0834bf184a69821918219cb5ab9cd6ca0dfcc SHA256 (FreeBSD-14.0-BETA3-amd64-ufs.qcow2.xz) = f03431148cf9b6ab45d33bc4299549f93833f5e0cef54167414a6008dab90c98 SHA256 (FreeBSD-14.0-BETA3-amd64-ufs.raw.xz) = d5f28b5db4be4d2e79d4ec96e7751003199ed1aa8e0beaf3c331edabb335d900 SHA256 (FreeBSD-14.0-BETA3-amd64-ufs.vhd.xz) = ce63a0191664cc644943fbd06e10638087f17d47017a154929ecb19ac9baca82 SHA256 (FreeBSD-14.0-BETA3-amd64-ufs.vmdk.xz) = 4182d564e7599291f165bfd1bf8146f2127e78ce122521e9d1c53d4415c0f38f SHA256 (FreeBSD-14.0-BETA3-amd64-zfs.qcow2.xz) = ac6bddae05fbb2fc7fe82e4dbbe4fc974a544f9fa8b1110346acee694d776554 SHA256 (FreeBSD-14.0-BETA3-amd64-zfs.raw.xz) = 0e8a1eb9753be8b5b2053289593379df42b7638ff331b42943ab843fdcae97a5 SHA256 (FreeBSD-14.0-BETA3-amd64-zfs.vhd.xz) = eb56d8a65404bf0453214c91df365fb75ce9b3c05a677799ec944792ef9b86de SHA256 (FreeBSD-14.0-BETA3-amd64-zfs.vmdk.xz) = f5b4743559dca00a84a50857612bd9c9499210b3378f46912aa84674bb273777 SHA256 (FreeBSD-14.0-BETA3-amd64.qcow2.xz) = f03431148cf9b6ab45d33bc4299549f93833f5e0cef54167414a6008dab90c98 SHA256 (FreeBSD-14.0-BETA3-amd64.raw.xz) = d5f28b5db4be4d2e79d4ec96e7751003199ed1aa8e0beaf3c331edabb335d900 SHA256 (FreeBSD-14.0-BETA3-amd64.vhd.xz) = ce63a0191664cc644943fbd06e10638087f17d47017a154929ecb19ac9baca82 SHA256 (FreeBSD-14.0-BETA3-amd64.vmdk.xz) = 4182d564e7599291f165bfd1bf8146f2127e78ce122521e9d1c53d4415c0f38f o 14.0-BETA3 i386: SHA512 (FreeBSD-14.0-BETA3-i386-ufs.qcow2.xz) = ad1b70ef2b3acdea7bb949afacbd07ff458a40a2d52da7a559abd4faf18a423f11c72e1f127e7cf982d38afb6ecd4470cd0d0bc72f3d0d67364597d5310dc430 SHA512 (FreeBSD-14.0-BETA3-i386-ufs.raw.xz) = 663ea4fae827dc4301e2dbd4499df9c972f2d51e491f7472e798329d9a92cf438683366885873334c24ccd9335f0c2ca8a6d76495b273dec306c80e9c965c264 SHA512 (FreeBSD-14.0-BETA3-i386-ufs.vhd.xz) = 5c0d423c7a8d6cdba03fd8bf62723505782b2e3c762a8f8b2e4a9b1c0646d1ac284c541d0f6388d3e1c547e543b6cb2a66dff0d55444618dd10e1fb35ecae419 SHA512 (FreeBSD-14.0-BETA3-i386-ufs.vmdk.xz) = b92e7a1768e50504da49b88289a20ebf496d84bddeb5794f8cc7a20bbde3ec7b45f966e141b1fe20d679c69bd86550b5d8647ae31f25af4dc39f1753c5ff4317 SHA512 (FreeBSD-14.0-BETA3-i386-zfs.qcow2.xz) = 39aa934e80548070a9cfb699ccf541de186967d6363860affe53d4410a33c96ec5c2a7fe13ffb1587e69b44c53dc2340cbe6ebb5136ce5b1e95f38d47133a1f2 SHA512 (FreeBSD-14.0-BETA3-i386-zfs.raw.xz) = 0d0e45060650030cfad97fb1557b1e7195a83cd4d007b5a48e7a3c1d0322ac9db39e3a2bc58d83aff6bd4b90a95160ae25af63d505aa6e4e9099eebf0b3c5005 SHA512 (FreeBSD-14.0-BETA3-i386-zfs.vhd.xz) = 67266701d7cbee7f6c5dfca15cc0ebf8ed827586f02f42ee146f69d8cf8b8b1c1fd83a11c57a53b8b74aa9aa2aa2c8693514b7b2ac5d57c19ffa20bc2fdf2bdb SHA512 (FreeBSD-14.0-BETA3-i386-zfs.vmdk.xz) = 3c2252d7b804753d0e4c9335906e73e839e3a5b7ac073c19dd5ff7fa9f6020e3568a8fcd3f2d08b88c25407eeb07c8d6abd2b44e22ef8b16b01b535812b2505f SHA512 (FreeBSD-14.0-BETA3-i386.qcow2.xz) = ad1b70ef2b3acdea7bb949afacbd07ff458a40a2d52da7a559abd4faf18a423f11c72e1f127e7cf982d38afb6ecd4470cd0d0bc72f3d0d67364597d5310dc430 SHA512 (FreeBSD-14.0-BETA3-i386.raw.xz) = 663ea4fae827dc4301e2dbd4499df9c972f2d51e491f7472e798329d9a92cf438683366885873334c24ccd9335f0c2ca8a6d76495b273dec306c80e9c965c264 SHA512 (FreeBSD-14.0-BETA3-i386.vhd.xz) = 5c0d423c7a8d6cdba03fd8bf62723505782b2e3c762a8f8b2e4a9b1c0646d1ac284c541d0f6388d3e1c547e543b6cb2a66dff0d55444618dd10e1fb35ecae419 SHA512 (FreeBSD-14.0-BETA3-i386.vmdk.xz) = b92e7a1768e50504da49b88289a20ebf496d84bddeb5794f8cc7a20bbde3ec7b45f966e141b1fe20d679c69bd86550b5d8647ae31f25af4dc39f1753c5ff4317 SHA256 (FreeBSD-14.0-BETA3-i386-ufs.qcow2.xz) = 9e38867524e6b6db263ed574e00e679406bdd12e04046d326e6aa3c15356cb81 SHA256 (FreeBSD-14.0-BETA3-i386-ufs.raw.xz) = d4b864e4f63cac8fb3b07ad279d43ff672c4aafa2d4cf74c93265776ef968927 SHA256 (FreeBSD-14.0-BETA3-i386-ufs.vhd.xz) = ff989d3759675f32704300ed3edd573fd620df085e0ff384b4f2ee273e827f99 SHA256 (FreeBSD-14.0-BETA3-i386-ufs.vmdk.xz) = a0772f1658ea4282ec9be293314c2ebf91eeeae1e8d0351e445985a72240de6f SHA256 (FreeBSD-14.0-BETA3-i386-zfs.qcow2.xz) = 53707b05982ae83c634e22fa7043d424fb960343ae57c50d703af511bb383831 SHA256 (FreeBSD-14.0-BETA3-i386-zfs.raw.xz) = c6111041a915a7f1ca75971b52ae5120a72a6922b8d09b4047b15987ef837582 SHA256 (FreeBSD-14.0-BETA3-i386-zfs.vhd.xz) = a542179fee30c8895233908525e579a79773c53efd48136ff83c78a97de6645b SHA256 (FreeBSD-14.0-BETA3-i386-zfs.vmdk.xz) = 45f7f1a16d6dbbe595b875b27d886869bee38fb47c859a5fbe049448ad94a58d SHA256 (FreeBSD-14.0-BETA3-i386.qcow2.xz) = 9e38867524e6b6db263ed574e00e679406bdd12e04046d326e6aa3c15356cb81 SHA256 (FreeBSD-14.0-BETA3-i386.raw.xz) = d4b864e4f63cac8fb3b07ad279d43ff672c4aafa2d4cf74c93265776ef968927 SHA256 (FreeBSD-14.0-BETA3-i386.vhd.xz) = ff989d3759675f32704300ed3edd573fd620df085e0ff384b4f2ee273e827f99 SHA256 (FreeBSD-14.0-BETA3-i386.vmdk.xz) = a0772f1658ea4282ec9be293314c2ebf91eeeae1e8d0351e445985a72240de6f o 14.0-BETA3 aarch64: SHA512 (FreeBSD-14.0-BETA3-arm64-aarch64-ufs.qcow2.xz) = 586f4959acf1d70b31441de2936546fab99dc0ed9385c07a96f0b628f63169e4a60b2c4ab35104607a6fbc767403cd755efcafa99010c80917234ba40c9fdce8 SHA512 (FreeBSD-14.0-BETA3-arm64-aarch64-ufs.raw.xz) = d460ccbf3cbe2dc8d14226182ebecd8de2a6bb856ce248a08ce9a4daf6175309fe1f415d6891ce9cbd57d91da2de854966f5c20bb3e1f9d0dd6366bd79150315 SHA512 (FreeBSD-14.0-BETA3-arm64-aarch64-ufs.vhd.xz) = b86c0fde674a13784777d672cb0dcc89986f85ad999233ccec729ef26f78101aa422a7604d5da4fc51dfba0b00bd32ada654aefbad9feb6f5ff25ab58aad106c SHA512 (FreeBSD-14.0-BETA3-arm64-aarch64-ufs.vmdk.xz) = f38564140d115e45a991540dc868cef5460d112bfaf7dc4fea9074391252507ddbe107c17c955ccbb0fa5c8d3ae41dd0ed841e10a96cd7114e98892033abad38 SHA512 (FreeBSD-14.0-BETA3-arm64-aarch64-zfs.qcow2.xz) = b88e1aaaf767cd9d7f83edbfe6b6e41374d4b459fb26ebbadd448c585ceab788313cd61ee10bd771d08e1a2f2256807a179d7f875f477f47cfff71a3f8f8afcc SHA512 (FreeBSD-14.0-BETA3-arm64-aarch64-zfs.raw.xz) = e82cf86eb8d22780332e5c0a6a641a3805405981c4bba2f56e59ab98a4786238a94c4c91fe86a4187e58e9fbf69b0e7df6ddca18b4ca0e99757c094e5c643e46 SHA512 (FreeBSD-14.0-BETA3-arm64-aarch64-zfs.vhd.xz) = 1a3f236cb92bbc76e0369a733ddca3a5031cefeab69d70e57d38a61b0f550fe6a6465365f3a840ef139e84608148e8c4253e99925e6f996fe4a08d7b71f0cc5a SHA512 (FreeBSD-14.0-BETA3-arm64-aarch64-zfs.vmdk.xz) = 958fdddc4fb62841f6f280b3644767bd3efd8f94454faf47489846b53aeba9229c287b98027a679045930ed8c4dadd9e40bcfefe99fd81b2529658862aeebad6 SHA512 (FreeBSD-14.0-BETA3-arm64-aarch64.qcow2.xz) = 586f4959acf1d70b31441de2936546fab99dc0ed9385c07a96f0b628f63169e4a60b2c4ab35104607a6fbc767403cd755efcafa99010c80917234ba40c9fdce8 SHA512 (FreeBSD-14.0-BETA3-arm64-aarch64.raw.xz) = d460ccbf3cbe2dc8d14226182ebecd8de2a6bb856ce248a08ce9a4daf6175309fe1f415d6891ce9cbd57d91da2de854966f5c20bb3e1f9d0dd6366bd79150315 SHA512 (FreeBSD-14.0-BETA3-arm64-aarch64.vhd.xz) = b86c0fde674a13784777d672cb0dcc89986f85ad999233ccec729ef26f78101aa422a7604d5da4fc51dfba0b00bd32ada654aefbad9feb6f5ff25ab58aad106c SHA512 (FreeBSD-14.0-BETA3-arm64-aarch64.vmdk.xz) = f38564140d115e45a991540dc868cef5460d112bfaf7dc4fea9074391252507ddbe107c17c955ccbb0fa5c8d3ae41dd0ed841e10a96cd7114e98892033abad38 SHA256 (FreeBSD-14.0-BETA3-arm64-aarch64-ufs.qcow2.xz) = 7d9686e61dc7c1db73d8635ee7d286a26cb14b2c9d3296e20912b6ba60cd307a SHA256 (FreeBSD-14.0-BETA3-arm64-aarch64-ufs.raw.xz) = 439ed508ae517025f0b6935286131e7110f8b0c46efa6172224bb8e6680bfaf9 SHA256 (FreeBSD-14.0-BETA3-arm64-aarch64-ufs.vhd.xz) = 440c27cecc850823fc96dcc3ea68090bcfe413870017f7e00dce26f49e284fdd SHA256 (FreeBSD-14.0-BETA3-arm64-aarch64-ufs.vmdk.xz) = 35e63c88276c1f0f6904d19b6e576bd814f18477bb33b9df7ab940ada7a49e2e SHA256 (FreeBSD-14.0-BETA3-arm64-aarch64-zfs.qcow2.xz) = 74c2a5498024070874696ae07aea3055871fa7dcf2bb129fbcf7a04e7bdb1f4e SHA256 (FreeBSD-14.0-BETA3-arm64-aarch64-zfs.raw.xz) = f15b531716834f494b726ea12debfbc7470d33c6df7de6365b6e736ff4d900b6 SHA256 (FreeBSD-14.0-BETA3-arm64-aarch64-zfs.vhd.xz) = 4293cf19d137dd14dadda98353beabe2ac90922128d198bdb0ccb418bcc21c0f SHA256 (FreeBSD-14.0-BETA3-arm64-aarch64-zfs.vmdk.xz) = 4c20b0196203103344ab7af8440be85028b01b42f2708f37d803f692e9caf815 SHA256 (FreeBSD-14.0-BETA3-arm64-aarch64.qcow2.xz) = 7d9686e61dc7c1db73d8635ee7d286a26cb14b2c9d3296e20912b6ba60cd307a SHA256 (FreeBSD-14.0-BETA3-arm64-aarch64.raw.xz) = 439ed508ae517025f0b6935286131e7110f8b0c46efa6172224bb8e6680bfaf9 SHA256 (FreeBSD-14.0-BETA3-arm64-aarch64.vhd.xz) = 440c27cecc850823fc96dcc3ea68090bcfe413870017f7e00dce26f49e284fdd SHA256 (FreeBSD-14.0-BETA3-arm64-aarch64.vmdk.xz) = 35e63c88276c1f0f6904d19b6e576bd814f18477bb33b9df7ab940ada7a49e2e o 14.0-BETA3 riscv64: SHA512 (FreeBSD-14.0-BETA3-riscv-riscv64-ufs.qcow2.xz) = a278e2c80b1c9aac53dba2627f625f81b0f13dc619553599cefcb9e9d214312e42cce547d02bb1e4e57c129a67364f9d89d48d463fd1a6ce36775eed88b81a79 SHA512 (FreeBSD-14.0-BETA3-riscv-riscv64-ufs.raw.xz) = 14214f29ce25eb4c50edb6bef462ac5acbb5f620140e352ee7807f8b3cf9c1f0a2a87d0b0b03af095a3ec9309c5b2b7d7505a79aa7cdc8a97295927fe86c7486 SHA512 (FreeBSD-14.0-BETA3-riscv-riscv64-ufs.vhd.xz) = 4347b6f238752888577d2957e5c643604d4f0fc323f07f26a496a3deb2c6fae1163b6a3e42c59907f6ea46d083da85fc5c26bab45c5116e44fb5315a99c25427 SHA512 (FreeBSD-14.0-BETA3-riscv-riscv64-ufs.vmdk.xz) = d61b3f610d14feddb729f020c355b02e70dae85a8949bbe9ae9c5d7a68d55d2bfa74ab5e07b6ec9d33613642f8525814211ab7bf429f46330cc2a51c9a40f5b1 SHA512 (FreeBSD-14.0-BETA3-riscv-riscv64-zfs.qcow2.xz) = 2ceb44216d8d6e77d4ebf99a5ed97407d74b2b1e6be528a7181bfdb8f4af1efeb962ea52702fc3cb61a55741308f1951d0448eac65e037485e20879f489c764a SHA512 (FreeBSD-14.0-BETA3-riscv-riscv64-zfs.raw.xz) = 5b3e7319fb14410129c0500d7efbd687da045ba931d849c9cdaf49d217760f5bc84f63820d96d2553eb28097c1846ec9cf389a4bfd0fcbe6f9027c05d819a20c SHA512 (FreeBSD-14.0-BETA3-riscv-riscv64-zfs.vhd.xz) = 779a8bc13989d15bac9bcf8400132aaf687c15243efbb52d674509e8713c020c73379e5a96fe4a08d13108b913d19364242871dd023ca2f5c7a3d934407a8681 SHA512 (FreeBSD-14.0-BETA3-riscv-riscv64-zfs.vmdk.xz) = 58fa1be404a264d681e822e50bd549027ad9e2efa2bdeb113d9551330a081efb20ce7901baf25f1cce453b12f48513298f8bb6f2a89061a05ffb79ca09c01e79 SHA512 (FreeBSD-14.0-BETA3-riscv-riscv64.qcow2.xz) = a278e2c80b1c9aac53dba2627f625f81b0f13dc619553599cefcb9e9d214312e42cce547d02bb1e4e57c129a67364f9d89d48d463fd1a6ce36775eed88b81a79 SHA512 (FreeBSD-14.0-BETA3-riscv-riscv64.raw.xz) = 14214f29ce25eb4c50edb6bef462ac5acbb5f620140e352ee7807f8b3cf9c1f0a2a87d0b0b03af095a3ec9309c5b2b7d7505a79aa7cdc8a97295927fe86c7486 SHA512 (FreeBSD-14.0-BETA3-riscv-riscv64.vhd.xz) = 4347b6f238752888577d2957e5c643604d4f0fc323f07f26a496a3deb2c6fae1163b6a3e42c59907f6ea46d083da85fc5c26bab45c5116e44fb5315a99c25427 SHA512 (FreeBSD-14.0-BETA3-riscv-riscv64.vmdk.xz) = d61b3f610d14feddb729f020c355b02e70dae85a8949bbe9ae9c5d7a68d55d2bfa74ab5e07b6ec9d33613642f8525814211ab7bf429f46330cc2a51c9a40f5b1 SHA256 (FreeBSD-14.0-BETA3-riscv-riscv64-ufs.qcow2.xz) = 6f67ff2985874da38dddd027475fa76bea9b25e528d08aa3659ad438a6ef3d07 SHA256 (FreeBSD-14.0-BETA3-riscv-riscv64-ufs.raw.xz) = 4a632a825aa1de4888e25bf7380bd31c37db423e0434ced00e8df3d476bdf175 SHA256 (FreeBSD-14.0-BETA3-riscv-riscv64-ufs.vhd.xz) = 7d8dccd8681c70faad8f50d3010a442b07e4ab02ae2e68bdd04a0e8103f6713d SHA256 (FreeBSD-14.0-BETA3-riscv-riscv64-ufs.vmdk.xz) = 2c1c9a64963bacaf2b07866dd78de85826a1c802b1f269a984a19060b84dfcc2 SHA256 (FreeBSD-14.0-BETA3-riscv-riscv64-zfs.qcow2.xz) = 172738edb2edf4c5d581a5ec9e7470ac93dbef23f81154d71726667effc1a143 SHA256 (FreeBSD-14.0-BETA3-riscv-riscv64-zfs.raw.xz) = c3b29b2e5071a11d74b8610befaecb4b8082184eeb00136ff43c4eb086667073 SHA256 (FreeBSD-14.0-BETA3-riscv-riscv64-zfs.vhd.xz) = 6eb2a2bc6e731b8483317b8ee581731b8d738f9ad02e33cc370bf0890244f5b2 SHA256 (FreeBSD-14.0-BETA3-riscv-riscv64-zfs.vmdk.xz) = c4c1eff1dd5ac124ceacad21b85b02d1d775bb9443b799b0f6794a333db7415d SHA256 (FreeBSD-14.0-BETA3-riscv-riscv64.qcow2.xz) = 6f67ff2985874da38dddd027475fa76bea9b25e528d08aa3659ad438a6ef3d07 SHA256 (FreeBSD-14.0-BETA3-riscv-riscv64.raw.xz) = 4a632a825aa1de4888e25bf7380bd31c37db423e0434ced00e8df3d476bdf175 SHA256 (FreeBSD-14.0-BETA3-riscv-riscv64.vhd.xz) = 7d8dccd8681c70faad8f50d3010a442b07e4ab02ae2e68bdd04a0e8103f6713d SHA256 (FreeBSD-14.0-BETA3-riscv-riscv64.vmdk.xz) = 2c1c9a64963bacaf2b07866dd78de85826a1c802b1f269a984a19060b84dfcc2 o 14.0-BETA3 amd64 BASIC-CI: SHA512 (FreeBSD-CHECKSUM.SHA256-amd64-BASIC-CI.raw.xz) = 8fcffa262a584d5af3d2ee1380b92bc1b4ae28fbf00ed5b09cb40457c6d68e85300ac9e631a3a62aa16b37349e1361b3d928618a60211b523c54479168ab72c0 SHA256 (FreeBSD-CHECKSUM.SHA256-amd64-BASIC-CI.raw.xz) = d6a1f40bbf0b4fcff146f4c5fc0cab912a4afb57b47532ebd0931b41670fe463 Regards, Glen Please consider donating to help support my FreeBSD work: https://www.gofundme.com/f/gjbbsd https://paypal.me/gjbbsd Love FreeBSD? Support this and future releases with a donation to the FreeBSD Foundation! https://www.freebsdfoundation.org/donate/ -----BEGIN PGP SIGNATURE----- iQIzBAEBCAAdFiEEjRJAPC5sqwhs9k2jAxRYpUeP4pMFAmUOGiAACgkQAxRYpUeP 4pMouA/+Nk0iPykMBsH9nrGDeGBllLbBqlUf8HoK8UdXu/soRaQUySC4QP0h/oLc TSc+H8KxACGrHkjGQs55pNb7Ai5ErNmwgba6LO3sOi28kgH3WL4TxLazs+zRC3g0 ojb13pBBfpxphuhMHQl7/11n3RUunFJRO6yeD+HV3Wkn2bVZpPSStTSvV7n/x4zM DaOI29f7Nd/Y0T04wZjo6wldnObZbwznk8F+fBBHtMeK2KD6Lz1/c7nSyDJnVyg9 7dJ8DWxu1iM+EdvZlUIPntWOzSpTtaP2UOJPoEllkS2DxkIabGmgJ8Ti9nF7z6S0 Q88kn6nU9H8X4FZJ0bDsPXkR/WWGxGfeOuKC1C0e0Nx6XeVYmUX2i2Lcve7d/Ci9 vuobc8BH6/PFNI6wn3NAU6FDnP1+5W4zLazSzhnn2QCE0wMKKlbeCMyGMy7wzC94 s0RmoLMCRKFjRX75BTgHzjQoxX1CAnxGCi54BzOAu9ZVnZMIiPiGYnimC95dHH7e eIGYoS+u+Cc7bJ7WR4XgHv66/4GbfjmNBJub9N23U7LP2gRIm1AEQOVZpZUKOenm ucsbPnUKqEDvnTga4c5T6oYmU0wFe1CV5CnHjbR8+uvAxFucVF7CIVkegk/wbBQF WlAcR39gEiUKemuop2c1Q8jQ4T0lNo0AMu3r82MLnRkW7YH9Gjg= =HK46 -----END PGP SIGNATURE----- From nobody Fri Sep 22 22:55:31 2023 X-Original-To: freebsd-stable@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4Rsnfs4BD0z4tZ3c; Fri, 22 Sep 2023 22:55:33 +0000 (UTC) (envelope-from gjb@freebsd.org) Received: from freefall.freebsd.org (freefall.freebsd.org [96.47.72.132]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "freefall.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4Rsnfs3hQfz3cC5; Fri, 22 Sep 2023 22:55:33 +0000 (UTC) (envelope-from gjb@freebsd.org) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1695423333; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:cc:mime-version:mime-version:content-type:content-type; bh=0Owh38q+UrlItL22tijA+QNAcoSoxq1t8DjvtSCYrrU=; b=Cftn3q15A9+ieSkMPMC6wqCV7geDgtN+5ss/ukSfvvFJPf84lWdj+VW98xocN+P1CxFO3d oRBD/q4HvKOpJ5vsnATU2r5UlNiGlokdZ8fiR5soUPdUt1peaBKc38a6eL1KzIt+VaPCyd miktr96sZKr2Ctd3a7Afst9BZ3FSmjEAPaawBPsEUznEy35sxQfRUFnVymHwk7n9V+gm6C 6CWeTYdzv+u/qhqHgvvPLzQpQA23157G48aY/BeCy8eBG0eiZpsGbMu6CqIgXSXOpTNR9p uDIJa4gmaEcWOOGyGD2ApD/uaVK+MShgCmTj2pFsQeysr89t9y+DZ5/mHhLBfQ== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1695423333; a=rsa-sha256; cv=none; b=tsaCpFBT47wrr8ltmA+34FnfTHERcb85VlB027V5TwIepDXb+hkn3fAtEMbVfyB4s2oB1q kznw7cHjEVm4jX1Z26iBqmwKm6spab7zplXOHYSxu8Nq3Xmuafr/yMcF5SYJOZyefjv8/w 7s5p7zgB+K23+ymMuldWWH76FbIdAhUI79dl8Y1RUBs9wPKhHyDzJK5lOzDAFF3NfpFmcy nwc95ECBeArgAW/tS/Og+ZKscVswPtkUUBKvwN5ayqFUD91M6GUJxNGy85EbLYGsLvzMdQ vef26M8DuGtlMcu6MJQmB+BUQTgEjLmicL+Gmwt3o6rdiB/MrmubVuPSU7vscg== ARC-Authentication-Results: i=1; mx1.freebsd.org; none ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1695423333; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:cc:mime-version:mime-version:content-type:content-type; bh=0Owh38q+UrlItL22tijA+QNAcoSoxq1t8DjvtSCYrrU=; b=TEb2rTHdasJRFHC2rnh2GitaS2CC/6xVoS4Pt+caX4HrImJq1EY3p/o5i9akzoA6O/ZBzz vUaa5iNs6SXz/U+iL7/DgJJvyuFY2fyjn+4FpT8DTqNYEEI4tBCmwvY/wqX3kz77Gngu1Q Ou3KocjDfUkjxGln8Mn5rEzLReRNUZ48z2nNLo1Tg4aiegeuxAb2wXZ8z7I9lGVi/mB0oV nr1XM+tqI4SGEMvdlKCwvUMzjaLHwUSLsjn5wsH9rOanEC7zeB/KZqLjTpVHohjox3CDdo vAOEe84hYqGLlq8VPuhQ1RRvN3ldycIeokVGFYb1nSyf/CETFtUh+LUCWMeOSw== Received: from FreeBSD.org (freefall.freebsd.org [IPv6:2610:1c1:1:6074::16:84]) (using TLSv1 with cipher ECDHE-RSA-AES256-SHA (256/256 bits)) (Client did not present a certificate) by freefall.freebsd.org (Postfix) with ESMTPS id F3F8C84FA; Fri, 22 Sep 2023 22:55:32 +0000 (UTC) (envelope-from gjb@freebsd.org) Date: Fri, 22 Sep 2023 22:55:31 +0000 From: Glen Barber To: freebsd-current@freebsd.org, freebsd-stable@freebsd.org, freebsd-hackers@freebsd.org Cc: FreeBSD Release Engineering Team Subject: Update on 14.0-RELEASE Message-ID: <20230922225531.GT1219@FreeBSD.org> List-Id: Production branch of FreeBSD source code List-Archive: https://lists.freebsd.org/archives/freebsd-stable List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-stable@freebsd.org X-BeenThere: freebsd-stable@freebsd.org MIME-Version: 1.0 Content-Type: multipart/signed; micalg=pgp-sha256; protocol="application/pgp-signature"; boundary="A/2QVx3Okwt4+LIK" Content-Disposition: inline --A/2QVx3Okwt4+LIK Content-Type: text/plain; charset=us-ascii Content-Disposition: inline We will likely need at minimum a fourth BETA build for the 14.0-RELEASE cycle. As was just announced, BETA3 is now available. There are some known outstanding issues: 1) freebsd-update(8) has previously failed to upgrade from 13.x and earlier due to a file name that had been replaced with a directory of the same name. A patch for this is under testing. 2) FreeBSD arm64/aarch64 EC2 AMIs have been failing to build properly, presumably due to lang/rust build failures leading to the ec2-scripts package from being prevented to be available. The last 15.0-CURRENT snapshots seem to have this resolved, so hopefully it is also resolved for what will eventually be the 'release_0' package set for 14.0-RELEASE, but that is still over a week away. 3) There are no "official" FreeBSD base packages available. I have been occupied with external factors preventing me from having cycles available to look into this without interruption, but I think I am going to err on the side of caution and have a manual package set run available via https://download.freebsd.org/ somewhere within the version, architecture, and machine type namespace. 4) Vagrant images fail to upload due to an incorrect target following the addition of ZFS images. This is another issue where I have personally been blocked/blocking progress. 5) The 'ftp-stage' target does not currently account for ZFS virtual machine images. I again have this in my queue. I do not know if I necessarily care too much about this for 14.0-RELEASE, since all virtual machine images are within the 'Latest/' directory namespace for all builds, but I am intent on fixing it. 6) The ZFS-root EC2 AMIs panic a few seconds after booting, apparently due to memory corruption in ZFS. Note regarding (3) above: this is not yet done, but the datasets in which the builds were done are preserved. I hope to have at least a few hours this weekend to try to get binary packages for the FreeBSD base system in place, wherever that ends up being. Glen On behalf of: re --A/2QVx3Okwt4+LIK Content-Type: application/pgp-signature; name="signature.asc" -----BEGIN PGP SIGNATURE----- iQIzBAEBCAAdFiEEjRJAPC5sqwhs9k2jAxRYpUeP4pMFAmUOG2MACgkQAxRYpUeP 4pOPCw/+K8Lod6s+bzgmP08Ata8Ag1VNqpVMhiiMQfhBplChUT3kahJuA9Pbucxq 7w6CEemCJOYm2xeQ7RsesnAl3qvrxOVT9P4/z6zBw737/DMyMy0VgAwNNua9Rn4m iFJrqfohMjPyoiq76N6MM6fN8LzXE8GWo/qAmY/2Z5IA4h78NdUAvT4TieqQl8bB X8exhMMlE0C+C0cA5CXC35urNYsZFDIvrdSF3ps5NORard41md0p+EL8lL/Tsd9N FgtPjeX4fhpuoMaNtXPLSPz2DnMfnzkvvmgC+pQrBJS4CoA7gQ3ibT6x11Ams+gC /qBBwP69i252J7EEHfrpSKOfK9iedMW9x54Ay7MlLUc6n03z8d1dSfptNuTKUBuw RsfCbpCO9HxkyXJGJWQc8Z7dmFhy5l1qYL7djA8B7APQag2kH+BwY+x9lE/Rsk2W Wf9OAFTifMsJKLrYd//HRgRwr9Ldf0zywXIuCqFo8NVwNI7WmcL9rx7avfJ4gqB0 y5GGhK5UaVANe6D4FXqvFa7270T0CL+J51jI7HnY9FmJ3MevhvjRhptr7pcmMpty Lw1HYAcYhTuBEcOWmE00t6syONLfDzlqgbJbIKbOWjm2aBE+GmBcoOW2WckQ7kHr yEpsE5hdrtjSAjWw7EV+5LHwbxpu7Adf16ubodTDCHPPIw4X67U= =967b -----END PGP SIGNATURE----- --A/2QVx3Okwt4+LIK-- From nobody Fri Sep 22 23:16:47 2023 X-Original-To: freebsd-stable@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4RspBj19Vnz4tbY9; Fri, 22 Sep 2023 23:19:41 +0000 (UTC) (envelope-from yasu@FreeBSD.org) Received: from smtp.freebsd.org (smtp.freebsd.org [IPv6:2610:1c1:1:606c::24b:4]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "smtp.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4RspBj0R1Nz3ghm; Fri, 22 Sep 2023 23:19:41 +0000 (UTC) (envelope-from yasu@FreeBSD.org) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1695424781; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=+rTGCyy56tl4mMZTalkRNp/KqeOSarwt9V5mQdVxA1A=; b=YjGKs8lZXT/o+L2JOnkrj0dzQWLIxOJQUSLq3EI5HMMeVYU1Rpjd8fSviQz/FPfDGegD+D 47l6pq9iuBc2hIHI1HaDki5xShh7IP9Hb26H8KjOIqwCWaImNQUoCnKW0OlgpYmQzIVK6z RMb9EAne40/p5/S5VZQZX+Dmk/MkA/INZq4XicAYlgkv8EswGG1yXWfIBe24wq593rwEOE E32M7TL3EAWsp/nX1trPNdgv8RVcu7ioVaUz2dfsVP2BgjL5nPoBaWRAYOpowTgvf8RGDc SZFaM2vv15Ihunvyi+zzvbkpovphrx2hFnahvjN58VUM2AQWj+QWEdw4e3tcRw== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1695424781; a=rsa-sha256; cv=none; b=qmQdxAxVeIC2BQMvpGJR70aZL96YuxnYHmu/FPVHbXP/Ik4K4J5d1NCGPZDRgPXVgBcm5V DCDoCXnp6fHQwGa2h6RU/ZMoY4E5UxIBh067O2rGSYq7+Yhi4RalU9W1DD50IH5QRuLOBM ycnGCNMdVceA84Sdw7YLQV86QbQAKaeSn0D6zugWPBo0gXwAszSoiuKpF3yd1v8YSYmz7v IXeCRKdHLsgDHF8n7iof7VzMm9108/9ksFlLNbGKzOJfiN37664aT9Kms7eDkQ2C3GEHAW QpEXJeWtnoxTCniiojaLSRvXuozb4ktRMNYtV0wSvW6BYdMyeM+ASeMII1dYPA== ARC-Authentication-Results: i=1; mx1.freebsd.org; none ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1695424781; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=+rTGCyy56tl4mMZTalkRNp/KqeOSarwt9V5mQdVxA1A=; b=jg6m95x41kqiZF1+m5gIO8mwJzgoxR+pFYlxU+fOfUmPgWCRBJkoB5J+9wniZFdZN3EVoh at1efUBg5LB0yD+Ns/JX/qJEZrB86I3K3WKFiHNll8uJ7R8eFXMkeBD1NKRWPho6lojRGe PQLkmKvJzdBKhrsa4fwuKHKlvQiRUZET3CqK8F609Oz4w93LEcVZIVD8PXfaoV7b9I0jG5 ZQdJ1LyF5NDI1PoSl0hFhLMio3+1/yAGcRjBgKkorlIsx1g2WmZ2N1nAa7r62m98JbSE8t 7UNfKFwS8YLUqvvmjVs1+A/IJqGLU+GlS5GznSd1qnxbfgbHo/3QxGpdsr9QoQ== Received: from localhost (unknown [IPv6:240b:11:220:fe00::174:11]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits)) (Client did not present a certificate) (Authenticated sender: yasu/mail) by smtp.freebsd.org (Postfix) with ESMTPSA id 4RspBg5bxGz132r; Fri, 22 Sep 2023 23:19:39 +0000 (UTC) (envelope-from yasu@FreeBSD.org) Date: Sat, 23 Sep 2023 08:16:47 +0900 (JST) Message-Id: <20230923.081647.116419710205124654.yasu@FreeBSD.org> To: gjb@freebsd.org Cc: freebsd-current@freebsd.org, freebsd-stable@freebsd.org, re@freebsd.org Subject: Re: FreeBSD 14.0-BETA3 Now Available From: Yasuhiro Kimura In-Reply-To: <20230922225008.GQ4090@FreeBSD.org> References: <20230922225008.GQ4090@FreeBSD.org> X-Mailer: Mew version 6.9 on Emacs 30.0.50 List-Id: Production branch of FreeBSD source code List-Archive: https://lists.freebsd.org/archives/freebsd-stable List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-stable@freebsd.org X-BeenThere: freebsd-stable@freebsd.org Mime-Version: 1.0 Content-Type: Text/Plain; charset=us-ascii Content-Transfer-Encoding: 7bit From: Glen Barber Subject: FreeBSD 14.0-BETA3 Now Available Date: Fri, 22 Sep 2023 22:50:08 +0000 > The third BETA build of the 14.0-RELEASE release cycle is now available. I tried to update from 14.0-BETA2 to 14.0-BETA3 with freebsd-update(8) but it fails as following. root@rolling-vm-freebsd4[180]# uname -a FreeBSD rolling-vm-freebsd4.home.utahime.org 14.0-BETA2 FreeBSD 14.0-BETA2 #0 releng/14.0-n265096-dfd44f2f0143: Fri Sep 15 05:46:35 UTC 2023 root@releng1.nyi.freebsd.org:/usr/obj/usr/src/amd64.amd64/sys/GENERIC amd64 root@rolling-vm-freebsd4[181]# freebsd-update -r 14.0-BETA3 upgrade Looking up update.FreeBSD.org mirrors... 2 mirrors found. Fetching metadata signature for 14.0-BETA2 from update1.freebsd.org... done. Fetching metadata index... done. Inspecting system... done. The following components of FreeBSD seem to be installed: kernel/generic world/base world/lib32 The following components of FreeBSD do not seem to be installed: Does this look reasonable (y/n)? y Fetching metadata signature for 14.0-BETA3 from update1.freebsd.org... failed. Fetching metadata signature for 14.0-BETA3 from update2.freebsd.org... failed. No mirrors remaining, giving up. This may be because upgrading from this platform (amd64) or release (14.0-BETA3) is unsupported by freebsd-update. Only platforms with Tier 1 support can be upgraded by freebsd-update. See https://www.freebsd.org/platforms/ for more info. If unsupported, FreeBSD must be upgraded by source. root@rolling-vm-freebsd4[182]# What is wrong? --- Yasuhiro Kimura From nobody Fri Sep 22 23:32:53 2023 X-Original-To: freebsd-stable@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4RspV0394yz4tcJd; Fri, 22 Sep 2023 23:32:56 +0000 (UTC) (envelope-from gjb@freebsd.org) Received: from freefall.freebsd.org (freefall.freebsd.org [96.47.72.132]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "freefall.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4RspV02cB9z4Gdq; Fri, 22 Sep 2023 23:32:56 +0000 (UTC) (envelope-from gjb@freebsd.org) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1695425576; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:cc:mime-version:mime-version:content-type:content-type: in-reply-to:in-reply-to:references:references; bh=l4sedsQDqHz9oEduk2jaNGgrWQTjGUT50AWkc8SXQrs=; b=E8TYxBLPAm4RBmPf3zF1F0k/yUQHqBAYmv04hI/UnncsPziRR6+/vyZCJZu7BKxs8bBCto Dp9oZHgX1XvYVCljBRNUnsijHrNVejuaOUyMNTRUgQOSiGIcMQ+ngtrcnKorQCNAkEG8Fu MaNgTyR6jnXTBjVV2UFkR+pPbu6h1qMWSAD/EjCJKsgIA0s5bxnSLbHyrq12mV81OEGqca iKDFPcct6dOaoHq1AQAlHlgAx2BZ0XSYPIlSgv7kesLvzM/igkSj4LavxhTBT/E+fo4NSy HjVk9Q/hPom2Ku+Jg5GkhValmDYbpaPti4de0gLY/IryCYbOybMHVCs+yI7O7g== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1695425576; a=rsa-sha256; cv=none; b=w1Mtc2olhLpvv644cNWijuEDcHgBMd1PewG3EK+VsoioU1zPBNd0e92Rs/ZSo7PmKUWDBg u4Z+ZOHQRglP2V7TyRsDtCBK4wRXHY7KZfbiRM8KHR12p9vlGCXhylsU9brBVJTTbhYT5t irrmFC1SdmAdPcMugy0trx7usqpPRSSOBoTyVZ/F+c04o3R4QZ9kBh1pK47EYADAG79DBH DbyjTTuJ27wojLNCSMfcesWTBJ6od6+v31W3l4uqFg3rEZ6H+JOWoa8zprRtA563VGZY3d IR7j7eulmV7CkYNn6W/MPoDC/4lP3yv1s4qylwrOO0oFcbbXaiTkEjYZfKgmKg== ARC-Authentication-Results: i=1; mx1.freebsd.org; none ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1695425576; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:cc:mime-version:mime-version:content-type:content-type: in-reply-to:in-reply-to:references:references; bh=l4sedsQDqHz9oEduk2jaNGgrWQTjGUT50AWkc8SXQrs=; b=urkUuFg6dwnZXYwCk7TxTo1fcPXMf8eR2QaiEsGjhYxJ5t8h5Gyh0hdzvbKLxF0yLk4fvE kRbIxSiX7a4KgJa1R5isjUa0nO60FRbDZccpt14nz2X+Gsqr4mOMNGz2U0dUGDu+iguf6x o3YtCiHs7D+RERX/9ozKXegSdDh/rIqYOpRRkwHUYgV9fWeX2zv0d2YofIT+swmasLKDov 16ZRp6TNMjMG7kHsKVb2c57xyQJNrjE3RHefXk1IXvkPTVQLMo4wd3LnWXL/Mv6HjlIiUe 9dd2gac5X0n4wxTxU3O0LBri6aJybASAGH/XwcvtcCBFvvNkZhBosnlhNRwFMQ== Received: from FreeBSD.org (freefall.freebsd.org [IPv6:2610:1c1:1:6074::16:84]) (using TLSv1 with cipher ECDHE-RSA-AES256-SHA (256/256 bits)) (Client did not present a certificate) by freefall.freebsd.org (Postfix) with ESMTPS id EB93987AD; Fri, 22 Sep 2023 23:32:55 +0000 (UTC) (envelope-from gjb@freebsd.org) Date: Fri, 22 Sep 2023 23:32:53 +0000 From: Glen Barber To: Yasuhiro Kimura Cc: freebsd-current@freebsd.org, freebsd-stable@freebsd.org, re@freebsd.org Subject: Re: FreeBSD 14.0-BETA3 Now Available Message-ID: <20230922233253.GI52318@FreeBSD.org> References: <20230922225008.GQ4090@FreeBSD.org> <20230923.081647.116419710205124654.yasu@FreeBSD.org> List-Id: Production branch of FreeBSD source code List-Archive: https://lists.freebsd.org/archives/freebsd-stable List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-stable@freebsd.org X-BeenThere: freebsd-stable@freebsd.org MIME-Version: 1.0 Content-Type: multipart/signed; micalg=pgp-sha256; protocol="application/pgp-signature"; boundary="MoMqJSZefcPDZlII" Content-Disposition: inline In-Reply-To: <20230923.081647.116419710205124654.yasu@FreeBSD.org> --MoMqJSZefcPDZlII Content-Type: text/plain; charset=us-ascii Content-Disposition: inline Content-Transfer-Encoding: quoted-printable On Sat, Sep 23, 2023 at 08:16:47AM +0900, Yasuhiro Kimura wrote: > I tried to update from 14.0-BETA2 to 14.0-BETA3 with freebsd-update(8) > but it fails as following. >=20 [...] -------------------------- begin quoted text --------------------------- =3D=3D=3D Upgrading =3D=3D=3D Due to a known delay, freebsd-update(8) binary update builds are not yet ready for BETA3. A separate email will be sent once they are available. --------------------------- end quoted text ---------------------------- Glen --MoMqJSZefcPDZlII Content-Type: application/pgp-signature; name="signature.asc" -----BEGIN PGP SIGNATURE----- iQIzBAEBCAAdFiEEjRJAPC5sqwhs9k2jAxRYpUeP4pMFAmUOJCUACgkQAxRYpUeP 4pPaQw//exKjF2s3EVk6umxFB1+wXfm6hYbtLpAbFWt7uULPeK2CBUzEpwmCUVI/ 9tIRNaD+689h+5xtf7Qmcbqu+tveFfqtHzQeXm5bugeY+60bHn5y8XkFjfiJJ7D5 u62Fwxv2B/i5V4NQ4PBM2ApwFPzWNQ5Q8rKHZJAORzI5JjilfJ7sxtFbEktnI8x/ gVLgPu3U9HV3MQ//rdr4YoZoy5o9NWTWx75lR2S4TVi8GBJd0hCxSFDfRXw/13M2 ZCbqzDJuSvKwF2PuWbX2U5kMiYKRP1YWaNvh09pPlH0vozf3nISoDtID0x1Xmfgm dtwO6J0WdzAMkwRn9AVnVVgTTQKTdF1P6DyMMP2/cmQ2xwW0QIShHIe/Lk+pGP50 SVKQ9O350iy2jlXrkZgTAJrOsynvQO1k/M6v9apmNnASAu25H7UvxpkDo1yZlBx/ UsRq5ek92ubTHGQZLrXj5Af1arjxPq0xmO+y3CUgb8CBngO/H49TvWJc62E2Dj3v JdX1GuRqY21uvENIyvYsyK0C9CPP8lW7Bi0khzOKD3C0+sUygUBQSP149fd6SNFb /w2xgA6AFQcIDN/K6CZemd+8MNHsp2wp48LEqAkKNWLAMhQJjfECkh0ZOQaW/BZ9 ST1eJD3A6RRyBO58br6+KFv2SSpQz9cGzW57mYjl0spnJ1+HaVo= =et3g -----END PGP SIGNATURE----- --MoMqJSZefcPDZlII-- From nobody Fri Sep 22 23:51:37 2023 X-Original-To: freebsd-stable@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4Rspvs6F50z4tfch; Fri, 22 Sep 2023 23:51:53 +0000 (UTC) (envelope-from yasu@FreeBSD.org) Received: from smtp.freebsd.org (smtp.freebsd.org [IPv6:2610:1c1:1:606c::24b:4]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "smtp.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4Rspvs4hNMz4fqf; Fri, 22 Sep 2023 23:51:53 +0000 (UTC) (envelope-from yasu@FreeBSD.org) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1695426713; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=LBQEM6orPcN8jJxR6jjkd28+ttQ6VDlXFGr5U4DCAfQ=; b=HLuygDwpRgI+OdHFQm60eMd7FYRlk5MsTHb19PXzH7ZQCzRdENlnv79N+lrQDKp9cGH7m+ 3ZX0JpNEStCDtoIZe/kc/lWjXAcK5jPAo86u3qfnlm5Jx0PQhp0zZlDFgYAOXlx6Lh9icq jfe8iXTwOne3Rnr8tYm4S/4nAYu0kcfw7UtbCfcXMwBBLxkwvA0Nbe6SKdV5NzEUrGJyIq gB14X5RRlrgb0IxC925J+pXjCDEy+lOJD2lw90l5VnLnh5vGFwH5iLFvDNs1v665X6x9Yl ozdPB2FEXZdc9YVDKxMfl5v/0ZDv0oF+SoWtooyAJEAdnHPIr2AQDGmdFTvd5A== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1695426713; a=rsa-sha256; cv=none; b=gkiWswlYzTI1YItC0b9xKePMrnQ7rY9wsXed8CpxmYaSeqOO44qHAZWdlzIcHv+lD1DLy5 C3HfRoOhBuTVEcCjKc9QqB/DCLKELW/3CAdTFjN7wZq6J+PVB8dyDVwLGvF5wIafdS/+uX 3Vyac1Bihc/L86IeBcAnkbOkD1MisG07SfJK1ljA6/KKcnJ4UeSA1EOauJBA9yJN47N87x MndKSCsKpt/4jbZ2OZEhoZQw3lBuJP3qpUfYmYNFvtHEUGajdiEjnPVp98ZN2lZc4si/yQ 2mvjcFkbGWYZDZLVFXXnDnUH0K3dZAaTx8MmuEmj46k5t3QdzmLtD66bm4SgPA== ARC-Authentication-Results: i=1; mx1.freebsd.org; none ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1695426713; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=LBQEM6orPcN8jJxR6jjkd28+ttQ6VDlXFGr5U4DCAfQ=; b=cR19LyOi0uqIrk0kt6eYE4NfkHxV3zCv1FOIOvLG1ZLEhnj30GLjIeNcB+Mmv24IFkd76e xnpjWIJJ5WiOLI5a5nOLTRB4o3q554TYKgDb6VdYT7NoyN5ALTZ1bRUTV09lu4SY5HyWqV w2eaypCNB7UtCqOC/Xnxwmggzub4oNZbcWs80QH5Bjxlsvhs10ABJqgc70FalgHiAUaDZB S0Xgv80n164dIV2U/Bqn4/pytT/B32GkSPUw+oXRIU0YaEDLLRsjHNHHkGqLcygUikUB8y JNuSXuuF0IyFTMHLp9nRVOZUfuThqIDpV2ZXH9CZ4i39697FgNy0SaiPDSOUdA== Received: from localhost (unknown [IPv6:240b:11:220:fe00::174:11]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) (Authenticated sender: yasu/mail) by smtp.freebsd.org (Postfix) with ESMTPSA id 4Rspvr2tkYz12v9; Fri, 22 Sep 2023 23:51:52 +0000 (UTC) (envelope-from yasu@FreeBSD.org) Date: Sat, 23 Sep 2023 08:51:37 +0900 (JST) Message-Id: <20230923.085137.1788040230669865191.yasu@FreeBSD.org> To: gjb@freebsd.org Cc: freebsd-current@freebsd.org, freebsd-stable@freebsd.org, re@freebsd.org Subject: Re: FreeBSD 14.0-BETA3 Now Available From: Yasuhiro Kimura In-Reply-To: <20230922233253.GI52318@FreeBSD.org> References: <20230922225008.GQ4090@FreeBSD.org> <20230923.081647.116419710205124654.yasu@FreeBSD.org> <20230922233253.GI52318@FreeBSD.org> X-Mailer: Mew version 6.9 on Emacs 30.0.50 List-Id: Production branch of FreeBSD source code List-Archive: https://lists.freebsd.org/archives/freebsd-stable List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-stable@freebsd.org X-BeenThere: freebsd-stable@freebsd.org Mime-Version: 1.0 Content-Type: Text/Plain; charset=us-ascii Content-Transfer-Encoding: 7bit From: Glen Barber Subject: Re: FreeBSD 14.0-BETA3 Now Available Date: Fri, 22 Sep 2023 23:32:53 +0000 > On Sat, Sep 23, 2023 at 08:16:47AM +0900, Yasuhiro Kimura wrote: >> I tried to update from 14.0-BETA2 to 14.0-BETA3 with freebsd-update(8) >> but it fails as following. >> > [...] > > -------------------------- begin quoted text --------------------------- > === Upgrading === > > Due to a known delay, freebsd-update(8) binary update builds are not yet > ready for BETA3. A separate email will be sent once they are available. > --------------------------- end quoted text ---------------------------- > > Glen > Oops, I should have read more carefully. Anyway thanks for quick reply. --- Yasuhiro Kimura From nobody Sat Sep 23 05:45:35 2023 X-Original-To: freebsd-stable@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4Rsym14jnPz4v5SS; Sat, 23 Sep 2023 05:45:37 +0000 (UTC) (envelope-from gjb@freebsd.org) Received: from freefall.freebsd.org (freefall.freebsd.org [IPv6:2610:1c1:1:6074::16:84]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "freefall.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4Rsym13sSlz4BMp; Sat, 23 Sep 2023 05:45:37 +0000 (UTC) (envelope-from gjb@freebsd.org) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1695447937; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:cc:mime-version:mime-version:content-type:content-type: in-reply-to:in-reply-to:references:references; bh=bVHqOCgI6d9uu/VTouLbxJWC2DHy/XczAWAhxb+wP84=; b=PpHa6ARkIGGUUzmfqp8YgaEp7lWPRBh13bK1eks3xG2X18Br10uwiN6R7mvfmGwtI24qmu GAZA08lWBI2QCEcJ3Yi17dEu+tNbQDSmHh92puwg5ASzO/trn3MNE3Z/4C+rSjsYz8fe55 wQeQtwP4dqxLvPu6Ex6AV/muRUc2pE5OhhumY8gg/LQ0VkJeEabGOWoIM5MiwVqy+wuAcB LWsu1a66lesmUgKMBULRGyILWujrH2mq1goyigGD9V+xjPc9Dj2Qe6wTWdc9olsldcgnX1 foWLCmS9QleVlJyJD/vrPwC6sJIgTxLDzjKjmC6gBoQXeYybHGP4utiwWt1CFA== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1695447937; a=rsa-sha256; cv=none; b=lPD/aDRPGaT+RLNvCre4I30WVYx0I1sedvLQop8qb7gUX/A1TCAkDA5OH89460PDablrT1 6ZzzNRDkIB3LH2HVmhhTOO05cKtcxgv5FbQ0y2ocj5/DDhVK4xVYBBYoiq7lDgLpqQPD5c Tta9Iy5CpnnWh5/aHH828opj1tKH6NRKxmMjATxqqw9sb7NCUTWTLalKL7Or48t3YP+3WN BiejumvYIG1+3b53k8xUCaNsIlXQocRuRT6JEEetEZXgmCInU7d9bfUCQESGwgQamYuTHP SfC+9azcVnPNvKCpLTHT6oWjTPj2FfC9npuyd31Z6K14PefTeMdoo/11OIk1cw== ARC-Authentication-Results: i=1; mx1.freebsd.org; none ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1695447937; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:cc:mime-version:mime-version:content-type:content-type: in-reply-to:in-reply-to:references:references; bh=bVHqOCgI6d9uu/VTouLbxJWC2DHy/XczAWAhxb+wP84=; b=EHKg9fhKZHkFJ9dpTD1rCfYDEpuKRCwp764YlqwdRzFC0LIGqAZPRfeB8DlB/U3pMQhJDJ OMrqE76hvsEkYXNjLwke8IBuGVm/CfR+WMohHb7FCZFKg+r5qXGnIG5mv//Qd1IGsq1Zyk Bi1TYT0xH428OphjL/IMeY/Sr1TOImE15DgmxuYWiKW+Hjk5Qz12P/WfPv7ITOK6/xzkRS HxPI+bc6La8g4mbo3+FcFkwEcrId1XGwmxO4Vul0qgSlasYZ5vJPCPWkT88FNRyi60NOE4 FmsQKgfSzWASEr5KK8izS1U9JiaQZc64a5qftt9V5hBkuGB4hUbWfOFfNFzLTg== Received: from FreeBSD.org (freefall.freebsd.org [IPv6:2610:1c1:1:6074::16:84]) (using TLSv1 with cipher ECDHE-RSA-AES256-SHA (256/256 bits)) (Client did not present a certificate) by freefall.freebsd.org (Postfix) with ESMTPS id 3206FB9A3; Sat, 23 Sep 2023 05:45:37 +0000 (UTC) (envelope-from gjb@freebsd.org) Date: Sat, 23 Sep 2023 05:45:35 +0000 From: Glen Barber To: freebsd-current@freebsd.org, freebsd-stable@freebsd.org Cc: FreeBSD Release Engineering Team Subject: [UPDATE] FreeBSD 14.0-BETA3 Now Available Message-ID: <20230923054535.GJ52318@FreeBSD.org> References: <20230922225008.GQ4090@FreeBSD.org> List-Id: Production branch of FreeBSD source code List-Archive: https://lists.freebsd.org/archives/freebsd-stable List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-stable@freebsd.org X-BeenThere: freebsd-stable@freebsd.org MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii; x-action=pgp-signed In-Reply-To: <20230922225008.GQ4090@FreeBSD.org> -----BEGIN PGP SIGNED MESSAGE----- Hash: SHA256 On Fri, Sep 22, 2023 at 10:50:08PM +0000, Glen Barber wrote: > === Upgrading === > > Due to a known delay, freebsd-update(8) binary update builds are not yet > ready for BETA3. A separate email will be sent once they are available. > Binary updates via freebsd-update(8) are now available for systems already running 14.0-BETA. Note, releases from 13.2 and earlier are still problematic due to a file name being replaced with a directory of the same name. A patch is being tested currently, and we hope to have this resolved for 14.0-BETA4. === Upgrading === The freebsd-update(8) utility supports binary upgrades of amd64, i386, and aarch64 systems running earlier FreeBSD releases. Systems running earlier FreeBSD releases can upgrade as follows: # freebsd-update upgrade -r 14.0-BETA3 During this process, freebsd-update(8) may ask the user to help by merging some configuration files or by confirming that the automatically performed merging was done correctly. # freebsd-update install The system must be rebooted with the newly installed kernel before continuing. # shutdown -r now After rebooting, freebsd-update needs to be run again to install the new userland components: # freebsd-update install It is recommended to rebuild and install all applications if possible, especially if upgrading from an earlier FreeBSD release, for example, FreeBSD 12.x. Alternatively, the user can install misc/compat12x and other compatibility libraries, afterwards the system must be rebooted into the new userland: # shutdown -r now Finally, after rebooting, freebsd-update needs to be run again to remove stale files: # freebsd-update install Regards, Glen Please consider donating to help support my FreeBSD work: https://www.gofundme.com/f/gjbbsd https://paypal.me/gjbbsd Love FreeBSD? Support this and future releases with a donation to the FreeBSD Foundation! https://www.freebsdfoundation.org/donate/ -----BEGIN PGP SIGNATURE----- iQIzBAEBCAAdFiEEjRJAPC5sqwhs9k2jAxRYpUeP4pMFAmUOe38ACgkQAxRYpUeP 4pO5xA//Zeg5TAYEhXYdEj7Nk3S46dmq7FgRcgns7wAyQlnNEA31fHCmG0B/aSg4 Ronzr4ed14KX7HUdbd5tsWmIleILH1dLJkmx/wlFOe4uzLC0Nm3zHEwrgn4w6GYj 4hZ67O7Pw/tUYDF57hYYrXWk0zYX90JJZ7nHc4o9f/i/kIIYI6o6MRKZjpuK+lmD eGFgC22s/GR8iR4QC2I++SMDsKSpdOTAqkUo/oOmPPciWqfS8bYfg83i1IDXOmIk VAOBPJ8yJpc6q3EgXFrCRDhFENPLdKG5qT85LinS1z8OS2AppPZ5kixUn2XRI0/Z Nu+UVGEd9zX47wHqtsgjW4vjruHoTRKjFaDh3zJ8tLuX+Q8ZcPidA8JfRQmbqk+R RHW/7gT8j4Nso9fosx0JrQCa3TJG7l7worGG89TtHvWTxPjACtyiE2ocIzDrEj4P 1OQfNPvUQ0fFjm3Di16fwVm8VIGlHq8M2eQho+4n25DvpwVOqiaFrXVdampm4Y2V SnzLqczkR7dK4//sw5+OPK28aIFdaA443Xx6iiuD7DFYrCtxDVx7YDQXbcFdNoMA QuuoV4kRrr+ZrieWX5OWBuzBeLuY9h6Xm0xxkKw42+gdZlU5Uvc0mSMstb7DdEqR l0iMzOAIn2yF8a9Xvo8m+7vWXnODjrcyItNQCl5UVs9sujzu2lg= =qYkR -----END PGP SIGNATURE----- From nobody Sat Sep 23 11:33:33 2023 X-Original-To: freebsd-stable@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4Rt6TX4xfjz4tWLf; Sat, 23 Sep 2023 11:33:36 +0000 (UTC) (envelope-from pi@freebsd.org) Received: from fc.opsec.eu (fc.opsec.eu [IPv6:2001:14f8:200:4::4]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4Rt6TX3HS6z3JMJ; Sat, 23 Sep 2023 11:33:36 +0000 (UTC) (envelope-from pi@freebsd.org) Authentication-Results: mx1.freebsd.org; none Received: from pi by fc.opsec.eu with local (Exim 4.96 (FreeBSD)) (envelope-from ) id 1qk0tC-000BDY-00; Sat, 23 Sep 2023 13:33:34 +0200 Date: Sat, 23 Sep 2023 13:33:33 +0200 From: Kurt Jaeger To: Glen Barber Cc: freebsd-current@freebsd.org, freebsd-stable@freebsd.org, FreeBSD Release Engineering Team Subject: Re: [UPDATE] FreeBSD 14.0-BETA3 Now Available Message-ID: References: <20230922225008.GQ4090@FreeBSD.org> <20230923054535.GJ52318@FreeBSD.org> List-Id: Production branch of FreeBSD source code List-Archive: https://lists.freebsd.org/archives/freebsd-stable List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-stable@freebsd.org X-BeenThere: freebsd-stable@freebsd.org MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: <20230923054535.GJ52318@FreeBSD.org> X-Spamd-Bar: ---- X-Rspamd-Pre-Result: action=no action; module=replies; Message is reply to one we originated X-Spamd-Result: default: False [-4.00 / 15.00]; REPLY(-4.00)[]; ASN(0.00)[asn:12502, ipnet:2001:14f8::/32, country:DE] X-Rspamd-Queue-Id: 4Rt6TX3HS6z3JMJ Hi! > On Fri, Sep 22, 2023 at 10:50:08PM +0000, Glen Barber wrote: > > === Upgrading === > > > > Due to a known delay, freebsd-update(8) binary update builds are not yet > > ready for BETA3. A separate email will be sent once they are available. > > > > Binary updates via freebsd-update(8) are now available for systems > already running 14.0-BETA. If I try to update my poudriere 14.0-BETA2 jail with this command: poudriere jail -u -j 140 -t 14.0-BETA3 it fails, see here: https://people.freebsd.org/~pi/logs/pou-fail.txt (short, only 1550 bytes) I have: 140 14.0-BETA2 amd64 http 2023-09-16 08:20:01 /pou/jails/140 with /usr/local/bin/poudriere installed by package poudriere-devel-3.3.99.20220831 -- pi@FreeBSD.org +49 171 3101372 Now what ? From nobody Sat Sep 23 12:11:31 2023 X-Original-To: freebsd-stable@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4Rt7KY50QLz4tYlv; Sat, 23 Sep 2023 12:11:45 +0000 (UTC) (envelope-from eduardo@freebsd.org) Received: from smtp.freebsd.org (smtp.freebsd.org [IPv6:2610:1c1:1:606c::24b:4]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "smtp.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4Rt7KY4Gsdz3Q7N; Sat, 23 Sep 2023 12:11:45 +0000 (UTC) (envelope-from eduardo@freebsd.org) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1695471105; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:cc:mime-version:mime-version:content-type:content-type: in-reply-to:in-reply-to:references:references; bh=1fU5Lr2Poo0BbOgE2dnEZW/7u/xVvV560PXqOw/xKSE=; b=qpKrZ7nT+rIjxld8fdjSLvQX1bEVMMaMxUowlaJrlBS65twpLcL/XxVEPMDkNYwWo0be0O kaqZwhGO+WkTPCVtweIqELAhrsj+70zoJRJLFV9Day+6eoicRH+N+koWdytSJeiHbHiIDu WP1U6dFpHfTJizIbsl95QTzuYVLISmv63vmKtQpb2mtxGSaBOKnoAdvaI5UXYPv+cEz47j 9JUNRknQYVlr1GPCxbS4FZo1heQ20Nq/loY7LLUXiW5bzcsv83Q8xjNsoWK9oSY+IX+iRK YbAXgrwZbCXct4WoUbbb73UvcXRLwKTcsax3GBJi2VAiWZdLBgzH+3qpRpDoaA== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1695471105; a=rsa-sha256; cv=none; b=DXQGYRQJQcV2DyfD0ShH7Zi6aKCVmkIDEeXKMuxZym2dsIHelZaR40ju1+13lMY0Tgai/l WMbHz9+eIriXnJcep4HTMH/YblieuxwpRkH4gH8DwqAGpO1eL1Pc/+1/+FQ5SrU41LEZQ0 3kGq8nciOElXQH0RcClSEsn7d9IIGzJ124dvzV3emda9OhH85bLhhdEq8QyV9yiB31m/QF l9zodAAJjCN3yGwdvxW8Ld45DOnGCzZxFLhsfcCRQQzsDAXciJbNjzr1EalRn8k4glQtIA GIMCMk8eDmlSI0XpjqyDp+JgVJrn2Jesum87oGXFQJ/mrQ5qb7ui5pUfui9mmA== ARC-Authentication-Results: i=1; mx1.freebsd.org; none ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1695471105; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:cc:mime-version:mime-version:content-type:content-type: in-reply-to:in-reply-to:references:references; bh=1fU5Lr2Poo0BbOgE2dnEZW/7u/xVvV560PXqOw/xKSE=; b=TLSdiTAmxPlj9ylHdigGeqPzDCMqxezv7fktz8Wv3dF8diix9Nk0o9B1SEfj4GpqZw6X0n b2NAeoTtIBjOJxkv20CQkdra6LTYthjZu1HvTFdqM+HhzJnw4TMQrEsPWmtCJFGeLZmf9b GJ94YIgWaLz4zKYeQhZVDpRroAAEWe+JhBpvdNu2d2jndfep1k5sCU0e9KmbGiSVten9+N NuAqKDNyo58F/YQQbnqqaicfMnjN4RNpNelsyBXL6SW0so9Kkyv8WR2iPJUkejcztGb2Vv Mt2fLBwFhJSFmnGf31h5hNxNPmpOa2Vrct3opN7l1a5h09KLyK3kjb0Z0eRZXw== Received: from mail-qt1-f177.google.com (mail-qt1-f177.google.com [209.85.160.177]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "GTS CA 1D4" (verified OK)) (Authenticated sender: eduardo) by smtp.freebsd.org (Postfix) with ESMTPSA id 4Rt7KY3KBpz1Gr7; Sat, 23 Sep 2023 12:11:45 +0000 (UTC) (envelope-from eduardo@freebsd.org) Received: by mail-qt1-f177.google.com with SMTP id d75a77b69052e-418025bf4d6so8873871cf.1; Sat, 23 Sep 2023 05:11:45 -0700 (PDT) X-Gm-Message-State: AOJu0YzJO4+IYI+yiGSdoSMrURczzQlMqEVdin//4/tp98a/jNUKiHSj pMhC4ie+guJpZRxeUaWlA3aGg/zytu2xSLsMzE0= X-Google-Smtp-Source: AGHT+IFKIUSYd20Ky0DA/NDwOclQ6Ev1vRLbWewRsufcFYTbufZqOsLBydirHIYOvcMTjs7Bx1TrdY2GN0lZg35hgGY= X-Received: by 2002:a05:622a:14c:b0:412:2911:7e16 with SMTP id v12-20020a05622a014c00b0041229117e16mr2229438qtw.24.1695471104399; Sat, 23 Sep 2023 05:11:44 -0700 (PDT) List-Id: Production branch of FreeBSD source code List-Archive: https://lists.freebsd.org/archives/freebsd-stable List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-stable@freebsd.org X-BeenThere: freebsd-stable@freebsd.org MIME-Version: 1.0 References: <20230922225008.GQ4090@FreeBSD.org> <20230923054535.GJ52318@FreeBSD.org> In-Reply-To: From: Nuno Teixeira Date: Sat, 23 Sep 2023 13:11:31 +0100 X-Gmail-Original-Message-ID: Message-ID: Subject: Re: [UPDATE] FreeBSD 14.0-BETA3 Now Available To: Kurt Jaeger Cc: Glen Barber , freebsd-current@freebsd.org, freebsd-stable@freebsd.org, FreeBSD Release Engineering Team Content-Type: multipart/alternative; boundary="000000000000e7a0f2060605a086" --000000000000e7a0f2060605a086 Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable Same error but it seems that upgrade completed and pkgs cleaned: --- =3D>> Building lang/rust build started at Sat Sep 23 12:26:01 WEST 2023 port directory: /usr/ports/lang/rust package name: rust-1.72.0 building for: FreeBSD 140amd64-main-job-02 14.0-BETA3 FreeBSD 14.0-BETA3 amd64 maintained by: rust@FreeBSD.org Makefile datestamp: -rw-r--r-- 1 1001 1001 11640 Sep 9 08:02 /usr/ports/lang/rust/Makefile Poudriere version: poudriere-git-3.3.99.20220831 Host OSVERSION: 1500001 Jail OSVERSION: 1400097 Job Id: 02 --- Kurt Jaeger escreveu no dia s=C3=A1bado, 23/09/2023 =C3=A0= (s) 12:33: > Hi! > > > On Fri, Sep 22, 2023 at 10:50:08PM +0000, Glen Barber wrote: > > > =3D=3D=3D Upgrading =3D=3D=3D > > > > > > Due to a known delay, freebsd-update(8) binary update builds are not > yet > > > ready for BETA3. A separate email will be sent once they are > available. > > > > > > > Binary updates via freebsd-update(8) are now available for systems > > already running 14.0-BETA. > > If I try to update my poudriere 14.0-BETA2 jail with this command: > > poudriere jail -u -j 140 -t 14.0-BETA3 > > it fails, see here: > > https://people.freebsd.org/~pi/logs/pou-fail.txt > (short, only 1550 bytes) > > I have: > > 140 14.0-BETA2 amd64 http 2023-09-16 08:20:01 /pou/jails/140 > > with > > /usr/local/bin/poudriere installed by package > poudriere-devel-3.3.99.20220831 > > -- > pi@FreeBSD.org +49 171 3101372 Now what ? > > --=20 Nuno Teixeira FreeBSD Committer (ports) --000000000000e7a0f2060605a086 Content-Type: text/html; charset="UTF-8" Content-Transfer-Encoding: quoted-printable
Same error but it seems that upgrade completed and pk= gs cleaned:
---
=3D>> Building lang/rust
build= started at Sat Sep 23 12:26:01 WEST 2023
port directory: /usr/ports/lan= g/rust
package name: rust-1.72.0
building for: FreeBSD 140amd64-main-= job-02 14.0-BETA3 FreeBSD 14.0-BETA3 amd64
maintained by: rust@FreeBSD.o= rg
Makefile datestamp: -rw-r--r-- =C2=A01 1001 1001 11640 Sep =C2=A09 08= :02 /usr/ports/lang/rust/Makefile
Poudriere version: poudriere-git-3.3.9= 9.20220831
Host OSVERSION: 1500001
Jail OSVERSION: 1400097
Job Id:= 02
---

Kurt Jaeger <pi@freebsd.org> escreveu no dia s=C3=A1bado, 23/09/2023 =C3=A0(s) = 12:33:
Hi!

> On Fri, Sep 22, 2023 at 10:50:08PM +0000, Glen Barber wrote:
> > =3D=3D=3D Upgrading =3D=3D=3D
> >
> > Due to a known delay, freebsd-update(8) binary update builds are = not yet
> > ready for BETA3.=C2=A0 A separate email will be sent once they ar= e available.
> >
>
> Binary updates via freebsd-update(8) are now available for systems
> already running 14.0-BETA.

If I try to update my poudriere 14.0-BETA2 jail with this command:

poudriere jail -u -j 140 -t 14.0-BETA3

it fails, see here:

https://people.freebsd.org/~pi/logs/pou-fail.txt=
(short, only 1550 bytes)

I have:

140=C2=A0 =C2=A014.0-BETA2=C2=A0 =C2=A0 =C2=A0 amd64 http=C2=A0 =C2=A0 2023= -09-16 08:20:01 /pou/jails/140

with

/usr/local/bin/poudriere installed by package poudriere-devel-3.3.99.202208= 31

--
pi@FreeBSD.org=C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0+49 171 3101372=C2=A0 =C2= =A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 Now what ?



--
Nuno Teixeira
FreeBSD Committ= er (ports)
--000000000000e7a0f2060605a086-- From nobody Sat Sep 23 13:18:44 2023 X-Original-To: freebsd-stable@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4Rt8pv3KPxz4tfYL for ; Sat, 23 Sep 2023 13:18:47 +0000 (UTC) (envelope-from shoesoft@gmx.net) Received: from mout.gmx.net (mout.gmx.net [212.227.15.15]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange ECDHE (P-256) server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "mout.gmx.net", Issuer "Telekom Security ServerID OV Class 2 CA" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4Rt8pt3rtQz3ZgR for ; Sat, 23 Sep 2023 13:18:46 +0000 (UTC) (envelope-from shoesoft@gmx.net) Authentication-Results: mx1.freebsd.org; dkim=pass header.d=gmx.net header.s=s31663417 header.b=IWL80Gga; spf=pass (mx1.freebsd.org: domain of shoesoft@gmx.net designates 212.227.15.15 as permitted sender) smtp.mailfrom=shoesoft@gmx.net; dmarc=pass (policy=none) header.from=gmx.net DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/simple; d=gmx.net; s=s31663417; t=1695475125; x=1696079925; i=shoesoft@gmx.net; bh=ck6XnKwk5Zpy542JfXKXhoCWTCViqQF2e1mlGrPv+GA=; h=X-UI-Sender-Class:From:To:Subject:Date; b=IWL80GgahsbD8X/aFwl2sAMd1OfAJ6n8aT/mPSv0HjRzY+N8GEjQRfZh6veUBgqkNN2P/nxDDj1 5/B0ns94Bmij4N1rh21ybIRwE5JcG8PoT//uX15r7Mtij2IOQBk5KsmbhXeJqgvSSP2KPPCWT0D2g rMxOXYztz6bAtiwFfqTiBtoU+FMTsvCkoTJayWs7B7oPZ6Jbvh6Tvx9jfsorKlMHnU+JqE/RwOhVg VN/dpMxZuSPb41aTg/arXdiMWiVx9kPPf20+cDa8hSc7UMfhyxH4mcsOvzo5QxBlOvs4vtaA4tfsj plTkCeGXnLI7n2N/6csPlrU/9zkmRLYKTNZQ== X-UI-Sender-Class: 724b4f7f-cbec-4199-ad4e-598c01a50d3a Received: from walrus.pepperland ([81.217.72.171]) by mail.gmx.net (mrgmx005 [212.227.17.190]) with ESMTPSA (Nemesis) id 1N2mFi-1rg6Dw3twS-0138g4 for ; Sat, 23 Sep 2023 15:18:44 +0200 From: Stefan Ehmann To: freebsd-stable@freebsd.org Subject: nvd compatibility links and geli Date: Sat, 23 Sep 2023 15:18:44 +0200 Message-ID: <99750134.ESjDGNxrJy@walrus.pepperland> List-Id: Production branch of FreeBSD source code List-Archive: https://lists.freebsd.org/archives/freebsd-stable List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-stable@freebsd.org X-BeenThere: freebsd-stable@freebsd.org MIME-Version: 1.0 Content-Transfer-Encoding: quoted-printable Content-Type: text/plain; charset="us-ascii" X-Provags-ID: V03:K1:2Ag60uzYwFZeaMX8InuzmvIvRouINK2PgOZeCYC5MM69+kBzqhD Wzy5gIK1hgtVcURKkLtVvVAKLI1ZlVRXgCW2PFzwmNl1UT/J8hUmPg9LqE/o2bJHOzOSwiL VBjWV/soqUMjtNKREvHO31sFuSbUdpaDq3Le9w6SULrMXtgk/9SY9bWkYRlzHde9KDLgkHA 8ntkHjhjBHwrSiOA8it+g== X-Spam-Flag: NO UI-OutboundReport: notjunk:1;M01:P0:jQZPB4emlw8=;KnnoVzM+knRdK9VQvENeuhPhGEO 0m4AB7WMVJ2C+R+mEVO9THSB0wQmkOOfzhFHV2NtGGxNb6f9yb249eFsxt1QssV2eWb6ERMeU HF6OQ2o6RiZL4krVyIGi3TgpXbf93hS2XhubPJ4lD7o4EamWya9/Qecq7Ndr53VcFR3yWhFmh /v4IRX6oXCgAazg2hIuGAxzXumYdYkZAVYhEyDxX7oXOXPk7oyHb1Q88EuGXjIDRAvSLOf1AT Sx/Z+ezab9AFafOw9++hDfcdyNcCJcImbIQWO2djkzuE0R9d5ijuuWBZiKegn7pRG3msf0d9p i630Yz5/C7qnC39DA2nhl49e8HoJ2rDC5TPCxP1YXEP7ns5jUEQ0bfKVhuD/6G/k63Ji4JBGt 6jKlyZIUnoarVtlgaF1a2SAQ0FlTUWh1z3fVtv5IcB1KWHStL/0RxWYi89vq2PYxYLx1eyP2b pJODpWlQsDBp6Y7QE6+BHXS003pWWkb1B2w0ZdlfgWj3KKxIxY7z6IYZlpCj5vO5/twN7mdwR ERj3fXq3pWIrR/W8gfaKR6gnwsc+JF4lae/r6Knk1a7k3/4qRLpv9URUuS87wWlRU0WwkPdL5 OClWATmxRgoqnxZhlc8A77cPMvv9iQ2Si8JTmIUTUhwis6u3uLjqxQJdNaRA2FlLJhJmcwAYx UiqnconVandkh7rSAuPtULZbGzvhiVsrhDCwrXhYJarbYReZs/tFXJLXFS8c3Y4frkBv4+GLG tUi7ztTxuTDwn8TOX09JzYVsJAnntgjiVXvPgl47dLTnio3D6i8s1qtqRFNyX4/3eazXX2FZH 1FqWdbzanmrdL2jCAsNWvMhlsnOjDVzxjGkTGpTxE/AzKcxsOkt69GZYm06MyLG+WV0eR4MUO gzehvoXI7zhlOmjnW61FtynAgPB1KFa2qrunvmUyAVq9e/c4bgh9TFclMjRX6zIAX4g3GRpMQ JdTmzw== X-Spamd-Bar: ----- X-Spamd-Result: default: False [-5.13 / 15.00]; DWL_DNSWL_LOW(-1.00)[gmx.net:dkim]; NEURAL_HAM_LONG(-1.00)[-1.000]; NEURAL_HAM_SHORT(-0.99)[-0.993]; NEURAL_HAM_MEDIUM(-0.94)[-0.941]; DMARC_POLICY_ALLOW(-0.50)[gmx.net,none]; R_DKIM_ALLOW(-0.20)[gmx.net:s=s31663417]; R_SPF_ALLOW(-0.20)[+ip4:212.227.15.0/25]; RWL_MAILSPIKE_VERYGOOD(-0.20)[212.227.15.15:from]; MIME_GOOD(-0.10)[text/plain]; ONCE_RECEIVED(0.10)[]; RCVD_IN_DNSWL_LOW(-0.10)[212.227.15.15:from]; MLMMJ_DEST(0.00)[freebsd-stable@freebsd.org]; RCPT_COUNT_ONE(0.00)[1]; FROM_HAS_DN(0.00)[]; TO_MATCH_ENVRCPT_ALL(0.00)[]; PREVIOUSLY_DELIVERED(0.00)[freebsd-stable@freebsd.org]; RCVD_VIA_SMTP_AUTH(0.00)[]; ASN(0.00)[asn:8560, ipnet:212.227.0.0/16, country:DE]; DKIM_TRACE(0.00)[gmx.net:+]; TO_DN_NONE(0.00)[]; FREEMAIL_FROM(0.00)[gmx.net]; ARC_NA(0.00)[]; RCVD_COUNT_ONE(0.00)[1]; MIME_TRACE(0.00)[0:+]; FROM_EQ_ENVFROM(0.00)[]; FREEMAIL_ENVFROM(0.00)[gmx.net]; RCVD_TLS_ALL(0.00)[] X-Rspamd-Queue-Id: 4Rt8pt3rtQz3ZgR The 20230612 entry in UPDATING says: Encrypted swap partitions need to be changed from nvd to nda if yo= u migrate, or you need to use the above to switch back to nvd. Are encrypted (non-swap) partitions supposed to work? If not, it would be = less confusing to directly abort with an error message instead of prompting "En= ter passphrase: " first. # ls -l /dev/nvd0p4 lrwxr-xr-x 1 root wheel 6 Sep 23 14:59 /dev/nvd0p4 -> nda0p4 # geli attach nvd0p4 Enter passphrase: geli: Provider not found: "nvd0p4" geli: There was an error with at least one provider. Using nda works as expected: # geli attach nda0p4 # Enter passphrase: Tested on 14.0-BETA3. From nobody Sat Sep 23 14:45:36 2023 X-Original-To: freebsd-stable@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4RtBlL05wdz4tm4H for ; Sat, 23 Sep 2023 14:45:50 +0000 (UTC) (envelope-from wlosh@bsdimp.com) Received: from mail-ed1-x536.google.com (mail-ed1-x536.google.com [IPv6:2a00:1450:4864:20::536]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "GTS CA 1D4" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4RtBlK5Vj2z4Db7 for ; Sat, 23 Sep 2023 14:45:49 +0000 (UTC) (envelope-from wlosh@bsdimp.com) Authentication-Results: mx1.freebsd.org; none Received: by mail-ed1-x536.google.com with SMTP id 4fb4d7f45d1cf-533cbbd0153so811484a12.0 for ; Sat, 23 Sep 2023 07:45:49 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=bsdimp-com.20230601.gappssmtp.com; s=20230601; t=1695480348; x=1696085148; darn=freebsd.org; h=cc:to:subject:message-id:date:from:in-reply-to:references :mime-version:from:to:cc:subject:date:message-id:reply-to; bh=IieSq3p251lvXPhkEApbDSgJxCvlnUejjAVz84VpuHE=; b=Z97/O5P/1YtKf07vfe/OB8Th5uRzIEKNLPjSlUEXmy9A3SAa1cxgb/84khFg+R6T74 8tbf7y+h4HkxECa5RzqSAbaSRh21hsDKD1dNKqhthyDJ7EMOt5gL6vokqxzOGi+0jTld zfkkuOUuCv5CwSReiUfd9YFrZkcogMMprjrcaJtt4hUb2WZMlxelA9HSnw2jiTANGyrk tJ4xnw2KggCmZ/pX9rHbuM5A7sggO0ic9IVDvWaOnor2cqtMA8w1ZooPkaiI44bjUCKh JBokdF8mZNd2YHPVLh9ZuDDbk+Zff5InL5MWBMKnVFDj65lmx0iosnMqzMaKUmnyX+rZ u/pA== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20230601; t=1695480348; x=1696085148; h=cc:to:subject:message-id:date:from:in-reply-to:references :mime-version:x-gm-message-state:from:to:cc:subject:date:message-id :reply-to; bh=IieSq3p251lvXPhkEApbDSgJxCvlnUejjAVz84VpuHE=; b=sr7BtLLXxwXM3kdXBS8CJJnWzu3l0ssWUrXfigGYsWv8P4JU1zEw5p+gZeyKhPMLnY PVAHx4l5Od2ibBnCMG81Dgj7mtNCB2b2UCr4k7PKibta6Kk1ifH8RNy56DRgkc7Rn986 O4PkylR0+JWCD0Y2s3fVghZ+04geUjHcqsbsJLX601OTO6/GE0xu//VgBK5Zi4XKmHEG D2CYv+uHkd3nMZpS916zDPC4NLLX20Nh9x5IhHMwuvt+Oeh0OM+QKBlkbsN/Ezl3ffVN E7+GYusYB71upOeSLJi1RHIeSZGlqxaWgcAqkEnte4LkxbLTbqe/xxxFy1i2IGCcium+ A81Q== X-Gm-Message-State: AOJu0YyBuL4f8s+qYbMC0JSDiNZ8NxvMS8enY4Rfqa0gh0wVW8U3bo6h mdLL7PsCp5s69ULc+zPc+LfeqFtBsu41eS+nLy0X7g== X-Google-Smtp-Source: AGHT+IGX8R8lW0+ML8trK/q1TgZ74/wyECLj3uZX+lFXGDwBufl1f+3Sg2tl2+3Z+3p1mD+P+/sw+WyL5MUPnE0phsU= X-Received: by 2002:aa7:c98b:0:b0:530:74ed:fc85 with SMTP id c11-20020aa7c98b000000b0053074edfc85mr1840114edt.3.1695480348065; Sat, 23 Sep 2023 07:45:48 -0700 (PDT) List-Id: Production branch of FreeBSD source code List-Archive: https://lists.freebsd.org/archives/freebsd-stable List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-stable@freebsd.org X-BeenThere: freebsd-stable@freebsd.org MIME-Version: 1.0 References: <99750134.ESjDGNxrJy@walrus.pepperland> In-Reply-To: <99750134.ESjDGNxrJy@walrus.pepperland> From: Warner Losh Date: Sat, 23 Sep 2023 08:45:36 -0600 Message-ID: Subject: Re: nvd compatibility links and geli To: Stefan Ehmann Cc: FreeBSD-STABLE Mailing List Content-Type: multipart/alternative; boundary="000000000000ded6f9060607c7c1" X-Spamd-Bar: ---- X-Rspamd-Pre-Result: action=no action; module=replies; Message is reply to one we originated X-Spamd-Result: default: False [-4.00 / 15.00]; REPLY(-4.00)[]; ASN(0.00)[asn:15169, ipnet:2a00:1450::/32, country:US] X-Rspamd-Queue-Id: 4RtBlK5Vj2z4Db7 --000000000000ded6f9060607c7c1 Content-Type: text/plain; charset="UTF-8" On Sat, Sep 23, 2023, 7:19 AM Stefan Ehmann wrote: > The 20230612 entry in UPDATING says: > > Encrypted swap partitions need to be changed from nvd to nda if you > migrate, or you need to use the above to switch back to nvd. > > Are encrypted (non-swap) partitions supposed to work? If not, it would be > less > confusing to directly abort with an error message instead of prompting > "Enter > passphrase: " first. > > # ls -l /dev/nvd0p4 > lrwxr-xr-x 1 root wheel 6 Sep 23 14:59 /dev/nvd0p4 -> nda0p4 > # geli attach nvd0p4 > Enter passphrase: > geli: Provider not found: "nvd0p4" > geli: There was an error with at least one provider. > > Using nda works as expected: > # geli attach nda0p4 > # Enter passphrase: > > > Tested on 14.0-BETA3. > They do not work due to obscure issues with geom and how I implemented the compat code. You will either need to set the sysctl in the updating entry to switch back to nvd. Or you'll need to change the config to use the new name. Geom doesn't provide a nice centralized place to deal with all the name stuff, so my compat code was just at the most popular places. I missed a few... How hard is it for you to adapt? Warner > --000000000000ded6f9060607c7c1 Content-Type: text/html; charset="UTF-8" Content-Transfer-Encoding: quoted-printable


On Sat, Sep 23, 2023, 7:19 AM Stefan Ehmann <shoesoft@gmx.net> wrote:
The 20230612 entry in UPDATING says:

=C2=A0 =C2=A0 =C2=A0 =C2=A0 Encrypted swap partitions need to be changed fr= om nvd to nda if you
=C2=A0 =C2=A0 =C2=A0 =C2=A0 migrate, or you need to use the above to switch= back to nvd.

Are encrypted (non-swap) partitions supposed to work? If not, it would be l= ess
confusing to directly abort with an error message instead of prompting &quo= t;Enter
passphrase: " first.

# ls -l /dev/nvd0p4
lrwxr-xr-x=C2=A0 1 root wheel 6 Sep 23 14:59 /dev/nvd0p4 -> nda0p4
# geli attach nvd0p4
Enter passphrase:
geli: Provider not found: "nvd0p4"
geli: There was an error with at least one provider.

Using nda works as expected:
# geli attach nda0p4
# Enter passphrase:
<no error>

Tested on 14.0-BETA3.

They do not work due to obscure issues with geom and h= ow I implemented the compat code. You will either need to set the sysctl in= the updating entry to switch back to nvd. Or you'll need to change the= config to use the new name.

Geom doesn't provide a nice centralized place to deal with all the= name stuff, so my compat code was just at the most popular places. I misse= d a few...

How hard is i= t for you to adapt?

Warn= er
--000000000000ded6f9060607c7c1-- From nobody Sat Sep 23 15:43:04 2023 X-Original-To: freebsd-stable@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4RtD1S40Zdz4tqYp for ; Sat, 23 Sep 2023 15:43:08 +0000 (UTC) (envelope-from shoesoft@gmx.net) Received: from mout.gmx.net (mout.gmx.net [212.227.15.15]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange ECDHE (P-256) server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "mout.gmx.net", Issuer "Telekom Security ServerID OV Class 2 CA" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4RtD1R6h6Wz4Khj for ; Sat, 23 Sep 2023 15:43:07 +0000 (UTC) (envelope-from shoesoft@gmx.net) Authentication-Results: mx1.freebsd.org; none DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/simple; d=gmx.net; s=s31663417; t=1695483785; x=1696088585; i=shoesoft@gmx.net; bh=CWl4PjWTeQ7NvP7XQtTGYR4MH/ZsHQBD15PaPee8pXk=; h=X-UI-Sender-Class:From:To:Cc:Subject:Date:In-Reply-To:References; b=EFIuLvKg1LsLr0coA9H/6uleGx4slGMoyIWj++oOky8OOMqmxAYKKGQzhEgyONg9N36SvBlQsKI Zu1UrnII8JH1r12uVPiiw+3i2VXLt7kULtVm+55BtBNqs70br9hMLTvVsPn3vMqpjGmbmDhZCmKYM p4je+OCkbHKGsmLB8ZiWVcToFDosz4TwSnLLUpI7PX4hFsfX9VhD82G4WJJFDKcbiIcqW+xpe0X8M 8B4U03Jx2Y4wURr8XfknBwtAvSV4obs1bDB2yk8WdUKyckth7xiuxmgwv1qKeGZ4phumCtOHjIiKL mtPznp/RNRJM1bnaPhcuOZBl88UVQve3K3LQ== X-UI-Sender-Class: 724b4f7f-cbec-4199-ad4e-598c01a50d3a Received: from walrus.pepperland ([81.217.72.171]) by mail.gmx.net (mrgmx004 [212.227.17.190]) with ESMTPSA (Nemesis) id 1MDQeK-1qrFnT2Qic-00AZfW; Sat, 23 Sep 2023 17:43:05 +0200 From: Stefan Ehmann To: Warner Losh Cc: FreeBSD-STABLE Mailing List Subject: Re: nvd compatibility links and geli Date: Sat, 23 Sep 2023 17:43:04 +0200 Message-ID: <6137184.BczB8pWqXV@walrus.pepperland> In-Reply-To: References: <99750134.ESjDGNxrJy@walrus.pepperland> List-Id: Production branch of FreeBSD source code List-Archive: https://lists.freebsd.org/archives/freebsd-stable List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-stable@freebsd.org X-BeenThere: freebsd-stable@freebsd.org MIME-Version: 1.0 Content-Transfer-Encoding: quoted-printable Content-Type: text/plain; charset="us-ascii" X-Provags-ID: V03:K1:1fJwEi2WjPBYzAp7hn3Ei7WFP5jqsczvSBsFT77w5gesF1NoE/E btFdnjHfiOftN101knAgdfJ8xgHCtjBVtCCNZpwcU34hbW38WlobRAFAO8VI4c5pzD0GleI 7w/RnEBpF6XadzfdIlyjJaTJYPP3+eTZvrLaxmvgGi+VLPhMtJz67w4FB+rmIhDRxtgEZG4 hFUcObfGIXCoMWCHMZDsQ== X-Spam-Flag: NO UI-OutboundReport: notjunk:1;M01:P0:WaY6u85nA3E=;GVVRuM6dtc/4gSsuhs6AgrWnyg3 UtIDWoHvCRMA4Mx1O17ERhxrojG4n3HPDSFqfG50t/vw9aWhJ4jGf7XVylzlfCGXesO/27U3b PpLyLhjlN6bOGFdnCDxYl7zOUujP288VjaZm0ZoiqlF0QUsAqbCDsILQx7j57zGOTnhzZcP5m 2gCsq6rWxJHNSqQ1MGn39udh1tCUISsuyjfCuZAwF9ZncnWp7HnYLPhwomv6WetOsviUTyawL r3kQHEIcvtJjuDSeJk6Mzu/4E3qzYsOGZY/m0IAHPble/3wVR23abHlOoUDMCSnFJRhiEh+pk bSzTX9buuGBuAWH2BsSo+vXMgOgDL9K8wNRo6rlltOnpOc6B5XP/NKzCIx3bpnO6F+LX8HJCi 5KQZ9XZdC4xg92ZdZeGBEvggYq7SR9q+wMgLlXH7zoTWKU1q0OLYd+9aWNxx0Nnv0VtYFtcjP jjTIbWLQmlAJYbgc3Fy9boFNdPtRhceFf4j/BXo014VOKC3OjdAx6h+e4ark+sxdeDWbBXjMN 7wuiWHq64veARRAAFv+QdX0qgrcDMfTMbf/b7l/WqDJgODDVmDqCP3vD7qgMJa2AVlkDEkTH9 rp48cTg+OY8uqWFxEIY3K7yqYpF19e0akmWQ9Zf87K6EfWdm/kma46m9aOl28tipwcFjSTVOd wgE0MShv2wtqoYJriNkcKygPgIbyKfanPMl/7Ja0MtKrCUrtGp//lNDQV8tv301bpF/dn6y5/ pUaBcpJYuZmOPHEBUxx2nAvNyIk56K+Sg4LGec54mC4h81rq7P4GVJk3i4Xs1hqUz2PF9ztHp EJKIAP3Tkrhnkq8K041WPDcR2117SyCgEvoCqhsqqdxhrXHLYCNl7QvwyurTJYUJXejd4JyxM 4QpTeubzHtuPt9q57O6DRFmQaYAXm6S6UK5HGxw6o+1EBPhg6X+Kv5yTdvhSuQou7vkJYpYqi Fb6q3F10D0d5WRKStOJBCI88uZ8= X-Spamd-Bar: ---- X-Rspamd-Pre-Result: action=no action; module=replies; Message is reply to one we originated X-Spamd-Result: default: False [-4.00 / 15.00]; REPLY(-4.00)[]; ASN(0.00)[asn:8560, ipnet:212.227.0.0/16, country:DE] X-Rspamd-Queue-Id: 4RtD1R6h6Wz4Khj On Saturday, September 23, 2023 4:45:36 PM CEST Warner Losh wrote: > On Sat, Sep 23, 2023, 7:19 AM Stefan Ehmann wrote: > > The 20230612 entry in UPDATING says: > > Encrypted swap partitions need to be changed from nvd to nda i= f > > you > > migrate, or you need to use the above to switch back to nvd. > > > > Are encrypted (non-swap) partitions supposed to work? If not, it would= be > > less > > confusing to directly abort with an error message instead of prompting > > "Enter > > passphrase: " first. > > > > # ls -l /dev/nvd0p4 > > lrwxr-xr-x 1 root wheel 6 Sep 23 14:59 /dev/nvd0p4 -> nda0p4 > > # geli attach nvd0p4 > > Enter passphrase: > > geli: Provider not found: "nvd0p4" > > geli: There was an error with at least one provider. > > > > Using nda works as expected: > > # geli attach nda0p4 > > # Enter passphrase: > > > > > > Tested on 14.0-BETA3. > > They do not work due to obscure issues with geom and how I implemented t= he > compat code. You will either need to set the sysctl in the updating entr= y > to switch back to nvd. Or you'll need to change the config to use the ne= w > name. > > Geom doesn't provide a nice centralized place to deal with all the name > stuff, so my compat code was just at the most popular places. I missed a > few... > > How hard is it for you to adapt? Thanks for the explanation. It's no issue for me. I'll just set kern.cam.nda.nvd_compat=3D0 to avoid accessing nvd devices out of habit. Maybe we should drop the "swap" from "Encrypted swap partitions" in UPDATI= NG? From nobody Sat Sep 23 16:31:40 2023 X-Original-To: freebsd-stable@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4RtF5j0rzYz4tvH6 for ; Sat, 23 Sep 2023 16:31:53 +0000 (UTC) (envelope-from frank@harz2023.behrens.de) Received: from post.behrens.de (post.behrens.de [IPv6:2a01:170:1023::1:2]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "post.behrens.de", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4RtF5g4MRBz4Vfn for ; Sat, 23 Sep 2023 16:31:51 +0000 (UTC) (envelope-from frank@harz2023.behrens.de) Authentication-Results: mx1.freebsd.org; dkim=pass header.d=harz2023.behrens.de header.s=pinky2 header.b=B+Iom+9g; spf=pass (mx1.freebsd.org: domain of frank@harz2023.behrens.de designates 2a01:170:1023::1:2 as permitted sender) smtp.mailfrom=frank@harz2023.behrens.de; dmarc=none DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d= harz2023.behrens.de; h=message-id:date:mime-version:to:from :subject:content-type:content-transfer-encoding; s=pinky2; bh=jb /cEueKfostOEbZIdAoWrQYzzC21AKBmYGhSdYAkmM=; b=B+Iom+9g1yRNM28QL3 Y+y9EdOP+9LJQZxy/nZH/hyaRaaEDbrtjvOYThEKzgW1vipaVN9Ln9hn33CZCAbI GePMdd4/wiAC5LVqV/zjvcPJaHcCvcbu6YoP87/AnDAHfsUpQYP7mLwAM5/n0pkg sgVQalLF3oowzRQsakpiQL/Qs= Received: from [IPV6:fdfb:1999:428:bb80:3db4:e508:5137:9b17] ([IPv6:fdfb:1999:428:bb80:3db4:e508:5137:9b17]) (authenticated bits=0) by post.behrens.de (8.17.1/8.17.1) with ESMTPSA(MSP) id 38NGVfUB062092 (version=TLSv1.3 cipher=TLS_AES_256_GCM_SHA384 bits=256 verify=NO cn=) for ; Sat, 23 Sep 2023 18:31:41 +0200 (CEST) (envelope-from frank@harz2023.behrens.de) Message-ID: <1b6190d1-1d42-6c99-bef6-c6b77edd386a@harz2023.behrens.de> Date: Sat, 23 Sep 2023 18:31:40 +0200 List-Id: Production branch of FreeBSD source code List-Archive: https://lists.freebsd.org/archives/freebsd-stable List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-stable@freebsd.org X-BeenThere: freebsd-stable@freebsd.org MIME-Version: 1.0 User-Agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64; rv:102.0) Gecko/20100101 Thunderbird/102.15.1 To: freebsd-stable@freebsd.org Content-Language: de-DE, en-GB From: Frank Behrens Subject: nvd->nda switch and blocksize changes for ZFS Content-Type: text/plain; charset=UTF-8; format=flowed Content-Transfer-Encoding: 8bit X-Spamd-Bar: --- X-Spamd-Result: default: False [-3.39 / 15.00]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; NEURAL_HAM_LONG(-1.00)[-1.000]; NEURAL_HAM_SHORT(-0.99)[-0.995]; R_DKIM_ALLOW(-0.20)[harz2023.behrens.de:s=pinky2]; R_SPF_ALLOW(-0.20)[+mx]; MIME_GOOD(-0.10)[text/plain]; ONCE_RECEIVED(0.10)[]; FROM_HAS_DN(0.00)[]; FROM_EQ_ENVFROM(0.00)[]; RCVD_COUNT_ONE(0.00)[1]; MLMMJ_DEST(0.00)[freebsd-stable@freebsd.org]; MIME_TRACE(0.00)[0:+]; RCVD_TLS_ALL(0.00)[]; ASN(0.00)[asn:8820, ipnet:2a01:170:1000::/36, country:DE]; TO_MATCH_ENVRCPT_ALL(0.00)[]; ARC_NA(0.00)[]; DMARC_NA(0.00)[behrens.de]; TO_DN_NONE(0.00)[]; DKIM_TRACE(0.00)[harz2023.behrens.de:+]; PREVIOUSLY_DELIVERED(0.00)[freebsd-stable@freebsd.org]; MID_RHS_MATCH_FROM(0.00)[]; RCPT_COUNT_ONE(0.00)[1]; RCVD_VIA_SMTP_AUTH(0.00)[] X-Rspamd-Queue-Id: 4RtF5g4MRBz4Vfn Hi, I created a zpool with a FreeBSD-14.0-CURRENT on February. With 15.0-CURRENT/14.0-STABLE from now I get the message: status: One or more devices are configured to use a non-native block size.         Expect reduced performance. action: Replace affected devices with devices that support the         configured block size, or migrate data to a properly configured         pool.         NAME        STATE     READ WRITE CKSUM         zsys        ONLINE       0     0     0           raidz1-0  ONLINE       0     0     0             nda0p4  ONLINE       0     0     0  block size: 4096B configured, 16384B native             nda1p4  ONLINE       0     0     0  block size: 4096B configured, 16384B native             nda2p4  ONLINE       0     0     0  block size: 4096B configured, 16384B native I use: nda0: nda0: nvme version 1.4 nda0: 953869MB (1953525168 512 byte sectors) I cannot imagine, that the native blocksize changed. Do I really expect a reduced performance? Is it advisable to switch back to nvd? Kind regards,    Frank -- Frank Behrens Osterwieck, Germany From nobody Sat Sep 23 18:12:35 2023 X-Original-To: freebsd-stable@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4RtHL83PZfz4v2hl for ; Sat, 23 Sep 2023 18:12:48 +0000 (UTC) (envelope-from dim@FreeBSD.org) Received: from smtp.freebsd.org (smtp.freebsd.org [96.47.72.83]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "smtp.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4RtHL82v6hz4hCG; Sat, 23 Sep 2023 18:12:48 +0000 (UTC) (envelope-from dim@FreeBSD.org) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1695492768; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:cc:mime-version:mime-version:content-type:content-type: in-reply-to:in-reply-to:references:references; bh=ntH8Ya63M6HqM3IzOOjRLWz7+HXwottz4alwsfi/K9A=; b=CteHZElAxLRuRSBcOGoEkHq29j58sXI1pw+6ElQeqbpA7i148eKTAz+fhxarxWz6uFOaj3 YmBPe3psEOY2gQnOEB96VgP05/rxZ7YAVGyF3cR3siEIri+D4mGoOp5Xb9wOgMjuiBrWDr 8uvDvm16zXFIQCVpHyduLDSe5mrvFMHzb+7S8Dxqs7jlnSYAJNw5UMdZsKvRVtzIXK0t3y zloeXzSNt7q28anUbbLftDv4ZIvh4iBD0cF2LUUWgkuZFuRad4M6ZQHZHZgWHsurqbCzfw cnGodr0QPkMvqJ9zP/cKKDrlIg3ktnu2z9dVzj/bLJi+wRWT+ON8bNKfZTzZSQ== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1695492768; a=rsa-sha256; cv=none; b=lCYhn5u25jEjZfg0UEuNdd75jQVmiUI37oFA1txIWaFVBXK5HWj73v6Gh3hblg0zv3xPAM rsFn3Q7mIETO6SmUiHiCLBPOmAk9ew6kfhl2fcRQ3FK6jbG76bnag1dPv7cgXPqbuKY4WP 3LBzQtQA/v9wjx20HTvIay1Q37Mrk9sXXzCAlXouUNNu0Rsciz1NScamEtHX7ev2zT0baH g2uJ51NUgu0m12abm/mYIjwoxaHc2v/m2IPS4Z1pgV/KnYC9Gje1jpoD39Xp4/mwzxoiSU rsy1tP9bIjt3JjL9UvKnV2bFZOlckFmt14FuETnx+4K52HG07xfit4NfyNrp+Q== ARC-Authentication-Results: i=1; mx1.freebsd.org; none ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1695492768; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:cc:mime-version:mime-version:content-type:content-type: in-reply-to:in-reply-to:references:references; bh=ntH8Ya63M6HqM3IzOOjRLWz7+HXwottz4alwsfi/K9A=; b=jn/JyPo8v3PBtEG5DQQ0LxkuDum8i17VSfw1Deo8QLaC6hLOh7Yg2ZuC+EDCQIkkBGUSz6 iX/GI5MAhtGJ6ytiRmo+mHtCPw8yVCxSw/ZRQXDexlCA4/CaYFXOznNHCmUqNjVCegde35 4DguCpXUwqd+V2rZU/RFIP7ukhNxKxmJAT24kA9/IBPBXAtiO2cOaasW5mUDRXYzTpqd1e guKb5ALVqu8CLPJunCTktw/Ax5Otq5RTO9vrdg/Lyu8/8d7EZ/3jNMGBm1ub4mnZJaYGFB feOaoZX5G87vPBYjcD5iPLZ/ARpb+hbLKd6YBbGTEnlimSoBZZZWzeQs3EPtjg== Received: from tensor.andric.com (tensor.andric.com [87.251.56.140]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "tensor.andric.com", Issuer "R3" (verified OK)) (Authenticated sender: dim) by smtp.freebsd.org (Postfix) with ESMTPSA id 4RtHL81Lp3z1Mqp; Sat, 23 Sep 2023 18:12:48 +0000 (UTC) (envelope-from dim@FreeBSD.org) Received: from smtpclient.apple (longrow.wg.andric.com [10.69.1.2]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by tensor.andric.com (Postfix) with ESMTPSA id 4FCF42843A; Sat, 23 Sep 2023 20:12:46 +0200 (CEST) Content-Type: multipart/signed; boundary="Apple-Mail=_4B998D1C-DD4B-409F-AA24-9AB80B5A4A91"; protocol="application/pgp-signature"; micalg=pgp-sha1 List-Id: Production branch of FreeBSD source code List-Archive: https://lists.freebsd.org/archives/freebsd-stable List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-stable@freebsd.org X-BeenThere: freebsd-stable@freebsd.org Mime-Version: 1.0 (Mac OS X Mail 16.0 \(3731.700.6\)) Subject: Re: nvd->nda switch and blocksize changes for ZFS From: Dimitry Andric In-Reply-To: <1b6190d1-1d42-6c99-bef6-c6b77edd386a@harz2023.behrens.de> Date: Sat, 23 Sep 2023 20:12:35 +0200 Cc: freebsd-stable@freebsd.org Message-Id: References: <1b6190d1-1d42-6c99-bef6-c6b77edd386a@harz2023.behrens.de> To: Frank Behrens X-Mailer: Apple Mail (2.3731.700.6) --Apple-Mail=_4B998D1C-DD4B-409F-AA24-9AB80B5A4A91 Content-Transfer-Encoding: quoted-printable Content-Type: text/plain; charset=us-ascii On 23 Sep 2023, at 18:31, Frank Behrens = wrote: >=20 > I created a zpool with a FreeBSD-14.0-CURRENT on February. With = 15.0-CURRENT/14.0-STABLE from now I get the message: >=20 > status: One or more devices are configured to use a non-native block = size. > Expect reduced performance. > action: Replace affected devices with devices that support the > configured block size, or migrate data to a properly = configured > pool. > NAME STATE READ WRITE CKSUM > zsys ONLINE 0 0 0 > raidz1-0 ONLINE 0 0 0 > nda0p4 ONLINE 0 0 0 block size: 4096B = configured, 16384B native > nda1p4 ONLINE 0 0 0 block size: 4096B = configured, 16384B native > nda2p4 ONLINE 0 0 0 block size: 4096B = configured, 16384B native >=20 > I use: > nda0: > nda0: nvme version 1.4 > nda0: 953869MB (1953525168 512 byte sectors) >=20 > I cannot imagine, that the native blocksize changed. Do I really = expect a reduced performance? > Is it advisable to switch back to nvd? It could be due to a bug in nda so it reports the native block size = incorrectly, in which case you would not need to do anything but ignore = the message. However, if the native block size is really 16kiB, you will = get write amplification effects, which could needlessly shorten the life = of your SSD. I would try running e.g. smartmontools's smartctl, which can sometimes = tell you what the real block size is. Although as far as I know, it = retrieves this information from some internal database. You could also = try to look up the information in the SSD vendor's data sheet, or ask = the vendor directly? -Dimitry --Apple-Mail=_4B998D1C-DD4B-409F-AA24-9AB80B5A4A91 Content-Transfer-Encoding: 7bit Content-Disposition: attachment; filename=signature.asc Content-Type: application/pgp-signature; name=signature.asc Content-Description: Message signed with OpenPGP -----BEGIN PGP SIGNATURE----- Version: GnuPG/MacGPG2 v2.2 iF0EARECAB0WIQR6tGLSzjX8bUI5T82wXqMKLiCWowUCZQ8qkwAKCRCwXqMKLiCW o/GQAJwK/AafYZZR8OGo3ktZWjXiNghqZACgjnKr4tH/FYhdNd3tkvXMDsK8aZc= =Wf4G -----END PGP SIGNATURE----- --Apple-Mail=_4B998D1C-DD4B-409F-AA24-9AB80B5A4A91-- From nobody Sat Sep 23 18:58:53 2023 X-Original-To: stable@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4RtJMQ6kqWz4v5db for ; Sat, 23 Sep 2023 18:58:58 +0000 (UTC) (envelope-from yuri@aetern.org) Received: from out2-smtp.messagingengine.com (out2-smtp.messagingengine.com [66.111.4.26]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4RtJMQ3Qhbz4sp0 for ; Sat, 23 Sep 2023 18:58:58 +0000 (UTC) (envelope-from yuri@aetern.org) Authentication-Results: mx1.freebsd.org; dkim=pass header.d=aetern.org header.s=fm1 header.b=tb1K619Y; dkim=pass header.d=messagingengine.com header.s=fm2 header.b="J ydV27L"; spf=pass (mx1.freebsd.org: domain of yuri@aetern.org designates 66.111.4.26 as permitted sender) smtp.mailfrom=yuri@aetern.org Received: from compute3.internal (compute3.nyi.internal [10.202.2.43]) by mailout.nyi.internal (Postfix) with ESMTP id B4B565C01A8 for ; Sat, 23 Sep 2023 14:58:56 -0400 (EDT) Received: from mailfrontend2 ([10.202.2.163]) by compute3.internal (MEProxy); Sat, 23 Sep 2023 14:58:56 -0400 DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=aetern.org; h=cc :content-transfer-encoding:content-type:content-type:date:date :from:from:in-reply-to:in-reply-to:message-id:mime-version :references:reply-to:sender:subject:subject:to:to; s=fm1; t= 1695495536; x=1695581936; bh=807zhHwEPI8vcbiNfLVgksUwBXPeEt+aRX5 XBDjzzhM=; b=tb1K619YbghpaFFJvO8d5GG0z1n8sOxGtjeXlGPyU3hrc6AUQeX lVa8k6JXy1+CO1unsSmSIxETDDV6qaIXR5Q9fkHppHqFEfYaELaFkbk3Kou4Pagw feu/+DsoatNUHArJ11Hm1lehyiIQOpqW6X1rLJzjoUa3LG5avtVhjYtH4ZKtdhHI VRpyTI1iqk9fWmYZL1onBKSCsMxzYa0r2G8id1jV00p4+rTCcp2tomG+LMFzmOxf u8yZkBoiNmKk+JBQcGihHqOI/BNJ1yf58U1P7bK9QFeFeD5zQH6zFufcS1L8wbq9 do3xYsZaEyk/uEdZ/U/oDGHmfKexwRcCY7w== DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d= messagingengine.com; h=cc:content-transfer-encoding:content-type :content-type:date:date:feedback-id:feedback-id:from:from :in-reply-to:in-reply-to:message-id:mime-version:references :reply-to:sender:subject:subject:to:to:x-me-proxy:x-me-proxy :x-me-sender:x-me-sender:x-sasl-enc; s=fm2; t=1695495536; x= 1695581936; bh=807zhHwEPI8vcbiNfLVgksUwBXPeEt+aRX5XBDjzzhM=; b=J ydV27LrjUYOanR43omuY4nP77lsgGIyW4yugQZeFqv8r2thmz2VKORjexgOWyxv5 F7+xNyYdM0ESRb5PxeBaBAE+jyfpiilx88typG3eOha6OGFtnxVjmSjDV1h1f7sy ZI8Lrh1cS1IkVISoRLK6yTvM6l/TOgLXEg3ZDjcCVEJVYTT7EiM1qo9J9VhhDVu+ 8ZnTPsq8x1hrRNRrIozvvM7etKs4S1Iht70O88ZQFns9nW5LQyaBo3ppEP5qLOIt 7bXQwjMttY+IHVzwGJJpdnojjp5pONELynihFyX6u5EtDtJ7UiAHEq3gvdjysNUE 4EvhQNIPWVkdCd4FcolvA== X-ME-Sender: X-ME-Received: X-ME-Proxy-Cause: gggruggvucftvghtrhhoucdtuddrgedviedrudeltddgudefudcutefuodetggdotefrod ftvfcurfhrohhfihhlvgemucfhrghsthforghilhdpqfgfvfdpuffrtefokffrpgfnqfgh necuuegrihhlohhuthemuceftddtnecunecujfgurhepkfffgggfuffvfhfhjggtgfesth ejredttdefjeenucfhrhhomhepjghurhhiucfrrghnkhhovhcuoeihuhhrihesrggvthgv rhhnrdhorhhgqeenucggtffrrghtthgvrhhnpeekieejgeehhffhheehieeljeeutdetfe fgieffffdvvefhffdutefgkeetjeffjeenucevlhhushhtvghrufhiiigvpedtnecurfgr rhgrmhepmhgrihhlfhhrohhmpeihuhhrihesrggvthgvrhhnrdhorhhg X-ME-Proxy: Feedback-ID: i0d79475b:Fastmail Received: by mail.messagingengine.com (Postfix) with ESMTPA for ; Sat, 23 Sep 2023 14:58:55 -0400 (EDT) Message-ID: <779546e4-1135-c808-372f-e77d347ecf65@aetern.org> Date: Sat, 23 Sep 2023 20:58:53 +0200 List-Id: Production branch of FreeBSD source code List-Archive: https://lists.freebsd.org/archives/freebsd-stable List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-stable@freebsd.org X-BeenThere: freebsd-stable@freebsd.org MIME-Version: 1.0 User-Agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64; rv:102.0) Gecko/20100101 Thunderbird/102.15.1 Subject: Re: nvd->nda switch and blocksize changes for ZFS Content-Language: en-US To: stable@freebsd.org References: <1b6190d1-1d42-6c99-bef6-c6b77edd386a@harz2023.behrens.de> From: Yuri Pankov In-Reply-To: Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: 7bit X-Spamd-Bar: / X-Rspamd-Pre-Result: action=no action; module=multimap; Matched map: local_wl_from X-Spamd-Result: default: False [-0.40 / 15.00]; R_SPF_ALLOW(-0.20)[+ip4:66.111.4.26]; R_DKIM_ALLOW(-0.20)[aetern.org:s=fm1,messagingengine.com:s=fm2]; DKIM_TRACE(0.00)[aetern.org:+,messagingengine.com:+]; PREVIOUSLY_DELIVERED(0.00)[stable@freebsd.org]; local_wl_from(0.00)[yuri@aetern.org]; FREEFALL_USER(0.00)[yuri]; MLMMJ_DEST(0.00)[stable@freebsd.org]; ASN(0.00)[asn:19151, ipnet:66.111.4.0/24, country:US] X-Rspamd-Queue-Id: 4RtJMQ3Qhbz4sp0 Dimitry Andric wrote: > On 23 Sep 2023, at 18:31, Frank Behrens wrote: >> >> I created a zpool with a FreeBSD-14.0-CURRENT on February. With 15.0-CURRENT/14.0-STABLE from now I get the message: >> >> status: One or more devices are configured to use a non-native block size. >> Expect reduced performance. >> action: Replace affected devices with devices that support the >> configured block size, or migrate data to a properly configured >> pool. >> NAME STATE READ WRITE CKSUM >> zsys ONLINE 0 0 0 >> raidz1-0 ONLINE 0 0 0 >> nda0p4 ONLINE 0 0 0 block size: 4096B configured, 16384B native >> nda1p4 ONLINE 0 0 0 block size: 4096B configured, 16384B native >> nda2p4 ONLINE 0 0 0 block size: 4096B configured, 16384B native >> >> I use: >> nda0: >> nda0: nvme version 1.4 >> nda0: 953869MB (1953525168 512 byte sectors) >> >> I cannot imagine, that the native blocksize changed. Do I really expect a reduced performance? >> Is it advisable to switch back to nvd? > > It could be due to a bug in nda so it reports the native block size incorrectly, in which case you would not need to do anything but ignore the message. However, if the native block size is really 16kiB, you will get write amplification effects, which could needlessly shorten the life of your SSD. > > I would try running e.g. smartmontools's smartctl, which can sometimes tell you what the real block size is. Although as far as I know, it retrieves this information from some internal database. You could also try to look up the information in the SSD vendor's data sheet, or ask the vendor directly? Isn't it displayed by e.g. `nvmecontrol identify nda0` under the LBA Formats (including the current one used to format the namespace)? From nobody Sat Sep 23 19:21:27 2023 X-Original-To: freebsd-stable@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4RtJsf3MGVz4v6qh for ; Sat, 23 Sep 2023 19:21:42 +0000 (UTC) (envelope-from marklmi@yahoo.com) Received: from sonic309-21.consmr.mail.gq1.yahoo.com (sonic309-21.consmr.mail.gq1.yahoo.com [98.137.65.147]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4RtJsd21VGz3DbX for ; Sat, 23 Sep 2023 19:21:41 +0000 (UTC) (envelope-from marklmi@yahoo.com) Authentication-Results: mx1.freebsd.org; dkim=pass header.d=yahoo.com header.s=s2048 header.b=EKkY1UOZ; spf=pass (mx1.freebsd.org: domain of marklmi@yahoo.com designates 98.137.65.147 as permitted sender) smtp.mailfrom=marklmi@yahoo.com; dmarc=pass (policy=reject) header.from=yahoo.com DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=yahoo.com; s=s2048; t=1695496898; bh=DUfZ8ZQnbvsh6gjz8gH83OYsdCgXA/NfQqAoF9SCcXU=; h=From:Subject:Date:To:References:From:Subject:Reply-To; b=EKkY1UOZzZ+7QMcvEaXYDoJ8/OwPa6AO64fZ2ENnwWSND27mXayAQAr1Gx9S1dlmg3c0AnRd0wPeu5Om/+pesK8egfj69tVeEqszTQkhgeOWusI7mJaVI8GJuR+r2JzIyvHylo4EIP6AmVuSAU+RRng5ieUROeC65f4WjrF1gbkST009NTLR7O4slGKxBAoyExbbSYgRn4tsOPmyQlyVUbtmDmgd4SIwZ9vaVMynYD1Jj+HJw65HL0+5erAq5+zCPEUBt5/vweUsdCoLRZ+FaPtQ6khkOMNAsaAFIFoQRsH92/9Xem/AbfWJZAydRkK48m2Dgm4zAjlt6IzZD0vEDg== X-SONIC-DKIM-SIGN: v=1; a=rsa-sha256; c=relaxed/relaxed; d=yahoo.com; s=s2048; t=1695496898; bh=2oAXagQd+PN/IxzToVt863bWdj4IxSg//5GNVz41WMX=; h=X-Sonic-MF:From:Subject:Date:To:From:Subject; b=jVd+zas14EuGDXKzLjYFSJeHOwjXwS5bCWYKg5TZGXAqXIYH1Y/vU37PUryjq3WrL+HeRn3dLbsFrZaOpak4qynZEOcR98KA9pMRn1yBljh/pdGUnKRTd+32o885ZVOFVTAIpwuV3aUq9xbl7ciGsjDrtTvbZA3H6MiWyC5x1nmBTDQvaqjmatyNa+w7ywNE/mQ55vgoodxx9fUbs9AGTSDgrmko/KIAp7WWT9z8wbWd3ZPdWxB6jXfecIMaVCayevJ0s+d4KBaldBZCXpnWOvnL0tLSVQQuiHBuvBpjL1Jq8Hm1uHElxIOnChp4mmuvnngSP50Q6Z7UijPU3oRQqQ== X-YMail-OSG: 1ixBl0cVM1npxLrLMuokTlIV.BZIG6frUobNnLazMbsY6FnUTfS8LotVWrFxAMg jAY.4_webjNAw6GZdij4NdiFqeKkOChGgvu72CFlNg0aW1x5FfpPZX0t1_LALMfHLzijyuvBeV1b ab7jN0X7PIIcVkYz3ggFJZJVsIZpMIEytNEctQm6OOAAXf.mvXgWXnH1bBDrByWWmGaJlLwSEX.p NIQrboJO1pJNu7r5vV7cVtu9NshkoLhDNKN5URBJQyTdZH58puOsni7DLMup4E8o6ZHiMptV3FHR 7gLKpQmN72XGxSn22XSuejdrAbSL7fuoEFlbRLIfD4Vn9SXIxmaEcIQ7OowR_dwFb0njQvXJeEib bUCS0kcwb2QJCahD.Jw4TxaAGvzfXaa5dis8vcKDk6FpOiu_S2G767o7lrmcG.p6eaESofWqDUYi J5LSR7RAcuEgapaOfWI8l9H_htQpg4nLR.GPtmeCMmmviVdwYQkte66L5GVdbeb.u7wNceoz3TLo FF.5DTfh8LDszFj97Z2nLwigrB4IMmuyQy.37yeOHABZjGJ6QBBk3KrRy4Zl7vVcAzImedZRLHTc mla3AY7nV3muG1ccd5xZJKvluNWeVRvneqPjhg9LFJxpMvJm5KZoUuyhsjNQYqngLTWrMhRLHHP5 FuOBbs9G8vExA6gCy3AMm2rJNIFT5qGeRECeeEIZRwJtsXSxyhR0djb3P4RWYxhruxMLI8a8TiDE V.I.3QZ4yCXAmqCJo.pMSPnSIXCnoRcnjYMVi1ggnQulhJ_iYHol09qJ0TC.Gcny4zfL5Pc4ULSH dcU7x7jKaOu40c8WQywuJEGlVTfFSQQUCmUCVMUHcB6fG8yMZL.tkWMhCbuGE2oqZYhaizVTROsc wnnbnr0F4o_au9Er.xC6.ffJEJFXtmWH7WU9gb00ri3bsKxwz4lUC2KwkI1NSuEdZVxvSF1GqBH9 TAxAKFSuGrG6PReP47dbJI.veuDW2KWnv6c89ZT5QUpfmlsIvTwVC6hdEIVzXbO1fJgY_.MzyhOx mtNtnbtPB240Q0AxIjv5prymX2zH5QACeknJQl4.69E2slOmSn9obJn83fnuOBJrPzzxp49HqHIc mn3YzIbC5khssMNMqHiIECFdQmILNDclnIVZnm5iDphi.IFkKBMP5n3JNSz1LbcTRxr71fJ4vF4I YtokDlpKwRTEkyaE4Ileh0yxyP8UBjtvqO2F8fP.Nw6t5WsXT_jaUs7O5xXoEtlpNvVfh6BhasfV 1TzMu8fbjnHXY0X1zd2Oi1lN13..eUk02F6VZPNQDiY859z0gCok7NeA6n3CeMm5SnxE03dpoSZz dZNUR.FB9ED5i2tG0yeuZelBCsams1.ySOKvF4qZ_cD8.Ml8PChgj1NvWQBip6TMvz4iNr73DlEq K._uAat3B3ikPgUJ9xenJEzQ0xcWQyhdZRxDjcxIwsr9WkhUdgy0mHBFF3Aa_XV5lpcPpTQpXX_R LzsxHNdoGqmwVoPr9smpilLPGHZW0ns7RrIjDNv30E4RgBly6t7xEBklEzGZg9HXeiUW1uD9F_fq n4g7BGXq_lDkoRS6ym1SA5BWDHltLTTTGQeT5bzTQhULbz1i1vz2ZyeTLtisQYAk3W5p97KQONVp 88ea6Hv8a4aYRrw5ms3Q3Up.Fuyf9u9l_Q_JZf1qVrdr449oq6Q3hwINwsRic0yw6_qVe1ATcYZM 99OHY_HqeYk5PHTn.fl0EceYDb3aRflVA7HVc2pRSYgtgJWv508e6u84V5xUKRx8i8U.LMOn.FJc dWzI0XytuVyLmQ8Cc1OYh9eivGKw6wPDY39RCsGPA3OOTX7H_zidaeC5Y73Psy_y3RjhPHw4ijl2 JkaWm_K5.D7axaXbZ25QhTcMRgtWVzBtDsoO0Pcf2yG8YF8t3VoeltO8zR9PHGnxacsadq9vcvqL sbtrpJOm5X7CUeuB6khIaSGDXthveIWx3cm6y3zR0C9pvfwZHWa0YKVgBzTOBjDp40RA2vwyH5Cb X69cHA2r2xEinNI70DZvX_1y7KVjoaRj00v0Zux_juOU6oZCJB0lgXZuVx27IkIlHtGH2J0sax7v Ht1aknxpPXbvSJ1zdZaQ1.S50fiUZo_ySJu6W64HJqDkC3YSDlPO1Xu0FYUpPZ2rdFghsjzW2mTY yUuhoOX4024ISmQ0jWWr6IplObxwCZNMekf16Qu9FFoVxPFxeaMQwFWT9jkPe.ZXTcuZkG9bnjjI _AkQzsNaahSwPtNDGkc6w4aBd2_M3QTVrclX1o9XWS3V9_R8XT22xvbUjodE3ZdiEJ8aN8FuNpxQ l X-Sonic-MF: X-Sonic-ID: 85c9e06b-b878-496d-8975-14c19e90750b Received: from sonic.gate.mail.ne1.yahoo.com by sonic309.consmr.mail.gq1.yahoo.com with HTTP; Sat, 23 Sep 2023 19:21:38 +0000 Received: by hermes--production-gq1-77657878bb-fqbqk (Yahoo Inc. Hermes SMTP Server) with ESMTPA ID a76923fce8e5934e519a47d390acfcb2; Sat, 23 Sep 2023 19:21:37 +0000 (UTC) From: Mark Millard Content-Type: text/plain; charset=us-ascii Content-Transfer-Encoding: quoted-printable List-Id: Production branch of FreeBSD source code List-Archive: https://lists.freebsd.org/archives/freebsd-stable List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-stable@freebsd.org X-BeenThere: freebsd-stable@freebsd.org Mime-Version: 1.0 (Mac OS X Mail 16.0 \(3731.700.6\)) Subject: RE: nvd->nda switch and blocksize changes for ZFS Message-Id: Date: Sat, 23 Sep 2023 12:21:27 -0700 To: frank@harz2023.behrens.de, FreeBSD-STABLE Mailing List X-Mailer: Apple Mail (2.3731.700.6) References: X-Spamd-Bar: --- X-Spamd-Result: default: False [-3.49 / 15.00]; NEURAL_HAM_LONG(-1.00)[-1.000]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; NEURAL_HAM_SHORT(-0.99)[-0.990]; DMARC_POLICY_ALLOW(-0.50)[yahoo.com,reject]; MV_CASE(0.50)[]; R_DKIM_ALLOW(-0.20)[yahoo.com:s=s2048]; R_SPF_ALLOW(-0.20)[+ptr:yahoo.com]; MIME_GOOD(-0.10)[text/plain]; FROM_HAS_DN(0.00)[]; RCVD_VIA_SMTP_AUTH(0.00)[]; TO_MATCH_ENVRCPT_SOME(0.00)[]; ARC_NA(0.00)[]; MLMMJ_DEST(0.00)[freebsd-stable@freebsd.org]; RCVD_IN_DNSWL_NONE(0.00)[98.137.65.147:from]; DWL_DNSWL_NONE(0.00)[yahoo.com:dkim]; ASN(0.00)[asn:36647, ipnet:98.137.64.0/20, country:US]; RWL_MAILSPIKE_POSSIBLE(0.00)[98.137.65.147:from]; DKIM_TRACE(0.00)[yahoo.com:+]; FREEMAIL_FROM(0.00)[yahoo.com]; TO_DN_SOME(0.00)[]; MID_RHS_MATCH_FROM(0.00)[]; RCPT_COUNT_TWO(0.00)[2]; RCVD_TLS_LAST(0.00)[]; FROM_EQ_ENVFROM(0.00)[]; FREEMAIL_ENVFROM(0.00)[yahoo.com]; MIME_TRACE(0.00)[0:+]; RCVD_COUNT_TWO(0.00)[2] X-Rspamd-Queue-Id: 4RtJsd21VGz3DbX Frank Behrens wrote on Date: Sat, 23 Sep 2023 16:31:40 UTC : > I created a zpool with a FreeBSD-14.0-CURRENT on February. With=20 > 15.0-CURRENT/14.0-STABLE from now I get the message: >=20 > status: One or more devices are configured to use a non-native block = size. > Expect reduced performance. > action: Replace affected devices with devices that support the > configured block size, or migrate data to a properly = configured > pool. > NAME STATE READ WRITE CKSUM > zsys ONLINE 0 0 0 > raidz1-0 ONLINE 0 0 0 > nda0p4 ONLINE 0 0 0 block size: 4096B=20 > configured, 16384B native > nda1p4 ONLINE 0 0 0 block size: 4096B=20 > configured, 16384B native > nda2p4 ONLINE 0 0 0 block size: 4096B=20 > configured, 16384B native >=20 > I use: > nda0: > nda0: nvme version 1.4 > nda0: 953869MB (1953525168 512 byte sectors) >=20 > I cannot imagine, that the native blocksize changed. Do I really = expect=20 > a reduced performance? > Is it advisable to switch back to nvd? Looking at: https://www.techpowerup.com/ssd-specs/samsung-980-1-tb.d58 it reports (indifferent places on the page): QUOTE Page Size: 16 KB Notes NAND Die: A Dual-plane Die with 2 sub-planes with 8 KiB pages in order to improve = performance through paralellism. Endurance: Could be from 1.500 to 3.000 P.E.C. depending on NAND binning END QUOTE That "A Dual-plane Die with 2 sub-planes with 8 KiB pages", for a total of 16 KB, does suggest to me that the new messages have a chance of being correct about there being a tradeoff. (But I'm no expert in the area.) =3D=3D=3D Mark Millard marklmi at yahoo.com