From nobody Wed Dec 18 06:15:40 2024 X-Original-To: freebsd-current@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4YCk281DrYz5gsDk for ; Wed, 18 Dec 2024 06:15:44 +0000 (UTC) (envelope-from glebius@freebsd.org) Received: from smtp.freebsd.org (smtp.freebsd.org [IPv6:2610:1c1:1:606c::24b:4]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "smtp.freebsd.org", Issuer "R10" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4YCk280hyHz4XvM; Wed, 18 Dec 2024 06:15:44 +0000 (UTC) (envelope-from glebius@freebsd.org) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1734502544; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:cc:mime-version:mime-version:content-type:content-type: in-reply-to:in-reply-to:references:references; bh=he3mvkBjYkcrMIP0Fw0ci6RJumNtyQtZxLcYLR5f16c=; b=b2yMjzgWgXhOUw3+EGNh4V9rV3D7MtFVqoSS2e5MBKPIhIf+6pU8J+EMAtR2CKqVv/vdM8 wJGOzNJzwcht3veoDTNhZ2fwfz9TG0+NRLlzY3wl4jArjeHlET/ve922P9eErnNsBg6uTU pZQwDLS5Gg3g3QPabcoGb2xMk1kaIw+fCdnIjudZKOwNJ1B/4ncwdWMjN2rWZu0e7Qo67I 8YeLLutIP7s+9uL1Qd22sXZtzAtJjL4BhNrW0BFOZ/c1GdoxQIjHfSx3r7MOp7yQF5Hjum vCV0q7Q353RGMiQ4/2pzUjnfS/VPXWNGIx3yjps32DW+5fJUaD/FDuxQWMk6xQ== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1734502544; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:cc:mime-version:mime-version:content-type:content-type: in-reply-to:in-reply-to:references:references; bh=he3mvkBjYkcrMIP0Fw0ci6RJumNtyQtZxLcYLR5f16c=; b=QNSSrhqmTUYgLmwo0hw9n8MGNwfQwjNxq0smz7QbB4qE3GoyO53aTM4IYBkMFtHa5KCEG8 R2kG/uFaUGfGbqvKBRzfubpLNgjgiB44ggCgtwhYSdB/x5Nirk7zARabjTov8sZgjVMkId lchNsmTGrE2jIl3crvarWNvO+F9KpVgooy7Vh610ts82NB9cbzf+xHnWDcPt14d9l/9RKw 2ob0oPpPldUBuHIp1p/CQAFZ69uEIw3gnVxd6FZRBmKXmqLtQcTmBNeYWPbHJFMyizi5WY ps3s4qapkiBV9mtxJiZxXsyJn4H/a4+XJG4VWzZ/uJ1P5UtQOkN7SmYsSvM/DQ== ARC-Authentication-Results: i=1; mx1.freebsd.org; none ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1734502544; a=rsa-sha256; cv=none; b=CuZ+Pzcr/jw/yajFzm3QIRBM16ZXNluTCieTJ6q6LDljBFDCht50hne2ZRL/ptw7tIvada GGf6kzzhCwaG634uLWHsdMI6AK6b6QvQQof2Kem1/xNnXFemUFwUPjjY4pbqvFudOhAMfz RbaNm7sYU+tkBGgLjDvQneW2RvN6K5d3AbFOnnrNcSKq50TMJw49PtdzzMGsmzcqAO8VcB E5o5Y6aGv8XjslQWTvZLuN92XYFeDbJPgHw+PCCR3nOt1XHu0r1E/wo/EwbkVARNlviVXu F9bFbu0cWvxTYbna5dNcXh9N1sJw6VACbh3ZQKGM/R6A/ZgB43pU86p/L8xHjw== Received: from cell.glebi.us (glebi.us [162.251.186.162]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) (Authenticated sender: glebius) by smtp.freebsd.org (Postfix) with ESMTPSA id 4YCk274PbGz13S3; Wed, 18 Dec 2024 06:15:43 +0000 (UTC) (envelope-from glebius@freebsd.org) Date: Tue, 17 Dec 2024 22:15:40 -0800 From: Gleb Smirnoff To: George Neville-Neil Cc: freebsd-current@freebsd.org, src-committers@freebsd.org Subject: Re: December 2024 stabilization week CANCELED! Message-ID: References: <53FED895-91D1-46F1-8702-A82B9E046927@neville-neil.com> List-Id: Discussions about the use of FreeBSD-current List-Archive: https://lists.freebsd.org/archives/freebsd-current List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-current@FreeBSD.org MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: <53FED895-91D1-46F1-8702-A82B9E046927@neville-neil.com> On Wed, Dec 18, 2024 at 08:29:46AM +0800, George Neville-Neil wrote: G> > due to shortage of human resources and due to reservation of certain hardware G> > for the Christmas events, we won't be able to properly A/B test the December G> > snapshot at Netflix as we usually do. Given that testing performed by Netflix G> > is the largest sieve to catch regressions, and we still don't have any second G> > large party participating in the stabweek, me together with David dhw@ decided G> > that this month the stabweek to be skipped. G> G> How much hardware is required for this? Could this be done with new machines either in the cluster or at Sentex (the test lab) or does this have to be done at NetFlix because that's where the systems are best set up to do this? If more hardware is needed you should talk to Ed at the Foundation and get some ordered. I don't think there is anything in the world comparable to the A/B testing that David does at Netflix. Although, the test covers only some subset of FreeBSD functionality: TCP (including advanced stacks), sendfile(2), kernel TLS and a small set of device drivers, it does that at a very large scale on production traffic. You can't repeat that at home :) But the point is not about substituting the David's test with an other test (next week or anytime). The point of the stabweeks cycle is that several parties pick the same revision and extensively test it with their own tests. I was really hoping that more large companies that use FreeBSD would join the stabweek cycle, that the FreeBSD cluster updates would also use the same revision, that more individuals will follow the stabweek. Unfortunately, little participation is observed right now. This December, if we exclude Netflix/dhw@ test from the stabweek, it would be only a handful of individuals updating their desktops, which in my opinion, isn't enough to announce a stabweek and the associated freeze. But for any future months any additional testing resources are very much appreciated. E.g., I'd be glad to see Peter's Holm stress2 running on the Sentex test lab during Monday of stabweek. If you can provide more coverage in future stabweeks - please join. -- Gleb Smirnoff