From owner-freebsd-hackers@freebsd.org Sun Sep 13 01:38:21 2020 Return-Path: Delivered-To: freebsd-hackers@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id B90943E81FD for ; Sun, 13 Sep 2020 01:38:21 +0000 (UTC) (envelope-from eugen@grosbein.net) Received: from hz.grosbein.net (hz.grosbein.net [IPv6:2a01:4f8:c2c:26d8::2]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client CN "hz.grosbein.net", Issuer "hz.grosbein.net" (not verified)) by mx1.freebsd.org (Postfix) with ESMTPS id 4BpsZh20C6z4m3G for ; Sun, 13 Sep 2020 01:38:19 +0000 (UTC) (envelope-from eugen@grosbein.net) Received: from eg.sd.rdtc.ru (eg.sd.rdtc.ru [IPv6:2a03:3100:c:13:0:0:0:5]) by hz.grosbein.net (8.15.2/8.15.2) with ESMTPS id 08D1bxPs021392 (version=TLSv1.2 cipher=DHE-RSA-AES256-GCM-SHA384 bits=256 verify=NOT); Sun, 13 Sep 2020 01:38:02 GMT (envelope-from eugen@grosbein.net) X-Envelope-From: eugen@grosbein.net X-Envelope-To: eric@metricspace.net Received: from [10.58.0.10] (dadvw [10.58.0.10]) by eg.sd.rdtc.ru (8.16.1/8.16.1) with ESMTPS id 08D1c24T013483 (version=TLSv1.2 cipher=ECDHE-RSA-AES128-GCM-SHA256 bits=128 verify=NOT); Sun, 13 Sep 2020 08:38:02 +0700 (+07) (envelope-from eugen@grosbein.net) Subject: Re: ZFS encryption and loader To: Eric McCorkle , freebsd-hackers@freebsd.org References: <676dfde0-4202-1dc9-f90c-420fe9bbae27@metricspace.net> From: Eugene Grosbein Message-ID: <9bbc0793-25d5-6525-fad5-c74ec836e26e@grosbein.net> Date: Sun, 13 Sep 2020 08:37:56 +0700 User-Agent: Mozilla/5.0 (Windows NT 6.3; WOW64; rv:45.0) Gecko/20100101 Thunderbird/45.8.0 MIME-Version: 1.0 In-Reply-To: <676dfde0-4202-1dc9-f90c-420fe9bbae27@metricspace.net> Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 8bit X-Spam-Status: No, score=-2.2 required=5.0 tests=BAYES_00,LOCAL_FROM, NICE_REPLY_A,SPF_HELO_NONE,SPF_PASS autolearn=no autolearn_force=no version=3.4.2 X-Spam-Report: * -2.3 BAYES_00 BODY: Bayes spam probability is 0 to 1% * [score: 0.0000] * -0.0 SPF_PASS SPF: sender matches SPF record * 0.0 SPF_HELO_NONE SPF: HELO does not publish an SPF Record * 2.6 LOCAL_FROM From my domains * -2.5 NICE_REPLY_A Looks like a legit reply (A) X-Spam-Checker-Version: SpamAssassin 3.4.2 (2018-09-13) on hz.grosbein.net X-Rspamd-Queue-Id: 4BpsZh20C6z4m3G X-Spamd-Bar: -- Authentication-Results: mx1.freebsd.org; dkim=none; dmarc=none; spf=permerror (mx1.freebsd.org: domain of eugen@grosbein.net uses mechanism not recognized by this client) smtp.mailfrom=eugen@grosbein.net X-Spamd-Result: default: False [-2.21 / 15.00]; MID_RHS_MATCH_FROM(0.00)[]; ARC_NA(0.00)[]; FREEFALL_USER(0.00)[eugen]; FROM_HAS_DN(0.00)[]; TO_DN_SOME(0.00)[]; NEURAL_HAM_MEDIUM(-0.89)[-0.889]; NEURAL_HAM_LONG(-0.94)[-0.936]; MIME_GOOD(-0.10)[text/plain]; DMARC_NA(0.00)[grosbein.net]; RCVD_COUNT_THREE(0.00)[3]; TO_MATCH_ENVRCPT_SOME(0.00)[]; R_SPF_PERMFAIL(0.00)[empty SPF record]; RCPT_COUNT_TWO(0.00)[2]; NEURAL_HAM_SHORT(-0.29)[-0.285]; FROM_EQ_ENVFROM(0.00)[]; R_DKIM_NA(0.00)[]; MIME_TRACE(0.00)[0:+]; ASN(0.00)[asn:24940, ipnet:2a01:4f8::/29, country:DE]; RCVD_TLS_ALL(0.00)[]; MAILMAN_DEST(0.00)[freebsd-hackers] X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.33 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 13 Sep 2020 01:38:21 -0000 13.09.2020 5:46, Eric McCorkle wrote: > I'm thinking of migrating to ZFS encryption from GELI in the near future. > > Does anyone know offhand what the state of support for ZFS encryption in > loader looks like, and if there's support for passing keys to the kernel > for boot-time loading? (I can look at adding these if they're missing) Recently I've learned from one of ZoL maintainers that native ZFS encryption is not so comprehensive as GELI. I've been told that native ZFS encryption was initially designed for one specific task: being able to receive encrypted customer data (backups), verify its integrity without decryption, store and then receive incremental backups later. Therefore, not all data is hidden with encryption, for example, dataset names and some other metadata are not. From owner-freebsd-hackers@freebsd.org Sun Sep 13 09:08:29 2020 Return-Path: Delivered-To: freebsd-hackers@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id C84543D1A5C for ; Sun, 13 Sep 2020 09:08:29 +0000 (UTC) (envelope-from debdrup@freebsd.org) Received: from freefall.freebsd.org (freefall.freebsd.org [96.47.72.132]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "freefall.freebsd.org", Issuer "Let's Encrypt Authority X3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4Bq3Z54vVYz3fGw for ; Sun, 13 Sep 2020 09:08:29 +0000 (UTC) (envelope-from debdrup@freebsd.org) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1599988109; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: in-reply-to:in-reply-to:references:references; bh=oPe+LCJNhZoReKbg2TcChiyJnajqAxqI092M39z8pWQ=; b=hbYIpqXNwnh8dmij3zUlAQGFwgtXgA/N5ePQ7Jk58jI1D4XUQV8MIwFJtDkBk/WKQo9Xmm lDk4/2pT7/MgOYnkm3/FKjzMzjmCVU/NcpK+7cZOOZ6n2TencHpc8sP+dDf4KNqjancRHN HYpp6iNNjpO7svbEDklcE+abYlREjoDtq89i+dkxGLCVHUlhGn91LDWpwcTitcyFGO8qln qTC6NAN+nhn33Uamf5fjqTi8X91fhvE8iRUjXwPwEA8dqdRGh0Vj3mqsdtSfI2zXcFOsd/ yFHe8AyfYWDMuS/kXF9jEImx+ojKtVSG7Td2cmJIMLTaYMFrGoypXJ89WchuqA== Received: by freefall.freebsd.org (Postfix, from userid 1471) id 925421FB; Sun, 13 Sep 2020 09:08:29 +0000 (UTC) Date: Sun, 13 Sep 2020 11:08:27 +0200 From: Daniel Ebdrup Jensen To: freebsd-hackers@freebsd.org Subject: Re: ZFS encryption and loader Message-ID: <20200913090827.kdfnnx76n2yknmiw@nerd-thinkpad.local> Mail-Followup-To: Daniel Ebdrup Jensen , freebsd-hackers@freebsd.org References: <676dfde0-4202-1dc9-f90c-420fe9bbae27@metricspace.net> MIME-Version: 1.0 Content-Type: multipart/signed; micalg=pgp-sha512; protocol="application/pgp-signature"; boundary="ggara5xsymlqyn7w" Content-Disposition: inline In-Reply-To: ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1599988109; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: in-reply-to:in-reply-to:references:references; bh=oPe+LCJNhZoReKbg2TcChiyJnajqAxqI092M39z8pWQ=; b=PP1pq58pJGVzeYVq3ofTacHSZwgMUw3PO+TozP15CzLOkpyWkvarIdQzzwqKLpOEhS1Coc 2Nhz+J+vYoWQ+qUlcaDfZh81pnDRUF3xaTGkWdy89BBAeDl/XzolVhIuOAabaDu+68BmO1 Y1bQToLyu0/YFq/UgP2FtVXdpGBvRBgg652dLbSdfDl1FCgQue4zi/dxrT91FjlU12UGph l8zByphH/sWZz6WjymTvM2MQZuBSRnSyqqd/vPX7ETaPW74/WH6KmjQlY8CIECERLl2FDz 69TyPU2w9DwSF74M6hNgi4htF9vfWx9LSRCX98IXQuEzBCMtYXEt+TCAbErXig== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1599988109; a=rsa-sha256; cv=none; b=EkhgzwffKFSTMT0rLo34PIS3z8ej+9dr2jkZWZZBG4jAHjwMt4Moz4hYTMJrIPqYDtyd6z tqWAnSFlfamcCLFeLDbkZ8IsPLGQzrxegawfIjSSnwMusfWyPkTvlNotGyxhUf+qtEI0a6 vGjDVjSRb1ShCsb8GCilorC7kGSN7v7HU/ImSewAyw0p5tOnshwGs5z0svHxPGsd3/SfVx n42Fr1PYxwTCSmdpxtO8cTgonBPucnFsSDuhSrfK78zPIDRiDZQaNt7eHZONPZgvLxMZvn 077JicbPUtb0gGbmxM/D7rSZoBoIVhOMLOFxWreZcpGKoL7XSCJZ2C5Q2zFdkA== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.33 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 13 Sep 2020 09:08:29 -0000 --ggara5xsymlqyn7w Content-Type: text/plain; charset=us-ascii; format=flowed Content-Disposition: inline Content-Transfer-Encoding: quoted-printable On Sat, Sep 12, 2020 at 04:52:32PM -0600, Warner Losh wrote: >On Sat, Sep 12, 2020, 4:49 PM Warner Losh wrote: > >> >> >> On Sat, Sep 12, 2020, 4:46 PM Eric McCorkle wrote: >> >>> I'm thinking of migrating to ZFS encryption from GELI in the near futur= e. >>> >>> Does anyone know offhand what the state of support for ZFS encryption in >>> loader looks like, and if there's support for passing keys to the kernel >>> for boot-time loading? (I can look at adding these if they're missing) >>> >> >> Matt macey did an initial port. I've refined it to fit the stand env >> better. I need to upstream some things and got stalked there for unrelat= ed >> reasons. >> > >Wait. I just got crypto and compression confused. The work is on >compression.... > >Warner > >> >_______________________________________________ >freebsd-hackers@freebsd.org mailing list >https://lists.freebsd.org/mailman/listinfo/freebsd-hackers >To unsubscribe, send any mail to "freebsd-hackers-unsubscribe@freebsd.org" This came up in another thread, perhaps on another FreeBSD mailing list,=20 recently - but the gist of it is that as of r364787 [1], you can have a roo= t=20 pool that isn't encrypted, and use encrypted datasets - as far as I remembe= r,=20 given the bsdinstall dataset layout, this means that at least the data will= be=20 encrypted. Thankfully, sef@ added AES-CCM as well as an aesni implementation back in 2= 019. Yours, Daniel Ebdrup Jensen [1]: https://svnweb.freebsd.org/changeset/base/364787 --ggara5xsymlqyn7w Content-Type: application/pgp-signature; name="signature.asc" -----BEGIN PGP SIGNATURE----- iQGTBAABCgB9FiEEDonNJPbg/JLIMoS6Ps5hSHzN87oFAl9d4YpfFIAAAAAALgAo aXNzdWVyLWZwckBub3RhdGlvbnMub3BlbnBncC5maWZ0aGhvcnNlbWFuLm5ldDBF ODlDRDI0RjZFMEZDOTJDODMyODRCQTNFQ0U2MTQ4N0NDREYzQkEACgkQPs5hSHzN 87pmvAgAg/iw98/iz16ED3A22bgxdOsQGU5lVJjjexXDFbCDv1SYRx6au36XiH4T CmyxqomVHAbkTJugNfsn5dWjCP7LB/QR41SAF1jDaVDtVPcTubf5ioIfu0ffi3oF dKfiUG9VgOEivaCWES8t+jJLnrzIfxhqS6N5Aatp+lDKCZY6G2Q8Pon2EE0fkIs8 WLfpp/kB3rsW2Syufk+/SaWgwf9ZUV6nBEsqOgyBY45ineLJB139cb6RgC9n5iTA 9mhRi0OtzwjEvfNH4/yjeOZBSQKuPpgJIZp/RxN6IIr8Z37kBCGN311jvURDzWWv S83LUZs+hHXyCsORpNTGZCHSPMjJZA== =O/ai -----END PGP SIGNATURE----- --ggara5xsymlqyn7w-- From owner-freebsd-hackers@freebsd.org Sun Sep 13 14:33:32 2020 Return-Path: Delivered-To: freebsd-hackers@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id E07713DBFDD for ; Sun, 13 Sep 2020 14:33:32 +0000 (UTC) (envelope-from ryan@ixsystems.com) Received: from mail-ej1-x634.google.com (mail-ej1-x634.google.com [IPv6:2a00:1450:4864:20::634]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "GTS CA 1O1" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4BqBn80x3nz4G2Z for ; Sun, 13 Sep 2020 14:33:31 +0000 (UTC) (envelope-from ryan@ixsystems.com) Received: by mail-ej1-x634.google.com with SMTP id e23so19657569eja.3 for ; Sun, 13 Sep 2020 07:33:31 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=ixsystems.com; s=google; h=mime-version:references:in-reply-to:from:date:message-id:subject:to :cc; bh=QH3SIXsfGv1H42Mn8Jm83EDKfN0cWjP+1AB6CwuuLY0=; b=D32H12lcYLZ5IdsrchH8EOduuWk+/BBYYlKRmVF2rw9Iw75M8+bN3eBn9+yzN8/5l6 pHVmOGX5yaHp9Us9aJr9n1m+vykVlYqEjPqL/QDWGNAKBhn4yLkGCU1sVRQF/qfv06zG RTaMw0agTnyROIipM1lToxe2gN73NdsMCQ5X8FgRXdbQ+VpOr5qZq/aijgvduG76hxum QVff2ccnXxkqk8JqVGUns2dS71DEA37ELoGXh6YG156tvNtScgO9Zpj3UGMfIiKAiNVG YQ9Q5TcSF5b0eGCL25PiPZ5Bl8AP0zRSwrvjzbKGA+HD992rtYacANJADlcoeB/IrK6a M4NA== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:references:in-reply-to:from:date :message-id:subject:to:cc; bh=QH3SIXsfGv1H42Mn8Jm83EDKfN0cWjP+1AB6CwuuLY0=; b=tjiee7zLg3uCskE851Fd5G3I/NS+0/o7gyVItoo3/sSJiylvtZkNNvgQIrv/d6b0Yy VN2zVu04iUAgcxK16oXnjhuw1oUpvIpDDW0+VXv36kypW3IZQpQJygVSvdBZyjVvOYm9 lGgZf+RIjKBwQ0Ltdd2pSHtxw5fjdP5HDjFSlVzKy6McoWr61VMbVOH5QoHOuq1tuFkv Gw5Evop/HVpvWzkrcxSeVIKarTR/tuoJ5STCUgg8n5JyI7c0h1vv1uJ5Yi3BUGheL0jA 19laWkQxiN+D5Zdx1656UH7hnqWZc41xJhdGjdT+GpxF0dZ8AGxtcJZf/aD97FsnaaYO w5cQ== X-Gm-Message-State: AOAM5303+fZz2EidUwhiw8Wp6UkavHmbpzJ2/givwcIopkK8lUvwlm8l 9j5RHIN5kah6W0X8e0bY8C3LaX+0Kb7RBcJZRLTZeiTgITScTw== X-Google-Smtp-Source: ABdhPJxXhHriGnIwk2/xs5pw9PMm2TY1e21t0Rj164ew32zl/k0Tlm0IencQpXRypiuqIN2bVrJ33rNS8sKWuBBRZi8= X-Received: by 2002:a17:907:648:: with SMTP id wq8mr10915615ejb.291.1600007610523; Sun, 13 Sep 2020 07:33:30 -0700 (PDT) MIME-Version: 1.0 References: <676dfde0-4202-1dc9-f90c-420fe9bbae27@metricspace.net> In-Reply-To: <676dfde0-4202-1dc9-f90c-420fe9bbae27@metricspace.net> From: Ryan Moeller Date: Sun, 13 Sep 2020 10:33:19 -0400 Message-ID: Subject: Re: ZFS encryption and loader To: Eric McCorkle Cc: freebsd-hackers@freebsd.org Content-Type: text/plain; charset="UTF-8" X-Rspamd-Queue-Id: 4BqBn80x3nz4G2Z X-Spamd-Bar: --- Authentication-Results: mx1.freebsd.org; dkim=pass header.d=ixsystems.com header.s=google header.b=D32H12lc; dmarc=pass (policy=none) header.from=ixsystems.com; spf=pass (mx1.freebsd.org: domain of ryan@ixsystems.com designates 2a00:1450:4864:20::634 as permitted sender) smtp.mailfrom=ryan@ixsystems.com X-Spamd-Result: default: False [-3.88 / 15.00]; RCVD_TLS_ALL(0.00)[]; ARC_NA(0.00)[]; R_DKIM_ALLOW(-0.20)[ixsystems.com:s=google]; FREEFALL_USER(0.00)[ryan]; FROM_HAS_DN(0.00)[]; TO_DN_SOME(0.00)[]; R_SPF_ALLOW(-0.20)[+ip6:2a00:1450:4000::/36]; NEURAL_HAM_LONG(-1.03)[-1.032]; MIME_GOOD(-0.10)[text/plain]; PREVIOUSLY_DELIVERED(0.00)[freebsd-hackers@freebsd.org]; NEURAL_HAM_MEDIUM(-1.01)[-1.013]; TO_MATCH_ENVRCPT_SOME(0.00)[]; DKIM_TRACE(0.00)[ixsystems.com:+]; RCPT_COUNT_TWO(0.00)[2]; RCVD_IN_DNSWL_NONE(0.00)[2a00:1450:4864:20::634:from]; NEURAL_HAM_SHORT(-0.84)[-0.835]; DMARC_POLICY_ALLOW(-0.50)[ixsystems.com,none]; FROM_EQ_ENVFROM(0.00)[]; MIME_TRACE(0.00)[0:+]; ASN(0.00)[asn:15169, ipnet:2a00:1450::/32, country:US]; RCVD_COUNT_TWO(0.00)[2]; MAILMAN_DEST(0.00)[freebsd-hackers] X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.33 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 13 Sep 2020 14:33:32 -0000 On Sat, Sep 12, 2020 at 6:46 PM Eric McCorkle wrote: > > I'm thinking of migrating to ZFS encryption from GELI in the near future. > > Does anyone know offhand what the state of support for ZFS encryption in > loader looks like, and if there's support for passing keys to the kernel > for boot-time loading? (I can look at adding these if they're missing) > There is no support for ZFS encryption in loader, and nobody is working on it. -- Ryan Moeller iXsystems, Inc. OS Developer Email: ryan@iXsystems.com From owner-freebsd-hackers@freebsd.org Mon Sep 14 08:25:24 2020 Return-Path: Delivered-To: freebsd-hackers@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 8F6173F6D90 for ; Mon, 14 Sep 2020 08:25:24 +0000 (UTC) (envelope-from lg49152@outlook.com) Received: from NAM04-BN3-obe.outbound.protection.outlook.com (mail-oln040092009054.outbound.protection.outlook.com [40.92.9.54]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client CN "mail.protection.outlook.com", Issuer "GlobalSign Organization Validation CA - SHA256 - G3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4BqfYv06zlz4PHk for ; Mon, 14 Sep 2020 08:25:22 +0000 (UTC) (envelope-from lg49152@outlook.com) ARC-Seal: i=1; a=rsa-sha256; s=arcselector9901; d=microsoft.com; cv=none; b=cjCpIkETUOfAkZYp1S846yKtJIXgSjwfbyLdrZJylzF8GXLpjRpIYmDiez/0BBxy/ZvD6eAWuFbD1N5ym3Ht8deEVhtY43oH+HYxtiUL4NYLtEDcFqHmjEIjQ8qVbDPeXathFNCaGPGxmrPvtG6eLeWAbCnih62LOTzgUxp5941PR4rljGyvrERHjBfxZtPyxqA/uSCnpJyIx+UTngAHK0T+CF+6/uYAb0tqUTMHTOISKAWCwkMNCznR3lD39a/8gPqQ/USt9e/h3kOwbCrSrJcCt+D1CQNrHej+NiMBNCjrOkegL0A6NqK4Ng9Keiz8AERc8T6moEuhjj//xwG4+w== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=microsoft.com; s=arcselector9901; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=EjugJ4+HswPtbwWtA3Kow5r9nvNLlDfehUXH0jUBVUg=; b=h0k3F2rjtQMmLMV0DRE60UjEfOMM2QZusbFO8ocHXeDT7ql62+Cne+s7lMyxdvs4XNwy1NZ4zgRs9ORr902px1GOStWZXoFLcbs2WW4iZhiOO6CD/PgjYEW4it0AcqYFugfXXY9gezmrnRyLR/zCKCBCiUirpqdjlXbqoQwrDyW33rfLABKngqhABK5Pqlvy1lmltJnNex+XtXOX3UjpyYtdal8Hnm9tykgYFz1pIUl3Yz0MWSrnW6IqhX7XeiTN+EiKPpCSMwixymfBfa1AM1gFuVVzaacGtCh1cbq9znyToTbxDSvD+yFRWQppkUb6oM0b84tKz3OTIitlQqRYyg== ARC-Authentication-Results: i=1; mx.microsoft.com 1; spf=none; dmarc=none; dkim=none; arc=none DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=outlook.com; s=selector1; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=EjugJ4+HswPtbwWtA3Kow5r9nvNLlDfehUXH0jUBVUg=; b=ah0sSdvZ9hVL2VQVmqgzLmESenuo06BOwHu7QK6KotpxV9RzWEN+20tcWRTPT1ZSB2w2WHkPOY86TSHWr06HI+scSbesYCmj2hwxwW+1an/IZy1YgZE2EhkjzPQxRe0bkFsb0kpzt2GvP/srd894wKDhLrJpKs0irap9a9V1674SYTx7xf/Ipzw1i68V+ruM7SJC14ygcWKbz6bR7p2f1RFSJzYdjhtuj1NqiTzOIsCkdPPDfhJKAhoHjSh+BQ/JqSMSLCdGgAojpgc39+NhmrbvgtaguFr9BqpAQBQLZeEtc7KLWS+/zgWKw+hXdWEqgjJa5Q0zSuWCvwo5h1CdxA== Received: from DM6NAM04FT042.eop-NAM04.prod.protection.outlook.com (2a01:111:e400:7ea3::46) by DM6NAM04HT249.eop-NAM04.prod.protection.outlook.com (2a01:111:e400:7ea3::483) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.3370.16; Mon, 14 Sep 2020 08:25:21 +0000 Received: from DM6PR04MB5484.namprd04.prod.outlook.com (2a01:111:e400:7ea3::48) by DM6NAM04FT042.mail.protection.outlook.com (2a01:111:e400:7ea3::97) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.3370.16 via Frontend Transport; Mon, 14 Sep 2020 08:25:21 +0000 Received: from DM6PR04MB5484.namprd04.prod.outlook.com ([fe80::e927:93b0:247b:ae50]) by DM6PR04MB5484.namprd04.prod.outlook.com ([fe80::e927:93b0:247b:ae50%5]) with mapi id 15.20.3370.019; Mon, 14 Sep 2020 08:25:21 +0000 From: Lawrence Greening To: "freebsd-hackers@freebsd.org" Subject: Developers' Handbook: Chapter on testing Thread-Topic: Developers' Handbook: Chapter on testing Thread-Index: AQHWimr8UXzpwrGVwEucfJbDxX3NYg== Date: Mon, 14 Sep 2020 08:25:21 +0000 Message-ID: Accept-Language: en-CA, en-US Content-Language: en-CA X-MS-Has-Attach: X-MS-TNEF-Correlator: x-incomingtopheadermarker: OriginalChecksum:1ED2FEA058F386777AB91C8C3E016F42B4090D008021B488C3255FE0E79BD6C9; UpperCasedChecksum:D7076CB6503314C277B1949D3BBE0323F7238F1FE234500A7B9EE60F32903D79; SizeAsReceived:2630; Count:41 x-ms-exchange-messagesentrepresentingtype: 1 x-tmn: [4hSjU1ojsGHz1wPJd8+nChWSsjCsUa8ie/M5x8V4uqA=] x-ms-publictraffictype: Email x-incomingheadercount: 41 x-eopattributedmessage: 0 x-ms-office365-filtering-correlation-id: e388fb44-8de9-41e2-1c8c-08d85887b8ba x-ms-traffictypediagnostic: DM6NAM04HT249: x-microsoft-antispam: BCL:0; x-microsoft-antispam-message-info: S0Z7KsxgdZFUt8t6RmpIFR0k42w2rchbWhti1IGuMoPNKOOVXlAaWc3Az7ZMdqFqUo9f0+DGtqJvh1YCfOuMAa5uWc+hzB0BUk0WNkzIa5irrh+h1wreK84knM/9l+CppwtHleRoNfdTJ6VzzQGqWKxTMCinnuUdcguGImYEHkk2B3Pq8fjZJz8MY89Lft6v x-ms-exchange-antispam-messagedata: 8fOdtPqPkEHAg/Ll9Rh0A1l52RFht9oKII7qO78xaNwTAfb9s1j1Fym0NEpNqKfT1GzKHvTudGugHolEbn5ctaaUl1Pbwqo10QyBijVXk3S6YXsVm+OVfNJ02rxdIKodU2cf0h0QfyJupus+A+q9GQ== x-ms-exchange-transport-forked: True Content-Type: text/plain; charset="utf-8" Content-Transfer-Encoding: base64 MIME-Version: 1.0 X-OriginatorOrg: outlook.com X-MS-Exchange-CrossTenant-AuthAs: Anonymous X-MS-Exchange-CrossTenant-AuthSource: DM6NAM04FT042.eop-NAM04.prod.protection.outlook.com X-MS-Exchange-CrossTenant-RMS-PersistedConsumerOrg: 00000000-0000-0000-0000-000000000000 X-MS-Exchange-CrossTenant-Network-Message-Id: e388fb44-8de9-41e2-1c8c-08d85887b8ba X-MS-Exchange-CrossTenant-rms-persistedconsumerorg: 00000000-0000-0000-0000-000000000000 X-MS-Exchange-CrossTenant-originalarrivaltime: 14 Sep 2020 08:25:21.4839 (UTC) X-MS-Exchange-CrossTenant-fromentityheader: Internet X-MS-Exchange-CrossTenant-id: 84df9e7f-e9f6-40af-b435-aaaaaaaaaaaa X-MS-Exchange-Transport-CrossTenantHeadersStamped: DM6NAM04HT249 X-Rspamd-Queue-Id: 4BqfYv06zlz4PHk X-Spamd-Bar: ----- Authentication-Results: mx1.freebsd.org; dkim=pass header.d=outlook.com header.s=selector1 header.b=ah0sSdvZ; dmarc=pass (policy=none) header.from=outlook.com; spf=pass (mx1.freebsd.org: domain of lg49152@outlook.com designates 40.92.9.54 as permitted sender) smtp.mailfrom=lg49152@outlook.com X-Spamd-Result: default: False [-5.18 / 15.00]; DWL_DNSWL_NONE(0.00)[outlook.com:dkim]; NEURAL_HAM_MEDIUM(-1.00)[-0.995]; R_DKIM_ALLOW(-0.20)[outlook.com:s=selector1]; FROM_HAS_DN(0.00)[]; FREEMAIL_FROM(0.00)[outlook.com]; TO_MATCH_ENVRCPT_ALL(0.00)[]; MIME_GOOD(-0.10)[text/plain]; R_SPF_ALLOW(-0.20)[+ip4:40.92.0.0/15]; NEURAL_HAM_LONG(-1.01)[-1.011]; ARC_ALLOW(-1.00)[microsoft.com:s=arcselector9901:i=1]; RCPT_COUNT_ONE(0.00)[1]; RCVD_COUNT_THREE(0.00)[4]; DKIM_TRACE(0.00)[outlook.com:+]; MIME_BASE64_TEXT(0.10)[]; RCVD_IN_DNSWL_NONE(0.00)[40.92.9.54:from]; NEURAL_HAM_SHORT(-1.27)[-1.272]; TO_DN_EQ_ADDR_ALL(0.00)[]; DMARC_POLICY_ALLOW(-0.50)[outlook.com,none]; FROM_EQ_ENVFROM(0.00)[]; MIME_TRACE(0.00)[0:+]; FREEMAIL_ENVFROM(0.00)[outlook.com]; ASN(0.00)[asn:8075, ipnet:40.80.0.0/12, country:US]; RCVD_TLS_LAST(0.00)[]; MAILMAN_DEST(0.00)[freebsd-hackers]; RWL_MAILSPIKE_POSSIBLE(0.00)[40.92.9.54:from] X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.33 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 14 Sep 2020 08:25:24 -0000 SGkuCuKAiwpBIHZhcmlhdGlvbiBvZiB0aGUgZm9sbG93aW5nIHdhcyBwb3N0ZWQgdG8gZnJlZWJz ZC10ZXN0aW5nLiBJIHdvdWxkIGdlbmVyYWxseSBhdm9pZCBjcm9zcy1wb3N0aW5nIGJ1dCBJJ20g cmVwb3N0aW5nIGhlcmUgYmVjYXVzZSBvZiByZWNlbnQgaW50ZXJlc3QgaW4gdGVzdGluZyBvbiB0 aGlzIGxpc3QuLi4KCkkgYW0gd3JpdGluZyBhIGNoYXB0ZXIgb24gdGVzdGluZyBmb3IgdGhlIEZy ZWVCU0QgRGV2ZWxvcGVycycgSGFuZGJvb2suCgpUaGUgZm9sbG93aW5nIHRvcGljcyBhcmUgZXhw ZWN0ZWQgdG8gYmUgY292ZXJlZDoKCiogRnJlZUJTRCBUZXN0IFN1aXRlCiogS3l1YQoqIEF1dG9t YXRlZCBUZXN0aW5nIEZyYW1ld29yayAoQVRGKQoqIE9yZ2FuaXphdGlvbiBvZiBjdXJyZW50IEZy ZWVCU0QgdGVzdHMuCiogVXNpbmcgYXV0b21hdGlvbiBhbmQgdmlydHVhbGl6YXRpb24gdG8gcmVk dWNlIHRoZSBvdmVyaGVhZCBpbiBzZXR0aW5nIHVwIHRoZSB0ZXN0IGluZnJhc3RydWN0dXJlLgoq IEV4YW1wbGVzIG9mIGRpZmZlcmVudCB0eXBlcyBvZiB0ZXN0aW5nLgoqIFJlcHJvZHVjaWJpbGl0 eSBpbiBidWlsZGluZyBhbmQgdGVzdGluZy4KClRoaXMgbGlzdCBvZiB0b3BpY3MgaXMganVzdCBh IHN0YXJ0aW5nIHBvaW50LiBUaGUgc2NvcGUgYW5kIG9yZ2FuaXphdGlvbiB3aWxsIGV2b2x2ZSBh cyB0aGUgY2hhcHRlciBpcyB3cml0dGVuLgoKQWZ0ZXIgcmVhZGluZyB0aGUgY2hhcHRlciwgdGhl IHJlYWRlciBzaG91bGQgYmUgYWJsZSB0byBkbyBhdCBsZWFzdCB0aGUgZm9sbG93aW5nOgoKKiBJ bnN0YWxsIGFuZCBjb25maWd1cmUgdGhlIG5lY2Vzc2FyeSB0ZXN0aW5nIHRvb2xzLCB0ZXN0IHN1 aXRlcywgZXRjLiBmb3IgdGhlIHB1cnBvc2VzIG9mIHRlc3RpbmcgRnJlZUJTRC4KKiBSdW4gdGVz dHMuCiogV3JpdGUgdGVzdHMuCiogU3VibWl0IHRlc3RzLgoKVGhlIGNoYXB0ZXIgd2lsbCBpbmNs dWRlIHdhbGt0aHJvdWdocyBhbmQgZ3VpZGVkIG9yIGN1bXVsYXRpdmUgZXhhbXBsZXMuCgpBdCB0 aGlzIHByZWxpbWluYXJ5IHN0YWdlLCBJIGFtIGludGVyZXN0ZWQgaW4gdGhlIGZvbGxvd2luZyBm ZWVkYmFjazoKCigxKSBXaGF0IG1hdGVyaWFsIGRvIHlvdSB3YW50IHRvIHNlZSBjb3ZlcmVkPwoo MikgV2hhdCBtYXRlcmlhbCBkbyB5b3Ugd2FudCB0byBzZWUgcHJpb3JpdGl6ZWQ/CigzKSBXaGF0 IGdlbmVyYWwgYXBwcm9hY2goZXMpIGRvIHlvdSB3YW50IHRvIHNlZSB0YWtlbiB0b3dhcmRzIHRo ZSBzdWJqZWN0IG1hdHRlcj8KKDQpIEFyZSB0aGVyZSBnb29kIGV4YW1wbGUgdGVzdHMgb3IgYXJl YXMgb2YgdGhlIGNvZGUgYmFzZSB0aGF0IGRlc2VydmUgZm9jdXMsIGVpdGhlciBiZWNhdXNlIG9m IHRoZWlyIGltcG9ydGFuY2UsIHVzZWZ1bG5lc3MgYXMgZXhhbXBsZXMsIGhpc3Rvcnkgb2YgcmVn cmVzc2lvbnMsIGV0Yy4/Cig1KSBBbnl0aGluZyBlbHNlPwoKQ2hlZXJzLApMYXdyZW5jZQo= From owner-freebsd-hackers@freebsd.org Mon Sep 14 11:00:57 2020 Return-Path: Delivered-To: freebsd-hackers@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 2B22B3D25AE for ; Mon, 14 Sep 2020 11:00:57 +0000 (UTC) (envelope-from lme@FreeBSD.org) Received: from mail.0x20.net (mail.0x20.net [46.251.251.56]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4Bqk1N1JwPz4Xpl for ; Mon, 14 Sep 2020 11:00:55 +0000 (UTC) (envelope-from lme@FreeBSD.org) Received: from 0x20.net (webs.0x20.net [46.251.251.54]) (Authenticated sender: lala) by mail.0x20.net (Postfix) with ESMTPA id 76A4AAFA48 for ; Mon, 14 Sep 2020 13:00:48 +0200 (CEST) MIME-Version: 1.0 Date: Mon, 14 Sep 2020 13:00:48 +0200 From: Lars Engels To: freebsd-hackers@freebsd.org Subject: Re: is it possible? In-Reply-To: References: <9e47e676-45bb-9fc5-87eb-41c4ba313d9c@gmail.com> User-Agent: Roundcube Webmail/1.4.7 Message-ID: <284f0efacc1f323f6b0cfb815beeed51@FreeBSD.org> X-Sender: lme@FreeBSD.org Content-Type: text/plain; charset=US-ASCII; format=flowed Content-Transfer-Encoding: 7bit X-Rspamd-Queue-Id: 4Bqk1N1JwPz4Xpl X-Spamd-Bar: / Authentication-Results: mx1.freebsd.org; none X-Spamd-Result: default: False [0.00 / 15.00]; ASN(0.00)[asn:31400, ipnet:46.251.251.0/24, country:DE]; local_wl_from(0.00)[FreeBSD.org] X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.33 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 14 Sep 2020 11:00:57 -0000 Am 2020-08-29 00:15, schrieb Wojciech Puchar: > i use xdm > i just put in my /etc/X11/Xservers > > :0 local /usr/local/bin/Xorg vt02 -nolisten tcp :0 > :1 local /usr/local/bin/Xorg vt03 -nolisten tcp :1 > > > and it works. For the records: startx -- :0 startx -- :1 does the same without using a display manager. From owner-freebsd-hackers@freebsd.org Mon Sep 14 18:52:17 2020 Return-Path: Delivered-To: freebsd-hackers@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id D1C8D3DF3F0 for ; Mon, 14 Sep 2020 18:52:17 +0000 (UTC) (envelope-from sega01@go-beyond.org) Received: from haggis.mythic-beasts.com (haggis.mythic-beasts.com [IPv6:2a00:1098:0:86:1000:0:2:1]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4BqwTD5wphz4BNx for ; Mon, 14 Sep 2020 18:52:16 +0000 (UTC) (envelope-from sega01@go-beyond.org) Received: from [174.126.78.63] (port=22650 helo=localhost) by haggis.mythic-beasts.com with esmtpsa (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.92.3) (envelope-from ) id 1kHtaC-0001vB-Ny; Mon, 14 Sep 2020 19:52:09 +0100 Date: Mon, 14 Sep 2020 18:51:59 +0000 From: Teran McKinney To: Lawrence Greening Cc: "freebsd-hackers@freebsd.org" Subject: Re: Developers' Handbook: Chapter on testing Message-ID: <20200914185159.GA25758@daemon> References: MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: X-BlackCat-Spam-Score: 4 X-Spam-Status: No, score=0.4 X-Rspamd-Queue-Id: 4BqwTD5wphz4BNx X-Spamd-Bar: -- Authentication-Results: mx1.freebsd.org; dkim=none; dmarc=none; spf=pass (mx1.freebsd.org: domain of sega01@go-beyond.org designates 2a00:1098:0:86:1000:0:2:1 as permitted sender) smtp.mailfrom=sega01@go-beyond.org X-Spamd-Result: default: False [-2.45 / 15.00]; TO_DN_EQ_ADDR_SOME(0.00)[]; RCVD_VIA_SMTP_AUTH(0.00)[]; RCVD_TLS_ALL(0.00)[]; FROM_HAS_DN(0.00)[]; TO_DN_SOME(0.00)[]; R_SPF_ALLOW(-0.20)[+ip6:2a00:1098::86:1000:0:2:1]; NEURAL_HAM_LONG(-1.05)[-1.049]; MIME_GOOD(-0.10)[text/plain]; MID_RHS_NOT_FQDN(0.50)[]; ARC_NA(0.00)[]; DMARC_NA(0.00)[go-beyond.org]; TO_MATCH_ENVRCPT_SOME(0.00)[]; RCVD_IN_DNSWL_MED(-0.20)[2a00:1098:0:86:1000:0:2:1:from]; RCPT_COUNT_TWO(0.00)[2]; NEURAL_HAM_SHORT(-0.41)[-0.410]; NEURAL_HAM_MEDIUM(-0.99)[-0.988]; FREEMAIL_TO(0.00)[outlook.com]; FROM_EQ_ENVFROM(0.00)[]; R_DKIM_NA(0.00)[]; MIME_TRACE(0.00)[0:+]; ASN(0.00)[asn:44684, ipnet:2a00:1098::/32, country:GB]; RCVD_COUNT_TWO(0.00)[2]; MAILMAN_DEST(0.00)[freebsd-hackers] X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.33 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 14 Sep 2020 18:52:17 -0000 On 2020-09-14 08-25-21 , Lawrence Greening wrote: > Hi. > ??? > A variation of the following was posted to freebsd-testing. I would generally avoid cross-posting but I'm reposting here because of recent interest in testing on this list... > > I am writing a chapter on testing for the FreeBSD Developers' Handbook. > > The following topics are expected to be covered: > > * FreeBSD Test Suite > * Kyua > * Automated Testing Framework (ATF) > * Organization of current FreeBSD tests. > * Using automation and virtualization to reduce the overhead in setting up the test infrastructure. > * Examples of different types of testing. > * Reproducibility in building and testing. > > This list of topics is just a starting point. The scope and organization will evolve as the chapter is written. > > After reading the chapter, the reader should be able to do at least the following: > > * Install and configure the necessary testing tools, test suites, etc. for the purposes of testing FreeBSD. > * Run tests. > * Write tests. > * Submit tests. > > The chapter will include walkthroughs and guided or cumulative examples. > > At this preliminary stage, I am interested in the following feedback: > > (1) What material do you want to see covered? > (2) What material do you want to see prioritized? > (3) What general approach(es) do you want to see taken towards the subject matter? > (4) Are there good example tests or areas of the code base that deserve focus, either because of their importance, usefulness as examples, history of regressions, etc.? > (5) Anything else? > > Cheers, > Lawrence > _______________________________________________ > freebsd-hackers@freebsd.org mailing list > https://lists.freebsd.org/mailman/listinfo/freebsd-hackers > To unsubscribe, send any mail to "freebsd-hackers-unsubscribe@freebsd.org" Hi Lawrence, I personally like this idea a lot. I guess it might be a bit too late for 12.2-RELEASE but maybe could land in time for 13.0-RELEASE? I also wonder if there could be a single burn-in style command to run all of the tests (after making sure the kyua package is installed) once a box is installed. Or maybe an installer option to run the tests on first boot. I think though that some are not compatible with all of the security options, so may be some conflicts there. One angle I'm curious about is vulnerability-based testing, where a vulnerability comes out and a version of the exploit becomes a test case that can be ran. Not sure how much that is used with FreeBSD though or how relevant it is, just thought I'd mention it. Thank you, Teran From owner-freebsd-hackers@freebsd.org Tue Sep 15 02:41:52 2020 Return-Path: Delivered-To: freebsd-hackers@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id AD19B3EA83F for ; Tue, 15 Sep 2020 02:41:52 +0000 (UTC) (envelope-from yaneurabeya@gmail.com) Received: from mail-pg1-x531.google.com (mail-pg1-x531.google.com [IPv6:2607:f8b0:4864:20::531]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "GTS CA 1O1" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4Br6v35N6yz4fRY for ; Tue, 15 Sep 2020 02:41:51 +0000 (UTC) (envelope-from yaneurabeya@gmail.com) Received: by mail-pg1-x531.google.com with SMTP id u13so1217175pgh.1 for ; Mon, 14 Sep 2020 19:41:51 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=mime-version:subject:from:in-reply-to:date:cc :content-transfer-encoding:message-id:references:to; bh=QGsmFN6bGVEIG66lxkIkepzPT+4f0oMS76Ox8oh9j1o=; b=djPqFRnnuO19jpd/FVFekBJDyOMxmAVMVif/fy0wVcG28jZ5IpFdlFzMJkvK3Yav+g 3PPHdE1obu7who7DGii9wIehG3RlD4ln2QhNz87qPeM4bcW4xb7++17gjJ42zLDyHK6q 9jR2Jne0Q6f5a5ISdtVKBwp5V6D12PnwrbZuBukWVhkdiuvlSX+dL+ilDNVrDiyWbU2w M+n7IKuZL+jFSlnCFTuu9R2dYLMYD3MjQLSu01wCjcH0ov8nYjE0YV2eoQG9B9ZKnbX1 /7CPnH+Z+6ATLqY6ZHyO4d3bMtm4puUqYeG40dQbxgiLxHs+EIqJZVchaxMVtJvuQTb4 TwyA== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:subject:from:in-reply-to:date:cc :content-transfer-encoding:message-id:references:to; bh=QGsmFN6bGVEIG66lxkIkepzPT+4f0oMS76Ox8oh9j1o=; b=dOJ5qE2TpKnIdKwWsVXciREdY+ogYsrkYq0hOdJu8V5LKNShW4eSJpFnSUiPY3AHbz D3yODVVehvlQcpBLlJZ8OsbsHek1yJTtPfjxa8+PwYIvnQcFzK5lMyy+Im1p677MoqQt WrqClZo+basmOBZb38a7Kry3mksZId/03eNco+ICPkInSra7JkifSsf9f3xnTdueaFEb baVrCMOPRhTVnB7Uv/nlLualCx9l26X9Cj9rTdgWtl4FOva1lMWFW3lZ+GJDHdouCshi nmWL3rHuZGrigCbGj/PiNc0rf1FYkyJtoslcnuQwE0LE+VLAOuwkuq8iMvlfUGomi5se hkzQ== X-Gm-Message-State: AOAM531J3x3Z+hHmbRJEdiyXTmZngTdiFai/9s5cBQwime6auTGKuedw iSSYD1qXNs2IpBRIQzHw+Yw= X-Google-Smtp-Source: ABdhPJyIMSg5n79VvQxXabkSpvbGIxSNPnZfuXOWu6Ca1sihtDghHWSq9qwBq+OJH2yOux4citAd3Q== X-Received: by 2002:a63:5a5d:: with SMTP id k29mr12924839pgm.51.1600137710128; Mon, 14 Sep 2020 19:41:50 -0700 (PDT) Received: from [192.168.20.26] (c-73-19-52-228.hsd1.wa.comcast.net. [73.19.52.228]) by smtp.gmail.com with ESMTPSA id c1sm11664587pfc.93.2020.09.14.19.41.49 (version=TLS1_2 cipher=ECDHE-ECDSA-AES128-GCM-SHA256 bits=128/128); Mon, 14 Sep 2020 19:41:49 -0700 (PDT) Content-Type: text/plain; charset=utf-8 Mime-Version: 1.0 (Mac OS X Mail 13.4 \(3608.120.23.2.1\)) Subject: Re: Developers' Handbook: Chapter on testing From: Enji Cooper In-Reply-To: <20200914185159.GA25758@daemon> Date: Mon, 14 Sep 2020 19:41:48 -0700 Cc: Lawrence Greening , "freebsd-hackers@freebsd.org" Content-Transfer-Encoding: quoted-printable Message-Id: <68F3C3B3-C3E6-4089-A4BF-1D5FD542FF33@gmail.com> References: <20200914185159.GA25758@daemon> To: Teran McKinney X-Mailer: Apple Mail (2.3608.120.23.2.1) X-Rspamd-Queue-Id: 4Br6v35N6yz4fRY X-Spamd-Bar: -- Authentication-Results: mx1.freebsd.org; dkim=pass header.d=gmail.com header.s=20161025 header.b=djPqFRnn; dmarc=pass (policy=none) header.from=gmail.com; spf=pass (mx1.freebsd.org: domain of yaneurabeya@gmail.com designates 2607:f8b0:4864:20::531 as permitted sender) smtp.mailfrom=yaneurabeya@gmail.com X-Spamd-Result: default: False [-2.62 / 15.00]; TO_DN_EQ_ADDR_SOME(0.00)[]; RCVD_VIA_SMTP_AUTH(0.00)[]; TO_DN_SOME(0.00)[]; FREEMAIL_FROM(0.00)[gmail.com]; MV_CASE(0.50)[]; R_SPF_ALLOW(-0.20)[+ip6:2607:f8b0:4000::/36]; RCVD_COUNT_THREE(0.00)[3]; DKIM_TRACE(0.00)[gmail.com:+]; DMARC_POLICY_ALLOW(-0.50)[gmail.com,none]; NEURAL_HAM_SHORT(-0.10)[-0.102]; RECEIVED_SPAMHAUS_PBL(0.00)[73.19.52.228:received]; FROM_EQ_ENVFROM(0.00)[]; MIME_TRACE(0.00)[0:+]; FREEMAIL_ENVFROM(0.00)[gmail.com]; MID_RHS_MATCH_FROM(0.00)[]; ASN(0.00)[asn:15169, ipnet:2607:f8b0::/32, country:US]; DWL_DNSWL_NONE(0.00)[gmail.com:dkim]; ARC_NA(0.00)[]; R_DKIM_ALLOW(-0.20)[gmail.com:s=20161025]; NEURAL_HAM_MEDIUM(-1.00)[-1.001]; FROM_HAS_DN(0.00)[]; RCPT_COUNT_THREE(0.00)[3]; NEURAL_HAM_LONG(-1.02)[-1.022]; MIME_GOOD(-0.10)[text/plain]; PREVIOUSLY_DELIVERED(0.00)[freebsd-hackers@freebsd.org]; TO_MATCH_ENVRCPT_SOME(0.00)[]; RCVD_IN_DNSWL_NONE(0.00)[2607:f8b0:4864:20::531:from]; FREEMAIL_CC(0.00)[outlook.com,freebsd.org]; RCVD_TLS_ALL(0.00)[]; MAILMAN_DEST(0.00)[freebsd-hackers] X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.33 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 15 Sep 2020 02:41:52 -0000 > On Sep 14, 2020, at 11:51 AM, Teran McKinney = wrote: =E2=80=A6 > Hi Lawrence, >=20 > I personally like this idea a lot. I guess it might be a bit too > late for 12.2-RELEASE but maybe could land in time for 13.0-RELEASE? >=20 > I also wonder if there could be a single burn-in style command to > run all of the tests (after making sure the kyua package is installed) > once a box is installed. Or maybe an installer option to run the > tests on first boot. I think though that some are not compatible > with all of the security options, so may be some conflicts there. >=20 > One angle I'm curious about is vulnerability-based testing, where > a vulnerability comes out and a version of the exploit becomes a > test case that can be ran. Not sure how much that is used with > FreeBSD though or how relevant it is, just thought I'd mention it. =E2=80=9Cmake checkworld=E2=80=9D accomplishes that if you have access = to a source tree. HTH, -Enji= From owner-freebsd-hackers@freebsd.org Tue Sep 15 00:00:02 2020 Return-Path: Delivered-To: freebsd-hackers@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 797483E5EE1; Tue, 15 Sep 2020 00:00:02 +0000 (UTC) (envelope-from owner-freebsd-quarterly-calls@freebsd.org) Received: from mailman.nyi.freebsd.org (mailman.nyi.freebsd.org [IPv6:2610:1c1:1:606c::50:13]) by mx1.freebsd.org (Postfix) with ESMTP id 4Br3JL1Hhjz4VMt; Tue, 15 Sep 2020 00:00:02 +0000 (UTC) (envelope-from owner-freebsd-quarterly-calls@freebsd.org) Delivered-To: freebsd-quarterly-calls@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id F33123E5EA6; Tue, 15 Sep 2020 00:00:00 +0000 (UTC) (envelope-from debdrup@freebsd.org) Received: from freefall.freebsd.org (freefall.freebsd.org [IPv6:2610:1c1:1:6074::16:84]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "freefall.freebsd.org", Issuer "Let's Encrypt Authority X3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4Br3JJ65DSz4VQF; Tue, 15 Sep 2020 00:00:00 +0000 (UTC) (envelope-from debdrup@freebsd.org) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1600128000; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc; bh=GsZkOQ98mtEG+Y4D3fU55qcSdX0+pLRfjUgDx/1c48s=; b=FGOZ4i4kdACyNxaPBMLQE5WpLXdfmpBxk6uakIPhNEYowKyCTIrBn0hiX7I9hNxl5BnuQK KCd5AqA37+zH8SUol7u/AN7n0pHEi9qyVQ8yuG5DbAjutELpD6o/Ts8AMpchn7/jPzyH6/ tlHkZ/OhY2FwDidf/97G/BSmh32TykPzjhlgVIgPki6aVJQ7LPgqYadGchT25PGaSLHYRn R/tcYX+b9wmACA4L/YvGvmMu8gWEhd/JXsBwFv1X7RVDt3Gg4+vmDMaRD/pwdQbrF+CyYz F2XduGDK+lqQCItx070K4IcbngHO1oNQI/YaY0D2Gd5oGWw3Tz6XCVH6LXQtiA== Received: by freefall.freebsd.org (Postfix, from userid 1471) id BE1541E953; Tue, 15 Sep 2020 00:00:00 +0000 (UTC) To: freebsd-quarterly-calls@FreeBSD.org Subject: [2 WEEKS LEFT REMINDER] Call for 2020Q3 quarterly status reports Message-Id: <20200915000000.BE1541E953@freefall.freebsd.org> Date: Tue, 15 Sep 2020 00:00:00 +0000 (UTC) From: Daniel Ebdrup Jensen ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1600128000; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc; bh=GsZkOQ98mtEG+Y4D3fU55qcSdX0+pLRfjUgDx/1c48s=; b=yi26FTLa9wuBSElSjX1YWajCBfdKht0T//hhVlvfDdry/71UgJXiZG8m2GXCqEnQW2ato+ JHo6xDN/NWcjPeSV+uCFsblvuS/dv7tSxanJw1zm6iveDZ0etIwKKWK/EAZf/fE5Z7eO7n aXzYYtvfZaGZ0le+uOmrQwLMCFQ9ahQQVCKdZh6vaXld3SSOrzxarbGrhNetAyE/GKfECO kShyL+CULM7M6g0FlqUGgzwlUmmKZPZ0Y4mm15IGQGDnpz82UMfMQi52WIMUrQvkJWKsjH vIgmxqlAsf9Vnn6Hw+Iw0ZVBzry4crbL68cfsJPNwMcQkR5ko7MHYO9s+uQ2bQ== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1600128000; a=rsa-sha256; cv=none; b=rKBjtTO/ljPTWweHwLZiXHEMLEhI+RvjW/MJBn6NSerdoQvJiINdZWset9evZMMZ0oFoOt fQh3fiO/jNK+zcvv8irKZlUcCBmkdM+xVgi2np7e3nP+H/EBDj9p/v79VoDCeCuQ3oovHh IdPW2vsd+4zra3rqS2ryjBDqCPH2sYBngqXVQ3T4glQ6i6ZjMfChcOrfJdTXHZ+RQYMcaS sQKVpn5S3jzhQXIOwDcBQqJC0Q+6SJJbhFlk0IYJbjPO8INUIfKc8D6SLwl5t/kNOk0r9y addBYJSyoLo3xl1zRbhvE6ypGHfRLCZm5l0NCEsHuZ7uKo8rxrCB6ijbS2t8dw== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-BeenThere: freebsd-quarterly-calls@freebsd.org X-Mailman-Version: 2.1.33 Precedence: list MIME-Version: 1.0 Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: 7bit Errors-To: owner-freebsd-quarterly-calls@freebsd.org Sender: owner-freebsd-quarterly-calls@freebsd.org X-Mailman-Approved-At: Tue, 15 Sep 2020 05:28:35 +0000 X-BeenThere: freebsd-hackers@freebsd.org List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 15 Sep 2020 00:00:02 -0000 Dear FreeBSD Community, The deadline for the next FreeBSD Quarterly Status update is October, 1st 2020 for work done since the last round of Quarterly Reports: July 2020 - September 2020. I would like to remind you that reports are collected during the last month of every quarter. Status report submissions do not need to be very long. They may be about anything happening in the FreeBSD project and community, and they provide a great way to inform FreeBSD users and developers about work that is underway or has been completed. Report submissions are not limited to committers; anyone doing anything interesting and FreeBSD related can -- and should -- write one! The preferred method is to follow the guidelines at the Quarterly GitHub repository: https://github.com/freebsd/freebsd-quarterly Alternatively you can fetch the Markdown template, fill it in, and email it to quarterly-submissions@FreeBSD.org. The template can be found at: https://raw.githubusercontent.com/freebsd/freebsd-quarterly/master/report-sample.md We look forward to seeing your 2020Q3 reports! Thanks, Daniel Ebdrup Jensen (on behalf of quarterly@) _______________________________________________ freebsd-quarterly-calls@freebsd.org mailing list https://lists.freebsd.org/mailman/listinfo/freebsd-quarterly-calls To unsubscribe, send any mail to "freebsd-quarterly-calls-unsubscribe@freebsd.org" From owner-freebsd-hackers@freebsd.org Tue Sep 15 14:12:20 2020 Return-Path: Delivered-To: freebsd-hackers@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 543F43D3414 for ; Tue, 15 Sep 2020 14:12:20 +0000 (UTC) (envelope-from core-secretary@freebsd.org) Received: from mailman.nyi.freebsd.org (unknown [127.0.1.3]) by mx1.freebsd.org (Postfix) with ESMTP id 4BrQCm1bCsz46M9 for ; Tue, 15 Sep 2020 14:12:20 +0000 (UTC) (envelope-from core-secretary@freebsd.org) Received: by mailman.nyi.freebsd.org (Postfix) id 368923D357C; Tue, 15 Sep 2020 14:12:20 +0000 (UTC) Delivered-To: hackers@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 3652B3D38B3 for ; Tue, 15 Sep 2020 14:12:20 +0000 (UTC) (envelope-from core-secretary@freebsd.org) Received: from mail-ej1-f46.google.com (mail-ej1-f46.google.com [209.85.218.46]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "GTS CA 1O1" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4BrQCl3FWgz46Pm for ; Tue, 15 Sep 2020 14:12:19 +0000 (UTC) (envelope-from core-secretary@freebsd.org) Received: by mail-ej1-f46.google.com with SMTP id j11so5361330ejk.0 for ; Tue, 15 Sep 2020 07:12:19 -0700 (PDT) X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:from:mime-version:date:subject:message-id:to; bh=Yv3KiMnYXYhU/xIjUd6AayxU29gpEq2xgqP94p1CPvA=; b=P/Sj83dCixlW5wenutaNrTdUTi1g6+kvqpjB6PeO/2PVumksMWELkaT2fa0NvmkWk7 21rESK329tYHuP2C6vi4YZhHQBSRGs8gXaXqPxMt06Er+ZhGl0xqPV+0yOWbskzq3xPP g/igTvVeumhBSZaFe8h4jfiias2MS6J4TR7HmhGuuixrWICWJ1EE6ctOy8gYv4jZ93V/ lvxQ4H3AtMRJd+6L3D8OAAG70IEN/gFnGll4a07QcnUThRpO5ltOlKVG1jzT/IY+I0ih PWIKNuUcgvWVAbtD51tP5Jv9VReO8Duw8BkTIv68P3mtyQ37kuAhlPCgVD2cY6/RUIKw Q3qA== X-Gm-Message-State: AOAM533lJ0jIZfUAuLbqrdUOZN5y5XIZF2Nfwx141Crk23xoNvCFtpMV 47zTFveTFWmkJZ7KtgxK9nHlO+QC X-Google-Smtp-Source: ABdhPJwtJDDnhVUEe4G+Kg/0s8VaCsuhyJVJn6AyexP1RpeozNAhpL+WVUwIQ5sZDBgUkF6iipyjCQ== X-Received: by 2002:a17:906:4cd6:: with SMTP id q22mr19898296ejt.139.1600179137885; Tue, 15 Sep 2020 07:12:17 -0700 (PDT) Received: from mx.bofh.network (mx.bofh.network. [2001:19f0:5001:2b77:5400:2ff:fe7b:aa2c]) by smtp.gmail.com with ESMTPSA id f4sm11569077edm.76.2020.09.15.07.12.15 (version=TLS1_3 cipher=TLS_AES_256_GCM_SHA384 bits=256/256); Tue, 15 Sep 2020 07:12:16 -0700 (PDT) Received: from [192.168.10.84] ( [119.18.149.8]) by mx.bofh.network (OpenSMTPD) with ESMTPSA id a5fdfacf (TLSv1.2:ECDHE-RSA-AES256-GCM-SHA384:256:NO); Tue, 15 Sep 2020 14:12:14 +0000 (UTC) From: FreeBSD Core Team Secretary Content-Type: multipart/signed; boundary="Apple-Mail=_ED8E017F-F0E3-4F5A-B32D-F6BA88E8CBFE"; protocol="application/pgp-signature"; micalg=pgp-sha512 Mime-Version: 1.0 (Mac OS X Mail 13.4 \(3608.120.23.2.1\)) Date: Tue, 15 Sep 2020 20:12:00 +0600 Subject: Core Team Office Hours Message-Id: <33FC5165-BD63-4A77-98DB-E955C50D3254@freebsd.org> To: announce@freebsd.org X-Mailer: Apple Mail (2.3608.120.23.2.1) X-Rspamd-Queue-Id: 4BrQCl3FWgz46Pm X-Spamd-Bar: / Authentication-Results: mx1.freebsd.org; none X-Spamd-Result: default: False [0.00 / 15.00]; ASN(0.00)[asn:15169, ipnet:209.85.128.0/17, country:US]; local_wl_from(0.00)[freebsd.org] X-Mailman-Approved-At: Tue, 15 Sep 2020 14:21:25 +0000 X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.33 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 15 Sep 2020 14:12:20 -0000 --Apple-Mail=_ED8E017F-F0E3-4F5A-B32D-F6BA88E8CBFE Content-Transfer-Encoding: quoted-printable Content-Type: text/plain; charset=utf-8 Based on the continuity of our last CORE Office Hours The FreeBSD CORE = Team would like to invite you all to a virtual town hall meeting. The = session is timed at 1800 UTC on 16th September, 2020. See = https://wiki.freebsd.org/OfficeHours for details on how to join either a = live stream to watch, or an interactive meeting to participate. A link = to this agenda (and any updates) will be there as well. We=E2=80=99ll be discussing the following topics and taking general = questions at the end. We=E2=80=99ll have a moderator who will help call = on people in the meeting to ask questions (or to offer comments) as well = as relay relevant questions from IRC. a. Git Transition -- To raise awareness, Ed Maste and Warner Losh will = be giving a brief presentation about the state of the project=E2=80=99s = planned transition to git. They can answer a few questions here, but are = also planning an entire office hours on the git transition (tentatively = scheduled in two weeks). b. Recruiting for project teams -- When a new core team takes over, = it=E2=80=99s a good time to assess the needs of each of the teams that = we have running different aspects of the project, such as administering = our machines and helping keep FreeBSD secure. One common theme is the = need for more help. We=E2=80=99ll discuss what teams there are, and make = a recruiting pitch and answer any questions. c. Core TODO List publishing -- To continue the openness initiative, the = core team will start publishing out TODO list. This will be in addition = to the normal meeting minutes and other openness ideas. The new core = team would love to hear from the community how to improve our = communications. d. General Questions -- Time permitting, the core team can answer any = other questions or concerns the community might have. Thanks! We look forward to meeting you. Regards, Moin (bofh), with core-secretary@ hat on --Apple-Mail=_ED8E017F-F0E3-4F5A-B32D-F6BA88E8CBFE Content-Transfer-Encoding: 7bit Content-Disposition: attachment; filename=signature.asc Content-Type: application/pgp-signature; name=signature.asc Content-Description: Message signed with OpenPGP -----BEGIN PGP SIGNATURE----- iQKTBAEBCgB9FiEES2Tp4L3ps+zAa1xm2MjIO0nybxcFAl9gy7BfFIAAAAAALgAo aXNzdWVyLWZwckBub3RhdGlvbnMub3BlbnBncC5maWZ0aGhvcnNlbWFuLm5ldDRC NjRFOUUwQkRFOUIzRUNDMDZCNUM2NkQ4QzhDODNCNDlGMjZGMTcACgkQ2MjIO0ny bxfd8hAAr1s89b/EQv6MJVxs6GA3+GdnPc1lHLUdk0O+Shw6+CcSmO6HVs/BdBUS FgfVhfsuBZizUe3F8BrKfiSjq9GKHbPjGvPrp+t627QXsy7Vlp2QGblOqAqNe+RK K/9FSDjbTALRUX3hKj5yXWZs9oNy2KvphKJlVudwnFx8P4bzNOBCFU5V/mX5EYlo 0E84LOEg2T3HD+1XPk0PB1eXiQWjOfW/YADMXr1FliuNV58uUTaXsI8Gx5QVEr4L BeBGfBO0aKbdTBbkh05G5VCLx8s+p1WVZLHbjGcsR7GWSQNjuQMreEx5wXzsOgmj /4oeLseaBaAEp57QtDnecNA5U+j3A3UdkgsgPvXoVgAiKWx1Sl/lXkP5zCgPsiMB unGc9EZZZvLpizUGVyIguTzX4MxiB+HPC76htiQgChrzwKVncBJqmT7mcgWMt1Y1 F7/IchMhqrVPQGc1vDMuxDu1hZvoH1kXXb+1uy7qwSM3knhqJ1bNYSSjuQZTvOa/ 6XOI57Nc1oV5Pr2hTHvdfrBEBWURpKNLiXo9S/HUfJ9P81UhbFMTGbjefnGrowEt XNsquICh4UJ6njiuM5x+o3mP/5ejpZmRjgYzSUBbM3ktvUUtyGxTayyNe98xxooU sbXTYvJavKZjs6sQ6yRM7o5OOVETIrsG5XOGgT2GQQiu8UFDVwQ= =70pi -----END PGP SIGNATURE----- --Apple-Mail=_ED8E017F-F0E3-4F5A-B32D-F6BA88E8CBFE-- From owner-freebsd-hackers@freebsd.org Wed Sep 16 01:45:16 2020 Return-Path: Delivered-To: freebsd-hackers@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 090493E9BCB for ; Wed, 16 Sep 2020 01:45:16 +0000 (UTC) (envelope-from eric@metricspace.net) Received: from mail.metricspace.net (mail.metricspace.net [IPv6:2001:470:1f11:617::107]) by mx1.freebsd.org (Postfix) with ESMTP id 4BrjbG4ZmKz42TQ for ; Wed, 16 Sep 2020 01:45:14 +0000 (UTC) (envelope-from eric@metricspace.net) Received: from [IPv6:2001:470:1f11:617:3210:b3ff:fe77:ca3f] (unknown [IPv6:2001:470:1f11:617:3210:b3ff:fe77:ca3f]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange ECDHE (P-384) server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) (Authenticated sender: eric) by mail.metricspace.net (Postfix) with ESMTPSA id C0C2B11BD1 for ; Wed, 16 Sep 2020 01:45:08 +0000 (UTC) Subject: Re: ZFS encryption and loader To: freebsd-hackers@freebsd.org References: <676dfde0-4202-1dc9-f90c-420fe9bbae27@metricspace.net> From: Eric McCorkle Autocrypt: addr=eric@metricspace.net; prefer-encrypt=mutual; keydata= mDMEXonLJBYJKwYBBAHaRw8BAQdA4oHU11A8qtqD0EtRofyORHbGX1ZIT/mnk9eceKQx56q0 JEVyaWMgTWNDb3JrbGUgPGVyaWNAbWV0cmljc3BhY2UubmV0PoiZBBMWCABBAhsDBQkB4TOA BQsJCAcCBhUKCQgLAgQWAgMBAh4BAheAFiEEPfuJobsx0Me4pIwLPOOjZtwQVqwFAl6JzIAC GQEACgkQPOOjZtwQVqy2DgD+IRCNNfb7C16fjEHazDMBwmBIMz+CTJUdhoz73P9iy0cA/ixK 83qOW46q1fpCpaZtPvv0FRpcZ5EppnNQ0Yuh40YLuDgEXonLJBIKKwYBBAGXVQEFAQEHQCxw rRXlvDoXgDGv2WMrLy9UaJ4fNWXIdlaiiKZIH7lBAwEIB4h+BBgWCAAmFiEEPfuJobsx0Me4 pIwLPOOjZtwQVqwFAl6JyyQCGwwFCQHhM4AACgkQPOOjZtwQVqxS7wD+JgzZC4995EL9j2iB qhPUZTIgs61IypLoDx+o1zsSfvkBALs+/jvkQL4plT0hGtfFaa0iMnLeIXKd/1FSNGSD9hQI Message-ID: Date: Tue, 15 Sep 2020 21:45:05 -0400 User-Agent: Mozilla/5.0 (X11; FreeBSD amd64; rv:68.0) Gecko/20100101 Thunderbird/68.11.0 MIME-Version: 1.0 In-Reply-To: Content-Type: multipart/signed; micalg=pgp-sha256; protocol="application/pgp-signature"; boundary="5r32fpiInMbSEEUYjgsygimlG2lS37aWF" X-Rspamd-Queue-Id: 4BrjbG4ZmKz42TQ X-Spamd-Bar: - Authentication-Results: mx1.freebsd.org; dkim=none; dmarc=none; spf=none (mx1.freebsd.org: domain of eric@metricspace.net has no SPF policy when checking 2001:470:1f11:617::107) smtp.mailfrom=eric@metricspace.net X-Spamd-Result: default: False [-1.85 / 15.00]; RCVD_VIA_SMTP_AUTH(0.00)[]; ARC_NA(0.00)[]; FREEFALL_USER(0.00)[eric]; FROM_HAS_DN(0.00)[]; TO_MATCH_ENVRCPT_ALL(0.00)[]; MID_RHS_MATCH_FROM(0.00)[]; MIME_GOOD(-0.20)[multipart/signed,multipart/mixed,text/plain]; PREVIOUSLY_DELIVERED(0.00)[freebsd-hackers@freebsd.org]; TO_DN_NONE(0.00)[]; HAS_ATTACHMENT(0.00)[]; RCPT_COUNT_ONE(0.00)[1]; AUTH_NA(1.00)[]; DMARC_NA(0.00)[metricspace.net]; NEURAL_SPAM_SHORT(0.63)[0.632]; NEURAL_HAM_LONG(-0.53)[-0.531]; NEURAL_HAM_MEDIUM(-0.85)[-0.853]; SIGNED_PGP(-2.00)[]; R_SPF_NA(0.00)[no SPF record]; RCVD_NO_TLS_LAST(0.10)[]; FROM_EQ_ENVFROM(0.00)[]; R_DKIM_NA(0.00)[]; MIME_TRACE(0.00)[0:+,1:+,2:+,3:~]; ASN(0.00)[asn:6939, ipnet:2001:470::/32, country:US]; RCVD_COUNT_TWO(0.00)[2]; MAILMAN_DEST(0.00)[freebsd-hackers] X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.33 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 16 Sep 2020 01:45:16 -0000 This is an OpenPGP/MIME signed message (RFC 4880 and 3156) --5r32fpiInMbSEEUYjgsygimlG2lS37aWF Content-Type: multipart/mixed; boundary="NX59LPpS0wFecziB6MATcQ3QdKnLWwHlv"; protected-headers="v1" From: Eric McCorkle To: freebsd-hackers@freebsd.org Message-ID: Subject: Re: ZFS encryption and loader References: <676dfde0-4202-1dc9-f90c-420fe9bbae27@metricspace.net> In-Reply-To: --NX59LPpS0wFecziB6MATcQ3QdKnLWwHlv Content-Type: text/plain; charset=utf-8 Content-Language: en-US Content-Transfer-Encoding: quoted-printable On 9/13/20 10:33 AM, Ryan Moeller wrote: > On Sat, Sep 12, 2020 at 6:46 PM Eric McCorkle wr= ote: >> >> I'm thinking of migrating to ZFS encryption from GELI in the near futu= re. >> >> Does anyone know offhand what the state of support for ZFS encryption = in >> loader looks like, and if there's support for passing keys to the kern= el >> for boot-time loading? (I can look at adding these if they're missing= ) >=20 > There is no support for ZFS encryption in loader, and nobody is working= on it. >=20 Sounds like a good way for me to get back in the game then ;) --NX59LPpS0wFecziB6MATcQ3QdKnLWwHlv-- --5r32fpiInMbSEEUYjgsygimlG2lS37aWF Content-Type: application/pgp-signature; name="signature.asc" Content-Description: OpenPGP digital signature Content-Disposition: attachment; filename="signature.asc" -----BEGIN PGP SIGNATURE----- iHUEARYIAB0WIQQ9+4mhuzHQx7ikjAs846Nm3BBWrAUCX2FuIQAKCRA846Nm3BBW rNCyAPoD8GEQgqN35DMh+ikzFj8NIR/EQWm5Hc9PcueQ4AJsiQD/QcqyuqzcaYfZ qsFAFuG1WWacxlwTse6jVfhRKMKVBgQ= =Qzvn -----END PGP SIGNATURE----- --5r32fpiInMbSEEUYjgsygimlG2lS37aWF-- From owner-freebsd-hackers@freebsd.org Wed Sep 16 01:58:38 2020 Return-Path: Delivered-To: freebsd-hackers@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id BDA863EA323 for ; Wed, 16 Sep 2020 01:58:38 +0000 (UTC) (envelope-from eric@metricspace.net) Received: from mail.metricspace.net (mail.metricspace.net [IPv6:2001:470:1f11:617::107]) by mx1.freebsd.org (Postfix) with ESMTP id 4Brjtj6ZKdz436w for ; Wed, 16 Sep 2020 01:58:37 +0000 (UTC) (envelope-from eric@metricspace.net) Received: from [IPv6:2001:470:1f11:617:3210:b3ff:fe77:ca3f] (unknown [IPv6:2001:470:1f11:617:3210:b3ff:fe77:ca3f]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange ECDHE (P-384) server-signature RSA-PSS (4096 bits)) (Client did not present a certificate) (Authenticated sender: eric) by mail.metricspace.net (Postfix) with ESMTPSA id 0F6C911B70 for ; Wed, 16 Sep 2020 01:58:37 +0000 (UTC) To: freebsd-hackers@freebsd.org References: <676dfde0-4202-1dc9-f90c-420fe9bbae27@metricspace.net> <9bbc0793-25d5-6525-fad5-c74ec836e26e@grosbein.net> From: Eric McCorkle Autocrypt: addr=eric@metricspace.net; prefer-encrypt=mutual; keydata= mDMEXonLJBYJKwYBBAHaRw8BAQdA4oHU11A8qtqD0EtRofyORHbGX1ZIT/mnk9eceKQx56q0 JEVyaWMgTWNDb3JrbGUgPGVyaWNAbWV0cmljc3BhY2UubmV0PoiZBBMWCABBAhsDBQkB4TOA BQsJCAcCBhUKCQgLAgQWAgMBAh4BAheAFiEEPfuJobsx0Me4pIwLPOOjZtwQVqwFAl6JzIAC GQEACgkQPOOjZtwQVqy2DgD+IRCNNfb7C16fjEHazDMBwmBIMz+CTJUdhoz73P9iy0cA/ixK 83qOW46q1fpCpaZtPvv0FRpcZ5EppnNQ0Yuh40YLuDgEXonLJBIKKwYBBAGXVQEFAQEHQCxw rRXlvDoXgDGv2WMrLy9UaJ4fNWXIdlaiiKZIH7lBAwEIB4h+BBgWCAAmFiEEPfuJobsx0Me4 pIwLPOOjZtwQVqwFAl6JyyQCGwwFCQHhM4AACgkQPOOjZtwQVqxS7wD+JgzZC4995EL9j2iB qhPUZTIgs61IypLoDx+o1zsSfvkBALs+/jvkQL4plT0hGtfFaa0iMnLeIXKd/1FSNGSD9hQI Subject: Re: ZFS encryption and loader Message-ID: Date: Tue, 15 Sep 2020 21:58:22 -0400 User-Agent: Mozilla/5.0 (X11; FreeBSD amd64; rv:68.0) Gecko/20100101 Thunderbird/68.11.0 MIME-Version: 1.0 In-Reply-To: <9bbc0793-25d5-6525-fad5-c74ec836e26e@grosbein.net> Content-Type: multipart/signed; micalg=pgp-sha256; protocol="application/pgp-signature"; boundary="aH9EEbGhoMDnmIazM5SNMwGIkNLTcP1Ov" X-Rspamd-Queue-Id: 4Brjtj6ZKdz436w X-Spamd-Bar: -- Authentication-Results: mx1.freebsd.org; dkim=none; dmarc=none; spf=none (mx1.freebsd.org: domain of eric@metricspace.net has no SPF policy when checking 2001:470:1f11:617::107) smtp.mailfrom=eric@metricspace.net X-Spamd-Result: default: False [-2.78 / 15.00]; RCVD_VIA_SMTP_AUTH(0.00)[]; ARC_NA(0.00)[]; FREEFALL_USER(0.00)[eric]; FROM_HAS_DN(0.00)[]; TO_MATCH_ENVRCPT_ALL(0.00)[]; MID_RHS_MATCH_FROM(0.00)[]; MIME_GOOD(-0.20)[multipart/signed,multipart/mixed,text/plain]; PREVIOUSLY_DELIVERED(0.00)[freebsd-hackers@freebsd.org]; TO_DN_NONE(0.00)[]; HAS_ATTACHMENT(0.00)[]; RCPT_COUNT_ONE(0.00)[1]; AUTH_NA(1.00)[]; DMARC_NA(0.00)[metricspace.net]; NEURAL_HAM_LONG(-0.52)[-0.524]; NEURAL_HAM_SHORT(-0.31)[-0.312]; NEURAL_HAM_MEDIUM(-0.84)[-0.845]; SIGNED_PGP(-2.00)[]; R_SPF_NA(0.00)[no SPF record]; RCVD_NO_TLS_LAST(0.10)[]; FROM_EQ_ENVFROM(0.00)[]; R_DKIM_NA(0.00)[]; MIME_TRACE(0.00)[0:+,1:+,2:+,3:~]; ASN(0.00)[asn:6939, ipnet:2001:470::/32, country:US]; RCVD_COUNT_TWO(0.00)[2]; MAILMAN_DEST(0.00)[freebsd-hackers] X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.33 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 16 Sep 2020 01:58:38 -0000 This is an OpenPGP/MIME signed message (RFC 4880 and 3156) --aH9EEbGhoMDnmIazM5SNMwGIkNLTcP1Ov Content-Type: multipart/mixed; boundary="Jgu6imFkkefZzGhumHpk2HcuJVHEHzMCI"; protected-headers="v1" From: Eric McCorkle To: freebsd-hackers@freebsd.org Message-ID: Subject: Re: ZFS encryption and loader References: <676dfde0-4202-1dc9-f90c-420fe9bbae27@metricspace.net> <9bbc0793-25d5-6525-fad5-c74ec836e26e@grosbein.net> In-Reply-To: <9bbc0793-25d5-6525-fad5-c74ec836e26e@grosbein.net> --Jgu6imFkkefZzGhumHpk2HcuJVHEHzMCI Content-Type: text/plain; charset=utf-8 Content-Language: en-US Content-Transfer-Encoding: quoted-printable On 9/12/20 9:37 PM, Eugene Grosbein wrote: > 13.09.2020 5:46, Eric McCorkle wrote: >=20 >> I'm thinking of migrating to ZFS encryption from GELI in the near futu= re. >> >> Does anyone know offhand what the state of support for ZFS encryption = in >> loader looks like, and if there's support for passing keys to the kern= el >> for boot-time loading? (I can look at adding these if they're missing= ) >=20 > Recently I've learned from one of ZoL maintainers that native > ZFS encryption is not so comprehensive as GELI. >=20 > I've been told that native ZFS encryption was initially designed for on= e specific task: > being able to receive encrypted customer data (backups), verify its int= egrity without decryption, > store and then receive incremental backups later. Therefore, not all da= ta is hidden with encryption, > for example, dataset names and some other metadata are not. >=20 I've looked into this prior, and you're right. The metadata that remains unencrypted shouldn't be a security risk, unless you're leaking info through your dataset names or something. I don't know enough about ZFS to know whether encryption for that stuff could be added later. One big advantage you get is per-block single-use keys and tight integration of AEAD. I would regard this as more trustworthy than repeatedly encrypting with the same key. It also opens the door to some interesting proactive security features. --Jgu6imFkkefZzGhumHpk2HcuJVHEHzMCI-- --aH9EEbGhoMDnmIazM5SNMwGIkNLTcP1Ov Content-Type: application/pgp-signature; name="signature.asc" Content-Description: OpenPGP digital signature Content-Disposition: attachment; filename="signature.asc" -----BEGIN PGP SIGNATURE----- iHUEARYIAB0WIQQ9+4mhuzHQx7ikjAs846Nm3BBWrAUCX2FxPgAKCRA846Nm3BBW rF7gAQCoqDVW+xhZqCZ+Ry7d8bXuXrq54HPi4hts7jGSDpYudgEA9C70PU6gugBg WvlQevEUEUBtNNo5FYTi8w40xq4JGAI= =55af -----END PGP SIGNATURE----- --aH9EEbGhoMDnmIazM5SNMwGIkNLTcP1Ov-- From owner-freebsd-hackers@freebsd.org Wed Sep 16 04:16:50 2020 Return-Path: Delivered-To: freebsd-hackers@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 61C073EC8B6 for ; Wed, 16 Sep 2020 04:16:50 +0000 (UTC) (envelope-from ota@j.email.ne.jp) Received: from mail03.asahi-net.or.jp (mail03.asahi-net.or.jp [202.224.55.15]) by mx1.freebsd.org (Postfix) with ESMTP id 4Brmy82LRzz49Ky for ; Wed, 16 Sep 2020 04:16:47 +0000 (UTC) (envelope-from ota@j.email.ne.jp) Received: from vmware.advok.com (cpe-184-152-96-96.nj.res.rr.com [184.152.96.96]) (Authenticated sender: NR2Y-OOT) by mail03.asahi-net.or.jp (Postfix) with ESMTPSA id 9E4262FF02; Wed, 16 Sep 2020 13:16:44 +0900 (JST) Date: Wed, 16 Sep 2020 00:16:00 -0400 From: Yoshihiro Ota To: Lawrence Greening Cc: ota@j.email.ne.jp, "freebsd-hackers@freebsd.org" Subject: Re: Developers' Handbook: Chapter on testing Message-Id: <20200916001600.9741e3230466be3a0e1ad098@j.email.ne.jp> In-Reply-To: References: X-Mailer: Sylpheed 3.7.0 (GTK+ 2.24.32; i386-portbld-freebsd12.0) Mime-Version: 1.0 Content-Type: text/plain; charset=ISO-2022-JP Content-Transfer-Encoding: 7bit X-Rspamd-Queue-Id: 4Brmy82LRzz49Ky X-Spamd-Bar: -- Authentication-Results: mx1.freebsd.org; dkim=none; dmarc=none; spf=pass (mx1.freebsd.org: domain of ota@j.email.ne.jp designates 202.224.55.15 as permitted sender) smtp.mailfrom=ota@j.email.ne.jp X-Spamd-Result: default: False [-2.55 / 15.00]; TO_DN_EQ_ADDR_SOME(0.00)[]; RCVD_VIA_SMTP_AUTH(0.00)[]; TO_DN_SOME(0.00)[]; MV_CASE(0.50)[]; R_SPF_ALLOW(-0.20)[+ip4:202.224.55.0/24]; NEURAL_HAM_SHORT(-0.74)[-0.739]; FREEMAIL_TO(0.00)[outlook.com]; RCVD_NO_TLS_LAST(0.10)[]; RCVD_IN_DNSWL_LOW(-0.10)[202.224.55.15:from]; FROM_EQ_ENVFROM(0.00)[]; R_DKIM_NA(0.00)[]; RECEIVED_SPAMHAUS_PBL(0.00)[184.152.96.96:received]; MIME_TRACE(0.00)[0:+]; MID_RHS_MATCH_FROM(0.00)[]; RWL_MAILSPIKE_NEUTRAL(0.00)[202.224.55.15:from]; ARC_NA(0.00)[]; NEURAL_HAM_MEDIUM(-1.00)[-0.997]; ASN(0.00)[asn:4685, ipnet:202.224.32.0/19, country:JP]; FROM_HAS_DN(0.00)[]; RCPT_COUNT_THREE(0.00)[3]; NEURAL_HAM_LONG(-1.02)[-1.017]; MIME_GOOD(-0.10)[text/plain]; DMARC_NA(0.00)[email.ne.jp]; TO_MATCH_ENVRCPT_SOME(0.00)[]; RCVD_COUNT_TWO(0.00)[2]; MAILMAN_DEST(0.00)[freebsd-hackers] X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.33 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 16 Sep 2020 04:16:50 -0000 Hi, My responses are embedded below. By the way, is it okay to continue here or should I join freebst-testing? On Mon, 14 Sep 2020 08:25:21 +0000 Lawrence Greening wrote: > Hi. > $B".(B > A variation of the following was posted to freebsd-testing. I would generally avoid cross-posting > but I'm reposting here because of recent interest in testing on this list... > > I am writing a chapter on testing for the FreeBSD Developers' Handbook. > > The following topics are expected to be covered: > > * FreeBSD Test Suite > * Kyua > * Automated Testing Framework (ATF) > * Organization of current FreeBSD tests. > * Using automation and virtualization to reduce the overhead in setting up the test > infrastructure. > * Examples of different types of testing. > * Reproducibility in building and testing. > > This list of topics is just a starting point. The scope and organization will evolve as the > chapter is written. > > After reading the chapter, the reader should be able to do at least the following: > > * Install and configure the necessary testing tools, test suites, etc. for the purposes of > testing FreeBSD. > * Run tests. > * Write tests. > * Submit tests. > > The chapter will include walkthroughs and guided or cumulative examples. That sounds a good starting point and what I started looking around. I found some extra documents below after posting my previous question. Mark and Warner's responses were also helpful to understand further. https://wiki.freebsd.org/TestSuite https://wiki.freebsd.org/TestSuite/DeveloperHowTo https://wiki.freebsd.org/TestSuite/Structure These wiki covers some of topics above. > At this preliminary stage, I am interested in the following feedback: > > (1) What material do you want to see covered? In addition to the list you have, topics on kernel code will be great. > (2) What material do you want to see prioritized? My personal interest is step by step guide to setup a test environment and one or few examples of how to start writing additional test cases. > (3) What general approach(es) do you want to see taken towards the subject matter? We need a good test coverage and start writing more test cases. My suggestion is lowering bar with good documents with examples to encourage people writing more test cases. Then, I'd like to have code-coverage tool run together. Then, I can check how/if my new code reduced test coverage and my new test cases increased test coverage. It will be even nicer if all tests are run by Jenkins and phabricator bounces back ones with broken test cases. > (4) Are there good example tests or areas of the code base that deserve focus, either because of > their importance, usefulness as examples, history of regressions, etc.? Not familiar enough on FreeBSD test case but I recently realized some of user land programs actively adding more test cases from svn mailing list. That's a good trend. > (5) Anything else? In my experiences, I like unit test cases at C/C++ API level. These allow me to test same scenarios over and over again each time I make a change. These also detect un-intended behavior changes. Unit test cases also pays off very quickly. I also think integration tests are important but some programs like client/server have extra difficulties. > Cheers, > Lawrence Regards, Hiro From owner-freebsd-hackers@freebsd.org Wed Sep 16 06:52:48 2020 Return-Path: Delivered-To: freebsd-hackers@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 8E7583D975A for ; Wed, 16 Sep 2020 06:52:48 +0000 (UTC) (envelope-from weh@microsoft.com) Received: from APC01-PU1-obe.outbound.protection.outlook.com (mail-eopbgr1320105.outbound.protection.outlook.com [40.107.132.105]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client CN "mail.protection.outlook.com", Issuer "GlobalSign Organization Validation CA - SHA256 - G3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4BrrQ70bDdz4Kmx for ; Wed, 16 Sep 2020 06:52:46 +0000 (UTC) (envelope-from weh@microsoft.com) ARC-Seal: i=1; a=rsa-sha256; s=arcselector9901; d=microsoft.com; cv=none; b=KP0CwbCtXXqLJeJY+PZ/fw+K68P50HFHjGIscIXi1gDpCX13aY+dFbnnJLNMTdl5GHBq6kQPXDMRK6zbZnzgfqOhYxySu4YjXWUnvtHxBqa/P/s7KF3f0iIYHXgeDunFOiFKQGprRixeYNxSV7rc3q0qpj+r6YIa0WIv5o9dgrCtpJRZ7LFe8ZhmSwpDO/e7pj4phrTA/borYX9zquqW2yx4PJDgOdgOIGeIPtf5MF+yEoTIVXFIgw4GKyZtUzEDfigyOsgx2fsD4r5GHyDgJn99ggPlYDrnEkGNb1yPHoEhezc8DPA31iChlX/Fft7ht+C0qq6eR2uQ09CMNT+dWg== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=microsoft.com; s=arcselector9901; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=fxUT2SrVF8C7K5J7ywkewurRY7ph7m0sFyBkTW+lsHA=; b=YC9lRxYtsa3n1jZIVEETRdNdOHuLvU5r7TX0/778ENV4RGwfIoVRrgm4IrdCqGCsUYrOH2pVoXJc2PnsnX8jm1On5TbJd+cNgO26AQqL7u2CfGwtfszZZiH0BrQdxxnLYebEb68BHrkzBaFZ3HEL0pGQJhsG1gZ3UeSIxk1u4earx2ymLMkM11MBbxUBYSJXn6OPMYdLdS5yU4hlMdukFSe63CK3lWUfymKpXKTwqb9/TPjVu2KkzQ9YZMgR5j0PgWouwPYVJm3LriKh1NEl1U9ZpxoLwc1IPjU10alMpp8UqZPBRZ8eEyCAgpwRZA5qERhNU4E/N+pGfEBfJd1joQ== ARC-Authentication-Results: i=1; mx.microsoft.com 1; spf=pass smtp.mailfrom=microsoft.com; dmarc=pass action=none header.from=microsoft.com; dkim=pass header.d=microsoft.com; arc=none Received: from SG2P153MB0352.APCP153.PROD.OUTLOOK.COM (2603:1096:4:d4::23) by SG2P15301MB0015.APCP153.PROD.OUTLOOK.COM (2603:1096:3:f::20) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.3412.1; Wed, 16 Sep 2020 06:52:43 +0000 Received: from SG2P153MB0352.APCP153.PROD.OUTLOOK.COM ([fe80::e1d4:23b8:2c19:4745]) by SG2P153MB0352.APCP153.PROD.OUTLOOK.COM ([fe80::e1d4:23b8:2c19:4745%6]) with mapi id 15.20.3412.003; Wed, 16 Sep 2020 06:52:43 +0000 From: Wei Hu To: "freebsd-hackers@freebsd.org" Subject: MSR accesses that slows down the hypervisor/host Thread-Topic: MSR accesses that slows down the hypervisor/host Thread-Index: AdaL9HYbtJyLPxf3TL+CSKzmJaxdTw== Date: Wed, 16 Sep 2020 06:52:42 +0000 Message-ID: Accept-Language: en-US Content-Language: en-US X-MS-Has-Attach: X-MS-TNEF-Correlator: x-originating-ip: [167.220.255.32] x-ms-publictraffictype: Email x-ms-office365-filtering-ht: Tenant x-ms-office365-filtering-correlation-id: 71dba7f1-3113-42b6-6082-08d85a0d1c7d x-ms-traffictypediagnostic: SG2P15301MB0015: x-microsoft-antispam-prvs: x-ms-oob-tlc-oobclassifiers: OLM:9508; x-ms-exchange-senderadcheck: 1 x-microsoft-antispam: BCL:0; x-microsoft-antispam-message-info: WHIv/GCak8gHNMSxqxQgfcDpeYNnL4H45D0PuDiWag15YxTMZEv2wwMWKAIU+06Prw097mI0kYtvTuNVEiFmC4p7e+tMpI2YWo0bcliXzuPxqNxEhXgT6Fi++ZKxfyLbq5XbeOJZ81iGECI2Nz9agqkqPScvAcPYh7qhvm9zVmrzxjWleE8ip9r2yndyhD1ZgoAbLrle5vmCJNekoxmho+cKIoZbWG6e67EP1AdcPxAJPNvaBCZLpbpbOYtMe7FIk1DL6kHiHrKUk0wxJpvYq8RvJsmKml1WZsFkrLG6jHmYIaGQ0TBSDovJiUdZFk5pc06qZTC4KCJshVMkOcfT2O3lxTHGjDyERuQ0k44MSPolwUalNJYvqsO2bnjiV8CL x-forefront-antispam-report: CIP:255.255.255.255; CTRY:; LANG:en; SCL:1; SRV:; IPV:NLI; SFV:NSPM; H:SG2P153MB0352.APCP153.PROD.OUTLOOK.COM; PTR:; CAT:NONE; SFS:(4636009)(376002)(366004)(346002)(136003)(396003)(39860400002)(5660300002)(10290500003)(316002)(26005)(478600001)(83380400001)(6916009)(82960400001)(82950400001)(9686003)(6506007)(55016002)(186003)(7696005)(86362001)(52536014)(8936002)(33656002)(66946007)(76116006)(8990500004)(71200400001)(66476007)(66556008)(66446008)(64756008)(8676002)(4744005)(2906002); DIR:OUT; SFP:1102; x-ms-exchange-antispam-messagedata: W4Yv1szSfAXzx90kaBIqwg37qPLWwlZxHDoxI/uv/X1y603EeeLAeLVBxungrPWGIMqcsFLOrh5vV/l4jv3vLyeEifbnCBaHtF/hUM5PRCPC9Uw+heIC2it12omMpRHnBDbY/dtLWHapgOUmsQfZVftfzzyBQl+5xvq6FYdjrNpH1+E9V28l/ZD03I9UCeafeGMlYwzExVp/ifeOHsAlnmOE1Q+W8EGer9XC8DMLy/eGKluCObyWQPt0ty22hUr4r6ozAbB7N36Iqpiib9kIjyqAgN6g3Wct0nngKd8RTlaMoLhpwbWt8dnAu2xayCXU9SLuhVOeyMde6XKcBzvSg/k8Oy2a8FeO5z0y02ehtZACOrUBmHJKdOxcAKy1SJny0hqfW/jvFnPgkeuAoCwYdYLs/eKODgHv5CBgNfG+TI91ZMB7NrBDrzLSVmYa2Mhs9gDFrmybnac109s5nHs39BHue/JWjHh1f9bIphX0fDCCRvEVlKZgrN/D4D16YAJruChQeqXtfFsmOPn1nQ/b9PFGNI7rBYaiHbCM6WuaXHD+DvpPBOx+rfGcg8eVb3sSjGx2axhEPf3+k5Erlk7+LcnzCPdFvJZHoD0seFzSL4EKO3wC1tEUgdPIxasnT8lSHBMIdxWBUUnn0f9MIZthkA== x-ms-exchange-transport-forked: True Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: quoted-printable MIME-Version: 1.0 X-OriginatorOrg: microsoft.com X-MS-Exchange-CrossTenant-AuthAs: Internal X-MS-Exchange-CrossTenant-AuthSource: SG2P153MB0352.APCP153.PROD.OUTLOOK.COM X-MS-Exchange-CrossTenant-Network-Message-Id: 71dba7f1-3113-42b6-6082-08d85a0d1c7d X-MS-Exchange-CrossTenant-originalarrivaltime: 16 Sep 2020 06:52:42.7301 (UTC) X-MS-Exchange-CrossTenant-fromentityheader: Hosted X-MS-Exchange-CrossTenant-id: 72f988bf-86f1-41af-91ab-2d7cd011db47 X-MS-Exchange-CrossTenant-mailboxtype: HOSTED X-MS-Exchange-CrossTenant-userprincipalname: UkTMC4WpUZGhgllLxki6Xu8qgOXWRXsojdtc8ylfj/yr7Pl9VnSENMZiroFnRE38WFvwMI1qNuyYeyDn9CoghA== X-MS-Exchange-Transport-CrossTenantHeadersStamped: SG2P15301MB0015 X-Rspamd-Queue-Id: 4BrrQ70bDdz4Kmx X-Spamd-Bar: --------- X-Spamd-Result: default: False [-9.95 / 15.00]; NEURAL_HAM_MEDIUM(-1.02)[-1.016]; R_DKIM_ALLOW(-0.20)[microsoft.com:s=selector2]; HAS_XOIP(0.00)[]; FROM_HAS_DN(0.00)[]; DWL_DNSWL_MED(-2.00)[microsoft.com:dkim]; TO_MATCH_ENVRCPT_ALL(0.00)[]; R_SPF_ALLOW(-0.20)[+ip4:40.107.0.0/16]; MIME_GOOD(-0.10)[text/plain]; NEURAL_HAM_LONG(-1.00)[-1.005]; RCPT_COUNT_ONE(0.00)[1]; RCVD_COUNT_THREE(0.00)[3]; WHITELIST_SPF_DKIM(-3.00)[microsoft.com:d:+,microsoft.com:s:+]; DKIM_TRACE(0.00)[microsoft.com:+]; DMARC_POLICY_ALLOW(-0.50)[microsoft.com,reject]; RCVD_IN_DNSWL_LOW(-0.10)[40.107.132.105:from]; TO_DN_EQ_ADDR_ALL(0.00)[]; NEURAL_HAM_SHORT(-0.83)[-0.830]; FROM_EQ_ENVFROM(0.00)[]; MIME_TRACE(0.00)[0:+]; RCVD_TLS_LAST(0.00)[]; ASN(0.00)[asn:8075, ipnet:40.104.0.0/14, country:US]; ARC_ALLOW(-1.00)[microsoft.com:s=arcselector9901:i=1]; MAILMAN_DEST(0.00)[freebsd-hackers]; RWL_MAILSPIKE_POSSIBLE(0.00)[40.107.132.105:from] X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.33 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 16 Sep 2020 06:52:48 -0000 Hello, There are couple AMD processor related MSRs which are being accessed in Fre= eBSD.=20 #define MSR_AMDK8_IPM 0xc0010055 #define MSR_LS_CFG 0xc0011020 We are seeing a lot of CPU time being spent in the host (Hyper-V) in handli= ng traps when accessing these MSRs. Especially the first MRS is frequently = being accessed in cpu_idle() so the performance impact to host is significa= nt. We noted that Linux made some code changes in the 4.10 kernel to access the= first MSR much less frequently. So we are wondering if there are similar c= hanges in FreeBSD that might be in the plan. Microsoft Hyper-V team is also= planning some work to speed up the accesses to these MSRs. However any sug= gestions or plan to improve in the FreeBSD guest are welcome. Thanks, Wei From owner-freebsd-hackers@freebsd.org Wed Sep 16 13:57:37 2020 Return-Path: Delivered-To: freebsd-hackers@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 54D893E68A0 for ; Wed, 16 Sep 2020 13:57:37 +0000 (UTC) (envelope-from kostikbel@gmail.com) Received: from kib.kiev.ua (kib.kiev.ua [IPv6:2001:470:d5e7:1::1]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4Bs1rH6hFyz3XLk for ; Wed, 16 Sep 2020 13:57:35 +0000 (UTC) (envelope-from kostikbel@gmail.com) Received: from tom.home (kib@localhost [127.0.0.1]) by kib.kiev.ua (8.16.1/8.16.1) with ESMTPS id 08GDvRge054685 (version=TLSv1.3 cipher=TLS_AES_256_GCM_SHA384 bits=256 verify=NO); Wed, 16 Sep 2020 16:57:31 +0300 (EEST) (envelope-from kostikbel@gmail.com) DKIM-Filter: OpenDKIM Filter v2.10.3 kib.kiev.ua 08GDvRge054685 Received: (from kostik@localhost) by tom.home (8.16.1/8.16.1/Submit) id 08GDvRa6054684; Wed, 16 Sep 2020 16:57:27 +0300 (EEST) (envelope-from kostikbel@gmail.com) X-Authentication-Warning: tom.home: kostik set sender to kostikbel@gmail.com using -f Date: Wed, 16 Sep 2020 16:57:27 +0300 From: Konstantin Belousov To: Wei Hu Cc: "freebsd-hackers@freebsd.org" Subject: Re: MSR accesses that slows down the hypervisor/host Message-ID: <20200916135727.GO94807@kib.kiev.ua> References: MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: X-Spam-Status: No, score=-1.0 required=5.0 tests=ALL_TRUSTED,BAYES_00, DKIM_ADSP_CUSTOM_MED,FORGED_GMAIL_RCVD,FREEMAIL_FROM, NML_ADSP_CUSTOM_MED autolearn=no autolearn_force=no version=3.4.4 X-Spam-Checker-Version: SpamAssassin 3.4.4 (2020-01-24) on tom.home X-Rspamd-Queue-Id: 4Bs1rH6hFyz3XLk X-Spamd-Bar: / Authentication-Results: mx1.freebsd.org; dkim=none; dmarc=fail reason="No valid SPF, No valid DKIM" header.from=gmail.com (policy=none); spf=softfail (mx1.freebsd.org: 2001:470:d5e7:1::1 is neither permitted nor denied by domain of kostikbel@gmail.com) smtp.mailfrom=kostikbel@gmail.com X-Spamd-Result: default: False [-0.16 / 15.00]; ARC_NA(0.00)[]; TO_DN_EQ_ADDR_SOME(0.00)[]; DMARC_POLICY_SOFTFAIL(0.10)[gmail.com : No valid SPF, No valid DKIM,none]; RCVD_TLS_ALL(0.00)[]; FROM_HAS_DN(0.00)[]; TO_DN_SOME(0.00)[]; FREEMAIL_FROM(0.00)[gmail.com]; NEURAL_HAM_LONG(-0.78)[-0.779]; MIME_GOOD(-0.10)[text/plain]; HAS_XAW(0.00)[]; NEURAL_HAM_MEDIUM(-0.10)[-0.096]; R_SPF_SOFTFAIL(0.00)[~all:c]; NEURAL_SPAM_SHORT(0.71)[0.714]; TO_MATCH_ENVRCPT_SOME(0.00)[]; RCPT_COUNT_TWO(0.00)[2]; FROM_EQ_ENVFROM(0.00)[]; R_DKIM_NA(0.00)[]; FREEMAIL_ENVFROM(0.00)[gmail.com]; ASN(0.00)[asn:6939, ipnet:2001:470::/32, country:US]; MIME_TRACE(0.00)[0:+]; MAILMAN_DEST(0.00)[freebsd-hackers]; RCVD_COUNT_TWO(0.00)[2] X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.33 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 16 Sep 2020 13:57:37 -0000 On Wed, Sep 16, 2020 at 06:52:42AM +0000, Wei Hu via freebsd-hackers wrote: > Hello, > > There are couple AMD processor related MSRs which are being accessed in FreeBSD. > > #define MSR_AMDK8_IPM 0xc0010055 > #define MSR_LS_CFG 0xc0011020 > > We are seeing a lot of CPU time being spent in the host (Hyper-V) in handling traps when accessing these MSRs. Especially the first MRS is frequently being accessed in cpu_idle() so the performance impact to host is significant. > > We noted that Linux made some code changes in the 4.10 kernel to access the first MSR much less frequently. So we are wondering if there are similar changes in FreeBSD that might be in the plan. Microsoft Hyper-V team is also planning some work to speed up the accesses to these MSRs. However any suggestions or plan to improve in the FreeBSD guest are welcome. > Where do you see accesses to MSR_LS_CFG ? I can only find manipulations of that MSR in init_amd(), and then it is all under check that we are not virtualized. For MSR_AMDK8_IPM access in cpu_idle(), it seems that the workaround was applied too wide. It might be that we do not need to do it on recent CPUs, but I need to spent more time looking at datasheets to confirm/deny. But, do you (hypervisor) indeed allow guest to initiate C1 or deeper idle state ? If not, perhaps as the first measure, we can avoid manipulating MSR_AMDK8_IPM under hypervisor at all. From owner-freebsd-hackers@freebsd.org Wed Sep 16 20:02:32 2020 Return-Path: Delivered-To: freebsd-hackers@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id E79343EF9CD for ; Wed, 16 Sep 2020 20:02:32 +0000 (UTC) (envelope-from agapon@gmail.com) Received: from mail-lj1-f173.google.com (mail-lj1-f173.google.com [209.85.208.173]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "GTS CA 1O1" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4Bs9xM65J0z4CMj for ; Wed, 16 Sep 2020 20:02:31 +0000 (UTC) (envelope-from agapon@gmail.com) Received: by mail-lj1-f173.google.com with SMTP id r24so7034663ljm.3 for ; Wed, 16 Sep 2020 13:02:31 -0700 (PDT) X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:subject:to:cc:references:from:openpgp:autocrypt :message-id:date:user-agent:mime-version:in-reply-to :content-language:content-transfer-encoding; bh=FuSFqhnww5g6YakjmCjfYih8fjHm+8t0eibP1A2sz6A=; b=eFGzulkFFaZiQ8INH3jvnBHjSFUoRtRCOOl5cceKiZ9CgcliIg2mmr90MGmvDDbNAn jnp8+YMEND1sYZPPT+sACfJ63W0mZfsTh4xRxZQ+ULgHoUME4HoSUhOlBVBFotcPR/Dm EIN8bIBCD0xHeVRYMvzGCPuPq/V+CH6+DYIA7DUsdEA5RBudOun9NkL3pPU+S+O2opQ+ qJ2skTVgYIoB79Vwx65mWgc8DZnA3UplcPJqM1a7/YL6ZkTrmhXL3rXsKfiZffJVw76n 3qd28mbbLYj6VEIhFSdKZmzfKHkDd5sZA/st7kcsh61np/ffa3TQR5j8jsezejMMLSd4 maxQ== X-Gm-Message-State: AOAM533HErFHyMO8SRuajmBa6ORjas16Ynlh8yO0YW2P3fICDYICyC5f 5BsWoxKYerq/cxeGJ+CY25aTZpql03Q= X-Google-Smtp-Source: ABdhPJxc4DVnEtGQUgxQ+M7m/64qVnOlEZN4FKZD+lYGsmBFZxsHpjTPkofDi9ymX4TSLJYun0ICUw== X-Received: by 2002:a05:651c:1188:: with SMTP id w8mr9834385ljo.344.1600286549510; Wed, 16 Sep 2020 13:02:29 -0700 (PDT) Received: from [192.168.0.88] (east.meadow.volia.net. [93.72.151.96]) by smtp.googlemail.com with ESMTPSA id j4sm5554880lja.31.2020.09.16.13.02.28 (version=TLS1_3 cipher=TLS_AES_128_GCM_SHA256 bits=128/128); Wed, 16 Sep 2020 13:02:28 -0700 (PDT) Subject: Re: MSR accesses that slows down the hypervisor/host To: Konstantin Belousov , Wei Hu Cc: "freebsd-hackers@freebsd.org" References: <20200916135727.GO94807@kib.kiev.ua> From: Andriy Gapon Openpgp: preference=signencrypt Autocrypt: addr=avg@FreeBSD.org; prefer-encrypt=mutual; keydata= mDMEX1iFDhYJKwYBBAHaRw8BAQdAiu8JG/oLFkVkOAJqJc7Dx5KI/Q6C3SBI20EQm+DXnAu0 HkFuZHJpeSBHYXBvbiA8YXZnQEZyZWVCU0Qub3JnPoiWBBMWCAA+FiEEyCHHZM09l0OE3Ir/ 1A1+Gq8+L1EFAl9YhQ4CGwMFCQeEzgAFCwkIBwIGFQoJCAsCBBYCAwECHgECF4AACgkQ1A1+ Gq8+L1Fc0wD/ZjmhHfbCJywZU3aOxXIPjcz73FYEGMvqMCCLAWyLbSABALFL+1ZNrjV3BGjq 889cOYFuboA/Yn3eWezS+tfqYBsGuDgEX1iFDhIKKwYBBAGXVQEFAQEHQL6B20Xi600TrkpG P9fWjl7JtHNxqrHKhX6Kg7kgb4ILAwEIB4h+BBgWCAAmFiEEyCHHZM09l0OE3Ir/1A1+Gq8+ L1EFAl9YhQ4CGwwFCQeEzgAACgkQ1A1+Gq8+L1F3cgEAktp4h+IJUJxL1vn6zMOt//znni/J TanKfQuA8wGXcGkBAKpZJhqMkg+pKk7MGvJhgJ6nCpTZ+rMK6vZVZLUWc3QF Message-ID: <6d17f16e-d672-11e1-eabc-e9d64bc13ff4@FreeBSD.org> Date: Wed, 16 Sep 2020 23:02:27 +0300 User-Agent: Mozilla/5.0 (X11; FreeBSD amd64; rv:60.0) Gecko/20100101 Firefox/60.0 Thunderbird/60.9.0 MIME-Version: 1.0 In-Reply-To: <20200916135727.GO94807@kib.kiev.ua> Content-Type: text/plain; charset=utf-8 Content-Language: en-US Content-Transfer-Encoding: 7bit X-Rspamd-Queue-Id: 4Bs9xM65J0z4CMj X-Spamd-Bar: -- Authentication-Results: mx1.freebsd.org; dkim=none; dmarc=none; spf=pass (mx1.freebsd.org: domain of agapon@gmail.com designates 209.85.208.173 as permitted sender) smtp.mailfrom=agapon@gmail.com X-Spamd-Result: default: False [-2.23 / 15.00]; TO_DN_EQ_ADDR_SOME(0.00)[]; RCVD_VIA_SMTP_AUTH(0.00)[]; TO_DN_SOME(0.00)[]; R_SPF_ALLOW(-0.20)[+ip4:209.85.128.0/17]; RCVD_COUNT_THREE(0.00)[3]; NEURAL_HAM_SHORT(-0.25)[-0.254]; FREEMAIL_TO(0.00)[gmail.com,microsoft.com]; FORGED_SENDER(0.30)[avg@FreeBSD.org,agapon@gmail.com]; RECEIVED_SPAMHAUS_PBL(0.00)[93.72.151.96:received]; MIME_TRACE(0.00)[0:+]; R_DKIM_NA(0.00)[]; FREEMAIL_ENVFROM(0.00)[gmail.com]; MID_RHS_MATCH_FROM(0.00)[]; FROM_NEQ_ENVFROM(0.00)[avg@FreeBSD.org,agapon@gmail.com]; ASN(0.00)[asn:15169, ipnet:209.85.128.0/17, country:US]; ARC_NA(0.00)[]; NEURAL_HAM_MEDIUM(-0.97)[-0.966]; FROM_HAS_DN(0.00)[]; RCPT_COUNT_THREE(0.00)[3]; NEURAL_HAM_LONG(-1.01)[-1.012]; MIME_GOOD(-0.10)[text/plain]; PREVIOUSLY_DELIVERED(0.00)[freebsd-hackers@freebsd.org]; DMARC_NA(0.00)[FreeBSD.org]; TO_MATCH_ENVRCPT_SOME(0.00)[]; RCVD_IN_DNSWL_NONE(0.00)[209.85.208.173:from]; RWL_MAILSPIKE_POSSIBLE(0.00)[209.85.208.173:from]; RCVD_TLS_ALL(0.00)[]; MAILMAN_DEST(0.00)[freebsd-hackers] X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.33 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 16 Sep 2020 20:02:33 -0000 On 16/09/2020 16:57, Konstantin Belousov wrote: > On Wed, Sep 16, 2020 at 06:52:42AM +0000, Wei Hu via freebsd-hackers wrote: >> Hello, >> >> There are couple AMD processor related MSRs which are being accessed in FreeBSD. >> >> #define MSR_AMDK8_IPM 0xc0010055 >> #define MSR_LS_CFG 0xc0011020 >> >> We are seeing a lot of CPU time being spent in the host (Hyper-V) in handling traps when accessing these MSRs. Especially the first MRS is frequently being accessed in cpu_idle() so the performance impact to host is significant. >> >> We noted that Linux made some code changes in the 4.10 kernel to access the first MSR much less frequently. So we are wondering if there are similar changes in FreeBSD that might be in the plan. Microsoft Hyper-V team is also planning some work to speed up the accesses to these MSRs. However any suggestions or plan to improve in the FreeBSD guest are welcome. >> > > Where do you see accesses to MSR_LS_CFG ? I can only find manipulations > of that MSR in init_amd(), and then it is all under check that we are not > virtualized. > > For MSR_AMDK8_IPM access in cpu_idle(), it seems that the workaround was > applied too wide. It might be that we do not need to do it on recent CPUs, > but I need to spent more time looking at datasheets to confirm/deny. > > But, do you (hypervisor) indeed allow guest to initiate C1 or deeper idle > state ? If not, perhaps as the first measure, we can avoid manipulating > MSR_AMDK8_IPM under hypervisor at all. I agree with these observations and suggestions. Additionally, I am not sure why we check and clear AMDK8_CMPHALT bit on every call of cpu_idle(). Maybe in the past we had to deal with firmware / SMM code that aggresivekly restored that bit despite the wishes of our OS. I would assume that "firmware" of virtual machines does not do that. Having said that, echoing what Kostik said, I really doubt that any hypervisor faithfully emulates AMDK8_CMPHALT. I do not see any reason to do that. -- Andriy Gapon From owner-freebsd-hackers@freebsd.org Thu Sep 17 05:34:29 2020 Return-Path: Delivered-To: freebsd-hackers@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 415383FCDFC for ; Thu, 17 Sep 2020 05:34:29 +0000 (UTC) (envelope-from weh@microsoft.com) Received: from APC01-SG2-obe.outbound.protection.outlook.com (mail-eopbgr1310119.outbound.protection.outlook.com [40.107.131.119]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client CN "mail.protection.outlook.com", Issuer "GlobalSign Organization Validation CA - SHA256 - G3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4BsQdH2rpQz4l8t for ; Thu, 17 Sep 2020 05:34:27 +0000 (UTC) (envelope-from weh@microsoft.com) ARC-Seal: i=1; a=rsa-sha256; s=arcselector9901; d=microsoft.com; cv=none; b=Zykbwb/t6dYk2hhCdfDOLQm8uv/vL/6XGrP3Ahq2puskBxFbiEMPLOnaSSWabN9YY6bes4bZodmdwG3VlFyxr9Ejyit1V5DUEA1Vs2sX4sCJYHSO0o2XTJtBFwHaw+OQesUarWrzYuQiIyeQq36JQ/L9qEB10P/hmy21ato7GewKtiza7Zpp/QAOL8B8roPDO/AHdcqN/89CkVz8aCUmc60WuMujO0CfGpt1a2wv5BJl5BtNRjem1isAaEakF7u4QSn172Yvg0OB4WnLTap+GcEFFz772EATYcLsFny4iogyxiXTRi1+n+7Kcm2DTWZJd2aELaT45QNILUKlbV0ueQ== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=microsoft.com; s=arcselector9901; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=AgO4K9ChB7yEKHadnKV8F2o1v00FRo5LDhcF648X+I8=; b=HK+cDOAqTgZzX+SkDRhm6rEnRqBqRi2SRAqkSwaPoAVS/EicWjiUY2H62k30qgFYogHo7IzxE7Z0oyOeuqp0JPxQ4MVq8D/TxQeGntWXRbeqP7WnmenRMDGpwiCFRJDvtXl1ElI7XwvvVKrrqbIxOpzvQnvHNHKB8eh3f5bplApHGB+x8zP13i6r1I/7opeDToJVA1Idkkg5BIjhOmFS3dhMXzYbAEOfuZbMHdrk7uFFJSRp4kxzr+6S8IykRcWy+hHPL82mzfGbkgrfATqRbbgSZBulLIlYg71CXGNpAbK108L7AwG6R4MaK8gKsaXrXx/XeCYWGkfbn1rWi2e//Q== ARC-Authentication-Results: i=1; mx.microsoft.com 1; spf=pass smtp.mailfrom=microsoft.com; dmarc=pass action=none header.from=microsoft.com; dkim=pass header.d=microsoft.com; arc=none Received: from SG2P153MB0352.APCP153.PROD.OUTLOOK.COM (2603:1096:4:d4::23) by SG2P153MB0352.APCP153.PROD.OUTLOOK.COM (2603:1096:4:d4::23) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.3412.1; Thu, 17 Sep 2020 05:34:23 +0000 Received: from SG2P153MB0352.APCP153.PROD.OUTLOOK.COM ([fe80::e1d4:23b8:2c19:4745]) by SG2P153MB0352.APCP153.PROD.OUTLOOK.COM ([fe80::e1d4:23b8:2c19:4745%6]) with mapi id 15.20.3412.007; Thu, 17 Sep 2020 05:34:23 +0000 From: Wei Hu To: Konstantin Belousov CC: "freebsd-hackers@freebsd.org" Subject: RE: MSR accesses that slows down the hypervisor/host Thread-Topic: MSR accesses that slows down the hypervisor/host Thread-Index: AdaL9HYbtJyLPxf3TL+CSKzmJaxdTwAPNlyAACBa5AA= Date: Thu, 17 Sep 2020 05:34:22 +0000 Message-ID: References: <20200916135727.GO94807@kib.kiev.ua> In-Reply-To: <20200916135727.GO94807@kib.kiev.ua> Accept-Language: en-US Content-Language: en-US X-MS-Has-Attach: X-MS-TNEF-Correlator: msip_labels: MSIP_Label_f42aa342-8706-4288-bd11-ebb85995028c_ActionId=05b5b23f-aa6b-4da8-a038-e3d4554b221a; MSIP_Label_f42aa342-8706-4288-bd11-ebb85995028c_ContentBits=0; MSIP_Label_f42aa342-8706-4288-bd11-ebb85995028c_Enabled=true; MSIP_Label_f42aa342-8706-4288-bd11-ebb85995028c_Method=Standard; MSIP_Label_f42aa342-8706-4288-bd11-ebb85995028c_Name=Internal; MSIP_Label_f42aa342-8706-4288-bd11-ebb85995028c_SetDate=2020-09-17T05:23:53Z; MSIP_Label_f42aa342-8706-4288-bd11-ebb85995028c_SiteId=72f988bf-86f1-41af-91ab-2d7cd011db47; x-originating-ip: [116.233.42.161] x-ms-publictraffictype: Email x-ms-office365-filtering-ht: Tenant x-ms-office365-filtering-correlation-id: c726fc14-3d08-4e08-4bb8-08d85acb557d x-ms-traffictypediagnostic: SG2P153MB0352: x-microsoft-antispam-prvs: x-ms-oob-tlc-oobclassifiers: OLM:9508; x-ms-exchange-senderadcheck: 1 x-microsoft-antispam: BCL:0; x-microsoft-antispam-message-info: YsxnoCfueVzNXYpVfICLrOr6X1k4WbH4uf8GyS2g4USKVoiVaaRJNDxJy4Y7geCbM0xzvoWxjKJr7MfZP+WgUgIYKpTKho3Kk/H0+P9xOjaI9O7aODqxDarCZB2FsNeqXS8eVnp8QuOf03oI+/tms4/6GHRC/PtftHK9s2b7bF/OJq6b/eh3LRdDKXfEnFuvcGiAU9NEL/vI3546r5FlQtyEISfobTpg2Wdw+NDR/+6XHrP21x8nHdQWDWAjKAjf6n/ElvR8U3WVe7dPCHMTpwqffW/WDF6Ie7sudBh/V3crm7OzZrfRXZMgqOUsm6Ool7VewsvBU/W7tb0knMIjnv4Ak2vPOeQ3z9s6LgMj1wB4cfLfN89GpDlWgvJNNTTy x-forefront-antispam-report: CIP:255.255.255.255; CTRY:; LANG:en; SCL:1; SRV:; IPV:NLI; SFV:NSPM; H:SG2P153MB0352.APCP153.PROD.OUTLOOK.COM; PTR:; CAT:NONE; SFS:(4636009)(136003)(39860400002)(346002)(366004)(396003)(376002)(6916009)(66556008)(83380400001)(55016002)(4326008)(66946007)(66446008)(66476007)(64756008)(76116006)(8990500004)(8936002)(316002)(8676002)(86362001)(82960400001)(52536014)(186003)(82950400001)(5660300002)(26005)(33656002)(9686003)(6506007)(53546011)(71200400001)(7696005)(2906002)(10290500003)(478600001); DIR:OUT; SFP:1102; x-ms-exchange-antispam-messagedata: 5RZgenPDn1+Md+6ugyCjoX6xjoi4NF6b0j6kj2wzLsAAHDuStY6fKLYrJqtFCmBJrq8NG5rN1FZvYgGQPGxn/mOIN49LTbKdSpS0h44X+beYRz4uwa8o6F2nPsdiH6XNlu8Gs7VET2BDr4j2B7RSVsAySY9V9fYh4dJwXGt0/s4F4VUuTwEUqQFRzJQk9Yzgmh+m9CoLI4YiowQ/iFKHNauaj1lWgjoyMEI08tDHsXCfFL5bLJ/k0XuGkTqagEhVM84mmfdSn62Lqlh5BcvHr1jtkOzyld/xF2VUM7Xlr2+FNukYcq07LkEWcaQr312VMk/EXuY5O8n31CXes0qiPjX5ZS4pm2f9Cb6M3LCy77+yO2Kj2rWllo8etImAyErzN6dC8ZnqELeK5aKGtDqlxNfBC3/mc2XI6dzNdS3Z6BI8wSPrbv5fQp6rs6yWB8e7SDp5ep/10fnAIsWv7hvnlJmWUwYuh/p0ziN4KTbXj1cPvmSz2FFFh2I7NexncdzPsgjDJSY/qjZzmU7MWKXrBvjEcKL7yJ99wQoGipn8zIVNR7sbnn30XoUtYb9J7AmMWrHgJdzDomMPUGW8n6+gdtDwNfxqYCzJu7w9IOv47U0H/a+YsVrpiUR+a8ULd8DC5ITX4QwWzrJARPviN6aQlQ== x-ms-exchange-transport-forked: True Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: quoted-printable MIME-Version: 1.0 X-OriginatorOrg: microsoft.com X-MS-Exchange-CrossTenant-AuthAs: Internal X-MS-Exchange-CrossTenant-AuthSource: SG2P153MB0352.APCP153.PROD.OUTLOOK.COM X-MS-Exchange-CrossTenant-Network-Message-Id: c726fc14-3d08-4e08-4bb8-08d85acb557d X-MS-Exchange-CrossTenant-originalarrivaltime: 17 Sep 2020 05:34:22.6823 (UTC) X-MS-Exchange-CrossTenant-fromentityheader: Hosted X-MS-Exchange-CrossTenant-id: 72f988bf-86f1-41af-91ab-2d7cd011db47 X-MS-Exchange-CrossTenant-mailboxtype: HOSTED X-MS-Exchange-CrossTenant-userprincipalname: +UlR4H1Tt7i3IBkRhKv0J0ZlmKOU8lWfkb8n0h5KaKySbVRo286OrBc8AU1xM5U8cNXJ9B5hDpQ/L3Z2h8YvLA== X-MS-Exchange-Transport-CrossTenantHeadersStamped: SG2P153MB0352 X-Rspamd-Queue-Id: 4BsQdH2rpQz4l8t X-Spamd-Bar: --------- X-Spamd-Result: default: False [-9.54 / 15.00]; TO_DN_EQ_ADDR_SOME(0.00)[]; HAS_XOIP(0.00)[]; TO_DN_SOME(0.00)[]; R_SPF_ALLOW(-0.20)[+ip4:40.107.0.0/16]; RCVD_COUNT_THREE(0.00)[3]; DKIM_TRACE(0.00)[microsoft.com:+]; RCPT_COUNT_TWO(0.00)[2]; DMARC_POLICY_ALLOW(-0.50)[microsoft.com,reject]; NEURAL_HAM_SHORT(-0.42)[-0.421]; FREEMAIL_TO(0.00)[gmail.com]; FROM_EQ_ENVFROM(0.00)[]; MIME_TRACE(0.00)[0:+]; RCVD_TLS_LAST(0.00)[]; ASN(0.00)[asn:8075, ipnet:40.104.0.0/14, country:US]; ARC_ALLOW(-1.00)[microsoft.com:s=arcselector9901:i=1]; RCVD_IN_DNSWL_LOW(-0.10)[40.107.131.119:from]; NEURAL_HAM_MEDIUM(-1.01)[-1.013]; R_DKIM_ALLOW(-0.20)[microsoft.com:s=selector2]; FROM_HAS_DN(0.00)[]; DWL_DNSWL_MED(-2.00)[microsoft.com:dkim]; NEURAL_HAM_LONG(-1.01)[-1.005]; MIME_GOOD(-0.10)[text/plain]; TO_MATCH_ENVRCPT_SOME(0.00)[]; WHITELIST_SPF_DKIM(-3.00)[microsoft.com:d:+,microsoft.com:s:+]; RWL_MAILSPIKE_POSSIBLE(0.00)[40.107.131.119:from]; MAILMAN_DEST(0.00)[freebsd-hackers] X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.33 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 17 Sep 2020 05:34:29 -0000 > From: Konstantin Belousov > Sent: Wednesday, September 16, 2020 9:57 PM > To: Wei Hu > Cc: freebsd-hackers@freebsd.org > Subject: Re: MSR accesses that slows down the hypervisor/host >=20 > Where do you see accesses to MSR_LS_CFG ? I can only find manipulations = of > that MSR in init_amd(), and then it is all under check that we are not > virtualized. >=20 Yes, it is only accessed in init_amd() at boot time. So it is less concerne= d. MSR_AMDK8_IPM is accessed in cpu_idle() all the time, so it is the key place to optimize. > For MSR_AMDK8_IPM access in cpu_idle(), it seems that the workaround was > applied too wide. It might be that we do not need to do it on recent CPUs= , but I > need to spent more time looking at datasheets to confirm/deny. >=20 > But, do you (hypervisor) indeed allow guest to initiate C1 or deeper idle= state ? > If not, perhaps as the first measure, we can avoid manipulating > MSR_AMDK8_IPM under hypervisor at all. You are right a guest cannot initiate C1 or deeper idle state when running = on Hyper-V. So skipping the read of MSR_AMDK8_IPM when running under this hypervisor wo= uld=20 Be a viable solution.=20 Thanks, Wei From owner-freebsd-hackers@freebsd.org Thu Sep 17 13:26:06 2020 Return-Path: Delivered-To: freebsd-hackers@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 078CD3E0275 for ; Thu, 17 Sep 2020 13:26:06 +0000 (UTC) (envelope-from arka.sw1988@gmail.com) Received: from mail-wr1-x434.google.com (mail-wr1-x434.google.com [IPv6:2a00:1450:4864:20::434]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "GTS CA 1O1" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4Bsd5T0Xbcz40Wg for ; Thu, 17 Sep 2020 13:26:04 +0000 (UTC) (envelope-from arka.sw1988@gmail.com) Received: by mail-wr1-x434.google.com with SMTP id x14so2048995wrl.12 for ; Thu, 17 Sep 2020 06:26:04 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=mime-version:from:date:message-id:subject:to; bh=/g4kLICxl6cxcu0Asn9TjptQG5TaWaTagoCs8/sqPA8=; b=IJlnEI0/vY7LDbwhFmYE77TtVxWc2+UtGkOmSwBURTOjIx4/OlJHipWVGE+7WOYk0L fkR2QzoM6tcvf3eyjTqt+TiQqpOKaVwQHxUev+OD3jIFMYbFFu5ywc3s/Z/G8YuteWKj /wWhhN1rKU5scACQWb/to0IyoOR9yQVpV9bKC52DRqHKraCdk8yNWomcldWWGDvf4Yx9 j+OYgB4WJqSGDkES+eYvnp7IN4hBmXkp9S4YF5hqCDzAHoG6uEYhoyXkGgqqPQRl3xHs Sq92Kq11drb14JpnkSuBO6zWU4Fb4/pSa8B/+BkFJ+0AGzHRQyUMnnaPxqIRfX5qrSLG ncfA== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:from:date:message-id:subject:to; bh=/g4kLICxl6cxcu0Asn9TjptQG5TaWaTagoCs8/sqPA8=; b=rm9P/MYbUKYHFP5xdgZ2rOv+3c80GkuhBqw8QFrkIKQZ0Lj1++N2qcmluS/zVxjXFE 3QjggyX7g5h0zI0490bz90uUfrmHPIKM3kufG6jdaW+ZH6aCg2wHIjAOVANfklHB2uh7 2cp2FwFwsSXt4z8JLfWoZkfWIo8zjbw6vgTnd6eAoS/iiMxDteLm+zxnPCbAmM2xkk7Q F9aFluJ52lrmx00M/or5fHXpH96NNXNyiz4kzCJkwcoMPzbsq3tAnNuBsWwGgqe+R7vf sTaZlBCHE7jHo+Fma3K+FBHkFKvrpgskzeHNeh+In8VnMaccLzNoLF2a45kbmkjFQYpO yfgQ== X-Gm-Message-State: AOAM533EOavglgYrz/ycPj/XYgsf+Yx2kDg9UKDNiYx9ztIeUgHZfAGz AbBs2zJW0lWCCllUz/ObBBoWViTJ8vf4OGS3ir/SMHUL X-Google-Smtp-Source: ABdhPJyJQErIXS5EXgPg6GeX4EsCHjv2jRX7edVBzeKJr/D8uboidOIQIgUhS/gv5ht3lOLOzcuo8W0fOw3PAIO3aFs= X-Received: by 2002:a5d:518b:: with SMTP id k11mr31593886wrv.369.1600349163271; Thu, 17 Sep 2020 06:26:03 -0700 (PDT) MIME-Version: 1.0 From: Arka Sharma Date: Thu, 17 Sep 2020 18:55:51 +0530 Message-ID: Subject: ENOBUFS at reading end of a pipe To: freebsd-hackers@freebsd.org X-Rspamd-Queue-Id: 4Bsd5T0Xbcz40Wg X-Spamd-Bar: -- Authentication-Results: mx1.freebsd.org; dkim=pass header.d=gmail.com header.s=20161025 header.b=IJlnEI0/; dmarc=pass (policy=none) header.from=gmail.com; spf=pass (mx1.freebsd.org: domain of arkasw1988@gmail.com designates 2a00:1450:4864:20::434 as permitted sender) smtp.mailfrom=arkasw1988@gmail.com X-Spamd-Result: default: False [-2.69 / 15.00]; RCVD_TLS_ALL(0.00)[]; ARC_NA(0.00)[]; R_DKIM_ALLOW(-0.20)[gmail.com:s=20161025]; NEURAL_HAM_MEDIUM(-1.01)[-1.006]; FROM_HAS_DN(0.00)[]; DWL_DNSWL_NONE(0.00)[gmail.com:dkim]; FREEMAIL_FROM(0.00)[gmail.com]; TO_MATCH_ENVRCPT_ALL(0.00)[]; MIME_GOOD(-0.10)[multipart/alternative,text/plain]; PREVIOUSLY_DELIVERED(0.00)[freebsd-hackers@freebsd.org]; TO_DN_NONE(0.00)[]; RCPT_COUNT_ONE(0.00)[1]; NEURAL_HAM_LONG(-1.02)[-1.021]; R_SPF_ALLOW(-0.20)[+ip6:2a00:1450:4000::/36]; DKIM_TRACE(0.00)[gmail.com:+]; DMARC_POLICY_ALLOW(-0.50)[gmail.com,none]; RCVD_IN_DNSWL_NONE(0.00)[2a00:1450:4864:20::434:from]; NEURAL_SPAM_SHORT(0.34)[0.336]; FROM_EQ_ENVFROM(0.00)[]; MIME_TRACE(0.00)[0:+,1:+,2:~]; FREEMAIL_ENVFROM(0.00)[gmail.com]; ASN(0.00)[asn:15169, ipnet:2a00:1450::/32, country:US]; TAGGED_FROM(0.00)[]; MAILMAN_DEST(0.00)[freebsd-hackers]; RCVD_COUNT_TWO(0.00)[2] Content-Type: text/plain; charset="UTF-8" X-Content-Filtered-By: Mailman/MimeDel 2.1.33 X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.33 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 17 Sep 2020 13:26:06 -0000 Hi all, Let's say a parent process is writing to a pipe and child is reading. Is there a possibility that write is success but the child is getting ENOBUFS while reading. In this case the write precedes the read. Regards, Arka From owner-freebsd-hackers@freebsd.org Thu Sep 17 18:38:35 2020 Return-Path: Delivered-To: freebsd-hackers@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 6D3FF3E9EB2 for ; Thu, 17 Sep 2020 18:38:35 +0000 (UTC) (envelope-from kostikbel@gmail.com) Received: from kib.kiev.ua (kib.kiev.ua [IPv6:2001:470:d5e7:1::1]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4Bsm222bsNz4R2D; Thu, 17 Sep 2020 18:38:33 +0000 (UTC) (envelope-from kostikbel@gmail.com) Received: from tom.home (kib@localhost [127.0.0.1]) by kib.kiev.ua (8.16.1/8.16.1) with ESMTPS id 08HIcPot060419 (version=TLSv1.3 cipher=TLS_AES_256_GCM_SHA384 bits=256 verify=NO); Thu, 17 Sep 2020 21:38:29 +0300 (EEST) (envelope-from kostikbel@gmail.com) DKIM-Filter: OpenDKIM Filter v2.10.3 kib.kiev.ua 08HIcPot060419 Received: (from kostik@localhost) by tom.home (8.16.1/8.16.1/Submit) id 08HIcP8G060418; Thu, 17 Sep 2020 21:38:25 +0300 (EEST) (envelope-from kostikbel@gmail.com) X-Authentication-Warning: tom.home: kostik set sender to kostikbel@gmail.com using -f Date: Thu, 17 Sep 2020 21:38:25 +0300 From: Konstantin Belousov To: Wei Hu , avg@freebsd.org Cc: "freebsd-hackers@freebsd.org" Subject: Re: MSR accesses that slows down the hypervisor/host Message-ID: <20200917183825.GU94807@kib.kiev.ua> References: <20200916135727.GO94807@kib.kiev.ua> MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: X-Spam-Status: No, score=-1.0 required=5.0 tests=ALL_TRUSTED,BAYES_00, DKIM_ADSP_CUSTOM_MED,FORGED_GMAIL_RCVD,FREEMAIL_FROM, NML_ADSP_CUSTOM_MED autolearn=no autolearn_force=no version=3.4.4 X-Spam-Checker-Version: SpamAssassin 3.4.4 (2020-01-24) on tom.home X-Rspamd-Queue-Id: 4Bsm222bsNz4R2D X-Spamd-Bar: / Authentication-Results: mx1.freebsd.org; dkim=none; dmarc=fail reason="No valid SPF, No valid DKIM" header.from=gmail.com (policy=none); spf=softfail (mx1.freebsd.org: 2001:470:d5e7:1::1 is neither permitted nor denied by domain of kostikbel@gmail.com) smtp.mailfrom=kostikbel@gmail.com X-Spamd-Result: default: False [0.51 / 15.00]; ARC_NA(0.00)[]; TO_DN_EQ_ADDR_SOME(0.00)[]; DMARC_POLICY_SOFTFAIL(0.10)[gmail.com : No valid SPF, No valid DKIM,none]; RCVD_TLS_ALL(0.00)[]; FROM_HAS_DN(0.00)[]; RCPT_COUNT_THREE(0.00)[3]; FREEMAIL_FROM(0.00)[gmail.com]; NEURAL_SPAM_SHORT(0.30)[0.301]; MIME_GOOD(-0.10)[text/plain]; HAS_XAW(0.00)[]; NEURAL_HAM_MEDIUM(-0.19)[-0.191]; R_SPF_SOFTFAIL(0.00)[~all:c]; TO_DN_SOME(0.00)[]; TO_MATCH_ENVRCPT_SOME(0.00)[]; NEURAL_SPAM_LONG(0.40)[0.398]; FROM_EQ_ENVFROM(0.00)[]; R_DKIM_NA(0.00)[]; FREEMAIL_ENVFROM(0.00)[gmail.com]; ASN(0.00)[asn:6939, ipnet:2001:470::/32, country:US]; MIME_TRACE(0.00)[0:+]; MAILMAN_DEST(0.00)[freebsd-hackers]; RCVD_COUNT_TWO(0.00)[2] X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.33 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 17 Sep 2020 18:38:35 -0000 On Thu, Sep 17, 2020 at 05:34:22AM +0000, Wei Hu wrote: > > From: Konstantin Belousov > > Sent: Wednesday, September 16, 2020 9:57 PM > > To: Wei Hu > > Cc: freebsd-hackers@freebsd.org > > Subject: Re: MSR accesses that slows down the hypervisor/host > > > > Where do you see accesses to MSR_LS_CFG ? I can only find manipulations of > > that MSR in init_amd(), and then it is all under check that we are not > > virtualized. > > > Yes, it is only accessed in init_amd() at boot time. So it is less concerned. MSR_AMDK8_IPM > is accessed in cpu_idle() all the time, so it is the key place to optimize. > > > For MSR_AMDK8_IPM access in cpu_idle(), it seems that the workaround was > > applied too wide. It might be that we do not need to do it on recent CPUs, but I > > need to spent more time looking at datasheets to confirm/deny. > > > > But, do you (hypervisor) indeed allow guest to initiate C1 or deeper idle state ? > > If not, perhaps as the first measure, we can avoid manipulating > > MSR_AMDK8_IPM under hypervisor at all. > > You are right a guest cannot initiate C1 or deeper idle state when running on Hyper-V. > So skipping the read of MSR_AMDK8_IPM when running under this hypervisor would > Be a viable solution. https://reviews.freebsd.org/D26470 From owner-freebsd-hackers@freebsd.org Fri Sep 18 04:29:15 2020 Return-Path: Delivered-To: freebsd-hackers@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id F16323F726E for ; Fri, 18 Sep 2020 04:29:15 +0000 (UTC) (envelope-from darius@dons.net.au) Received: from midget.dons.net.au (midget.dons.net.au [IPv6:2403:5800:5101:0:ea:1cff:fefa:f00]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "dons.net.au", Issuer "Let's Encrypt Authority X3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4Bt17Y1wJKz44Z7 for ; Fri, 18 Sep 2020 04:29:12 +0000 (UTC) (envelope-from darius@dons.net.au) Received: from midget.dons.net.au (localhost [127.0.0.1]) by midget.dons.net.au (8.15.2/8.15.2) with ESMTPS id 08I4SsZE099604 (version=TLSv1.3 cipher=TLS_AES_256_GCM_SHA384 bits=256 verify=NO) for ; Fri, 18 Sep 2020 13:58:55 +0930 (ACST) (envelope-from darius@dons.net.au) Received: (from mailnull@localhost) by midget.dons.net.au (8.15.2/8.15.2/Submit) id 08I4Sa7c099597 for ; Fri, 18 Sep 2020 13:58:36 +0930 (ACST) (envelope-from darius@dons.net.au) X-MIMEDefang-Relay-be813b1f1da6d6b27d681222cb70cc4f5b642383: 2001:44b8:1d2:8900:a51e:fc60:6b55:f6c8 Received: from [IPv6:2001:44b8:1d2:8900:a51e:fc60:6b55:f6c8] ([IPv6:2001:44b8:1d2:8900:a51e:fc60:6b55:f6c8] [2001:44b8:1d2:8900:a51e:fc60:6b55:f6c8]) by midget.dons.net.au (envelope-sender ) (MIMEDefang) with ESMTP id 08I4SVjN099588; Fri, 18 Sep 2020 13:58:36 +0930 Content-Type: text/plain; charset=us-ascii Mime-Version: 1.0 (Mac OS X Mail 13.4 \(3608.120.23.2.1\)) Subject: Re: ASPEED video driver From: "O'Connor, Daniel" In-Reply-To: <8851FC7F-979D-4CDC-8513-CE893B2EF269@dons.net.au> Date: Fri, 18 Sep 2020 13:58:31 +0930 Cc: FreeBSD Hackers Content-Transfer-Encoding: quoted-printable Message-Id: References: <8851FC7F-979D-4CDC-8513-CE893B2EF269@dons.net.au> To: "Daniel O'Connor" X-Mailer: Apple Mail (2.3608.120.23.2.1) X-Spam-Score: 1 (*) No, score=1.0 required=5.0 tests=HELO_MISC_IP, HELO_NO_DOMAIN, TO_EQ_FM_DIRECT_MX, T_SPF_PERMERROR autolearn=no autolearn_force=no version=3.4.2 X-Scanned-By: MIMEDefang 2.83 on 10.0.2.1 X-Rspamd-Queue-Id: 4Bt17Y1wJKz44Z7 X-Spamd-Bar: --- X-Spamd-Result: default: False [-3.87 / 15.00]; ARC_NA(0.00)[]; NEURAL_HAM_MEDIUM(-1.01)[-1.009]; R_DKIM_ALLOW(-0.20)[dons.net.au:s=default]; FROM_HAS_DN(0.00)[]; MV_CASE(0.50)[]; R_SPF_ALLOW(-0.20)[+mx]; MIME_GOOD(-0.10)[text/plain]; PREVIOUSLY_DELIVERED(0.00)[freebsd-hackers@freebsd.org]; NEURAL_HAM_LONG(-1.04)[-1.040]; RCVD_COUNT_THREE(0.00)[3]; TO_MATCH_ENVRCPT_SOME(0.00)[]; TO_DN_ALL(0.00)[]; DKIM_TRACE(0.00)[dons.net.au:+]; RCPT_COUNT_TWO(0.00)[2]; DMARC_POLICY_ALLOW(-0.50)[dons.net.au,quarantine]; NEURAL_HAM_SHORT(-1.32)[-1.324]; FROM_EQ_ENVFROM(0.00)[]; MIME_TRACE(0.00)[0:+]; RCVD_TLS_LAST(0.00)[]; ASN(0.00)[asn:4764, ipnet:2403:5800:5000::/36, country:AU]; MID_RHS_MATCH_FROM(0.00)[]; MAILMAN_DEST(0.00)[freebsd-hackers] X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.33 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 18 Sep 2020 04:29:16 -0000 > On 7 Sep 2020, at 13:02, O'Connor, Daniel via freebsd-hackers = wrote: > Performance used to be tolerable but it seems to have gotten = significantly worse in newer BIOS versions. It turns out this is likely due to compositing being turned on for newer = systems, although even with it disabled it's not a great performer (but = usable) > I note that Linux has a DRM driver for these = https://git.kernel.org/pub/scm/linux/kernel/git/torvalds/linux.git/tree/dr= ivers/gpu/drm/ast=20 An attempt was made to get the FreeBSD DRM port of this running but = failed because the version in that tree is too old to support the atomic = modset (but hopefully it can be picked up later..) > However I'm not sure how that integrates with X.. If Linux doesn't = actually use the Xorg driver then I suppose that would explain why it's = rotted and useless. >=20 > If that is the case, does anyone know difficult it would be to port = the Linux DRM driver? >=20 > I did try contacting ASPEED and Supermicro but they pointed the finger = at each other and then blamed FreeBSD so I'm a bit stuck. Some more investigation in the Linux DRM code showed it has a work = around because some systems disable a feature (for security reasons). I've ported this to the X driver and filed a PR for the port. -- Daniel O'Connor "The nice thing about standards is that there are so many of them to choose from." -- Andrew Tanenbaum From owner-freebsd-hackers@freebsd.org Fri Sep 18 15:28:54 2020 Return-Path: Delivered-To: freebsd-hackers@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id E2C213E61B8 for ; Fri, 18 Sep 2020 15:28:54 +0000 (UTC) (envelope-from thj@freebsd.org) Received: from wforward4-smtp.messagingengine.com (wforward4-smtp.messagingengine.com [64.147.123.34]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4BtHmk3Dc1z3SXt; Fri, 18 Sep 2020 15:28:54 +0000 (UTC) (envelope-from thj@freebsd.org) Received: from compute7.internal (compute7.nyi.internal [10.202.2.47]) by mailforward.west.internal (Postfix) with ESMTP id 378B9D4A; Fri, 18 Sep 2020 11:28:51 -0400 (EDT) Received: from mailfrontend1 ([10.202.2.162]) by compute7.internal (MEProxy); Fri, 18 Sep 2020 11:28:51 -0400 DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d= messagingengine.com; h=content-type:date:from:in-reply-to :message-id:mime-version:references:subject:to:x-me-proxy :x-me-proxy:x-me-sender:x-me-sender:x-sasl-enc; s=fm3; bh=So3x6J /GDcwFTPKdZkW5SRfmek1Fk477hXz2vNJvXcM=; b=VdNSmpFI7D2+R4hdRgYBZf a4DjUEZFqRY+5SUtuGvdLfcU2FmQiy2thNCM4ZrkqRHoNYIzbyNWqdjqnwUVYOSy DpyM6k0VeG8KPPXIZCYxBUXO7ek1r8GMc36lgXDoApcoFC6vkNWfPzEQxeAL1iiR 4aFnBxFFLKgP9J3ZD+0hmNNkAfLyba0VFPWYExyqToBEcXNc57ydq4+CcQR+9PkK swaWJPhooUw7STAmpXATjE27F6kubSP2xGD+TkoZ4/tXQWzh2SWCnnztF6m0Mq/3 eTkCgufi+7rwqKjfvxtmhZRxXeLRE8DM5w3v6ApvidtH23mLslisMyruiKWc5vwg == X-ME-Sender: X-ME-Proxy-Cause: gggruggvucftvghtrhhoucdtuddrgedujedrtdeigdeklecutefuodetggdotefrodftvf curfhrohhfihhlvgemucfhrghsthforghilhdpqfgfvfdpuffrtefokffrpgfnqfghnecu uegrihhlohhuthemuceftddtnecunecujfgurhepfffhvffukfhfgggtuggjsehttdertd dttddvnecuhfhrohhmpefvohhmucflohhnvghsuceothhhjhesfhhrvggvsghsugdrohhr gheqnecuggftrfgrthhtvghrnheplefhvdeffeegjeehteejleevffdtvdekieeftedufe effeelfeevkefgkeeigfeknecuffhomhgrihhnpehgohhoghhlvgdrtghomhdpfhhrvggv sghsugdrohhrghdprgguvhgvnhhtuhhrihhsthdrmhgvnecukfhppedufeejrdehtddrud ejrdduvdenucevlhhushhtvghrufhiiigvpedtnecurfgrrhgrmhepmhgrihhlfhhrohhm pehthhhjsehfrhgvvggsshgurdhorhhg X-ME-Proxy: Received: from tom-desk.erg.abdn.ac.uk (tom-desk.erg.abdn.ac.uk [137.50.17.12]) by mail.messagingengine.com (Postfix) with ESMTPA id 1CD77328005A; Fri, 18 Sep 2020 11:28:50 -0400 (EDT) Date: Fri, 18 Sep 2020 16:29:59 +0100 From: Tom Jones To: freebsd-hackers@freebsd.org Subject: Re: FreeBSD Bugathon Setpember 19th 1400-2100UTC Message-ID: <20200918152959.GG23457@tom-desk.erg.abdn.ac.uk> References: <20200906132420.GA82277@tom-desk.erg.abdn.ac.uk> MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: <20200906132420.GA82277@tom-desk.erg.abdn.ac.uk> X-Rspamd-Queue-Id: 4BtHmk3Dc1z3SXt X-Spamd-Bar: / Authentication-Results: mx1.freebsd.org; none X-Spamd-Result: default: False [0.00 / 15.00]; local_wl_from(0.00)[freebsd.org]; ASN(0.00)[asn:11403, ipnet:64.147.123.0/24, country:US] X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.33 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 18 Sep 2020 15:28:54 -0000 On Sun, Sep 06, 2020 at 02:24:20PM +0100, Tom Jones wrote: > Hello Hackers, > > On the 19th September 2020 from 1400-2100 UTC we will be running a coordinated > virtual Bugathon. FreeBSD has a Problem Report (PR) database[1] where users > and developers are encouraged to file issues and regressions they find in both > the base system and ports tree. > > A Bugathon is a focused session where we try to triage, process, fix and close > as many reports as we can from the PR database. This will be our second > Bugathon in 2020, the first was held in July[2] was very successful. I hope we > can reproduce those great results. > > To help explain our bug tracking and squashing process I am looking for FreeBSD > committers (one each from src, docs and ports) to speak for 10-15 minutes on > their bug squashing workflow. Please contact me via email if you feel like > talking about your workflow. > > We will host a google meet at the start of the Bug Squash to provide an > introduction to the process and will use the #freebsd-bugs irc channel on > freenode to coordinate work, triage and discuss PRs and patches. > > https://meet.google.com/zob-qoeu-fub > > We will use the google meet through out the day last time it proved to be a > really helpful resource to get immediate answers to questions. > > I look forward to joining you to squash bugs and commit fixes to improve > FreeBSD. > > - Tom > > [1]: https://bugs.freebsd.org > [2]: https://lists.freebsd.org/pipermail/freebsd-hackers/2020-July/056297.html > > Some other links: > > https://wiki.freebsd.org/OfficeHours > https://wiki.freebsd.org/MarkLinimon/BugbustingOfficeHours > https://wiki.freebsd.org/Bugathons > https://wiki.freebsd.org/MarkLinimon/KitchenerNotes > https://wiki.freebsd.org/BugBusting > https://adventurist.me/posts/00301 Just a reminder that the Bugathon is tomorrrow. - Tom From owner-freebsd-hackers@freebsd.org Fri Sep 18 19:07:20 2020 Return-Path: Delivered-To: freebsd-hackers@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 6E2A93ECA12; Fri, 18 Sep 2020 19:07:20 +0000 (UTC) (envelope-from bsd-lists@bsdforge.com) Received: from udns.ultimatedns.net (static-24-113-41-81.wavecable.com [24.113.41.81]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "ultimatedns.net", Issuer "Let's Encrypt Authority X3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4BtNcl6Q01z3ycK; Fri, 18 Sep 2020 19:07:19 +0000 (UTC) (envelope-from bsd-lists@bsdforge.com) Received: from ultimatedns.net (localhost [127.0.0.1]) by udns.ultimatedns.net (8.16.1/8.16.1) with ESMTP id 08IJ7WV8011137; Fri, 18 Sep 2020 12:07:38 -0700 (PDT) (envelope-from bsd-lists@bsdforge.com) MIME-Version: 1.0 Date: Fri, 18 Sep 2020 12:07:32 -0700 From: Chris To: freebsd-git Cc: freebsd-current , freebsd-hackers Subject: on moving freebsd from svn to git; would this be of any help? User-Agent: UDNSMS/17.0 Message-ID: X-Sender: bsd-lists@bsdforge.com Content-Type: text/plain; charset=US-ASCII; format=flowed Content-Transfer-Encoding: 7bit X-Rspamd-Queue-Id: 4BtNcl6Q01z3ycK X-Spamd-Bar: / Authentication-Results: mx1.freebsd.org; none X-Spamd-Result: default: False [0.00 / 15.00]; ASN(0.00)[asn:11404, ipnet:24.113.0.0/16, country:US]; local_wl_ip(0.00)[24.113.41.81] X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.33 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 18 Sep 2020 19:07:20 -0000 While contemplating a massive re-tooling job ahead to accommodate any/all changes when freebsd fully lands in git. I ran across this[1][2] and wondered if it may be of any assistance for the task of those involved in the migration process @freebsd. 1) http://catb.org/esr/reposurgeon/ 2) https://gitlab.com/esr/reposurgeon FTR I'm unaffiliated with the project. It just looked like it might be of interest. --Chris From owner-freebsd-hackers@freebsd.org Fri Sep 18 19:32:46 2020 Return-Path: Delivered-To: freebsd-hackers@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id BB3953ED806 for ; Fri, 18 Sep 2020 19:32:46 +0000 (UTC) (envelope-from jim@netgate.com) Received: from mail-qv1-xf2b.google.com (mail-qv1-xf2b.google.com [IPv6:2607:f8b0:4864:20::f2b]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "GTS CA 1O1" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4BtPB55WYFz41F2 for ; Fri, 18 Sep 2020 19:32:45 +0000 (UTC) (envelope-from jim@netgate.com) Received: by mail-qv1-xf2b.google.com with SMTP id cv8so3539924qvb.12 for ; Fri, 18 Sep 2020 12:32:45 -0700 (PDT) X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:references:in-reply-to:from:date :message-id:subject:to:cc; bh=sS7XtVVtPqA1vYCUoclgO8iv6AGtBPYpWGmBSX7BkC4=; b=Azr955rOvv9aYKXZDyA8I/W5WqD36hKbgHvLzwT+kRil44W73/Ad6IBvb03pF5HwOH sj4+um9ET0XPjkX9fDpEfUtSAPnQpb+rutPMpluDMy0krG869vO65pu6tm4vngfRTFzR WDZVhFQ8NPpquR4783QfsbbJmAxlikCY5rGwgW4+P+en4oaKi+yQF4W/xdUEOnFKVfgc /HefJLx3omBsGI4wGi7ov/ta2WBF2EYVcr0750/8yKL+8tM5DSwLYihHquflgkR5dMtC Y2BA7tfvg1mdxXNl0YQdr+5pNFnWgV4cNtQOYtngu3DIcPS2HAFa4LZsga3JwxC3qvJ2 8/sA== X-Gm-Message-State: AOAM530PlDn25sET3/EHi0AuRGxn4Qvkz0nFBFeGRj22XVF2tmNxoqcU s0Qr7fHOD0TNlCODhwT4odr4CZVq5oT+i5he2tcbyQ== X-Google-Smtp-Source: ABdhPJxbRdAmNM2ttmS1FizRtpq3m//cg8wpQnrTUuNgpL40My0ehpcvcpyYURJmAWjUdBZ1rR6Va7BRo7uMwwBdi2g= X-Received: by 2002:a0c:ec87:: with SMTP id u7mr18564053qvo.50.1600457564590; Fri, 18 Sep 2020 12:32:44 -0700 (PDT) MIME-Version: 1.0 References: In-Reply-To: From: Jim Thompson Date: Fri, 18 Sep 2020 14:32:33 -0500 Message-ID: Subject: Re: on moving freebsd from svn to git; would this be of any help? To: Chris Cc: freebsd-git , freebsd-current , freebsd-hackers X-Rspamd-Queue-Id: 4BtPB55WYFz41F2 X-Spamd-Bar: -- X-Spamd-Result: default: False [-2.44 / 15.00]; RCVD_TLS_ALL(0.00)[]; ARC_NA(0.00)[]; R_DKIM_ALLOW(-0.20)[netgate.com:s=google]; FREEFALL_USER(0.00)[jim]; FROM_HAS_DN(0.00)[]; RCPT_COUNT_THREE(0.00)[4]; R_SPF_ALLOW(-0.20)[+ip6:2607:f8b0:4000::/36]; NEURAL_HAM_LONG(-1.05)[-1.054]; MIME_GOOD(-0.10)[multipart/alternative,text/plain]; PREVIOUSLY_DELIVERED(0.00)[freebsd-hackers@freebsd.org]; NEURAL_HAM_MEDIUM(-1.01)[-1.009]; TO_MATCH_ENVRCPT_SOME(0.00)[]; TO_DN_ALL(0.00)[]; DKIM_TRACE(0.00)[netgate.com:+]; DMARC_POLICY_ALLOW(-0.50)[netgate.com,quarantine]; RCVD_IN_DNSWL_NONE(0.00)[2607:f8b0:4864:20::f2b:from]; NEURAL_HAM_SHORT(-0.38)[-0.375]; FROM_EQ_ENVFROM(0.00)[]; MIME_TRACE(0.00)[0:+,1:+,2:~]; SUBJECT_ENDS_QUESTION(1.00)[]; ASN(0.00)[asn:15169, ipnet:2607:f8b0::/32, country:US]; RCVD_COUNT_TWO(0.00)[2]; MAILMAN_DEST(0.00)[freebsd-hackers] Content-Type: text/plain; charset="UTF-8" X-Content-Filtered-By: Mailman/MimeDel 2.1.33 X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.33 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 18 Sep 2020 19:32:46 -0000 worst idea I've heard this week. On Fri, Sep 18, 2020 at 2:07 PM Chris wrote: > While contemplating a massive re-tooling job ahead to accommodate > any/all changes when freebsd fully lands in git. I ran across this[1][2] > and wondered if it may be of any assistance for the task of those > involved in the migration process @freebsd. > > 1) http://catb.org/esr/reposurgeon/ > 2) https://gitlab.com/esr/reposurgeon > > FTR I'm unaffiliated with the project. It just looked like it might be of > interest. > > --Chris > _______________________________________________ > freebsd-hackers@freebsd.org mailing list > https://lists.freebsd.org/mailman/listinfo/freebsd-hackers > To unsubscribe, send any mail to "freebsd-hackers-unsubscribe@freebsd.org" > From owner-freebsd-hackers@freebsd.org Fri Sep 18 20:04:45 2020 Return-Path: Delivered-To: freebsd-hackers@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id A4A8F3EE29F; Fri, 18 Sep 2020 20:04:45 +0000 (UTC) (envelope-from carpeddiem@gmail.com) Received: from mail-il1-f178.google.com (mail-il1-f178.google.com [209.85.166.178]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "GTS CA 1O1" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4BtPv04nkYz437h; Fri, 18 Sep 2020 20:04:44 +0000 (UTC) (envelope-from carpeddiem@gmail.com) Received: by mail-il1-f178.google.com with SMTP id y9so7548366ilq.2; Fri, 18 Sep 2020 13:04:44 -0700 (PDT) X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:references:in-reply-to:from:date :message-id:subject:to:cc; bh=AWoA4esb+iobpC8k+sYLXAReMN1k+Oi+IJqV53qUN00=; b=gCtA7H1mJYgCs3kj1RG4BK2kJr9QvlB6YeRZM60AfR0pdnmaxiAm2RUz8JnrYwqs4P WfAictp7OFGTLHqM35AfO8aZvJr5I5ntx2jo5jZ2S4f4mISzlkEGmsxBTKwwk598YPQB yiLZ+epHXnAouSLWf+etsbjfVqwbzfYGJZTQkBHsTZqoVHMRBQTMNPKgF/Gxy1FS5OoF rmp6/Qn0PN0dCEUlIzRAmm5Mk66r5phtE86ZJkIsododMsqLw2IcWCOoJ2xQQBzozrk5 LSFWZcf6wLjMEaqS00o1cQM6qKC5YZ94iMOMa8TX8HKzcn+VXYClc3xGLcRNDmZ+mGp+ jMGA== X-Gm-Message-State: AOAM532qFYpauUD7U8zfYaP+7DPyhXnnHZ8dfAJi9cgEBrIZC2LA4WRl 1QAeuVMLR6sFWIW2WHBK45okdwY0xfBUbf+WlnMzEXL8 X-Google-Smtp-Source: ABdhPJyN+l8aKYfvwa0VLIapIwZUlAfJhAdp0GfvgSqwr9I50G02XBO6k4j1kiLpu57v6Ge/tP4/ew4rSDQVJ0dD6ZU= X-Received: by 2002:a92:ba0a:: with SMTP id o10mr12800139ili.100.1600459483404; Fri, 18 Sep 2020 13:04:43 -0700 (PDT) MIME-Version: 1.0 References: In-Reply-To: From: Ed Maste Date: Fri, 18 Sep 2020 16:04:31 -0400 Message-ID: Subject: Re: on moving freebsd from svn to git; would this be of any help? To: Chris Cc: freebsd-git , freebsd-current , freebsd-hackers Content-Type: text/plain; charset="UTF-8" X-Rspamd-Queue-Id: 4BtPv04nkYz437h X-Spamd-Bar: - Authentication-Results: mx1.freebsd.org; dkim=none; dmarc=none; spf=pass (mx1.freebsd.org: domain of carpeddiem@gmail.com designates 209.85.166.178 as permitted sender) smtp.mailfrom=carpeddiem@gmail.com X-Spamd-Result: default: False [-1.03 / 15.00]; SUBJECT_ENDS_QUESTION(1.00)[]; FREEMAIL_ENVFROM(0.00)[gmail.com]; FREEFALL_USER(0.00)[carpeddiem]; FROM_HAS_DN(0.00)[]; RCPT_COUNT_THREE(0.00)[4]; R_SPF_ALLOW(-0.20)[+ip4:209.85.128.0/17]; RCVD_TLS_ALL(0.00)[]; MIME_GOOD(-0.10)[text/plain]; DMARC_NA(0.00)[freebsd.org]; ARC_NA(0.00)[]; NEURAL_HAM_LONG(-1.04)[-1.035]; TO_MATCH_ENVRCPT_SOME(0.00)[]; TO_DN_ALL(0.00)[]; NEURAL_HAM_SHORT(-0.02)[-0.017]; RCVD_IN_DNSWL_NONE(0.00)[209.85.166.178:from]; NEURAL_HAM_MEDIUM(-0.98)[-0.976]; FORGED_SENDER(0.30)[emaste@freebsd.org,carpeddiem@gmail.com]; RWL_MAILSPIKE_POSSIBLE(0.00)[209.85.166.178:from]; R_DKIM_NA(0.00)[]; MIME_TRACE(0.00)[0:+]; ASN(0.00)[asn:15169, ipnet:209.85.128.0/17, country:US]; FROM_NEQ_ENVFROM(0.00)[emaste@freebsd.org,carpeddiem@gmail.com]; MAILMAN_DEST(0.00)[freebsd-git,freebsd-current,freebsd-hackers]; RCVD_COUNT_TWO(0.00)[2] X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.33 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 18 Sep 2020 20:04:45 -0000 On Fri, 18 Sep 2020 at 15:07, Chris wrote: > > While contemplating a massive re-tooling job ahead to accommodate > any/all changes when freebsd fully lands in git. I ran across this[1][2] > and wondered if it may be of any assistance for the task of those > involved in the migration process @freebsd. It doesn't solve any of the problems we have now; the actual svn to git conversion via svn2git works fine. Open issues are with the svn repository / mirrors, and finishing up process documentation. > 1) http://catb.org/esr/reposurgeon/ > 2) https://gitlab.com/esr/reposurgeon > > FTR I'm unaffiliated with the project. It just looked like it might be of > interest. > > --Chris > _______________________________________________ > freebsd-current@freebsd.org mailing list > https://lists.freebsd.org/mailman/listinfo/freebsd-current > To unsubscribe, send any mail to "freebsd-current-unsubscribe@freebsd.org" From owner-freebsd-hackers@freebsd.org Fri Sep 18 18:54:47 2020 Return-Path: Delivered-To: freebsd-hackers@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 6419A3EA642 for ; Fri, 18 Sep 2020 18:54:47 +0000 (UTC) (envelope-from core-secretary@freebsd.org) Received: from mailman.nyi.freebsd.org (mailman.nyi.freebsd.org [IPv6:2610:1c1:1:606c::50:13]) by mx1.freebsd.org (Postfix) with ESMTP id 4BtNLH254zz3g6B for ; Fri, 18 Sep 2020 18:54:47 +0000 (UTC) (envelope-from core-secretary@freebsd.org) Received: by mailman.nyi.freebsd.org (Postfix) id 45DC53EA68F; Fri, 18 Sep 2020 18:54:47 +0000 (UTC) Delivered-To: hackers@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 45A6D3EA5E7 for ; Fri, 18 Sep 2020 18:54:47 +0000 (UTC) (envelope-from core-secretary@freebsd.org) Received: from mail-ej1-f48.google.com (mail-ej1-f48.google.com [209.85.218.48]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "GTS CA 1O1" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4BtNLG6kTVz3g8C for ; Fri, 18 Sep 2020 18:54:46 +0000 (UTC) (envelope-from core-secretary@freebsd.org) Received: by mail-ej1-f48.google.com with SMTP id z23so9390417ejr.13 for ; Fri, 18 Sep 2020 11:54:46 -0700 (PDT) X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:from:reply-to:mime-version:date:subject:to :message-id; bh=abn9ARBjzQPCrhbyxtzaudRvYx6YDDIo3vxCazTgdWY=; b=OnuoKqsmUIgEgUThwqV8ci1BrsEx5iRxFCxmNjRZHjgEvYbWQxeEt6kEFs5qb33N5R UFA0G7Y0GzfxStjRZxYQR53UUy/wNZaJ7DLEDBx/5STM8UYYsvv0gs+Gj6oan4QnSwX/ f3juSfQ88I6776ISfjHBUDlrd+Mjl9zoUerCk+evq8wajiF6qIRoeV+l8iOWhS4bR2Ak QiTEbtv9C4FNGzhrjsEJp6FmMNZMSxuHIhVrvo9V5h6/5l+x83sXrJ+uItKDHF9PJiU6 AORhwVvQzQYT81//SpoNT5MykosuewKSsZ27rL3mBl4TpnL0lGeJDFs72Rxb/SUirULY kCJQ== X-Gm-Message-State: AOAM53019ulNzddbXgWCuPkBa8p+P14y3IwfhFul45SRenZPQhWoiptF gFT9tBwPi7s/XcZeb/czPDMw3tPJ X-Google-Smtp-Source: ABdhPJy0ADZsivnIjV933aIdKBIMwu4BmbsxVtSfTSwvuXbKYWQY62cbM8IWmAB8m4IlD4aJG7R7wA== X-Received: by 2002:a17:907:37b:: with SMTP id rs27mr39589119ejb.0.1600455285651; Fri, 18 Sep 2020 11:54:45 -0700 (PDT) Received: from mx.bofh.network (mx.bofh.network. [2001:19f0:5001:2b77:5400:2ff:fe7b:aa2c]) by smtp.gmail.com with ESMTPSA id w8sm2852902ejo.117.2020.09.18.11.54.43 (version=TLS1_3 cipher=TLS_AES_256_GCM_SHA384 bits=256/256); Fri, 18 Sep 2020 11:54:44 -0700 (PDT) Received: from [IPv6:2402:54c0:ffff:ffff:c907:1958:7f11:cde0] ( [2402:54c0:ffff:ffff:c907:1958:7f11:cde0]) by mx.bofh.network (OpenSMTPD) with ESMTPSA id e95980be (TLSv1.2:ECDHE-RSA-AES256-GCM-SHA384:256:NO); Fri, 18 Sep 2020 18:54:42 +0000 (UTC) From: FreeBSD Core Team Secretary Content-Type: multipart/signed; boundary="Apple-Mail=_D16C193A-390A-44CD-A20C-00F53AA0455F"; protocol="application/pgp-signature"; micalg=pgp-sha512 Reply-To: FreeBSD Core Team Mime-Version: 1.0 (Mac OS X Mail 13.4 \(3608.120.23.2.1\)) Date: Sat, 19 Sep 2020 00:54:34 +0600 Subject: Core Team Office Hours To: announce@freebsd.org Message-Id: <3603C4BC-9BED-4F74-8140-2BC38BB8F104@freebsd.org> X-Mailer: Apple Mail (2.3608.120.23.2.1) X-Rspamd-Queue-Id: 4BtNLG6kTVz3g8C X-Spamd-Bar: / Authentication-Results: mx1.freebsd.org; none X-Spamd-Result: default: False [0.00 / 15.00]; local_wl_from(0.00)[freebsd.org]; ASN(0.00)[asn:15169, ipnet:209.85.128.0/17, country:US] X-Mailman-Approved-At: Sat, 19 Sep 2020 00:48:50 +0000 X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.33 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 18 Sep 2020 18:54:47 -0000 --Apple-Mail=_D16C193A-390A-44CD-A20C-00F53AA0455F Content-Transfer-Encoding: quoted-printable Content-Type: text/plain; charset=utf-8 Based on the continuity of our last CORE Office Hours The FreeBSD CORE = Team would like to invite you all to a virtual town hall meeting. The = session is timed at 1800 UTC on 23rd September, 2020. See = https://wiki.freebsd.org/OfficeHours for details on how to join either a = live stream to watch, or an interactive meeting to participate. A link = to this agenda (and any updates) will be there as well. A similar = session is planned on the next week and will be announced soon targeting = the other part of the world. We=E2=80=99ll be discussing the following topics and taking general = questions at the end. We=E2=80=99ll have a moderator who will help call = on people in the meeting to ask questions (or to offer comments) as well = as relay relevant questions from IRC. * Git Transition -- To raise awareness, Ed Maste and Warner Losh will be = giving a brief presentation about the state of the project=E2=80=99s = planned transition to git. They can answer a few questions here, but are = also planning an entire office hours on the git transition (tentatively = scheduled in two weeks). * Recruiting for project teams -- When a new core team takes over, = it=E2=80=99s a good time to assess the needs of each of the teams that = we have running different aspects of the project, such as administering = our machines and helping keep FreeBSD secure. One common theme is the = need for more help. We=E2=80=99ll discuss what teams there are, and make = a recruiting pitch and answer any questions. * Core TODO List publishing -- To continue the openness initiative, the = core team will start publishing out TODO list. This will be in addition = to the normal meeting minutes and other openness ideas. The new core = team would love to hear from the community how to improve our = communications. * Discuss proposed terminology changes -- The prior core team had sent = out a proposal about how to handle shifts in language based on societal = change. The initial message was poorly written and didn=E2=80=99t strike = the right tone. We=E2=80=99ll discuss it, the underlying issue and how = the new core team plans on doing things better. * General Questions -- Time permitting, the new core team can answer any = other questions or concerns the community might have. Thanks! We look forward to meeting you. Regards, Moin (bofh), with core-secretary@ hat on --Apple-Mail=_D16C193A-390A-44CD-A20C-00F53AA0455F Content-Transfer-Encoding: 7bit Content-Disposition: attachment; filename=signature.asc Content-Type: application/pgp-signature; name=signature.asc Content-Description: Message signed with OpenPGP -----BEGIN PGP SIGNATURE----- iQKTBAEBCgB9FiEES2Tp4L3ps+zAa1xm2MjIO0nybxcFAl9lAmpfFIAAAAAALgAo aXNzdWVyLWZwckBub3RhdGlvbnMub3BlbnBncC5maWZ0aGhvcnNlbWFuLm5ldDRC NjRFOUUwQkRFOUIzRUNDMDZCNUM2NkQ4QzhDODNCNDlGMjZGMTcACgkQ2MjIO0ny bxcYcg/+O7RFPQMDckP3Epmoq3bHNhTDLq+MIGq9jWMNe7j6kEyzpWOWsr8mqWCO GzKCIGippZ7sDaEV+dKbZjV3pNztO0sh0X5a0lQrd6CKV32GuhvJnUmGxwDctgP2 ePSZu6H9aXeReiMwIb69MOU+p42pt9lJEIafS9HSiWizlO4BVKnkX4Q09fvVpD2A XEZtih1Q+N98YbzQmNH1dynpvrNrRwcD9fjVBK6soFjyspp3NC9T81+yIvmRGyxo 2TY2ijV+7EtTmREPmOm3RNA3diOKMprCfLcp1Iqgvk0THNovbAqdqv9hrIAmqSSz VGVTqFrTpQ9KvXzEosB96TKSQmy4LgmN7/KjKqZhPWyWvtXWJlsAyB5KWFASDpN6 8T6FnYplHGwamllAjLtqteug55JzqFT4FwIFhimhH9NIKlmeuz/MiyF4+eWzm9Jo 7QOyfNqY7nODwffNpbhSXtSwCS0rQeyrmZe2XPlC/ZLLA0FW1jadhoq+KxBiewqp 9f3SElzH9t7UQX884Hfpec4D2aERpEtvRvzvyjHxHNALDumjBjecBKqdA4MSfayc laK7r/654ABxZ8favBy2CUGeWuZOAAcL1qUshJ71XpclKh56NXyiYvqmg7HhwFIr UxpGWSwyJ1NNc00ZIxlrCGguBZbecIWpC0XrkHBais/qMPjDl4M= =uy5v -----END PGP SIGNATURE----- --Apple-Mail=_D16C193A-390A-44CD-A20C-00F53AA0455F-- From owner-freebsd-hackers@freebsd.org Sat Sep 19 10:29:12 2020 Return-Path: Delivered-To: freebsd-hackers@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 708ED3D9710 for ; Sat, 19 Sep 2020 10:29:12 +0000 (UTC) (envelope-from wojtek@puchar.net) Received: from puchar.net (puchar.net [194.1.144.90]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4Btn4R1G5dz4r2n for ; Sat, 19 Sep 2020 10:29:10 +0000 (UTC) (envelope-from wojtek@puchar.net) Received: Received: from 127.0.0.1 (localhost [127.0.0.1]) by puchar.net (8.15.2/8.16.1) with ESMTPS id 08JAT2Aq075246 (version=TLSv1.2 cipher=ECDHE-RSA-AES256-GCM-SHA384 bits=256 verify=NO) for ; Sat, 19 Sep 2020 12:29:02 +0200 (CEST) (envelope-from puchar-wojtek@puchar.net) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=puchar.net; s=default; t=1600511342; bh=i+KQoHziQJJuEngzH40+/TzzHzxX4wUhdmSYUAmWmjY=; h=Date:From:To:Subject; b=IzboyFhOgEzR6k7OD3iLA3KfrM4NuMOnscde4ufo69WKfC319ILp9JhjpJnMbVpqC /AHyU9JIDlVyH+CdOulFAXAT/nMp40mLVHg5NGTmrRXLAqhGKUkcK+lnyWduLih6ot 5XPCZGjtE5I8ABq8iPAhLFhdDcRo5jolsaxJFlyg= Received: from localhost (puchar-wojtek@localhost) by puchar.net (8.16.1/8.16.1/Submit) with ESMTP id 08JAT2uW075243 for ; Sat, 19 Sep 2020 12:29:02 +0200 (CEST) (envelope-from puchar-wojtek@puchar.net) Date: Sat, 19 Sep 2020 12:29:02 +0200 (CEST) From: Wojciech Puchar To: freebsd-hackers@freebsd.org Subject: portsnap problem Message-ID: User-Agent: Alpine 2.20 (BSF 67 2015-01-07) MIME-Version: 1.0 Content-Type: text/plain; format=flowed; charset=US-ASCII X-Rspamd-Queue-Id: 4Btn4R1G5dz4r2n X-Spamd-Bar: - Authentication-Results: mx1.freebsd.org; dkim=fail (headers rsa verify failed) header.d=puchar.net header.s=default header.b=IzboyFhO; dmarc=none; spf=pass (mx1.freebsd.org: domain of wojtek@puchar.net designates 194.1.144.90 as permitted sender) smtp.mailfrom=wojtek@puchar.net X-Spamd-Result: default: False [-1.14 / 15.00]; MID_RHS_MATCH_FROM(0.00)[]; ARC_NA(0.00)[]; NEURAL_HAM_MEDIUM(-0.95)[-0.945]; FROM_HAS_DN(0.00)[]; TO_MATCH_ENVRCPT_ALL(0.00)[]; R_SPF_ALLOW(-0.20)[+mx]; MIME_GOOD(-0.10)[text/plain]; TO_DN_NONE(0.00)[]; PREVIOUSLY_DELIVERED(0.00)[freebsd-hackers@freebsd.org]; RCPT_COUNT_ONE(0.00)[1]; NEURAL_HAM_LONG(-0.97)[-0.968]; DMARC_NA(0.00)[puchar.net]; R_DKIM_REJECT(1.00)[puchar.net:s=default]; DKIM_TRACE(0.00)[puchar.net:-]; NEURAL_SPAM_SHORT(0.07)[0.072]; FROM_EQ_ENVFROM(0.00)[]; MIME_TRACE(0.00)[0:+]; RCVD_TLS_LAST(0.00)[]; ASN(0.00)[asn:43476, ipnet:194.1.144.0/24, country:PL]; RCVD_COUNT_TWO(0.00)[2]; MAILMAN_DEST(0.00)[freebsd-hackers] X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.33 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 19 Sep 2020 10:29:12 -0000 i have up to day portsnap database on one host in /var/db/portsnap portsnap update works correctly i exported it over NFS /var/db/portsnap -ro -network 10/8 and mounted on another computer 10.1.0.1:/var/db/portsnap /var/db/portsnap nfs ro,late 0 0 and portsnap doesn't work # portsnap update No snapshot available. Try running # portsnap fetch what's more is needed that is not in /var/db/portsnap? From owner-freebsd-hackers@freebsd.org Sat Sep 19 20:02:37 2020 Return-Path: Delivered-To: freebsd-hackers@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id DF9983EDDB5; Sat, 19 Sep 2020 20:02:37 +0000 (UTC) (envelope-from uspoerlein@gmail.com) Received: from mail-oi1-f171.google.com (mail-oi1-f171.google.com [209.85.167.171]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "GTS CA 1O1" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4Bv1p46PFRz4QfV; Sat, 19 Sep 2020 20:02:36 +0000 (UTC) (envelope-from uspoerlein@gmail.com) Received: by mail-oi1-f171.google.com with SMTP id 26so3342084ois.5; Sat, 19 Sep 2020 13:02:36 -0700 (PDT) X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:references:in-reply-to:from:date :message-id:subject:to:cc; bh=jHRELi8xqcR4F1ZFH0+Cx6s1bSL8ARoeF/PJCer/lc4=; b=VCCcZoQN+83f9dkCKbgEO50Y6pjUlUD8I1B7PWLYWfHDkDzi00schv4K2F34Ez7rpN sB9t9OmZ58/DIcRimzGZh9e4ok+/yieAeFugoZLu1t3YnAt15STazXMT3pSUzw5L8avR DhKtTGPitH9N1ykmkUd/lgIRAuISkceFY8DSDN5Zg2JxrO1jlNQLvxsXe47p5e1GvONt hDBUlkltZaooInakkvLdDZmcKhlObA36sq3XrmRU2F3T0+EAk/Ez4DKTyTaYR+Zj0xN3 OpVDezmABZhZsCwFlG1lywhMVToDvNemLxp1cyFQxnP2tAotapV8VfYy6xn/bkoaXcQ3 nUEw== X-Gm-Message-State: AOAM533vm9dWuNSuGfDX05PdwuWoE4jGHis6OkJGgA5fplpayqqA6HE1 o420sc/jyhGGNBrXfFXQ8eZHXz0hkxVeMSeDO5ZNb4+tXm4= X-Google-Smtp-Source: ABdhPJzEYMsf7yfdmdqR1KfztYc8jQsWvghk+lppGeIFbi2Vgd8Iz5N9R/fSr0ivHD3+vNU/dl4cJKxYbvg8BMVkveI= X-Received: by 2002:aca:f414:: with SMTP id s20mr12857014oih.42.1600545755782; Sat, 19 Sep 2020 13:02:35 -0700 (PDT) MIME-Version: 1.0 References: In-Reply-To: From: =?UTF-8?Q?Ulrich_Sp=C3=B6rlein?= Date: Sat, 19 Sep 2020 22:02:24 +0200 Message-ID: Subject: Re: on moving freebsd from svn to git; would this be of any help? To: Chris Cc: freebsd-git , freebsd-current , freebsd-hackers , Ed Maste Content-Type: text/plain; charset="UTF-8" X-Rspamd-Queue-Id: 4Bv1p46PFRz4QfV X-Spamd-Bar: - Authentication-Results: mx1.freebsd.org; dkim=none; dmarc=none; spf=pass (mx1.freebsd.org: domain of uspoerlein@gmail.com designates 209.85.167.171 as permitted sender) smtp.mailfrom=uspoerlein@gmail.com X-Spamd-Result: default: False [-1.45 / 15.00]; MIME_TRACE(0.00)[0:+]; ARC_NA(0.00)[]; RCVD_COUNT_TWO(0.00)[2]; RCVD_TLS_ALL(0.00)[]; FROM_HAS_DN(0.00)[]; R_SPF_ALLOW(-0.20)[+ip4:209.85.128.0/17]; NEURAL_HAM_LONG(-0.99)[-0.990]; MIME_GOOD(-0.10)[text/plain]; DMARC_NA(0.00)[freebsd.org]; NEURAL_HAM_MEDIUM(-0.90)[-0.901]; RCPT_COUNT_FIVE(0.00)[5]; TO_MATCH_ENVRCPT_SOME(0.00)[]; TO_DN_ALL(0.00)[]; NEURAL_HAM_SHORT(-0.56)[-0.557]; RCVD_IN_DNSWL_NONE(0.00)[209.85.167.171:from]; FORGED_SENDER(0.30)[uqs@freebsd.org,uspoerlein@gmail.com]; RWL_MAILSPIKE_POSSIBLE(0.00)[209.85.167.171:from]; SUBJECT_ENDS_QUESTION(1.00)[]; FREEMAIL_ENVFROM(0.00)[gmail.com]; ASN(0.00)[asn:15169, ipnet:209.85.128.0/17, country:US]; R_DKIM_NA(0.00)[]; FROM_NEQ_ENVFROM(0.00)[uqs@freebsd.org,uspoerlein@gmail.com]; MAILMAN_DEST(0.00)[freebsd-git,freebsd-current,freebsd-hackers] X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.33 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 19 Sep 2020 20:02:37 -0000 On Fri, Sep 18, 2020 at 10:04 PM Ed Maste wrote: > > On Fri, 18 Sep 2020 at 15:07, Chris wrote: > > > > While contemplating a massive re-tooling job ahead to accommodate > > any/all changes when freebsd fully lands in git. I ran across this[1][2] > > and wondered if it may be of any assistance for the task of those > > involved in the migration process @freebsd. > > It doesn't solve any of the problems we have now; the actual svn to > git conversion via svn2git works fine. Open issues are with the svn > repository / mirrors, and finishing up process documentation. > > 1) http://catb.org/esr/reposurgeon/ > > 2) https://gitlab.com/esr/reposurgeon > > > > FTR I'm unaffiliated with the project. It just looked like it might be of > > interest. Thanks for bringing this up. I did look at reposurgeon quite a while ago but considered it too much work to get the rules right, especially for the CVS days of the project. Cheers Uli From owner-freebsd-hackers@freebsd.org Sat Sep 19 21:21:39 2020 Return-Path: Delivered-To: freebsd-hackers@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 34F4D3EFC69 for ; Sat, 19 Sep 2020 21:21:39 +0000 (UTC) (envelope-from thj@freebsd.org) Received: from wforward4-smtp.messagingengine.com (wforward4-smtp.messagingengine.com [64.147.123.34]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4Bv3YG69YRz4WfY; Sat, 19 Sep 2020 21:21:38 +0000 (UTC) (envelope-from thj@freebsd.org) Received: from compute7.internal (compute7.nyi.internal [10.202.2.47]) by mailforward.west.internal (Postfix) with ESMTP id 05B44614; Sat, 19 Sep 2020 17:21:36 -0400 (EDT) Received: from mailfrontend1 ([10.202.2.162]) by compute7.internal (MEProxy); Sat, 19 Sep 2020 17:21:37 -0400 DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d= messagingengine.com; h=content-type:date:from:message-id :mime-version:subject:to:x-me-proxy:x-me-proxy:x-me-sender :x-me-sender:x-sasl-enc; s=fm3; bh=d9I2Hwgy9lXy4fifAFcwhd7fII4OS /L14XbjeCj43yQ=; b=LaX1orP1wfj7NeMYmjA1jrqNqgjbXyTvuA7vURwmeduns CT0wqfJYVhcxVdvOkhjOFNcBOg0Zg/3mxhs/ggtzEOKkruFvrN1GKFdk5UW7A6kQ Z46SEoAXXR3+v+btkPhEw3PwXX1648M/XBRnWc0GLTBnShVTeHIJKDmm3L4OK0Ea BNGJ6gDxwpjGuQiQT35YI5Y8bGrZR3nik6U8vpkJoTrCzjsSN+36V4qIzeDBUNbj BhI89fKVF16NK38+R9tPj2ff6hlNq1XOOaKPQiEUANgXnmuQYUqETmWkQW1UN3Bh 3fzBsz0CD6kaMgGHv+AypGYwj2EtCBzYW+2hqbzuA== X-ME-Sender: X-ME-Proxy-Cause: gggruggvucftvghtrhhoucdtuddrgedujedrtdekgdduieduucetufdoteggodetrfdotf fvucfrrhhofhhilhgvmecuhfgrshhtofgrihhlpdfqfgfvpdfurfetoffkrfgpnffqhgen uceurghilhhouhhtmecufedttdenucenucfjughrpeffhffvuffkgggtugesthdtredttd dtvdenucfhrhhomhepvfhomhculfhonhgvshcuoehthhhjsehfrhgvvggsshgurdhorhhg qeenucggtffrrghtthgvrhhnpedvleegtdehhefhgefhjefhkeegffeftddutdfhgedtge fhhfefueetieehvddvgfenucffohhmrghinhepfhhrvggvsghsugdrohhrghdpfhhrvghs hhgsshgurdhorhhgnecukfhppedufeejrdehtddrudejrdduvdenucevlhhushhtvghruf hiiigvpedtnecurfgrrhgrmhepmhgrihhlfhhrohhmpehthhhjsehfrhgvvggsshgurdho rhhg X-ME-Proxy: Received: from tom-desk.erg.abdn.ac.uk (tom-desk.erg.abdn.ac.uk [137.50.17.12]) by mail.messagingengine.com (Postfix) with ESMTPA id 84EEE328005A; Sat, 19 Sep 2020 17:21:35 -0400 (EDT) Date: Sat, 19 Sep 2020 22:22:44 +0100 From: Tom Jones To: freebsd-hackers@freebsd.org Subject: Bugathon September 2020 Follow Up Message-ID: <20200919212244.GA28029@tom-desk.erg.abdn.ac.uk> MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline X-Rspamd-Queue-Id: 4Bv3YG69YRz4WfY X-Spamd-Bar: / Authentication-Results: mx1.freebsd.org; none X-Spamd-Result: default: False [0.00 / 15.00]; ASN(0.00)[asn:11403, ipnet:64.147.123.0/24, country:US]; local_wl_from(0.00)[freebsd.org] X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.33 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 19 Sep 2020 21:21:39 -0000 Hello Developers, On Saturday 19th September 2020[1] we held the second Bugathon of 2020. The Bugathon was hosted on google meet, and coordinated in the #freebsd-bugs irc channel on freenode. We planned a window from 1400UTC-2100UTC with the intention of having a long enough block of time that most of the world could take part. During this time we spoke about workflows and approaches for dealing with bugs and issues. For most hours of today there were 10 or so people on the google meet. In total we modified roughly 90 bugs[2] and have generated roughly 20 commits[2] so far (most of these commits are tagged with 'Event: September 2020 Bugathon'). Contributors today included several people that had not contribute to the FreeBSD bug reporting and development process and we got some creating accounts on phabricator and creating reviews. I would like to thank everyone that attended and helped close bugs, triage issues and added form to the discussion. I hope that more of these events happen in the future. To make sure we don't have another long pause between Bugathons, we are going to plan a third Bugathon for 2020 around the end of November/start of December. Going forward we might want to consider reducing the number of hours and starting later or setting up a couple of people to 'host' the start and the end of the Bugathon time slot. I will follow up nearer to the time of the next Bugathon date with specific details and plans for the day. I hope that you will join us next time to process bugs and make FreeBSD better. - Tom [1]: https://wiki.freebsd.org/Bugathons/202008 [2]: https://freshbsd.org/search?q=September+2020+Bugathon&sort=commit_date From owner-freebsd-hackers@freebsd.org Sat Sep 19 23:58:59 2020 Return-Path: Delivered-To: freebsd-hackers@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 3C36F3F2A73; Sat, 19 Sep 2020 23:58:59 +0000 (UTC) (envelope-from sgk@troutmask.apl.washington.edu) Received: from troutmask.apl.washington.edu (troutmask.apl.washington.edu [128.95.76.21]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "troutmask", Issuer "troutmask" (not verified)) by mx1.freebsd.org (Postfix) with ESMTPS id 4Bv72n6sk6z3RNy; Sat, 19 Sep 2020 23:58:57 +0000 (UTC) (envelope-from sgk@troutmask.apl.washington.edu) Received: from troutmask.apl.washington.edu (localhost [127.0.0.1]) by troutmask.apl.washington.edu (8.16.1/8.16.1) with ESMTPS id 08JNwnQG047724 (version=TLSv1.3 cipher=TLS_AES_256_GCM_SHA384 bits=256 verify=NO); Sat, 19 Sep 2020 16:58:49 -0700 (PDT) (envelope-from sgk@troutmask.apl.washington.edu) Received: (from sgk@localhost) by troutmask.apl.washington.edu (8.16.1/8.16.1/Submit) id 08JNwnLl047723; Sat, 19 Sep 2020 16:58:49 -0700 (PDT) (envelope-from sgk) Date: Sat, 19 Sep 2020 16:58:49 -0700 From: Steve Kargl To: freebsd-hackers@freebsd.org, freebsd-current@freebsd.org Subject: [PATCH] libm -- fix expl kernels Message-ID: <20200919235849.GA47701@troutmask.apl.washington.edu> MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline X-Rspamd-Queue-Id: 4Bv72n6sk6z3RNy X-Spamd-Bar: - Authentication-Results: mx1.freebsd.org; dkim=none; dmarc=fail reason="No valid SPF, No valid DKIM" header.from=washington.edu (policy=none); spf=none (mx1.freebsd.org: domain of sgk@troutmask.apl.washington.edu has no SPF policy when checking 128.95.76.21) smtp.mailfrom=sgk@troutmask.apl.washington.edu X-Spamd-Result: default: False [-1.48 / 15.00]; RCVD_TLS_ALL(0.00)[]; ARC_NA(0.00)[]; MID_RHS_MATCH_FROM(0.00)[]; FROM_HAS_DN(0.00)[]; TO_MATCH_ENVRCPT_ALL(0.00)[]; NEURAL_HAM_LONG(-0.37)[-0.367]; MIME_GOOD(-0.10)[text/plain]; TO_DN_NONE(0.00)[]; NEURAL_HAM_MEDIUM(-0.56)[-0.558]; NEURAL_HAM_SHORT(-0.55)[-0.553]; RCPT_COUNT_TWO(0.00)[2]; R_SPF_NA(0.00)[no SPF record]; FROM_EQ_ENVFROM(0.00)[]; R_DKIM_NA(0.00)[]; MIME_TRACE(0.00)[0:+]; ASN(0.00)[asn:73, ipnet:128.95.0.0/16, country:US]; RCVD_COUNT_TWO(0.00)[2]; MAILMAN_DEST(0.00)[freebsd-hackers,freebsd-current]; DMARC_POLICY_SOFTFAIL(0.10)[washington.edu : No valid SPF, No valid DKIM, none] X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.33 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 19 Sep 2020 23:58:59 -0000 The following patch fixes the ld80 and ld128 kernels for expl(x). I can't test ld128, so that patch is untested. . Micro-optimization: use sincosl(x) instead of a call to cosl(x) and a call to sinl(x). Argument reduction is done once not twice. . Use a long double constant instead of an invalid double constant. . Spell scale2 correctly --- /usr/src/lib/msun/ld80/k_expl.h 2019-02-23 07:45:04.364785000 -0800 +++ ld80/k_expl.h 2019-12-26 08:15:29.366146000 -0800 @@ -277,7 +277,7 @@ static inline long double complex __ldexp_cexpl(long double complex z, int expt) { - long double exp_x, hi, lo; + long double c, exp_x, hi, lo, s; long double x, y, scale1, scale2; int half_expt, k; @@ -285,16 +285,17 @@ y = cimagl(z); __k_expl(x, &hi, &lo, &k); - exp_x = (lo + hi) * 0x1p16382; + exp_x = (lo + hi) * 0x1p16382L; expt += k - 16382; scale1 = 1; half_expt = expt / 2; SET_LDBL_EXPSIGN(scale1, BIAS + half_expt); scale2 = 1; - SET_LDBL_EXPSIGN(scale1, BIAS + expt - half_expt); + SET_LDBL_EXPSIGN(scale2, BIAS + expt - half_expt); - return (CMPLXL(cos(y) * exp_x * scale1 * scale2, - sinl(y) * exp_x * scale1 * scale2)); + sincosl(y, &s, &c); + return (CMPLXL(c * exp_x * scale1 * scale2, + s * exp_x * scale1 * scale2)); } #endif /* _COMPLEX_H */ --- /usr/src/lib/msun/ld128/k_expl.h 2020-03-07 09:48:15.719876000 -0800 +++ ld128/k_expl.h 2020-09-19 16:51:43.577195000 -0700 @@ -300,7 +300,7 @@ static inline long double complex __ldexp_cexpl(long double complex z, int expt) { - long double exp_x, hi, lo; + long double c, exp_x, hi, lo, s; long double x, y, scale1, scale2; int half_expt, k; @@ -308,16 +308,17 @@ y = cimagl(z); __k_expl(x, &hi, &lo, &k); - exp_x = (lo + hi) * 0x1p16382; + exp_x = (lo + hi) * 0x1p16382L; expt += k - 16382; scale1 = 1; half_expt = expt / 2; SET_LDBL_EXPSIGN(scale1, BIAS + half_expt); scale2 = 1; - SET_LDBL_EXPSIGN(scale1, BIAS + expt - half_expt); + SET_LDBL_EXPSIGN(scale2, BIAS + expt - half_expt); - return (CMPLXL(cos(y) * exp_x * scale1 * scale2, - sinl(y) * exp_x * scale1 * scale2)); + sincosl(y, &s, &c); + return (CMPLXL(c * exp_x * scale1 * scale2, + s * exp_x * scale1 * scale2)); } #endif /* _COMPLEX_H */ -- Steve