From owner-freebsd-current@freebsd.org Mon Jun 15 05:34:22 2020 Return-Path: Delivered-To: freebsd-current@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 7CDFE34FA25; Mon, 15 Jun 2020 05:34:22 +0000 (UTC) (envelope-from owner-freebsd-quarterly-calls@freebsd.org) Received: from mailman.nyi.freebsd.org (mailman.nyi.freebsd.org [IPv6:2610:1c1:1:606c::50:13]) by mx1.freebsd.org (Postfix) with ESMTP id 49lg4Z1rb3z47Fs; Mon, 15 Jun 2020 05:34:22 +0000 (UTC) (envelope-from owner-freebsd-quarterly-calls@freebsd.org) Delivered-To: freebsd-quarterly-calls@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 72D973498D5; Mon, 15 Jun 2020 00:10:01 +0000 (UTC) (envelope-from salvadore@freebsd.org) Received: from freefall.freebsd.org (freefall.freebsd.org [IPv6:2610:1c1:1:6074::16:84]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "freefall.freebsd.org", Issuer "Let's Encrypt Authority X3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 49lWtK2RGBz3ZZP; Mon, 15 Jun 2020 00:10:01 +0000 (UTC) (envelope-from salvadore@freebsd.org) Received: by freefall.freebsd.org (Postfix, from userid 1472) id 3DFD31D4F4; Mon, 15 Jun 2020 00:10:01 +0000 (UTC) To: freebsd-quarterly-calls@FreeBSD.org Subject: [2 WEEKS LEFT REMINDER] Call for 2020Q2 quarterly status reports Message-Id: <20200615001001.3DFD31D4F4@freefall.freebsd.org> Date: Mon, 15 Jun 2020 00:10:01 +0000 (UTC) From: Lorenzo Salvadore X-Mailman-Approved-At: Mon, 15 Jun 2020 05:34:21 +0000 X-BeenThere: freebsd-quarterly-calls@freebsd.org X-Mailman-Version: 2.1.33 Precedence: list Cc: jhibbits@FreeBSD.org, brooks@FreeBSD.org, dgr@semihalf.com, bsdic@microsoft.com, mikael@FreeBSD.org, mk@semihalf.com, pizzamig@FreeBSD.org, ebrandi@FreeBSD.org, kib@FreeBSD.org, dmgk@FreeBSD.org, rmacklem@freebsd.org, trasz@FreeBSD.org, kp@FreeBSD.org, mw@semihalf.com, kde@FreeBSD.org, linimon@FreeBSD.org, imp@freebsd.org, soc-mentors@FreeBSD.org, andrew@FreeBSD.org, esteban.barrios@trivago.com, info@NomadBSD.org, x11@freebsd.org, gerald@FreeBSD.org, mba@semihalf.com, ar@semihalf.com, dbaio@FreeBSD.org, philip@FreeBSD.org, info@bsdcan.org, rwatson@FreeBSD.org, tuexen@FreeBSD.org, lwhsu@FreeBSD.org, alfonso.siciliano@email.com, soc-students@FreeBSD.org, jhb@FreeBSD.org, xfce@FreeBSD.org, zeising@freebsd.org, pkubaj@FreeBSD.org, markj@FreeBSD.org, mhorne@FreeBSD.org, gbergling@gmail.com, br@FreeBSD.org, whu@FreeBSD.org MIME-Version: 1.0 Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: 7bit Errors-To: owner-freebsd-quarterly-calls@freebsd.org Sender: owner-freebsd-quarterly-calls@freebsd.org X-Mailman-Approved-At: Mon, 15 Jun 2020 06:01:41 +0000 X-BeenThere: freebsd-current@freebsd.org List-Id: Discussions about the use of FreeBSD-current List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 15 Jun 2020 05:34:22 -0000 Dear FreeBSD Community, The deadline for the next FreeBSD Quarterly Status update is July, 1st 2020 for work done since the last round of Quarterly Reports: April 2020 - June 2020. I would like to remind you that reports are collected during the last month of every quarter. Status report submissions do not need to be very long. They may be about anything happening in the FreeBSD project and community, and they provide a great way to inform FreeBSD users and developers about work that is underway or has been completed. Report submissions are not limited to committers; anyone doing anything interesting and FreeBSD related can -- and should -- write one! The preferred method is to follow the guidelines at the Quarterly GitHub repository: https://github.com/freebsd/freebsd-quarterly Alternatively you can fetch the Markdown template, fill it in, and email it to quarterly-submissions@FreeBSD.org. The template can be found at: https://raw.githubusercontent.com/freebsd/freebsd-quarterly/master/report-sample.md We look forward to seeing your 2020Q2 reports! Thanks, Lorenzo Salvadore (on behalf of quarterly@) _______________________________________________ freebsd-quarterly-calls@freebsd.org mailing list https://lists.freebsd.org/mailman/listinfo/freebsd-quarterly-calls To unsubscribe, send any mail to "freebsd-quarterly-calls-unsubscribe@freebsd.org" From owner-freebsd-current@freebsd.org Mon Jun 15 09:12:37 2020 Return-Path: Delivered-To: freebsd-current@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 92AD732D10A for ; Mon, 15 Jun 2020 09:12:37 +0000 (UTC) (envelope-from SRS0=j+G0yf=74=codenetworks.net=sm@eigbox.net) Received: from mailman.nyi.freebsd.org (unknown [127.0.1.3]) by mx1.freebsd.org (Postfix) with ESMTP id 49llwP2htsz4KcJ for ; Mon, 15 Jun 2020 09:12:37 +0000 (UTC) (envelope-from SRS0=j+G0yf=74=codenetworks.net=sm@eigbox.net) Received: by mailman.nyi.freebsd.org (Postfix) id 5C6C132D108; Mon, 15 Jun 2020 09:12:37 +0000 (UTC) Delivered-To: current@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 5C28A32D107 for ; Mon, 15 Jun 2020 09:12:37 +0000 (UTC) (envelope-from SRS0=j+G0yf=74=codenetworks.net=sm@eigbox.net) Received: from bosmailout06.eigbox.net (bosmailout06.eigbox.net [66.96.189.6]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 49llwN48Dlz4Kql for ; Mon, 15 Jun 2020 09:12:36 +0000 (UTC) (envelope-from SRS0=j+G0yf=74=codenetworks.net=sm@eigbox.net) Received: from bosmailscan12.eigbox.net ([10.20.15.12]) by bosmailout06.eigbox.net with esmtp (Exim) id 1jklAR-0001xy-Of for current@freebsd.org; Mon, 15 Jun 2020 05:12:35 -0400 DKIM-Signature: v=1; a=rsa-sha256; q=dns/txt; c=relaxed/relaxed; d=codenetworks.net; s=dkim; h=Sender:Content-Transfer-Encoding:Content-Type: MIME-Version:Date:Message-ID:Subject:From:To:Reply-To:Cc:Content-ID: Content-Description:Resent-Date:Resent-From:Resent-Sender:Resent-To:Resent-Cc :Resent-Message-ID:In-Reply-To:References:List-Id:List-Help:List-Unsubscribe: List-Subscribe:List-Post:List-Owner:List-Archive; bh=jxsjDpFx67nfC8ehpaHXHy51l1ihCTimvNdEogu1sG4=; b=CnZ6+UYS6ak+POLFQUpUZjwzhO IxTyPpVZxn1Dzrx5FKuIHG6AHiQUH2Y00BecBdvjl6BBDMo/pbnFzXlGcOTxzDQF3sGKcW/mDn30Z NkTXJ5XmAxfELEcXxlQNp1YNZfCYOA24DaXwkScyNL4CitiyKOIUbUK6A45wQvasd8UXVdtn+FstS bYLaLKJUFrV0iWsoKppuAqkNbZfaaPHRw4bo3nggFc+TBY10uaI4Xp+iEUpEETvCoH6ONA70jchsA KM+KMwhINGeGfRL6UGGqB6MDBh/oy7yFwzD/v6nmVjuBkGI234sqtDO3epzEMrtswJsLrXZOXzZz/ PAm17YgQ==; Received: from [10.115.3.33] (helo=bosimpout13) by bosmailscan12.eigbox.net with esmtp (Exim) id 1jklAM-0005fW-KS for current@freebsd.org; Mon, 15 Jun 2020 05:12:30 -0400 Received: from bosauthsmtp12.yourhostingaccount.com ([10.20.18.12]) by bosimpout13 with id rMCT220050FdZ9W01MCWyj; Mon, 15 Jun 2020 05:12:30 -0400 X-Authority-Analysis: v=2.2 cv=fPhJ5dSe c=1 sm=1 tr=0 a=wx0GOVZTcu8EuaXTIXj3VQ==:117 a=kkwQLKMA1cIZLGAtbCrT4w==:17 a=IkcTkHD0fZMA:10 a=nTHF0DUjJn0A:10 a=zXyMKnP1Z5YA:10 a=SL0ElOo6BE46HkWlXfoA:9 a=QEXdDO2ut3YA:10 Received: from cpc96142-rdng26-2-0-cust93.15-3.cable.virginm.net ([80.5.170.94]:19248 helo=[192.168.0.100]) by bosauthsmtp12.eigbox.net with esmtpa (Exim) id 1jklAJ-0004KH-6B for current@freebsd.org; Mon, 15 Jun 2020 05:12:27 -0400 To: FreeBSD Current From: Santiago Martinez Subject: Panic on mlx5en. Message-ID: <1bf2ffc5-386a-c0fa-4cc1-246892da3a38@codenetworks.net> Date: Mon, 15 Jun 2020 10:12:25 +0100 User-Agent: Mozilla/5.0 (X11; FreeBSD amd64; rv:68.0) Gecko/20100101 Thunderbird/68.9.0 MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8; format=flowed Content-Transfer-Encoding: 7bit Content-Language: en-US X-EN-UserInfo: d3bdfab0736480cedf04ed92aaea2ef5:931c98230c6409dcc37fa7e93b490c27 X-EN-AuthUser: sm@codenetworks.net Sender: Santiago Martinez X-EN-OrigIP: 80.5.170.94 X-EN-OrigHost: cpc96142-rdng26-2-0-cust93.15-3.cable.virginm.net X-Rspamd-Queue-Id: 49llwN48Dlz4Kql X-Spamd-Bar: - Authentication-Results: mx1.freebsd.org; dkim=none (invalid DKIM record) header.d=codenetworks.net header.s=dkim header.b=CnZ6+UYS; dmarc=none; spf=pass (mx1.freebsd.org: domain of SRS0=j@eigbox.net designates 66.96.189.6 as permitted sender) smtp.mailfrom=SRS0=j@eigbox.net X-Spamd-Result: default: False [-1.88 / 15.00]; RCVD_VIA_SMTP_AUTH(0.00)[]; ARC_NA(0.00)[]; RCVD_COUNT_FIVE(0.00)[5]; MID_RHS_MATCH_FROM(0.00)[]; FROM_HAS_DN(0.00)[]; TO_MATCH_ENVRCPT_ALL(0.00)[]; R_SPF_ALLOW(-0.20)[+ip4:66.96.128.0/18]; MIME_GOOD(-0.10)[text/plain]; DMARC_NA(0.00)[codenetworks.net: no valid DMARC record]; NEURAL_HAM_LONG(-0.90)[-0.896]; RCPT_COUNT_ONE(0.00)[1]; NEURAL_HAM_MEDIUM(-0.81)[-0.811]; TO_DN_ALL(0.00)[]; DKIM_TRACE(0.00)[codenetworks.net:~]; NEURAL_HAM_SHORT(-0.18)[-0.177]; RCVD_IN_DNSWL_NONE(0.00)[66.96.189.6:from]; R_DKIM_PERMFAIL(0.00)[codenetworks.net:s=dkim]; FORGED_SENDER(0.30)[sm@codenetworks.net,SRS0=j@eigbox.net]; RWL_MAILSPIKE_POSSIBLE(0.00)[66.96.189.6:from]; MIME_TRACE(0.00)[0:+]; RCVD_TLS_LAST(0.00)[]; ASN(0.00)[asn:29873, ipnet:66.96.128.0/18, country:US]; TAGGED_FROM(0.00)[G0yf=74=codenetworks.net=sm]; FROM_NEQ_ENVFROM(0.00)[sm@codenetworks.net,SRS0=j@eigbox.net]; RECEIVED_SPAMHAUS_PBL(0.00)[80.5.170.94:received] X-BeenThere: freebsd-current@freebsd.org X-Mailman-Version: 2.1.33 Precedence: list List-Id: Discussions about the use of FreeBSD-current List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 15 Jun 2020 09:12:37 -0000 Hi everyone, while doing some tests for an MRSAS panic I hit another one on mlx5en. The device is a LenovoSR655 with 2xMellanox NIC. 1 - Mellanox CX-4 Lx 10/25GbE SFP28 2-port OCP Ethernet Adapter 2 - Mellanox CX-4 Lx 10/25GbE SFP28 2-port PCIe Ethernet Adapter This only happens only with current, tried different snapshots and the same in all. On 12.1 works without a problem. Trace (please not that is OCR+ manual corrections): Tracing pid 2288 tid 182178 td @8xfffffeB385fe6500 kdb_enter() at kbd_inter+0x37/frame 0xfffffe0386030ba0 vpanic() at vpanic+0x19e/frame 0xfffffe0386030bf0 panic() at panic+0x43/frame 0xfffffe038630c50 trap_fatal() at trap_fatal+0x387/frame 0xfffffe0386030cb0 trap() at trap+0x80/frame Bxfffffe0386030dc0 calltrap() at calltrap+0x80/frame Bxfffffed386830dc0 --- trap 0x9, rip = 0xfffffff8275c060, rsp = 0xfffffe0386030e90, rbp = 0xfffffe0386030e90 --- linux_root_RB_INSERT_COLOR() at linux_root_RB_INSERT COLOR+0x40/frame 0xfffffe0386030f60 give_pages() at give pages+0x163/frame 0xfffffe0386830f20 mlx5_satisfy_startup_pages() at mlx5_satisfy_startup_pages+0x76/frame 0xfffffe0386030f60 mlx5_load_one () at mlx5_load_one+0x6b7/frame 0xfffffe0386031080 init_one() at init_one+0x12d5/frame 0xfffffe03860310f0 linux_pci_attach_device() at linux_pci_attach device+0x573/frame 0xfffffe0386031150 device_attach() at device_attach+0x3ca/frame 0xfffffe0386031190 device_probe_and_attach() at device_probe_and_attach+0x70/frame 0xfffffe03860311c0 pci_driver_added() at pci_driver_added+0xf6/frame 0xfffffe0386031200 devclass_driver_added() at devclass_driver_added+0x39/frame 0xfffffe0386031240 devclass_add_driver() at devclass_add_driver+0x147/frame 0xfffffe0386031280 _linux_pci_register_driver() at _linux_pci_register_driver+0xc9/frame 0xfffffe03860312a0 From owner-freebsd-current@freebsd.org Mon Jun 15 11:26:58 2020 Return-Path: Delivered-To: freebsd-current@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 0F277330600 for ; Mon, 15 Jun 2020 11:26:58 +0000 (UTC) (envelope-from hps@selasky.org) Received: from mailman.nyi.freebsd.org (unknown [127.0.1.3]) by mx1.freebsd.org (Postfix) with ESMTP id 49lpvP5WbCz4SFh for ; Mon, 15 Jun 2020 11:26:57 +0000 (UTC) (envelope-from hps@selasky.org) Received: by mailman.nyi.freebsd.org (Postfix) id BD6E132F9E3; Mon, 15 Jun 2020 11:26:57 +0000 (UTC) Delivered-To: current@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id BD31F330320 for ; Mon, 15 Jun 2020 11:26:57 +0000 (UTC) (envelope-from hps@selasky.org) Received: from mail.turbocat.net (turbocat.net [88.99.82.50]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 49lpvN4nH0z4SHj for ; Mon, 15 Jun 2020 11:26:56 +0000 (UTC) (envelope-from hps@selasky.org) Received: from hps2020.home.selasky.org (unknown [62.141.129.235]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (2048 bits) server-digest SHA256) (No client certificate requested) by mail.turbocat.net (Postfix) with ESMTPSA id 834542601EC; Mon, 15 Jun 2020 13:26:54 +0200 (CEST) Subject: Re: Panic on mlx5en. To: Santiago Martinez , FreeBSD Current References: <1bf2ffc5-386a-c0fa-4cc1-246892da3a38@codenetworks.net> From: Hans Petter Selasky Message-ID: <37677b81-0984-d6f4-9a6d-ebe94957ce47@selasky.org> Date: Mon, 15 Jun 2020 13:26:35 +0200 User-Agent: Mozilla/5.0 (X11; FreeBSD amd64; rv:68.0) Gecko/20100101 Thunderbird/68.8.0 MIME-Version: 1.0 In-Reply-To: <1bf2ffc5-386a-c0fa-4cc1-246892da3a38@codenetworks.net> Content-Type: text/plain; charset=utf-8; format=flowed Content-Language: en-US Content-Transfer-Encoding: 7bit X-Rspamd-Queue-Id: 49lpvN4nH0z4SHj X-Spamd-Bar: -- Authentication-Results: mx1.freebsd.org; dkim=none; dmarc=none; spf=pass (mx1.freebsd.org: domain of hps@selasky.org designates 88.99.82.50 as permitted sender) smtp.mailfrom=hps@selasky.org X-Spamd-Result: default: False [-2.53 / 15.00]; RCVD_VIA_SMTP_AUTH(0.00)[]; ARC_NA(0.00)[]; MID_RHS_MATCH_FROM(0.00)[]; FROM_HAS_DN(0.00)[]; R_SPF_ALLOW(-0.20)[+a:mail.turbocat.net]; NEURAL_HAM_LONG(-0.98)[-0.980]; MIME_GOOD(-0.10)[text/plain]; DMARC_NA(0.00)[selasky.org]; NEURAL_HAM_MEDIUM(-0.97)[-0.973]; TO_MATCH_ENVRCPT_SOME(0.00)[]; TO_DN_ALL(0.00)[]; NEURAL_HAM_SHORT(-0.28)[-0.279]; RCPT_COUNT_TWO(0.00)[2]; FROM_EQ_ENVFROM(0.00)[]; R_DKIM_NA(0.00)[]; MIME_TRACE(0.00)[0:+]; ASN(0.00)[asn:24940, ipnet:88.99.0.0/16, country:DE]; RCVD_COUNT_TWO(0.00)[2]; RCVD_TLS_ALL(0.00)[] X-BeenThere: freebsd-current@freebsd.org X-Mailman-Version: 2.1.33 Precedence: list List-Id: Discussions about the use of FreeBSD-current List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 15 Jun 2020 11:26:58 -0000 On 2020-06-15 11:12, Santiago Martinez wrote: > Hi everyone, while doing some tests for an MRSAS panic I hit another one > on mlx5en. > > The device is a LenovoSR655 with 2xMellanox NIC. > > 1 - Mellanox CX-4 Lx 10/25GbE SFP28 2-port OCP Ethernet Adapter > 2 - Mellanox CX-4 Lx 10/25GbE SFP28 2-port PCIe Ethernet Adapter > > This only happens only with current, tried different snapshots and the > same in all. > On 12.1 works without a problem. > > Trace (please not that is OCR+ manual corrections): > > Tracing pid 2288 tid 182178 td @8xfffffeB385fe6500 > kdb_enter() at kbd_inter+0x37/frame 0xfffffe0386030ba0 > vpanic() at vpanic+0x19e/frame 0xfffffe0386030bf0 > panic() at panic+0x43/frame 0xfffffe038630c50 > trap_fatal() at trap_fatal+0x387/frame 0xfffffe0386030cb0 > trap() at trap+0x80/frame Bxfffffe0386030dc0 > calltrap() at calltrap+0x80/frame Bxfffffed386830dc0 > --- trap 0x9, rip = 0xfffffff8275c060, rsp = 0xfffffe0386030e90, rbp = > 0xfffffe0386030e90 --- > linux_root_RB_INSERT_COLOR() at linux_root_RB_INSERT COLOR+0x40/frame > 0xfffffe0386030f60 > give_pages() at give pages+0x163/frame 0xfffffe0386830f20 > mlx5_satisfy_startup_pages() at mlx5_satisfy_startup_pages+0x76/frame > 0xfffffe0386030f60 > mlx5_load_one () at mlx5_load_one+0x6b7/frame 0xfffffe0386031080 > init_one() at init_one+0x12d5/frame 0xfffffe03860310f0 > linux_pci_attach_device() at linux_pci_attach device+0x573/frame > 0xfffffe0386031150 > device_attach() at device_attach+0x3ca/frame 0xfffffe0386031190 > device_probe_and_attach() at device_probe_and_attach+0x70/frame > 0xfffffe03860311c0 > pci_driver_added() at pci_driver_added+0xf6/frame 0xfffffe0386031200 > devclass_driver_added() at devclass_driver_added+0x39/frame > 0xfffffe0386031240 > devclass_add_driver() at devclass_add_driver+0x147/frame 0xfffffe0386031280 > _linux_pci_register_driver() at _linux_pci_register_driver+0xc9/frame > 0xfffffe03860312a0 > Are you using the latest version of kernel & mlx5en as of today? There was a regression issue with the rbtree.h implementation which recently was fixed. --HPS From owner-freebsd-current@freebsd.org Mon Jun 15 13:31:17 2020 Return-Path: Delivered-To: freebsd-current@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 284CD334198 for ; Mon, 15 Jun 2020 13:31:17 +0000 (UTC) (envelope-from SRS0=j+G0yf=74=codenetworks.net=sm@eigbox.net) Received: from mailman.nyi.freebsd.org (mailman.nyi.freebsd.org [IPv6:2610:1c1:1:606c::50:13]) by mx1.freebsd.org (Postfix) with ESMTP id 49lsfr6dLfz4bHK for ; Mon, 15 Jun 2020 13:31:16 +0000 (UTC) (envelope-from SRS0=j+G0yf=74=codenetworks.net=sm@eigbox.net) Received: by mailman.nyi.freebsd.org (Postfix) id E385F334113; Mon, 15 Jun 2020 13:31:16 +0000 (UTC) Delivered-To: current@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id E34D8333FB9 for ; Mon, 15 Jun 2020 13:31:16 +0000 (UTC) (envelope-from SRS0=j+G0yf=74=codenetworks.net=sm@eigbox.net) Received: from bosmailout04.eigbox.net (bosmailout04.eigbox.net [66.96.187.4]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 49lsfr14B0z4bCW for ; Mon, 15 Jun 2020 13:31:15 +0000 (UTC) (envelope-from SRS0=j+G0yf=74=codenetworks.net=sm@eigbox.net) Received: from bosmailscan01.eigbox.net ([10.20.15.1]) by bosmailout04.eigbox.net with esmtp (Exim) id 1jkpCl-0004sM-5e for current@freebsd.org; Mon, 15 Jun 2020 09:31:15 -0400 DKIM-Signature: v=1; a=rsa-sha256; q=dns/txt; c=relaxed/relaxed; d=codenetworks.net; s=dkim; h=Sender:Content-Transfer-Encoding:Content-Type: In-Reply-To:MIME-Version:Date:Message-ID:From:References:To:Subject:Reply-To: Cc:Content-ID:Content-Description:Resent-Date:Resent-From:Resent-Sender: Resent-To:Resent-Cc:Resent-Message-ID:List-Id:List-Help:List-Unsubscribe: List-Subscribe:List-Post:List-Owner:List-Archive; bh=eP9oRW+GHdbR9DAnmihXEDNaZ+2MGCXTtDitJdFJNzI=; b=vk6QpNarbaHf4iKvuSbNkr4t39 S+1ytKWbzCWJs9bLgr1ejaiJjxRvb62FaBwLF59gqXMfj6Tb7LWbP3rxLBZkMKlRGLDsWPIc9RWhg kTrCpGMfRIhUpP7KzBcpsquJGTjgQHOSUIAYpr01yoLIHABDTlzYwWzXzKgdogUGQWxGkQQ6z9Yef H05E+PrGf7gvNy2OovDPF09IBuINKyhA6gpfG+n0hI+K6Xq/s3eYALV0vbqp6+eSQ2BMx53xQfTaF aH0MaGPrgRN2QpKcDruAeAB4FnDXsMUqRlSEm4wpUgUSJE2defCzVzgoDyCyC+Gt57dQwaKXe4Mhn VOGx3u7A==; Received: from [10.115.3.31] (helo=bosimpout11) by bosmailscan01.eigbox.net with esmtp (Exim) id 1jkpCl-0001ep-22 for current@freebsd.org; Mon, 15 Jun 2020 09:31:15 -0400 Received: from bosauthsmtp12.yourhostingaccount.com ([10.20.18.12]) by bosimpout11 with id rRXB2200c0FdZ9W01RXEUH; Mon, 15 Jun 2020 09:31:15 -0400 X-Authority-Analysis: v=2.2 cv=RKvDJ8q+ c=1 sm=1 tr=0 a=wx0GOVZTcu8EuaXTIXj3VQ==:117 a=kkwQLKMA1cIZLGAtbCrT4w==:17 a=IkcTkHD0fZMA:10 a=nTHF0DUjJn0A:10 a=zXyMKnP1Z5YA:10 a=6I5d2MoRAAAA:8 a=rKwGeXDLPNT9r_oSBT4A:9 a=QEXdDO2ut3YA:10 a=IjZwj45LgO3ly-622nXo:22 Received: from cpc96142-rdng26-2-0-cust93.15-3.cable.virginm.net ([80.5.170.94]:27647 helo=[192.168.0.100]) by bosauthsmtp12.eigbox.net with esmtpa (Exim) id 1jkpCh-0001Hu-C7; Mon, 15 Jun 2020 09:31:11 -0400 Subject: Re: Panic on mlx5en. To: Hans Petter Selasky , FreeBSD Current References: <1bf2ffc5-386a-c0fa-4cc1-246892da3a38@codenetworks.net> <37677b81-0984-d6f4-9a6d-ebe94957ce47@selasky.org> From: Santiago Martinez Message-ID: <5bfad49a-5b74-1947-c6bb-9d9a20f472be@codenetworks.net> Date: Mon, 15 Jun 2020 14:31:08 +0100 User-Agent: Mozilla/5.0 (X11; FreeBSD amd64; rv:68.0) Gecko/20100101 Thunderbird/68.9.0 MIME-Version: 1.0 In-Reply-To: <37677b81-0984-d6f4-9a6d-ebe94957ce47@selasky.org> Content-Type: text/plain; charset=utf-8; format=flowed Content-Transfer-Encoding: 7bit Content-Language: en-US X-EN-UserInfo: d3bdfab0736480cedf04ed92aaea2ef5:931c98230c6409dcc37fa7e93b490c27 X-EN-AuthUser: sm@codenetworks.net Sender: Santiago Martinez X-EN-OrigIP: 80.5.170.94 X-EN-OrigHost: cpc96142-rdng26-2-0-cust93.15-3.cable.virginm.net X-Rspamd-Queue-Id: 49lsfr14B0z4bCW X-Spamd-Bar: -- Authentication-Results: mx1.freebsd.org; dkim=none (invalid DKIM record) header.d=codenetworks.net header.s=dkim header.b=vk6QpNar; dmarc=none; spf=pass (mx1.freebsd.org: domain of SRS0=j@eigbox.net designates 66.96.187.4 as permitted sender) smtp.mailfrom=SRS0=j@eigbox.net X-Spamd-Result: default: False [-2.56 / 15.00]; RCVD_VIA_SMTP_AUTH(0.00)[]; ARC_NA(0.00)[]; RCVD_COUNT_FIVE(0.00)[5]; MID_RHS_MATCH_FROM(0.00)[]; FROM_HAS_DN(0.00)[]; R_SPF_ALLOW(-0.20)[+ip4:66.96.128.0/18]; NEURAL_HAM_LONG(-1.02)[-1.021]; MIME_GOOD(-0.10)[text/plain]; DMARC_NA(0.00)[codenetworks.net: no valid DMARC record]; NEURAL_HAM_MEDIUM(-0.98)[-0.981]; TO_MATCH_ENVRCPT_SOME(0.00)[]; TO_DN_ALL(0.00)[]; DKIM_TRACE(0.00)[codenetworks.net:~]; RCPT_COUNT_TWO(0.00)[2]; RCVD_IN_DNSWL_NONE(0.00)[66.96.187.4:from]; NEURAL_HAM_SHORT(-0.56)[-0.562]; R_DKIM_PERMFAIL(0.00)[codenetworks.net:s=dkim]; FORGED_SENDER(0.30)[sm@codenetworks.net,SRS0=j@eigbox.net]; RECEIVED_SPAMHAUS_PBL(0.00)[80.5.170.94:received]; MIME_TRACE(0.00)[0:+]; RCVD_TLS_LAST(0.00)[]; ASN(0.00)[asn:29873, ipnet:66.96.128.0/18, country:US]; TAGGED_FROM(0.00)[G0yf=74=codenetworks.net=sm]; FROM_NEQ_ENVFROM(0.00)[sm@codenetworks.net,SRS0=j@eigbox.net] X-BeenThere: freebsd-current@freebsd.org X-Mailman-Version: 2.1.33 Precedence: list List-Id: Discussions about the use of FreeBSD-current List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 15 Jun 2020 13:31:17 -0000 Hi Peter, yes Im using the latest one. Santi On 2020-06-15 12:26, Hans Petter Selasky wrote: > On 2020-06-15 11:12, Santiago Martinez wrote: >> Hi everyone, while doing some tests for an MRSAS panic I hit another >> one on mlx5en. >> >> The device is a LenovoSR655 with 2xMellanox NIC. >> >> 1 - Mellanox CX-4 Lx 10/25GbE SFP28 2-port OCP Ethernet Adapter >> 2 - Mellanox CX-4 Lx 10/25GbE SFP28 2-port PCIe Ethernet Adapter >> >> This only happens only with current, tried different snapshots and >> the same in all. >> On 12.1 works without a problem. >> >> Trace (please not that is OCR+ manual corrections): >> >> Tracing pid 2288 tid 182178 td @8xfffffeB385fe6500 >> kdb_enter() at kbd_inter+0x37/frame 0xfffffe0386030ba0 >> vpanic() at vpanic+0x19e/frame 0xfffffe0386030bf0 >> panic() at panic+0x43/frame 0xfffffe038630c50 >> trap_fatal() at trap_fatal+0x387/frame 0xfffffe0386030cb0 >> trap() at trap+0x80/frame Bxfffffe0386030dc0 >> calltrap() at calltrap+0x80/frame Bxfffffed386830dc0 >> --- trap 0x9, rip = 0xfffffff8275c060, rsp = 0xfffffe0386030e90, rbp >> = 0xfffffe0386030e90 --- >> linux_root_RB_INSERT_COLOR() at linux_root_RB_INSERT COLOR+0x40/frame >> 0xfffffe0386030f60 >> give_pages() at give pages+0x163/frame 0xfffffe0386830f20 >> mlx5_satisfy_startup_pages() at mlx5_satisfy_startup_pages+0x76/frame >> 0xfffffe0386030f60 >> mlx5_load_one () at mlx5_load_one+0x6b7/frame 0xfffffe0386031080 >> init_one() at init_one+0x12d5/frame 0xfffffe03860310f0 >> linux_pci_attach_device() at linux_pci_attach device+0x573/frame >> 0xfffffe0386031150 >> device_attach() at device_attach+0x3ca/frame 0xfffffe0386031190 >> device_probe_and_attach() at device_probe_and_attach+0x70/frame >> 0xfffffe03860311c0 >> pci_driver_added() at pci_driver_added+0xf6/frame 0xfffffe0386031200 >> devclass_driver_added() at devclass_driver_added+0x39/frame >> 0xfffffe0386031240 >> devclass_add_driver() at devclass_add_driver+0x147/frame >> 0xfffffe0386031280 >> _linux_pci_register_driver() at _linux_pci_register_driver+0xc9/frame >> 0xfffffe03860312a0 >> > > Are you using the latest version of kernel & mlx5en as of today? There > was a regression issue with the rbtree.h implementation which recently > was fixed. > > --HPS > _______________________________________________ > freebsd-current@freebsd.org mailing list > https://lists.freebsd.org/mailman/listinfo/freebsd-current > To unsubscribe, send any mail to > "freebsd-current-unsubscribe@freebsd.org" From owner-freebsd-current@freebsd.org Mon Jun 15 13:45:49 2020 Return-Path: Delivered-To: freebsd-current@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 4B3C3334824 for ; Mon, 15 Jun 2020 13:45:49 +0000 (UTC) (envelope-from hps@selasky.org) Received: from mailman.nyi.freebsd.org (mailman.nyi.freebsd.org [IPv6:2610:1c1:1:606c::50:13]) by mx1.freebsd.org (Postfix) with ESMTP id 49lszc6wlNz4cXy for ; Mon, 15 Jun 2020 13:45:48 +0000 (UTC) (envelope-from hps@selasky.org) Received: by mailman.nyi.freebsd.org (Postfix) id EDAB8334732; Mon, 15 Jun 2020 13:45:48 +0000 (UTC) Delivered-To: current@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id ED762334731 for ; Mon, 15 Jun 2020 13:45:48 +0000 (UTC) (envelope-from hps@selasky.org) Received: from mail.turbocat.net (turbocat.net [IPv6:2a01:4f8:c17:6c4b::2]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 49lszb6j2vz4cTF for ; Mon, 15 Jun 2020 13:45:47 +0000 (UTC) (envelope-from hps@selasky.org) Received: from hps2020.home.selasky.org (unknown [62.141.129.235]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (2048 bits) server-digest SHA256) (No client certificate requested) by mail.turbocat.net (Postfix) with ESMTPSA id AB8E7260378; Mon, 15 Jun 2020 15:45:40 +0200 (CEST) Subject: Re: Panic on mlx5en. To: Santiago Martinez , FreeBSD Current References: <1bf2ffc5-386a-c0fa-4cc1-246892da3a38@codenetworks.net> <37677b81-0984-d6f4-9a6d-ebe94957ce47@selasky.org> <5bfad49a-5b74-1947-c6bb-9d9a20f472be@codenetworks.net> From: Hans Petter Selasky Message-ID: <528921f6-ee36-d341-2ceb-6143154827b9@selasky.org> Date: Mon, 15 Jun 2020 15:45:21 +0200 User-Agent: Mozilla/5.0 (X11; FreeBSD amd64; rv:68.0) Gecko/20100101 Thunderbird/68.8.0 MIME-Version: 1.0 In-Reply-To: <5bfad49a-5b74-1947-c6bb-9d9a20f472be@codenetworks.net> Content-Type: text/plain; charset=utf-8; format=flowed Content-Language: en-US Content-Transfer-Encoding: 7bit X-Rspamd-Queue-Id: 49lszb6j2vz4cTF X-Spamd-Bar: -- Authentication-Results: mx1.freebsd.org; dkim=none; dmarc=none; spf=pass (mx1.freebsd.org: domain of hps@selasky.org designates 2a01:4f8:c17:6c4b::2 as permitted sender) smtp.mailfrom=hps@selasky.org X-Spamd-Result: default: False [-2.06 / 15.00]; RCVD_VIA_SMTP_AUTH(0.00)[]; ARC_NA(0.00)[]; MID_RHS_MATCH_FROM(0.00)[]; FROM_HAS_DN(0.00)[]; R_SPF_ALLOW(-0.20)[+a:mail.turbocat.net]; NEURAL_HAM_LONG(-0.98)[-0.978]; MIME_GOOD(-0.10)[text/plain]; DMARC_NA(0.00)[selasky.org]; NEURAL_HAM_MEDIUM(-0.97)[-0.972]; NEURAL_SPAM_SHORT(0.19)[0.192]; TO_MATCH_ENVRCPT_SOME(0.00)[]; TO_DN_ALL(0.00)[]; RCPT_COUNT_TWO(0.00)[2]; FROM_EQ_ENVFROM(0.00)[]; R_DKIM_NA(0.00)[]; MIME_TRACE(0.00)[0:+]; ASN(0.00)[asn:24940, ipnet:2a01:4f8::/29, country:DE]; RCVD_COUNT_TWO(0.00)[2]; RCVD_TLS_ALL(0.00)[] X-BeenThere: freebsd-current@freebsd.org X-Mailman-Version: 2.1.33 Precedence: list List-Id: Discussions about the use of FreeBSD-current List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 15 Jun 2020 13:45:49 -0000 On 2020-06-15 15:31, Santiago Martinez wrote: > Hi Peter, yes Im using the latest one. > Can you tell me which version you are at? --HPS From owner-freebsd-current@freebsd.org Mon Jun 15 13:49:52 2020 Return-Path: Delivered-To: freebsd-current@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 3E06E334D84 for ; Mon, 15 Jun 2020 13:49:52 +0000 (UTC) (envelope-from SRS0=j+G0yf=74=codenetworks.net=sm@eigbox.net) Received: from mailman.nyi.freebsd.org (unknown [127.0.1.3]) by mx1.freebsd.org (Postfix) with ESMTP id 49lt4J05wwz4cmk for ; Mon, 15 Jun 2020 13:49:52 +0000 (UTC) (envelope-from SRS0=j+G0yf=74=codenetworks.net=sm@eigbox.net) Received: by mailman.nyi.freebsd.org (Postfix) id 01C62334BC4; Mon, 15 Jun 2020 13:49:52 +0000 (UTC) Delivered-To: current@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 018FE334C2D for ; Mon, 15 Jun 2020 13:49:52 +0000 (UTC) (envelope-from SRS0=j+G0yf=74=codenetworks.net=sm@eigbox.net) Received: from bosmailout02.eigbox.net (bosmailout02.eigbox.net [66.96.184.2]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 49lt4G62ZSz4d0R for ; Mon, 15 Jun 2020 13:49:50 +0000 (UTC) (envelope-from SRS0=j+G0yf=74=codenetworks.net=sm@eigbox.net) Received: from bosmailscan05.eigbox.net ([10.20.15.5]) by bosmailout02.eigbox.net with esmtp (Exim) id 1jkpUh-0004PK-RI for current@freebsd.org; Mon, 15 Jun 2020 09:49:47 -0400 DKIM-Signature: v=1; a=rsa-sha256; q=dns/txt; c=relaxed/relaxed; d=codenetworks.net; s=dkim; h=Sender:Content-Transfer-Encoding:Content-Type: In-Reply-To:MIME-Version:Date:Message-ID:From:References:To:Subject:Reply-To: Cc:Content-ID:Content-Description:Resent-Date:Resent-From:Resent-Sender: Resent-To:Resent-Cc:Resent-Message-ID:List-Id:List-Help:List-Unsubscribe: List-Subscribe:List-Post:List-Owner:List-Archive; bh=O1jEnj4OcHbCVR6AuyW+D4msNxEI1wgrvNhcZR5PqPs=; b=PL9/VUYaW1tYKXGwyxN5ZvG5ws zcNHJum4nE4SMTmSts0t52clnI4GNonG2q06DgZysmKsD5cOV+Px7M5c4uw2LtGYmL5blCOGJQfSZ YF3ikEeB0M1wUZxCspQYPkwmGrUIiGPfOJ2OJwZDSE0IWnA83Wxo+sVeaei7YeEGkXg5uQnJfx5PC gZ49rAX73QmD/o9eUPIsIfnQyQvYaSBBRCUL4MwBG8wravOVkyVjc0yMoa1GOPYPnHiY/kKTcWjPv 6O10tx2upjm49jTAR0G/abThtJNR5IsyIhnma1onBoPY7jnmUZYOQv4MPJKXvIBwAxXihKjFIYkvs TQlIg1yA==; Received: from [10.115.3.31] (helo=bosimpout11) by bosmailscan05.eigbox.net with esmtp (Exim) id 1jkpUh-0000VJ-Mg for current@freebsd.org; Mon, 15 Jun 2020 09:49:47 -0400 Received: from bosauthsmtp12.yourhostingaccount.com ([10.20.18.12]) by bosimpout11 with id rRpk2200F0FdZ9W01Rpn72; Mon, 15 Jun 2020 09:49:47 -0400 X-Authority-Analysis: v=2.2 cv=RKvDJ8q+ c=1 sm=1 tr=0 a=wx0GOVZTcu8EuaXTIXj3VQ==:117 a=kkwQLKMA1cIZLGAtbCrT4w==:17 a=IkcTkHD0fZMA:10 a=nTHF0DUjJn0A:10 a=zXyMKnP1Z5YA:10 a=6I5d2MoRAAAA:8 a=Y2W86koQ1h8KYfJpY_UA:9 a=QEXdDO2ut3YA:10 a=IjZwj45LgO3ly-622nXo:22 Received: from cpc96142-rdng26-2-0-cust93.15-3.cable.virginm.net ([80.5.170.94]:13085 helo=[192.168.0.100]) by bosauthsmtp12.eigbox.net with esmtpa (Exim) id 1jkpUe-00066W-G8; Mon, 15 Jun 2020 09:49:44 -0400 Subject: Re: Panic on mlx5en. To: Hans Petter Selasky , FreeBSD Current References: <1bf2ffc5-386a-c0fa-4cc1-246892da3a38@codenetworks.net> <37677b81-0984-d6f4-9a6d-ebe94957ce47@selasky.org> <5bfad49a-5b74-1947-c6bb-9d9a20f472be@codenetworks.net> <528921f6-ee36-d341-2ceb-6143154827b9@selasky.org> From: Santiago Martinez Message-ID: Date: Mon, 15 Jun 2020 14:49:41 +0100 User-Agent: Mozilla/5.0 (X11; FreeBSD amd64; rv:68.0) Gecko/20100101 Thunderbird/68.9.0 MIME-Version: 1.0 In-Reply-To: <528921f6-ee36-d341-2ceb-6143154827b9@selasky.org> Content-Type: text/plain; charset=utf-8; format=flowed Content-Transfer-Encoding: 8bit Content-Language: en-US X-EN-UserInfo: d3bdfab0736480cedf04ed92aaea2ef5:931c98230c6409dcc37fa7e93b490c27 X-EN-AuthUser: sm@codenetworks.net Sender: Santiago Martinez X-EN-OrigIP: 80.5.170.94 X-EN-OrigHost: cpc96142-rdng26-2-0-cust93.15-3.cable.virginm.net X-Rspamd-Queue-Id: 49lt4G62ZSz4d0R X-Spamd-Bar: -- Authentication-Results: mx1.freebsd.org; dkim=none (invalid DKIM record) header.d=codenetworks.net header.s=dkim header.b=PL9/VUYa; dmarc=none; spf=pass (mx1.freebsd.org: domain of SRS0=j@eigbox.net designates 66.96.184.2 as permitted sender) smtp.mailfrom=SRS0=j@eigbox.net X-Spamd-Result: default: False [-2.49 / 15.00]; RCVD_VIA_SMTP_AUTH(0.00)[]; ARC_NA(0.00)[]; RCVD_COUNT_FIVE(0.00)[5]; MID_RHS_MATCH_FROM(0.00)[]; FROM_HAS_DN(0.00)[]; R_SPF_ALLOW(-0.20)[+ip4:66.96.128.0/18:c]; NEURAL_HAM_LONG(-1.02)[-1.021]; MIME_GOOD(-0.10)[text/plain]; DMARC_NA(0.00)[codenetworks.net: no valid DMARC record]; NEURAL_HAM_MEDIUM(-0.97)[-0.973]; TO_MATCH_ENVRCPT_SOME(0.00)[]; TO_DN_ALL(0.00)[]; DKIM_TRACE(0.00)[codenetworks.net:~]; RCPT_COUNT_TWO(0.00)[2]; RCVD_IN_DNSWL_NONE(0.00)[66.96.184.2:from]; NEURAL_HAM_SHORT(-0.49)[-0.492]; R_DKIM_PERMFAIL(0.00)[codenetworks.net:s=dkim]; FORGED_SENDER(0.30)[sm@codenetworks.net,SRS0=j@eigbox.net]; RWL_MAILSPIKE_POSSIBLE(0.00)[66.96.184.2:from]; MIME_TRACE(0.00)[0:+]; RCVD_TLS_LAST(0.00)[]; ASN(0.00)[asn:29873, ipnet:66.96.128.0/18, country:US]; FROM_NEQ_ENVFROM(0.00)[sm@codenetworks.net,SRS0=j@eigbox.net]; TAGGED_FROM(0.00)[G0yf=74=codenetworks.net=sm]; RECEIVED_SPAMHAUS_PBL(0.00)[80.5.170.94:received] X-BeenThere: freebsd-current@freebsd.org X-Mailman-Version: 2.1.33 Precedence: list List-Id: Discussions about the use of FreeBSD-current List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 15 Jun 2020 13:49:52 -0000 Hi Hans Petter,  At the moment I'm running r362037 but can reinstall, patch/rebuild as needed as is just a lab machine. Santi On 2020-06-15 14:45, Hans Petter Selasky wrote: > On 2020-06-15 15:31, Santiago Martinez wrote: >> Hi Peter, yes Im using the latest one. >> > > Can you tell me which version you are at? > > --HPS > > _______________________________________________ > freebsd-current@freebsd.org mailing list > https://lists.freebsd.org/mailman/listinfo/freebsd-current > To unsubscribe, send any mail to > "freebsd-current-unsubscribe@freebsd.org" From owner-freebsd-current@freebsd.org Mon Jun 15 13:53:29 2020 Return-Path: Delivered-To: freebsd-current@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 334BD334E3F for ; Mon, 15 Jun 2020 13:53:29 +0000 (UTC) (envelope-from hps@selasky.org) Received: from mailman.nyi.freebsd.org (mailman.nyi.freebsd.org [IPv6:2610:1c1:1:606c::50:13]) by mx1.freebsd.org (Postfix) with ESMTP id 49lt8T02JYz4d4r for ; Mon, 15 Jun 2020 13:53:29 +0000 (UTC) (envelope-from hps@selasky.org) Received: by mailman.nyi.freebsd.org (Postfix) id 010A1334F25; Mon, 15 Jun 2020 13:53:29 +0000 (UTC) Delivered-To: current@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 00CFB334CFD for ; Mon, 15 Jun 2020 13:53:29 +0000 (UTC) (envelope-from hps@selasky.org) Received: from mail.turbocat.net (turbocat.net [88.99.82.50]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 49lt8Q6cvZz4cwT for ; Mon, 15 Jun 2020 13:53:26 +0000 (UTC) (envelope-from hps@selasky.org) Received: from hps2020.home.selasky.org (unknown [62.141.129.235]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (2048 bits)) (No client certificate requested) by mail.turbocat.net (Postfix) with ESMTPSA id 8F58B260378; Mon, 15 Jun 2020 15:53:24 +0200 (CEST) Subject: Re: Panic on mlx5en. To: Santiago Martinez , FreeBSD Current References: <1bf2ffc5-386a-c0fa-4cc1-246892da3a38@codenetworks.net> <37677b81-0984-d6f4-9a6d-ebe94957ce47@selasky.org> <5bfad49a-5b74-1947-c6bb-9d9a20f472be@codenetworks.net> <528921f6-ee36-d341-2ceb-6143154827b9@selasky.org> From: Hans Petter Selasky Message-ID: <632de2d3-2bac-b237-49ef-15211377cca0@selasky.org> Date: Mon, 15 Jun 2020 15:53:05 +0200 User-Agent: Mozilla/5.0 (X11; FreeBSD amd64; rv:68.0) Gecko/20100101 Thunderbird/68.8.0 MIME-Version: 1.0 In-Reply-To: Content-Type: text/plain; charset=utf-8; format=flowed Content-Language: en-US Content-Transfer-Encoding: 8bit X-Rspamd-Queue-Id: 49lt8Q6cvZz4cwT X-Spamd-Bar: -- Authentication-Results: mx1.freebsd.org; dkim=none; dmarc=none; spf=pass (mx1.freebsd.org: domain of hps@selasky.org designates 88.99.82.50 as permitted sender) smtp.mailfrom=hps@selasky.org X-Spamd-Result: default: False [-2.12 / 15.00]; ARC_NA(0.00)[]; RCVD_VIA_SMTP_AUTH(0.00)[]; MID_RHS_MATCH_FROM(0.00)[]; FROM_HAS_DN(0.00)[]; R_SPF_ALLOW(-0.20)[+a:mail.turbocat.net:c]; NEURAL_HAM_LONG(-1.00)[-1.003]; MIME_GOOD(-0.10)[text/plain]; DMARC_NA(0.00)[selasky.org]; NEURAL_HAM_MEDIUM(-0.91)[-0.914]; NEURAL_SPAM_SHORT(0.09)[0.092]; TO_MATCH_ENVRCPT_SOME(0.00)[]; TO_DN_ALL(0.00)[]; RCPT_COUNT_TWO(0.00)[2]; FROM_EQ_ENVFROM(0.00)[]; R_DKIM_NA(0.00)[]; MIME_TRACE(0.00)[0:+]; ASN(0.00)[asn:24940, ipnet:88.99.0.0/16, country:DE]; RCVD_COUNT_TWO(0.00)[2]; RCVD_TLS_ALL(0.00)[] X-BeenThere: freebsd-current@freebsd.org X-Mailman-Version: 2.1.33 Precedence: list List-Id: Discussions about the use of FreeBSD-current List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 15 Jun 2020 13:53:29 -0000 On 2020-06-15 15:49, Santiago Martinez wrote: > Hi Hans Petter,  At the moment I'm running r362037 but can reinstall, > patch/rebuild as needed as is just a lab machine. One more question: Did you check if the firmware is up-to-date on the card? Are you able to extract the mce.N.xxx. sysctl from 12.x ? sysctl -a | grep fw --HPS From owner-freebsd-current@freebsd.org Mon Jun 15 14:05:23 2020 Return-Path: Delivered-To: freebsd-current@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id B2E11335594 for ; Mon, 15 Jun 2020 14:05:23 +0000 (UTC) (envelope-from hps@selasky.org) Received: from mailman.nyi.freebsd.org (mailman.nyi.freebsd.org [IPv6:2610:1c1:1:606c::50:13]) by mx1.freebsd.org (Postfix) with ESMTP id 49ltQC3nWlz4dtv for ; Mon, 15 Jun 2020 14:05:23 +0000 (UTC) (envelope-from hps@selasky.org) Received: by mailman.nyi.freebsd.org (Postfix) id 800E7335593; Mon, 15 Jun 2020 14:05:23 +0000 (UTC) Delivered-To: current@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 7EB8B335258 for ; Mon, 15 Jun 2020 14:05:23 +0000 (UTC) (envelope-from hps@selasky.org) Received: from mail.turbocat.net (turbocat.net [88.99.82.50]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 49ltQB4gPSz4fDX for ; Mon, 15 Jun 2020 14:05:22 +0000 (UTC) (envelope-from hps@selasky.org) Received: from hps2020.home.selasky.org (unknown [62.141.129.235]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (2048 bits)) (No client certificate requested) by mail.turbocat.net (Postfix) with ESMTPSA id 0C468260378; Mon, 15 Jun 2020 16:05:20 +0200 (CEST) Subject: Re: Panic on mlx5en. To: Santiago Martinez , FreeBSD Current References: <1bf2ffc5-386a-c0fa-4cc1-246892da3a38@codenetworks.net> <37677b81-0984-d6f4-9a6d-ebe94957ce47@selasky.org> <5bfad49a-5b74-1947-c6bb-9d9a20f472be@codenetworks.net> <528921f6-ee36-d341-2ceb-6143154827b9@selasky.org> From: Hans Petter Selasky Message-ID: <79d7e3de-fda5-5456-6f79-749d6314a9cb@selasky.org> Date: Mon, 15 Jun 2020 16:05:01 +0200 User-Agent: Mozilla/5.0 (X11; FreeBSD amd64; rv:68.0) Gecko/20100101 Thunderbird/68.8.0 MIME-Version: 1.0 In-Reply-To: Content-Type: text/plain; charset=utf-8; format=flowed Content-Language: en-US Content-Transfer-Encoding: 8bit X-Rspamd-Queue-Id: 49ltQB4gPSz4fDX X-Spamd-Bar: -- Authentication-Results: mx1.freebsd.org; dkim=none; dmarc=none; spf=pass (mx1.freebsd.org: domain of hps@selasky.org designates 88.99.82.50 as permitted sender) smtp.mailfrom=hps@selasky.org X-Spamd-Result: default: False [-2.08 / 15.00]; ARC_NA(0.00)[]; RCVD_VIA_SMTP_AUTH(0.00)[]; MID_RHS_MATCH_FROM(0.00)[]; FROM_HAS_DN(0.00)[]; R_SPF_ALLOW(-0.20)[+a:mail.turbocat.net:c]; NEURAL_HAM_LONG(-0.98)[-0.979]; MIME_GOOD(-0.10)[text/plain]; DMARC_NA(0.00)[selasky.org]; NEURAL_HAM_MEDIUM(-0.91)[-0.909]; NEURAL_SPAM_SHORT(0.11)[0.108]; TO_MATCH_ENVRCPT_SOME(0.00)[]; TO_DN_ALL(0.00)[]; RCPT_COUNT_TWO(0.00)[2]; FROM_EQ_ENVFROM(0.00)[]; R_DKIM_NA(0.00)[]; MIME_TRACE(0.00)[0:+]; ASN(0.00)[asn:24940, ipnet:88.99.0.0/16, country:DE]; RCVD_COUNT_TWO(0.00)[2]; RCVD_TLS_ALL(0.00)[] X-BeenThere: freebsd-current@freebsd.org X-Mailman-Version: 2.1.33 Precedence: list List-Id: Discussions about the use of FreeBSD-current List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 15 Jun 2020 14:05:23 -0000 On 2020-06-15 15:49, Santiago Martinez wrote: > Hi Hans Petter,  At the moment I'm running r362037 but can reinstall, > patch/rebuild as needed as is just a lab machine. This revision is not good. There are two things you can try: 1) Try a kernel newer than r362139. 2) Copy sys/sys/tree.h from 12-stable and put it into the 13-current tree at the same location and re-build the kernel. --HPS From owner-freebsd-current@freebsd.org Mon Jun 15 14:39:58 2020 Return-Path: Delivered-To: freebsd-current@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id D7C7E336688 for ; Mon, 15 Jun 2020 14:39:58 +0000 (UTC) (envelope-from SRS0=j+G0yf=74=codenetworks.net=sm@eigbox.net) Received: from mailman.nyi.freebsd.org (mailman.nyi.freebsd.org [IPv6:2610:1c1:1:606c::50:13]) by mx1.freebsd.org (Postfix) with ESMTP id 49lvB64d1wz3SFj for ; Mon, 15 Jun 2020 14:39:58 +0000 (UTC) (envelope-from SRS0=j+G0yf=74=codenetworks.net=sm@eigbox.net) Received: by mailman.nyi.freebsd.org (Postfix) id 9CE90336595; Mon, 15 Jun 2020 14:39:58 +0000 (UTC) Delivered-To: current@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 9CAFB33670A for ; Mon, 15 Jun 2020 14:39:58 +0000 (UTC) (envelope-from SRS0=j+G0yf=74=codenetworks.net=sm@eigbox.net) Received: from bosmailout06.eigbox.net (bosmailout06.eigbox.net [66.96.189.6]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 49lvB55R97z3S8y for ; Mon, 15 Jun 2020 14:39:57 +0000 (UTC) (envelope-from SRS0=j+G0yf=74=codenetworks.net=sm@eigbox.net) Received: from bosmailscan02.eigbox.net ([10.20.15.2]) by bosmailout06.eigbox.net with esmtp (Exim) id 1jkqHF-0001eT-2P for current@freebsd.org; Mon, 15 Jun 2020 10:39:57 -0400 DKIM-Signature: v=1; a=rsa-sha256; q=dns/txt; c=relaxed/relaxed; d=codenetworks.net; s=dkim; h=Sender:Content-Transfer-Encoding:Content-Type: In-Reply-To:MIME-Version:Date:Message-ID:From:References:To:Subject:Reply-To: Cc:Content-ID:Content-Description:Resent-Date:Resent-From:Resent-Sender: Resent-To:Resent-Cc:Resent-Message-ID:List-Id:List-Help:List-Unsubscribe: List-Subscribe:List-Post:List-Owner:List-Archive; bh=VJbU4uSufLeaQiHepPTn2B6AGCb+IN0TyPO/H/FERV8=; b=F2Hrx8eDYlrRQM92LL7EnGCebk lqCH30rc8sIt4UzVl0l0bOPm8MqFvTT+IENK/gr+DmbuB5WumIo65UrO4Q4KsqNTfjv+cf3zUunrq s/BfSQABOH5foeJS4EEQklvW0kL7RzCF7c9Bxe4ZXkd09ALQtXEhLGm+eLtgZ3e8C77zBoRK5gSaF HQC0ISVFdGoTOE2xjxxxlM0wTXOiDooooXcGgRDVcoiUcm5ZHmebUdxu1p/ANjPixFmcgAL0hkQ3O 6Qr/bipoAYX9xFa37lLuHduo0CQfmJO5Sqlh+iv8XprtIVt+AWngOk134IKbNUI112uCbTu3+esAU Ysx6PNOA==; Received: from [10.115.3.31] (helo=bosimpout11) by bosmailscan02.eigbox.net with esmtp (Exim) id 1jkqHF-0001vC-0k for current@freebsd.org; Mon, 15 Jun 2020 10:39:57 -0400 Received: from bosauthsmtp12.yourhostingaccount.com ([10.20.18.12]) by bosimpout11 with id rSft2200E0FdZ9W01SfwAB; Mon, 15 Jun 2020 10:39:57 -0400 X-Authority-Analysis: v=2.2 cv=RKvDJ8q+ c=1 sm=1 tr=0 a=wx0GOVZTcu8EuaXTIXj3VQ==:117 a=kkwQLKMA1cIZLGAtbCrT4w==:17 a=IkcTkHD0fZMA:10 a=nTHF0DUjJn0A:10 a=zXyMKnP1Z5YA:10 a=1PQYbVxEIy1xmF9zIRoA:9 a=QEXdDO2ut3YA:10 Received: from cpc96142-rdng26-2-0-cust93.15-3.cable.virginm.net ([80.5.170.94]:12153 helo=[192.168.0.100]) by bosauthsmtp12.eigbox.net with esmtpa (Exim) id 1jkqHB-0007s8-EW; Mon, 15 Jun 2020 10:39:53 -0400 Subject: Re: Panic on mlx5en. To: Hans Petter Selasky , FreeBSD Current References: <1bf2ffc5-386a-c0fa-4cc1-246892da3a38@codenetworks.net> <37677b81-0984-d6f4-9a6d-ebe94957ce47@selasky.org> <5bfad49a-5b74-1947-c6bb-9d9a20f472be@codenetworks.net> <528921f6-ee36-d341-2ceb-6143154827b9@selasky.org> <79d7e3de-fda5-5456-6f79-749d6314a9cb@selasky.org> From: Santiago Martinez Message-ID: <09fd8689-ea71-9bd6-25ee-27575bca1842@codenetworks.net> Date: Mon, 15 Jun 2020 15:39:50 +0100 User-Agent: Mozilla/5.0 (X11; FreeBSD amd64; rv:68.0) Gecko/20100101 Thunderbird/68.9.0 MIME-Version: 1.0 In-Reply-To: <79d7e3de-fda5-5456-6f79-749d6314a9cb@selasky.org> Content-Type: text/plain; charset=utf-8; format=flowed Content-Transfer-Encoding: 8bit Content-Language: en-US X-EN-UserInfo: d3bdfab0736480cedf04ed92aaea2ef5:931c98230c6409dcc37fa7e93b490c27 X-EN-AuthUser: sm@codenetworks.net Sender: Santiago Martinez X-EN-OrigIP: 80.5.170.94 X-EN-OrigHost: cpc96142-rdng26-2-0-cust93.15-3.cable.virginm.net X-Rspamd-Queue-Id: 49lvB55R97z3S8y X-Spamd-Bar: -- Authentication-Results: mx1.freebsd.org; dkim=none (invalid DKIM record) header.d=codenetworks.net header.s=dkim header.b=F2Hrx8eD; dmarc=none; spf=pass (mx1.freebsd.org: domain of SRS0=j@eigbox.net designates 66.96.189.6 as permitted sender) smtp.mailfrom=SRS0=j@eigbox.net X-Spamd-Result: default: False [-2.57 / 15.00]; RCVD_VIA_SMTP_AUTH(0.00)[]; ARC_NA(0.00)[]; RCVD_COUNT_FIVE(0.00)[5]; MID_RHS_MATCH_FROM(0.00)[]; FROM_HAS_DN(0.00)[]; R_SPF_ALLOW(-0.20)[+ip4:66.96.128.0/18]; NEURAL_HAM_LONG(-1.02)[-1.016]; MIME_GOOD(-0.10)[text/plain]; DMARC_NA(0.00)[codenetworks.net: no valid DMARC record]; NEURAL_HAM_MEDIUM(-0.98)[-0.976]; TO_MATCH_ENVRCPT_SOME(0.00)[]; TO_DN_ALL(0.00)[]; DKIM_TRACE(0.00)[codenetworks.net:~]; RCPT_COUNT_TWO(0.00)[2]; RCVD_IN_DNSWL_NONE(0.00)[66.96.189.6:from]; NEURAL_HAM_SHORT(-0.57)[-0.575]; R_DKIM_PERMFAIL(0.00)[codenetworks.net:s=dkim]; FORGED_SENDER(0.30)[sm@codenetworks.net,SRS0=j@eigbox.net]; RECEIVED_SPAMHAUS_PBL(0.00)[80.5.170.94:received]; MIME_TRACE(0.00)[0:+]; RCVD_TLS_LAST(0.00)[]; ASN(0.00)[asn:29873, ipnet:66.96.128.0/18, country:US]; TAGGED_FROM(0.00)[G0yf=74=codenetworks.net=sm]; FROM_NEQ_ENVFROM(0.00)[sm@codenetworks.net,SRS0=j@eigbox.net] X-BeenThere: freebsd-current@freebsd.org X-Mailman-Version: 2.1.33 Precedence: list List-Id: Discussions about the use of FreeBSD-current List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 15 Jun 2020 14:39:58 -0000 Ok , will sync now/compile and let you know. Santi On 2020-06-15 15:05, Hans Petter Selasky wrote: > On 2020-06-15 15:49, Santiago Martinez wrote: >> Hi Hans Petter,  At the moment I'm running r362037 but can reinstall, >> patch/rebuild as needed as is just a lab machine. > > This revision is not good. There are two things you can try: > > 1) Try a kernel newer than r362139. > > 2) Copy sys/sys/tree.h from 12-stable and put it into the 13-current > tree at the same location and re-build the kernel. > > --HPS From owner-freebsd-current@freebsd.org Mon Jun 15 17:47:05 2020 Return-Path: Delivered-To: freebsd-current@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 65F9333B235 for ; Mon, 15 Jun 2020 17:47:05 +0000 (UTC) (envelope-from SRS0=j+G0yf=74=codenetworks.net=sm@eigbox.net) Received: from mailman.nyi.freebsd.org (unknown [127.0.1.3]) by mx1.freebsd.org (Postfix) with ESMTP id 49lzL073LQz40BY for ; Mon, 15 Jun 2020 17:47:04 +0000 (UTC) (envelope-from SRS0=j+G0yf=74=codenetworks.net=sm@eigbox.net) Received: by mailman.nyi.freebsd.org (Postfix) id F052633B0BA; Mon, 15 Jun 2020 17:47:04 +0000 (UTC) Delivered-To: current@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id F009033B234 for ; Mon, 15 Jun 2020 17:47:04 +0000 (UTC) (envelope-from SRS0=j+G0yf=74=codenetworks.net=sm@eigbox.net) Received: from bosmailout01.eigbox.net (bosmailout01.eigbox.net [66.96.189.1]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 49lzKz5fTYz401N; Mon, 15 Jun 2020 17:47:03 +0000 (UTC) (envelope-from SRS0=j+G0yf=74=codenetworks.net=sm@eigbox.net) Received: from bosmailscan04.eigbox.net ([10.20.15.4]) by bosmailout01.eigbox.net with esmtp (Exim) id 1jktCI-0004CO-Up; Mon, 15 Jun 2020 13:47:02 -0400 DKIM-Signature: v=1; a=rsa-sha256; q=dns/txt; c=relaxed/relaxed; d=codenetworks.net; s=dkim; h=Sender:Content-Type:In-Reply-To:MIME-Version: Date:Message-ID:From:References:Cc:To:Subject:Reply-To: Content-Transfer-Encoding:Content-ID:Content-Description:Resent-Date: Resent-From:Resent-Sender:Resent-To:Resent-Cc:Resent-Message-ID:List-Id: List-Help:List-Unsubscribe:List-Subscribe:List-Post:List-Owner:List-Archive; bh=UJswl/DwJpJaicFtkg9dIe65VPM+fWJ604fztMRrheo=; b=kKWjjbprZ9kJVbqYcer19SUks 1gacz1dI/SNYD78VTjYuM8utExYGArdRpVzUnZd+5zfmQpr3M+JvTGWTVv4ObN+Qm68Ul+VWmOsJi D9Ke/lwrVyv4QKBoDrjOPRIYEQ/PLIuYvJulgElbWKwAx04hFA1gXIt1MGDAKHmvra2h4ZQ1ptC2B ixJE+7Ugez3mm0K3JRL8E8llRCfhfe/sXZ10ch7aiDqYOTfYW4fMKu/slSanPKqvg9bdpXJBw9IBa /iqJoAM44R4flIY1Nr2sXcZwcXgdjbCQ1Y7mTnlOxOd5lZTiJUgO8FS8ZFR9ko4hOiYsEQfzQffsm sqcNZ9Ytw==; Received: from [10.115.3.32] (helo=bosimpout12) by bosmailscan04.eigbox.net with esmtp (Exim) id 1jktCI-0002op-QC; Mon, 15 Jun 2020 13:47:02 -0400 Received: from bosauthsmtp12.yourhostingaccount.com ([10.20.18.12]) by bosimpout12 with id rVmz2200R0FdZ9W01Vn2Sr; Mon, 15 Jun 2020 13:47:02 -0400 X-Authority-Analysis: v=2.2 cv=KNQqNBNo c=1 sm=1 tr=0 a=wx0GOVZTcu8EuaXTIXj3VQ==:117 a=kkwQLKMA1cIZLGAtbCrT4w==:17 a=nTHF0DUjJn0A:10 a=zXyMKnP1Z5YA:10 a=r77TgQKjGQsHNAKrUKIA:9 a=jlvWEfeLAAAA:8 a=Q-fNiiVtAAAA:8 a=6I5d2MoRAAAA:8 a=Mr1XnJQWAAAA:8 a=RqpxR_Uu6BmmPebR-JUA:9 a=6PsYHdNlhsdy9nig:21 a=fPAz4z-ZbvD6C7PK:21 a=QEXdDO2ut3YA:10 a=pGLkceISAAAA:8 a=NYoH4pcVmjYOLUs8VH8A:9 a=UYAltOaibo_vuw7v:21 a=KmWLlvzAYEEKpzbG:21 a=7w6pQmUjtCewf1kY:21 a=UiCQ7L4-1S4A:10 a=hTZeC7Yk6K0A:10 a=frz4AuCg-hUA:10 a=_W_S_7VecoQA:10 a=BUduvz6nQKmfCEOu4uBS:22 a=Fp8MccfUoT0GBdDC_Lng:22 a=IjZwj45LgO3ly-622nXo:22 a=x1WslF1p1lK7vEzEGcse:22 Received: from cpc96142-rdng26-2-0-cust93.15-3.cable.virginm.net ([80.5.170.94]:22203 helo=[192.168.0.100]) by bosauthsmtp12.eigbox.net with esmtpa (Exim) id 1jktCE-0000SO-W7; Mon, 15 Jun 2020 13:46:59 -0400 Subject: Re: MRSAS Panic during Install. To: Kashyap Desai , Don Lewis , Andriy Gapon Cc: FreeBSD Current , "Kashyap D. Desai" , "Kenneth D. Merry" , Sumit Saxena , Chandrakanth Patil References: <99447152-0340-11dd-fb75-a745d2ee5a6a@codenetworks.net> <0fa770fc-4fbc-cd1f-e8cc-30c74b37b71b@codenetworks.net> <3b0d4cec-69bd-0516-77e8-574678b6bd36@FreeBSD.org> <692229ea-ceb5-9e0d-e12e-2999ecb69297@codenetworks.net> <165ad464ab307e604a992dc59df40853@mail.gmail.com> <28f0a9f2-3f00-0167-bb5d-eab7d66ff813@codenetworks.net> <75ff0cfe-e516-a10a-abc5-7e1eb708c87f@codenetworks.net> <51abdead-b727-c3e3-b6a9-dfaaf400a6d8@codenetworks.net> <37c9656e67b7479933a6b66e61d46e90@mail.gmail.com> From: Santiago Martinez Message-ID: <9f2eeda1-528b-539a-40b6-c6c712facdf3@codenetworks.net> Date: Mon, 15 Jun 2020 18:46:48 +0100 User-Agent: Mozilla/5.0 (X11; FreeBSD amd64; rv:68.0) Gecko/20100101 Thunderbird/68.9.0 MIME-Version: 1.0 In-Reply-To: <37c9656e67b7479933a6b66e61d46e90@mail.gmail.com> Content-Language: en-US X-EN-UserInfo: d3bdfab0736480cedf04ed92aaea2ef5:931c98230c6409dcc37fa7e93b490c27 X-EN-AuthUser: sm@codenetworks.net Sender: Santiago Martinez X-EN-OrigIP: 80.5.170.94 X-EN-OrigHost: cpc96142-rdng26-2-0-cust93.15-3.cable.virginm.net X-Rspamd-Queue-Id: 49lzKz5fTYz401N X-Spamd-Bar: -- Authentication-Results: mx1.freebsd.org; dkim=none (invalid DKIM record) header.d=codenetworks.net header.s=dkim header.b=kKWjjbpr; dmarc=none; spf=pass (mx1.freebsd.org: domain of SRS0=j@eigbox.net designates 66.96.189.1 as permitted sender) smtp.mailfrom=SRS0=j@eigbox.net X-Spamd-Result: default: False [-2.92 / 15.00]; RCVD_VIA_SMTP_AUTH(0.00)[]; ARC_NA(0.00)[]; RCVD_COUNT_FIVE(0.00)[5]; MID_RHS_MATCH_FROM(0.00)[]; FROM_HAS_DN(0.00)[]; R_SPF_ALLOW(-0.20)[+ip4:66.96.128.0/18]; NEURAL_HAM_LONG(-1.01)[-1.012]; MIME_GOOD(-0.10)[multipart/alternative,text/plain]; DMARC_NA(0.00)[codenetworks.net: no valid DMARC record]; NEURAL_HAM_MEDIUM(-0.98)[-0.979]; TO_MATCH_ENVRCPT_SOME(0.00)[]; TO_DN_ALL(0.00)[]; DKIM_TRACE(0.00)[codenetworks.net:~]; NEURAL_HAM_SHORT(-0.93)[-0.934]; RCPT_COUNT_SEVEN(0.00)[8]; RCVD_IN_DNSWL_NONE(0.00)[66.96.189.1:from]; R_DKIM_PERMFAIL(0.00)[codenetworks.net:s=dkim]; FORGED_SENDER(0.30)[sm@codenetworks.net,SRS0=j@eigbox.net]; RWL_MAILSPIKE_POSSIBLE(0.00)[66.96.189.1:from]; MIME_TRACE(0.00)[0:+,1:+,2:~]; RCVD_TLS_LAST(0.00)[]; ASN(0.00)[asn:29873, ipnet:66.96.128.0/18, country:US]; TAGGED_FROM(0.00)[G0yf=74=codenetworks.net=sm]; FROM_NEQ_ENVFROM(0.00)[sm@codenetworks.net,SRS0=j@eigbox.net] Content-Type: text/plain; charset=utf-8; format=flowed Content-Transfer-Encoding: 8bit X-Content-Filtered-By: Mailman/MimeDel 2.1.33 X-BeenThere: freebsd-current@freebsd.org X-Mailman-Version: 2.1.33 Precedence: list List-Id: Discussions about the use of FreeBSD-current List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 15 Jun 2020 17:47:05 -0000 Hi guys, sorry for the radio silence, I did a fresh install today to apply the patch, and by mistake i changed from UEFI to BIOS (legacy), now I'm not able to replicate the panic any more (without applying the patch). Do you think is related, I mean does it make sense to you? Im planning to re install tonight with UEFI to see if i can hit it again. SAnti On 2020-06-12 06:30, Kashyap Desai wrote: > > Screenshot of final error is good enough at least for now. Additional > logs will be good if you can provide. > > Kashyap > > *From:*Santiago Martinez [mailto:sm@codenetworks.net > ] > *Sent:* Thursday, June 11, 2020 8:49 PM > *To:* Kashyap Desai >; Don Lewis >; Andriy Gapon > > *Cc:* FreeBSD Current >; Kashyap D. Desai >; Kenneth D. Merry >; Sumit Saxena >; Chandrakanth Patil > > > *Subject:* Re: MRSAS Panic during Install. > > Hi Everyone,  i haven't forget about this.... yet :) > > I perform the following test in preparation to apply the patch: > > 1. Installed 12.1 stable with one disc in raid0, no issues (did this > so i can apply patch and don't have to build a new bootable image). > 2. with 12.1 added second raid, in this case RAID1 and it crashed. > during foot complain about wrong/corrupt partition table > > Repeated the same test with current with exactly the same results ( I > also hit another issues on mlx5en that crashed with current, will > follow after we can sort this out) > > Today I'm planning to apply the patch and see what happens. > > Have some question: > > * Do you want me to record the booting/error for each case and make > it available? > * Do you want access to the box? > > Best regards. > > Santiago > > On 2020-06-09 22:43, Santiago Martinez wrote: > > Hi there, apologies for the delayed response. > > Regarding the lock reversal, I can try to capture the screen > showing the message. > > The "Wil check go it goes...." it was my brain trying to > multitask, obviously not in a successful way. What I meant to say > was "I will check how it goes..... without the RAID". > > Sure, I will test with the patch and let you know asap. hopefully > by tomorrow night(BST). > > Cheers > > Santi > > > On 2020-06-09 19:20, Kashyap Desai wrote: > > -----Original Message----- > From: Santiago Martinez [mailto:sm@codenetworks.net] > Sent: Tuesday, June 9, 2020 11:27 PM > To: Kashyap Desai > ; Don Lewis > ; > Andriy Gapon > Cc: FreeBSD Current > ; Kashyap D. Desai > ; > Kenneth D. Merry > ; Sumit Saxena > > ; Chandrakanth Patil > > > Subject: Re: MRSAS Panic during Install. > > Hi! so it works but i got a lock order reversal warning, > but it continue. > > OK. So what is a warning ? > > > Wil check go it goes.... > > Could not get your point. Can you elaborate ? > > > Also can you try Raid - 1 VD with below patch ? > > diff --git a/mrsas.c b/mrsas.c > index 3d33073..60f4b4d 100755 > --- a/mrsas.c > +++ b/mrsas.c > @@ -1744,11 +1744,14 @@ mrsas_complete_cmd(struct mrsas_softc > *sc, u_int32_t > MSIxIndex) > data_length = > r1_cmd->io_request->DataLength; > sense = > r1_cmd->sense; >                                                  } > + > + mtx_lock(&sc->sim_lock); > r1_cmd->ccb_ptr = NULL; >                                                  if > (r1_cmd->callout_owner) { > > callout_stop(&r1_cmd->cm_callout); > r1_cmd->callout_owner > = false; >                                                  } > + mtx_unlock(&sc->sim_lock); > mrsas_release_mpt_cmd(r1_cmd); > > mrsas_map_mpt_cmd_status(cmd_mpt, > cmd_mpt->ccb_ptr, status, > extStatus, > data_length, sense); > > > > > Santi > > On 2020-06-09 11:13, Santiago Martinez wrote: > > Trying right now, will let you know..... > > > On 2020-06-09 11:07, Kashyap Desai wrote: > > Hi Santi - Please try without Raid-1 VD. Most > likely you will not > observe issue, but you can confirm from your end. > > Kashyap > > > -----Original Message----- > From: Santiago Martinez > [mailto:sm@codenetworks.net] > Sent: Tuesday, June 9, 2020 2:08 PM > To: Don Lewis > ; Andriy Gapon > > > > Cc: FreeBSD Current > ; Kashyap D. Desai > > ; Kenneth D. Merry > > Subject: Re: MRSAS Panic during Install. > > Hi Kashayp, that's correct, the servers has > two raids. A raid 1 VD0 > with 2xSSD on it and a RAID5 VD0. > > Do you want me to break the raid and see i it > does not trigger the > bug? > > cheers > > Santi > > > On 2020-06-09 07:51, Don Lewis wrote: > > On  9 Jun, Andriy Gapon wrote: > > On 09/06/2020 03:42, Santiago Martinez > wrote: > > Hi Everyone, today I tested with > 12.1 and it works without any > issues (at least for now). > > I will sync against current and > see if it fails. > > Santiago > > On 2020-06-08 17:41, Santiago > Martinez wrote: > > Hi there, tried again and now > i got it with UFS also.. that > make > sense.. > > right... > > On 2020-06-08 15:20, Santiago > Martinez wrote: > > Hi Everyone, > > I'm installing FreeBSD > current(361567) snapshot > on a Lenovo > SR655 > > server. > > After selecting ZFS, and > the installer tries to > make the > partitions, etc I get the > following panic. > > I tried selecting UFS and > its works. > > I uploaded a screenshot as > I only have KVM access to it: > > https://0bin.net/paste/4yn33GkSKiYto6m4#h78yCE6h80- > > > 3DsApbXa1XLW9+b > > hoKhOr3MVS+NRgA5A > > > The server is a > ThinkSystem SR655, with > the following > controller, RAID 930-8i > 2GB Flash PCIe 12Gb Adapter > > Lousy OCR of the picture: > ... > nic: nutex mrsas_sin_lock not ouned at > /usr/src/sys/kern/kern_nutex.c:284 > ... > b_trace_self_urapper () at > db_trace_self_urapper+8x2b/frane > BxfffffeB33c44a918 > anic() at vpanic+Bx182/frane > BxfffffeA33c44ad68 > nic() at panic+Bx43/frame > BxfffffeB33c44adcd > _mtx_assert() at > __mtx_assert+@xb@/frane > Bxfffffed33c44a9dd > callout_stop_safe() at > _callout_stop_safe+Bx82/frane > Bxfffffe33c44aac > rsas_conplete_cnd() at > mrsas_complete_cnd+8x1b8/frane > BxfffffeB33c4daaed > ithread_loop() at > ithread_loop+@x279/frame > BxfffffeB33c44ah78 > > This looks like a fallout from r342064. > cm_callout is initialized like this: > callout_init_mtx(&cmd->cm_callout, > &sc->sim_lock, 0); but in > mrsas_complete_cmd() it's stopped > without holding the lock. > > _______________________________________________ > > freebsd-current@freebsd.org > > mailing list > https://lists.freebsd.org/mailman/listinfo/freebsd-current > > To unsubscribe, send any mail to > "freebsd-current- > > unsubscribe@freebsd.org > " > > _______________________________________________ > freebsd-current@freebsd.org > mailing list > https://lists.freebsd.org/mailman/listinfo/freebsd-current > > To unsubscribe, send any mail to > "freebsd-current-unsubscribe@freebsd.org" > > > _______________________________________________ > freebsd-current@freebsd.org > mailing list > https://lists.freebsd.org/mailman/listinfo/freebsd-current > To unsubscribe, send any mail to > "freebsd-current-unsubscribe@freebsd.org" > > From owner-freebsd-current@freebsd.org Mon Jun 15 19:54:08 2020 Return-Path: Delivered-To: freebsd-current@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 8F1E6341BD9 for ; Mon, 15 Jun 2020 19:54:08 +0000 (UTC) (envelope-from SRS0=j+G0yf=74=codenetworks.net=sm@eigbox.net) Received: from mailman.nyi.freebsd.org (unknown [127.0.1.3]) by mx1.freebsd.org (Postfix) with ESMTP id 49m28c2M21z3RTY for ; Mon, 15 Jun 2020 19:54:08 +0000 (UTC) (envelope-from SRS0=j+G0yf=74=codenetworks.net=sm@eigbox.net) Received: by mailman.nyi.freebsd.org (Postfix) id 50B67341BD8; Mon, 15 Jun 2020 19:54:08 +0000 (UTC) Delivered-To: current@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 50698341F2A for ; Mon, 15 Jun 2020 19:54:08 +0000 (UTC) (envelope-from SRS0=j+G0yf=74=codenetworks.net=sm@eigbox.net) Received: from bosmailout03.eigbox.net (bosmailout03.eigbox.net [66.96.186.3]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 49m28b2fZrz3RRZ; Mon, 15 Jun 2020 19:54:07 +0000 (UTC) (envelope-from SRS0=j+G0yf=74=codenetworks.net=sm@eigbox.net) Received: from bosmailscan11.eigbox.net ([10.20.15.11]) by bosmailout03.eigbox.net with esmtp (Exim) id 1jkvBG-0006Cv-EI; Mon, 15 Jun 2020 15:54:06 -0400 DKIM-Signature: v=1; a=rsa-sha256; q=dns/txt; c=relaxed/relaxed; d=codenetworks.net; s=dkim; h=Sender:Content-Type:MIME-Version:Cc:To:From: In-Reply-To:Subject:Date:Reply-To:Message-ID:Content-Transfer-Encoding: Content-ID:Content-Description:Resent-Date:Resent-From:Resent-Sender: Resent-To:Resent-Cc:Resent-Message-ID:References:List-Id:List-Help: List-Unsubscribe:List-Subscribe:List-Post:List-Owner:List-Archive; bh=n7Gr7+eVXSFSgOeu/lYmUh9h8100IDeKdt2nB6DWUGg=; b=lyFSK2u9RCcukicuch0CEVmVMW dQgGrEzLvlNgaKZzRJbbb517kTJi8t5TGc36gVPwd3J1dNlpyqZ8zHZ5J5GdEdq01pbquYXcXfkdw UZabTiRpe4eYAh/vXD8Rv9jCOqP2jGzbjUZIy2D+k8LWkCcASQWcTc2VoxV9NQttWPvErZ4AYRip+ oI+YjrUdHrT9j6sv622zQVO34EJLmpI3Gg6wkRFJ677puwYX8zKiNTpS+dVM50Q96TosKLRz0pi1l uPORt4cCm8M5/2agAEcaeCXc/bXvawRJTmKweOOwQwDJVsB4UueVUgJWeBSmlHGZHImUPybQeNosW Gk52gM5A==; Received: from [10.115.3.33] (helo=bosimpout13) by bosmailscan11.eigbox.net with esmtp (Exim) id 1jkvBB-0006Sg-9N; Mon, 15 Jun 2020 15:54:01 -0400 Received: from bosauthsmtp12.yourhostingaccount.com ([10.20.18.12]) by bosimpout13 with id rXtx2200J0FdZ9W01Xu0KB; Mon, 15 Jun 2020 15:54:01 -0400 X-Authority-Analysis: v=2.2 cv=fPhJ5dSe c=1 sm=1 tr=0 a=wx0GOVZTcu8EuaXTIXj3VQ==:117 a=kkwQLKMA1cIZLGAtbCrT4w==:17 a=nTHF0DUjJn0A:10 a=zXyMKnP1Z5YA:10 a=Q-fNiiVtAAAA:8 a=jlvWEfeLAAAA:8 a=6I5d2MoRAAAA:8 a=Mr1XnJQWAAAA:8 a=Jk1YTaCxFIsRxJ5xNTwA:9 a=Y039zK5ZfEGN55jF:21 a=J88D_MUw3F8Iidcy:21 a=QEXdDO2ut3YA:10 a=y5BbhHNl8ruKYrMu:21 a=skyZGD-RCFCf8kXe:21 a=9F8NImrfpARFPq9o:21 a=_W_S_7VecoQA:10 a=Fp8MccfUoT0GBdDC_Lng:22 a=BUduvz6nQKmfCEOu4uBS:22 a=IjZwj45LgO3ly-622nXo:22 a=x1WslF1p1lK7vEzEGcse:22 Received: from cpc96142-rdng26-2-0-cust93.15-3.cable.virginm.net ([80.5.170.94]:11075 helo=[192.168.0.70]) by bosauthsmtp12.eigbox.net with esmtpsa (TLSv1.2:ECDHE-RSA-AES128-GCM-SHA256:128) (Exim) id 1jkvB6-0003ja-Cn; Mon, 15 Jun 2020 15:53:57 -0400 SavedFromEmail: sm@codenetworks.net Date: Mon, 15 Jun 2020 20:53:44 +0100 Subject: RE: MRSAS Panic during Install. In-Reply-To: <7600ebf9e78f1d5a591cc9984a56d232@mail.gmail.com> Importance: normal From: Santiago Martinez To: Kashyap Desai , Don Lewis , Andriy Gapon Cc: sm@codenetworks.net, FreeBSD Current , "Kashyap D. Desai" , "Kenneth D. Merry" , Sumit Saxena , Chandrakanth Patil MIME-Version: 1.0 X-EN-UserInfo: d3bdfab0736480cedf04ed92aaea2ef5:931c98230c6409dcc37fa7e93b490c27 X-EN-AuthUser: sm@codenetworks.net Sender: Santiago Martinez X-EN-OrigIP: 80.5.170.94 X-EN-OrigHost: cpc96142-rdng26-2-0-cust93.15-3.cable.virginm.net X-Rspamd-Queue-Id: 49m28b2fZrz3RRZ X-Spamd-Bar: / Authentication-Results: mx1.freebsd.org; dkim=none (invalid DKIM record) header.d=codenetworks.net header.s=dkim header.b=lyFSK2u9; dmarc=none; spf=pass (mx1.freebsd.org: domain of SRS0=j@eigbox.net designates 66.96.186.3 as permitted sender) smtp.mailfrom=SRS0=j@eigbox.net X-Spamd-Result: default: False [0.58 / 15.00]; RCVD_VIA_SMTP_AUTH(0.00)[]; TO_DN_SOME(0.00)[]; R_SPF_ALLOW(-0.20)[+ip4:66.96.128.0/18]; MIME_BASE64_TEXT_BOGUS(1.00)[]; DKIM_TRACE(0.00)[codenetworks.net:~]; MIME_BASE64_TEXT(0.10)[]; RCPT_COUNT_SEVEN(0.00)[9]; NEURAL_HAM_SHORT(-1.03)[-1.034]; FORGED_SENDER(0.30)[sm@codenetworks.net,SRS0=j@eigbox.net]; MIME_TRACE(0.00)[0:+,1:+,2:~]; RCVD_TLS_LAST(0.00)[]; ASN(0.00)[asn:29873, ipnet:66.96.128.0/18, country:US]; TAGGED_FROM(0.00)[G0yf=74=codenetworks.net=sm]; FROM_NEQ_ENVFROM(0.00)[sm@codenetworks.net,SRS0=j@eigbox.net]; ARC_NA(0.00)[]; NEURAL_HAM_MEDIUM(-0.96)[-0.960]; RCVD_COUNT_FIVE(0.00)[5]; FROM_HAS_DN(0.00)[]; NEURAL_HAM_LONG(-1.03)[-1.027]; MIME_GOOD(-0.10)[multipart/alternative,text/plain]; DMARC_NA(0.00)[codenetworks.net: no valid DMARC record]; TO_MATCH_ENVRCPT_SOME(0.00)[]; MISSING_MID(2.50)[]; RCVD_IN_DNSWL_NONE(0.00)[66.96.186.3:from]; R_DKIM_PERMFAIL(0.00)[codenetworks.net:s=dkim]; RWL_MAILSPIKE_POSSIBLE(0.00)[66.96.186.3:from] X-Spam: Yes Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: base64 X-Content-Filtered-By: Mailman/MimeDel 2.1.33 X-BeenThere: freebsd-current@freebsd.org X-Mailman-Version: 2.1.33 Precedence: list List-Id: Discussions about the use of FreeBSD-current List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 15 Jun 2020 19:54:08 -0000 T2ssIHdpbGwgdHJ5IGEgZmV3IG1vcmUgdGltZXMgYXMgSSBkb250IG5lZWQgdGhlIHNlcnZlciBy aWdodCBub3cuIGkgd2lsbCBrZWVwIHlvdSBwb3N0ZWQuU2VudCBmcm9tIG15IFNhbXN1bmcgR2Fs YXh5IHNtYXJ0cGhvbmUuCi0tLS0tLS0tIE9yaWdpbmFsIG1lc3NhZ2UgLS0tLS0tLS1Gcm9tOiBL YXNoeWFwIERlc2FpIDxrYXNoeWFwLmRlc2FpQGJyb2FkY29tLmNvbT4gRGF0ZTogMTUvMDYvMjAy MCAgMTk6MjkgIChHTVQrMDA6MDApIFRvOiBTYW50aWFnbyBNYXJ0aW5leiA8c21AY29kZW5ldHdv cmtzLm5ldD4sIERvbiBMZXdpcyA8dHJ1Y2ttYW5AZnJlZWJzZC5vcmc+LCBBbmRyaXkgR2Fwb24g PGF2Z0BmcmVlYnNkLm9yZz4gQ2M6IEZyZWVCU0QgQ3VycmVudCA8Y3VycmVudEBmcmVlYnNkLm9y Zz4sICJLYXNoeWFwIEQuIERlc2FpIiA8a2FkZXNhaUBmcmVlYnNkLm9yZz4sICJLZW5uZXRoIEQu IE1lcnJ5IiA8a2VuQGZyZWVic2Qub3JnPiwgU3VtaXQgU2F4ZW5hIDxzdW1pdC5zYXhlbmFAYnJv YWRjb20uY29tPiwgQ2hhbmRyYWthbnRoIFBhdGlsIDxjaGFuZHJha2FudGgucGF0aWxAYnJvYWRj b20uY29tPiBTdWJqZWN0OiBSRTogTVJTQVMgUGFuaWMgZHVyaW5nIEluc3RhbGwuIEhpLMKgSXNz dWUgcmVxdWlyZSBjZXJ0YWluIHNwZWNpZmljIHRpbWluZy4gV2UgZmlyZSB0d28gV3JpdGUgb3Bl cmF0aW9uIGZyb20gRHJpdmVyIG9uIHJhaWQtMSB2b2x1bWUuwqAgV3JpdGUgb24gRGF0YSBhcm0g YW5kIFdyaXRlIG9uIE1pcnJvciBhcm0uIEJhc2VkIG9uIHdoaWNoIElPIGNvbXBsZXRlZCBieSBk ZXZpY2UvSEJBIHRvIHRoZSBkcml2ZXIgZmlyc3QgY2FuIGNoYW5nZSB0aGUgYmVoYXZpb3IuIFRv IGhpdCB0aGlzIGlzc3VlLCBJTyBmcm9tIE1pcnJvciBhcm0gc2hvdWxkIHJldHVybiBmaXJzdC7C oEthc2h5YXDCoEZyb206IFNhbnRpYWdvIE1hcnRpbmV6IFttYWlsdG86c21AY29kZW5ldHdvcmtz Lm5ldF0gU2VudDogTW9uZGF5LCBKdW5lIDE1LCAyMDIwIDExOjE3IFBNVG86IEthc2h5YXAgRGVz YWkgPGthc2h5YXAuZGVzYWlAYnJvYWRjb20uY29tPjsgRG9uIExld2lzIDx0cnVja21hbkBmcmVl YnNkLm9yZz47IEFuZHJpeSBHYXBvbiA8YXZnQGZyZWVic2Qub3JnPkNjOiBGcmVlQlNEIEN1cnJl bnQgPGN1cnJlbnRAZnJlZWJzZC5vcmc+OyBLYXNoeWFwIEQuIERlc2FpIDxrYWRlc2FpQGZyZWVi c2Qub3JnPjsgS2VubmV0aCBELiBNZXJyeSA8a2VuQGZyZWVic2Qub3JnPjsgU3VtaXQgU2F4ZW5h IDxzdW1pdC5zYXhlbmFAYnJvYWRjb20uY29tPjsgQ2hhbmRyYWthbnRoIFBhdGlsIDxjaGFuZHJh a2FudGgucGF0aWxAYnJvYWRjb20uY29tPlN1YmplY3Q6IFJlOiBNUlNBUyBQYW5pYyBkdXJpbmcg SW5zdGFsbC7CoEhpIGd1eXMsIHNvcnJ5IGZvciB0aGUgcmFkaW8gc2lsZW5jZSwgSSBkaWQgYSBm cmVzaCBpbnN0YWxsIHRvZGF5IHRvIGFwcGx5IHRoZSBwYXRjaCwgYW5kIGJ5IG1pc3Rha2UgaSBj aGFuZ2VkIGZyb20gVUVGSSB0byBCSU9TIChsZWdhY3kpLCBub3cgSSdtIG5vdCBhYmxlIHRvIHJl cGxpY2F0ZSB0aGUgcGFuaWMgYW55IG1vcmUgKHdpdGhvdXQgYXBwbHlpbmcgdGhlIHBhdGNoKS4g RG8geW91IHRoaW5rIGlzIHJlbGF0ZWQsIEkgbWVhbiBkb2VzIGl0IG1ha2Ugc2Vuc2UgdG8geW91 P0ltIHBsYW5uaW5nIHRvIHJlIGluc3RhbGwgdG9uaWdodCB3aXRoIFVFRkkgdG8gc2VlIGlmIGkg Y2FuIGhpdCBpdCBhZ2Fpbi5TQW50acKgwqBPbiAyMDIwLTA2LTEyIDA2OjMwLCBLYXNoeWFwIERl c2FpIHdyb3RlOlNjcmVlbnNob3Qgb2YgZmluYWwgZXJyb3IgaXMgZ29vZCBlbm91Z2ggYXQgbGVh c3QgZm9yIG5vdy4gQWRkaXRpb25hbCBsb2dzIHdpbGwgYmUgZ29vZCBpZiB5b3UgY2FuIHByb3Zp ZGUuwqBLYXNoeWFwwqBGcm9tOiBTYW50aWFnbyBNYXJ0aW5leiBbbWFpbHRvOnNtQGNvZGVuZXR3 b3Jrcy5uZXRdIFNlbnQ6IFRodXJzZGF5LCBKdW5lIDExLCAyMDIwIDg6NDkgUE1UbzogS2FzaHlh cCBEZXNhaSA8a2FzaHlhcC5kZXNhaUBicm9hZGNvbS5jb20+OyBEb24gTGV3aXMgPHRydWNrbWFu QGZyZWVic2Qub3JnPjsgQW5kcml5IEdhcG9uIDxhdmdAZnJlZWJzZC5vcmc+Q2M6IEZyZWVCU0Qg Q3VycmVudCA8Y3VycmVudEBmcmVlYnNkLm9yZz47IEthc2h5YXAgRC4gRGVzYWkgPGthZGVzYWlA ZnJlZWJzZC5vcmc+OyBLZW5uZXRoIEQuIE1lcnJ5IDxrZW5AZnJlZWJzZC5vcmc+OyBTdW1pdCBT YXhlbmEgPHN1bWl0LnNheGVuYUBicm9hZGNvbS5jb20+OyBDaGFuZHJha2FudGggUGF0aWwgPGNo YW5kcmFrYW50aC5wYXRpbEBicm9hZGNvbS5jb20+U3ViamVjdDogUmU6IE1SU0FTIFBhbmljIGR1 cmluZyBJbnN0YWxsLsKgSGkgRXZlcnlvbmUswqAgaSBoYXZlbid0IGZvcmdldCBhYm91dCB0aGlz Li4uLiB5ZXQgOilJIHBlcmZvcm0gdGhlIGZvbGxvd2luZyB0ZXN0IGluIHByZXBhcmF0aW9uIHRv IGFwcGx5IHRoZSBwYXRjaDpJbnN0YWxsZWQgMTIuMSBzdGFibGUgd2l0aCBvbmUgZGlzYyBpbiBy YWlkMCwgbm8gaXNzdWVzIChkaWQgdGhpcyBzbyBpIGNhbiBhcHBseSBwYXRjaCBhbmQgZG9uJ3Qg aGF2ZSB0byBidWlsZCBhIG5ldyBib290YWJsZSBpbWFnZSkud2l0aCAxMi4xIGFkZGVkIHNlY29u ZCByYWlkLCBpbiB0aGlzIGNhc2UgUkFJRDEgYW5kIGl0IGNyYXNoZWQuIGR1cmluZyBmb290IGNv bXBsYWluIGFib3V0IHdyb25nL2NvcnJ1cHQgcGFydGl0aW9uIHRhYmxlUmVwZWF0ZWQgdGhlIHNh bWUgdGVzdCB3aXRoIGN1cnJlbnQgd2l0aCBleGFjdGx5IHRoZSBzYW1lIHJlc3VsdHMgKCBJIGFs c28gaGl0IGFub3RoZXIgaXNzdWVzIG9uIG1seDVlbiB0aGF0IGNyYXNoZWQgd2l0aCBjdXJyZW50 LCB3aWxsIGZvbGxvdyBhZnRlciB3ZSBjYW4gc29ydCB0aGlzIG91dClUb2RheSBJJ20gcGxhbm5p bmcgdG8gYXBwbHkgdGhlIHBhdGNoIGFuZCBzZWUgd2hhdCBoYXBwZW5zLiBIYXZlIHNvbWUgcXVl c3Rpb246RG8geW91IHdhbnQgbWUgdG8gcmVjb3JkIHRoZSBib290aW5nL2Vycm9yIGZvciBlYWNo IGNhc2UgYW5kIG1ha2UgaXQgYXZhaWxhYmxlP0RvIHlvdSB3YW50IGFjY2VzcyB0byB0aGUgYm94 P0Jlc3QgcmVnYXJkcy5TYW50aWFnb8KgT24gMjAyMC0wNi0wOSAyMjo0MywgU2FudGlhZ28gTWFy dGluZXogd3JvdGU6SGkgdGhlcmUsIGFwb2xvZ2llcyBmb3IgdGhlIGRlbGF5ZWQgcmVzcG9uc2Uu IFJlZ2FyZGluZyB0aGUgbG9jayByZXZlcnNhbCwgSSBjYW4gdHJ5IHRvIGNhcHR1cmUgdGhlIHNj cmVlbiBzaG93aW5nIHRoZSBtZXNzYWdlLiBUaGUgIldpbCBjaGVjayBnbyBpdCBnb2VzLi4uLiIg aXQgd2FzIG15IGJyYWluIHRyeWluZyB0byBtdWx0aXRhc2ssIG9idmlvdXNseSBub3QgaW4gYSBz dWNjZXNzZnVsIHdheS4gV2hhdCBJIG1lYW50IHRvIHNheSB3YXMgIkkgd2lsbCBjaGVjayBob3cg aXQgZ29lcy4uLi4uIHdpdGhvdXQgdGhlIFJBSUQiLiBTdXJlLCBJIHdpbGwgdGVzdCB3aXRoIHRo ZSBwYXRjaCBhbmQgbGV0IHlvdSBrbm93IGFzYXAuIGhvcGVmdWxseSBieSB0b21vcnJvdyBuaWdo dChCU1QpLiBDaGVlcnMgU2FudGkgT24gMjAyMC0wNi0wOSAxOToyMCwgS2FzaHlhcCBEZXNhaSB3 cm90ZTogLS0tLS1PcmlnaW5hbCBNZXNzYWdlLS0tLS0gRnJvbTogU2FudGlhZ28gTWFydGluZXog W21haWx0bzpzbUBjb2RlbmV0d29ya3MubmV0XSBTZW50OiBUdWVzZGF5LCBKdW5lIDksIDIwMjAg MTE6MjcgUE0gVG86IEthc2h5YXAgRGVzYWkgPGthc2h5YXAuZGVzYWlAYnJvYWRjb20uY29tPjsg RG9uIExld2lzIDx0cnVja21hbkBmcmVlYnNkLm9yZz47IEFuZHJpeSBHYXBvbiA8YXZnQGZyZWVi c2Qub3JnPiBDYzogRnJlZUJTRCBDdXJyZW50IDxjdXJyZW50QGZyZWVic2Qub3JnPjsgS2FzaHlh cCBELiBEZXNhaSA8a2FkZXNhaUBmcmVlYnNkLm9yZz47IEtlbm5ldGggRC4gTWVycnkgPGtlbkBm cmVlYnNkLm9yZz47IFN1bWl0IFNheGVuYSA8c3VtaXQuc2F4ZW5hQGJyb2FkY29tLmNvbT47IENo YW5kcmFrYW50aCBQYXRpbCA8Y2hhbmRyYWthbnRoLnBhdGlsQGJyb2FkY29tLmNvbT4gU3ViamVj dDogUmU6IE1SU0FTIFBhbmljIGR1cmluZyBJbnN0YWxsLiBIaSEgc28gaXQgd29ya3MgYnV0IGkg Z290IGEgbG9jayBvcmRlciByZXZlcnNhbCB3YXJuaW5nLCBidXQgaXQgY29udGludWUuIE9LLiBT byB3aGF0IGlzIGEgd2FybmluZyA/IFdpbCBjaGVjayBnbyBpdCBnb2VzLi4uLiBDb3VsZCBub3Qg Z2V0IHlvdXIgcG9pbnQuIENhbiB5b3UgZWxhYm9yYXRlID8gQWxzbyBjYW4geW91IHRyeSBSYWlk IC0gMSBWRCB3aXRoIGJlbG93IHBhdGNoID8gZGlmZiAtLWdpdCBhL21yc2FzLmMgYi9tcnNhcy5j IGluZGV4IDNkMzMwNzMuLjYwZjRiNGQgMTAwNzU1IC0tLSBhL21yc2FzLmMgKysrIGIvbXJzYXMu YyBAQCAtMTc0NCwxMSArMTc0NCwxNCBAQCBtcnNhc19jb21wbGV0ZV9jbWQoc3RydWN0IG1yc2Fz X3NvZnRjICpzYywgdV9pbnQzMl90IE1TSXhJbmRleCkgwqDCoMKgwqDCoMKgwqDCoMKgwqDCoMKg wqDCoMKgwqDCoMKgwqDCoMKgwqDCoMKgwqDCoMKgwqDCoMKgwqDCoMKgwqDCoMKgwqDCoMKgwqDC oMKgwqDCoMKgwqDCoMKgwqDCoMKgwqDCoMKgwqDCoCBkYXRhX2xlbmd0aCA9IHIxX2NtZC0+aW9f cmVxdWVzdC0+RGF0YUxlbmd0aDsgwqDCoMKgwqDCoMKgwqDCoMKgwqDCoMKgwqDCoMKgwqDCoMKg wqDCoMKgwqDCoMKgwqDCoMKgwqDCoMKgwqDCoMKgwqDCoMKgwqDCoMKgwqDCoMKgwqDCoMKgwqDC oMKgwqDCoMKgwqDCoMKgwqDCoCBzZW5zZSA9IHIxX2NtZC0+c2Vuc2U7IMKgwqDCoMKgwqDCoMKg wqDCoMKgwqDCoMKgwqDCoMKgwqDCoMKgwqDCoMKgwqDCoMKgwqDCoMKgwqDCoMKgwqDCoMKgwqDC oMKgwqDCoMKgwqDCoMKgwqDCoMKgwqDCoCB9ICsgK8KgwqDCoMKgwqDCoMKgwqDCoMKgwqDCoMKg wqDCoMKgwqDCoMKgwqDCoMKgwqDCoMKgwqDCoMKgwqDCoMKgwqDCoMKgwqDCoMKgwqDCoMKgwqDC oMKgwqDCoCBtdHhfbG9jaygmc2MtPnNpbV9sb2NrKTsgwqDCoMKgwqDCoMKgwqDCoMKgwqDCoMKg wqDCoMKgwqDCoMKgwqDCoMKgwqDCoMKgwqDCoMKgwqDCoMKgwqDCoMKgwqDCoMKgwqDCoMKgwqDC oMKgwqDCoMKgwqDCoMKgIHIxX2NtZC0+Y2NiX3B0ciA9IE5VTEw7IMKgwqDCoMKgwqDCoMKgwqDC oMKgwqDCoMKgwqDCoMKgwqDCoMKgwqDCoMKgwqDCoMKgwqDCoMKgwqDCoMKgwqDCoMKgwqDCoMKg wqDCoMKgwqDCoMKgwqDCoMKgwqDCoCBpZiAocjFfY21kLT5jYWxsb3V0X293bmVyKSB7IGNhbGxv dXRfc3RvcCgmcjFfY21kLT5jbV9jYWxsb3V0KTsgwqDCoMKgwqDCoMKgwqDCoMKgwqDCoMKgwqDC oMKgwqDCoMKgwqDCoMKgwqDCoMKgwqDCoMKgwqDCoMKgwqDCoMKgwqDCoMKgwqDCoMKgwqDCoMKg wqDCoMKgwqDCoMKgwqDCoMKgwqDCoMKgwqDCoCByMV9jbWQtPmNhbGxvdXRfb3duZXIgPSBmYWxz ZTsgwqDCoMKgwqDCoMKgwqDCoMKgwqDCoMKgwqDCoMKgwqDCoMKgwqDCoMKgwqDCoMKgwqDCoMKg wqDCoMKgwqDCoMKgwqDCoMKgwqDCoMKgwqDCoMKgwqDCoMKgwqDCoMKgIH0gK8KgwqDCoMKgwqDC oMKgwqDCoMKgwqDCoMKgwqDCoMKgwqDCoMKgwqDCoMKgwqDCoMKgwqDCoMKgwqDCoMKgwqDCoMKg wqDCoMKgwqDCoMKgwqDCoMKgwqDCoCBtdHhfdW5sb2NrKCZzYy0+c2ltX2xvY2spOyDCoMKgwqDC oMKgwqDCoMKgwqDCoMKgwqDCoMKgwqDCoMKgwqDCoMKgwqDCoMKgwqDCoMKgwqDCoMKgwqDCoMKg wqDCoMKgwqDCoMKgwqDCoMKgwqDCoMKgwqDCoMKgwqAgbXJzYXNfcmVsZWFzZV9tcHRfY21kKHIx X2NtZCk7IG1yc2FzX21hcF9tcHRfY21kX3N0YXR1cyhjbWRfbXB0LCBjbWRfbXB0LT5jY2JfcHRy LCBzdGF0dXMsIMKgwqDCoMKgwqDCoMKgwqDCoMKgwqDCoMKgwqDCoMKgwqDCoMKgwqDCoMKgwqDC oMKgwqDCoMKgwqDCoMKgwqDCoMKgwqDCoMKgwqDCoMKgwqDCoMKgwqDCoMKgwqDCoMKgwqDCoMKg wqDCoMKgwqAgZXh0U3RhdHVzLCBkYXRhX2xlbmd0aCwgc2Vuc2UpOyBTYW50aSBPbiAyMDIwLTA2 LTA5IDExOjEzLCBTYW50aWFnbyBNYXJ0aW5leiB3cm90ZTogVHJ5aW5nIHJpZ2h0IG5vdywgd2ls bCBsZXQgeW91IGtub3cuLi4uLiBPbiAyMDIwLTA2LTA5IDExOjA3LCBLYXNoeWFwIERlc2FpIHdy b3RlOiBIaSBTYW50aSAtIFBsZWFzZSB0cnkgd2l0aG91dCBSYWlkLTEgVkQuIE1vc3QgbGlrZWx5 IHlvdSB3aWxsIG5vdCBvYnNlcnZlIGlzc3VlLCBidXQgeW91IGNhbiBjb25maXJtIGZyb20geW91 ciBlbmQuIEthc2h5YXAgLS0tLS1PcmlnaW5hbCBNZXNzYWdlLS0tLS0gRnJvbTogU2FudGlhZ28g TWFydGluZXogW21haWx0bzpzbUBjb2RlbmV0d29ya3MubmV0XSBTZW50OiBUdWVzZGF5LCBKdW5l IDksIDIwMjAgMjowOCBQTSBUbzogRG9uIExld2lzIDx0cnVja21hbkBGcmVlQlNELm9yZz47IEFu ZHJpeSBHYXBvbiA8YXZnQEZyZWVCU0Qub3JnPiBDYzogRnJlZUJTRCBDdXJyZW50IDxjdXJyZW50 QGZyZWVic2Qub3JnPjsgS2FzaHlhcCBELiBEZXNhaSA8a2FkZXNhaUBGcmVlQlNELm9yZz47IEtl bm5ldGggRC4gTWVycnkgPGtlbkBGcmVlQlNELm9yZz4gU3ViamVjdDogUmU6IE1SU0FTIFBhbmlj IGR1cmluZyBJbnN0YWxsLiBIaSBLYXNoYXlwLCB0aGF0J3MgY29ycmVjdCwgdGhlIHNlcnZlcnMg aGFzIHR3byByYWlkcy4gQSByYWlkIDEgVkQwIHdpdGggMnhTU0Qgb24gaXQgYW5kIGEgUkFJRDUg VkQwLiBEbyB5b3Ugd2FudCBtZSB0byBicmVhayB0aGUgcmFpZCBhbmQgc2VlIGkgaXQgZG9lcyBu b3QgdHJpZ2dlciB0aGUgYnVnPyBjaGVlcnMgU2FudGkgT24gMjAyMC0wNi0wOSAwNzo1MSwgRG9u IExld2lzIHdyb3RlOiBPbsKgIDkgSnVuLCBBbmRyaXkgR2Fwb24gd3JvdGU6IE9uIDA5LzA2LzIw MjAgMDM6NDIsIFNhbnRpYWdvIE1hcnRpbmV6IHdyb3RlOiBIaSBFdmVyeW9uZSwgdG9kYXkgSSB0 ZXN0ZWQgd2l0aCAxMi4xIGFuZCBpdCB3b3JrcyB3aXRob3V0IGFueSBpc3N1ZXMgKGF0IGxlYXN0 IGZvciBub3cpLiBJIHdpbGwgc3luYyBhZ2FpbnN0IGN1cnJlbnQgYW5kIHNlZSBpZiBpdCBmYWls cy4gU2FudGlhZ28gT24gMjAyMC0wNi0wOCAxNzo0MSwgU2FudGlhZ28gTWFydGluZXogd3JvdGU6 IEhpIHRoZXJlLCB0cmllZCBhZ2FpbiBhbmQgbm93IGkgZ290IGl0IHdpdGggVUZTIGFsc28uLiB0 aGF0IG1ha2Ugc2Vuc2UuLiByaWdodC4uLiBPbiAyMDIwLTA2LTA4IDE1OjIwLCBTYW50aWFnbyBN YXJ0aW5leiB3cm90ZTogSGkgRXZlcnlvbmUsIEknbSBpbnN0YWxsaW5nIEZyZWVCU0QgY3VycmVu dCgzNjE1NjcpIHNuYXBzaG90IG9uIGEgTGVub3ZvIFNSNjU1IHNlcnZlci4gQWZ0ZXIgc2VsZWN0 aW5nIFpGUywgYW5kIHRoZSBpbnN0YWxsZXIgdHJpZXMgdG8gbWFrZSB0aGUgcGFydGl0aW9ucywg ZXRjIEkgZ2V0IHRoZSBmb2xsb3dpbmcgcGFuaWMuIEkgdHJpZWQgc2VsZWN0aW5nIFVGUyBhbmQg aXRzIHdvcmtzLiBJIHVwbG9hZGVkIGEgc2NyZWVuc2hvdCBhcyBJIG9ubHkgaGF2ZSBLVk0gYWNj ZXNzIHRvIGl0OiBodHRwczovLzBiaW4ubmV0L3Bhc3RlLzR5bjMzR2tTS2lZdG82bTQjaDc4eUNF Nmg4MC0gM0RzQXBiWGExWExXOStiIGhvS2hPcjNNVlMrTlJnQTVBIFRoZSBzZXJ2ZXIgaXMgYSBU aGlua1N5c3RlbSBTUjY1NSwgd2l0aCB0aGUgZm9sbG93aW5nIGNvbnRyb2xsZXIsIFJBSUQgOTMw LThpIDJHQiBGbGFzaCBQQ0llIDEyR2IgQWRhcHRlciBMb3VzeSBPQ1Igb2YgdGhlIHBpY3R1cmU6 IC4uLiBuaWM6IG51dGV4IG1yc2FzX3Npbl9sb2NrIG5vdCBvdW5lZCBhdCAvdXNyL3NyYy9zeXMv a2Vybi9rZXJuX251dGV4LmM6Mjg0IC4uLiBiX3RyYWNlX3NlbGZfdXJhcHBlciAoKSBhdCBkYl90 cmFjZV9zZWxmX3VyYXBwZXIrOHgyYi9mcmFuZSBCeGZmZmZmZUIzM2M0NGE5MTggYW5pYygpIGF0 IHZwYW5pYytCeDE4Mi9mcmFuZSBCeGZmZmZmZUEzM2M0NGFkNjggbmljKCkgYXQgcGFuaWMrQng0 My9mcmFtZSBCeGZmZmZmZUIzM2M0NGFkY2QgX210eF9hc3NlcnQoKSBhdCBfX210eF9hc3NlcnQr QHhiQC9mcmFuZSBCeGZmZmZmZWQzM2M0NGE5ZGQgY2FsbG91dF9zdG9wX3NhZmUoKSBhdCBfY2Fs bG91dF9zdG9wX3NhZmUrQng4Mi9mcmFuZSBCeGZmZmZmZTMzYzQ0YWFjIHJzYXNfY29ucGxldGVf Y25kKCkgYXQgbXJzYXNfY29tcGxldGVfY25kKzh4MWI4L2ZyYW5lIEJ4ZmZmZmZlQjMzYzRkYWFl ZCBpdGhyZWFkX2xvb3AoKSBhdCBpdGhyZWFkX2xvb3ArQHgyNzkvZnJhbWUgQnhmZmZmZmVCMzNj NDRhaDc4IFRoaXMgbG9va3MgbGlrZSBhIGZhbGxvdXQgZnJvbSByMzQyMDY0LiBjbV9jYWxsb3V0 IGlzIGluaXRpYWxpemVkIGxpa2UgdGhpczogwqDCoMKgwqAgY2FsbG91dF9pbml0X210eCgmY21k LT5jbV9jYWxsb3V0LCAmc2MtPnNpbV9sb2NrLCAwKTsgYnV0IGluIG1yc2FzX2NvbXBsZXRlX2Nt ZCgpIGl0J3Mgc3RvcHBlZCB3aXRob3V0IGhvbGRpbmcgdGhlIGxvY2suIF9fX19fX19fX19fX19f X19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fIGZyZWVic2QtY3VycmVudEBmcmVlYnNk Lm9yZyBtYWlsaW5nIGxpc3QgaHR0cHM6Ly9saXN0cy5mcmVlYnNkLm9yZy9tYWlsbWFuL2xpc3Rp bmZvL2ZyZWVic2QtY3VycmVudCBUbyB1bnN1YnNjcmliZSwgc2VuZCBhbnkgbWFpbCB0byAiZnJl ZWJzZC1jdXJyZW50LSB1bnN1YnNjcmliZUBmcmVlYnNkLm9yZyIgX19fX19fX19fX19fX19fX19f X19fX19fX19fX19fX19fX19fX19fX19fX19fX18gZnJlZWJzZC1jdXJyZW50QGZyZWVic2Qub3Jn IG1haWxpbmcgbGlzdCBodHRwczovL2xpc3RzLmZyZWVic2Qub3JnL21haWxtYW4vbGlzdGluZm8v ZnJlZWJzZC1jdXJyZW50IFRvIHVuc3Vic2NyaWJlLCBzZW5kIGFueSBtYWlsIHRvICJmcmVlYnNk LWN1cnJlbnQtdW5zdWJzY3JpYmVAZnJlZWJzZC5vcmciIF9fX19fX19fX19fX19fX19fX19fX19f X19fX19fX19fX19fX19fX19fX19fX19fIGZyZWVic2QtY3VycmVudEBmcmVlYnNkLm9yZyBtYWls aW5nIGxpc3QgaHR0cHM6Ly9saXN0cy5mcmVlYnNkLm9yZy9tYWlsbWFuL2xpc3RpbmZvL2ZyZWVi c2QtY3VycmVudCBUbyB1bnN1YnNjcmliZSwgc2VuZCBhbnkgbWFpbCB0byAiZnJlZWJzZC1jdXJy ZW50LXVuc3Vic2NyaWJlQGZyZWVic2Qub3JnIiA= From owner-freebsd-current@freebsd.org Mon Jun 15 20:48:17 2020 Return-Path: Delivered-To: freebsd-current@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id D3672343781; Mon, 15 Jun 2020 20:48:17 +0000 (UTC) (envelope-from lwhsu@freebsd.org) Received: from freefall.freebsd.org (freefall.freebsd.org [IPv6:2610:1c1:1:6074::16:84]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "freefall.freebsd.org", Issuer "Let's Encrypt Authority X3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 49m3M55FNQz3W6s; Mon, 15 Jun 2020 20:48:17 +0000 (UTC) (envelope-from lwhsu@freebsd.org) Received: by freefall.freebsd.org (Postfix, from userid 1129) id 9C0B520B2B; Mon, 15 Jun 2020 20:48:17 +0000 (UTC) Date: Mon, 15 Jun 2020 20:48:17 +0000 From: Li-Wen Hsu To: freebsd-testing@freebsd.org Cc: freebsd-current@freebsd.org, freebsd-stable@freebsd.org Subject: FreeBSD CI Weekly Report 2020-06-14 Message-ID: <20200615204817.GA4096@freefall.freebsd.org> Reply-To: freebsd-testing@freebsd.org MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline X-BeenThere: freebsd-current@freebsd.org X-Mailman-Version: 2.1.33 Precedence: list List-Id: Discussions about the use of FreeBSD-current List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 15 Jun 2020 20:48:17 -0000 (Please send the followup to freebsd-testing@ and note Reply-To is set.) FreeBSD CI Weekly Report 2020-06-14 =================================== Here is a summary of the FreeBSD Continuous Integration results for the period from 2020-06-08 to 2020-06-14. During this period, we have: * 1798 builds (90.0% (+1.4) passed, 10.0% (-1.4) failed) of buildworld and buildkernel (GENERIC and LINT) were executed on aarch64, amd64, armv6, armv7, i386, mips, mips64, powerpc, powerpc64, powerpcspe, riscv64, sparc64 architectures for head, stable/12, stable/11 branches. * 199 test runs (77.9% (+1.1) passed, 20.6% (-0.1) unstable, 1.5% (-1.0) exception) were executed on amd64, i386, riscv64 architectures for head, stable/12, stable/11 branches. * 29 doc and www builds (96.6% (-3.4) passed, 3.4% (+3.4) failed) Test case status (on 2020-06-14 23:59): | Branch/Architecture | Total | Pass | Fail | Skipped | | ------------------- | ---------- | ---------- | ------ | ------- | | head/amd64 | 7863 (+30) | 7773 (+32) | 0 (+0) | 90 (-2) | | head/i386 | 7861 (+30) | 7762 (+27) | 0 (+0) | 99 (+3) | | 12-STABLE/amd64 | 7587 (+1) | 7528 (+1) | 0 (+0) | 59 (+0) | | 12-STABLE/i386 | 7585 (+1) | 7521 (+4) | 0 (+0) | 64 (-3) | | 11-STABLE/amd64 | 6885 (+2) | 6835 (+5) | 0 (+0) | 50 (-3) | | 11-STABLE/i386 | 6883 (+2) | 6831 (+2) | 0 (+0) | 52 (+0) | (The statistics from experimental jobs are omitted) If any of the issues found by CI are in your area of interest or expertise please investigate the PRs listed below. The latest web version of this report is available at https://hackmd.io/@FreeBSD-CI/report-20200614 and archive is available at https://hackmd.io/@FreeBSD-CI/ , any help is welcome. ## Failing jobs * https://ci.freebsd.org/job/FreeBSD-head-amd64-gcc6_build/ ``` /usr/local/bin/x86_64-unknown-freebsd12.1-ld: /tmp/obj/workspace/src/amd64.amd64/lib/clang/liblldb/liblldb.a(IOHandlerCursesGUI.o): in function `curses::Window::Box(unsigned int, unsigned int)': /workspace/src/contrib/llvm-project/lldb/source/Core/IOHandlerCursesGUI.cpp:361: undefined reference to `box' /usr/local/bin/x86_64-unknown-freebsd12.1-ld: /workspace/src/contrib/llvm-project/lldb/source/Core/IOHandlerCursesGUI.cpp:361: undefined reference to `box' collect2: error: ld returned 1 exit status ``` ## Regressions * lib.libexecinfo.backtrace_test.backtrace_fmt_basic starts failing on amd64 after r360915 https://bugs.freebsd.org/246537 * (head, stable/12, stable/11) 2 tests start failing after llvm10 import * lib.msun.ctrig_test.test_inf_inputs https://bugs.freebsd.org/244732 * (DTrace) common.pid.t_dtrace_contrib.err_D_PROC_OFF_toobig_d https://bugs.freebsd.org/244823 * Lock-order reversals triggered by tests under sys.net.if_lagg_test.* on i386 https://bugs.freebsd.org/244163 Discovered by newly endabled sys.net.* tests. ([r357857](https://svnweb.freebsd.org/changeset/base/357857)) * sys.net.if_lagg_test.lacp_linkstate_destroy_stress panics i386 kernel https://bugs.freebsd.org/244168 Discovered by newly endabled sys.net.* tests. ([r357857](https://svnweb.freebsd.org/changeset/base/357857)) Fix in review: https://reviews.freebsd.org/D25284 ## Failing and Flaky tests (from experimental jobs) * https://ci.freebsd.org/job/FreeBSD-head-amd64-dtrace_test/ * cddl.usr.sbin.dtrace.common.misc.t_dtrace_contrib.tst_dynopt_d * https://bugs.freebsd.org/237641 * cddl.usr.sbin.dtrace.common.pid.t_dtrace_contrib.err_D_PROC_OFF_toobig_d * https://bugs.freebsd.org/244823 * https://ci.freebsd.org/job/FreeBSD-head-amd64-test_zfs/ * There are ~13 failing and ~109 skipped cases, including flakey ones, see https://ci.freebsd.org/job/FreeBSD-head-amd64-test_zfs/lastCompletedBuild/testReport/ for more details * Work for cleaning these failing cass are in progress * https://ci.freebsd.org/job/FreeBSD-head-amd64-test_ltp/ * Total 3749 tests, 2277 success, 646 failures, 826 skipped ## Disabled Tests * sys.fs.tmpfs.mount_test.large https://bugs.freebsd.org/212862 * sys.fs.tmpfs.link_test.kqueue https://bugs.freebsd.org/213662 * sys.kqueue.libkqueue.kqueue_test.main https://bugs.freebsd.org/233586 * sys.kern.ptrace_test.ptrace__PT_KILL_competing_stop https://bugs.freebsd.org/220841 * lib.libc.regex.exhaust_test.regcomp_too_big (i386 only) https://bugs.freebsd.org/237450 * sys.netinet.socket_afinet.socket_afinet_bind_zero https://bugs.freebsd.org/238781 * sys.netpfil.pf.names.names * sys.netpfil.pf.synproxy.synproxy https://bugs.freebsd.org/238870 * sys.kern.ptrace_test.ptrace__follow_fork_child_detached_unrelated_debugger https://bugs.freebsd.org/239292 * sys.kern.ptrace_test.ptrace__follow_fork_both_attached_unrelated_debugger https://bugs.freebsd.org/239397 * sys.kern.ptrace_test.ptrace__parent_sees_exit_after_child_debugger https://bugs.freebsd.org/239399 * sys.kern.ptrace_test.ptrace__follow_fork_parent_detached_unrelated_debugger https://bugs.freebsd.org/239425 * lib.libc.gen.getmntinfo_test.getmntinfo_test https://bugs.freebsd.org/240049 * sys.sys.qmath_test.qdivq_s64q https://bugs.freebsd.org/240219 * sys.kern.ptrace_test.ptrace__getppid https://bugs.freebsd.org/240510 * lib.libc.sys.stat_test.stat_socket https://bugs.freebsd.org/240621 * lib.libarchive.functional_test.test_write_filter_zstd https://bugs.freebsd.org/240683 * lib.libcasper.services.cap_dns.dns_test.main https://bugs.freebsd.org/241435 * local.kyua.* (31 cases) & local.lutok.* (3 cases) on 11-i386 https://ci.freebsd.org/job/FreeBSD-stable-11-i386-test/2278/testReport/ * sys.kern.ptrace_test.ptrace__procdesc_reparent_wait_child https://bugs.freebsd.org/243605 * sys.kern.ptrace_test.ptrace__parent_wait_after_attach https://bugs.freebsd.org/244055 * sys.kern.ptrace_test.ptrace__parent_exits_before_child https://bugs.freebsd.org/244056 * sys.net.if_lagg_test.witness (i386) https://bugs.freebsd.org/244163 * PipePdfork.WildcardWait in sys.capsicum.capsicum-test.main https://bugs.freebsd.org/244165 * sys.net.if_lagg_test.lacp_linkstate_destroy_stress (i386) https://bugs.freebsd.org/244168 * sys.netinet6.frag6.frag6_07.frag6_07 https://bugs.freebsd.org/244170 * sys.netinet.fibs_test.udp_dontroute6 https://bugs.freebsd.org/244172 * sys.netpfil.pf.nat.exhaust https://bugs.freebsd.org/244703 ## Issues ### Cause build fails * https://bugs.freebsd.org/233735 Possible build race: genoffset.o /usr/src/sys/sys/types.h: error: machine/endian.h: No such file or directory * https://bugs.freebsd.org/233769 Possible build race: ld: error: unable to find library -lgcc_s ### Cause kernel panics * https://bugs.freebsd.org/238870 sys.netpfil.pf.names.names and sys.netpfil.pf.synproxy.synproxy cause panic ### Open * https://bugs.freebsd.org/237403 Tests in sys/opencrypto should be converted to Python3 * https://bugs.freebsd.org/237641 Flakey test case: common.misc.t_dtrace_contrib.tst_dynopt_d * https://bugs.freebsd.org/237656 "Freed UMA keg (rtentry) was not empty (18 items). Lost 1 pages of memory." seen when running sys/netipsec tests * https://bugs.freebsd.org/238781 sys.netinet.socket_afinet.socket_afinet_bind_zero does not work when mac_portacl(4) loaded * https://bugs.freebsd.org/239292 Flakey test case: sys.kern.ptrace_test.ptrace__follow_fork_child_detached_unrelated_debugger * https://bugs.freebsd.org/239397 Flakey test case: sys.kern.ptrace_test.ptrace__follow_fork_both_attached_unrelated_debugger * https://bugs.freebsd.org/239399 Flakey test case: sys.kern.ptrace_test.ptrace__parent_sees_exit_after_child_debugger * https://bugs.freebsd.org/239425 Flakey test case: sys.kern.ptrace_test.ptrace__follow_fork_parent_detached_unrelated_debugger * https://bugs.freebsd.org/241662 Flakey test case: lib.libarchive.functional_test.test_fuzz_iso9660 * https://bugs.freebsd.org/246443 sys.net.if_clone_test.epair_stress sometimes exceeds timeout limit but not caught by kyua ### Others * [Tickets related to testing@](https://preview.tinyurl.com/y9maauwg) From owner-freebsd-current@freebsd.org Tue Jun 16 00:06:44 2020 Return-Path: Delivered-To: freebsd-current@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 59FA2347216 for ; Tue, 16 Jun 2020 00:06:44 +0000 (UTC) (envelope-from rmacklem@uoguelph.ca) Received: from CAN01-QB1-obe.outbound.protection.outlook.com (mail-qb1can01on0612.outbound.protection.outlook.com [IPv6:2a01:111:f400:fe5c::612]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client CN "mail.protection.outlook.com", Issuer "GlobalSign Organization Validation CA - SHA256 - G3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 49m7m31TS5z400M; Tue, 16 Jun 2020 00:06:42 +0000 (UTC) (envelope-from rmacklem@uoguelph.ca) ARC-Seal: i=1; a=rsa-sha256; s=arcselector9901; d=microsoft.com; cv=none; b=YMuzA7wHzByZXuCYdPctklMhHR3iTx8nJ9DmO/rlNdwposIcd5XsV7Q5Gzy49YqIlrjAxWRGIGz9G4bsf39dISS347GWiETQ9CKWiZITKyqhYIzEtzdVH2uswd9I8AahGl+ApQhAzcrNouIolbxiuZR2k7owWrtqrwuOnIWtJIYMhAsWdfqK5kzwdlMmmwV2jVFUp8gd3RiC+9QY7r0nV3ba7awtvjrDG4aPjaew4KbbDexPxpq5h+41qXYeiGdEfSXxF8THjTXmnUFDvoroMuThZ9CO77Uw6djAs+c+cfjaa35BmHp7YwkNHGWL8POBHA4ciytVYYxWNy/aiPJj2g== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=microsoft.com; s=arcselector9901; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=q5IExhbfPiIxghFIdOLZyOAxdtNcO1MQCYz6RQBC7JU=; b=BP+FMNL5gqHF7xpQCXvHhCZByfwF/OCRqFTldCUSCSfRINUrqFe2Q3w4xCc+X7RLzZ1njgmzfj1tEf4usSEQfiBbjQMbInT2VE+yZI0q2E7lqpa6tN/dWna2o4LdSZzOMwCwpwKj0cVazx1rWmVjDisszurwFtSqy4Y7ueGFxM+9Dj+HxvMAHpmc2BgKF3wrt5E+9O51TBzo6iF8AtHsBmrCURugRCEBA+hPF0ya+C3nYW0FTM+ymbd2RHo4mQ/E98seJXROWLP8pDqtwAMgJ+ZhbzmRdu9aQ8XZsQ8PdCDBS/p2O/1Q62TF9oDbkv9wkuG6ZJzWi9V/5PGcvPg6fg== ARC-Authentication-Results: i=1; mx.microsoft.com 1; spf=pass smtp.mailfrom=uoguelph.ca; dmarc=pass action=none header.from=uoguelph.ca; dkim=pass header.d=uoguelph.ca; arc=none DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=uoguelph.ca; s=selector1; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=q5IExhbfPiIxghFIdOLZyOAxdtNcO1MQCYz6RQBC7JU=; b=WodONKIQN0iH7CcFgbN1seM6O8QiX4gMOS8FkDEBnsMEQna2kvUBLmXclZXupetVwBYU2W530o91VgX6B1DWP1e811NDw2cu6TJ3nhGCtT+v0Hs4MkhbhBE6UbYajDCrWZOe/6qaXI8tzLA+Ll04Wt1KYjMezoboTcYDEPTXEv/BINarotQugYmpALXzMPfTK6A7Gt80fdTERAZSA5E4g0j5AiLShIJ30K8kDGw5AA+APf30RfXPDFE3KECOGSZPzwk/1DaD4dQtC0qfBI385t3WOkIkv0E1iBk7OO+meYzKNFsMTrTA56Nkmh16EJc5fi0h23KuBTfiyQDUTQ/2hw== Received: from QB1PR01MB3364.CANPRD01.PROD.OUTLOOK.COM (2603:10b6:c00:38::14) by QB1PR01MB3412.CANPRD01.PROD.OUTLOOK.COM (2603:10b6:c00:3f::28) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.3088.24; Tue, 16 Jun 2020 00:06:39 +0000 Received: from QB1PR01MB3364.CANPRD01.PROD.OUTLOOK.COM ([fe80::60f3:4ca2:8a4a:1e91]) by QB1PR01MB3364.CANPRD01.PROD.OUTLOOK.COM ([fe80::60f3:4ca2:8a4a:1e91%7]) with mapi id 15.20.3088.028; Tue, 16 Jun 2020 00:06:39 +0000 From: Rick Macklem To: Konstantin Belousov , Jeff Roberson CC: Ryan Libby , "freebsd-current@FreeBSD.org" Subject: Re: r358252 causes intermittent hangs where processes are stuck sleeping on btalloc Thread-Topic: r358252 causes intermittent hangs where processes are stuck sleeping on btalloc Thread-Index: AQHWLwsKoH8lF1xuI0WPckyCNZ/JGaiyHHkAgAA2qQCAAlx9bIAA08mAgAWQ7N2AFd4gwYAJkgDc Date: Tue, 16 Jun 2020 00:06:39 +0000 Message-ID: References: <20200521101428.GC64045@kib.kiev.ua> , <20200523105601.GN64045@kib.kiev.ua>, , In-Reply-To: Accept-Language: en-US Content-Language: en-US X-MS-Has-Attach: X-MS-TNEF-Correlator: x-ms-publictraffictype: Email x-ms-office365-filtering-correlation-id: d854e407-cb20-4dbb-9691-08d81189248d x-ms-traffictypediagnostic: QB1PR01MB3412: x-microsoft-antispam-prvs: x-ms-oob-tlc-oobclassifiers: OLM:7691; x-forefront-prvs: 04362AC73B x-ms-exchange-senderadcheck: 1 x-microsoft-antispam: BCL:0; x-microsoft-antispam-message-info: 3BL4fQrly7g5iFH1BqkpglRNDFEPvD3jNuEte5QvMmMturyJ3c7EGm4JybOpH7xFaB8j7/CEO/rJaOZ1oXwlKbdvI4+pnZNot+pftfBVg3u/wxXgfWbhlJD4nPSSWIPGmAm62AgQEI9EXOWv264A76mwswc0n6SI9ofm6SJsqON+g3zNbzCt+9Rfe3tcgYfCp8nScj6gIvQvnx/tK8HdtGJc13ZT9dqm6y8jYVhKuRhLweO2PJWS7JR3WNSWItHPn0PR/UKpve8ge5a2lf/2O0vyCjGra2QpxKfOgCib4VFjCMxmL7uy+KTaQ2cukVZUMgA1Rs6qz8C53f2kpCXH+uOQIwrm/qlaSD/xGQAbeLdzy1bI4tAy/P7RtkncHYoiTJ55tljdiERliTblVdGUrQ== x-forefront-antispam-report: CIP:255.255.255.255; CTRY:; LANG:en; SCL:1; SRV:; IPV:NLI; SFV:NSPM; H:QB1PR01MB3364.CANPRD01.PROD.OUTLOOK.COM; PTR:; CAT:NONE; SFTY:; SFS:(396003)(376002)(346002)(366004)(39860400002)(136003)(33656002)(83380400001)(8676002)(4326008)(786003)(316002)(2906002)(9686003)(55016002)(110136005)(478600001)(966005)(7696005)(54906003)(8936002)(76116006)(5660300002)(30864003)(66476007)(52536014)(71200400001)(86362001)(64756008)(6506007)(66446008)(66556008)(53546011)(186003)(66946007); DIR:OUT; SFP:1101; x-ms-exchange-antispam-messagedata: l6YpmfOScRBikOgl+62RWkjG642e9HXvxyBkZWeLfP6vAKMb08AVkOvlBCwQ8Wi2MbnzcR/SYE68aXxRrWkW+xzN3tJ/zHO3OJsrbIVGYd8qrVeU5UCKj+jVS3KdEhTOn75+UIETAu5a2aXQ5/taKNjPRy6rd3y/uqWv3oQRnU9YsW+Lm3YhGZqro1j+XBLpXsopxg2EdbA6J8GC60vAV2Yqh01zO2X3nW40mjkRg2A5rZmU7R6k2AL/fidEm2D8ALd3ymZlj1hESozbdx9w2niOdu8m41g7xcSCevD9RbedBbmK6Dh7ChdQGrbAmjkGdp3rxR6jIh1kLRTlXxbG064xJV+Ko1ObXlHJ6MJoKYWa/Aelu0Jk7OV2E1m7krNrmD4FeFtz1J43kX9xojM+sULVDC5KdqIuxu6OPmvzuqCAufy3qpPCv73tiSRLvG6L/E2lLL4fLyPzKEQmrXUXKU8mjd7nVfxbQ5XCVjQMPgaA7iKYfMQB1LVHDv5yVYCbLj/d4caJdooNC0Z6B7PWD+p2MDYuM7efPBNLr0CbHBW/2lg7MaL0nAJNTNh+10XF x-ms-exchange-transport-forked: True Content-Type: text/plain; charset="Windows-1252" Content-Transfer-Encoding: quoted-printable MIME-Version: 1.0 X-OriginatorOrg: uoguelph.ca X-MS-Exchange-CrossTenant-Network-Message-Id: d854e407-cb20-4dbb-9691-08d81189248d X-MS-Exchange-CrossTenant-originalarrivaltime: 16 Jun 2020 00:06:39.3226 (UTC) X-MS-Exchange-CrossTenant-fromentityheader: Hosted X-MS-Exchange-CrossTenant-id: be62a12b-2cad-49a1-a5fa-85f4f3156a7d X-MS-Exchange-CrossTenant-mailboxtype: HOSTED X-MS-Exchange-CrossTenant-userprincipalname: GcNhn9LhS+0FssIm1kttMh39pgxBFRIPHE9G7bclLOXIsj9XusjvW1NUizwkyl9A3qiMhvNjr7ROymuyxpXVNA== X-MS-Exchange-Transport-CrossTenantHeadersStamped: QB1PR01MB3412 X-Rspamd-Queue-Id: 49m7m31TS5z400M X-Spamd-Bar: ----- Authentication-Results: mx1.freebsd.org; dkim=pass header.d=uoguelph.ca header.s=selector1 header.b=WodONKIQ; dmarc=none; spf=pass (mx1.freebsd.org: domain of rmacklem@uoguelph.ca designates 2a01:111:f400:fe5c::612 as permitted sender) smtp.mailfrom=rmacklem@uoguelph.ca X-Spamd-Result: default: False [-5.10 / 15.00]; TO_DN_EQ_ADDR_SOME(0.00)[]; NEURAL_HAM_MEDIUM(-1.01)[-1.013]; R_DKIM_ALLOW(-0.20)[uoguelph.ca:s=selector1]; FROM_HAS_DN(0.00)[]; RCPT_COUNT_THREE(0.00)[4]; TO_DN_SOME(0.00)[]; R_SPF_ALLOW(-0.20)[+ip6:2a01:111:f400::/48]; MIME_GOOD(-0.10)[text/plain]; DMARC_NA(0.00)[uoguelph.ca]; NEURAL_HAM_LONG(-0.98)[-0.984]; DWL_DNSWL_LOW(-1.00)[uoguelph.ca:dkim]; RCVD_COUNT_THREE(0.00)[3]; TO_MATCH_ENVRCPT_SOME(0.00)[]; DKIM_TRACE(0.00)[uoguelph.ca:+]; NEURAL_HAM_SHORT(-0.60)[-0.601]; FREEMAIL_TO(0.00)[gmail.com,FreeBSD.org]; FROM_EQ_ENVFROM(0.00)[]; MIME_TRACE(0.00)[0:+]; RCVD_TLS_LAST(0.00)[]; ASN(0.00)[asn:8075, ipnet:2a01:111:f000::/36, country:US]; ARC_ALLOW(-1.00)[microsoft.com:s=arcselector9901:i=1] X-BeenThere: freebsd-current@freebsd.org X-Mailman-Version: 2.1.33 Precedence: list List-Id: Discussions about the use of FreeBSD-current List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 16 Jun 2020 00:06:44 -0000 Rick Macklem wrote:=0A= >r358098 will hang fairly easily, in 1-3 cycles of the kernel build over NF= S.=0A= >I thought this was the culprit, since I did 6 cycles of r358097 without a = hang.=0A= >However, I just got a hang with r358097, but it looks rather different.=0A= >The r358097 hang did not have any processes sleeping on btalloc. They=0A= >appeared to be waiting on two different locks in the buffer cache.=0A= >As such, I think it might be a different problem. (I'll admit I should hav= e=0A= >made notes about this one before rebooting, but I was flustrated that=0A= >it happened and rebooted before looking at it mush detail.)=0A= Ok, so I did 10 cycles of the kernel build over NFS for r358096 and never= =0A= got a hang.=0A= --> It seems that r358097 is the culprit and r358098 makes it easier=0A= to reproduce.=0A= --> Basically runs out of kernel memory.=0A= =0A= It is not obvious if I can revert these two commits without reverting=0A= other ones, since there were a bunch of vm changes after these.=0A= =0A= I'll take a look, but if you guys have any ideas on how to fix this, please= =0A= let me know.=0A= =0A= Thanks, rick=0A= =0A= Jeff, to fill you in, I have been getting intermittent hangs on a Pentium 4= =0A= (single core i386) with 1.25Gbytes ram when doing kernel builds using=0A= head kernels from this winter. (I also saw one when doing a kernel build=0A= on UFS, so they aren't NFS specific, although easier to reproduce that way.= )=0A= After a typical hang, there will be a bunch of processes sleeping on "btall= oc"=0A= and several processes holding the following lock:=0A= exclusive sx lock @ vm/vm_map.c:4761=0A= - I have seen hangs where that is the only lock held by any process except= =0A= the interrupt thread.=0A= - I have also seen processes waiting on the following locks:=0A= kern/subr_vmem.c:1343=0A= kern/subr_vmem.c:633=0A= =0A= I can't be absolutely sure r358098 is the culprit, but it seems to make the= =0A= problem more reproducible.=0A= =0A= If anyone has a patch suggestion, I can test it.=0A= Otherwise, I will continue to test r358097 and earlier, to try and see what= hangs=0A= occur. (I've done 8 cycles of testing of r356776 without difficulties, but = that=0A= doesn't guarantee it isn't broken.)=0A= =0A= There is a bunch more of the stuff I got for Kostik and Ryan below.=0A= I can do "db" when it is hung, but it is a screen console, so I need to=0A= transcribe the output to email by hand. (ie. If you need something=0A= specific I can do that, but trying to do everything Kostik and Ryan asked= =0A= for isn't easy.)=0A= =0A= rick=0A= =0A= =0A= =0A= Konstantin Belousov wrote:=0A= >On Fri, May 22, 2020 at 11:46:26PM +0000, Rick Macklem wrote:=0A= >> Konstantin Belousov wrote:=0A= >> >On Wed, May 20, 2020 at 11:58:50PM -0700, Ryan Libby wrote:=0A= >> >> On Wed, May 20, 2020 at 6:04 PM Rick Macklem w= rote:=0A= >> >> >=0A= >> >> > Hi,=0A= >> >> >=0A= >> >> > Since I hadn't upgraded a kernel through the winter, it took me a w= hile=0A= >> >> > to bisect this, but r358252 seems to be the culprit.=0A= No longer true. I succeeded in reproducing the hang to-day running a=0A= r358251 kernel.=0A= =0A= I haven't had much luck sofar, but see below for what I have learned.=0A= =0A= >> >> >=0A= >> >> > If I do a kernel build over NFS using my not so big Pentium 4 (sing= le core,=0A= >> >> > 1.25Gbytes RAM, i386), about every second attempt will hang.=0A= >> >> > When I do a "ps" in the debugger, I see processes sleeping on btall= oc.=0A= >> >> > If I revert to r358251, I cannot reproduce this.=0A= As above, this is no longer true.=0A= =0A= >> >> >=0A= >> >> > Any ideas?=0A= >> >> >=0A= >> >> > I can easily test any change you might suggest to see if it fixes t= he=0A= >> >> > problem.=0A= >> >> >=0A= >> >> > If you want more debug info, let me know, since I can easily=0A= >> >> > reproduce it.=0A= >> >> >=0A= >> >> > Thanks, rick=0A= >> >>=0A= >> >> Nothing obvious to me. I can maybe try a repro on a VM...=0A= >> >>=0A= >> >> ddb ps, acttrace, alltrace, show all vmem, show page would be welcome= .=0A= >> >>=0A= >> >> "btalloc" is "We're either out of address space or lost a fill race."= =0A= >From what I see, I think it is "out of address space".=0A= For one of the hangs, when I did "show alllocks", everything except the=0A= intr thread, was waiting for the=0A= exclusive sx lock @ vm/vm_map.c:4761=0A= =0A= >> >=0A= >> >Yes, I would be not surprised to be out of something on 1G i386 machine= .=0A= >> >Please also add 'show alllocks'.=0A= >> Ok, I used an up to date head kernel and it took longer to reproduce a h= ang.=0A= Go down to Kostik's comment about kern.maxvnodes for the rest of what I've= =0A= learned. (The time it takes to reproduce one of these varies greatly, but I= usually=0A= get one within 3 cycles of a full kernel build over NFS. I have had it happ= en=0A= once when doing a kernel build over UFS.)=0A= =0A= >> This time, none of the processes are stuck on "btalloc".=0A= > I'll try and give you most of the above, but since I have to type it in b= y hand=0A= > from the screen, I might not get it all. (I'm no real typist;-)=0A= > > show alllocks=0A= > exclusive lockmgr ufs (ufs) r =3D 0 locked @ kern/vfs_subr.c: 3259=0A= > exclusive lockmgr nfs (nfs) r =3D 0 locked @ kern/vfs_lookup.c:737=0A= > exclusive sleep mutex kernel area domain (kernel arena domain) r =3D 0 lo= cked @ kern/subr_vmem.c:1343=0A= > exclusive lockmgr bufwait (bufwait) r =3D 0 locked @ kern/vfs_bio.c:1663= =0A= > exclusive lockmgr ufs (ufs) r =3D 0 locked @ kern/vfs_subr.c:2930=0A= > exclusive lockmgr syncer (syncer) r =3D 0 locked @ kern/vfs_subr.c:2474= =0A= > Process 12 (intr) thread 0x.. (1000008)=0A= > exclusive sleep mutex Giant (Giant) r =3D 0 locked @ kern/kern_intr.c:115= 2=0A= >=0A= > > ps=0A= > - Not going to list them all, but here are the ones that seem interesting= ...=0A= > 18 0 0 0 DL vlruwt 0x11d939cc [vnlru]=0A= > 16 0 0 0 DL (threaded) [bufdaemon]=0A= > 100069 D qsleep [bufdaemon]=0A= > 100074 D - [bufspacedaemon-0]=0A= > 100084 D sdflush 0x11923284 [/ worker]=0A= > - and more of these for the other UFS file systems=0A= > 9 0 0 0 DL psleep 0x1e2f830 [vmdaemon]=0A= > 8 0 0 0 DL (threaded) [pagedaemon]=0A= > 100067 D psleep 0x1e2e95c [dom0]=0A= > 100072 D launds 0x1e2e968 [laundry: dom0]=0A= > 100073 D umarcl 0x12cc720 [uma]=0A= > =85 a bunch of usb and cam ones=0A= > 100025 D - 0x1b2ee40 [doneq0]=0A= > =85=0A= > 12 0 0 0 RL (threaded) [intr]=0A= > 100007 I [swi6: task queue]=0A= > 100008 Run CPU 0 [swi6: Giant taskq]=0A= > =85=0A= > 100000 D swapin 0x1d96dfc [swapper]=0A= > - and a bunch more in D state.=0A= > Does this mean the swapper was trying to swap in?=0A= >=0A= > > acttrace=0A= > - just shows the keyboard=0A= > kdb_enter() at kdb_enter+0x35/frame=0A= > vt_kbdevent() at vt_kdbevent+0x329/frame=0A= > kdbmux_intr() at kbdmux_intr+0x19/frame=0A= > taskqueue_run_locked() at taskqueue_run_locked+0x175/frame=0A= > taskqueue_run() at taskqueue_run+0x44/frame=0A= > taskqueue_swi_giant_run(0) at taskqueue_swi_giant_run+0xe/frame=0A= > ithread_loop() at ithread_loop+0x237/frame=0A= > fork_exit() at fork_exit+0x6c/frame=0A= > fork_trampoline() at 0x../frame=0A= >=0A= > > show all vmem=0A= > vmem 0x.. 'transient arena'=0A= > quantum: 4096=0A= > size: 23592960=0A= > inuse: 0=0A= > free: 23592960=0A= > busy tags: 0=0A= > free tags: 2=0A= > inuse size free size=0A= > 16777216 0 0 1 23592960=0A= > vmem 0x.. 'buffer arena'=0A= > quantum: 4096=0A= > size: 94683136=0A= > inuse: 94502912=0A= > free: 180224=0A= > busy tags: 1463=0A= > free tags: 3=0A= > inuse size free size=0A= > 16384 2 32768 1 16384=0A= > 32768 39 1277952 1 32768=0A= > 65536 1422 93192192 0 0=0A= > 131072 0 0 1 131072=0A= > vmem 0x.. 'i386trampoline'=0A= > quantum: 1=0A= > size: 24576=0A= > inuse: 20860=0A= > free: 3716=0A= > busy tags: 9=0A= > free tags: 3=0A= > inuse size free size=0A= > 32 1 48 1 52=0A= > 64 2 208 0 0=0A= > 128 2 280 0 0=0A= > 2048 1 2048 1 3664=0A= > 4096 2 8192 0 0=0A= > 8192 1 10084 0 0=0A= > vmem 0x.. 'kernel rwx arena'=0A= > quantum: 4096=0A= > size: 0=0A= > inuse: 0=0A= > free: 0=0A= > busy tags: 0=0A= > free tags: 0=0A= > vmem 0x.. 'kernel area dom'=0A= > quantum: 4096=0A= > size: 56623104=0A= > inuse: 56582144=0A= >> free: 40960=0A= >> busy tags: 11224=0A= >> free tags: 3=0A= >I think this is the trouble.=0A= >=0A= >Did you tried to reduce kern.maxvnodes ? What is the default value for=0A= >the knob on your machine ?=0A= The default is 84342.=0A= I have tried 64K, 32K and 128K and they all hung sooner or later.=0A= For the 32K case, I did see vnodes being recycled for a while before it got= hung,=0A= so it isn't just when it hits the limit.=0A= =0A= Although it is much easier for me to reproduce on an NFS mount, I did see= =0A= a hang while doing a kernel build on UFS (no NFS mount on the machine at=0A= that time).=0A= =0A= So, I now know that the problem pre-dates r358252 and is not NFS specific.= =0A= =0A= I'm not bisecting back further to try and isolate the commit that causes th= is.=0A= (Unfortunately, each test cycle can take days. I now know that I have to do= =0A= several of these kernel builds, which take hours each, to see if a hang is = going=0A= to happen.)=0A= =0A= I'll post if/when I have more, rick=0A= =0A= We scaled maxvnodes for ZFS and UFS, might be NFS is even more demanding,= =0A= having larger node size.=0A= =0A= > inuse size free size=0A= > 4096 11091 45428736 0 0=0A= > 8192 63 516096 0 0=0A= > 16384 12 196608 0 0=0A= > 32768 6 196608 0 0=0A= > 40960 2 81920 1 40960=0A= > 65536 16 1048576 0 0=0A= > 94208 1 94208 0 0=0A= > 110592 1 110592 0 0=0A= > 131072 15 2441216 0 0=0A= > 262144 15 3997696 0 0=0A= > 524288 1 524288 0 0=0A= > 1048576 1 1945600 0 0=0A= > vmem 0x.. 'kernel arena'=0A= > quantum: 4096=0A= > size: 390070272=0A= > inuse: 386613248=0A= > free: 3457024=0A= > busy tags: 873=0A= > free tags: 3=0A= > inuse size free size=0A= > 4096 35 143360 1 4096=0A= > 8192 2 16384 2 16384=0A= > 12288 1 12288 0 0=0A= > 16384 30 491520 0 0=0A= > 20480 140 2867200 0 0=0A= > 65536 1 65536 0 0=0A= > 131072 631 82706432 0 0=0A= > 1048576 0 0 1 1339392=0A= > 2097152 27 56623104 1 2097152=0A= > 8388608 1 13774848 0 0=0A= > 16777216 3 74883072 0 0=0A= > 33554432 1 36753408 0 0=0A= > 67108864 1 118276096 0 0=0A= >=0A= > > alltrace=0A= > - I can't face typing too much more, but I'll put a few=0A= > here that look interesting=0A= >=0A= > - for csh=0A= > sched_switch()=0A= > mi_switch()=0A= > kern_yield()=0A= > getblkx()=0A= > breadn_flags()=0A= > ffs_update()=0A= > ufs_inactive()=0A= > VOP_INACTIVE()=0A= > vinactivef()=0A= > vput_final()=0A= > vm_object_deallocate()=0A= > vm_map_process_deferred()=0A= > kern_munmap()=0A= > sys_munmap()=0A= >=0A= > - For cc=0A= > sched_switch()=0A= > mi_switch()=0A= > sleepq_switch()=0A= > sleepq_timedwait()=0A= > _sleep()=0A= > pause_sbt()=0A= > vmem_bt_alloc()=0A= > keg_alloc_slab()=0A= > zone_import()=0A= > cache_alloc()=0A= > cache_alloc_retry()=0A= > uma_zalloc_arg()=0A= > bt_fill()=0A= > vmem_xalloc()=0A= > vmem_alloc()=0A= > kmem_alloc()=0A= > kmem_malloc_domainset()=0A= > page_alloc()=0A= > keg_alloc_slab()=0A= > zone_import()=0A= > cache_alloc()=0A= > cache_alloc_retry()=0A= > uma_zalloc_arg()=0A= > nfscl_nget()=0A= > nfs_create()=0A= > vop_sigdefer()=0A= > nfs_vnodeops_bypass()=0A= > VOP_CREATE_APV()=0A= > vn_open_cred()=0A= > vn_open()=0A= > kern_openat()=0A= > sys_openat()=0A= >=0A= > Then there are a bunch of these... for cc, make=0A= > sched_switch()=0A= > mi_switch()=0A= > sleepq_switch()=0A= > sleepq_catch_signals()=0A= > sleepq_wait_sig()=0A= > kern_wait6()=0A= > sys_wait4()=0A= >=0A= > - for vnlru=0A= > sched_switch()=0A= > mi_switch()=0A= > sleepq_switch()=0A= > sleepq_timedwait()=0A= > _sleep()=0A= > vnlru_proc()=0A= > fork_exit()=0A= > fork_trampoline()=0A= >=0A= > - for syncer=0A= > sched_switch()=0A= > mi_switch()=0A= > critical_exit_preempt()=0A= > intr_event_handle()=0A= > intr_execute_handlers()=0A= > lapic_handle_intr()=0A= > Xapic_isr1()=0A= > - interrupt=0A= > memset()=0A= > cache_alloc()=0A= > cache_alloc_retry()=0A= > uma_zalloc_arg()=0A= > vmem_xalloc()=0A= > vmem_bt_alloc()=0A= > keg_alloc_slab()=0A= > zone_import()=0A= > cache_alloc()=0A= > cache_alloc_retry()=0A= > uma_zalloc_arg()=0A= > bt_fill()=0A= > vmem_xalloc()=0A= > vmem_alloc()=0A= > bufkva_alloc()=0A= > getnewbuf()=0A= > getblkx()=0A= > breadn_flags()=0A= > ffs_update()=0A= > ffs_sync()=0A= > sync_fsync()=0A= > VOP_FSYNC_APV()=0A= > sched_sync()=0A= > fork_exit()=0A= > fork_trampoline()=0A= >=0A= > - For bufdaemon (a bunch of these)=0A= > sched_switch()=0A= > mi_switch()=0A= > sleepq_switch()=0A= > sleepq_timedwait()=0A= > _sleep()=0A= > buf_daemon()=0A= > fork_exit()=0A= > fork_trampoline()=0A= >=0A= > vmdaemon and pagedaemon are basically just like above,=0A= > sleeping in=0A= > vm_daemon()=0A= > or=0A= > vm_pageout_worker()=0A= > or=0A= > vm_pageout_laundry_worker()=0A= > or=0A= > uma_reclaim_worker()=0A= >=0A= > That's all the typing I can take right now.=0A= > I can probably make this happen again if you want more specific stuff.=0A= >=0A= > rick=0A= >=0A= >=0A= >=0A= >=0A= _______________________________________________=0A= freebsd-current@freebsd.org mailing list=0A= https://lists.freebsd.org/mailman/listinfo/freebsd-current=0A= To unsubscribe, send any mail to "freebsd-current-unsubscribe@freebsd.org"= =0A= _______________________________________________=0A= freebsd-current@freebsd.org mailing list=0A= https://lists.freebsd.org/mailman/listinfo/freebsd-current=0A= To unsubscribe, send any mail to "freebsd-current-unsubscribe@freebsd.org"= =0A= _______________________________________________=0A= freebsd-current@freebsd.org mailing list=0A= https://lists.freebsd.org/mailman/listinfo/freebsd-current=0A= To unsubscribe, send any mail to "freebsd-current-unsubscribe@freebsd.org"= =0A= From owner-freebsd-current@freebsd.org Tue Jun 16 01:44:51 2020 Return-Path: Delivered-To: freebsd-current@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id ED35B349B5D for ; Tue, 16 Jun 2020 01:44:51 +0000 (UTC) (envelope-from rlibby@gmail.com) Received: from mail-qt1-f194.google.com (mail-qt1-f194.google.com [209.85.160.194]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "GTS CA 1O1" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 49m9xH0wxfz45vG; Tue, 16 Jun 2020 01:44:50 +0000 (UTC) (envelope-from rlibby@gmail.com) Received: by mail-qt1-f194.google.com with SMTP id w90so14323154qtd.8; Mon, 15 Jun 2020 18:44:50 -0700 (PDT) X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:references:in-reply-to:from:date :message-id:subject:to:cc:content-transfer-encoding; bh=LKt876Y+lx2Jnu0nvYoa7x6goMC5RC0EiCTJ+RfMoYI=; b=Tz9WV04YJv5p3WTNOXsdMcSHu3wPN+rjId9iTBSuY9Ji3lPSKdBnxgY6Ps4i+ZY3kA Ae2lqNIwIWqp4n2t5psYFIfjBEEYQfMQcSnMBWP8Yw3DxuFInRFy0YSNE/HAnqU6hdh0 I91zpjrvpqtG1KBRB6GfMJ8uEfV2wUvf0mOhmoxwfupEl3UFNm+F1sRvU5S2dDeWQfQV HvODlnPFbK3r0mEW7XWhrIpLyrtOqGGtu4WmhVQafSMKFyIdGLdnhyV0l0ARLNXu8/H8 +gGej5O6SpS2FdyAGo1qSzZA8xVmcdOgfY0SEynvmZDHCQydonRpbG7DEToyA2Ws3Q0E zn/Q== X-Gm-Message-State: AOAM530Y1BjWrLkJP6usJJCzkziXwRg+r932ZBcfxGlWnU7EjlefC1rb chJeAM6RrptvU/fbU50MHziIQyNL X-Google-Smtp-Source: ABdhPJzHYgV67IFC0Z83FlO2K9PuW78GfzTU0zCoeczW9avjekpy+wZYdLABaByKyv9ELwWSVSscFg== X-Received: by 2002:ac8:5646:: with SMTP id 6mr18786445qtt.296.1592271889291; Mon, 15 Jun 2020 18:44:49 -0700 (PDT) Received: from mail-qv1-f53.google.com (mail-qv1-f53.google.com. [209.85.219.53]) by smtp.gmail.com with ESMTPSA id c58sm15028962qtd.27.2020.06.15.18.44.49 (version=TLS1_3 cipher=TLS_AES_128_GCM_SHA256 bits=128/128); Mon, 15 Jun 2020 18:44:49 -0700 (PDT) Received: by mail-qv1-f53.google.com with SMTP id dp10so8744066qvb.10; Mon, 15 Jun 2020 18:44:49 -0700 (PDT) X-Received: by 2002:a0c:8d46:: with SMTP id s6mr26541qvb.241.1592271888666; Mon, 15 Jun 2020 18:44:48 -0700 (PDT) MIME-Version: 1.0 References: <20200521101428.GC64045@kib.kiev.ua> <20200523105601.GN64045@kib.kiev.ua> In-Reply-To: From: Ryan Libby Date: Mon, 15 Jun 2020 18:44:37 -0700 X-Gmail-Original-Message-ID: Message-ID: Subject: Re: r358252 causes intermittent hangs where processes are stuck sleeping on btalloc To: Rick Macklem Cc: Konstantin Belousov , Jeff Roberson , "freebsd-current@FreeBSD.org" Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Rspamd-Queue-Id: 49m9xH0wxfz45vG X-Spamd-Bar: -- Authentication-Results: mx1.freebsd.org; dkim=none; dmarc=none; spf=pass (mx1.freebsd.org: domain of rlibby@gmail.com designates 209.85.160.194 as permitted sender) smtp.mailfrom=rlibby@gmail.com X-Spamd-Result: default: False [-2.80 / 15.00]; TO_DN_EQ_ADDR_SOME(0.00)[]; RCVD_VIA_SMTP_AUTH(0.00)[]; RCVD_TLS_ALL(0.00)[]; FROM_HAS_DN(0.00)[]; RCPT_COUNT_THREE(0.00)[4]; TO_DN_SOME(0.00)[]; R_SPF_ALLOW(-0.20)[+ip4:209.85.128.0/17]; MIME_GOOD(-0.10)[text/plain]; DMARC_NA(0.00)[freebsd.org]; ARC_NA(0.00)[]; RWL_MAILSPIKE_GOOD(0.00)[209.85.160.194:from]; NEURAL_HAM_LONG(-0.96)[-0.964]; RCVD_COUNT_THREE(0.00)[4]; TO_MATCH_ENVRCPT_SOME(0.00)[]; NEURAL_HAM_SHORT(-0.85)[-0.849]; RCVD_IN_DNSWL_NONE(0.00)[209.85.160.194:from]; NEURAL_HAM_MEDIUM(-0.99)[-0.991]; FORGED_SENDER(0.30)[rlibby@freebsd.org,rlibby@gmail.com]; R_DKIM_NA(0.00)[]; FREEMAIL_ENVFROM(0.00)[gmail.com]; ASN(0.00)[asn:15169, ipnet:209.85.128.0/17, country:US]; MIME_TRACE(0.00)[0:+]; FROM_NEQ_ENVFROM(0.00)[rlibby@freebsd.org,rlibby@gmail.com]; FREEMAIL_CC(0.00)[gmail.com,freebsd.org] X-BeenThere: freebsd-current@freebsd.org X-Mailman-Version: 2.1.33 Precedence: list List-Id: Discussions about the use of FreeBSD-current List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 16 Jun 2020 01:44:52 -0000 On Mon, Jun 15, 2020 at 5:06 PM Rick Macklem wrote: > > Rick Macklem wrote: > >r358098 will hang fairly easily, in 1-3 cycles of the kernel build over = NFS. > >I thought this was the culprit, since I did 6 cycles of r358097 without = a hang. > >However, I just got a hang with r358097, but it looks rather different. > >The r358097 hang did not have any processes sleeping on btalloc. They > >appeared to be waiting on two different locks in the buffer cache. > >As such, I think it might be a different problem. (I'll admit I should h= ave > >made notes about this one before rebooting, but I was flustrated that > >it happened and rebooted before looking at it mush detail.) > Ok, so I did 10 cycles of the kernel build over NFS for r358096 and never > got a hang. > --> It seems that r358097 is the culprit and r358098 makes it easier > to reproduce. > --> Basically runs out of kernel memory. > > It is not obvious if I can revert these two commits without reverting > other ones, since there were a bunch of vm changes after these. > > I'll take a look, but if you guys have any ideas on how to fix this, plea= se > let me know. > > Thanks, rick Interesting. Could you try re-adding UMA_ZONE_NOFREE to the vmem btag zone to see if that rescues it, on whatever base revision gets you a reliable repro? > > Jeff, to fill you in, I have been getting intermittent hangs on a Pentium= 4 > (single core i386) with 1.25Gbytes ram when doing kernel builds using > head kernels from this winter. (I also saw one when doing a kernel build > on UFS, so they aren't NFS specific, although easier to reproduce that wa= y.) > After a typical hang, there will be a bunch of processes sleeping on "bta= lloc" > and several processes holding the following lock: > exclusive sx lock @ vm/vm_map.c:4761 > - I have seen hangs where that is the only lock held by any process excep= t > the interrupt thread. > - I have also seen processes waiting on the following locks: > kern/subr_vmem.c:1343 > kern/subr_vmem.c:633 > > I can't be absolutely sure r358098 is the culprit, but it seems to make t= he > problem more reproducible. > > If anyone has a patch suggestion, I can test it. > Otherwise, I will continue to test r358097 and earlier, to try and see wh= at hangs > occur. (I've done 8 cycles of testing of r356776 without difficulties, bu= t that > doesn't guarantee it isn't broken.) > > There is a bunch more of the stuff I got for Kostik and Ryan below. > I can do "db" when it is hung, but it is a screen console, so I need to > transcribe the output to email by hand. (ie. If you need something > specific I can do that, but trying to do everything Kostik and Ryan asked > for isn't easy.) > > rick > > > > Konstantin Belousov wrote: > >On Fri, May 22, 2020 at 11:46:26PM +0000, Rick Macklem wrote: > >> Konstantin Belousov wrote: > >> >On Wed, May 20, 2020 at 11:58:50PM -0700, Ryan Libby wrote: > >> >> On Wed, May 20, 2020 at 6:04 PM Rick Macklem = wrote: > >> >> > > >> >> > Hi, > >> >> > > >> >> > Since I hadn't upgraded a kernel through the winter, it took me a= while > >> >> > to bisect this, but r358252 seems to be the culprit. > No longer true. I succeeded in reproducing the hang to-day running a > r358251 kernel. > > I haven't had much luck sofar, but see below for what I have learned. > > >> >> > > >> >> > If I do a kernel build over NFS using my not so big Pentium 4 (si= ngle core, > >> >> > 1.25Gbytes RAM, i386), about every second attempt will hang. > >> >> > When I do a "ps" in the debugger, I see processes sleeping on bta= lloc. > >> >> > If I revert to r358251, I cannot reproduce this. > As above, this is no longer true. > > >> >> > > >> >> > Any ideas? > >> >> > > >> >> > I can easily test any change you might suggest to see if it fixes= the > >> >> > problem. > >> >> > > >> >> > If you want more debug info, let me know, since I can easily > >> >> > reproduce it. > >> >> > > >> >> > Thanks, rick > >> >> > >> >> Nothing obvious to me. I can maybe try a repro on a VM... > >> >> > >> >> ddb ps, acttrace, alltrace, show all vmem, show page would be welco= me. > >> >> > >> >> "btalloc" is "We're either out of address space or lost a fill race= ." > From what I see, I think it is "out of address space". > For one of the hangs, when I did "show alllocks", everything except the > intr thread, was waiting for the > exclusive sx lock @ vm/vm_map.c:4761 > > >> > > >> >Yes, I would be not surprised to be out of something on 1G i386 machi= ne. > >> >Please also add 'show alllocks'. > >> Ok, I used an up to date head kernel and it took longer to reproduce a= hang. > Go down to Kostik's comment about kern.maxvnodes for the rest of what I'v= e > learned. (The time it takes to reproduce one of these varies greatly, but= I usually > get one within 3 cycles of a full kernel build over NFS. I have had it ha= ppen > once when doing a kernel build over UFS.) > > >> This time, none of the processes are stuck on "btalloc". > > I'll try and give you most of the above, but since I have to type it in= by hand > > from the screen, I might not get it all. (I'm no real typist;-) > > > show alllocks > > exclusive lockmgr ufs (ufs) r =3D 0 locked @ kern/vfs_subr.c: 3259 > > exclusive lockmgr nfs (nfs) r =3D 0 locked @ kern/vfs_lookup.c:737 > > exclusive sleep mutex kernel area domain (kernel arena domain) r =3D 0 = locked @ kern/subr_vmem.c:1343 > > exclusive lockmgr bufwait (bufwait) r =3D 0 locked @ kern/vfs_bio.c:166= 3 > > exclusive lockmgr ufs (ufs) r =3D 0 locked @ kern/vfs_subr.c:2930 > > exclusive lockmgr syncer (syncer) r =3D 0 locked @ kern/vfs_subr.c:2474 > > Process 12 (intr) thread 0x.. (1000008) > > exclusive sleep mutex Giant (Giant) r =3D 0 locked @ kern/kern_intr.c:1= 152 > > > > > ps > > - Not going to list them all, but here are the ones that seem interesti= ng... > > 18 0 0 0 DL vlruwt 0x11d939cc [vnlru] > > 16 0 0 0 DL (threaded) [bufdaemon] > > 100069 D qsleep [bufdaemon] > > 100074 D - [bufspacedaemon-0] > > 100084 D sdflush 0x11923284 [/ worker] > > - and more of these for the other UFS file systems > > 9 0 0 0 DL psleep 0x1e2f830 [vmdaemon] > > 8 0 0 0 DL (threaded) [pagedaemon] > > 100067 D psleep 0x1e2e95c [dom0] > > 100072 D launds 0x1e2e968 [laundry: dom0] > > 100073 D umarcl 0x12cc720 [uma] > > =E2=80=A6 a bunch of usb and cam ones > > 100025 D - 0x1b2ee40 [doneq0] > > =E2=80=A6 > > 12 0 0 0 RL (threaded) [intr] > > 100007 I [swi6: task queue] > > 100008 Run CPU 0 [swi6: Giant taskq] > > =E2=80=A6 > > 100000 D swapin 0x1d96dfc [swapper] > > - and a bunch more in D state. > > Does this mean the swapper was trying to swap in? > > > > > acttrace > > - just shows the keyboard > > kdb_enter() at kdb_enter+0x35/frame > > vt_kbdevent() at vt_kdbevent+0x329/frame > > kdbmux_intr() at kbdmux_intr+0x19/frame > > taskqueue_run_locked() at taskqueue_run_locked+0x175/frame > > taskqueue_run() at taskqueue_run+0x44/frame > > taskqueue_swi_giant_run(0) at taskqueue_swi_giant_run+0xe/frame > > ithread_loop() at ithread_loop+0x237/frame > > fork_exit() at fork_exit+0x6c/frame > > fork_trampoline() at 0x../frame > > > > > show all vmem > > vmem 0x.. 'transient arena' > > quantum: 4096 > > size: 23592960 > > inuse: 0 > > free: 23592960 > > busy tags: 0 > > free tags: 2 > > inuse size free size > > 16777216 0 0 1 23592960 > > vmem 0x.. 'buffer arena' > > quantum: 4096 > > size: 94683136 > > inuse: 94502912 > > free: 180224 > > busy tags: 1463 > > free tags: 3 > > inuse size free size > > 16384 2 32768 1 16384 > > 32768 39 1277952 1 32768 > > 65536 1422 93192192 0 0 > > 131072 0 0 1 131072 > > vmem 0x.. 'i386trampoline' > > quantum: 1 > > size: 24576 > > inuse: 20860 > > free: 3716 > > busy tags: 9 > > free tags: 3 > > inuse size free size > > 32 1 48 1 52 > > 64 2 208 0 0 > > 128 2 280 0 0 > > 2048 1 2048 1 3664 > > 4096 2 8192 0 0 > > 8192 1 10084 0 0 > > vmem 0x.. 'kernel rwx arena' > > quantum: 4096 > > size: 0 > > inuse: 0 > > free: 0 > > busy tags: 0 > > free tags: 0 > > vmem 0x.. 'kernel area dom' > > quantum: 4096 > > size: 56623104 > > inuse: 56582144 > >> free: 40960 > >> busy tags: 11224 > >> free tags: 3 > >I think this is the trouble. > > > >Did you tried to reduce kern.maxvnodes ? What is the default value for > >the knob on your machine ? > The default is 84342. > I have tried 64K, 32K and 128K and they all hung sooner or later. > For the 32K case, I did see vnodes being recycled for a while before it g= ot hung, > so it isn't just when it hits the limit. > > Although it is much easier for me to reproduce on an NFS mount, I did see > a hang while doing a kernel build on UFS (no NFS mount on the machine at > that time). > > So, I now know that the problem pre-dates r358252 and is not NFS specific= . > > I'm not bisecting back further to try and isolate the commit that causes = this. > (Unfortunately, each test cycle can take days. I now know that I have to = do > several of these kernel builds, which take hours each, to see if a hang i= s going > to happen.) > > I'll post if/when I have more, rick > > We scaled maxvnodes for ZFS and UFS, might be NFS is even more demanding, > having larger node size. > > > inuse size free size > > 4096 11091 45428736 0 0 > > 8192 63 516096 0 0 > > 16384 12 196608 0 0 > > 32768 6 196608 0 0 > > 40960 2 81920 1 40960 > > 65536 16 1048576 0 0 > > 94208 1 94208 0 0 > > 110592 1 110592 0 0 > > 131072 15 2441216 0 0 > > 262144 15 3997696 0 0 > > 524288 1 524288 0 0 > > 1048576 1 1945600 0 0 > > vmem 0x.. 'kernel arena' > > quantum: 4096 > > size: 390070272 > > inuse: 386613248 > > free: 3457024 > > busy tags: 873 > > free tags: 3 > > inuse size free size > > 4096 35 143360 1 4096 > > 8192 2 16384 2 16384 > > 12288 1 12288 0 0 > > 16384 30 491520 0 0 > > 20480 140 2867200 0 0 > > 65536 1 65536 0 0 > > 131072 631 82706432 0 0 > > 1048576 0 0 1 1339392 > > 2097152 27 56623104 1 2097152 > > 8388608 1 13774848 0 0 > > 16777216 3 74883072 0 0 > > 33554432 1 36753408 0 0 > > 67108864 1 118276096 0 0 > > > > > alltrace > > - I can't face typing too much more, but I'll put a few > > here that look interesting > > > > - for csh > > sched_switch() > > mi_switch() > > kern_yield() > > getblkx() > > breadn_flags() > > ffs_update() > > ufs_inactive() > > VOP_INACTIVE() > > vinactivef() > > vput_final() > > vm_object_deallocate() > > vm_map_process_deferred() > > kern_munmap() > > sys_munmap() > > > > - For cc > > sched_switch() > > mi_switch() > > sleepq_switch() > > sleepq_timedwait() > > _sleep() > > pause_sbt() > > vmem_bt_alloc() > > keg_alloc_slab() > > zone_import() > > cache_alloc() > > cache_alloc_retry() > > uma_zalloc_arg() > > bt_fill() > > vmem_xalloc() > > vmem_alloc() > > kmem_alloc() > > kmem_malloc_domainset() > > page_alloc() > > keg_alloc_slab() > > zone_import() > > cache_alloc() > > cache_alloc_retry() > > uma_zalloc_arg() > > nfscl_nget() > > nfs_create() > > vop_sigdefer() > > nfs_vnodeops_bypass() > > VOP_CREATE_APV() > > vn_open_cred() > > vn_open() > > kern_openat() > > sys_openat() > > > > Then there are a bunch of these... for cc, make > > sched_switch() > > mi_switch() > > sleepq_switch() > > sleepq_catch_signals() > > sleepq_wait_sig() > > kern_wait6() > > sys_wait4() > > > > - for vnlru > > sched_switch() > > mi_switch() > > sleepq_switch() > > sleepq_timedwait() > > _sleep() > > vnlru_proc() > > fork_exit() > > fork_trampoline() > > > > - for syncer > > sched_switch() > > mi_switch() > > critical_exit_preempt() > > intr_event_handle() > > intr_execute_handlers() > > lapic_handle_intr() > > Xapic_isr1() > > - interrupt > > memset() > > cache_alloc() > > cache_alloc_retry() > > uma_zalloc_arg() > > vmem_xalloc() > > vmem_bt_alloc() > > keg_alloc_slab() > > zone_import() > > cache_alloc() > > cache_alloc_retry() > > uma_zalloc_arg() > > bt_fill() > > vmem_xalloc() > > vmem_alloc() > > bufkva_alloc() > > getnewbuf() > > getblkx() > > breadn_flags() > > ffs_update() > > ffs_sync() > > sync_fsync() > > VOP_FSYNC_APV() > > sched_sync() > > fork_exit() > > fork_trampoline() > > > > - For bufdaemon (a bunch of these) > > sched_switch() > > mi_switch() > > sleepq_switch() > > sleepq_timedwait() > > _sleep() > > buf_daemon() > > fork_exit() > > fork_trampoline() > > > > vmdaemon and pagedaemon are basically just like above, > > sleeping in > > vm_daemon() > > or > > vm_pageout_worker() > > or > > vm_pageout_laundry_worker() > > or > > uma_reclaim_worker() > > > > That's all the typing I can take right now. > > I can probably make this happen again if you want more specific stuff. > > > > rick > > > > > > > > > _______________________________________________ > freebsd-current@freebsd.org mailing list > https://lists.freebsd.org/mailman/listinfo/freebsd-current > To unsubscribe, send any mail to "freebsd-current-unsubscribe@freebsd.org= " > _______________________________________________ > freebsd-current@freebsd.org mailing list > https://lists.freebsd.org/mailman/listinfo/freebsd-current > To unsubscribe, send any mail to "freebsd-current-unsubscribe@freebsd.org= " > _______________________________________________ > freebsd-current@freebsd.org mailing list > https://lists.freebsd.org/mailman/listinfo/freebsd-current > To unsubscribe, send any mail to "freebsd-current-unsubscribe@freebsd.org= " From owner-freebsd-current@freebsd.org Tue Jun 16 06:59:29 2020 Return-Path: Delivered-To: freebsd-current@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id B953232A992 for ; Tue, 16 Jun 2020 06:59:29 +0000 (UTC) (envelope-from rajfbsd@gmail.com) Received: from mail-wm1-x329.google.com (mail-wm1-x329.google.com [IPv6:2a00:1450:4864:20::329]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "GTS CA 1O1" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 49mJwK00Zhz4Prn for ; Tue, 16 Jun 2020 06:59:28 +0000 (UTC) (envelope-from rajfbsd@gmail.com) Received: by mail-wm1-x329.google.com with SMTP id r9so1766031wmh.2 for ; Mon, 15 Jun 2020 23:59:28 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=mime-version:from:date:message-id:subject:to; bh=TUehnlcSuTvhSAbTYf3uuzXjWqJWPl22I5q8EwQJTt8=; b=nYwIri6KrlAMW9tqlxUfsywS5RJFRm8XGn77v6V3ETMRYXbB7yFDMUhQJyHjhGoVng tYUWJTkCcAbe3UD76DCkLdy1aq3I7ianBAhSc6OPBVupm/krBxGliuXL/pihV81tCzRx f8ZoCXamN2pTYEbbGEDvTWYpHqcJbCVHfkfuy6gqCi0LxVOpvNjH6/ITNcwXw7uMKIzJ t3U2YYFlAVhO/dMwAAPsRP0JQNdg2kUUsbxKQBVLX8n7auXfqS0/4wbAGGBngcS1vWqG YWTZ48B7LV3OPFlKzMNABV6cP9PIEJqQwdQPlVVVt3jypPCAoJKa+kZ+y7lmX/OZBgqf S6Og== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:from:date:message-id:subject:to; bh=TUehnlcSuTvhSAbTYf3uuzXjWqJWPl22I5q8EwQJTt8=; b=HSCe8G0d/4XCDw2tmyU44bk/TLG6lKA7NwwPotGxJAYK0nN+OJux353g8GlsTVT3cy KDpxCEKJin5Fgw5HdAbkKJvuk69of/CNjxGrRAuqK9zosWx8J5MZgw2dBo+Bku8cQWxS O8szCYYNfiJKhHU0bcG6DjAhXW0a6gqGoE42aQWfE+P2sZllw6VBnQ9ks57V3iPngH8b d4FYqcJiz3UU1RTBJ+Ox3Mpd8s2/HGgyTHr1tEkXitzz56jKr2a4VfthRhsgvrB4nnJP 8jLBphD2uqGGgUUe9AeHMRYT3z853xmBTTVdGs6o4A6YiUg7EPjad+CZy4hWkkkKmqVH BtLA== X-Gm-Message-State: AOAM532+8VtVsmBIxEWANoxXfGV6En8xw3GvStp87rjy2j+8CotYOx+K wEY7ddl49VfRf4f0r7jm0/l7JeI/AduEWmb2GDINocgI X-Google-Smtp-Source: ABdhPJwcjxWZVY+3aAACARc02Bv0f6vwxho9W56vvP/hxq1ZHIg4zsukPIhy0d89KRW2p3ALqkPEbORsj7PPAWUlwek= X-Received: by 2002:a1c:9d96:: with SMTP id g144mr1578751wme.126.1592290766112; Mon, 15 Jun 2020 23:59:26 -0700 (PDT) MIME-Version: 1.0 From: Rajesh Kumar Date: Tue, 16 Jun 2020 12:29:14 +0530 Message-ID: Subject: Building modules gives error: "invalid output constraint '=@cce' in asm" To: freebsd-current@freebsd.org X-Rspamd-Queue-Id: 49mJwK00Zhz4Prn X-Spamd-Bar: --- Authentication-Results: mx1.freebsd.org; dkim=pass header.d=gmail.com header.s=20161025 header.b=nYwIri6K; dmarc=pass (policy=none) header.from=gmail.com; spf=pass (mx1.freebsd.org: domain of rajfbsd@gmail.com designates 2a00:1450:4864:20::329 as permitted sender) smtp.mailfrom=rajfbsd@gmail.com X-Spamd-Result: default: False [-3.02 / 15.00]; ARC_NA(0.00)[]; NEURAL_HAM_MEDIUM(-0.97)[-0.969]; R_DKIM_ALLOW(-0.20)[gmail.com:s=20161025]; FROM_HAS_DN(0.00)[]; FREEMAIL_FROM(0.00)[gmail.com]; TO_MATCH_ENVRCPT_ALL(0.00)[]; MIME_GOOD(-0.10)[multipart/alternative,text/plain]; PREVIOUSLY_DELIVERED(0.00)[freebsd-current@freebsd.org]; TO_DN_NONE(0.00)[]; RCPT_COUNT_ONE(0.00)[1]; NEURAL_HAM_LONG(-1.01)[-1.009]; R_SPF_ALLOW(-0.20)[+ip6:2a00:1450:4000::/36]; DKIM_TRACE(0.00)[gmail.com:+]; DMARC_POLICY_ALLOW(-0.50)[gmail.com,none]; RCVD_IN_DNSWL_NONE(0.00)[2a00:1450:4864:20::329:from]; NEURAL_HAM_SHORT(-0.04)[-0.041]; FROM_EQ_ENVFROM(0.00)[]; MIME_TRACE(0.00)[0:+,1:+,2:~]; FREEMAIL_ENVFROM(0.00)[gmail.com]; ASN(0.00)[asn:15169, ipnet:2a00:1450::/32, country:US]; RCVD_COUNT_TWO(0.00)[2]; RCVD_TLS_ALL(0.00)[]; DWL_DNSWL_NONE(0.00)[gmail.com:dkim] Content-Type: text/plain; charset="UTF-8" X-Content-Filtered-By: Mailman/MimeDel 2.1.33 X-BeenThere: freebsd-current@freebsd.org X-Mailman-Version: 2.1.33 Precedence: list List-Id: Discussions about the use of FreeBSD-current List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 16 Jun 2020 06:59:29 -0000 Hi, I am trying to build my module with freebsd current branch. But I am facing compilation issue with header files as below. I have built and installed the freebsd current branch and booted to that kernel before building my module. So, not sure what is going wrong. *In file included from /root//freebsd_current/sys/sys/systm.h:44:./machine/atomic.h:230:1: error: invalid output constraint '=@cce' in asmATOMIC_CMPSET(char);^./machine/atomic.h:205:4: note: expanded from macro 'ATOMIC_CMPSET' : "=@cce" (res), /* 0 */ \* Am I missing something? Thanks, Rajesh. From owner-freebsd-current@freebsd.org Tue Jun 16 08:57:28 2020 Return-Path: Delivered-To: freebsd-current@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id E441132E276 for ; Tue, 16 Jun 2020 08:57:28 +0000 (UTC) (envelope-from kib@freebsd.org) Received: from kib.kiev.ua (kib.kiev.ua [IPv6:2001:470:d5e7:1::1]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 49mMXS34Xhz4Y06 for ; Tue, 16 Jun 2020 08:57:28 +0000 (UTC) (envelope-from kib@freebsd.org) Received: from tom.home (kib@localhost [127.0.0.1]) by kib.kiev.ua (8.15.2/8.15.2) with ESMTPS id 05G8vKjI073851 (version=TLSv1.3 cipher=TLS_AES_256_GCM_SHA384 bits=256 verify=NO); Tue, 16 Jun 2020 11:57:23 +0300 (EEST) (envelope-from kib@freebsd.org) DKIM-Filter: OpenDKIM Filter v2.10.3 kib.kiev.ua 05G8vKjI073851 Received: (from kostik@localhost) by tom.home (8.15.2/8.15.2/Submit) id 05G8vK0v073850; Tue, 16 Jun 2020 11:57:20 +0300 (EEST) (envelope-from kib@freebsd.org) X-Authentication-Warning: tom.home: kostik set sender to kib@freebsd.org using -f Date: Tue, 16 Jun 2020 11:57:20 +0300 From: Konstantin Belousov To: Rajesh Kumar Cc: freebsd-current@freebsd.org Subject: Re: Building modules gives error: "invalid output constraint '=@cce' in asm" Message-ID: <20200616085720.GC45690@kib.kiev.ua> References: MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: X-Spam-Status: No, score=-2.9 required=5.0 tests=ALL_TRUSTED,BAYES_00 autolearn=ham autolearn_force=no version=3.4.4 X-Spam-Checker-Version: SpamAssassin 3.4.4 (2020-01-24) on tom.home X-Rspamd-Queue-Id: 49mMXS34Xhz4Y06 X-Spamd-Bar: / Authentication-Results: mx1.freebsd.org; none X-Spamd-Result: default: False [0.00 / 15.00]; local_wl_from(0.00)[freebsd.org]; ASN(0.00)[asn:6939, ipnet:2001:470::/32, country:US] X-BeenThere: freebsd-current@freebsd.org X-Mailman-Version: 2.1.33 Precedence: list List-Id: Discussions about the use of FreeBSD-current List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 16 Jun 2020 08:57:29 -0000 On Tue, Jun 16, 2020 at 12:29:14PM +0530, Rajesh Kumar wrote: > Hi, > > I am trying to build my module with freebsd current branch. But I am > facing compilation issue with header files as below. I have built and > installed the freebsd current branch and booted to that kernel before > building my module. So, not sure what is going wrong. > > *In file included from > /root//freebsd_current/sys/sys/systm.h:44:./machine/atomic.h:230:1: error: > invalid output constraint '=@cce' in > asmATOMIC_CMPSET(char);^./machine/atomic.h:205:4: note: expanded from macro > 'ATOMIC_CMPSET' : "=@cce" (res), /* 0 */ \* > > Am I missing something? Your compiler is too old. You must either build on current, use buildworld/buildkernel method. From owner-freebsd-current@freebsd.org Tue Jun 16 11:17:56 2020 Return-Path: Delivered-To: freebsd-current@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id E049933275B for ; Tue, 16 Jun 2020 11:17:56 +0000 (UTC) (envelope-from miguelmclara@gmail.com) Received: from mail-pl1-x62f.google.com (mail-pl1-x62f.google.com [IPv6:2607:f8b0:4864:20::62f]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "GTS CA 1O1" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 49mQfX1XZjz3T0y for ; Tue, 16 Jun 2020 11:17:55 +0000 (UTC) (envelope-from miguelmclara@gmail.com) Received: by mail-pl1-x62f.google.com with SMTP id x11so2843732plo.7 for ; Tue, 16 Jun 2020 04:17:55 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=mime-version:from:date:message-id:subject:to; bh=PUsWjhMAEgFO4FEN1pbMwFfl4MkvHu1t4JrvZFPZTRM=; b=adlxq3dEDJXCXa9CAwPY1Gk/EpElg5hYTX7WYLcowfkSJUfu9FCuHvTfnD+0SyiIx9 bMC/XrR1qG22I3TXUE8DkB07J2Hfs3K6MvYo7wxoin6eua/ZiEESn64npqY1oQgdqSVj 7wQ/TRfItVL4tTiGlUCPknpIog4K7kYdhG/RgwHvvlwUpSw2w1G0s4Q4lRgiWJd3Ekgo 9DUyUQaSCefRqVaezNCkPQUSNIw6mYNKLqj5yZgw4EC5KiLmVhnhToRGnkwxB7PhOi8p uSgBeyYBQr4U8NOZQ//RaDKiC3CgAaT+LmYFx4vOzCY59fzqPXbWT8vWKDH+pY613zfa B5Cw== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:from:date:message-id:subject:to; bh=PUsWjhMAEgFO4FEN1pbMwFfl4MkvHu1t4JrvZFPZTRM=; b=VL/WtExDW0Zr7pTl32+htMMqcFkdlYpPJ4IocPq5SrjM4Vinx1SPc4UXabn+Wkh6Bz HTcTbAvr8u0IA5Rsf/9NWcX8i/8HVOi3YVbjlmaYrgKxjraSSGh2tS2mSfm2NXEZxfQ3 fs28+RuEGcNVKPbxX47qJIUZpTN/gcj4KIuxf736prLpkJdqD/tNVFd4bRBBgRiJi4MT +Rf03/Mw0ie95/EsemZYdefT7IJVunMZaHr/lTsEU+W10FX33idbtWlbcNeB63ZzA6+c H8MEwrwk/L3csHMFKTJNRdP8me450K21j4nn9mNzccJDF6SfMLiLED6oiYdR8KLFCApe nYww== X-Gm-Message-State: AOAM5337zwNxkOEHQEF90f+j4BewTuhvFh/he0p6do/1SroveA7oAuTe O9QN+r42DMQGdNM0HMT0nox5p1/w3HfcBsUrruAvJ5S8qUlH1g== X-Google-Smtp-Source: ABdhPJytOy5ZjM2lT4Iu9QbidVtmly4VUHAF5yrXBpq/WzvyAJ4Xmv43/0tLO9igwbYPewayvOXwhsJ7SkIUw5Hy3ds= X-Received: by 2002:a17:90a:4d09:: with SMTP id c9mr2345594pjg.137.1592306274249; Tue, 16 Jun 2020 04:17:54 -0700 (PDT) MIME-Version: 1.0 From: Miguel C Date: Tue, 16 Jun 2020 12:17:18 +0100 Message-ID: Subject: Re: CTF: UEFI HTTP boot support To: freebsd-current@freebsd.org X-Rspamd-Queue-Id: 49mQfX1XZjz3T0y X-Spamd-Bar: - Authentication-Results: mx1.freebsd.org; dkim=pass header.d=gmail.com header.s=20161025 header.b=adlxq3dE; dmarc=pass (policy=none) header.from=gmail.com; spf=pass (mx1.freebsd.org: domain of miguelmclara@gmail.com designates 2607:f8b0:4864:20::62f as permitted sender) smtp.mailfrom=miguelmclara@gmail.com X-Spamd-Result: default: False [-1.57 / 15.00]; ARC_NA(0.00)[]; FAKE_REPLY(1.00)[]; R_DKIM_ALLOW(-0.20)[gmail.com:s=20161025]; NEURAL_HAM_MEDIUM(-0.97)[-0.968]; FROM_HAS_DN(0.00)[]; R_SPF_ALLOW(-0.20)[+ip6:2607:f8b0:4000::/36:c]; FREEMAIL_FROM(0.00)[gmail.com]; MIME_GOOD(-0.10)[multipart/alternative,text/plain]; PREVIOUSLY_DELIVERED(0.00)[freebsd-current@freebsd.org]; TO_DN_NONE(0.00)[]; RCPT_COUNT_ONE(0.00)[1]; NEURAL_HAM_LONG(-1.01)[-1.014]; TO_MATCH_ENVRCPT_ALL(0.00)[]; DKIM_TRACE(0.00)[gmail.com:+]; DMARC_POLICY_ALLOW(-0.50)[gmail.com,none]; RCVD_IN_DNSWL_NONE(0.00)[2607:f8b0:4864:20::62f:from]; NEURAL_SPAM_SHORT(0.41)[0.414]; FROM_EQ_ENVFROM(0.00)[]; MIME_TRACE(0.00)[0:+,1:+,2:~]; FREEMAIL_ENVFROM(0.00)[gmail.com]; ASN(0.00)[asn:15169, ipnet:2607:f8b0::/32, country:US]; RCVD_COUNT_TWO(0.00)[2]; RCVD_TLS_ALL(0.00)[]; DWL_DNSWL_NONE(0.00)[gmail.com:dkim] Content-Type: text/plain; charset="UTF-8" X-Content-Filtered-By: Mailman/MimeDel 2.1.33 X-BeenThere: freebsd-current@freebsd.org X-Mailman-Version: 2.1.33 Precedence: list List-Id: Discussions about the use of FreeBSD-current List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 16 Jun 2020 11:17:57 -0000 I've been trying out FreeBSD with raspberry Pi4 (4GB) and wanted to see what the state of HTTP BOOT is in FreeBSD, so I bumped into this! I'm curious if it should be possible to point to a img/iso directly (I tried to use the img.xz unpacked it and make it available on a local web server and that didn't seem to work for me) but maybe thats cause those images miss something, so arm64 aside does that work for amd64? I.E. using the bootonly.iso? And on the other hand is there any doc on how to set up dhcp/http specific to FreeBSD similar to https://en.opensuse.org/UEFI_HTTPBoot_Server_Setup? I looked into https://www.freebsd.org/doc/handbook/network-diskless.html but that doesn't seem to be up to date (or at least it focuses only on PXE and TFTP). For clarification my ultimate goal is to use a few pi4's as "thin clients", so eventually I will have to setup an image of the system with the needed software (freerdp) but for starters I just wanted to check if pointing directly to a img/iso would work and that does not seem to be the case. Thanks. From owner-freebsd-current@freebsd.org Tue Jun 16 11:36:29 2020 Return-Path: Delivered-To: freebsd-current@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 7213D333999 for ; Tue, 16 Jun 2020 11:36:29 +0000 (UTC) (envelope-from SRS0=MZrarz=75=codenetworks.net=sm@eigbox.net) Received: from mailman.nyi.freebsd.org (mailman.nyi.freebsd.org [IPv6:2610:1c1:1:606c::50:13]) by mx1.freebsd.org (Postfix) with ESMTP id 49mR3x1dhLz3VyK for ; Tue, 16 Jun 2020 11:36:29 +0000 (UTC) (envelope-from SRS0=MZrarz=75=codenetworks.net=sm@eigbox.net) Received: by mailman.nyi.freebsd.org (Postfix) id 38217333B9A; Tue, 16 Jun 2020 11:36:29 +0000 (UTC) Delivered-To: current@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 37E97333C97 for ; Tue, 16 Jun 2020 11:36:29 +0000 (UTC) (envelope-from SRS0=MZrarz=75=codenetworks.net=sm@eigbox.net) Received: from bosmailout09.eigbox.net (bosmailout09.eigbox.net [66.96.187.9]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 49mR3v5m5hz3VlB for ; Tue, 16 Jun 2020 11:36:27 +0000 (UTC) (envelope-from SRS0=MZrarz=75=codenetworks.net=sm@eigbox.net) Received: from bosmailscan03.eigbox.net ([10.20.15.3]) by bosmailout09.eigbox.net with esmtp (Exim) id 1jl9tC-0004Kp-UN for current@freebsd.org; Tue, 16 Jun 2020 07:36:26 -0400 DKIM-Signature: v=1; a=rsa-sha256; q=dns/txt; c=relaxed/relaxed; d=codenetworks.net; s=dkim; h=Sender:Content-Transfer-Encoding:Content-Type: In-Reply-To:MIME-Version:Date:Message-ID:References:To:From:Subject:Reply-To: Cc:Content-ID:Content-Description:Resent-Date:Resent-From:Resent-Sender: Resent-To:Resent-Cc:Resent-Message-ID:List-Id:List-Help:List-Unsubscribe: List-Subscribe:List-Post:List-Owner:List-Archive; bh=60DdzWaHC/lbyeKxIbPBIyFL+IEKprbvs6zQZy/pAww=; b=YBVh/fdrGcBVENK/6VDHg8S3Ae FCW2NlowT4JL6cvueQIk3XueJKfjAYBnNmsf/jBudve+MmkcsQgEDlfokIpEEmf9wq4nNuWCO0jJD 9zAq/cH3pzjdIabCB6pz6yRPgeRtvYTf4DZYZ/A2C5o7AkHYrP6sCy+eNl8eutbpXYFj446VuZ1b8 DXLT2TQbzD/eeYjLfOxYyInEkzHoM5+Hu8zbd8GtX9XpFsFt289Dk+Lxcxq9ZO6/uNMfvF6PxzwUf KkSNo6OttGqeE8Tz1arS5zjwzfNCiSe4wM2239sbe7X/XvUAOltnPHt9NHfydkz9Lrmjgp1Ml5yLb sEn7fpKg==; Received: from [10.115.3.31] (helo=bosimpout11) by bosmailscan03.eigbox.net with esmtp (Exim) id 1jl9t7-0004Pw-NT for current@freebsd.org; Tue, 16 Jun 2020 07:36:21 -0400 Received: from bosauthsmtp07.yourhostingaccount.com ([10.20.18.7]) by bosimpout11 with id rncJ22002099BUA01ncM20; Tue, 16 Jun 2020 07:36:21 -0400 X-Authority-Analysis: v=2.2 cv=RKvDJ8q+ c=1 sm=1 tr=0 a=x8qw8EAkfcRkIpZA8Q87Bg==:117 a=HgejYIwJ78uhX17IQOWm3w==:17 a=IkcTkHD0fZMA:10 a=nTHF0DUjJn0A:10 a=x6SUvDt4rVEA:10 a=6I5d2MoRAAAA:8 a=G3Jz2E4CcLkiMf7YCSYA:9 a=QEXdDO2ut3YA:10 a=IjZwj45LgO3ly-622nXo:22 Received: from cpc96352-rdng26-2-0-cust40.15-3.cable.virginm.net ([86.18.84.41]:6327 helo=[192.168.0.100]) by bosauthsmtp07.eigbox.net with esmtpa (Exim) id 1jl9t4-0001Wf-3Y; Tue, 16 Jun 2020 07:36:18 -0400 Subject: Re: Panic on mlx5en. From: Santiago Martinez To: Hans Petter Selasky , FreeBSD Current References: <1bf2ffc5-386a-c0fa-4cc1-246892da3a38@codenetworks.net> <37677b81-0984-d6f4-9a6d-ebe94957ce47@selasky.org> <5bfad49a-5b74-1947-c6bb-9d9a20f472be@codenetworks.net> <528921f6-ee36-d341-2ceb-6143154827b9@selasky.org> <79d7e3de-fda5-5456-6f79-749d6314a9cb@selasky.org> <09fd8689-ea71-9bd6-25ee-27575bca1842@codenetworks.net> Message-ID: Date: Tue, 16 Jun 2020 12:36:14 +0100 User-Agent: Mozilla/5.0 (X11; FreeBSD amd64; rv:68.0) Gecko/20100101 Thunderbird/68.9.0 MIME-Version: 1.0 In-Reply-To: <09fd8689-ea71-9bd6-25ee-27575bca1842@codenetworks.net> Content-Type: text/plain; charset=utf-8; format=flowed Content-Transfer-Encoding: 8bit Content-Language: en-US X-EN-UserInfo: d3bdfab0736480cedf04ed92aaea2ef5:931c98230c6409dcc37fa7e93b490c27 X-EN-AuthUser: sm@codenetworks.net Sender: Santiago Martinez X-EN-OrigIP: 86.18.84.41 X-EN-OrigHost: cpc96352-rdng26-2-0-cust40.15-3.cable.virginm.net X-Rspamd-Queue-Id: 49mR3v5m5hz3VlB X-Spamd-Bar: -- Authentication-Results: mx1.freebsd.org; dkim=none (invalid DKIM record) header.d=codenetworks.net header.s=dkim header.b=YBVh/fdr; dmarc=none; spf=pass (mx1.freebsd.org: domain of SRS0=MZrarz=75=codenetworks.net=sm@eigbox.net designates 66.96.187.9 as permitted sender) smtp.mailfrom=SRS0=MZrarz=75=codenetworks.net=sm@eigbox.net X-Spamd-Result: default: False [-2.68 / 15.00]; RCVD_VIA_SMTP_AUTH(0.00)[]; ARC_NA(0.00)[]; RCVD_COUNT_FIVE(0.00)[5]; NEURAL_HAM_MEDIUM(-1.03)[-1.034]; FROM_HAS_DN(0.00)[]; R_SPF_ALLOW(-0.20)[+ip4:66.96.128.0/18]; NEURAL_HAM_LONG(-0.99)[-0.988]; MIME_GOOD(-0.10)[text/plain]; DMARC_NA(0.00)[codenetworks.net: no valid DMARC record]; TO_MATCH_ENVRCPT_SOME(0.00)[]; TO_DN_ALL(0.00)[]; DKIM_TRACE(0.00)[codenetworks.net:~]; RCPT_COUNT_TWO(0.00)[2]; RCVD_IN_DNSWL_NONE(0.00)[66.96.187.9:from]; NEURAL_HAM_SHORT(-0.66)[-0.658]; R_DKIM_PERMFAIL(0.00)[codenetworks.net:s=dkim]; FORGED_SENDER(0.30)[sm@codenetworks.net,SRS0=MZrarz=75=codenetworks.net=sm@eigbox.net]; RWL_MAILSPIKE_POSSIBLE(0.00)[66.96.187.9:from]; MIME_TRACE(0.00)[0:+]; RCVD_TLS_LAST(0.00)[]; ASN(0.00)[asn:29873, ipnet:66.96.128.0/18, country:US]; FROM_NEQ_ENVFROM(0.00)[sm@codenetworks.net,SRS0=MZrarz=75=codenetworks.net=sm@eigbox.net]; MID_RHS_MATCH_FROM(0.00)[] X-BeenThere: freebsd-current@freebsd.org X-Mailman-Version: 2.1.33 Precedence: list List-Id: Discussions about the use of FreeBSD-current List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 16 Jun 2020 11:36:29 -0000 Hi Hans Petter, I did sync to r362201 and it works great! no more panics. FreeBSD lenovo01 13.0-CURRENT FreeBSD 13.0-CURRENT #0 r362201: Tue Jun 16 08:31:05 BST 2020 smartinez@lenovo01:/usr/obj/usr/src/amd64.amd64/sys/GENERIC  amd64 hw.mlx5.auto_fw_update: 0 hw.mlx5.fw_reset_enable: 1 dev.mlx5_core.3.hw.fw_version: 14.26.1040 dev.mlx5_core.2.hw.fw_version: 14.26.1040 dev.mlx5_core.1.hw.fw_version: 14.26.1040 dev.mlx5_core.0.hw.fw_version: 14.26.1040 While here, do you know if there is any ongoing effort to add NETMAP support to mlx? Thanks a lot for your help. Santiago On 2020-06-15 15:39, Santiago Martinez wrote: > Ok , will sync now/compile and let you know. Santi > > > On 2020-06-15 15:05, Hans Petter Selasky wrote: >> On 2020-06-15 15:49, Santiago Martinez wrote: >>> Hi Hans Petter,  At the moment I'm running r362037 but can >>> reinstall, patch/rebuild as needed as is just a lab machine. >> >> This revision is not good. There are two things you can try: >> >> 1) Try a kernel newer than r362139. >> >> 2) Copy sys/sys/tree.h from 12-stable and put it into the 13-current >> tree at the same location and re-build the kernel. >> >> --HPS > _______________________________________________ > freebsd-current@freebsd.org mailing list > https://lists.freebsd.org/mailman/listinfo/freebsd-current > To unsubscribe, send any mail to > "freebsd-current-unsubscribe@freebsd.org" From owner-freebsd-current@freebsd.org Tue Jun 16 11:48:20 2020 Return-Path: Delivered-To: freebsd-current@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 29A2E334628 for ; Tue, 16 Jun 2020 11:48:20 +0000 (UTC) (envelope-from hps@selasky.org) Received: from mailman.nyi.freebsd.org (unknown [127.0.1.3]) by mx1.freebsd.org (Postfix) with ESMTP id 49mRKb6FrGz3Wy5 for ; Tue, 16 Jun 2020 11:48:19 +0000 (UTC) (envelope-from hps@selasky.org) Received: by mailman.nyi.freebsd.org (Postfix) id D68ED334798; Tue, 16 Jun 2020 11:48:19 +0000 (UTC) Delivered-To: current@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id D65C033451A for ; Tue, 16 Jun 2020 11:48:19 +0000 (UTC) (envelope-from hps@selasky.org) Received: from mail.turbocat.net (turbocat.net [88.99.82.50]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 49mRKZ61Hgz3X66 for ; Tue, 16 Jun 2020 11:48:18 +0000 (UTC) (envelope-from hps@selasky.org) Received: from hps2020.home.selasky.org (unknown [62.141.129.235]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (2048 bits) server-digest SHA256) (No client certificate requested) by mail.turbocat.net (Postfix) with ESMTPSA id BAF4726010D; Tue, 16 Jun 2020 13:48:10 +0200 (CEST) Subject: Re: Panic on mlx5en. To: Santiago Martinez , FreeBSD Current References: <1bf2ffc5-386a-c0fa-4cc1-246892da3a38@codenetworks.net> <37677b81-0984-d6f4-9a6d-ebe94957ce47@selasky.org> <5bfad49a-5b74-1947-c6bb-9d9a20f472be@codenetworks.net> <528921f6-ee36-d341-2ceb-6143154827b9@selasky.org> <79d7e3de-fda5-5456-6f79-749d6314a9cb@selasky.org> <09fd8689-ea71-9bd6-25ee-27575bca1842@codenetworks.net> From: Hans Petter Selasky Message-ID: <8b6f8dc8-61c3-f02f-4c38-68591db4d2a7@selasky.org> Date: Tue, 16 Jun 2020 13:47:51 +0200 User-Agent: Mozilla/5.0 (X11; FreeBSD amd64; rv:68.0) Gecko/20100101 Thunderbird/68.8.0 MIME-Version: 1.0 In-Reply-To: Content-Type: text/plain; charset=utf-8; format=flowed Content-Language: en-US Content-Transfer-Encoding: 7bit X-Rspamd-Queue-Id: 49mRKZ61Hgz3X66 X-Spamd-Bar: -- Authentication-Results: mx1.freebsd.org; dkim=none; dmarc=none; spf=pass (mx1.freebsd.org: domain of hps@selasky.org designates 88.99.82.50 as permitted sender) smtp.mailfrom=hps@selasky.org X-Spamd-Result: default: False [-2.05 / 15.00]; RCVD_VIA_SMTP_AUTH(0.00)[]; ARC_NA(0.00)[]; MID_RHS_MATCH_FROM(0.00)[]; FROM_HAS_DN(0.00)[]; R_SPF_ALLOW(-0.20)[+a:mail.turbocat.net]; NEURAL_HAM_LONG(-0.97)[-0.973]; MIME_GOOD(-0.10)[text/plain]; DMARC_NA(0.00)[selasky.org]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; NEURAL_SPAM_SHORT(0.22)[0.220]; TO_MATCH_ENVRCPT_SOME(0.00)[]; TO_DN_ALL(0.00)[]; RCPT_COUNT_TWO(0.00)[2]; FROM_EQ_ENVFROM(0.00)[]; R_DKIM_NA(0.00)[]; MIME_TRACE(0.00)[0:+]; ASN(0.00)[asn:24940, ipnet:88.99.0.0/16, country:DE]; RCVD_COUNT_TWO(0.00)[2]; RCVD_TLS_ALL(0.00)[] X-BeenThere: freebsd-current@freebsd.org X-Mailman-Version: 2.1.33 Precedence: list List-Id: Discussions about the use of FreeBSD-current List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 16 Jun 2020 11:48:20 -0000 On 2020-06-16 13:36, Santiago Martinez wrote: > > While here, do you know if there is any ongoing effort to add NETMAP > support to mlx? Not for FreeBSD. You might want to look at RoCE and infiniband support for userspace. It should support raw ethernet queues aswell. --HPS From owner-freebsd-current@freebsd.org Tue Jun 16 12:17:14 2020 Return-Path: Delivered-To: freebsd-current@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id A6FE0336349 for ; Tue, 16 Jun 2020 12:17:14 +0000 (UTC) (envelope-from SRS0=MZrarz=75=codenetworks.net=sm@eigbox.net) Received: from mailman.nyi.freebsd.org (unknown [127.0.1.3]) by mx1.freebsd.org (Postfix) with ESMTP id 49mRyx71VTz3ZsM for ; Tue, 16 Jun 2020 12:17:13 +0000 (UTC) (envelope-from SRS0=MZrarz=75=codenetworks.net=sm@eigbox.net) Received: by mailman.nyi.freebsd.org (Postfix) id F07613363AC; Tue, 16 Jun 2020 12:17:13 +0000 (UTC) Delivered-To: current@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id EF7CE3363AB for ; Tue, 16 Jun 2020 12:17:13 +0000 (UTC) (envelope-from SRS0=MZrarz=75=codenetworks.net=sm@eigbox.net) Received: from bosmailout08.eigbox.net (bosmailout08.eigbox.net [66.96.188.8]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 49mRyx1fKMz3b3G for ; Tue, 16 Jun 2020 12:17:12 +0000 (UTC) (envelope-from SRS0=MZrarz=75=codenetworks.net=sm@eigbox.net) Received: from bosmailscan09.eigbox.net ([10.20.15.9]) by bosmailout08.eigbox.net with esmtp (Exim) id 1jlAWe-0001AN-B1 for current@freebsd.org; Tue, 16 Jun 2020 08:17:12 -0400 DKIM-Signature: v=1; a=rsa-sha256; q=dns/txt; c=relaxed/relaxed; d=codenetworks.net; s=dkim; h=Sender:Content-Transfer-Encoding:Content-Type: In-Reply-To:MIME-Version:Date:Message-ID:From:References:To:Subject:Reply-To: Cc:Content-ID:Content-Description:Resent-Date:Resent-From:Resent-Sender: Resent-To:Resent-Cc:Resent-Message-ID:List-Id:List-Help:List-Unsubscribe: List-Subscribe:List-Post:List-Owner:List-Archive; bh=h3nBtq00wyXgAtjMuOLqWVsGT2SkO9QeeQwvyI8/hK8=; b=C8XOWKiDLFVb8SKs8fjsacYyD2 w2FclO471qhtWq/TIBIZ3NaYpyIpQZUQs+d9gR3uAoFEu046jOaDdt3roxGrBwngS7CviRXqS017u 5cbuv15xARCsucRaIDEDZKV1tjdXW3JT3rxyEJXKBMHG+uHgy4tdhMW0soVx4NdszVifHDhrw3pqf g8ZuAh2UlftbcduSkfdY+gp34kVsTtdg9BnBN2IZSSgZU9cuTy3A8UELcXG0a3CFo/FZ4llYEptSP ps00YcGKUJerOGS5tLgx9QkR+OwIrKOj6p2gGSY62QcmDZ8xvwXg6oXA+wydNtG8NGNxbBVBGaT8u KIcs3lRA==; Received: from [10.115.3.32] (helo=bosimpout12) by bosmailscan09.eigbox.net with esmtp (Exim) id 1jlAWe-00061m-9T for current@freebsd.org; Tue, 16 Jun 2020 08:17:12 -0400 Received: from bosauthsmtp07.yourhostingaccount.com ([10.20.18.7]) by bosimpout12 with id roH82200T099BUA01oHBik; Tue, 16 Jun 2020 08:17:12 -0400 X-Authority-Analysis: v=2.2 cv=KNQqNBNo c=1 sm=1 tr=0 a=x8qw8EAkfcRkIpZA8Q87Bg==:117 a=HgejYIwJ78uhX17IQOWm3w==:17 a=IkcTkHD0fZMA:10 a=nTHF0DUjJn0A:10 a=x6SUvDt4rVEA:10 a=6I5d2MoRAAAA:8 a=KQjDkNTdQKeMbk2Rw-gA:9 a=QEXdDO2ut3YA:10 a=IjZwj45LgO3ly-622nXo:22 Received: from cpc96352-rdng26-2-0-cust40.15-3.cable.virginm.net ([86.18.84.41]:17107 helo=[192.168.0.100]) by bosauthsmtp07.eigbox.net with esmtpa (Exim) id 1jlAWa-0000y7-Lz; Tue, 16 Jun 2020 08:17:08 -0400 Subject: Re: Panic on mlx5en. To: Hans Petter Selasky , FreeBSD Current References: <1bf2ffc5-386a-c0fa-4cc1-246892da3a38@codenetworks.net> <37677b81-0984-d6f4-9a6d-ebe94957ce47@selasky.org> <5bfad49a-5b74-1947-c6bb-9d9a20f472be@codenetworks.net> <528921f6-ee36-d341-2ceb-6143154827b9@selasky.org> <79d7e3de-fda5-5456-6f79-749d6314a9cb@selasky.org> <09fd8689-ea71-9bd6-25ee-27575bca1842@codenetworks.net> <8b6f8dc8-61c3-f02f-4c38-68591db4d2a7@selasky.org> From: Santiago Martinez Message-ID: <47be1af9-70f8-8401-b649-db999ab9d186@codenetworks.net> Date: Tue, 16 Jun 2020 13:17:05 +0100 User-Agent: Mozilla/5.0 (X11; FreeBSD amd64; rv:68.0) Gecko/20100101 Thunderbird/68.9.0 MIME-Version: 1.0 In-Reply-To: <8b6f8dc8-61c3-f02f-4c38-68591db4d2a7@selasky.org> Content-Type: text/plain; charset=utf-8; format=flowed Content-Transfer-Encoding: 7bit Content-Language: en-US X-EN-UserInfo: d3bdfab0736480cedf04ed92aaea2ef5:931c98230c6409dcc37fa7e93b490c27 X-EN-AuthUser: sm@codenetworks.net Sender: Santiago Martinez X-EN-OrigIP: 86.18.84.41 X-EN-OrigHost: cpc96352-rdng26-2-0-cust40.15-3.cable.virginm.net X-Rspamd-Queue-Id: 49mRyx1fKMz3b3G X-Spamd-Bar: --- Authentication-Results: mx1.freebsd.org; dkim=none (invalid DKIM record) header.d=codenetworks.net header.s=dkim header.b=C8XOWKiD; dmarc=none; spf=pass (mx1.freebsd.org: domain of SRS0=MZrarz=75=codenetworks.net=sm@eigbox.net designates 66.96.188.8 as permitted sender) smtp.mailfrom=SRS0=MZrarz=75=codenetworks.net=sm@eigbox.net X-Spamd-Result: default: False [-3.28 / 15.00]; RCVD_VIA_SMTP_AUTH(0.00)[]; ARC_NA(0.00)[]; RCVD_COUNT_FIVE(0.00)[5]; NEURAL_HAM_MEDIUM(-1.03)[-1.033]; FROM_HAS_DN(0.00)[]; R_SPF_ALLOW(-0.20)[+ip4:66.96.128.0/18:c]; NEURAL_HAM_LONG(-0.99)[-0.990]; MIME_GOOD(-0.10)[text/plain]; DMARC_NA(0.00)[codenetworks.net: no valid DMARC record]; TO_MATCH_ENVRCPT_SOME(0.00)[]; TO_DN_ALL(0.00)[]; DKIM_TRACE(0.00)[codenetworks.net:~]; RCPT_COUNT_TWO(0.00)[2]; RCVD_IN_DNSWL_NONE(0.00)[66.96.188.8:from]; NEURAL_HAM_SHORT(-1.26)[-1.257]; R_DKIM_PERMFAIL(0.00)[codenetworks.net:s=dkim]; FORGED_SENDER(0.30)[sm@codenetworks.net,SRS0=MZrarz=75=codenetworks.net=sm@eigbox.net]; RWL_MAILSPIKE_POSSIBLE(0.00)[66.96.188.8:from]; MIME_TRACE(0.00)[0:+]; RCVD_TLS_LAST(0.00)[]; ASN(0.00)[asn:29873, ipnet:66.96.128.0/18, country:US]; FROM_NEQ_ENVFROM(0.00)[sm@codenetworks.net,SRS0=MZrarz=75=codenetworks.net=sm@eigbox.net]; MID_RHS_MATCH_FROM(0.00)[] X-BeenThere: freebsd-current@freebsd.org X-Mailman-Version: 2.1.33 Precedence: list List-Id: Discussions about the use of FreeBSD-current List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 16 Jun 2020 12:17:14 -0000 Thanks. On 2020-06-16 12:47, Hans Petter Selasky wrote: > On 2020-06-16 13:36, Santiago Martinez wrote: >> >> While here, do you know if there is any ongoing effort to add NETMAP >> support to mlx? > > Not for FreeBSD. > > You might want to look at RoCE and infiniband support for userspace. > It should support raw ethernet queues aswell. > > --HPS > _______________________________________________ > freebsd-current@freebsd.org mailing list > https://lists.freebsd.org/mailman/listinfo/freebsd-current > To unsubscribe, send any mail to > "freebsd-current-unsubscribe@freebsd.org" From owner-freebsd-current@freebsd.org Tue Jun 16 15:35:22 2020 Return-Path: Delivered-To: freebsd-current@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 90BBC33EBBA for ; Tue, 16 Jun 2020 15:35:22 +0000 (UTC) (envelope-from freebsd-rwg@gndrsh.dnsmgr.net) Received: from gndrsh.dnsmgr.net (br1.CN84in.dnsmgr.net [69.59.192.140]) (using TLSv1 with cipher DHE-RSA-AES256-SHA (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 49mXMY57vBz4B0L for ; Tue, 16 Jun 2020 15:35:21 +0000 (UTC) (envelope-from freebsd-rwg@gndrsh.dnsmgr.net) Received: from gndrsh.dnsmgr.net (localhost [127.0.0.1]) by gndrsh.dnsmgr.net (8.13.3/8.13.3) with ESMTP id 05GFZJxH081326; Tue, 16 Jun 2020 08:35:19 -0700 (PDT) (envelope-from freebsd-rwg@gndrsh.dnsmgr.net) Received: (from freebsd-rwg@localhost) by gndrsh.dnsmgr.net (8.13.3/8.13.3/Submit) id 05GFZJFn081325; Tue, 16 Jun 2020 08:35:19 -0700 (PDT) (envelope-from freebsd-rwg) From: "Rodney W. Grimes" Message-Id: <202006161535.05GFZJFn081325@gndrsh.dnsmgr.net> Subject: Re: CTF: UEFI HTTP boot support In-Reply-To: To: Miguel C Date: Tue, 16 Jun 2020 08:35:19 -0700 (PDT) CC: freebsd-current@freebsd.org X-Mailer: ELM [version 2.4ME+ PL121h (25)] MIME-Version: 1.0 Content-Transfer-Encoding: 7bit Content-Type: text/plain; charset=US-ASCII X-Rspamd-Queue-Id: 49mXMY57vBz4B0L X-Spamd-Bar: + Authentication-Results: mx1.freebsd.org; dkim=none; dmarc=none; spf=none (mx1.freebsd.org: domain of freebsd-rwg@gndrsh.dnsmgr.net has no SPF policy when checking 69.59.192.140) smtp.mailfrom=freebsd-rwg@gndrsh.dnsmgr.net X-Spamd-Result: default: False [1.47 / 15.00]; ARC_NA(0.00)[]; NEURAL_HAM_MEDIUM(-0.11)[-0.111]; FROM_HAS_DN(0.00)[]; TO_DN_SOME(0.00)[]; NEURAL_SPAM_SHORT(0.02)[0.020]; MIME_GOOD(-0.10)[text/plain]; DMARC_NA(0.00)[dnsmgr.net]; AUTH_NA(1.00)[]; TO_MATCH_ENVRCPT_SOME(0.00)[]; RCPT_COUNT_TWO(0.00)[2]; NEURAL_SPAM_LONG(0.66)[0.663]; R_SPF_NA(0.00)[no SPF record]; FREEMAIL_TO(0.00)[gmail.com]; FROM_EQ_ENVFROM(0.00)[]; RCVD_TLS_LAST(0.00)[]; R_DKIM_NA(0.00)[]; ASN(0.00)[asn:13868, ipnet:69.59.192.0/19, country:US]; MIME_TRACE(0.00)[0:+]; MID_RHS_MATCH_FROM(0.00)[]; RCVD_COUNT_TWO(0.00)[2] X-BeenThere: freebsd-current@freebsd.org X-Mailman-Version: 2.1.33 Precedence: list List-Id: Discussions about the use of FreeBSD-current List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 16 Jun 2020 15:35:22 -0000 > I've been trying out FreeBSD with raspberry Pi4 (4GB) and wanted to see > what the state of HTTP BOOT is in FreeBSD, so I bumped into this! > > I'm curious if it should be possible to point to a img/iso directly (I > tried to use the img.xz unpacked it and make it available on a local web > server and that didn't seem to work for me) but maybe thats cause those > images miss something, so arm64 aside does that work for amd64? I.E. using > the bootonly.iso? One problem you run into in attemtping this is even if you get an image downloaded and started that image is being provided by some memory device driver that emulates some type of iso device. FreeBSD does not have a driver for that device so once the kernel gets to the point of mounting its root file system it falls on its face with a mountroot failure. > > And on the other hand is there any doc on how to set up dhcp/http specific > to FreeBSD similar to https://en.opensuse.org/UEFI_HTTPBoot_Server_Setup? Since Linux uses this idea of a kernel payload and an initrd payload to boot with it is much easier to get these 2 things over the network and then have a workable system. FreeBSD does not have the initrd payload and that complicates things, you need a functionaly filesystem avaliable at the end of kernel initilization. > > I looked into https://www.freebsd.org/doc/handbook/network-diskless.html > but that doesn't seem to be up to date (or at least it focuses only on PXE > and TFTP). Yes, old but workable. I have a more advanced system that supports NFS booting using NFS support in PXE. The only thing done via tftp is to upgrade the PXE running on the client to one that speaks NFS, then the kernel is loaded via NFS and the root file system is later provided via NFS. The use of NFS provides very fast boots, and I do not need a web server to do it :-). > For clarification my ultimate goal is to use a few pi4's as "thin clients", > so eventually I will have to setup an image of the system with the needed > software (freerdp) but for starters I just wanted to check if pointing > directly to a img/iso would work and that does not seem to be the case. I would strongly suggest use of NFS instead of trying to provide an ISO image, as you no longer need to store the ISO in memory on the client box, and with a pi4 your already memory contrained. > Thanks. > _______________________________________________ > freebsd-current@freebsd.org mailing list > https://lists.freebsd.org/mailman/listinfo/freebsd-current > To unsubscribe, send any mail to "freebsd-current-unsubscribe@freebsd.org" -- Rod Grimes rgrimes@freebsd.org From owner-freebsd-current@freebsd.org Tue Jun 16 15:49:04 2020 Return-Path: Delivered-To: freebsd-current@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 8DD7A33F0E9 for ; Tue, 16 Jun 2020 15:49:04 +0000 (UTC) (envelope-from sjg@juniper.net) Received: from mx0b-00273201.pphosted.com (mx0b-00273201.pphosted.com [67.231.152.164]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client CN "*.pphosted.com", Issuer "Thawte RSA CA 2018" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 49mXgM4RmTz4Ch4 for ; Tue, 16 Jun 2020 15:49:03 +0000 (UTC) (envelope-from sjg@juniper.net) Received: from pps.filterd (m0108163.ppops.net [127.0.0.1]) by mx0b-00273201.pphosted.com (8.16.0.42/8.16.0.42) with SMTP id 05GFl1sx005780; Tue, 16 Jun 2020 08:49:02 -0700 Received: from nam11-dm6-obe.outbound.protection.outlook.com (mail-dm6nam11lp2168.outbound.protection.outlook.com [104.47.57.168]) by mx0b-00273201.pphosted.com with ESMTP id 31mt1qnemr-1 (version=TLSv1.2 cipher=ECDHE-RSA-AES256-GCM-SHA384 bits=256 verify=NOT); Tue, 16 Jun 2020 08:49:02 -0700 ARC-Seal: i=1; a=rsa-sha256; s=arcselector9901; d=microsoft.com; cv=none; b=lJC4T3EpfF2bTPs/XlnXqlr0IN4g6KbidJbUBPefp8ARJ9s8aecJ3W7d9ODc1mtl47oXBZZ6CBQSbqzS0vkmsumcvxh72H7cai0NBdK5lNTOmF31qUoymjumq7KEg1MPtEdY1B/eimK/NolBVmnWgAjFmPJa1nkCK8uUpeDD/XYJZU4fVu4E2KH46CDfrO/tW2Opw31w7le/w7Pab8Z2HfNfSh8mAAOljcPQuRiRNB1p76b3jM7Ru2PlNi9UeyMjnvKDZ2DoVDurslSIiddQrDxzXb4F4hjISCZQhnhOl5wk13lUgSR9QRDbTS+JU3XG1W5rPyTYGurGR93hz0vHvw== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=microsoft.com; s=arcselector9901; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=L/SOIBY7tGEH0oCcR4QhjGSKlqNc619GmpSL95mVosU=; b=TjDEPxPuEL04h1Yfsq+H7REkGsKaSm5zqPLokwW3FIqhbeM9M47xjX7mGg9LwhE8yPPHfcbd/w02YrwIFCKblZdNTU34MJcMAfqO1xldbBRlvJfPlNneq1NHabSsCfb3P2oxg+FMpWgl/lZmp8aH6m0TCi1/+6BSEcx9hzz/1erETkaraAVe8TKUD1bQtQ8RJYH01AwTg/StzE8EperWgY284HwyLk1Jh8/ZYGIhHzmLia6qfOd+3up7PuM2iLoXjy+EgpiJkXzroB84eK/dh1bX2ssY7srGJLRr0Y/D72mBdd9VFv0G5ZW80OmrRrXardtMfJ6YIorhv2TORGde8g== ARC-Authentication-Results: i=1; mx.microsoft.com 1; spf=softfail (sender ip is 66.129.242.13) smtp.rcpttodomain=gndrsh.dnsmgr.net smtp.mailfrom=juniper.net; dmarc=fail (p=reject sp=reject pct=100) action=oreject header.from=juniper.net; dkim=none (message not signed); arc=none Received: from MW3PR05CA0025.namprd05.prod.outlook.com (2603:10b6:303:2b::30) by CY4PR05MB3576.namprd05.prod.outlook.com (2603:10b6:910:52::22) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.3109.18; Tue, 16 Jun 2020 15:48:59 +0000 Received: from CO1NAM05FT020.eop-nam05.prod.protection.outlook.com (2603:10b6:303:2b:cafe::16) by MW3PR05CA0025.outlook.office365.com (2603:10b6:303:2b::30) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.3109.10 via Frontend Transport; Tue, 16 Jun 2020 15:48:59 +0000 X-MS-Exchange-Authentication-Results: spf=softfail (sender IP is 66.129.242.13) smtp.mailfrom=juniper.net; gndrsh.dnsmgr.net; dkim=none (message not signed) header.d=none;gndrsh.dnsmgr.net; dmarc=fail action=oreject header.from=juniper.net; Received-SPF: SoftFail (protection.outlook.com: domain of transitioning juniper.net discourages use of 66.129.242.13 as permitted sender) Received: from P-EXFEND-EQX-02.jnpr.net (66.129.242.13) by CO1NAM05FT020.mail.protection.outlook.com (10.152.96.128) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_CBC_SHA384) id 15.20.3109.9 via Frontend Transport; Tue, 16 Jun 2020 15:48:58 +0000 Received: from P-EXBEND-EQX-01.jnpr.net (10.104.8.52) by P-EXFEND-EQX-02.jnpr.net (10.104.8.55) with Microsoft SMTP Server (TLS) id 15.0.1497.2; Tue, 16 Jun 2020 08:48:35 -0700 Received: from P-EXBEND-EQX-01.jnpr.net (10.104.8.52) by P-EXBEND-EQX-01.jnpr.net (10.104.8.52) with Microsoft SMTP Server (TLS) id 15.0.1497.2; Tue, 16 Jun 2020 08:48:35 -0700 Received: from p-mailhub01.juniper.net (10.104.20.6) by P-EXBEND-EQX-01.jnpr.net (10.104.8.52) with Microsoft SMTP Server (TLS) id 15.0.1497.2 via Frontend Transport; Tue, 16 Jun 2020 08:48:35 -0700 Received: from kaos.jnpr.net (kaos.jnpr.net [172.23.50.162]) by p-mailhub01.juniper.net (8.14.4/8.11.3) with ESMTP id 05GFmYN6030133; Tue, 16 Jun 2020 08:48:35 -0700 (envelope-from sjg@juniper.net) Received: by kaos.jnpr.net (Postfix, from userid 1377) id D80E6A879; Tue, 16 Jun 2020 08:48:34 -0700 (PDT) Received: from kaos.jnpr.net (localhost [127.0.0.1]) by kaos.jnpr.net (Postfix) with ESMTP id D666EA878; Tue, 16 Jun 2020 08:48:34 -0700 (PDT) To: "Rodney W. Grimes" CC: Miguel C , , Subject: Re: CTF: UEFI HTTP boot support In-Reply-To: <202006161535.05GFZJFn081325@gndrsh.dnsmgr.net> References: <202006161535.05GFZJFn081325@gndrsh.dnsmgr.net> Comments: In-reply-to: "Rodney W. Grimes" message dated "Tue, 16 Jun 2020 08:35:19 -0700." From: "Simon J. Gerraty" X-Mailer: MH-E 8.6+git; nmh 1.7.1; GNU Emacs 26.3 MIME-Version: 1.0 Content-Type: text/plain; charset="us-ascii" Content-ID: <3003.1592322514.1@kaos.jnpr.net> Date: Tue, 16 Jun 2020 08:48:34 -0700 Message-ID: <5957.1592322514@kaos.jnpr.net> X-EXCLAIMER-MD-CONFIG: e3cb0ff2-54e7-4646-8a04-0dae4ac7b136 X-EOPAttributedMessage: 0 X-MS-Office365-Filtering-HT: Tenant X-Forefront-Antispam-Report: CIP:66.129.242.13; CTRY:US; LANG:en; SCL:1; SRV:; IPV:CAL; SFV:NSPM; H:P-EXFEND-EQX-02.jnpr.net; PTR:InfoDomainNonexistent; CAT:NONE; SFTY:; SFS:(4636009)(39860400002)(396003)(136003)(376002)(346002)(46966005)(81166007)(26005)(82310400002)(54906003)(356005)(6916009)(316002)(83380400001)(70206006)(2906002)(70586007)(82740400003)(4744005)(6266002)(186003)(47076004)(86362001)(7126003)(478600001)(336012)(7696005)(8676002)(8936002)(9686003)(5660300002)(107886003)(4326008)(55016002); DIR:OUT; SFP:1102; X-MS-PublicTrafficType: Email X-MS-Office365-Filtering-Correlation-Id: 5a16c011-c3b4-418e-81d1-08d8120cc8cd X-MS-TrafficTypeDiagnostic: CY4PR05MB3576: X-Microsoft-Antispam-PRVS: X-MS-Oob-TLC-OOBClassifiers: OLM:5516; X-Forefront-PRVS: 04362AC73B X-MS-Exchange-SenderADCheck: 1 X-Microsoft-Antispam: BCL:0; X-Microsoft-Antispam-Message-Info: uR5PQxy19ndxmZIuiKkBSTAZHdIQ111vyYyF8+huAtCsvrPvyb3c+kcJS0417XufERr8akfiHzFx18VHBmWP7PeAJq31njIAl0J5t3Tx6Yh7dYnp5sNeRl8g77l9z0q3MsvyGIa5ALmLxdl+y1bSBF4OJPY9G2pCTYIT4KPsZDqhkOgqK4MXQiZvvSC7b7cJCjZ080DkemjeC2Rjgytf0gQmwyTgSagU8zdRJ1EzryD5r445tb5w6Hp+zuINfV0/iRGwt2RJcoxNTZtrkZCXeMHtrpqPuIprvpifKEhOmmsfitBAf/1bSHY5L30H6/dFLCFaY7jrZUDw2rhcaHgoiptx2YiD6xO+Z1sdicDonbGn9XiZMJKkU0cvSj6hy7BAeNmByPfPK3xx68DBNNsm/w== X-OriginatorOrg: juniper.net X-MS-Exchange-CrossTenant-OriginalArrivalTime: 16 Jun 2020 15:48:58.9784 (UTC) X-MS-Exchange-CrossTenant-Network-Message-Id: 5a16c011-c3b4-418e-81d1-08d8120cc8cd X-MS-Exchange-CrossTenant-Id: bea78b3c-4cdb-4130-854a-1d193232e5f4 X-MS-Exchange-CrossTenant-OriginalAttributedTenantConnectingIp: TenantId=bea78b3c-4cdb-4130-854a-1d193232e5f4; Ip=[66.129.242.13]; Helo=[P-EXFEND-EQX-02.jnpr.net] X-MS-Exchange-CrossTenant-FromEntityHeader: HybridOnPrem X-MS-Exchange-Transport-CrossTenantHeadersStamped: CY4PR05MB3576 X-Proofpoint-Virus-Version: vendor=fsecure engine=2.50.10434:6.0.216, 18.0.687 definitions=2020-06-16_07:2020-06-16, 2020-06-16 signatures=0 X-Proofpoint-Spam-Details: rule=outbound_spam_notspam policy=outbound_spam score=0 priorityscore=1501 impostorscore=0 suspectscore=0 adultscore=0 bulkscore=0 phishscore=0 cotscore=-2147483648 lowpriorityscore=0 malwarescore=0 spamscore=0 mlxscore=0 mlxlogscore=739 clxscore=1011 classifier=spam adjust=0 reason=mlx scancount=1 engine=8.12.0-2004280000 definitions=main-2006160111 X-Rspamd-Queue-Id: 49mXgM4RmTz4Ch4 X-Spamd-Bar: ----- X-Spamd-Result: default: False [-5.42 / 15.00]; NEURAL_HAM_MEDIUM(-1.02)[-1.016]; R_DKIM_ALLOW(-0.20)[juniper.net:s=PPS1017,juniper.net:s=selector1]; FROM_HAS_DN(0.00)[]; RCPT_COUNT_THREE(0.00)[4]; TO_DN_SOME(0.00)[]; R_SPF_ALLOW(-0.20)[+ip4:67.231.152.164]; MIME_GOOD(-0.10)[text/plain]; NEURAL_HAM_LONG(-0.99)[-0.995]; ARC_ALLOW(-1.00)[microsoft.com:s=arcselector9901:i=1]; TO_MATCH_ENVRCPT_SOME(0.00)[]; DKIM_TRACE(0.00)[juniper.net:+]; DMARC_POLICY_ALLOW(-0.50)[juniper.net,reject]; NEURAL_HAM_SHORT(-1.31)[-1.312]; RCVD_IN_DNSWL_LOW(-0.10)[67.231.152.164:from]; FROM_EQ_ENVFROM(0.00)[]; MIME_TRACE(0.00)[0:+]; ASN(0.00)[asn:22843, ipnet:67.231.152.0/24, country:US]; RCVD_TLS_LAST(0.00)[]; RCVD_COUNT_SEVEN(0.00)[11]; FREEMAIL_CC(0.00)[gmail.com,freebsd.org,juniper.net] X-BeenThere: freebsd-current@freebsd.org X-Mailman-Version: 2.1.33 Precedence: list List-Id: Discussions about the use of FreeBSD-current List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 16 Jun 2020 15:49:04 -0000 Rodney W. Grimes wrote: > > I'm curious if it should be possible to point to a img/iso directly (I > > tried to use the img.xz unpacked it and make it available on a local web > > server and that didn't seem to work for me) but maybe thats cause those > > images miss something, so arm64 aside does that work for amd64? I.E. using > > the bootonly.iso? > > One problem you run into in attemtping this is even if you get an > image downloaded and started that image is being provided by some > memory device driver that emulates some type of iso device. > FreeBSD does not have a driver for that device so once the kernel > gets to the point of mounting its root file system it falls on > its face with a mountroot failure. Are you refering to something like: vfs.root.mountfrom="cd9660:/dev/md0.uzip" we boot that way all the time. From owner-freebsd-current@freebsd.org Tue Jun 16 15:53:26 2020 Return-Path: Delivered-To: freebsd-current@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 688E233FD17 for ; Tue, 16 Jun 2020 15:53:26 +0000 (UTC) (envelope-from miguelmclara@gmail.com) Received: from mail-pl1-x62c.google.com (mail-pl1-x62c.google.com [IPv6:2607:f8b0:4864:20::62c]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "GTS CA 1O1" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 49mXmP4Z0Tz4D4J for ; Tue, 16 Jun 2020 15:53:25 +0000 (UTC) (envelope-from miguelmclara@gmail.com) Received: by mail-pl1-x62c.google.com with SMTP id m7so8576903plt.5 for ; Tue, 16 Jun 2020 08:53:25 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=mime-version:references:in-reply-to:from:date:message-id:subject:to :cc; bh=+t9OB7YpYITCmo40A/7FMy31A5gun81q9D3BlUnY1l8=; b=RPKMRxzxizmmdBrqhBJvqYEGCofyCuvoSZekrQjIE5WjCHl1zdNLka7VMfkvH0QfAW NdypQQKWxvgSlt46keI5kmwD84OepY5q5fqS/OHhTFpEqniWtfdqElDSqNCD1CXzBxth rT5YH29ggjvXpT5J29PnYH1YFtubdEku/ENNBXWfnY40S7D+7osMJsIEoZHVrsv6ud1T iEtPGVsTykNAwOKQPvQ8+hwsEoZuAlpkbySBz/XiPd40VuwaWSLEbRQH4IkuCraHDJ44 eAlVgwhEO//jk6EFRqz91unBM0v/eon2vLdUtVbRULhJrJf59u4SsRhPdCpKIb173Q+s qXuw== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:references:in-reply-to:from:date :message-id:subject:to:cc; bh=+t9OB7YpYITCmo40A/7FMy31A5gun81q9D3BlUnY1l8=; b=PV6L5aPkJrJ7qi54VZ7P42VTbk3BN1o/pQO5LAXvQHYgd1xj80zQcYxR0q/gqEJWZs CbnGpfmnLVzg3BzNOglBa0EVhlIhsPYRSjFOAnciHj2w6hxHhcYGxkejxR6ouM89nmls wNfAEKXd+cRVkyjSUF9EnnR97khSqGZUgRTMh0I9LSTfsGiryXaEQ54cP/kB9hSxNaL0 1zsV6FhRZcJBl4/i3vVZTDKARMt+J+Y3PnSWwTtTJNddKQw/hdLCqvFwGSU62dHXmc3l rSa9O9IF/XAf1nVoz/j8mZcpvg8F/JM95/X2lMCmpd7coen4fPIrEd8F76CaKK+V0oRU XRsw== X-Gm-Message-State: AOAM5321EFVASXkhDT4Rey04J3DBlmeJq+t61wLVWmetXdutL9KRDAfX u/0GOkP2s4mFQNXt+GFoYaxffKT9911h/mwFt+ikSR6Zpl4= X-Google-Smtp-Source: ABdhPJxXbyPLBKoYFsd6xUM0Yc0y6RAAKFuDrCHFYLvdcnYRoU95va9Cq6wNBOx1yX6V0XLVF4kOnlciFqw9SNYI3jk= X-Received: by 2002:a17:90a:4d09:: with SMTP id c9mr3520411pjg.137.1592322803894; Tue, 16 Jun 2020 08:53:23 -0700 (PDT) MIME-Version: 1.0 References: <202006161535.05GFZJFn081325@gndrsh.dnsmgr.net> In-Reply-To: <202006161535.05GFZJFn081325@gndrsh.dnsmgr.net> From: Miguel C Date: Tue, 16 Jun 2020 16:52:47 +0100 Message-ID: Subject: Re: CTF: UEFI HTTP boot support To: "Rodney W. Grimes" Cc: freebsd-current X-Rspamd-Queue-Id: 49mXmP4Z0Tz4D4J X-Spamd-Bar: -- Authentication-Results: mx1.freebsd.org; dkim=pass header.d=gmail.com header.s=20161025 header.b=RPKMRxzx; dmarc=pass (policy=none) header.from=gmail.com; spf=pass (mx1.freebsd.org: domain of miguelmclara@gmail.com designates 2607:f8b0:4864:20::62c as permitted sender) smtp.mailfrom=miguelmclara@gmail.com X-Spamd-Result: default: False [-2.37 / 15.00]; ARC_NA(0.00)[]; NEURAL_HAM_MEDIUM(-0.89)[-0.891]; R_DKIM_ALLOW(-0.20)[gmail.com:s=20161025]; FROM_HAS_DN(0.00)[]; FREEMAIL_FROM(0.00)[gmail.com]; R_SPF_ALLOW(-0.20)[+ip6:2607:f8b0:4000::/36]; MIME_GOOD(-0.10)[multipart/alternative,text/plain]; PREVIOUSLY_DELIVERED(0.00)[freebsd-current@freebsd.org]; NEURAL_HAM_LONG(-1.01)[-1.007]; URI_COUNT_ODD(1.00)[1]; TO_MATCH_ENVRCPT_SOME(0.00)[]; TO_DN_ALL(0.00)[]; DKIM_TRACE(0.00)[gmail.com:+]; RCPT_COUNT_TWO(0.00)[2]; RCVD_IN_DNSWL_NONE(0.00)[2607:f8b0:4864:20::62c:from]; NEURAL_HAM_SHORT(-0.48)[-0.476]; DMARC_POLICY_ALLOW(-0.50)[gmail.com,none]; FROM_EQ_ENVFROM(0.00)[]; MIME_TRACE(0.00)[0:+,1:+,2:~]; FREEMAIL_ENVFROM(0.00)[gmail.com]; RCVD_COUNT_TWO(0.00)[2]; ASN(0.00)[asn:15169, ipnet:2607:f8b0::/32, country:US]; RCVD_TLS_ALL(0.00)[]; DWL_DNSWL_NONE(0.00)[gmail.com:dkim] Content-Type: text/plain; charset="UTF-8" X-Content-Filtered-By: Mailman/MimeDel 2.1.33 X-BeenThere: freebsd-current@freebsd.org X-Mailman-Version: 2.1.33 Precedence: list List-Id: Discussions about the use of FreeBSD-current List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 16 Jun 2020 15:53:26 -0000 On Tue, Jun 16, 2020 at 4:35 PM Rodney W. Grimes < freebsd-rwg@gndrsh.dnsmgr.net> wrote: > > I've been trying out FreeBSD with raspberry Pi4 (4GB) and wanted to see > > what the state of HTTP BOOT is in FreeBSD, so I bumped into this! > > > > I'm curious if it should be possible to point to a img/iso directly (I > > tried to use the img.xz unpacked it and make it available on a local web > > server and that didn't seem to work for me) but maybe thats cause those > > images miss something, so arm64 aside does that work for amd64? I.E. > using > > the bootonly.iso? > > One problem you run into in attemtping this is even if you get an > image downloaded and started that image is being provided by some > memory device driver that emulates some type of iso device. > FreeBSD does not have a driver for that device so once the kernel > gets to the point of mounting its root file system it falls on > its face with a mountroot failure. > > > > > And on the other hand is there any doc on how to set up dhcp/http > specific > > to FreeBSD similar to https://en.opensuse.org/UEFI_HTTPBoot_Server_Setup > ? > > Since Linux uses this idea of a kernel payload and an initrd payload > to boot with it is much easier to get these 2 things over the network > and then have a workable system. FreeBSD does not have the initrd > payload and that complicates things, you need a functionaly filesystem > avaliable at the end of kernel initilization. > > > > I looked into https://www.freebsd.org/doc/handbook/network-diskless.html > > but that doesn't seem to be up to date (or at least it focuses only on > PXE > > and TFTP). > > Yes, old but workable. I have a more advanced system that supports NFS > booting using NFS support in PXE. The only thing done via tftp is to > upgrade the PXE running on the client to one that speaks NFS, then the > kernel is loaded via NFS and the root file system is later provided > via NFS. The use of NFS provides very fast boots, and I do not need > a web server to do it :-). > > > For clarification my ultimate goal is to use a few pi4's as "thin > clients", > > so eventually I will have to setup an image of the system with the needed > > software (freerdp) but for starters I just wanted to check if pointing > > directly to a img/iso would work and that does not seem to be the case. > > I would strongly suggest use of NFS instead of trying to provide an > ISO image, as you no longer need to store the ISO in memory on the > client box, and with a pi4 your already memory contrained. > Thanks for the tips, but I was really looking for HTTP BOOT info no NFS, that's why I replied to this thread. I might look into that at some point if HTTP BOOT is not an option of course, but this thread is about a Call for Testers for UEFI HTTP BOOT, not NFS and I would like to help test, the pi4 project just conveniently touches on the same use case (an it also does have support for http boot using https://rpi4-uefi.dev/) so I'm curious if I can test that way. Other than the iso I can ofc attempt the dhcp+dns+webserver setup but for that I would need a bit more guidance as the linked URL here is linux centric, hence why some docs would help. From owner-freebsd-current@freebsd.org Tue Jun 16 16:09:42 2020 Return-Path: Delivered-To: freebsd-current@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id D8E31340E05 for ; Tue, 16 Jun 2020 16:09:42 +0000 (UTC) (envelope-from freebsd-rwg@gndrsh.dnsmgr.net) Received: from gndrsh.dnsmgr.net (br1.CN84in.dnsmgr.net [69.59.192.140]) (using TLSv1 with cipher DHE-RSA-AES256-SHA (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 49mY7974Rqz4Fgv for ; Tue, 16 Jun 2020 16:09:41 +0000 (UTC) (envelope-from freebsd-rwg@gndrsh.dnsmgr.net) Received: from gndrsh.dnsmgr.net (localhost [127.0.0.1]) by gndrsh.dnsmgr.net (8.13.3/8.13.3) with ESMTP id 05GG9dxD081461; Tue, 16 Jun 2020 09:09:39 -0700 (PDT) (envelope-from freebsd-rwg@gndrsh.dnsmgr.net) Received: (from freebsd-rwg@localhost) by gndrsh.dnsmgr.net (8.13.3/8.13.3/Submit) id 05GG9dRs081460; Tue, 16 Jun 2020 09:09:39 -0700 (PDT) (envelope-from freebsd-rwg) From: "Rodney W. Grimes" Message-Id: <202006161609.05GG9dRs081460@gndrsh.dnsmgr.net> Subject: Re: CTF: UEFI HTTP boot support In-Reply-To: <5957.1592322514@kaos.jnpr.net> To: "Simon J. Gerraty" Date: Tue, 16 Jun 2020 09:09:39 -0700 (PDT) CC: "Rodney W. Grimes" , Miguel C , freebsd-current@freebsd.org X-Mailer: ELM [version 2.4ME+ PL121h (25)] MIME-Version: 1.0 Content-Transfer-Encoding: 7bit Content-Type: text/plain; charset=US-ASCII X-Rspamd-Queue-Id: 49mY7974Rqz4Fgv X-Spamd-Bar: / Authentication-Results: mx1.freebsd.org; dkim=none; dmarc=none; spf=none (mx1.freebsd.org: domain of freebsd-rwg@gndrsh.dnsmgr.net has no SPF policy when checking 69.59.192.140) smtp.mailfrom=freebsd-rwg@gndrsh.dnsmgr.net X-Spamd-Result: default: False [0.35 / 15.00]; RCVD_TLS_LAST(0.00)[]; ARC_NA(0.00)[]; NEURAL_HAM_MEDIUM(-0.57)[-0.568]; FROM_HAS_DN(0.00)[]; RCPT_COUNT_THREE(0.00)[4]; TO_DN_SOME(0.00)[]; NEURAL_HAM_LONG(-0.07)[-0.074]; MIME_GOOD(-0.10)[text/plain]; DMARC_NA(0.00)[dnsmgr.net]; AUTH_NA(1.00)[]; NEURAL_SPAM_SHORT(0.09)[0.089]; TO_MATCH_ENVRCPT_SOME(0.00)[]; R_SPF_NA(0.00)[no SPF record]; FROM_EQ_ENVFROM(0.00)[]; R_DKIM_NA(0.00)[]; MIME_TRACE(0.00)[0:+]; RCVD_COUNT_TWO(0.00)[2]; ASN(0.00)[asn:13868, ipnet:69.59.192.0/19, country:US]; MID_RHS_MATCH_FROM(0.00)[]; FREEMAIL_CC(0.00)[gndrsh.dnsmgr.net,gmail.com,freebsd.org] X-BeenThere: freebsd-current@freebsd.org X-Mailman-Version: 2.1.33 Precedence: list List-Id: Discussions about the use of FreeBSD-current List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 16 Jun 2020 16:09:42 -0000 > Rodney W. Grimes wrote: > > > I'm curious if it should be possible to point to a img/iso directly (I > > > tried to use the img.xz unpacked it and make it available on a local web > > > server and that didn't seem to work for me) but maybe thats cause those > > > images miss something, so arm64 aside does that work for amd64? I.E. using > > > the bootonly.iso? > > > > One problem you run into in attemtping this is even if you get an > > image downloaded and started that image is being provided by some > > memory device driver that emulates some type of iso device. > > FreeBSD does not have a driver for that device so once the kernel > > gets to the point of mounting its root file system it falls on > > its face with a mountroot failure. > > Are you refering to something like: > > vfs.root.mountfrom="cd9660:/dev/md0.uzip" > > we boot that way all the time. What provides the cd9660 driver to FreeBSD? When you load the .iso over a network card, aka PXE/HTTP, the code that does that usually creates a ram disk and a "fake cd drive" that stops working as soon as you stop running the PXE code, which means the device does not show up while the kernel is probing. FreeBSD simply does not support bios devices in this manner, unless something has changed I am totally unaware of. -- Rod Grimes rgrimes@freebsd.org From owner-freebsd-current@freebsd.org Tue Jun 16 16:24:07 2020 Return-Path: Delivered-To: freebsd-current@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 9742934177B for ; Tue, 16 Jun 2020 16:24:07 +0000 (UTC) (envelope-from andrnils@gmail.com) Received: from mail-lj1-x230.google.com (mail-lj1-x230.google.com [IPv6:2a00:1450:4864:20::230]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "GTS CA 1O1" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 49mYRp61FBz4HXr for ; Tue, 16 Jun 2020 16:24:06 +0000 (UTC) (envelope-from andrnils@gmail.com) Received: by mail-lj1-x230.google.com with SMTP id c17so24282575lji.11 for ; Tue, 16 Jun 2020 09:24:06 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=mime-version:references:in-reply-to:from:date:message-id:subject:to :cc; bh=GXarinitELuZHopucU0QZprgRSmkxRZcpI7hXA4N1dU=; b=I2u9QvoeQRt9E7gg4yEcLa7nGnnwqew3LSMGJ8Bqhst5t3qDNO+2kFCjoYIvGls6t3 LURjN6NVlr/6kmGhG+fAv3maUEcG4be6RmEbpeULRZCXRxOIFMmtOK4cLrBXbS6K+Z3v IxXwZG3NNMSlleYtjRClLERXEdIr1nmNRItmtSlg8gGv/CzKumw2eIfqshvZQ+k8AQ6x 8gBpdDpVwbTu+oTr5FDKLFFOX/jde8nHesmfzXuiVwutxqdmzchoLb6YcECoLBwCfFEq y5fGbf6mDjWKKUj5MRB7F4S2+ikXog36XoodCxv2b3ZXH1uJLxXMLUGYCkscWD95xbB7 0gQQ== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:references:in-reply-to:from:date :message-id:subject:to:cc; bh=GXarinitELuZHopucU0QZprgRSmkxRZcpI7hXA4N1dU=; b=TU9Qjc5qRweGM/EoUzbmqJuoY/dTPqnwJ06UShylfnRDFHms2Dsh6OJvPhtgLpFdyI 3Gww2PeWFfMlgaFKNQaTOKzJX515AsHYEo4nlLMelhJm+iU844vDHldTzq6RmfX41wPx ozhn0KaQYSnCr+3cPc8TTUTnECKeCEHxnsO04Dd3qbIlJTjvTy7wVAaIHLvhWhNAmB2F TImywsEKImpppWmI4Fj4yBg6HWjoT0ri/WXi/uPE7TZTb72zISbxHdUeM658F5GzFEJ9 Ei/Cy3qXpbKp7qW2KHwHLcBBALV2xI36wjtNaOVQVaU3XpOBk0Iv2xHa+52RZR6lYGq6 isAw== X-Gm-Message-State: AOAM530cQjMqf6YgH41vrf40MbzlZ1v7plZYZthccLA4dwFUL3L9Eeq3 2U7KrTIFMi4NkNecbshlSop5BwrOtidpI4Uo/S4p9OZx X-Google-Smtp-Source: ABdhPJyCsYcoLyVJW3GOhBnsgJ6BgvqEkMbSGXPJFLxYVgDvwqjLAQKp8bsxGRvyxw8EJtPUkER0IVpvG+H7p6KXC7Q= X-Received: by 2002:a2e:9dcd:: with SMTP id x13mr2013859ljj.465.1592324643948; Tue, 16 Jun 2020 09:24:03 -0700 (PDT) MIME-Version: 1.0 References: <202006161535.05GFZJFn081325@gndrsh.dnsmgr.net> In-Reply-To: From: Andreas Nilsson Date: Tue, 16 Jun 2020 18:23:51 +0200 Message-ID: Subject: Re: CTF: UEFI HTTP boot support To: Miguel C Cc: "Rodney W. Grimes" , freebsd-current X-Rspamd-Queue-Id: 49mYRp61FBz4HXr X-Spamd-Bar: --- Authentication-Results: mx1.freebsd.org; dkim=pass header.d=gmail.com header.s=20161025 header.b=I2u9Qvoe; dmarc=pass (policy=none) header.from=gmail.com; spf=pass (mx1.freebsd.org: domain of andrnils@gmail.com designates 2a00:1450:4864:20::230 as permitted sender) smtp.mailfrom=andrnils@gmail.com X-Spamd-Result: default: False [-3.77 / 15.00]; ARC_NA(0.00)[]; NEURAL_HAM_MEDIUM(-0.86)[-0.860]; R_DKIM_ALLOW(-0.20)[gmail.com:s=20161025]; FROM_HAS_DN(0.00)[]; RCPT_COUNT_THREE(0.00)[3]; FREEMAIL_FROM(0.00)[gmail.com]; R_SPF_ALLOW(-0.20)[+ip6:2a00:1450:4000::/36]; MIME_GOOD(-0.10)[multipart/alternative,text/plain]; PREVIOUSLY_DELIVERED(0.00)[freebsd-current@freebsd.org]; NEURAL_HAM_LONG(-1.01)[-1.008]; TO_MATCH_ENVRCPT_SOME(0.00)[]; TO_DN_ALL(0.00)[]; DKIM_TRACE(0.00)[gmail.com:+]; DMARC_POLICY_ALLOW(-0.50)[gmail.com,none]; RCVD_IN_DNSWL_NONE(0.00)[2a00:1450:4864:20::230:from]; NEURAL_HAM_SHORT(-0.91)[-0.907]; FREEMAIL_TO(0.00)[gmail.com]; FROM_EQ_ENVFROM(0.00)[]; MIME_TRACE(0.00)[0:+,1:+,2:~]; FREEMAIL_ENVFROM(0.00)[gmail.com]; ASN(0.00)[asn:15169, ipnet:2a00:1450::/32, country:US]; RCVD_COUNT_TWO(0.00)[2]; RCVD_TLS_ALL(0.00)[]; DWL_DNSWL_NONE(0.00)[gmail.com:dkim] Content-Type: text/plain; charset="UTF-8" X-Content-Filtered-By: Mailman/MimeDel 2.1.33 X-BeenThere: freebsd-current@freebsd.org X-Mailman-Version: 2.1.33 Precedence: list List-Id: Discussions about the use of FreeBSD-current List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 16 Jun 2020 16:24:07 -0000 On Tue, Jun 16, 2020, 17:53 Miguel C wrote: > On Tue, Jun 16, 2020 at 4:35 PM Rodney W. Grimes < > freebsd-rwg@gndrsh.dnsmgr.net> wrote: > > > > I've been trying out FreeBSD with raspberry Pi4 (4GB) and wanted to see > > > what the state of HTTP BOOT is in FreeBSD, so I bumped into this! > > > > > > I'm curious if it should be possible to point to a img/iso directly (I > > > tried to use the img.xz unpacked it and make it available on a local > web > > > server and that didn't seem to work for me) but maybe thats cause > those > > > images miss something, so arm64 aside does that work for amd64? I.E. > > using > > > the bootonly.iso? > > > > One problem you run into in attemtping this is even if you get an > > image downloaded and started that image is being provided by some > > memory device driver that emulates some type of iso device. > > FreeBSD does not have a driver for that device so once the kernel > > gets to the point of mounting its root file system it falls on > > its face with a mountroot failure. > > > > > > > > And on the other hand is there any doc on how to set up dhcp/http > > specific > > > to FreeBSD similar to > https://en.opensuse.org/UEFI_HTTPBoot_Server_Setup > > ? > > > > Since Linux uses this idea of a kernel payload and an initrd payload > > to boot with it is much easier to get these 2 things over the network > > and then have a workable system. FreeBSD does not have the initrd > > payload and that complicates things, you need a functionaly filesystem > > avaliable at the end of kernel initilization. > > > > > > I looked into > https://www.freebsd.org/doc/handbook/network-diskless.html > > > but that doesn't seem to be up to date (or at least it focuses only on > > PXE > > > and TFTP). > > > > Yes, old but workable. I have a more advanced system that supports NFS > > booting using NFS support in PXE. The only thing done via tftp is to > > upgrade the PXE running on the client to one that speaks NFS, then the > > kernel is loaded via NFS and the root file system is later provided > > via NFS. The use of NFS provides very fast boots, and I do not need > > a web server to do it :-). > > > > > For clarification my ultimate goal is to use a few pi4's as "thin > > clients", > > > so eventually I will have to setup an image of the system with the > needed > > > software (freerdp) but for starters I just wanted to check if pointing > > > directly to a img/iso would work and that does not seem to be the case. > > > > I would strongly suggest use of NFS instead of trying to provide an > > ISO image, as you no longer need to store the ISO in memory on the > > client box, and with a pi4 your already memory contrained. > > > > Thanks for the tips, but I was really looking for HTTP BOOT info no NFS, > that's why I replied to this thread. > > I might look into that at some point if HTTP BOOT is not an option of > course, but this thread is about a Call for Testers for UEFI HTTP BOOT, not > NFS and I would like to help test, the pi4 project just conveniently > touches on the same use case (an it also does have support for http boot > using https://rpi4-uefi.dev/) so I'm curious if I can test that way. > > Other than the iso I can ofc attempt the dhcp+dns+webserver setup but for > that I would need a bit more guidance as the linked URL here is linux > centric, hence why some docs would help. > > > Am I just misremembering or can't you get freebsd to load an mfsroot-image, which can act as rw fs ? I seem to remember pc-bsd DVDs using this say 7 years ago. You would of course have to modify/build your own iso image with the mfsroot-image on it. Best regards Andreas From owner-freebsd-current@freebsd.org Tue Jun 16 16:26:28 2020 Return-Path: Delivered-To: freebsd-current@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 514E63419E9 for ; Tue, 16 Jun 2020 16:26:28 +0000 (UTC) (envelope-from sjg@juniper.net) Received: from mx0a-00273201.pphosted.com (mx0a-00273201.pphosted.com [208.84.65.16]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client CN "*.pphosted.com", Issuer "Thawte RSA CA 2018" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 49mYVW3ByFz4Hn2 for ; Tue, 16 Jun 2020 16:26:26 +0000 (UTC) (envelope-from sjg@juniper.net) Received: from pps.filterd (m0108158.ppops.net [127.0.0.1]) by mx0a-00273201.pphosted.com (8.16.0.42/8.16.0.42) with SMTP id 05GGMAas007330; Tue, 16 Jun 2020 09:26:25 -0700 Received: from nam10-mw2-obe.outbound.protection.outlook.com (mail-mw2nam10lp2102.outbound.protection.outlook.com [104.47.55.102]) by mx0a-00273201.pphosted.com with ESMTP id 31q1d8r13q-1 (version=TLSv1.2 cipher=ECDHE-RSA-AES256-GCM-SHA384 bits=256 verify=NOT); Tue, 16 Jun 2020 09:26:25 -0700 ARC-Seal: i=1; a=rsa-sha256; s=arcselector9901; d=microsoft.com; cv=none; b=YF1iHcrRMYWUa4atvhBljy5B83vL6BHP9yDsqjBm1HjqtsRJHF4mWb76BKPv+Lo3WEbZNJDKb3unX4+dzelg9cNS2+FwPjWzZf/I9Bdl2/fPA6OiKdk6BJLqnWMq1zlfIlhke75xd/k8cj4oHdX2Gs+Tw3S7zMbWPmrKPRUlFha464oLO1/xXwPhA3WYVKsdMtg9sWrqnXmLSCXRrVDSJZADzRg6M4Zdb9b6otFMWiOVZa3gHLuBtmXHAPWxZwbYsZz1U5pdpy14qgczNN6faLYyR5P7BQvI9mUUzizPxH5LkVFfLPqqEXEScz0OHKQ+nGvQfZXwyrBWVgUt9tw2/A== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=microsoft.com; s=arcselector9901; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=eHLBb0wPPp49IQZ0AtVIuQZSKtApMh0RlDB6yz+aHKo=; b=Iedh8xkPIbWUG/+dSFyKhWRi9Ys19noGAuWEKvqZthbW6DMdM2Fb+cDNdqekFI/sSUkL8yhVkYSzuBSevTvPTY/P67rqNo22Bl4r14vpAkBgb1CoiQfFSKWxyys8lWXGO6hbF0n4I11Xl/Z7JbXW0yl+Z0N8W5S/9lOezLTLKcaOGql3pcQk3OdicdipMPbznQjumrV+QcILjFekGYiF90c4NQYPVxnT52QfzvxSzUQQKxXJ3pIdlRIDOAD/BCiKDMowvHQ5HCuDUq4VorQd+VV3RzZoSRuwGdsUh/VJfZ9jWh9YqhsR9I+ltD/p0sAh82z3PuEX27umkcIzQfLGcQ== ARC-Authentication-Results: i=1; mx.microsoft.com 1; spf=softfail (sender ip is 66.129.242.13) smtp.rcpttodomain=gndrsh.dnsmgr.net smtp.mailfrom=juniper.net; dmarc=fail (p=reject sp=reject pct=100) action=oreject header.from=juniper.net; dkim=none (message not signed); arc=none Received: from DM6PR17CA0023.namprd17.prod.outlook.com (2603:10b6:5:1b3::36) by BYAPR05MB4184.namprd05.prod.outlook.com (2603:10b6:a02:91::15) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.3109.10; Tue, 16 Jun 2020 16:26:24 +0000 Received: from DM3NAM05FT026.eop-nam05.prod.protection.outlook.com (2603:10b6:5:1b3:cafe::c6) by DM6PR17CA0023.outlook.office365.com (2603:10b6:5:1b3::36) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.3088.21 via Frontend Transport; Tue, 16 Jun 2020 16:26:23 +0000 X-MS-Exchange-Authentication-Results: spf=softfail (sender IP is 66.129.242.13) smtp.mailfrom=juniper.net; gndrsh.dnsmgr.net; dkim=none (message not signed) header.d=none;gndrsh.dnsmgr.net; dmarc=fail action=oreject header.from=juniper.net; Received-SPF: SoftFail (protection.outlook.com: domain of transitioning juniper.net discourages use of 66.129.242.13 as permitted sender) Received: from P-EXFEND-EQX-02.jnpr.net (66.129.242.13) by DM3NAM05FT026.mail.protection.outlook.com (10.152.98.136) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_CBC_SHA384) id 15.20.3109.9 via Frontend Transport; Tue, 16 Jun 2020 16:26:23 +0000 Received: from P-EXBEND-EQX-02.jnpr.net (10.104.8.53) by P-EXFEND-EQX-02.jnpr.net (10.104.8.55) with Microsoft SMTP Server (TLS) id 15.0.1497.2; Tue, 16 Jun 2020 09:26:22 -0700 Received: from P-EXBEND-EQX-01.jnpr.net (10.104.8.52) by P-EXBEND-EQX-02.jnpr.net (10.104.8.53) with Microsoft SMTP Server (TLS) id 15.0.1497.2; Tue, 16 Jun 2020 09:26:20 -0700 Received: from p-mailhub01.juniper.net (10.104.20.6) by P-EXBEND-EQX-01.jnpr.net (10.104.8.52) with Microsoft SMTP Server (TLS) id 15.0.1497.2 via Frontend Transport; Tue, 16 Jun 2020 09:26:20 -0700 Received: from kaos.jnpr.net (kaos.jnpr.net [172.23.50.162]) by p-mailhub01.juniper.net (8.14.4/8.11.3) with ESMTP id 05GGQKPE007859; Tue, 16 Jun 2020 09:26:20 -0700 (envelope-from sjg@juniper.net) Received: by kaos.jnpr.net (Postfix, from userid 1377) id 5E5EFA8AF; Tue, 16 Jun 2020 09:26:20 -0700 (PDT) Received: from kaos.jnpr.net (localhost [127.0.0.1]) by kaos.jnpr.net (Postfix) with ESMTP id 5DDC9A8AE; Tue, 16 Jun 2020 09:26:20 -0700 (PDT) To: "Rodney W. Grimes" CC: Miguel C , , Subject: Re: CTF: UEFI HTTP boot support In-Reply-To: <202006161609.05GG9dRs081460@gndrsh.dnsmgr.net> References: <202006161609.05GG9dRs081460@gndrsh.dnsmgr.net> Comments: In-reply-to: "Rodney W. Grimes" message dated "Tue, 16 Jun 2020 09:09:39 -0700." From: "Simon J. Gerraty" X-Mailer: MH-E 8.6+git; nmh 1.7.1; GNU Emacs 26.3 MIME-Version: 1.0 Content-Type: text/plain; charset="us-ascii" Content-ID: <54854.1592324780.1@kaos.jnpr.net> Date: Tue, 16 Jun 2020 09:26:20 -0700 Message-ID: <56737.1592324780@kaos.jnpr.net> X-EXCLAIMER-MD-CONFIG: e3cb0ff2-54e7-4646-8a04-0dae4ac7b136 X-EOPAttributedMessage: 0 X-MS-Office365-Filtering-HT: Tenant X-Forefront-Antispam-Report: CIP:66.129.242.13; CTRY:US; LANG:en; SCL:1; SRV:; IPV:CAL; SFV:NSPM; H:P-EXFEND-EQX-02.jnpr.net; PTR:InfoDomainNonexistent; CAT:NONE; SFTY:; SFS:(4636009)(39860400002)(376002)(136003)(396003)(346002)(46966005)(336012)(478600001)(7126003)(70206006)(47076004)(26005)(55016002)(70586007)(107886003)(9686003)(82740400003)(186003)(54906003)(6266002)(5660300002)(6916009)(81166007)(8936002)(8676002)(316002)(86362001)(82310400002)(2906002)(7696005)(356005)(4326008)(83380400001); DIR:OUT; SFP:1102; X-MS-PublicTrafficType: Email X-MS-Office365-Filtering-Correlation-Id: eb17a17e-e731-4c93-758b-08d81212029a X-MS-TrafficTypeDiagnostic: BYAPR05MB4184: X-Microsoft-Antispam-PRVS: X-MS-Oob-TLC-OOBClassifiers: OLM:4941; X-Forefront-PRVS: 04362AC73B X-MS-Exchange-SenderADCheck: 1 X-Microsoft-Antispam: BCL:0; X-Microsoft-Antispam-Message-Info: pAZ32JoU+Tztfw25C8ArgG4GRZBNU0TK8B59EVkVhS6H1A7pD0BPq3w7yQ0tN6ANIXROQGarwtgOETBPG+r3025D8Cb0e9YHP7S3RnmfQao5foS4SDNRdR3CpS2jtDCI6TvdaI3Gz3pbHkMOnDZ94Isrme1NcT+XyFp00c0rXixJXrfXykijTC8AVU/5uUTGBzS/yXiXlPC3C550u8v4qXE2OkNN+DOKqcO+WLDVDXU7MU8rlkHpDBk+yxhAOJticW39Tdy6Im6It95OL3uk8MGs82jgCf5DrFDy6r5sfHX42I9w64Jh2CU6f2+iLCCvnDa1mXqG/F8pempx17J26fv6dLGhnCLwtXSOagMIFYaVVGwv0G5Dt/lneVLc+Q8LEWbPadLAsxMNeUUXUiULlg== X-OriginatorOrg: juniper.net X-MS-Exchange-CrossTenant-OriginalArrivalTime: 16 Jun 2020 16:26:23.4263 (UTC) X-MS-Exchange-CrossTenant-Network-Message-Id: eb17a17e-e731-4c93-758b-08d81212029a X-MS-Exchange-CrossTenant-Id: bea78b3c-4cdb-4130-854a-1d193232e5f4 X-MS-Exchange-CrossTenant-OriginalAttributedTenantConnectingIp: TenantId=bea78b3c-4cdb-4130-854a-1d193232e5f4; Ip=[66.129.242.13]; Helo=[P-EXFEND-EQX-02.jnpr.net] X-MS-Exchange-CrossTenant-FromEntityHeader: HybridOnPrem X-MS-Exchange-Transport-CrossTenantHeadersStamped: BYAPR05MB4184 X-Proofpoint-Virus-Version: vendor=fsecure engine=2.50.10434:6.0.216, 18.0.687 definitions=2020-06-16_10:2020-06-16, 2020-06-16 signatures=0 X-Proofpoint-Spam-Details: rule=outbound_spam_notspam policy=outbound_spam score=0 cotscore=-2147483648 adultscore=0 mlxscore=0 clxscore=1015 spamscore=0 impostorscore=0 mlxlogscore=965 lowpriorityscore=0 phishscore=0 malwarescore=0 suspectscore=0 bulkscore=0 priorityscore=1501 classifier=spam adjust=0 reason=mlx scancount=1 engine=8.12.0-2004280000 definitions=main-2006160116 X-Rspamd-Queue-Id: 49mYVW3ByFz4Hn2 X-Spamd-Bar: ----- X-Spamd-Result: default: False [-5.25 / 15.00]; NEURAL_HAM_MEDIUM(-0.86)[-0.857]; R_DKIM_ALLOW(-0.20)[juniper.net:s=PPS1017,juniper.net:s=selector1]; FROM_HAS_DN(0.00)[]; RCPT_COUNT_THREE(0.00)[4]; TO_DN_SOME(0.00)[]; R_SPF_ALLOW(-0.20)[+ip4:208.84.65.16]; MIME_GOOD(-0.10)[text/plain]; NEURAL_HAM_LONG(-1.00)[-0.996]; ARC_ALLOW(-1.00)[microsoft.com:s=arcselector9901:i=1]; TO_MATCH_ENVRCPT_SOME(0.00)[]; DKIM_TRACE(0.00)[juniper.net:+]; DMARC_POLICY_ALLOW(-0.50)[juniper.net,reject]; NEURAL_HAM_SHORT(-1.30)[-1.301]; RCVD_IN_DNSWL_LOW(-0.10)[208.84.65.16:from]; FROM_EQ_ENVFROM(0.00)[]; MIME_TRACE(0.00)[0:+]; ASN(0.00)[asn:26211, ipnet:208.84.65.0/24, country:US]; RCVD_TLS_LAST(0.00)[]; RCVD_COUNT_SEVEN(0.00)[11]; FREEMAIL_CC(0.00)[gmail.com,freebsd.org,juniper.net] X-BeenThere: freebsd-current@freebsd.org X-Mailman-Version: 2.1.33 Precedence: list List-Id: Discussions about the use of FreeBSD-current List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 16 Jun 2020 16:26:28 -0000 Rodney W. Grimes wrote: > > Are you refering to something like: > > > > vfs.root.mountfrom="cd9660:/dev/md0.uzip" > > > > we boot that way all the time. > > What provides the cd9660 driver to FreeBSD? When you load the .iso > over a network card, aka PXE/HTTP, the code that does that usually > creates a ram disk and a "fake cd drive" that stops working as soon We don't use PXE much except in a bringup lab, and then I think we use NFS for rootfs. Normally if iso is comming from network it is to do an install eg loader is doing 'install tftp://host/install.tar' The "fake cd drive" is in the kernel, loader just copies the iso into memory like any other module, and by the time that's done you just reboot into the newly installed system, which again uses vfs.root.mountfrom="cd9660:/dev/md0.uzip" but in that case the rootfs is an iso image on local disk. The rootfs iso is minimal - enough to fsck and mount real media and initialize Verified Exec. It improves our chances of being able to recover from severe disk corruption after cleaning lady pulls the cord, to vaccuum ;-) --sjg From owner-freebsd-current@freebsd.org Tue Jun 16 16:27:13 2020 Return-Path: Delivered-To: freebsd-current@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 86D57341B44 for ; Tue, 16 Jun 2020 16:27:13 +0000 (UTC) (envelope-from miguelmclara@gmail.com) Received: from mail-pg1-x52c.google.com (mail-pg1-x52c.google.com [IPv6:2607:f8b0:4864:20::52c]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "GTS CA 1O1" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 49mYWN5VVMz4J9K for ; Tue, 16 Jun 2020 16:27:12 +0000 (UTC) (envelope-from miguelmclara@gmail.com) Received: by mail-pg1-x52c.google.com with SMTP id v11so1454831pgb.6 for ; Tue, 16 Jun 2020 09:27:12 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=mime-version:references:in-reply-to:from:date:message-id:subject:to :cc; bh=absZvigN0Iw+eLCFj+IAsM7wGv+ni09VhkftGmk/HuQ=; b=hRfoccmsXVCt+2K7NpRfjzpXVt4GP8EsSnc1ashFcyhCUGnVSy7qVammn64lfbIUGz xOsUF33P6zDAW5WIgqFPr7tT/6TKMsAyrYGsE+GddwSi4y4dfNkuFLN5L4QEvvGCVzkI a+ZTvQ1q1MIe/gRyz1I0mq3voxx8gQ0Z9teI4yrniBrq+pLANuRMAg3EZP4a2QZKrfuI fqezG8XlP6eLGiR1mCSJ31iRNrNVhZEDpXvRoOEfECyTYosIkIRA9uwiFPCiIyJLKvCx F0B/6POR5E8GOMLQXZGB1tF2VgLSbMCy5Dt32Pitr0uL8ilgYRvb+TqEqcuBozzJ50Hm 1WVA== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:references:in-reply-to:from:date :message-id:subject:to:cc; bh=absZvigN0Iw+eLCFj+IAsM7wGv+ni09VhkftGmk/HuQ=; b=LX6I3CWA4uzANWfgFlPTn6pxMq4K3d1Nfy7DntW1jd76TxiZbGkBxchnTxJte30pS7 ILUS8SQuf8YyOX4XHc1kiVuvOickuUDuT9DvxZPFmtiu67Ffn1mf0eG236MRe9pAilz7 lOnOv3ZmHAbfH+V6vzrFax7LZl1OnmwZ1gZ1deqpgpGr7t5vCQIifpb5BjwUfP7Hvplw NlaqiH2j3vmP44kYset7hQCebDtTMiFAH1h12Oh6mrbA8Yyr/CugEXK5PeSjht3tAxAx 9T9pXouYW4lbL1AK6z68JlXSqwLGGCPUbhPGkK2SfxM0wbhhKAO9ejBtTqHXt6lNpTFF u3ZQ== X-Gm-Message-State: AOAM531Km6zi8bHawzYjKd/OxoQ5mpyvVopxDbntlL/3x+5mUa1XU0f9 dBgb9FGz5CDZzXhTQZ9Tjwcll4DLwaqusYc2lIbE+ZXj X-Google-Smtp-Source: ABdhPJxrA2VJuX4N/nfX/PlXhHObY1tGMbGF7U0w3R/DUo/TFnecIlvVumrA+w8Hii2Q4nhjhbVrFqX+mlJ3lO9VRXA= X-Received: by 2002:a63:8f46:: with SMTP id r6mr2772619pgn.257.1592324831376; Tue, 16 Jun 2020 09:27:11 -0700 (PDT) MIME-Version: 1.0 References: <5957.1592322514@kaos.jnpr.net> <202006161609.05GG9dRs081460@gndrsh.dnsmgr.net> In-Reply-To: <202006161609.05GG9dRs081460@gndrsh.dnsmgr.net> From: Miguel C Date: Tue, 16 Jun 2020 17:26:34 +0100 Message-ID: Subject: Re: CTF: UEFI HTTP boot support To: "Rodney W. Grimes" Cc: "Simon J. Gerraty" , freebsd-current X-Rspamd-Queue-Id: 49mYWN5VVMz4J9K X-Spamd-Bar: --- Authentication-Results: mx1.freebsd.org; dkim=pass header.d=gmail.com header.s=20161025 header.b=hRfoccms; dmarc=pass (policy=none) header.from=gmail.com; spf=pass (mx1.freebsd.org: domain of miguelmclara@gmail.com designates 2607:f8b0:4864:20::52c as permitted sender) smtp.mailfrom=miguelmclara@gmail.com X-Spamd-Result: default: False [-3.77 / 15.00]; ARC_NA(0.00)[]; NEURAL_HAM_MEDIUM(-0.87)[-0.871]; R_DKIM_ALLOW(-0.20)[gmail.com:s=20161025]; FROM_HAS_DN(0.00)[]; RCPT_COUNT_THREE(0.00)[3]; R_SPF_ALLOW(-0.20)[+ip6:2607:f8b0:4000::/36:c]; FREEMAIL_FROM(0.00)[gmail.com]; MIME_GOOD(-0.10)[multipart/alternative,text/plain]; PREVIOUSLY_DELIVERED(0.00)[freebsd-current@freebsd.org]; NEURAL_HAM_LONG(-1.00)[-0.997]; TO_MATCH_ENVRCPT_SOME(0.00)[]; TO_DN_ALL(0.00)[]; DKIM_TRACE(0.00)[gmail.com:+]; DMARC_POLICY_ALLOW(-0.50)[gmail.com,none]; RCVD_IN_DNSWL_NONE(0.00)[2607:f8b0:4864:20::52c:from]; NEURAL_HAM_SHORT(-0.91)[-0.907]; FROM_EQ_ENVFROM(0.00)[]; MIME_TRACE(0.00)[0:+,1:+,2:~]; FREEMAIL_ENVFROM(0.00)[gmail.com]; ASN(0.00)[asn:15169, ipnet:2607:f8b0::/32, country:US]; RCVD_COUNT_TWO(0.00)[2]; RCVD_TLS_ALL(0.00)[]; DWL_DNSWL_NONE(0.00)[gmail.com:dkim] Content-Type: text/plain; charset="UTF-8" X-Content-Filtered-By: Mailman/MimeDel 2.1.33 X-BeenThere: freebsd-current@freebsd.org X-Mailman-Version: 2.1.33 Precedence: list List-Id: Discussions about the use of FreeBSD-current List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 16 Jun 2020 16:27:13 -0000 I don't think it needs the cdrom driver does it? UEF accepts a iso (since 2.5) has a http boot URI and that is mounted as a ramdisk via the http boot driver itself (I think, this is all a bit new to me too :) Most of the info I found on it is from tiano core: https://github.com/tianocore/tianocore.github.io/wiki/HTTP-Boot) I did just find the presentation/demo of this working with the FreeBSD amd64 iso that I bumped into before: https://bhyvecon.org/bhyveconOttawa2019-DScott.pdf From owner-freebsd-current@freebsd.org Tue Jun 16 16:46:56 2020 Return-Path: Delivered-To: freebsd-current@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id EC62E34384E for ; Tue, 16 Jun 2020 16:46:56 +0000 (UTC) (envelope-from freebsd-rwg@gndrsh.dnsmgr.net) Received: from gndrsh.dnsmgr.net (br1.CN84in.dnsmgr.net [69.59.192.140]) (using TLSv1 with cipher DHE-RSA-AES256-SHA (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 49mYy75PQsz4Lmp for ; Tue, 16 Jun 2020 16:46:55 +0000 (UTC) (envelope-from freebsd-rwg@gndrsh.dnsmgr.net) Received: from gndrsh.dnsmgr.net (localhost [127.0.0.1]) by gndrsh.dnsmgr.net (8.13.3/8.13.3) with ESMTP id 05GGkqZp081795; Tue, 16 Jun 2020 09:46:52 -0700 (PDT) (envelope-from freebsd-rwg@gndrsh.dnsmgr.net) Received: (from freebsd-rwg@localhost) by gndrsh.dnsmgr.net (8.13.3/8.13.3/Submit) id 05GGkqP7081794; Tue, 16 Jun 2020 09:46:52 -0700 (PDT) (envelope-from freebsd-rwg) From: "Rodney W. Grimes" Message-Id: <202006161646.05GGkqP7081794@gndrsh.dnsmgr.net> Subject: Re: CTF: UEFI HTTP boot support In-Reply-To: To: Andreas Nilsson Date: Tue, 16 Jun 2020 09:46:52 -0700 (PDT) CC: Miguel C , "Rodney W. Grimes" , freebsd-current X-Mailer: ELM [version 2.4ME+ PL121h (25)] MIME-Version: 1.0 Content-Transfer-Encoding: 7bit Content-Type: text/plain; charset=US-ASCII X-Rspamd-Queue-Id: 49mYy75PQsz4Lmp X-Spamd-Bar: ++ Authentication-Results: mx1.freebsd.org; dkim=none; dmarc=none; spf=none (mx1.freebsd.org: domain of freebsd-rwg@gndrsh.dnsmgr.net has no SPF policy when checking 69.59.192.140) smtp.mailfrom=freebsd-rwg@gndrsh.dnsmgr.net X-Spamd-Result: default: False [2.15 / 15.00]; RCVD_TLS_LAST(0.00)[]; ARC_NA(0.00)[]; FROM_HAS_DN(0.00)[]; RCPT_COUNT_THREE(0.00)[4]; NEURAL_SPAM_SHORT(0.58)[0.580]; MIME_GOOD(-0.10)[text/plain]; DMARC_NA(0.00)[dnsmgr.net]; AUTH_NA(1.00)[]; NEURAL_SPAM_MEDIUM(0.55)[0.545]; TO_MATCH_ENVRCPT_SOME(0.00)[]; TO_DN_ALL(0.00)[]; NEURAL_SPAM_LONG(0.13)[0.129]; R_SPF_NA(0.00)[no SPF record]; FREEMAIL_TO(0.00)[gmail.com]; FROM_EQ_ENVFROM(0.00)[]; R_DKIM_NA(0.00)[]; MIME_TRACE(0.00)[0:+]; ASN(0.00)[asn:13868, ipnet:69.59.192.0/19, country:US]; FREEMAIL_CC(0.00)[gmail.com,gndrsh.dnsmgr.net,freebsd.org]; MID_RHS_MATCH_FROM(0.00)[]; RCVD_COUNT_TWO(0.00)[2] X-BeenThere: freebsd-current@freebsd.org X-Mailman-Version: 2.1.33 Precedence: list List-Id: Discussions about the use of FreeBSD-current List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 16 Jun 2020 16:46:57 -0000 > On Tue, Jun 16, 2020, 17:53 Miguel C wrote: > > > On Tue, Jun 16, 2020 at 4:35 PM Rodney W. Grimes < > > freebsd-rwg@gndrsh.dnsmgr.net> wrote: > > > > > > I've been trying out FreeBSD with raspberry Pi4 (4GB) and wanted to see > > > > what the state of HTTP BOOT is in FreeBSD, so I bumped into this! > > > > > > > > I'm curious if it should be possible to point to a img/iso directly (I > > > > tried to use the img.xz unpacked it and make it available on a local > > web > > > > server and that didn't seem to work for me) but maybe thats cause > > those > > > > images miss something, so arm64 aside does that work for amd64? I.E. > > > using > > > > the bootonly.iso? > > > > > > One problem you run into in attemtping this is even if you get an > > > image downloaded and started that image is being provided by some > > > memory device driver that emulates some type of iso device. > > > FreeBSD does not have a driver for that device so once the kernel > > > gets to the point of mounting its root file system it falls on > > > its face with a mountroot failure. > > > > > > > > > > > And on the other hand is there any doc on how to set up dhcp/http > > > specific > > > > to FreeBSD similar to > > https://en.opensuse.org/UEFI_HTTPBoot_Server_Setup > > > ? > > > > > > Since Linux uses this idea of a kernel payload and an initrd payload > > > to boot with it is much easier to get these 2 things over the network > > > and then have a workable system. FreeBSD does not have the initrd > > > payload and that complicates things, you need a functionaly filesystem > > > avaliable at the end of kernel initilization. > > > > > > > > I looked into > > https://www.freebsd.org/doc/handbook/network-diskless.html > > > > but that doesn't seem to be up to date (or at least it focuses only on > > > PXE > > > > and TFTP). > > > > > > Yes, old but workable. I have a more advanced system that supports NFS > > > booting using NFS support in PXE. The only thing done via tftp is to > > > upgrade the PXE running on the client to one that speaks NFS, then the > > > kernel is loaded via NFS and the root file system is later provided > > > via NFS. The use of NFS provides very fast boots, and I do not need > > > a web server to do it :-). > > > > > > > For clarification my ultimate goal is to use a few pi4's as "thin > > > clients", > > > > so eventually I will have to setup an image of the system with the > > needed > > > > software (freerdp) but for starters I just wanted to check if pointing > > > > directly to a img/iso would work and that does not seem to be the case. > > > > > > I would strongly suggest use of NFS instead of trying to provide an > > > ISO image, as you no longer need to store the ISO in memory on the > > > client box, and with a pi4 your already memory contrained. > > > > > > > Thanks for the tips, but I was really looking for HTTP BOOT info no NFS, > > that's why I replied to this thread. > > > > I might look into that at some point if HTTP BOOT is not an option of > > course, but this thread is about a Call for Testers for UEFI HTTP BOOT, not > > NFS and I would like to help test, the pi4 project just conveniently > > touches on the same use case (an it also does have support for http boot > > using https://rpi4-uefi.dev/) so I'm curious if I can test that way. > > > > Other than the iso I can ofc attempt the dhcp+dns+webserver setup but for > > that I would need a bit more guidance as the linked URL here is linux > > centric, hence why some docs would help. > > > > > > > > Am I just misremembering or can't you get freebsd to load an mfsroot-image, > which can act as rw fs ? Yes, but that is *not* an .iso as was asked above. > I seem to remember pc-bsd DVDs using this say 7 years ago. Yes. > > You would of course have to modify/build your own iso image with the > mfsroot-image on it. Perhaps, if you can get the mfsroot image into memory by the loader while you still have access to the bios code. > Best regards > Andreas -- Rod Grimes rgrimes@freebsd.org From owner-freebsd-current@freebsd.org Tue Jun 16 16:50:47 2020 Return-Path: Delivered-To: freebsd-current@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 6C1F1343BB8 for ; Tue, 16 Jun 2020 16:50:47 +0000 (UTC) (envelope-from freebsd-rwg@gndrsh.dnsmgr.net) Received: from gndrsh.dnsmgr.net (br1.CN84in.dnsmgr.net [69.59.192.140]) (using TLSv1 with cipher DHE-RSA-AES256-SHA (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 49mZ2Z5MXmz4MBq for ; Tue, 16 Jun 2020 16:50:46 +0000 (UTC) (envelope-from freebsd-rwg@gndrsh.dnsmgr.net) Received: from gndrsh.dnsmgr.net (localhost [127.0.0.1]) by gndrsh.dnsmgr.net (8.13.3/8.13.3) with ESMTP id 05GGojuB081829; Tue, 16 Jun 2020 09:50:45 -0700 (PDT) (envelope-from freebsd-rwg@gndrsh.dnsmgr.net) Received: (from freebsd-rwg@localhost) by gndrsh.dnsmgr.net (8.13.3/8.13.3/Submit) id 05GGoj1M081828; Tue, 16 Jun 2020 09:50:45 -0700 (PDT) (envelope-from freebsd-rwg) From: "Rodney W. Grimes" Message-Id: <202006161650.05GGoj1M081828@gndrsh.dnsmgr.net> Subject: Re: CTF: UEFI HTTP boot support In-Reply-To: <56737.1592324780@kaos.jnpr.net> To: "Simon J. Gerraty" Date: Tue, 16 Jun 2020 09:50:45 -0700 (PDT) CC: "Rodney W. Grimes" , Miguel C , freebsd-current@freebsd.org X-Mailer: ELM [version 2.4ME+ PL121h (25)] MIME-Version: 1.0 Content-Transfer-Encoding: 7bit Content-Type: text/plain; charset=US-ASCII X-Rspamd-Queue-Id: 49mZ2Z5MXmz4MBq X-Spamd-Bar: / Authentication-Results: mx1.freebsd.org; dkim=none; dmarc=none; spf=none (mx1.freebsd.org: domain of freebsd-rwg@gndrsh.dnsmgr.net has no SPF policy when checking 69.59.192.140) smtp.mailfrom=freebsd-rwg@gndrsh.dnsmgr.net X-Spamd-Result: default: False [0.98 / 15.00]; RCVD_TLS_LAST(0.00)[]; ARC_NA(0.00)[]; NEURAL_HAM_MEDIUM(-0.51)[-0.512]; FROM_HAS_DN(0.00)[]; RCPT_COUNT_THREE(0.00)[4]; TO_DN_SOME(0.00)[]; NEURAL_HAM_LONG(-0.10)[-0.105]; MIME_GOOD(-0.10)[text/plain]; DMARC_NA(0.00)[dnsmgr.net]; AUTH_NA(1.00)[]; NEURAL_SPAM_SHORT(0.70)[0.696]; TO_MATCH_ENVRCPT_SOME(0.00)[]; R_SPF_NA(0.00)[no SPF record]; FROM_EQ_ENVFROM(0.00)[]; R_DKIM_NA(0.00)[]; MIME_TRACE(0.00)[0:+]; RCVD_COUNT_TWO(0.00)[2]; ASN(0.00)[asn:13868, ipnet:69.59.192.0/19, country:US]; MID_RHS_MATCH_FROM(0.00)[]; FREEMAIL_CC(0.00)[gndrsh.dnsmgr.net,gmail.com,freebsd.org] X-BeenThere: freebsd-current@freebsd.org X-Mailman-Version: 2.1.33 Precedence: list List-Id: Discussions about the use of FreeBSD-current List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 16 Jun 2020 16:50:47 -0000 > Rodney W. Grimes wrote: > > > Are you refering to something like: > > > > > > vfs.root.mountfrom="cd9660:/dev/md0.uzip" > > > > > > we boot that way all the time. > > > > What provides the cd9660 driver to FreeBSD? When you load the .iso > > over a network card, aka PXE/HTTP, the code that does that usually > > creates a ram disk and a "fake cd drive" that stops working as soon > > We don't use PXE much except in a bringup lab, and then I think we use > NFS for rootfs. Probably much like what I do once my kernel is loaded. > Normally if iso is comming from network it is to do an install > eg loader is doing 'install tftp://host/install.tar' > > The "fake cd drive" is in the kernel, loader just copies the iso into > memory like any other module, and by the time that's done you just > reboot into the newly installed system, which again uses > > vfs.root.mountfrom="cd9660:/dev/md0.uzip" ^^^ Argh, the cd9660 confused me, I think your doing a "root on mfs/md"? > but in that case the rootfs is an iso image on local disk. > > The rootfs iso is minimal - enough to fsck and mount real media > and initialize Verified Exec. > It improves our chances of being able to recover from severe disk > corruption after cleaning lady pulls the cord, to vaccuum ;-) > > --sjg > _______________________________________________ > freebsd-current@freebsd.org mailing list > https://lists.freebsd.org/mailman/listinfo/freebsd-current > To unsubscribe, send any mail to "freebsd-current-unsubscribe@freebsd.org" > -- Rod Grimes rgrimes@freebsd.org From owner-freebsd-current@freebsd.org Tue Jun 16 18:25:20 2020 Return-Path: Delivered-To: freebsd-current@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 1A45F346AAF for ; Tue, 16 Jun 2020 18:25:20 +0000 (UTC) (envelope-from rebecca@bsdio.com) Received: from out02.mta.xmission.com (out02.mta.xmission.com [166.70.13.232]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 49mc7g0kMdz4V5R for ; Tue, 16 Jun 2020 18:25:18 +0000 (UTC) (envelope-from rebecca@bsdio.com) DKIM-Signature: v=1; a=rsa-sha256; q=dns/txt; c=simple/simple; d=bsdio.com; s=xmission; h=Subject:Content-Transfer-Encoding:Content-Type:In-Reply-To: MIME-Version:Date:Message-ID:From:References:To:Sender:Reply-To:Cc:Content-ID :Content-Description:Resent-Date:Resent-From:Resent-Sender:Resent-To: Resent-Cc:Resent-Message-ID:List-Id:List-Help:List-Unsubscribe:List-Subscribe :List-Post:List-Owner:List-Archive; bh=ufsIagRun8Flx0/II/mIQSq7GFO4SrCSIzdUO6ekwMs=; b=DQMzu0++ElwEZbD5ZBVo9jv/bk 2ojnhAe64c4lXsiZE0tX36oJdzwsBXKEZXYBCKp3cfwUGoEtpSsgaT0EMPHPIfOPZaW/qlZgXaelI BJ/2RImtmlvwnS1404tvlroTpqEEJsIHHyJqVm4qj/sXtWppeYD3nDLhhQKKR2/4sVcU=; Received: from in01.mta.xmission.com ([166.70.13.51]) by out02.mta.xmission.com with esmtps (TLS1.2:ECDHE_RSA_AES_128_GCM_SHA256:128) (Exim 4.90_1) (envelope-from ) id 1jlGGq-0007w8-Qg; Tue, 16 Jun 2020 12:25:16 -0600 Received: from mta4.zcs.xmission.com ([166.70.13.68]) by in01.mta.xmission.com with esmtps (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.87) (envelope-from ) id 1jlGGq-0003QB-4C; Tue, 16 Jun 2020 12:25:16 -0600 Received: from localhost (localhost [127.0.0.1]) by mta4.zcs.xmission.com (Postfix) with ESMTP id A8643500BE5; Tue, 16 Jun 2020 12:25:15 -0600 (MDT) X-Amavis-Modified: Mail body modified (using disclaimer) - mta4.zcs.xmission.com Received: from mta4.zcs.xmission.com ([127.0.0.1]) by localhost (mta4.zcs.xmission.com [127.0.0.1]) (amavisd-new, port 10026) with ESMTP id NH7EYWF0_E4i; Tue, 16 Jun 2020 12:25:15 -0600 (MDT) Received: from [10.0.10.120] (c-174-52-16-57.hsd1.ut.comcast.net [174.52.16.57]) by mta4.zcs.xmission.com (Postfix) with ESMTPSA id 7170C500547; Tue, 16 Jun 2020 12:25:15 -0600 (MDT) To: Miguel C , freebsd-current@freebsd.org References: From: Rebecca Cran Message-ID: <0b38b537-9d9b-b3ae-bae3-bb5b4926bbaa@bsdio.com> Date: Tue, 16 Jun 2020 12:25:14 -0600 User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:68.0) Gecko/20100101 Thunderbird/68.8.0 MIME-Version: 1.0 In-Reply-To: Content-Type: text/plain; charset=utf-8; format=flowed Content-Transfer-Encoding: 7bit Content-Language: en-US X-XM-SPF: eid=1jlGGq-0003QB-4C; ; ; mid=<0b38b537-9d9b-b3ae-bae3-bb5b4926bbaa@bsdio.com>; ; ; hst=in01.mta.xmission.com; ; ; ip=166.70.13.68; ; ; frm=rebecca@bsdio.com; ; ; spf=pass X-SA-Exim-Connect-IP: 166.70.13.68 X-SA-Exim-Mail-From: rebecca@bsdio.com X-Spam-Checker-Version: SpamAssassin 3.4.2 (2018-09-13) on sa02.xmission.com X-Spam-Level: X-Spam-Status: No, score=0.1 required=8.0 tests=ALL_TRUSTED,BAYES_50, DCC_CHECK_NEGATIVE,T_TM2_M_HEADER_IN_MSG,TooManyTo_001 autolearn=disabled version=3.4.2 X-Spam-Virus: No X-Spam-Report: * -1.0 ALL_TRUSTED Passed through trusted hosts only via SMTP * 0.8 BAYES_50 BODY: Bayes spam probability is 40 to 60% * [score: 0.5000] * 0.3 TooManyTo_001 Multiple "To" Header Recipients 2x (uncommon) * 0.0 T_TM2_M_HEADER_IN_MSG BODY: No description available. * -0.0 DCC_CHECK_NEGATIVE Not listed in DCC * [sa02 0; Body=1 Fuz1=1 Fuz2=1] X-Spam-DCC: ; sa02 0; Body=1 Fuz1=1 Fuz2=1 X-Spam-Combo: ;Miguel C , freebsd-current@freebsd.org X-Spam-Relay-Country: X-Spam-Timing: total 390 ms - load_scoreonly_sql: 0.03 (0.0%), signal_user_changed: 3.6 (0.9%), b_tie_ro: 2.6 (0.7%), parse: 0.79 (0.2%), extract_message_metadata: 3.0 (0.8%), get_uri_detail_list: 0.47 (0.1%), tests_pri_-1000: 1.95 (0.5%), tests_pri_-950: 1.05 (0.3%), tests_pri_-900: 0.89 (0.2%), tests_pri_-90: 79 (20.4%), check_bayes: 78 (20.0%), b_tokenize: 4.1 (1.0%), b_tok_get_all: 4.9 (1.3%), b_comp_prob: 1.51 (0.4%), b_tok_touch_all: 65 (16.6%), b_finish: 0.82 (0.2%), tests_pri_0: 290 (74.4%), check_dkim_signature: 0.41 (0.1%), check_dkim_adsp: 171 (43.9%), poll_dns_idle: 165 (42.3%), tests_pri_10: 1.84 (0.5%), tests_pri_500: 6 (1.4%), rewrite_mail: 0.00 (0.0%) Subject: Re: CTF: UEFI HTTP boot support X-Spam-Flag: No X-SA-Exim-Version: 4.2.1 (built Thu, 05 May 2016 13:38:54 -0600) X-SA-Exim-Scanned: Yes (on in01.mta.xmission.com) X-Rspamd-Queue-Id: 49mc7g0kMdz4V5R X-Spamd-Bar: --- Authentication-Results: mx1.freebsd.org; dkim=pass header.d=bsdio.com header.s=xmission header.b=DQMzu0++; dmarc=none; spf=pass (mx1.freebsd.org: domain of rebecca@bsdio.com designates 166.70.13.232 as permitted sender) smtp.mailfrom=rebecca@bsdio.com X-Spamd-Result: default: False [-3.67 / 15.00]; RCVD_VIA_SMTP_AUTH(0.00)[]; ARC_NA(0.00)[]; RCVD_COUNT_FIVE(0.00)[6]; R_DKIM_ALLOW(-0.20)[bsdio.com:s=xmission]; FROM_HAS_DN(0.00)[]; TO_DN_SOME(0.00)[]; RWL_MAILSPIKE_GOOD(0.00)[166.70.13.232:from]; R_SPF_ALLOW(-0.20)[+ip4:166.70.13.0/24]; MIME_GOOD(-0.10)[text/plain]; DMARC_NA(0.00)[bsdio.com]; NEURAL_HAM_LONG(-1.04)[-1.037]; RECEIVED_SPAMHAUS_PBL(0.00)[174.52.16.57:received]; TO_MATCH_ENVRCPT_SOME(0.00)[]; DKIM_TRACE(0.00)[bsdio.com:+]; RCPT_COUNT_TWO(0.00)[2]; NEURAL_HAM_SHORT(-1.16)[-1.157]; NEURAL_HAM_MEDIUM(-0.87)[-0.874]; FREEMAIL_TO(0.00)[gmail.com,freebsd.org]; FROM_EQ_ENVFROM(0.00)[]; MIME_TRACE(0.00)[0:+]; RCVD_TLS_LAST(0.00)[]; ASN(0.00)[asn:6315, ipnet:166.70.0.0/16, country:US]; MID_RHS_MATCH_FROM(0.00)[]; RCVD_IN_DNSWL_LOW(-0.10)[166.70.13.232:from] X-BeenThere: freebsd-current@freebsd.org X-Mailman-Version: 2.1.33 Precedence: list List-Id: Discussions about the use of FreeBSD-current List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 16 Jun 2020 18:25:20 -0000 On 6/16/20 5:17 AM, Miguel C wrote: > I've been trying out FreeBSD with raspberry Pi4 (4GB) and wanted to see > what the state of HTTP BOOT is in FreeBSD, so I bumped into this! > > I'm curious if it should be possible to point to a img/iso directly (I > tried to use the img.xz unpacked it and make it available on a local web > server and that didn't seem to work for me) but maybe thats cause those > images miss something, so arm64 aside does that work for amd64? I.E. using > the bootonly.iso? Unfortunately HTTP boot only works as far as the kernel: UEFI fetches loader.efi, the loader fetches and runs the kernel over HTTP -- and then you need to use NFS to mount the filesystem (or have a local root filesystem). UEFI also has RamDisk support, but I don't think that's for remote ISO/disk files, just local files. -- Rebecca Cran From owner-freebsd-current@freebsd.org Tue Jun 16 21:36:15 2020 Return-Path: Delivered-To: freebsd-current@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id EF2A1335B57 for ; Tue, 16 Jun 2020 21:36:15 +0000 (UTC) (envelope-from miguelmclara@gmail.com) Received: from mail-pl1-x632.google.com (mail-pl1-x632.google.com [IPv6:2607:f8b0:4864:20::632]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "GTS CA 1O1" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 49mhMz22GZz3Wv1 for ; Tue, 16 Jun 2020 21:36:15 +0000 (UTC) (envelope-from miguelmclara@gmail.com) Received: by mail-pl1-x632.google.com with SMTP id y18so9007997plr.4 for ; Tue, 16 Jun 2020 14:36:15 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=mime-version:references:in-reply-to:from:date:message-id:subject:to :cc; bh=h2aEvezDyamY6xo4hmgOpH8V+KJ1KNn64XIVEwPYj0A=; b=djBp//ICHOL6YGT5wZ3+sl4RXHng62+p9W906yc6XabvLsL/4ignoSsuWuM8rfCf/t Izio7IUn86375bsMWUBYLj5w/IbmuNaRFDgw+sSejWeZQkFUMzrCC9G3apdJ99QdyZmN hiz5nlmtLavgMxpuqxjCjspdM4WNR/pxgHOWOpjYU/+agPpKJWShWQfQyAtdDwJBGCO9 vzCmQDxfoqTIZOgMYxzBK1hdd6u6Z4Uh3ZAmeu9MIH5SjVHBiSrGFlq40N7D/lM4AC7v 7eH2N59lQdbhg6VmwYkqD2AisKbjGSQyigCvv5tV+K/ihHXYKGbIqMuO4d3iIqoVxWsp WLxg== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:references:in-reply-to:from:date :message-id:subject:to:cc; bh=h2aEvezDyamY6xo4hmgOpH8V+KJ1KNn64XIVEwPYj0A=; b=l8nNGfhkgDWzLmx3TjAWCUL7Ogb9M513W7kgqF5CWtlAnvKUbS/Gqx1whsZmtFz46h j7YLmBwY44y3MEQ6NySKYRHxBOvDMsISwHo1NeBpHS3tFAMRFtEJq6tVFseoKCmINLyX AgsPhTJT8PRZuMCwNXihUHPkhwTPPFBzwh1fxZOCJ12R1NISlZdPas6WzDj4hzOvaFk7 Z7g5TsQ/bRsDqcIDcdXwGeWvlnf6yYixJhZL60OCyd3KHVaGWusbjbUbi08CJ4QXXVl9 Fk9NN/TWM9gRYrCJXxtb9XZoi4e6fZvlqeWP24puzYQ+ZYk7HqV4L0/hfHNDzXrykxM9 QyEQ== X-Gm-Message-State: AOAM530QhqIgpLpSj9/fNROXPWC0os0INdH8JP9AESnmUwUr0Rf24l1U 1YUoZwL3o9Eh9xj5wnNzoOZK+3eG8Y1SN0UnOl/2qgJpBzA= X-Google-Smtp-Source: ABdhPJzZ1t27QGDWT3Vfh5Ns7aX100n3q+EaZhy23hp8yvMNM1o+Gk7WPcRAlkq4C0l8B4wZx1pJ08WZG6DTGsWmtdc= X-Received: by 2002:a17:902:8d97:: with SMTP id v23mr3786453plo.3.1592343373830; Tue, 16 Jun 2020 14:36:13 -0700 (PDT) MIME-Version: 1.0 References: <0b38b537-9d9b-b3ae-bae3-bb5b4926bbaa@bsdio.com> In-Reply-To: <0b38b537-9d9b-b3ae-bae3-bb5b4926bbaa@bsdio.com> From: Miguel C Date: Tue, 16 Jun 2020 22:35:37 +0100 Message-ID: Subject: Re: CTF: UEFI HTTP boot support To: Rebecca Cran Cc: freebsd-current X-Rspamd-Queue-Id: 49mhMz22GZz3Wv1 X-Spamd-Bar: - Authentication-Results: mx1.freebsd.org; dkim=pass header.d=gmail.com header.s=20161025 header.b=djBp//IC; dmarc=pass (policy=none) header.from=gmail.com; spf=pass (mx1.freebsd.org: domain of miguelmclara@gmail.com designates 2607:f8b0:4864:20::632 as permitted sender) smtp.mailfrom=miguelmclara@gmail.com X-Spamd-Result: default: False [-1.24 / 15.00]; ARC_NA(0.00)[]; NEURAL_HAM_MEDIUM(-0.91)[-0.909]; R_DKIM_ALLOW(-0.20)[gmail.com:s=20161025]; FROM_HAS_DN(0.00)[]; R_SPF_ALLOW(-0.20)[+ip6:2607:f8b0:4000::/36:c]; FREEMAIL_FROM(0.00)[gmail.com]; MIME_GOOD(-0.10)[multipart/alternative,text/plain]; PREVIOUSLY_DELIVERED(0.00)[freebsd-current@freebsd.org]; NEURAL_HAM_LONG(-1.01)[-1.008]; URI_COUNT_ODD(1.00)[1]; TO_MATCH_ENVRCPT_SOME(0.00)[]; TO_DN_ALL(0.00)[]; DKIM_TRACE(0.00)[gmail.com:+]; RCPT_COUNT_TWO(0.00)[2]; DMARC_POLICY_ALLOW(-0.50)[gmail.com,none]; HTTP_TO_IP(1.00)[]; RCVD_IN_DNSWL_NONE(0.00)[2607:f8b0:4864:20::632:from]; NEURAL_HAM_SHORT(-0.32)[-0.321]; FROM_EQ_ENVFROM(0.00)[]; MIME_TRACE(0.00)[0:+,1:+,2:~]; FREEMAIL_ENVFROM(0.00)[gmail.com]; ASN(0.00)[asn:15169, ipnet:2607:f8b0::/32, country:US]; RCVD_COUNT_TWO(0.00)[2]; RCVD_TLS_ALL(0.00)[]; DWL_DNSWL_NONE(0.00)[gmail.com:dkim] Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Content-Filtered-By: Mailman/MimeDel 2.1.33 X-BeenThere: freebsd-current@freebsd.org X-Mailman-Version: 2.1.33 Precedence: list List-Id: Discussions about the use of FreeBSD-current List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 16 Jun 2020 21:36:16 -0000 On Tue, Jun 16, 2020 at 7:25 PM Rebecca Cran wrote: > On 6/16/20 5:17 AM, Miguel C wrote: > > > I've been trying out FreeBSD with raspberry Pi4 (4GB) and wanted to see > > what the state of HTTP BOOT is in FreeBSD, so I bumped into this! > > > > I'm curious if it should be possible to point to a img/iso directly (I > > tried to use the img.xz unpacked it and make it available on a local we= b > > server and that didn't seem to work for me) but maybe thats cause thos= e > > images miss something, so arm64 aside does that work for amd64? I.E. > using > > the bootonly.iso? > > Unfortunately HTTP boot only works as far as the kernel: UEFI fetches > loader.efi, the loader fetches and runs the kernel over HTTP -- and then > you need to use NFS to mount the filesystem (or have a local root > filesystem). > > Thanks for the reply , I can work with that for a live system still better than tftp, http+nfs should be that hard. > UEFI also has RamDisk support, but I don't think that's for remote > ISO/disk files, just local files. > > As for the ISO it does seem to work for remote ISO files, the bhyve con presentantion suggests the same and I was able to boot the ubuntu arm64 install iso using the direct link as a HTTP BOOT entry,. =EF=BF=BD>Start HTTP Boot over IPv4.... > Station IP address is 172.16.50.62 > > URI: http:/?172.16.50.106/uarm64.iso > File Size: 916357120 Bytes > Downloading...26% > But we also don't seem to have iso images for the raspberry pi, so it might not work there, this does sugget just a link to the .efi file would work: https://github.com/jljusten/tianocore/wiki/HTTP-Boot but I tired that with no succes In any case from what you're saying... for a live system I need http + nfs for rootfs. But I'm still clueless how to set that up for FreeBSD, the guide mentioned here is linux centric, what need to live on the http server side? > -- > Rebecca Cran > > > From owner-freebsd-current@freebsd.org Tue Jun 16 21:38:03 2020 Return-Path: Delivered-To: freebsd-current@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id B7A51335BF7 for ; Tue, 16 Jun 2020 21:38:03 +0000 (UTC) (envelope-from miguelmclara@gmail.com) Received: from mail-pl1-x630.google.com (mail-pl1-x630.google.com [IPv6:2607:f8b0:4864:20::630]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "GTS CA 1O1" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 49mhQ270GXz3Ww6 for ; Tue, 16 Jun 2020 21:38:02 +0000 (UTC) (envelope-from miguelmclara@gmail.com) Received: by mail-pl1-x630.google.com with SMTP id k6so4049310pll.9 for ; Tue, 16 Jun 2020 14:38:02 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=mime-version:references:in-reply-to:from:date:message-id:subject:to :cc; bh=e/HsjKVmf0mEHOhiUupYsZno87qWDu/Z8zMyQTv8+A0=; b=CZihR1GJqQ7dH42tgBP8T4YEiY1VeYmYvE+w5T3RBXteKQSQKKPIbKC6xNc6JWaw7+ eX9KVqFc6DDYxqd2YSRxoYWlcHjxply7zkgUS9gG46vMs6tDSvp9oFl21RbBSeC0ctk8 cEP8XT06J6WelQ67S3mUTmz6h1KJEFwSh6ntWB8d69K2oxiXxeItuUEvynvJ64NDH+uP VAhZ3rBF5G3dpNbkZfNh7ucHPkRuUmlSa3KP9P3aoZlppnIR7//hP1ToVzY8fm4t8vBb 0ius5YoLGFm9450JSB4ObfCggoiwn45W9US//qtck0cuTrnNGG4jvNsA5N5ZA7ORmcAz Aw6A== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:references:in-reply-to:from:date :message-id:subject:to:cc; bh=e/HsjKVmf0mEHOhiUupYsZno87qWDu/Z8zMyQTv8+A0=; b=IIC8lnYu/kk8x8qh5q+jIoBDfdh3RTFTMryYDWZZu8RSb+LoG57Qh/XbvV/J4hNCB/ 0qv/HXeItJrfZm0SBh27lU/GdEs1ea0eVq6yCQBKEgyqYZ5V/nCTsh41YBH70gtpS74n KTjyPZ9nMwggHBa77pyG6qdpFydIWLRk2KbnnEmDBBveJu1HhV161Wuvzz1zw6JQtB3a ehax3mS6SnRZcTDyWUQlHAamqHDpWFwB1L0sr9WnEVXSktlGu/H4Pkvpne+B7VQCDiIn l1CfkPTlnGtqXgFxfmqmoxUCNGcvI82+0dOtGf4Av6ZAx0H4K0DoUPYdok9hH92aaV/X YNbQ== X-Gm-Message-State: AOAM530n8ip9JL6xZxxrdljEMtqm2aEHN1SYCFntM2sacEJJQsJbkqKY 177BIJWROPWuuthRcenSu1ORO6yec13cWmo5cgA= X-Google-Smtp-Source: ABdhPJwdeHyDQwUMheffS3rxwaN3ItZjhskXCQoFwde45dV5RvQCtU6ZL56TXm86FdHZt+dxSbBhP6+358CHnYL+W5w= X-Received: by 2002:a17:902:8d97:: with SMTP id v23mr3790663plo.3.1592343481391; Tue, 16 Jun 2020 14:38:01 -0700 (PDT) MIME-Version: 1.0 References: <0b38b537-9d9b-b3ae-bae3-bb5b4926bbaa@bsdio.com> In-Reply-To: From: Miguel C Date: Tue, 16 Jun 2020 22:37:24 +0100 Message-ID: Subject: Re: CTF: UEFI HTTP boot support To: Rebecca Cran Cc: freebsd-current X-Rspamd-Queue-Id: 49mhQ270GXz3Ww6 X-Spamd-Bar: - Authentication-Results: mx1.freebsd.org; dkim=pass header.d=gmail.com header.s=20161025 header.b=CZihR1GJ; dmarc=pass (policy=none) header.from=gmail.com; spf=pass (mx1.freebsd.org: domain of miguelmclara@gmail.com designates 2607:f8b0:4864:20::630 as permitted sender) smtp.mailfrom=miguelmclara@gmail.com X-Spamd-Result: default: False [-1.09 / 15.00]; ARC_NA(0.00)[]; NEURAL_HAM_MEDIUM(-0.91)[-0.908]; R_DKIM_ALLOW(-0.20)[gmail.com:s=20161025]; FROM_HAS_DN(0.00)[]; R_SPF_ALLOW(-0.20)[+ip6:2607:f8b0:4000::/36:c]; FREEMAIL_FROM(0.00)[gmail.com]; MIME_GOOD(-0.10)[multipart/alternative,text/plain]; PREVIOUSLY_DELIVERED(0.00)[freebsd-current@freebsd.org]; NEURAL_HAM_LONG(-1.01)[-1.009]; URI_COUNT_ODD(1.00)[1]; TO_MATCH_ENVRCPT_SOME(0.00)[]; TO_DN_ALL(0.00)[]; DKIM_TRACE(0.00)[gmail.com:+]; RCPT_COUNT_TWO(0.00)[2]; DMARC_POLICY_ALLOW(-0.50)[gmail.com,none]; HTTP_TO_IP(1.00)[]; RCVD_IN_DNSWL_NONE(0.00)[2607:f8b0:4864:20::630:from]; NEURAL_HAM_SHORT(-0.17)[-0.172]; FROM_EQ_ENVFROM(0.00)[]; MIME_TRACE(0.00)[0:+,1:+,2:~]; FREEMAIL_ENVFROM(0.00)[gmail.com]; ASN(0.00)[asn:15169, ipnet:2607:f8b0::/32, country:US]; RCVD_COUNT_TWO(0.00)[2]; RCVD_TLS_ALL(0.00)[]; DWL_DNSWL_NONE(0.00)[gmail.com:dkim] Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Content-Filtered-By: Mailman/MimeDel 2.1.33 X-BeenThere: freebsd-current@freebsd.org X-Mailman-Version: 2.1.33 Precedence: list List-Id: Discussions about the use of FreeBSD-current List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 16 Jun 2020 21:38:03 -0000 On Tue, Jun 16, 2020 at 10:35 PM Miguel C wrote: > > On Tue, Jun 16, 2020 at 7:25 PM Rebecca Cran wrote: > >> On 6/16/20 5:17 AM, Miguel C wrote: >> >> > I've been trying out FreeBSD with raspberry Pi4 (4GB) and wanted to se= e >> > what the state of HTTP BOOT is in FreeBSD, so I bumped into this! >> > >> > I'm curious if it should be possible to point to a img/iso directly (I >> > tried to use the img.xz unpacked it and make it available on a local w= eb >> > server and that didn't seem to work for me) but maybe thats cause tho= se >> > images miss something, so arm64 aside does that work for amd64? I.E. >> using >> > the bootonly.iso? >> >> Unfortunately HTTP boot only works as far as the kernel: UEFI fetches >> loader.efi, the loader fetches and runs the kernel over HTTP -- and then >> you need to use NFS to mount the filesystem (or have a local root >> filesystem). >> >> > Thanks for the reply , I can work with that for a live system still bette= r > than tftp, http+nfs should be that hard. > > >> UEFI also has RamDisk support, but I don't think that's for remote >> ISO/disk files, just local files. >> >> As for the ISO it does seem to work for remote ISO files, the bhyve con > presentantion suggests the same and I was able to boot the ubuntu arm64 > install iso using the direct link as a HTTP BOOT entry,. > > =EF=BF=BD>Start HTTP Boot over IPv4.... >> Station IP address is 172.16.50.62 >> >> URI: http:/?172.16.50.106/uarm64.iso >> File Size: 916357120 Bytes >> Downloading...26% >> > > But we also don't seem to have iso images for the raspberry pi, so it > might not work there, this does sugget just a link to the .efi file would > work: https://github.com/jljusten/tianocore/wiki/HTTP-Boot but I tired > that with no succes > Actually that was bad interpertation on my side for a ramdisk to be used it needs o be iso/img format. > In any case from what you're saying... for a live system I need http + nf= s > for rootfs. > > But I'm still clueless how to set that up for FreeBSD, the guide mentione= d > here is linux centric, what need to live on the http server side? > > >> -- >> Rebecca Cran >> >> >> From owner-freebsd-current@freebsd.org Tue Jun 16 22:10:12 2020 Return-Path: Delivered-To: freebsd-current@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 02847336CEF for ; Tue, 16 Jun 2020 22:10:12 +0000 (UTC) (envelope-from miguelmclara@gmail.com) Received: from mail-pf1-x42a.google.com (mail-pf1-x42a.google.com [IPv6:2607:f8b0:4864:20::42a]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "GTS CA 1O1" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 49mj772FVjz3Z2R for ; Tue, 16 Jun 2020 22:10:11 +0000 (UTC) (envelope-from miguelmclara@gmail.com) Received: by mail-pf1-x42a.google.com with SMTP id b5so90184pfp.9 for ; Tue, 16 Jun 2020 15:10:11 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=mime-version:references:in-reply-to:from:date:message-id:subject:to :cc; bh=wX608id/N+trlttH4jr8l4PaEr2q9hDH0Zm6cpLzyVw=; b=ENQM2nBrp4lF+CPPuByujEg7kGERshjUHLgicpHv/cAjJzcF28vfiudjCMK6UYrsvo PPzasWGXUV6gkVsOiuv7NCsrWiQ+mjSEiOL6nSK65mxUIkvNCyAFJFPglfjtrLXeLl/o kRFBjVwigGoOupkZeqr/UehLpQufSUbjupLak3+khqXqV5ROFob/tTwXT7XOihJJgDGM LVMzdWJ7JKQ5ssnVqHmugpmSbsFo1cWNrcBAD/MMbtpAbEhi2DM9HG4uFP3tqIPJ8LoV DpOLOb30giS+syn84pwrlbTIuue1+nkQ88gvPhyV1n/UpNCKCotiAwINnIY3jlvjElpR zvdg== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:references:in-reply-to:from:date :message-id:subject:to:cc; bh=wX608id/N+trlttH4jr8l4PaEr2q9hDH0Zm6cpLzyVw=; b=OTRn+i0P2DFjIk6/9rUwTgjaDKYmMSwK1/8q607LhzEHUufQTZ8lQTAoLkLn+PzUYs A3XkzivneOp6Pm2eXfcc9F44uEaokAgY9Ju184myYEQS6Rms2CvM5orRXIaBbNh80pPo QtWCr4vpEcfHTKA9WA9gUGjQ4wzLI6wNWlVKtJdF/u3jy9Wz0IV3fXMh3hQnSh2dpIfD 61Fd9ok77mX97XW2BNA+KQqvAe111LPvSFxGjg/c6+CFRxLat2rCykJKHiDuSwGmA92U bmMtaWp/Dau2eAlJlBaIRJhl3udwvyGPacZOUqZyhsFgJ1MRbScN8MzyBQ0YLn+CpK1J W2/A== X-Gm-Message-State: AOAM533mTnWBtPDqshaMqv3WF3xfi5ecotXVX8r+OXzeAEgisiq7G1lF I7z/iSF8yfntUrySnVO0P4zB9SFzAFI7ubugfhukAKnF X-Google-Smtp-Source: ABdhPJyWsEAWs4vw6YGTtrA6UtMxgtzO0Dfk5FwxFvAReg0If0yOzPmii/q3YeaBMRtxHMCojcmXY7cgYEH0Y+0P9Mc= X-Received: by 2002:a63:8f46:: with SMTP id r6mr3798817pgn.257.1592345409525; Tue, 16 Jun 2020 15:10:09 -0700 (PDT) MIME-Version: 1.0 References: <0b38b537-9d9b-b3ae-bae3-bb5b4926bbaa@bsdio.com> In-Reply-To: From: Miguel C Date: Tue, 16 Jun 2020 23:09:33 +0100 Message-ID: Subject: Re: CTF: UEFI HTTP boot support To: Rebecca Cran Cc: freebsd-current X-Rspamd-Queue-Id: 49mj772FVjz3Z2R X-Spamd-Bar: - Authentication-Results: mx1.freebsd.org; dkim=pass header.d=gmail.com header.s=20161025 header.b=ENQM2nBr; dmarc=pass (policy=none) header.from=gmail.com; spf=pass (mx1.freebsd.org: domain of miguelmclara@gmail.com designates 2607:f8b0:4864:20::42a as permitted sender) smtp.mailfrom=miguelmclara@gmail.com X-Spamd-Result: default: False [-1.09 / 15.00]; ARC_NA(0.00)[]; NEURAL_HAM_MEDIUM(-0.91)[-0.907]; R_DKIM_ALLOW(-0.20)[gmail.com:s=20161025]; FROM_HAS_DN(0.00)[]; FREEMAIL_FROM(0.00)[gmail.com]; R_SPF_ALLOW(-0.20)[+ip6:2607:f8b0:4000::/36]; MIME_GOOD(-0.10)[multipart/alternative,text/plain]; PREVIOUSLY_DELIVERED(0.00)[freebsd-current@freebsd.org]; NEURAL_HAM_LONG(-1.01)[-1.009]; URI_COUNT_ODD(1.00)[3]; TO_MATCH_ENVRCPT_SOME(0.00)[]; TO_DN_ALL(0.00)[]; DKIM_TRACE(0.00)[gmail.com:+]; RCPT_COUNT_TWO(0.00)[2]; RCVD_IN_DNSWL_NONE(0.00)[2607:f8b0:4864:20::42a:from]; HTTP_TO_IP(1.00)[]; DMARC_POLICY_ALLOW(-0.50)[gmail.com,none]; NEURAL_HAM_SHORT(-0.18)[-0.175]; FROM_EQ_ENVFROM(0.00)[]; MIME_TRACE(0.00)[0:+,1:+,2:~]; FREEMAIL_ENVFROM(0.00)[gmail.com]; ASN(0.00)[asn:15169, ipnet:2607:f8b0::/32, country:US]; RCVD_COUNT_TWO(0.00)[2]; RCVD_TLS_ALL(0.00)[]; DWL_DNSWL_NONE(0.00)[gmail.com:dkim] Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Content-Filtered-By: Mailman/MimeDel 2.1.33 X-BeenThere: freebsd-current@freebsd.org X-Mailman-Version: 2.1.33 Precedence: list List-Id: Discussions about the use of FreeBSD-current List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 16 Jun 2020 22:10:12 -0000 On Tue, Jun 16, 2020 at 10:37 PM Miguel C wrote: > > > On Tue, Jun 16, 2020 at 10:35 PM Miguel C wrote: > >> >> On Tue, Jun 16, 2020 at 7:25 PM Rebecca Cran wrote: >> >>> On 6/16/20 5:17 AM, Miguel C wrote: >>> >>> > I've been trying out FreeBSD with raspberry Pi4 (4GB) and wanted to s= ee >>> > what the state of HTTP BOOT is in FreeBSD, so I bumped into this! >>> > >>> > I'm curious if it should be possible to point to a img/iso directly (= I >>> > tried to use the img.xz unpacked it and make it available on a local >>> web >>> > server and that didn't seem to work for me) but maybe thats cause >>> those >>> > images miss something, so arm64 aside does that work for amd64? I.E. >>> using >>> > the bootonly.iso? >>> >>> Unfortunately HTTP boot only works as far as the kernel: UEFI fetches >>> loader.efi, the loader fetches and runs the kernel over HTTP -- and the= n >>> you need to use NFS to mount the filesystem (or have a local root >>> filesystem). >>> >>> >> Thanks for the reply , I can work with that for a live system still >> better than tftp, http+nfs should be that hard. >> >> >>> UEFI also has RamDisk support, but I don't think that's for remote >>> ISO/disk files, just local files. >>> >>> As for the ISO it does seem to work for remote ISO files, the bhyve con >> presentantion suggests the same and I was able to boot the ubuntu arm64 >> install iso using the direct link as a HTTP BOOT entry,. >> >> =EF=BF=BD>Start HTTP Boot over IPv4.... >>> Station IP address is 172.16.50.62 >>> >>> URI: http:/?172.16.50.106/uarm64.iso >>> File Size: 916357120 Bytes >>> Downloading...26% >>> >> >> But we also don't seem to have iso images for the raspberry pi, so it >> might not work there, this does sugget just a link to the .efi file woul= d >> work: https://github.com/jljusten/tianocore/wiki/HTTP-Boot but I tired >> that with no succes >> > > Actually that was bad interpertation on my side for a ramdisk to be used > it needs o be iso/img format. > > >> In any case from what you're saying... for a live system I need http + >> nfs for rootfs. >> >> But I'm still clueless how to set that up for FreeBSD, the guide >> mentioned here is linux centric, what need to live on the http server si= de? >> >> Update so I was trying the ubuntu boot again and noticed it required a few tries (literary choose that boot entry ... fail... try again... 3 times and it worked ) Could be a bug in rpi4-uefi.dev though but it proves it works= . I then tried openbsd miniroot img (just case its smaller honestly :D ) and it also booted the img file, but not FreeBSD (using 12.1 ) I noticed the openbsd image includes startup.nsh inside ef/boot/ alongside bootaa64.efi, unsure if that's what FreeBSD would need. >>> -- >>> Rebecca Cran >>> >>> >>> From owner-freebsd-current@freebsd.org Tue Jun 16 23:48:19 2020 Return-Path: Delivered-To: freebsd-current@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 9901D339B0D for ; Tue, 16 Jun 2020 23:48:19 +0000 (UTC) (envelope-from sjg@juniper.net) Received: from mx0b-00273201.pphosted.com (mx0b-00273201.pphosted.com [67.231.152.164]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client CN "*.pphosted.com", Issuer "Thawte RSA CA 2018" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 49mlJL55B9z3xwF for ; Tue, 16 Jun 2020 23:48:18 +0000 (UTC) (envelope-from sjg@juniper.net) Received: from pps.filterd (m0108161.ppops.net [127.0.0.1]) by mx0b-00273201.pphosted.com (8.16.0.42/8.16.0.42) with SMTP id 05GNarNx025502; Tue, 16 Jun 2020 16:48:17 -0700 Received: from nam12-dm6-obe.outbound.protection.outlook.com (mail-dm6nam12lp2177.outbound.protection.outlook.com [104.47.59.177]) by mx0b-00273201.pphosted.com with ESMTP id 31q65ng61s-1 (version=TLSv1.2 cipher=ECDHE-RSA-AES256-GCM-SHA384 bits=256 verify=NOT); Tue, 16 Jun 2020 16:48:17 -0700 ARC-Seal: i=1; a=rsa-sha256; s=arcselector9901; d=microsoft.com; cv=none; b=co3OztGK8C9wpuG6AG8j9yqgvZ/54VY95db4RZ6BkwQRZzo/jSTcHZXHYhw2ixqj6iFPsQVudjGRWx67Mfbr4tl6/kf6LrFF/4nk4S4knyfoqkglaGTKg6/BMhAHyxn7efOVtl6DHh/XMasiFpRzDB0+7hHQOLwxAeS+ZqmMmsEK2yva6HJSYYuXH1hf3NP4uY29dEM2ge7xKOkjWe9icdh0N38sq90fqxoDo91BQ178AsqI1HnvjXSTEZ5K/lYov0iqSBEH9dcKHSHjnBRbZ+B2WuS51n7KmGOFGAvrz0rarWplG2xo6Bc7iaRNtz0MPqGJJr6GmCahAqCIXt+bGw== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=microsoft.com; s=arcselector9901; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=1W+J9nU0U/Ce/krYWP1B+EwbJPCfzOGRKcFlqceLOp8=; b=Of5E1CT4fsv69w70ZBOT1aAhjxEexR01QDPLcXV154KSC3Pd8zi31oESyBok9G1Ju5EQrhzWqw4VsdSU3K3q5IEVm73aA/6lfeLcKweFH71O1YJwrNf3QRjXE3m8de6GD9mCOABgA6FkbreBJtPB4eXKBHU1W9wk/U8mfYnRAAYZXHOvbdusS5G4ezg5ssCRdCUk8aS4vP215K2eGtoFtXDiXDy16W3wpeJc0uqgcbMoInJ1k/5zgal5U6zaBQ9ASMEpX8aIrTqpOGwssK/vlzuPd3JnOj9P5RhsU2Nac561krnRP/WuuzWC/FIAL+YIg2Ixd+TkW1tXbySbX6ZL/g== ARC-Authentication-Results: i=1; mx.microsoft.com 1; spf=temperror (sender ip is 66.129.242.13) smtp.rcpttodomain=gndrsh.dnsmgr.net smtp.mailfrom=juniper.net; dmarc=temperror action=none header.from=juniper.net; dkim=none (message not signed); arc=none Received: from DM5PR2201CA0005.namprd22.prod.outlook.com (2603:10b6:4:14::15) by DM6PR05MB5370.namprd05.prod.outlook.com (2603:10b6:5:59::26) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.3109.9; Tue, 16 Jun 2020 23:48:14 +0000 Received: from DM3NAM05FT027.eop-nam05.prod.protection.outlook.com (2603:10b6:4:14:cafe::f6) by DM5PR2201CA0005.outlook.office365.com (2603:10b6:4:14::15) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.3088.21 via Frontend Transport; Tue, 16 Jun 2020 23:48:14 +0000 X-MS-Exchange-Authentication-Results: spf=temperror (sender IP is 66.129.242.13) smtp.mailfrom=juniper.net; gndrsh.dnsmgr.net; dkim=none (message not signed) header.d=none;gndrsh.dnsmgr.net; dmarc=temperror action=none header.from=juniper.net; Received-SPF: TempError (protection.outlook.com: error in processing during lookup of juniper.net: DNS Timeout) Received: from P-EXFEND-EQX-02.jnpr.net (66.129.242.13) by DM3NAM05FT027.mail.protection.outlook.com (10.152.98.138) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_CBC_SHA384) id 15.20.3109.9 via Frontend Transport; Tue, 16 Jun 2020 23:48:12 +0000 Received: from P-EXBEND-EQX-01.jnpr.net (10.104.8.52) by P-EXFEND-EQX-02.jnpr.net (10.104.8.55) with Microsoft SMTP Server (TLS) id 15.0.1497.2; Tue, 16 Jun 2020 16:48:12 -0700 Received: from P-EXBEND-EQX-01.jnpr.net (10.104.8.52) by P-EXBEND-EQX-01.jnpr.net (10.104.8.52) with Microsoft SMTP Server (TLS) id 15.0.1497.2; Tue, 16 Jun 2020 16:48:11 -0700 Received: from p-mailhub01.juniper.net (10.104.20.6) by P-EXBEND-EQX-01.jnpr.net (10.104.8.52) with Microsoft SMTP Server (TLS) id 15.0.1497.2 via Frontend Transport; Tue, 16 Jun 2020 16:48:11 -0700 Received: from kaos.jnpr.net (kaos.jnpr.net [172.23.50.162]) by p-mailhub01.juniper.net (8.14.4/8.11.3) with ESMTP id 05GNmBqd024069; Tue, 16 Jun 2020 16:48:11 -0700 (envelope-from sjg@juniper.net) Received: by kaos.jnpr.net (Postfix, from userid 1377) id 1D082AA7D; Tue, 16 Jun 2020 16:48:11 -0700 (PDT) Received: from kaos.jnpr.net (localhost [127.0.0.1]) by kaos.jnpr.net (Postfix) with ESMTP id 1BD89AA7C; Tue, 16 Jun 2020 16:48:11 -0700 (PDT) To: "Rodney W. Grimes" CC: Miguel C , , Subject: Re: CTF: UEFI HTTP boot support In-Reply-To: <202006161650.05GGoj1M081828@gndrsh.dnsmgr.net> References: <202006161650.05GGoj1M081828@gndrsh.dnsmgr.net> Comments: In-reply-to: "Rodney W. Grimes" message dated "Tue, 16 Jun 2020 09:50:45 -0700." From: "Simon J. Gerraty" X-Mailer: MH-E 8.6+git; nmh 1.7.1; GNU Emacs 26.3 MIME-Version: 1.0 Content-Type: text/plain; charset="us-ascii" Content-ID: <45377.1592351291.1@kaos.jnpr.net> Date: Tue, 16 Jun 2020 16:48:11 -0700 Message-ID: <46934.1592351291@kaos.jnpr.net> X-EXCLAIMER-MD-CONFIG: e3cb0ff2-54e7-4646-8a04-0dae4ac7b136 X-EOPAttributedMessage: 0 X-MS-Office365-Filtering-HT: Tenant X-Forefront-Antispam-Report: CIP:66.129.242.13; CTRY:US; LANG:en; SCL:1; SRV:; IPV:CAL; SFV:NSPM; H:P-EXFEND-EQX-02.jnpr.net; PTR:InfoDomainNonexistent; CAT:NONE; SFTY:; SFS:(4636009)(136003)(39850400004)(376002)(396003)(346002)(46966005)(54906003)(86362001)(4744005)(6916009)(2906002)(55016002)(8936002)(70586007)(70206006)(8676002)(9686003)(316002)(81166007)(47076004)(186003)(82740400003)(107886003)(63350400001)(63370400001)(336012)(7126003)(7696005)(6266002)(5660300002)(82310400002)(478600001)(4326008)(26005)(356005); DIR:OUT; SFP:1102; X-MS-PublicTrafficType: Email X-MS-Office365-Filtering-Correlation-Id: 3a62795b-5dd9-422b-a953-08d8124fbb75 X-MS-TrafficTypeDiagnostic: DM6PR05MB5370: X-Microsoft-Antispam-PRVS: X-MS-Oob-TLC-OOBClassifiers: OLM:2399; X-Forefront-PRVS: 04362AC73B X-MS-Exchange-SenderADCheck: 1 X-Microsoft-Antispam: BCL:0; X-Microsoft-Antispam-Message-Info: yjNR2RYu2+7YD0Ko5/6nTSWErNxPPuRno+1EDhftGsa8ffbQGm+lAWjgOAUXwEYWX7J3CbnghGp89pKtgRzr7S3HmyDHCi7x3a2mmHJ+u48uWqxiqvn7QjgCyj9/9AVYKftv6HDSCjtcTj/EgOvD3rRrT5w7g0047cSV6CZrAfub/CoGP0xG+NvGkEhDuUd7HLACJEDUtUkNttDyZtyKunVKF8AmZ95fLydxzw7Tph0woIZAqMyIZQV6tE2Wqk6HEtxHJd5AlFVmIZdbYNCKphy2vVkHJWTAugp4p/6eI3D4UWpJFYqz4ZzogMy4QVYSoGN7rRo1mbUjFnA9uOmnIAEwsm5M6i8S4uJvsYSOnkNt0E0ygNawWa1t3T8wxkjfLpkr2RvO8gpedy8YPSubqA== X-OriginatorOrg: juniper.net X-MS-Exchange-CrossTenant-OriginalArrivalTime: 16 Jun 2020 23:48:12.8252 (UTC) X-MS-Exchange-CrossTenant-Network-Message-Id: 3a62795b-5dd9-422b-a953-08d8124fbb75 X-MS-Exchange-CrossTenant-Id: bea78b3c-4cdb-4130-854a-1d193232e5f4 X-MS-Exchange-CrossTenant-OriginalAttributedTenantConnectingIp: TenantId=bea78b3c-4cdb-4130-854a-1d193232e5f4; Ip=[66.129.242.13]; Helo=[P-EXFEND-EQX-02.jnpr.net] X-MS-Exchange-CrossTenant-FromEntityHeader: HybridOnPrem X-MS-Exchange-Transport-CrossTenantHeadersStamped: DM6PR05MB5370 X-Proofpoint-Virus-Version: vendor=fsecure engine=2.50.10434:6.0.216, 18.0.687 definitions=2020-06-16_13:2020-06-16, 2020-06-16 signatures=0 X-Proofpoint-Spam-Details: rule=outbound_spam_notspam policy=outbound_spam score=0 malwarescore=0 suspectscore=0 priorityscore=1501 mlxscore=0 phishscore=0 spamscore=0 adultscore=0 bulkscore=0 clxscore=1015 impostorscore=0 cotscore=-2147483648 mlxlogscore=982 lowpriorityscore=0 classifier=spam adjust=0 reason=mlx scancount=1 engine=8.12.0-2004280000 definitions=main-2006160163 X-Rspamd-Queue-Id: 49mlJL55B9z3xwF X-Spamd-Bar: ----- X-Spamd-Result: default: False [-5.39 / 15.00]; NEURAL_HAM_MEDIUM(-0.86)[-0.857]; R_DKIM_ALLOW(-0.20)[juniper.net:s=PPS1017,juniper.net:s=selector1]; FROM_HAS_DN(0.00)[]; RCPT_COUNT_THREE(0.00)[4]; TO_DN_SOME(0.00)[]; R_SPF_ALLOW(-0.20)[+ip4:67.231.152.164]; MIME_GOOD(-0.10)[text/plain]; NEURAL_HAM_LONG(-1.00)[-0.996]; ARC_ALLOW(-1.00)[microsoft.com:s=arcselector9901:i=1]; TO_MATCH_ENVRCPT_SOME(0.00)[]; DKIM_TRACE(0.00)[juniper.net:+]; DMARC_POLICY_ALLOW(-0.50)[juniper.net,reject]; NEURAL_HAM_SHORT(-1.44)[-1.439]; FROM_EQ_ENVFROM(0.00)[]; MIME_TRACE(0.00)[0:+]; RCVD_TLS_LAST(0.00)[]; ASN(0.00)[asn:22843, ipnet:67.231.152.0/24, country:US]; FREEMAIL_CC(0.00)[gmail.com,freebsd.org,juniper.net]; RCVD_COUNT_SEVEN(0.00)[11]; RCVD_IN_DNSWL_LOW(-0.10)[67.231.152.164:from] X-BeenThere: freebsd-current@freebsd.org X-Mailman-Version: 2.1.33 Precedence: list List-Id: Discussions about the use of FreeBSD-current List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 16 Jun 2020 23:48:19 -0000 Rodney W. Grimes wrote: > > The "fake cd drive" is in the kernel, loader just copies the iso into > > memory like any other module, and by the time that's done you just > > reboot into the newly installed system, which again uses > > > > vfs.root.mountfrom="cd9660:/dev/md0.uzip" > ^^^ > > Argh, the cd9660 confused me, I think your doing a > "root on mfs/md"? loader.conf says rootfs_load="yes" rootfs_name="contents.izo" rootfs_type="md_image" vfs.root.mountfrom="cd9660:/dev/md0.uzip" contents.izo is uzip'd contents.iso which file(1) describes as ISO 9660 CD-ROM filesystem data '' That's for normal boot, for the loader 'install' command it expects an uncompressed iso for rootfs. From owner-freebsd-current@freebsd.org Wed Jun 17 01:39:56 2020 Return-Path: Delivered-To: freebsd-current@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 2BEB333C81C for ; Wed, 17 Jun 2020 01:39:56 +0000 (UTC) (envelope-from rmacklem@uoguelph.ca) Received: from CAN01-TO1-obe.outbound.protection.outlook.com (mail-to1can01on0628.outbound.protection.outlook.com [IPv6:2a01:111:f400:fe5d::628]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client CN "mail.protection.outlook.com", Issuer "GlobalSign Organization Validation CA - SHA256 - G3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 49mnn713dWz44L3 for ; Wed, 17 Jun 2020 01:39:54 +0000 (UTC) (envelope-from rmacklem@uoguelph.ca) ARC-Seal: i=1; a=rsa-sha256; s=arcselector9901; d=microsoft.com; cv=none; b=AbYgO0j0C2xGBn96RPJfDx3UAxtteaVe5/A06m5KGO2R6EQyju1w82G8IszWZDRBvWBXKndlYfeec5zY34IWdmYi1l5jnUDbZHUh93wYEXYWumGs5jrRuPuLu0HfRAIg4bzfbTHlrkPsY+2RJOJ4hgXGL6rOauKn5I+F42+IoDZ4o8bSZnaaNErmUcwNh/Xbt61m8gwmjBQZ+NAVJHcRoJUZCpughZQ+d1oXX0b78Kzo3NJfmX6mBK/JtSNRkpfgbtEltoB3o8Zn5ZTEVx/ExCxGvgho2r/phFaW/8ECi+Tcf9fROv3N9e9uSLrJxyEh7qWFG/LhTUCHoU7uv5WlAw== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=microsoft.com; s=arcselector9901; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=fop3fdixTGaCWRbcAKAEK2udrKfC3upcN3g7eMNA/EA=; b=D3cjQ2zqdmfLqmJIh2TkGJLjC6usYu8m6T46pzpqcpzD7jG6SonHB1IDyrNwH4mBDjEwxkyL60/liHZX3/aN2YABFhe3QXFB3ihzKhLM+kFugOaYvMyLOG4VUoFU7v72PfC8zAAjfhvjhSC7QU4157tH+BdfG2JtfvQvf700TOnbWs4m6A62HbgLxFHyGC3jdLpYW8qb41ndv/xxSbxhTJTKMsmov2qAvumN9ygqwS21hSOhB0oNXz70q9yqVtJo2Yk2PIts29m7KE4jPY7CMqP7158ntQEFzMfXG8ovMcRjLLWylvd+R7WdQ5y3cgUeB0NrYome7XYKSAsNLwFtTg== ARC-Authentication-Results: i=1; mx.microsoft.com 1; spf=pass smtp.mailfrom=uoguelph.ca; dmarc=pass action=none header.from=uoguelph.ca; dkim=pass header.d=uoguelph.ca; arc=none DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=uoguelph.ca; s=selector1; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=fop3fdixTGaCWRbcAKAEK2udrKfC3upcN3g7eMNA/EA=; b=UQKsib45S43cmt5XO/1voZRX6dhILoimA+xOWpF3z0keMHD4BPCnGd8ByZ9+gLreFM1OgyKYQxsfNLojzn9iKiGMwNHATeytmxNdzVTpzZ2XbMnp29D+wyWUm8ng/EVLECdT9ygurhGfo4pwFEgDvUT1Oplr1yMHiJiNRbMNTvYTAeBxJmvvd55VZl76CT6LXq43Sg6O4HtSyy9kQXksri1ntg9IWDUe3KHNAJTg/HqxqlFtvlHQBjsXJE7/Td56eaPLfGVq+Jp1EFDC3l4N9HSEPCc6noY1cAbxZr5M4AJVmsVo1Z4N9dTsU11fjffGsOfj4MLZZ7Zkr6Igt3lxxQ== Received: from QB1PR01MB3364.CANPRD01.PROD.OUTLOOK.COM (2603:10b6:c00:38::14) by QB1PR01MB3538.CANPRD01.PROD.OUTLOOK.COM (2603:10b6:c00:2e::12) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.3088.21; Wed, 17 Jun 2020 01:39:51 +0000 Received: from QB1PR01MB3364.CANPRD01.PROD.OUTLOOK.COM ([fe80::60f3:4ca2:8a4a:1e91]) by QB1PR01MB3364.CANPRD01.PROD.OUTLOOK.COM ([fe80::60f3:4ca2:8a4a:1e91%7]) with mapi id 15.20.3088.028; Wed, 17 Jun 2020 01:39:51 +0000 From: Rick Macklem To: "freebsd-current@FreeBSD.org" Subject: does a ZFS change in head require additional work? Thread-Topic: does a ZFS change in head require additional work? Thread-Index: AQHWREfTSUm9OegDsUGNngCX49IZyQ== Date: Wed, 17 Jun 2020 01:39:51 +0000 Message-ID: Accept-Language: en-US Content-Language: en-US X-MS-Has-Attach: X-MS-TNEF-Correlator: x-ms-publictraffictype: Email x-ms-office365-filtering-correlation-id: 40916723-beda-4587-afce-08d8125f5453 x-ms-traffictypediagnostic: QB1PR01MB3538: x-microsoft-antispam-prvs: x-ms-oob-tlc-oobclassifiers: OLM:8273; x-forefront-prvs: 04371797A5 x-ms-exchange-senderadcheck: 1 x-microsoft-antispam: BCL:0; x-microsoft-antispam-message-info: I2/YPeREEdFBuq8owMe9MUUrSrfCPYYv8v58uyoyBep6c1RUES8qOHP++4hDTWpu7NLuE+5W3vWUSEvqlF2AeGv7U3p/SrOYlW1OiMwvoC+Vs6O12ufKjOJqQfEE2gnVdtM/4waKX3JWAKE2tU/vW8BwEj/KEsVlJB6J4nYUsyU00rCk6Mf8PVD62hbKGssAys2uDK5B/9nNPtstS/D+klBZ8WBUkY5KUoMLxhVB9iCKo30dfDCPgZvhT2XXJYoc0m1Evi7eTjPBwut9QLekDzqFWzKsTTfO3GhGVbpm7ypaPa9GNu6f76oab0hpmuWb x-forefront-antispam-report: CIP:255.255.255.255; CTRY:; LANG:en; SCL:1; SRV:; IPV:NLI; SFV:NSPM; H:QB1PR01MB3364.CANPRD01.PROD.OUTLOOK.COM; PTR:; CAT:NONE; SFTY:; SFS:(136003)(39860400002)(366004)(346002)(376002)(396003)(8936002)(5660300002)(8676002)(186003)(71200400001)(316002)(52536014)(558084003)(786003)(7696005)(66476007)(478600001)(64756008)(66446008)(33656002)(6506007)(6916009)(66556008)(76116006)(66946007)(9686003)(55016002)(2906002)(86362001); DIR:OUT; SFP:1101; x-ms-exchange-antispam-messagedata: ay7X/0pkH/4kTJp6N1XANcxf+Pd4kdG6tebr/yYReWXGO5nkKTUBKBx40izPL0bcD36XYDdynnK71OffbH82YaL2t5YlHNkCiPLuQpsQN4QYqJzMKMfGQmZUGdYXXnl8dMs0kSava2g9vLcJXeaeq27/LLlijRs0xntZp0ckolXyzUnpCZB4nrUm9m+upH9H+y7AP+jEPODWXuEJK3KgUSmnyUt7U3U1iPtyitlOoEM9KyEGkvS0hnC5KVmv0lC5PJLVTBGE1bODOnmviwDF8KMxQRam6Cp9YiQQCCcgqBo331I1U93vDsHKU9nDPrlXg7MiJ5XBR+KqTKymiMLIVW/REAawL0sSl/1uhV3CfLL60MzuVWoEQqym95XRmNfPFyUlBk9PebxCd0en5Ij+M4VGol1pekMVlxSJGLjY2EOCPYrYw32l8sRL+SYBmrDbMsWAZnHIbgF1zJiBcP3MwdMxpDJrJB/l1jAs1ORcUTvZuSq6aWeKx0h+U321OhaCMJ8PdS56ukBwHRb//u4qU41qmzXzNmaI+dvzessaRXjrfeessoPNf3RDWhg3a69G x-ms-exchange-transport-forked: True Content-Type: text/plain; charset="iso-8859-1" Content-Transfer-Encoding: quoted-printable MIME-Version: 1.0 X-OriginatorOrg: uoguelph.ca X-MS-Exchange-CrossTenant-Network-Message-Id: 40916723-beda-4587-afce-08d8125f5453 X-MS-Exchange-CrossTenant-originalarrivaltime: 17 Jun 2020 01:39:51.8479 (UTC) X-MS-Exchange-CrossTenant-fromentityheader: Hosted X-MS-Exchange-CrossTenant-id: be62a12b-2cad-49a1-a5fa-85f4f3156a7d X-MS-Exchange-CrossTenant-mailboxtype: HOSTED X-MS-Exchange-CrossTenant-userprincipalname: c1AOmDoHnHz6R+jbkpWWeJ2NbdfW2mA5uU/w0UgQJIVPVc59qTNv8VD8AKIE02NTNzTrtCQEA8pH17cXQkSruw== X-MS-Exchange-Transport-CrossTenantHeadersStamped: QB1PR01MB3538 X-Rspamd-Queue-Id: 49mnn713dWz44L3 X-Spamd-Bar: --- Authentication-Results: mx1.freebsd.org; dkim=pass header.d=uoguelph.ca header.s=selector1 header.b=UQKsib45; dmarc=none; spf=pass (mx1.freebsd.org: domain of rmacklem@uoguelph.ca designates 2a01:111:f400:fe5d::628 as permitted sender) smtp.mailfrom=rmacklem@uoguelph.ca X-Spamd-Result: default: False [-3.53 / 15.00]; NEURAL_HAM_MEDIUM(-0.94)[-0.943]; R_DKIM_ALLOW(-0.20)[uoguelph.ca:s=selector1]; FROM_HAS_DN(0.00)[]; TO_MATCH_ENVRCPT_ALL(0.00)[]; R_SPF_ALLOW(-0.20)[+ip6:2a01:111:f400::/48]; MIME_GOOD(-0.10)[text/plain]; DMARC_NA(0.00)[uoguelph.ca]; NEURAL_HAM_LONG(-1.00)[-1.003]; RCPT_COUNT_ONE(0.00)[1]; DWL_DNSWL_LOW(-1.00)[uoguelph.ca:dkim]; RCVD_COUNT_THREE(0.00)[3]; DKIM_TRACE(0.00)[uoguelph.ca:+]; NEURAL_HAM_SHORT(-0.08)[-0.082]; TO_DN_EQ_ADDR_ALL(0.00)[]; FROM_EQ_ENVFROM(0.00)[]; RCVD_TLS_LAST(0.00)[]; MIME_TRACE(0.00)[0:+]; ASN(0.00)[asn:8075, ipnet:2a01:111:f000::/36, country:US]; SUBJECT_ENDS_QUESTION(1.00)[]; ARC_ALLOW(-1.00)[microsoft.com:s=arcselector9901:i=1] X-BeenThere: freebsd-current@freebsd.org X-Mailman-Version: 2.1.33 Precedence: list List-Id: Discussions about the use of FreeBSD-current List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 17 Jun 2020 01:39:56 -0000 Hi,=0A= =0A= r362158 changed the arguments for zfs_checkexp() in head.=0A= There were no other changes, since the arguments are simply=0A= passed on to vfs_stdcheckexp().=0A= =0A= Is there something else that needs to be done,=0A= such as sending this patch upstream?=0A= =0A= rick=0A= From owner-freebsd-current@freebsd.org Wed Jun 17 01:53:58 2020 Return-Path: Delivered-To: freebsd-current@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id A5CE233E693; Wed, 17 Jun 2020 01:53:58 +0000 (UTC) (envelope-from rajfbsd@gmail.com) Received: from mail-wm1-x344.google.com (mail-wm1-x344.google.com [IPv6:2a00:1450:4864:20::344]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "GTS CA 1O1" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 49mp5K3KtZz45r9; Wed, 17 Jun 2020 01:53:57 +0000 (UTC) (envelope-from rajfbsd@gmail.com) Received: by mail-wm1-x344.google.com with SMTP id t194so302517wmt.4; Tue, 16 Jun 2020 18:53:57 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=mime-version:references:in-reply-to:from:date:message-id:subject:to; bh=6PduLYl0E/uXBeZ4Ru83tEmhhHQtCwscThVsc8amwIM=; b=bTRUxKGWtbddqUqNu86fn8m5+JhV2vneNZeIVtU/P5c4F5iTgkC/oiY5XH6qiNVl0O bbUX1XEPCG/ItStmpQNU0Wvz+mf0dkbb3SHw9Ubhk/yTHkcowxzWid31QnweCrKdwGlP /Axtv/4CYqHlFtJpnOcCp0m2FxLN+8c9nLdJXt9Xrut1CmDoqaP9JYEdrj5bUOFIjwY7 SRaDUoEQzvViJlHhUdh0tZNNyxhEqGBRQJAIK4VSgc6GU1BMhgUqT+yroG9eM/Nf8tHj Nqq0Nl40dkAw4QTSGdjaumETp1E+XgY0dQ8Yib0Le+cZepAT1/lOpDIK4sxhSoIYfQjU cWlA== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:references:in-reply-to:from:date :message-id:subject:to; bh=6PduLYl0E/uXBeZ4Ru83tEmhhHQtCwscThVsc8amwIM=; b=KQxS5MjDaQ2iD8NFPF14DUjaJEjf48CHFYZHNOSRQiG/SmIUvxgkJs5w7tKjhu+4XX zkUHJI2ZVxzBe6oYP/lTwRRb7g8Ty20G6bw4KSP3IjX64vDTHbr/FFYD6P8IA+c84TgG 6azYDu40I04k+6eZQ9QIOmy9wYqF4iyLDuhTlZzlxTaYB0kOBgmxemBK742BAaNECnLd LkL13vjFIvNWdIgaS2ICU8g03eX2TzzJRWAHnG3k2SbtWerTdACVJHTJVNWUMmeMK3Jv b4j0CFsQ+WQBDMr6VEu7hWjw/NEkja9snoQAugUKNxMqT73GvJKW0Ge19BxAu2lPFrr7 Kdig== X-Gm-Message-State: AOAM533x+pQcFrgSwoeUDHqJuhzojiLpm4DggLenr0PXs+0jgPA6/cgH QtJGPdI7/z3Mpo8zgE5LLsx8fhil6ykSt21zHECS7nIr X-Google-Smtp-Source: ABdhPJzzEMT2htPSQdjbbFdHOJuY1mNFcZI7evCb+BPT0rMCHWv4H0h8XRgo3XtLRB2V4gh/YycU+Ml+fhVZlYol6dE= X-Received: by 2002:a1c:2644:: with SMTP id m65mr5794517wmm.178.1592358835795; Tue, 16 Jun 2020 18:53:55 -0700 (PDT) MIME-Version: 1.0 References: In-Reply-To: From: Rajesh Kumar Date: Wed, 17 Jun 2020 07:23:44 +0530 Message-ID: Subject: Re: Building modules gives error: "invalid output constraint '=@cce' in asm" To: freebsd-current@freebsd.org, freebsd-drivers@freebsd.org X-Rspamd-Queue-Id: 49mp5K3KtZz45r9 X-Spamd-Bar: -- Authentication-Results: mx1.freebsd.org; dkim=pass header.d=gmail.com header.s=20161025 header.b=bTRUxKGW; dmarc=pass (policy=none) header.from=gmail.com; spf=pass (mx1.freebsd.org: domain of rajfbsd@gmail.com designates 2a00:1450:4864:20::344 as permitted sender) smtp.mailfrom=rajfbsd@gmail.com X-Spamd-Result: default: False [-2.95 / 15.00]; ARC_NA(0.00)[]; NEURAL_HAM_MEDIUM(-0.88)[-0.881]; R_DKIM_ALLOW(-0.20)[gmail.com:s=20161025]; FROM_HAS_DN(0.00)[]; FREEMAIL_FROM(0.00)[gmail.com]; TO_MATCH_ENVRCPT_ALL(0.00)[]; MIME_GOOD(-0.10)[multipart/alternative,text/plain]; TO_DN_NONE(0.00)[]; NEURAL_HAM_LONG(-0.99)[-0.987]; R_SPF_ALLOW(-0.20)[+ip6:2a00:1450:4000::/36]; DKIM_TRACE(0.00)[gmail.com:+]; MIME_BASE64_TEXT(0.10)[]; RCPT_COUNT_TWO(0.00)[2]; RCVD_IN_DNSWL_NONE(0.00)[2a00:1450:4864:20::344:from]; DMARC_POLICY_ALLOW(-0.50)[gmail.com,none]; NEURAL_HAM_SHORT(-0.18)[-0.184]; FROM_EQ_ENVFROM(0.00)[]; MIME_TRACE(0.00)[0:+,1:+,2:~]; FREEMAIL_ENVFROM(0.00)[gmail.com]; ASN(0.00)[asn:15169, ipnet:2a00:1450::/32, country:US]; RCVD_COUNT_TWO(0.00)[2]; RCVD_TLS_ALL(0.00)[]; DWL_DNSWL_NONE(0.00)[gmail.com:dkim] Content-Type: text/plain; charset="UTF-8" X-Content-Filtered-By: Mailman/MimeDel 2.1.33 X-BeenThere: freebsd-current@freebsd.org X-Mailman-Version: 2.1.33 Precedence: list List-Id: Discussions about the use of FreeBSD-current List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 17 Jun 2020 01:53:58 -0000 Hi, Has anyone faced a similar issue? I had a 12.0-RELEASE kernel earlier. I cloned the master branch and built world, built kernel and installed kernel with a different kernel name (INSTKERNNAME) and rebooted the machine and see it booting to 13.0-CURRENT as expected. Then, I am trying to compile the driver modules and hit the compilation error. I haven't done "install world" as I don't want the base 12.0 to be disturbed. When I compared the /usr/include/machine/atomic.h and the atomic.h from the OBJ directory, I see the below highlighted change. Looks like, building module is trying to use the headers in OBJ directory as expected, but hitting the compilation issue. *12.0 base installation atomic.h* static __inline int \ atomic_fcmpset_##TYPE(volatile u_##TYPE *dst, u_##TYPE *expect, u_##TYPE src) \ { \ u_char res; \ \ __asm __volatile( \ " " MPLOCKED " " \ " cmpxchg %3,%1 ; " \ " sete %0 ; " \ "# atomic_fcmpset_" #TYPE " " \ *: "=q" (res), /* 0 */ \ * "+m" (*dst), /* 1 */ \ "+a" (*expect) /* 2 */ \ : "r" (src) /* 3 */ \ : "memory", "cc"); \ return (res); \ } *13.0- CURRENT atomic.h in OBJ dir* static __inline int \ atomic_fcmpset_##TYPE(volatile u_##TYPE *dst, u_##TYPE *expect, u_##TYPE src) \ { \ u_char res; \ \ __asm __volatile( \ " " MPLOCKED " " \ "# atomic_fcmpset_" #TYPE " " \ *: "=@cce" (res), /* 0 */ \* "+m" (*dst), /* 1 */ \ "+a" (*expect) /* 2 */ \ : "r" (src) /* 3 */ \ : "memory", "cc"); \ return (res); \ } Any clue would be really helpful? Thanks, Rajesh On Tue, Jun 16, 2020 at 12:29 PM Rajesh Kumar wrote: > Hi, > > I am trying to build my module with freebsd current branch. But I am > facing compilation issue with header files as below. I have built and > installed the freebsd current branch and booted to that kernel before > building my module. So, not sure what is going wrong. > > > > > > > *In file included from > /root//freebsd_current/sys/sys/systm.h:44:./machine/atomic.h:230:1: error: > invalid output constraint '=@cce' in > asmATOMIC_CMPSET(char);^./machine/atomic.h:205:4: note: expanded from macro > 'ATOMIC_CMPSET' : "=@cce" (res), /* 0 */ \* > > Am I missing something? > > Thanks, > Rajesh. > From owner-freebsd-current@freebsd.org Wed Jun 17 02:19:53 2020 Return-Path: Delivered-To: freebsd-current@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 0607B33F428 for ; Wed, 17 Jun 2020 02:19:53 +0000 (UTC) (envelope-from freqlabs@FreeBSD.org) Received: from smtp.freebsd.org (smtp.freebsd.org [96.47.72.83]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "smtp.freebsd.org", Issuer "Let's Encrypt Authority X3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 49mpgD6Mxqz47PM for ; Wed, 17 Jun 2020 02:19:52 +0000 (UTC) (envelope-from freqlabs@FreeBSD.org) Received: from Ryans-MBP.attlocal.net (unknown [IPv6:2600:1700:358a:c660:b125:ee0f:a3ca:89e1]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client did not present a certificate) (Authenticated sender: freqlabs/mail) by smtp.freebsd.org (Postfix) with ESMTPSA id BFB201805D for ; Wed, 17 Jun 2020 02:19:52 +0000 (UTC) (envelope-from freqlabs@FreeBSD.org) Subject: Re: does a ZFS change in head require additional work? To: freebsd-current@freebsd.org References: From: Ryan Moeller Message-ID: Date: Tue, 16 Jun 2020 22:19:52 -0400 User-Agent: Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:68.0) Gecko/20100101 Thunderbird/68.9.0 MIME-Version: 1.0 In-Reply-To: Content-Type: text/plain; charset=utf-8; format=flowed Content-Transfer-Encoding: 7bit Content-Language: en-US X-BeenThere: freebsd-current@freebsd.org X-Mailman-Version: 2.1.33 Precedence: list List-Id: Discussions about the use of FreeBSD-current List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 17 Jun 2020 02:19:53 -0000 On 6/16/20 9:39 PM, Rick Macklem wrote: > Hi, > > r362158 changed the arguments for zfs_checkexp() in head. > There were no other changes, since the arguments are simply > passed on to vfs_stdcheckexp(). > > Is there something else that needs to be done, > such as sending this patch upstream? > > rick Yes please do upstream this! The FreeBSD snapshot for head used by the CI bot was broken this week (in libc) so your change to the KPI has managed to fly under the radar. We'll need this merged upstream before I update the FreeBSD ports for OpenZFS. Thanks for the reminder! -Ryan > _______________________________________________ > freebsd-current@freebsd.org mailing list > https://lists.freebsd.org/mailman/listinfo/freebsd-current > To unsubscribe, send any mail to "freebsd-current-unsubscribe@freebsd.org" From owner-freebsd-current@freebsd.org Wed Jun 17 06:23:55 2020 Return-Path: Delivered-To: freebsd-current@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id BB6A3344382; Wed, 17 Jun 2020 06:23:55 +0000 (UTC) (envelope-from agapon@gmail.com) Received: from mail-lj1-f172.google.com (mail-lj1-f172.google.com [209.85.208.172]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "GTS CA 1O1" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 49mw4p6lxQz4Lrb; Wed, 17 Jun 2020 06:23:54 +0000 (UTC) (envelope-from agapon@gmail.com) Received: by mail-lj1-f172.google.com with SMTP id e4so1423594ljn.4; Tue, 16 Jun 2020 23:23:54 -0700 (PDT) X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:subject:to:references:from:openpgp:autocrypt :message-id:date:user-agent:mime-version:in-reply-to :content-language:content-transfer-encoding; bh=Il7Bj1OimG+txynWetrPvxwBDm0T218fvuhamzfvY4s=; b=lzvudrllXSsLxHOOVw8TSRB/eZYQESiam71pip+onXoMJxTGuO6k5XUtgd59rtYfOL jiK6MlUG7j6gnsV7UOwibFhGVNfNLGzPA0u0tVpRwDR4M6dk+O5G7NJNHhNPqLYMEyby 4AIaCCCn9E6tPMaZL8faRLQG/jGhgbZls1sAZN1agvXulTzIaz/o76YqRnt7WSNFtQOt FXdBwGSzlgFqor30INbFA6utOHka9//tjgELFIaMHTVQ+QnNZJySiOplVakDVVNJmHjw wEkRo/oSQ64hAPt2E4nF+A/MauE0Pl/ixX3DrS2+dza12yEkxwkCszbsZqENFIILqNSt chgw== X-Gm-Message-State: AOAM53075zbbSH2XNtuns/ypDO+PtJ5lRqTL8aUwSBRDM946PKjppv3H Hlu5KUnuzq4qOxxzmRBk03eLYwSrBI4= X-Google-Smtp-Source: ABdhPJyZlInd0kU23AxyBY2tmXK4Yr/WRLEAJljSdblM3k3jDXbvSgaibU/qMXoPDjpPHN0Os2pvBQ== X-Received: by 2002:a2e:8ed6:: with SMTP id e22mr2873008ljl.401.1592375032812; Tue, 16 Jun 2020 23:23:52 -0700 (PDT) Received: from [192.168.0.88] (east.meadow.volia.net. [93.72.151.96]) by smtp.googlemail.com with ESMTPSA id i9sm4696662lfe.74.2020.06.16.23.23.51 (version=TLS1_3 cipher=TLS_AES_128_GCM_SHA256 bits=128/128); Tue, 16 Jun 2020 23:23:52 -0700 (PDT) Subject: Re: Building modules gives error: "invalid output constraint '=@cce' in asm" To: Rajesh Kumar , freebsd-current@freebsd.org, freebsd-drivers@freebsd.org References: From: Andriy Gapon Openpgp: preference=signencrypt Autocrypt: addr=avg@FreeBSD.org; prefer-encrypt=mutual; keydata= mQINBFm4LIgBEADNB/3lT7f15UKeQ52xCFQx/GqHkSxEdVyLFZTmY3KyNPQGBtyvVyBfprJ7 mAeXZWfhat6cKNRAGZcL5EmewdQuUfQfBdYmKjbw3a9GFDsDNuhDA2QwFt8BmkiVMRYyvI7l N0eVzszWCUgdc3qqM6qqcgBaqsVmJluwpvwp4ZBXmch5BgDDDb1MPO8AZ2QZfIQmplkj8Y6Z AiNMknkmgaekIINSJX8IzRzKD5WwMsin70psE8dpL/iBsA2cpJGzWMObVTtCxeDKlBCNqM1i gTXta1ukdUT7JgLEFZk9ceYQQMJJtUwzWu1UHfZn0Fs29HTqawfWPSZVbulbrnu5q55R4PlQ /xURkWQUTyDpqUvb4JK371zhepXiXDwrrpnyyZABm3SFLkk2bHlheeKU6Yql4pcmSVym1AS4 dV8y0oHAfdlSCF6tpOPf2+K9nW1CFA8b/tw4oJBTtfZ1kxXOMdyZU5fiG7xb1qDgpQKgHUX8 7Rd2T1UVLVeuhYlXNw2F+a2ucY+cMoqz3LtpksUiBppJhw099gEXehcN2JbUZ2TueJdt1FdS ztnZmsHUXLxrRBtGwqnFL7GSd6snpGIKuuL305iaOGODbb9c7ne1JqBbkw1wh8ci6vvwGlzx rexzimRaBzJxlkjNfMx8WpCvYebGMydNoeEtkWldtjTNVsUAtQARAQABtB5BbmRyaXkgR2Fw b24gPGF2Z0BGcmVlQlNELm9yZz6JAlQEEwEIAD4WIQS+LEO7ngQnXA4Bjr538m7TUc1yjwUC WbgsiAIbIwUJBaOagAULCQgHAgYVCAkKCwIEFgIDAQIeAQIXgAAKCRB38m7TUc1yj+JAEACV l9AK/nOWAt/9cufV2fRj0hdOqB1aCshtSrwHk/exXsDa4/FkmegxXQGY+3GWX3deIyesbVRL rYdtdK0dqJyT1SBqXK1h3/at9rxr9GQA6KWOxTjUFURsU7ok/6SIlm8uLRPNKO+yq0GDjgaO LzN+xykuBA0FlhQAXJnpZLcVfPJdWv7sSHGedL5ln8P8rxR+XnmsA5TUaaPcbhTB+mG+iKFj GghASDSfGqLWFPBlX/fpXikBDZ1gvOr8nyMY9nXhgfXpq3B6QCRYKPy58ChrZ5weeJZ29b7/ QdEO8NFNWHjSD9meiLdWQaqo9Y7uUxN3wySc/YUZxtS0bhAd8zJdNPsJYG8sXgKjeBQMVGuT eCAJFEYJqbwWvIXMfVWop4+O4xB+z2YE3jAbG/9tB/GSnQdVSj3G8MS80iLS58frnt+RSEw/ psahrfh0dh6SFHttE049xYiC+cM8J27Aaf0i9RflyITq57NuJm+AHJoU9SQUkIF0nc6lfA+o JRiyRlHZHKoRQkIg4aiKaZSWjQYRl5Txl0IZUP1dSWMX4s3XTMurC/pnja45dge/4ESOtJ9R 8XuIWg45Oq6MeIWdjKddGhRj3OohsltKgkEU3eLKYtB6qRTQypHHUawCXz88uYt5e3w4V16H lCpSTZV/EVHnNe45FVBlvK7k7HFfDDkryLkCDQRZuCyIARAAlq0slcsVboY/+IUJdcbEiJRW be9HKVz4SUchq0z9MZPX/0dcnvz/gkyYA+OuM78dNS7Mbby5dTvOqfpLJfCuhaNYOhlE0wY+ 1T6Tf1f4c/uA3U/YiadukQ3+6TJuYGAdRZD5EqYFIkreARTVWg87N9g0fT9BEqLw9lJtEGDY EWUE7L++B8o4uu3LQFEYxcrb4K/WKmgtmFcm77s0IKDrfcX4doV92QTIpLiRxcOmCC/OCYuO jB1oaaqXQzZrCutXRK0L5XN1Y1PYjIrEzHMIXmCDlLYnpFkK+itlXwlE2ZQxkfMruCWdQXye syl2fynAe8hvp7Mms9qU2r2K9EcJiR5N1t1C2/kTKNUhcRv7Yd/vwusK7BqJbhlng5ZgRx0m WxdntU/JLEntz3QBsBsWM9Y9wf2V4tLv6/DuDBta781RsCB/UrU2zNuOEkSixlUiHxw1dccI 6CVlaWkkJBxmHX22GdDFrcjvwMNIbbyfQLuBq6IOh8nvu9vuItup7qemDG3Ms6TVwA7BD3j+ 3fGprtyW8Fd/RR2bW2+LWkMrqHffAr6Y6V3h5kd2G9Q8ZWpEJk+LG6Mk3fhZhmCnHhDu6CwN MeUvxXDVO+fqc3JjFm5OxhmfVeJKrbCEUJyM8ESWLoNHLqjywdZga4Q7P12g8DUQ1mRxYg/L HgZY3zfKOqcAEQEAAYkCPAQYAQgAJhYhBL4sQ7ueBCdcDgGOvnfybtNRzXKPBQJZuCyIAhsM BQkFo5qAAAoJEHfybtNRzXKPBVwQAKfFy9P7N3OsLDMB56A4Kf+ZT+d5cIx0Yiaf4n6w7m3i ImHHHk9FIetI4Xe54a2IXh4Bq5UkAGY0667eIs+Z1Ea6I2i27Sdo7DxGwq09Qnm/Y65ADvXs 3aBvokCcm7FsM1wky395m8xUos1681oV5oxgqeRI8/76qy0hD9WR65UW+HQgZRIcIjSel9vR XDaD2HLGPTTGr7u4v00UeTMs6qvPsa2PJagogrKY8RXdFtXvweQFz78NbXhluwix2Tb9ETPk LIpDrtzV73CaE2aqBG/KrboXT2C67BgFtnk7T7Y7iKq4/XvEdDWscz2wws91BOXuMMd4c/c4 OmGW9m3RBLufFrOag1q5yUS9QbFfyqL6dftJP3Zq/xe+mr7sbWbhPVCQFrH3r26mpmy841ym dwQnNcsbIGiBASBSKksOvIDYKa2Wy8htPmWFTEOPRpFXdGQ27awcjjnB42nngyCK5ukZDHi6 w0qK5DNQQCkiweevCIC6wc3p67jl1EMFY5+z+zdTPb3h7LeVnGqW0qBQl99vVFgzLxchKcl0 R/paSFgwqXCZhAKMuUHncJuynDOP7z5LirUeFI8qsBAJi1rXpQoLJTVcW72swZ42IdPiboqx NbTMiNOiE36GqMcTPfKylCbF45JNX4nF9ElM0E+Y8gi4cizJYBRr2FBJgay0b9Cp Message-ID: Date: Wed, 17 Jun 2020 09:23:51 +0300 User-Agent: Mozilla/5.0 (X11; FreeBSD amd64; rv:60.0) Gecko/20100101 Firefox/60.0 Thunderbird/60.9.0 MIME-Version: 1.0 In-Reply-To: Content-Type: text/plain; charset=utf-8 Content-Language: en-US Content-Transfer-Encoding: 7bit X-Rspamd-Queue-Id: 49mw4p6lxQz4Lrb X-Spamd-Bar: - Authentication-Results: mx1.freebsd.org; dkim=none; dmarc=none; spf=pass (mx1.freebsd.org: domain of agapon@gmail.com designates 209.85.208.172 as permitted sender) smtp.mailfrom=agapon@gmail.com X-Spamd-Result: default: False [-1.87 / 15.00]; RCVD_TLS_ALL(0.00)[]; RCVD_VIA_SMTP_AUTH(0.00)[]; MID_RHS_MATCH_FROM(0.00)[]; FROM_HAS_DN(0.00)[]; RCPT_COUNT_THREE(0.00)[3]; TO_DN_SOME(0.00)[]; R_SPF_ALLOW(-0.20)[+ip4:209.85.128.0/17]; MIME_GOOD(-0.10)[text/plain]; DMARC_NA(0.00)[FreeBSD.org]; ARC_NA(0.00)[]; NEURAL_HAM_LONG(-0.61)[-0.611]; RCVD_COUNT_THREE(0.00)[3]; TO_MATCH_ENVRCPT_SOME(0.00)[]; NEURAL_HAM_SHORT(-0.69)[-0.686]; RCVD_IN_DNSWL_NONE(0.00)[209.85.208.172:from]; NEURAL_HAM_MEDIUM(-0.58)[-0.576]; FREEMAIL_TO(0.00)[gmail.com,freebsd.org]; FORGED_SENDER(0.30)[avg@FreeBSD.org,agapon@gmail.com]; RWL_MAILSPIKE_POSSIBLE(0.00)[209.85.208.172:from]; R_DKIM_NA(0.00)[]; MIME_TRACE(0.00)[0:+]; ASN(0.00)[asn:15169, ipnet:209.85.128.0/17, country:US]; FROM_NEQ_ENVFROM(0.00)[avg@FreeBSD.org,agapon@gmail.com]; FREEMAIL_ENVFROM(0.00)[gmail.com]; RECEIVED_SPAMHAUS_PBL(0.00)[93.72.151.96:received] X-BeenThere: freebsd-current@freebsd.org X-Mailman-Version: 2.1.33 Precedence: list List-Id: Discussions about the use of FreeBSD-current List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 17 Jun 2020 06:23:55 -0000 On 17/06/2020 04:53, Rajesh Kumar wrote: > Then, I am trying to compile the driver modules and hit the > compilation error. I haven't done "install world" as I don't want the base > 12.0 to be disturbed. You should do `make buildenv` and then do the module build in the subshell. This way you will be using a compiler (toolchain, in general) form the buildworld, not the currently installed compiler. -- Andriy Gapon From owner-freebsd-current@freebsd.org Wed Jun 17 14:00:10 2020 Return-Path: Delivered-To: freebsd-current@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 0B06F34FB48 for ; Wed, 17 Jun 2020 14:00:10 +0000 (UTC) (envelope-from imb@protected-networks.net) Received: from mail.protected-networks.net (mail.protected-networks.net [202.12.127.228]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "mail.protected-networks.net", Issuer "Protected Networks CA" (not verified)) by mx1.freebsd.org (Postfix) with ESMTPS id 49n6CD6DnHz3ZlM for ; Wed, 17 Jun 2020 14:00:08 +0000 (UTC) (envelope-from imb@protected-networks.net) Received: from toshi.auburn.protected-networks.net (toshi.auburn.protected-networks.net [192.168.1.10]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (2048 bits) server-digest SHA256) (Client did not present a certificate) (Authenticated sender: imb@mail.protected-networks.net) by mail.protected-networks.net (Postfix) with ESMTPSA id 987E811A55 for ; Wed, 17 Jun 2020 10:00:00 -0400 (EDT) To: freebsd-current From: Michael Butler Subject: magic file update? Message-ID: <230aa491-b510-a852-5f71-052305f752cf@protected-networks.net> Date: Wed, 17 Jun 2020 10:00:00 -0400 User-Agent: Mozilla/5.0 (X11; FreeBSD amd64; rv:68.0) Gecko/20100101 Thunderbird/68.9.0 MIME-Version: 1.0 Content-Type: text/plain; charset=windows-1252 Content-Language: en-NZ Content-Transfer-Encoding: 7bit X-Rspamd-Queue-Id: 49n6CD6DnHz3ZlM X-Spamd-Bar: - X-Spamd-Result: default: False [-1.96 / 15.00]; RCVD_VIA_SMTP_AUTH(0.00)[]; ARC_NA(0.00)[]; R_DKIM_ALLOW(-0.20)[protected-networks.net:s=201508]; MID_RHS_MATCH_FROM(0.00)[]; FROM_HAS_DN(0.00)[]; TO_MATCH_ENVRCPT_ALL(0.00)[]; R_SPF_ALLOW(-0.20)[+mx]; MIME_GOOD(-0.10)[text/plain]; PREVIOUSLY_DELIVERED(0.00)[freebsd-current@freebsd.org]; NEURAL_HAM_LONG(-1.01)[-1.010]; RCPT_COUNT_ONE(0.00)[1]; NEURAL_HAM_MEDIUM(-0.99)[-0.989]; TO_DN_ALL(0.00)[]; DKIM_TRACE(0.00)[protected-networks.net:+]; DMARC_POLICY_ALLOW(-0.50)[protected-networks.net,reject]; NEURAL_SPAM_SHORT(0.04)[0.043]; FROM_EQ_ENVFROM(0.00)[]; MIME_TRACE(0.00)[0:+]; SUBJECT_ENDS_QUESTION(1.00)[]; ASN(0.00)[asn:5716, ipnet:202.12.127.0/24, country:US]; RCVD_COUNT_TWO(0.00)[2]; RCVD_TLS_ALL(0.00)[] X-BeenThere: freebsd-current@freebsd.org X-Mailman-Version: 2.1.33 Precedence: list List-Id: Discussions about the use of FreeBSD-current List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 17 Jun 2020 14:00:10 -0000 I'm seeing this message repeatedly during port builds. Should I be concerned? file: File 5.39 supports only version 16 magic files. `/usr/share/misc/magic.mgc' is version 14 imb From owner-freebsd-current@freebsd.org Wed Jun 17 15:09:06 2020 Return-Path: Delivered-To: freebsd-current@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id A9E8E350FCE for ; Wed, 17 Jun 2020 15:09:06 +0000 (UTC) (envelope-from antoine.brodin.freebsd@gmail.com) Received: from mail-qk1-f181.google.com (mail-qk1-f181.google.com [209.85.222.181]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "GTS CA 1O1" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 49n7kn6Y6Tz3dcm; Wed, 17 Jun 2020 15:09:05 +0000 (UTC) (envelope-from antoine.brodin.freebsd@gmail.com) Received: by mail-qk1-f181.google.com with SMTP id n11so2300553qkn.8; Wed, 17 Jun 2020 08:09:05 -0700 (PDT) X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:references:in-reply-to:from:date :message-id:subject:to:cc; bh=MqoXcnBs07V4J8pHaKqcUAFQrbdo5vM1kSYZZC3p9Dc=; b=dL+wu/zShsRwWarQzDd3b8mQlGxpuK34XlfIu2ThcGO9NUwfjGMfNitU5If/+QKtOI w3bdtdfs7HZROLDBNMXG7K/pM56sTr+a05lAr7Q3lPit5rnYOnV7TYgnj37D852QRuzT SmhJL5tK7D7pH2jnXf4ri+L33Yw0sy3tjgjo30oFcuVGTujyjxLc5CN2j1jriVshy6kC xymi/phu9cN7RJYyYtnYzZDZL7+Akn+BMiG3iMaezaiyD8958sEGuN4S3EHv58uJ6Vrw CVw5UBoF5RgHUXwyNr/S71p/c9QILY/XhoFFDsxj6OQYiL342qNZIi+H04v/5xmb4UaS xJEA== X-Gm-Message-State: AOAM533hyptcznm5lSSVR/jrYapjkPEg1J4xMadH5lpfLdCZU0IUOfX9 1VbaeScmUMuvJNrnmBFGkoDFyeLC7xYJ9ZoQwMO1iaTZ X-Google-Smtp-Source: ABdhPJytgyMa3YUpdMhQ4mgGgt157/ojwy2gNcsFDssNAIu9TbzxCGNfyrLag3tW/2ilpplifQ/69lfeohI5181BLRU= X-Received: by 2002:ae9:ef8c:: with SMTP id d134mr26433196qkg.66.1592406545007; Wed, 17 Jun 2020 08:09:05 -0700 (PDT) MIME-Version: 1.0 References: <230aa491-b510-a852-5f71-052305f752cf@protected-networks.net> In-Reply-To: <230aa491-b510-a852-5f71-052305f752cf@protected-networks.net> From: Antoine Brodin Date: Wed, 17 Jun 2020 17:08:52 +0200 Message-ID: Subject: Re: magic file update? To: Michael Butler , Xin LI Cc: freebsd-current Content-Type: text/plain; charset="UTF-8" X-Rspamd-Queue-Id: 49n7kn6Y6Tz3dcm X-Spamd-Bar: / Authentication-Results: mx1.freebsd.org; dkim=none; dmarc=none; spf=pass (mx1.freebsd.org: domain of antoinebrodinfreebsd@gmail.com designates 209.85.222.181 as permitted sender) smtp.mailfrom=antoinebrodinfreebsd@gmail.com X-Spamd-Result: default: False [-0.20 / 15.00]; MIME_TRACE(0.00)[0:+]; ARC_NA(0.00)[]; FROM_NEQ_ENVFROM(0.00)[antoine@freebsd.org,antoinebrodinfreebsd@gmail.com]; FROM_HAS_DN(0.00)[]; RCPT_COUNT_THREE(0.00)[3]; R_SPF_ALLOW(-0.20)[+ip4:209.85.128.0/17]; RCVD_TLS_ALL(0.00)[]; MIME_GOOD(-0.10)[text/plain]; DMARC_NA(0.00)[freebsd.org]; NEURAL_HAM_LONG(-0.90)[-0.897]; NEURAL_SPAM_SHORT(0.17)[0.174]; TO_MATCH_ENVRCPT_SOME(0.00)[]; TO_DN_ALL(0.00)[]; RCVD_IN_DNSWL_NONE(0.00)[209.85.222.181:from]; NEURAL_HAM_MEDIUM(-0.48)[-0.477]; FORGED_SENDER(0.30)[antoine@freebsd.org,antoinebrodinfreebsd@gmail.com]; RWL_MAILSPIKE_POSSIBLE(0.00)[209.85.222.181:from]; SUBJECT_ENDS_QUESTION(1.00)[]; FREEMAIL_ENVFROM(0.00)[gmail.com]; ASN(0.00)[asn:15169, ipnet:209.85.128.0/17, country:US]; R_DKIM_NA(0.00)[]; TAGGED_FROM(0.00)[]; RCVD_COUNT_TWO(0.00)[2] X-BeenThere: freebsd-current@freebsd.org X-Mailman-Version: 2.1.33 Precedence: list List-Id: Discussions about the use of FreeBSD-current List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 17 Jun 2020 15:09:06 -0000 On Wed, Jun 17, 2020 at 4:00 PM Michael Butler wrote: > > I'm seeing this message repeatedly during port builds. Should I be > concerned? > > file: File 5.39 supports only version 16 magic files. > `/usr/share/misc/magic.mgc' is version 14 Hi, FILES and FILESDIR are overwritten in lib/libmagic/Makefile :-/ Antoine From owner-freebsd-current@freebsd.org Wed Jun 17 16:24:10 2020 Return-Path: Delivered-To: freebsd-current@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id B69B2353059 for ; Wed, 17 Jun 2020 16:24:10 +0000 (UTC) (envelope-from delphij@delphij.net) Received: from anubis.delphij.net (anubis.delphij.net [64.62.153.212]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "anubis.delphij.net", Issuer "Let's Encrypt Authority X3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 49n9PQ3Xfhz41mj; Wed, 17 Jun 2020 16:24:10 +0000 (UTC) (envelope-from delphij@delphij.net) Received: from p51.home.us.delphij.net (unknown [IPv6:2601:646:8600:58ba:e670:b8ff:fe5c:4e69]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange ECDHE (P-384) server-signature RSA-PSS (4096 bits)) (Client did not present a certificate) by anubis.delphij.net (Postfix) with ESMTPSA id 3A76B33599; Wed, 17 Jun 2020 09:24:09 -0700 (PDT) Reply-To: d@delphij.net Subject: Re: magic file update? To: Antoine Brodin , Michael Butler , Xin LI Cc: freebsd-current References: <230aa491-b510-a852-5f71-052305f752cf@protected-networks.net> From: Xin Li Autocrypt: addr=delphij@delphij.net; keydata= mQINBFuSR4oBEACvvEgwRIHs6IcSP/yaDtySF78Ji3rP29qdiQsxhMsOtvtffdbS56VApIWO UFb3/iN2gA8HwLvrmjijN0HEoLVX7na1WARmxRYzQMtApsZIUTtx7hnUYlsi2F5odZa6CDW9 a954DLRzYxiUwYDcu5Zjl9bglK1H8e/N9uC0Vuigr4teWfh86brzOyf819QzwFVYfMIK4ihw QGwMvTzbyVuCFy+LENkmcVYni70oQy6rZ5ktSuYbuOFvu7inRRfhSWPHziV7k+bW88sJ7xhv lBlegcnhkSudWX2M8tZ3MO1PJOcyys0CJlsBY5Weiog2lIPi05h/E9pZ9mc1Vud17iqDaL6w RaggOUhuPfDGCdO5ro82W4BZGeQMRnRF5Ntk+t2ShIH4nn3xRLV0E5nziCiKlgiMqOrz/ZTL QTVbHrCuiwD+fSK14y0oHbkOLYTYLlgh1JbwfY2Ty7elOYiWzyeJ7sJh2dF91NSEneWIOys3 mBpuvtU3nSzzTvAB48VV+Nbg1CpIOgNlPjj7uhIum/Z/VjUaJEyaLpTIRh0MVJVcbP7hXSqZ NA35EEZZVnWEOYdycm4CmEdeNPWkrAf2Ya77iR5VLGypwMlsUMQPh+sKVWDD38M8stFGBBNm d01Hi74Bsq5hKan654dOqMt5eYklrVj0ucMzFQtus7oE502UswARAQABtBxYaW4gTEkgPGRl bHBoaWpAZGVscGhpai5uZXQ+iQJUBBMBCgA+FiEEceNg5NEMZIki80nQQHl/fJX0g08FAluS R/YCGwMFCQmuhAAFCwkIBwMFFQoJCAsFFgIDAQACHgECF4AACgkQQHl/fJX0g0+2Og//bWpE F2V5/M5l6YW1T8oLcT9rIOH6oq9M0LMNRgFeiNNnilGIeeIgtOGBRueG4CZiZAvsRPJkrO70 1R2SrdkCIvwGUzUAxx1NfBWb+vgm4fgkW/MotGonceM5v0qfSKKXasWvDctkK28aG+IoQzmi FjXNW4+ju4zeQFYwD4ZDWqw9MqO0hVb24uW3dxtQhbfmOLgJ/PEDMQaFuANbW1c+iR0BQA3D Go/EeMY4kpN8on6Aqt/S/4JVltudfQ9OXdjQsC7netSaB9K3mHGt9aKAAB7RzlRY00DKkYS/ /eQwLzGPmK7yX13M68mMDjBs6mIR8t/E1S5OdBNhHRPNPlEbwugR4KaiCsN5yqzJoSV99fKY z2VyxjWPaG8yhHE+jmKUgIBKTfFUQEfkriQR4EASoeJ+soaMTiFDBij1Zw5n3ndLRFMB1ZCl fZLER36mAgW4m4kP83TWnDiJLxOxSOxifV8HpTFjff902H85cybg9KMwrfPDr6W19GGk5Vo1 fkza5krRMGbKWb7+74Evusi0ZxJLIOFwp5Y8eVqUMZaAD3f1ZX1M3pgXOp20QgAy+2KvMHij rLa4q+tMGRzYYD1BnFVSVdXAX5VOoTmHBcDz67DkuRwk2Byp1sgd407oEOmSwrNJlKS0TPCm xUJ2fdSQF+1/MMSRfee49vtMvz7cOrC5Ag0EW5JHigEQANiBmIFAfRNH3nzYNWC0yC+tfx3z sUwAsH1VaBM/cTib+yKtbBOSIlXWjJZWX3MHwoI/1LeGghB2mxkkX1L0pJ/vj1eXNR+sFZ32 0pYcl61Fxg/5fioG4QDTM4i3i7NR5PxDnc6UVaynSlII93DedRhZ1ROtdn4vyMgzsDiqhbL7 BthDOt5KxjqdRk4qRPSw7BovEqZLOcG5IJtf/zZUzRbM7SBljEbOAfekDGx1Br+RrYSD7/Ef Pwwzou9T8315IpBpIHyQF/dZNk3iFiB9Ed5CA71ZRYV5YoLWE9lL0j9kxOLQ5vHnX3mVq7QZ Bc7nzwZ6UhQgYmrG5+RWvuiPpGwvDRIsugJUGXucYkAQh5kuNblmkwpv6u9rNMjCNbzAylOa qdogra5EW+RUSbRz0b4iIr8nnZeAlh7BihCe7JjOwbDjoBEEEtSfVc4hD/LENqpcYVrChphf aOLB9YIXhnVDTVvMc9OklWT/81HzAaDQqOQCzEfY92199Ct9/CwRoQ2OpO8TO5+8A7b9Nb33 nmxMn09mb48ruRacMrfHxCWbgU4w9SEfbip4GcS5wGG6yTC+hw55Iwnnwus40NrJ0GEr8a4r cdsLbkvlyoNHB8ZGgyJ4aFCQ1V4qE1BnlTk7Z8BYBUkJM1odPSkVvHpCnMUjVpJ3hEOC+73Z YH1dh7lZABEBAAGJAjwEGAEKACYWIQRx42Dk0QxkiSLzSdBAeX98lfSDTwUCW5JHigIbDAUJ Ca6EAAAKCRBAeX98lfSDTz8DEACMh3poeUb+gWNF4RWFZuLteZVo0+E1JLYXQkmtrRBLXviP +Qy0pXyFAVxLM4hNIBoIDYfK9BcwrBYf7AwSKrH0GiNwFpgHCkbZd6qoZy2gB+adTnCpVCTJ KJetsH/8awkrChJWMK0ckGf3EeWMPvawG7kW7FBz70NYEZ0pOMiaEZNVtzD3wwbYWUiDFYth 83XGglOExg+1ShTW5XjQPRrdyJAO+aUW4o3lVjfyUJXMgI4rmhMiLVm06GuNrbpKIF0s+4Vd jQAjhrDQjfoXi9CkfsA/cONseuHNv1JGj3RqHiqHJq1dbrpodXp925zGDAnUGxCOBPoFopAH gVzR89GTut059GpwqsddZmU6y7rqifuam/ekJ+QRwc16vgt7pHqCrTY8WPxRZr2UpFU1wlTo COdeiFep1gq1F9jzFjJnoMaAdmC6k7bgAA+RQusOgIhJL0jIej7DoAHxmxFFCfRy+lDtpXwF gQ8HMvzHI65QWmQnMo7s6SQH/ZH5s1yR6SJq8+3lDz+dCuT42qJVqIPVvxd10LW0FNN+t7HF eLadU6ekSgD13/EYMYXlvNHkw7dAItSDxIzgRyykLz0bCU9xwNWoS4Z43+ifF9anJ+uR0ltW El1j++h6ZrD3LLuCgJIt1so0m49GzdcSpOI7LCwMlacyvafiEyjUn+tSNDsnfw== Organization: The FreeBSD Project Message-ID: Date: Wed, 17 Jun 2020 09:24:02 -0700 MIME-Version: 1.0 In-Reply-To: Content-Type: multipart/signed; micalg=pgp-sha512; protocol="application/pgp-signature"; boundary="CLVbDInxyTnMDamYgZnvZ2JpWDamBSPwh" X-Rspamd-Queue-Id: 49n9PQ3Xfhz41mj X-Spamd-Bar: ---- X-Spamd-Result: default: False [-4.00 / 15.00]; REPLY(-4.00)[]; ASN(0.00)[asn:6939, ipnet:64.62.128.0/18, country:US] X-BeenThere: freebsd-current@freebsd.org X-Mailman-Version: 2.1.33 Precedence: list List-Id: Discussions about the use of FreeBSD-current List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 17 Jun 2020 16:24:10 -0000 This is an OpenPGP/MIME signed message (RFC 4880 and 3156) --CLVbDInxyTnMDamYgZnvZ2JpWDamBSPwh Content-Type: multipart/mixed; boundary="wAYYnggl8F5nDuHLdqJs5W4vKOkORsHhB"; protected-headers="v1" From: Xin Li Reply-To: d@delphij.net To: Antoine Brodin , Michael Butler , Xin LI Cc: freebsd-current Message-ID: Subject: Re: magic file update? References: <230aa491-b510-a852-5f71-052305f752cf@protected-networks.net> In-Reply-To: --wAYYnggl8F5nDuHLdqJs5W4vKOkORsHhB Content-Type: text/plain; charset=utf-8 Content-Language: en-US Content-Transfer-Encoding: quoted-printable On 6/17/20 8:08 AM, Antoine Brodin wrote: > On Wed, Jun 17, 2020 at 4:00 PM Michael Butler > wrote: >> >> I'm seeing this message repeatedly during port builds. Should I be >> concerned? >> >> file: File 5.39 supports only version 16 magic files. >> `/usr/share/misc/magic.mgc' is version 14 >=20 > Hi, >=20 > FILES and FILESDIR are overwritten in lib/libmagic/Makefile :-/ Thanks, this should have been fixed by r362279. I should have used a fresh installation for testing, sorry about that. Cheers, --wAYYnggl8F5nDuHLdqJs5W4vKOkORsHhB-- --CLVbDInxyTnMDamYgZnvZ2JpWDamBSPwh Content-Type: application/pgp-signature; name="signature.asc" Content-Description: OpenPGP digital signature Content-Disposition: attachment; filename="signature.asc" -----BEGIN PGP SIGNATURE----- Version: GnuPG v2.2.20 (FreeBSD) iQIzBAEBCgAdFiEEceNg5NEMZIki80nQQHl/fJX0g08FAl7qQ6IACgkQQHl/fJX0 g095lQ/+LpvyUrr2D5zcsxyf/JH5reRitz7eBenjYJDdd1cNrlpApEWc/yjE9oJ7 h9fepvZJugUvZD/6wHcYBJB6htfgE6DHUultSp/eJjAyAYV/M6hQtstTOXNmEfO6 7bcU1RwgBpD40Z8xYMjC7rEjbqGUEHq3mBOycBVBW+KDGA5ipZVaZ+fk5bFPiX9y Uq35nzXOHzwpeLWm3DeVclBSQE9wwdyUeLW+2iyu8Pr89alvKDf9qKT3yGF9guLw xlExhuqT7piTqCEdt6vB+CeFgexnuXYIBzTU4/ml9CsCNLucB/FxdfwmTlCIFWC/ y/x+EDVBdYI7s6g/R4zjVHoUY1p6eB5x9Xraq4sDO+Rkoh8osgVpFOXS8f90m1y8 UanpKw/m8HVSXS8wQKwYZ+eVQpoLp9JUm5ef1EF3xQpU0MddkZTVkOH/iEYyEYBu m62qZmi5gMb+WfV77yi9aXKtuQF52LkHOju0Zx0rUaPsfvZ06gDwBeTeS7L3Udr0 der5a3sRN/8oyb6tUvzKStJRkf8MfC6t3m3TMzT5w2qb9D1FEadoipDPAdtievBr 4bVhvXF/kyoCxRm69DXYfIP9EJiaPR1xSZ1O6huaOWJfbrqNGF3bDrFGwizl5z5p xV5/OMtAcczVaeLVnJ4D+ZQ3cQb6KmCjXS4Dqu2VDP0y9qjMglo= =RVOx -----END PGP SIGNATURE----- --CLVbDInxyTnMDamYgZnvZ2JpWDamBSPwh-- From owner-freebsd-current@freebsd.org Wed Jun 17 17:40:59 2020 Return-Path: Delivered-To: freebsd-current@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 0EC1D354CE6 for ; Wed, 17 Jun 2020 17:40:59 +0000 (UTC) (envelope-from freebsd-rwg@gndrsh.dnsmgr.net) Received: from gndrsh.dnsmgr.net (br1.CN84in.dnsmgr.net [69.59.192.140]) (using TLSv1 with cipher DHE-RSA-AES256-SHA (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 49nC622Kb8z478w for ; Wed, 17 Jun 2020 17:40:57 +0000 (UTC) (envelope-from freebsd-rwg@gndrsh.dnsmgr.net) Received: from gndrsh.dnsmgr.net (localhost [127.0.0.1]) by gndrsh.dnsmgr.net (8.13.3/8.13.3) with ESMTP id 05HHecd5086406; Wed, 17 Jun 2020 10:40:38 -0700 (PDT) (envelope-from freebsd-rwg@gndrsh.dnsmgr.net) Received: (from freebsd-rwg@localhost) by gndrsh.dnsmgr.net (8.13.3/8.13.3/Submit) id 05HHecjX086405; Wed, 17 Jun 2020 10:40:38 -0700 (PDT) (envelope-from freebsd-rwg) From: "Rodney W. Grimes" Message-Id: <202006171740.05HHecjX086405@gndrsh.dnsmgr.net> Subject: Re: CTF: UEFI HTTP boot support In-Reply-To: <0b38b537-9d9b-b3ae-bae3-bb5b4926bbaa@bsdio.com> To: Rebecca Cran Date: Wed, 17 Jun 2020 10:40:38 -0700 (PDT) CC: Miguel C , freebsd-current@freebsd.org X-Mailer: ELM [version 2.4ME+ PL121h (25)] MIME-Version: 1.0 Content-Transfer-Encoding: 7bit Content-Type: text/plain; charset=US-ASCII X-Rspamd-Queue-Id: 49nC622Kb8z478w X-Spamd-Bar: + Authentication-Results: mx1.freebsd.org; dkim=none; dmarc=none; spf=none (mx1.freebsd.org: domain of freebsd-rwg@gndrsh.dnsmgr.net has no SPF policy when checking 69.59.192.140) smtp.mailfrom=freebsd-rwg@gndrsh.dnsmgr.net X-Spamd-Result: default: False [1.62 / 15.00]; RCVD_TLS_LAST(0.00)[]; ARC_NA(0.00)[]; FROM_HAS_DN(0.00)[]; RCPT_COUNT_THREE(0.00)[3]; TO_DN_SOME(0.00)[]; NEURAL_HAM_LONG(-0.20)[-0.195]; MIME_GOOD(-0.10)[text/plain]; DMARC_NA(0.00)[dnsmgr.net]; AUTH_NA(1.00)[]; NEURAL_SPAM_MEDIUM(0.57)[0.565]; NEURAL_SPAM_SHORT(0.35)[0.349]; TO_MATCH_ENVRCPT_SOME(0.00)[]; R_SPF_NA(0.00)[no SPF record]; FROM_EQ_ENVFROM(0.00)[]; R_DKIM_NA(0.00)[]; MIME_TRACE(0.00)[0:+]; RCVD_COUNT_TWO(0.00)[2]; ASN(0.00)[asn:13868, ipnet:69.59.192.0/19, country:US]; MID_RHS_MATCH_FROM(0.00)[]; FREEMAIL_CC(0.00)[gmail.com,freebsd.org] X-BeenThere: freebsd-current@freebsd.org X-Mailman-Version: 2.1.33 Precedence: list List-Id: Discussions about the use of FreeBSD-current List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 17 Jun 2020 17:40:59 -0000 > On 6/16/20 5:17 AM, Miguel C wrote: > > > I've been trying out FreeBSD with raspberry Pi4 (4GB) and wanted to see > > what the state of HTTP BOOT is in FreeBSD, so I bumped into this! > > > > I'm curious if it should be possible to point to a img/iso directly (I > > tried to use the img.xz unpacked it and make it available on a local web > > server and that didn't seem to work for me) but maybe thats cause those > > images miss something, so arm64 aside does that work for amd64? I.E. using > > the bootonly.iso? > > Unfortunately HTTP boot only works as far as the kernel: UEFI fetches > loader.efi, the loader fetches and runs the kernel over HTTP -- and then > you need to use NFS to mount the filesystem (or have a local root > filesystem). > > > UEFI also has RamDisk support, but I don't think that's for remote > ISO/disk files, just local files. > Does FreeBSD kernel have a driver that can talk to the UEFI ramdisk? I believe that is how many of the other distro's are actually able to do this "load the stock .iso over the network and just run from that in memory." I have booted serveral things this way and it is a nice feature. > -- > Rebecca Cran -- Rod Grimes rgrimes@freebsd.org From owner-freebsd-current@freebsd.org Wed Jun 17 17:52:53 2020 Return-Path: Delivered-To: freebsd-current@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 0F76A355746 for ; Wed, 17 Jun 2020 17:52:53 +0000 (UTC) (envelope-from freebsd-rwg@gndrsh.dnsmgr.net) Received: from gndrsh.dnsmgr.net (br1.CN84in.dnsmgr.net [69.59.192.140]) (using TLSv1 with cipher DHE-RSA-AES256-SHA (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 49nCMm0HQXz48Xc for ; Wed, 17 Jun 2020 17:52:51 +0000 (UTC) (envelope-from freebsd-rwg@gndrsh.dnsmgr.net) Received: from gndrsh.dnsmgr.net (localhost [127.0.0.1]) by gndrsh.dnsmgr.net (8.13.3/8.13.3) with ESMTP id 05HHqobW086455; Wed, 17 Jun 2020 10:52:50 -0700 (PDT) (envelope-from freebsd-rwg@gndrsh.dnsmgr.net) Received: (from freebsd-rwg@localhost) by gndrsh.dnsmgr.net (8.13.3/8.13.3/Submit) id 05HHqo0E086454; Wed, 17 Jun 2020 10:52:50 -0700 (PDT) (envelope-from freebsd-rwg) From: "Rodney W. Grimes" Message-Id: <202006171752.05HHqo0E086454@gndrsh.dnsmgr.net> Subject: Re: CTF: UEFI HTTP boot support In-Reply-To: <46934.1592351291@kaos.jnpr.net> To: "Simon J. Gerraty" Date: Wed, 17 Jun 2020 10:52:50 -0700 (PDT) CC: "Rodney W. Grimes" , Miguel C , freebsd-current@freebsd.org X-Mailer: ELM [version 2.4ME+ PL121h (25)] MIME-Version: 1.0 Content-Transfer-Encoding: 7bit Content-Type: text/plain; charset=US-ASCII X-Rspamd-Queue-Id: 49nCMm0HQXz48Xc X-Spamd-Bar: + Authentication-Results: mx1.freebsd.org; dkim=none; dmarc=none; spf=none (mx1.freebsd.org: domain of freebsd-rwg@gndrsh.dnsmgr.net has no SPF policy when checking 69.59.192.140) smtp.mailfrom=freebsd-rwg@gndrsh.dnsmgr.net X-Spamd-Result: default: False [1.57 / 15.00]; RCVD_TLS_LAST(0.00)[]; ARC_NA(0.00)[]; FROM_HAS_DN(0.00)[]; RCPT_COUNT_THREE(0.00)[4]; TO_DN_SOME(0.00)[]; NEURAL_HAM_LONG(-0.22)[-0.219]; MIME_GOOD(-0.10)[text/plain]; DMARC_NA(0.00)[dnsmgr.net]; AUTH_NA(1.00)[]; NEURAL_SPAM_MEDIUM(0.51)[0.508]; NEURAL_SPAM_SHORT(0.38)[0.378]; TO_MATCH_ENVRCPT_SOME(0.00)[]; R_SPF_NA(0.00)[no SPF record]; FROM_EQ_ENVFROM(0.00)[]; R_DKIM_NA(0.00)[]; MIME_TRACE(0.00)[0:+]; RCVD_COUNT_TWO(0.00)[2]; ASN(0.00)[asn:13868, ipnet:69.59.192.0/19, country:US]; MID_RHS_MATCH_FROM(0.00)[]; FREEMAIL_CC(0.00)[gndrsh.dnsmgr.net,gmail.com,freebsd.org] X-BeenThere: freebsd-current@freebsd.org X-Mailman-Version: 2.1.33 Precedence: list List-Id: Discussions about the use of FreeBSD-current List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 17 Jun 2020 17:52:53 -0000 > Rodney W. Grimes wrote: > > > The "fake cd drive" is in the kernel, loader just copies the iso into > > > memory like any other module, and by the time that's done you just > > > reboot into the newly installed system, which again uses > > > > > > vfs.root.mountfrom="cd9660:/dev/md0.uzip" > > ^^^ > > > > Argh, the cd9660 confused me, I think your doing a > > "root on mfs/md"? > > loader.conf says > > rootfs_load="yes" > rootfs_name="contents.izo" > rootfs_type="md_image" > vfs.root.mountfrom="cd9660:/dev/md0.uzip" > > contents.izo is uzip'd contents.iso which file(1) > describes as ISO 9660 CD-ROM filesystem data '' > > That's for normal boot, for the loader 'install' command > it expects an uncompressed iso for rootfs. Ok, now the puzzle is how much work to get from a stock FreeBSD .iso image to something that works with this. Obviously we need a non-stock /boot/loader.conf file, or to type some commands manually at a loader prompt. I believe the stock GENERIC kernel has the md_root support for this already, so it may not be that hard to do. -- Rod Grimes rgrimes@freebsd.org From owner-freebsd-current@freebsd.org Wed Jun 17 18:00:52 2020 Return-Path: Delivered-To: freebsd-current@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 8DE99355CB7 for ; Wed, 17 Jun 2020 18:00:52 +0000 (UTC) (envelope-from freebsd-rwg@gndrsh.dnsmgr.net) Received: from gndrsh.dnsmgr.net (br1.CN84in.dnsmgr.net [69.59.192.140]) (using TLSv1 with cipher DHE-RSA-AES256-SHA (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 49nCXw0r9sz49tH for ; Wed, 17 Jun 2020 18:00:47 +0000 (UTC) (envelope-from freebsd-rwg@gndrsh.dnsmgr.net) Received: from gndrsh.dnsmgr.net (localhost [127.0.0.1]) by gndrsh.dnsmgr.net (8.13.3/8.13.3) with ESMTP id 05HI0jcw086510; Wed, 17 Jun 2020 11:00:45 -0700 (PDT) (envelope-from freebsd-rwg@gndrsh.dnsmgr.net) Received: (from freebsd-rwg@localhost) by gndrsh.dnsmgr.net (8.13.3/8.13.3/Submit) id 05HI0jET086509; Wed, 17 Jun 2020 11:00:45 -0700 (PDT) (envelope-from freebsd-rwg) From: "Rodney W. Grimes" Message-Id: <202006171800.05HI0jET086509@gndrsh.dnsmgr.net> Subject: Re: CTF: UEFI HTTP boot support In-Reply-To: To: Maxim Sobolev Date: Wed, 17 Jun 2020 11:00:45 -0700 (PDT) CC: "Rodney W. Grimes" , Miguel C , FreeBSD Current X-Mailer: ELM [version 2.4ME+ PL121h (25)] MIME-Version: 1.0 Content-Transfer-Encoding: 7bit Content-Type: text/plain; charset=US-ASCII X-Rspamd-Queue-Id: 49nCXw0r9sz49tH X-Spamd-Bar: + Authentication-Results: mx1.freebsd.org; dkim=none; dmarc=none; spf=none (mx1.freebsd.org: domain of freebsd-rwg@gndrsh.dnsmgr.net has no SPF policy when checking 69.59.192.140) smtp.mailfrom=freebsd-rwg@gndrsh.dnsmgr.net X-Spamd-Result: default: False [1.47 / 15.00]; ARC_NA(0.00)[]; FREEMAIL_CC(0.00)[gndrsh.dnsmgr.net,gmail.com,freebsd.org]; FROM_HAS_DN(0.00)[]; RCPT_COUNT_THREE(0.00)[4]; NEURAL_SPAM_SHORT(0.34)[0.337]; NEURAL_HAM_LONG(-0.19)[-0.192]; MIME_GOOD(-0.10)[text/plain]; DMARC_NA(0.00)[dnsmgr.net]; AUTH_NA(1.00)[]; NEURAL_SPAM_MEDIUM(0.42)[0.425]; TO_MATCH_ENVRCPT_SOME(0.00)[]; TO_DN_ALL(0.00)[]; R_SPF_NA(0.00)[no SPF record]; FROM_EQ_ENVFROM(0.00)[]; RCVD_TLS_LAST(0.00)[]; R_DKIM_NA(0.00)[]; RCVD_COUNT_TWO(0.00)[2]; MIME_TRACE(0.00)[0:+]; MID_RHS_MATCH_FROM(0.00)[]; ASN(0.00)[asn:13868, ipnet:69.59.192.0/19, country:US] X-BeenThere: freebsd-current@freebsd.org X-Mailman-Version: 2.1.33 Precedence: list List-Id: Discussions about the use of FreeBSD-current List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 17 Jun 2020 18:00:52 -0000 > On Tue., Jun. 16, 2020, 8:35 a.m. Rodney W. Grimes, < > freebsd-rwg@gndrsh.dnsmgr.net> wrote: > > > > I've been trying out FreeBSD with raspberry Pi4 (4GB) and wanted to see > > > what the state of HTTP BOOT is in FreeBSD, so I bumped into this! > > > > > > I'm curious if it should be possible to point to a img/iso directly (I > > > tried to use the img.xz unpacked it and make it available on a local web > > > server and that didn't seem to work for me) but maybe thats cause those > > > images miss something, so arm64 aside does that work for amd64? I.E. > > using > > > the bootonly.iso? > > > > One problem you run into in attemtping this is even if you get an > > image downloaded and started that image is being provided by some > > memory device driver that emulates some type of iso device. > > FreeBSD does not have a driver for that device so once the kernel > > gets to the point of mounting its root file system it falls on > > its face with a mountroot failure. > > > > I donno what you are talking about Rodney, frankly! You information might > be way outdated, like 15 years outdated. :) FreeBSD comes with very decent > compressed image support in MD(4)+geom_uzip, which could be just UFS > snapshot or something created with mkimg utility. That said image could be > then either loaded after the kernel or embedded into one. Using this > approach we deploy our systems here, both kernel and all root + python > interpreter + custom gui installer fit into 40mb ISO but apart from loader > bits it's just two files. Max, Let me try explain what this user is actually experienceing, and that is taking a box stock linux distro, sticking it on a webserver and using PXE/HTTP booting to a running system. FreeBSD can not achieve that today WITHOUT some additional work. All that stuff like UFS snapshot, mkimg utlity, embeding the image is a ton of work compared to what others are doing. This person probably does not even have a running FreeBSD box to do any of your suggested solutions on. So give me some credit, I have only been doing "diskless" since 1982, and actually do exactly what the OP is doing with Esxi, Ubuntu, Windows Installers, etc. Just my choice of protocol at the PXE layer is NFS instead of HTTP, but my config files can do HTTP with 1 variable change and point a web server at the root of my boot images tree. I even have a menu entry that sends me off to: https://netboot.xyz/ Regards, Rod > > -Max > > > > > > > > And on the other hand is there any doc on how to set up dhcp/http > > specific > > > to FreeBSD similar to https://en.opensuse.org/UEFI_HTTPBoot_Server_Setup > > ? > > > > Since Linux uses this idea of a kernel payload and an initrd payload > > to boot with it is much easier to get these 2 things over the network > > and then have a workable system. FreeBSD does not have the initrd > > payload and that complicates things, you need a functionaly filesystem > > avaliable at the end of kernel initilization. > > > > > > I looked into https://www.freebsd.org/doc/handbook/network-diskless.html > > > but that doesn't seem to be up to date (or at least it focuses only on > > PXE > > > and TFTP). > > > > Yes, old but workable. I have a more advanced system that supports NFS > > booting using NFS support in PXE. The only thing done via tftp is to > > upgrade the PXE running on the client to one that speaks NFS, then the > > kernel is loaded via NFS and the root file system is later provided > > via NFS. The use of NFS provides very fast boots, and I do not need > > a web server to do it :-). > > > > > For clarification my ultimate goal is to use a few pi4's as "thin > > clients", > > > so eventually I will have to setup an image of the system with the needed > > > software (freerdp) but for starters I just wanted to check if pointing > > > directly to a img/iso would work and that does not seem to be the case. > > > > I would strongly suggest use of NFS instead of trying to provide an > > ISO image, as you no longer need to store the ISO in memory on the > > client box, and with a pi4 your already memory contrained. > > > > > Thanks. > > > _______________________________________________ > > > freebsd-current@freebsd.org mailing list > > > https://lists.freebsd.org/mailman/listinfo/freebsd-current > > > To unsubscribe, send any mail to " > > freebsd-current-unsubscribe@freebsd.org" > > -- > > Rod Grimes > > rgrimes@freebsd.org > > _______________________________________________ > > freebsd-current@freebsd.org mailing list > > https://lists.freebsd.org/mailman/listinfo/freebsd-current > > To unsubscribe, send any mail to "freebsd-current-unsubscribe@freebsd.org" > > > > -- Rod Grimes rgrimes@freebsd.org From owner-freebsd-current@freebsd.org Wed Jun 17 18:06:18 2020 Return-Path: Delivered-To: freebsd-current@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 8E245356A07 for ; Wed, 17 Jun 2020 18:06:18 +0000 (UTC) (envelope-from rebecca@bsdio.com) Received: from out01.mta.xmission.com (out01.mta.xmission.com [166.70.13.231]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 49nCgF4ch3z4G71 for ; Wed, 17 Jun 2020 18:06:17 +0000 (UTC) (envelope-from rebecca@bsdio.com) DKIM-Signature: v=1; a=rsa-sha256; q=dns/txt; c=simple/simple; d=bsdio.com; s=xmission; h=Subject:To:In-Reply-To:Cc:References:Message-Id:Date: Mime-Version:From:Content-Transfer-Encoding:Content-Type:Sender:Reply-To: Content-ID:Content-Description:Resent-Date:Resent-From:Resent-Sender: Resent-To:Resent-Cc:Resent-Message-ID:List-Id:List-Help:List-Unsubscribe: List-Subscribe:List-Post:List-Owner:List-Archive; bh=4oFb5C/a1b+1EZ4jZmicruZgHsGUHfJA4fpekvPNuIs=; b=hdSQlBHdoXXfeD82QTb5ylzGGq e4KDRc5yp7nki5M2Y1INFkR0RjLtmnHx2U2KYMaxKxoJ687eXDBOWmUWUXIcdGVbQOrwr1RrMTsyZ gkRhtjpv4xfKa3x9VnMQuZmbnYqa+szcmT7GJbo85zCW7aFQDZJtSQRVAan6L58OmWYM=; Received: from in01.mta.xmission.com ([166.70.13.51]) by out01.mta.xmission.com with esmtps (TLS1.2:ECDHE_RSA_AES_128_GCM_SHA256:128) (Exim 4.90_1) (envelope-from ) id 1jlcRy-00074a-0a; Wed, 17 Jun 2020 12:06:14 -0600 Received: from mta5.zcs.xmission.com ([166.70.13.69]) by in01.mta.xmission.com with esmtps (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.87) (envelope-from ) id 1jlcRw-0007Qy-Ff; Wed, 17 Jun 2020 12:06:13 -0600 Received: from localhost (localhost [127.0.0.1]) by mta5.zcs.xmission.com (Postfix) with ESMTP id 2C3C71280504; Wed, 17 Jun 2020 12:06:12 -0600 (MDT) X-Amavis-Modified: Mail body modified (using disclaimer) - mta5.zcs.xmission.com Received: from mta5.zcs.xmission.com ([127.0.0.1]) by localhost (mta5.zcs.xmission.com [127.0.0.1]) (amavisd-new, port 10026) with ESMTP id D695aYzCVei8; Wed, 17 Jun 2020 12:06:12 -0600 (MDT) Received: from [IPv6:2607:fb90:8239:a728:cc69:7baa:a67e:f2ba] (unknown [172.58.43.150]) by mta5.zcs.xmission.com (Postfix) with ESMTPSA id E1C62128020B; Wed, 17 Jun 2020 12:06:11 -0600 (MDT) Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: quoted-printable From: Rebecca Cran Mime-Version: 1.0 (1.0) Date: Wed, 17 Jun 2020 12:05:36 -0600 Message-Id: <05B13267-8CE6-452F-A969-C37DE22E640A@bsdio.com> References: <202006171740.05HHecjX086405@gndrsh.dnsmgr.net> Cc: Miguel C , freebsd-current@freebsd.org In-Reply-To: <202006171740.05HHecjX086405@gndrsh.dnsmgr.net> To: "Rodney W. Grimes" X-Mailer: iPhone Mail (17F80) X-XM-SPF: eid=1jlcRw-0007Qy-Ff; ; ; mid=<05B13267-8CE6-452F-A969-C37DE22E640A@bsdio.com>; ; ; hst=in01.mta.xmission.com; ; ; ip=166.70.13.69; ; ; frm=rebecca@bsdio.com; ; ; spf=pass X-SA-Exim-Connect-IP: 166.70.13.69 X-SA-Exim-Mail-From: rebecca@bsdio.com X-Spam-Checker-Version: SpamAssassin 3.4.2 (2018-09-13) on sa06.xmission.com X-Spam-Level: X-Spam-Status: No, score=-0.2 required=8.0 tests=ALL_TRUSTED,BAYES_50, DCC_CHECK_NEGATIVE,T_TM2_M_HEADER_IN_MSG,XM_B_Unicode autolearn=disabled version=3.4.2 X-Spam-Report: * -1.0 ALL_TRUSTED Passed through trusted hosts only via SMTP * 0.8 BAYES_50 BODY: Bayes spam probability is 40 to 60% * [score: 0.4982] * 0.0 XM_B_Unicode BODY: Testing for specific types of unicode * 0.0 T_TM2_M_HEADER_IN_MSG BODY: No description available. * -0.0 DCC_CHECK_NEGATIVE Not listed in DCC * [sa06 0; Body=1 Fuz1=1 Fuz2=1] X-Spam-DCC: ; sa06 0; Body=1 Fuz1=1 Fuz2=1 X-Spam-Combo: ;"Rodney W. Grimes" X-Spam-Relay-Country: X-Spam-Timing: total 877 ms - load_scoreonly_sql: 0.04 (0.0%), signal_user_changed: 9 (1.0%), b_tie_ro: 7 (0.8%), parse: 1.20 (0.1%), extract_message_metadata: 14 (1.6%), get_uri_detail_list: 0.54 (0.1%), tests_pri_-1000: 3.7 (0.4%), tests_pri_-950: 1.24 (0.1%), tests_pri_-900: 0.97 (0.1%), tests_pri_-90: 324 (37.0%), check_bayes: 319 (36.3%), b_tokenize: 4.6 (0.5%), b_tok_get_all: 3.4 (0.4%), b_comp_prob: 1.66 (0.2%), b_tok_touch_all: 305 (34.8%), b_finish: 1.04 (0.1%), tests_pri_0: 510 (58.1%), check_dkim_signature: 0.53 (0.1%), check_dkim_adsp: 429 (49.0%), poll_dns_idle: 421 (48.0%), tests_pri_10: 2.8 (0.3%), tests_pri_500: 8 (0.9%), rewrite_mail: 0.00 (0.0%) Subject: Re: CTF: UEFI HTTP boot support X-Spam-Flag: No X-SA-Exim-Version: 4.2.1 (built Thu, 05 May 2016 13:38:54 -0600) X-SA-Exim-Scanned: Yes (on in01.mta.xmission.com) X-Rspamd-Queue-Id: 49nCgF4ch3z4G71 X-Spamd-Bar: -- Authentication-Results: mx1.freebsd.org; dkim=pass header.d=bsdio.com header.s=xmission header.b=hdSQlBHd; dmarc=none; spf=pass (mx1.freebsd.org: domain of rebecca@bsdio.com designates 166.70.13.231 as permitted sender) smtp.mailfrom=rebecca@bsdio.com X-Spamd-Result: default: False [-2.35 / 15.00]; RCVD_VIA_SMTP_AUTH(0.00)[]; ARC_NA(0.00)[]; RCVD_COUNT_FIVE(0.00)[6]; R_DKIM_ALLOW(-0.20)[bsdio.com:s=xmission]; FROM_HAS_DN(0.00)[]; RCPT_COUNT_THREE(0.00)[3]; MV_CASE(0.50)[]; R_SPF_ALLOW(-0.20)[+ip4:166.70.13.0/24]; MIME_GOOD(-0.10)[text/plain]; DMARC_NA(0.00)[bsdio.com]; NEURAL_HAM_LONG(-0.96)[-0.957]; TO_DN_SOME(0.00)[]; RECEIVED_SPAMHAUS_PBL(0.00)[172.58.43.150:received]; TO_MATCH_ENVRCPT_SOME(0.00)[]; DKIM_TRACE(0.00)[bsdio.com:+]; NEURAL_HAM_SHORT(-0.28)[-0.282]; RWL_MAILSPIKE_GOOD(0.00)[166.70.13.231:from]; NEURAL_HAM_MEDIUM(-1.01)[-1.014]; FROM_EQ_ENVFROM(0.00)[]; MIME_TRACE(0.00)[0:+]; RCVD_TLS_LAST(0.00)[]; ASN(0.00)[asn:6315, ipnet:166.70.0.0/16, country:US]; FREEMAIL_CC(0.00)[gmail.com,freebsd.org]; MID_RHS_MATCH_FROM(0.00)[]; RCVD_IN_DNSWL_LOW(-0.10)[166.70.13.231:from] X-BeenThere: freebsd-current@freebsd.org X-Mailman-Version: 2.1.33 Precedence: list List-Id: Discussions about the use of FreeBSD-current List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 17 Jun 2020 18:06:18 -0000 > On Jun 17, 2020, at 11:40 AM, Rodney W. Grimes wrote: >=20 > Does FreeBSD kernel have a driver that can talk to the UEFI ramdisk? I=E2=80=99m fairly sure UEFI generates it as a standard CD drive. =E2=80=94=20 Rebecca Cran= From owner-freebsd-current@freebsd.org Wed Jun 17 18:06:41 2020 Return-Path: Delivered-To: freebsd-current@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 4B8EA356AA2 for ; Wed, 17 Jun 2020 18:06:41 +0000 (UTC) (envelope-from wlosh@bsdimp.com) Received: from mail-qv1-xf33.google.com (mail-qv1-xf33.google.com [IPv6:2607:f8b0:4864:20::f33]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "GTS CA 1O1" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 49nCgh2W05z4GGd for ; Wed, 17 Jun 2020 18:06:40 +0000 (UTC) (envelope-from wlosh@bsdimp.com) Received: by mail-qv1-xf33.google.com with SMTP id er17so1480681qvb.8 for ; Wed, 17 Jun 2020 11:06:40 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=bsdimp-com.20150623.gappssmtp.com; s=20150623; h=mime-version:references:in-reply-to:from:date:message-id:subject:to :cc; bh=EFal6ZOZwvFAyp+zl3piGdSvgPJVMKcGlSwl176ZNMU=; b=wY/suLwHzPaT7oh/FWYvQZ4IuY7My8cuUZcitJg/wXCz8isU5IROEQbb92X8KqKVsj oSJIvb6u3bf87LAdpU5Ac16FlRxzj9VN9DuX4RV+eafWG9XqiwFikytRj5KyE2hoJTMI WqANJjcQkjzYwlwBg3jf7CyaqcxNb9o7ucQgSCyyhKfLe3SDivKHONFV+eIxK+dvD89H H3TKpb4zJexcCMkGWlNkgq3dBjTqCtIqFFB31/wkByEau6yCq2B9JPXeNlp3sZlQF+Ao HcuPRjtRfz1i9f2rXxGZLzReq2QGiYGTUYdDuVGNxYjzex12WqW29Ov+ZAisjHr3mUUY aHMw== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:references:in-reply-to:from:date :message-id:subject:to:cc; bh=EFal6ZOZwvFAyp+zl3piGdSvgPJVMKcGlSwl176ZNMU=; b=FUHDQfKhod7k1AN0ugRMUXk7Z74HlnWS7vjzU/9rNruNyBXatqA227ZEQuz8LG6bUk dH6gtpucuieeKzHn4KnX4YU45gcnH3u5ByXsZ5tejqHmCMoY6zk9u89xu8TwLMabaXyQ P8oBgXAvK0RnO2t3hwJLm74Dz29hyjztrxLZD0A3YqdpbirMDU1HIE50hXqlxo54NOsx MDaQ9XVigKeRcMUrk+TrITXC9gmTJel9VegdmgWuDQobuofFH1Orq1p549G0uyi76NNj qbssItBS8WlUCLycb1AyT3WZybOA4ivPuMoT3cPSaq8a0J5V7s4I25TFmgGwAk8UdBKG SWew== X-Gm-Message-State: AOAM531nBK2xjynUDNzBzRDJ1BTm1webjEOhRm1vcUc46oapcEJsT1Q5 e35MN6GJo6jbSpyObPy1z28MfjLoh4et0DleBzyJrg== X-Google-Smtp-Source: ABdhPJzpYnsRVgMArr2P5zE6XhuPiyDRvPQXcubcr6xBXM4lTU7H3yUROehgpFkqRTUMd8VmKfwyCYeqeMMY8p8Gii0= X-Received: by 2002:a05:6214:17cb:: with SMTP id cu11mr8726549qvb.202.1592417199103; Wed, 17 Jun 2020 11:06:39 -0700 (PDT) MIME-Version: 1.0 References: <46934.1592351291@kaos.jnpr.net> <202006171752.05HHqo0E086454@gndrsh.dnsmgr.net> In-Reply-To: <202006171752.05HHqo0E086454@gndrsh.dnsmgr.net> From: Warner Losh Date: Wed, 17 Jun 2020 12:06:27 -0600 Message-ID: Subject: Re: CTF: UEFI HTTP boot support To: "Rodney W. Grimes" Cc: "Simon J. Gerraty" , Miguel C , FreeBSD Current X-Rspamd-Queue-Id: 49nCgh2W05z4GGd X-Spamd-Bar: - Authentication-Results: mx1.freebsd.org; dkim=pass header.d=bsdimp-com.20150623.gappssmtp.com header.s=20150623 header.b=wY/suLwH; dmarc=none; spf=none (mx1.freebsd.org: domain of wlosh@bsdimp.com has no SPF policy when checking 2607:f8b0:4864:20::f33) smtp.mailfrom=wlosh@bsdimp.com X-Spamd-Result: default: False [-1.66 / 15.00]; ARC_NA(0.00)[]; NEURAL_HAM_MEDIUM(-0.31)[-0.310]; FREEMAIL_CC(0.00)[juniper.net,gmail.com,freebsd.org]; R_DKIM_ALLOW(-0.20)[bsdimp-com.20150623.gappssmtp.com:s=20150623]; FROM_HAS_DN(0.00)[]; RCPT_COUNT_THREE(0.00)[4]; NEURAL_HAM_LONG(-0.98)[-0.979]; MIME_GOOD(-0.10)[multipart/alternative,text/plain]; PREVIOUSLY_DELIVERED(0.00)[freebsd-current@freebsd.org]; DMARC_NA(0.00)[bsdimp.com]; TO_MATCH_ENVRCPT_SOME(0.00)[]; TO_DN_ALL(0.00)[]; DKIM_TRACE(0.00)[bsdimp-com.20150623.gappssmtp.com:+]; NEURAL_HAM_SHORT(-0.37)[-0.369]; RCVD_IN_DNSWL_NONE(0.00)[2607:f8b0:4864:20::f33:from]; R_SPF_NA(0.00)[no SPF record]; FORGED_SENDER(0.30)[imp@bsdimp.com,wlosh@bsdimp.com]; MIME_TRACE(0.00)[0:+,1:+,2:~]; RCVD_COUNT_TWO(0.00)[2]; RCVD_TLS_ALL(0.00)[]; FROM_NEQ_ENVFROM(0.00)[imp@bsdimp.com,wlosh@bsdimp.com]; ASN(0.00)[asn:15169, ipnet:2607:f8b0::/32, country:US] Content-Type: text/plain; charset="UTF-8" X-Content-Filtered-By: Mailman/MimeDel 2.1.33 X-BeenThere: freebsd-current@freebsd.org X-Mailman-Version: 2.1.33 Precedence: list List-Id: Discussions about the use of FreeBSD-current List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 17 Jun 2020 18:06:41 -0000 On Wed, Jun 17, 2020 at 11:53 AM Rodney W. Grimes < freebsd-rwg@gndrsh.dnsmgr.net> wrote: > > Rodney W. Grimes wrote: > > > > The "fake cd drive" is in the kernel, loader just copies the iso into > > > > memory like any other module, and by the time that's done you just > > > > reboot into the newly installed system, which again uses > > > > > > > > vfs.root.mountfrom="cd9660:/dev/md0.uzip" > > > ^^^ > > > > > > Argh, the cd9660 confused me, I think your doing a > > > "root on mfs/md"? > > > > loader.conf says > > > > rootfs_load="yes" > > rootfs_name="contents.izo" > > rootfs_type="md_image" > > vfs.root.mountfrom="cd9660:/dev/md0.uzip" > > > > contents.izo is uzip'd contents.iso which file(1) > > describes as ISO 9660 CD-ROM filesystem data '' > > > > That's for normal boot, for the loader 'install' command > > it expects an uncompressed iso for rootfs. > > Ok, now the puzzle is how much work to get from a stock FreeBSD .iso > image to something that works with this. Obviously we need a non-stock > /boot/loader.conf file, or to type some commands manually at a loader > prompt. I believe the stock GENERIC kernel has the md_root support > for this already, so it may not be that hard to do. > Looking at the code, I think MD_ROOT alone is insufficient here... If there's no MD root provided, we look for the symbols mfs_root and mfs_root_end, which I think means that rootfs_ in the above example needs to be md_root_ instead so that we find it. You may need to have a custom kernel with 'options MD_ROOT_READONLY' because isofs is read-only. And there's a small chance you may need to define ROOTDEVNAME in the build as well to be "cd9660:/dev/md0.uzip" Every time I do stuff like this I have to re-puzzle it out, alas, but these should give you some guide posts. It should be better documented in md(4), but isn't at the moment. I'd honestly try to get this setup working first loading all the files off a local disk before layering in the networking on top of that. Warner From owner-freebsd-current@freebsd.org Wed Jun 17 18:12:13 2020 Return-Path: Delivered-To: freebsd-current@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id D3A93356DFD for ; Wed, 17 Jun 2020 18:12:13 +0000 (UTC) (envelope-from wlosh@bsdimp.com) Received: from mail-qt1-x82c.google.com (mail-qt1-x82c.google.com [IPv6:2607:f8b0:4864:20::82c]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "GTS CA 1O1" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 49nCp46rLSz4Gx5 for ; Wed, 17 Jun 2020 18:12:12 +0000 (UTC) (envelope-from wlosh@bsdimp.com) Received: by mail-qt1-x82c.google.com with SMTP id e16so2313063qtg.0 for ; Wed, 17 Jun 2020 11:12:12 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=bsdimp-com.20150623.gappssmtp.com; s=20150623; h=mime-version:references:in-reply-to:from:date:message-id:subject:to :cc; bh=Q8tqhac32KQ7Qa6+sJq6Nf0MdoJcBnQMRPx6+FxTKbw=; b=waMfomtlbPhipZ7P98ho3VPpdVPRhJ2R+T6P86/s3/iuaghgjP50KKVvtZv2IfNIs6 sC/kLhjBJRgCKCbXoywgZlom00xkZ4R9ymOaCK1INcv/Kf9IndFuMpxkwCxbQ7xmencE uWtV6TRPtg094a3GH0i2G75c/uFew4xnI+y/qLepfHITmtEa1j8r99hew8/CrFPQB6rE ydBXkX+9fBE+YThC08Hu8ckM8rDoCSU2wvWm31KeSqHTdWTyTjkAsGh2zHCoEqJof4mP TK+YDELB0z0oaZJZu4lB7/pkUBMOW8dp5yF1oqxHp197y5301yZU3chbgNDscRGOFFOz BB6A== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:references:in-reply-to:from:date :message-id:subject:to:cc; bh=Q8tqhac32KQ7Qa6+sJq6Nf0MdoJcBnQMRPx6+FxTKbw=; b=Ow8Rn+gg8DJ/jRHwQVJs7Kp6k36cOg4f6FEfVqcV3Nk0O/HJ7OZzef6p8xhLEjlmxc seEqID0kQRn53h5T42vGxN1Jwp1gAVJ82FZOHoWDZObJZZkVFQ/d4gT9A7dlhLNr/Rqt Dk903ocJYvhkKg2Pg7ofwSZrTcY2W7aMQ2FMisT/qLvKdH117bMr3abMdrRK8qDrhhm2 ALzRd1YEpGfXjkxttp3cL/OooCtliFvUc37fYnERaANarhuigMh9d+ZWiLF4Dk0SqkOi VkCkZShAi0D/kvrwCNt0WxSd3RSzyqtOk3YPPvLuWo7W/JsNePZ3eCYpYcdGFOIqJh18 9FVw== X-Gm-Message-State: AOAM533CQoSo+EpK/Im752ADUB7FaOiHqF6PE27iXPIY5HqUFnZeSUDz ZROEXgMVeg5x+KdwoPVFMgFzCZKPrthRb5XMERnJCw== X-Google-Smtp-Source: ABdhPJzCFgE3CsdISNvIzyqJOVkvgydDJIT3btAJnxU8LFFCzIKGTUopldRqUSlGvSiaJllYjLCk2K8FLYPoQgAJ8HE= X-Received: by 2002:ac8:4b71:: with SMTP id g17mr315993qts.187.1592417531596; Wed, 17 Jun 2020 11:12:11 -0700 (PDT) MIME-Version: 1.0 References: <202006171740.05HHecjX086405@gndrsh.dnsmgr.net> <05B13267-8CE6-452F-A969-C37DE22E640A@bsdio.com> In-Reply-To: <05B13267-8CE6-452F-A969-C37DE22E640A@bsdio.com> From: Warner Losh Date: Wed, 17 Jun 2020 12:12:00 -0600 Message-ID: Subject: Re: CTF: UEFI HTTP boot support To: Rebecca Cran Cc: "Rodney W. Grimes" , Miguel C , FreeBSD Current X-Rspamd-Queue-Id: 49nCp46rLSz4Gx5 X-Spamd-Bar: - Authentication-Results: mx1.freebsd.org; dkim=pass header.d=bsdimp-com.20150623.gappssmtp.com header.s=20150623 header.b=waMfomtl; dmarc=none; spf=none (mx1.freebsd.org: domain of wlosh@bsdimp.com has no SPF policy when checking 2607:f8b0:4864:20::82c) smtp.mailfrom=wlosh@bsdimp.com X-Spamd-Result: default: False [-1.57 / 15.00]; RCVD_TLS_ALL(0.00)[]; ARC_NA(0.00)[]; R_DKIM_ALLOW(-0.20)[bsdimp-com.20150623.gappssmtp.com:s=20150623]; NEURAL_HAM_MEDIUM(-0.38)[-0.376]; FROM_HAS_DN(0.00)[]; RCPT_COUNT_THREE(0.00)[4]; NEURAL_HAM_LONG(-0.98)[-0.981]; MIME_GOOD(-0.10)[multipart/alternative,text/plain]; PREVIOUSLY_DELIVERED(0.00)[freebsd-current@freebsd.org]; DMARC_NA(0.00)[bsdimp.com]; TO_MATCH_ENVRCPT_SOME(0.00)[]; TO_DN_ALL(0.00)[]; DKIM_TRACE(0.00)[bsdimp-com.20150623.gappssmtp.com:+]; NEURAL_HAM_SHORT(-0.21)[-0.212]; RCVD_IN_DNSWL_NONE(0.00)[2607:f8b0:4864:20::82c:from]; R_SPF_NA(0.00)[no SPF record]; FORGED_SENDER(0.30)[imp@bsdimp.com,wlosh@bsdimp.com]; MIME_TRACE(0.00)[0:+,1:+,2:~]; RCVD_COUNT_TWO(0.00)[2]; ASN(0.00)[asn:15169, ipnet:2607:f8b0::/32, country:US]; FROM_NEQ_ENVFROM(0.00)[imp@bsdimp.com,wlosh@bsdimp.com]; FREEMAIL_CC(0.00)[gndrsh.dnsmgr.net,gmail.com,freebsd.org] Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Content-Filtered-By: Mailman/MimeDel 2.1.33 X-BeenThere: freebsd-current@freebsd.org X-Mailman-Version: 2.1.33 Precedence: list List-Id: Discussions about the use of FreeBSD-current List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 17 Jun 2020 18:12:13 -0000 On Wed, Jun 17, 2020 at 12:06 PM Rebecca Cran wrote: > > > On Jun 17, 2020, at 11:40 AM, Rodney W. Grimes < > freebsd-rwg@gndrsh.dnsmgr.net> wrote: > > > > Does FreeBSD kernel have a driver that can talk to the UEFI ramdisk? > > I=E2=80=99m fairly sure UEFI generates it as a standard CD drive. > I missed the start of this thread, so maybe I'm missing a key detail. However, I thought UEFI didn't have a RAM-disk, per se, but that we could load memory areas and pass that into the kernel using freebsd-only methods. But UEFI is a bit weird, so maybe it will generate a virtual cdrom... Warner From owner-freebsd-current@freebsd.org Wed Jun 17 18:19:16 2020 Return-Path: Delivered-To: freebsd-current@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id A2305357400 for ; Wed, 17 Jun 2020 18:19:16 +0000 (UTC) (envelope-from freebsd-rwg@gndrsh.dnsmgr.net) Received: from gndrsh.dnsmgr.net (br1.CN84in.dnsmgr.net [69.59.192.140]) (using TLSv1 with cipher DHE-RSA-AES256-SHA (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 49nCyC55gnz4HPt for ; Wed, 17 Jun 2020 18:19:15 +0000 (UTC) (envelope-from freebsd-rwg@gndrsh.dnsmgr.net) Received: from gndrsh.dnsmgr.net (localhost [127.0.0.1]) by gndrsh.dnsmgr.net (8.13.3/8.13.3) with ESMTP id 05HIJB88086576; Wed, 17 Jun 2020 11:19:11 -0700 (PDT) (envelope-from freebsd-rwg@gndrsh.dnsmgr.net) Received: (from freebsd-rwg@localhost) by gndrsh.dnsmgr.net (8.13.3/8.13.3/Submit) id 05HIJBR2086575; Wed, 17 Jun 2020 11:19:11 -0700 (PDT) (envelope-from freebsd-rwg) From: "Rodney W. Grimes" Message-Id: <202006171819.05HIJBR2086575@gndrsh.dnsmgr.net> Subject: Re: CTF: UEFI HTTP boot support In-Reply-To: To: Warner Losh Date: Wed, 17 Jun 2020 11:19:11 -0700 (PDT) CC: "Rodney W. Grimes" , "Simon J. Gerraty" , Miguel C , FreeBSD Current X-Mailer: ELM [version 2.4ME+ PL121h (25)] MIME-Version: 1.0 Content-Transfer-Encoding: 7bit Content-Type: text/plain; charset=US-ASCII X-Rspamd-Queue-Id: 49nCyC55gnz4HPt X-Spamd-Bar: + Authentication-Results: mx1.freebsd.org; dkim=none; dmarc=none; spf=none (mx1.freebsd.org: domain of freebsd-rwg@gndrsh.dnsmgr.net has no SPF policy when checking 69.59.192.140) smtp.mailfrom=freebsd-rwg@gndrsh.dnsmgr.net X-Spamd-Result: default: False [1.07 / 15.00]; RCVD_TLS_LAST(0.00)[]; ARC_NA(0.00)[]; FROM_HAS_DN(0.00)[]; NEURAL_HAM_LONG(-0.04)[-0.036]; MIME_GOOD(-0.10)[text/plain]; DMARC_NA(0.00)[dnsmgr.net]; AUTH_NA(1.00)[]; NEURAL_SPAM_MEDIUM(0.31)[0.314]; RCPT_COUNT_FIVE(0.00)[5]; TO_MATCH_ENVRCPT_SOME(0.00)[]; TO_DN_ALL(0.00)[]; NEURAL_HAM_SHORT(-0.11)[-0.110]; R_SPF_NA(0.00)[no SPF record]; FROM_EQ_ENVFROM(0.00)[]; R_DKIM_NA(0.00)[]; MIME_TRACE(0.00)[0:+]; ASN(0.00)[asn:13868, ipnet:69.59.192.0/19, country:US]; FREEMAIL_CC(0.00)[gndrsh.dnsmgr.net,juniper.net,gmail.com,freebsd.org]; MID_RHS_MATCH_FROM(0.00)[]; RCVD_COUNT_TWO(0.00)[2] X-BeenThere: freebsd-current@freebsd.org X-Mailman-Version: 2.1.33 Precedence: list List-Id: Discussions about the use of FreeBSD-current List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 17 Jun 2020 18:19:16 -0000 > On Wed, Jun 17, 2020 at 11:53 AM Rodney W. Grimes < > freebsd-rwg@gndrsh.dnsmgr.net> wrote: > > > > Rodney W. Grimes wrote: > > > > > The "fake cd drive" is in the kernel, loader just copies the iso into > > > > > memory like any other module, and by the time that's done you just > > > > > reboot into the newly installed system, which again uses > > > > > > > > > > vfs.root.mountfrom="cd9660:/dev/md0.uzip" > > > > ^^^ > > > > > > > > Argh, the cd9660 confused me, I think your doing a > > > > "root on mfs/md"? > > > > > > loader.conf says > > > > > > rootfs_load="yes" > > > rootfs_name="contents.izo" > > > rootfs_type="md_image" > > > vfs.root.mountfrom="cd9660:/dev/md0.uzip" > > > > > > contents.izo is uzip'd contents.iso which file(1) > > > describes as ISO 9660 CD-ROM filesystem data '' > > > > > > That's for normal boot, for the loader 'install' command > > > it expects an uncompressed iso for rootfs. > > > > Ok, now the puzzle is how much work to get from a stock FreeBSD .iso > > image to something that works with this. Obviously we need a non-stock > > /boot/loader.conf file, or to type some commands manually at a loader > > prompt. I believe the stock GENERIC kernel has the md_root support > > for this already, so it may not be that hard to do. > > > > Looking at the code, I think MD_ROOT alone is insufficient here... I was a bit worried about that, but hopefull. We do work out of the box with a NFS root as long as the NIC is found during boot. And given that I load the loader over NFS the loader can also find my /boot/ directory and the files in it, so that part is already solved. > If there's no MD root provided, we look for the symbols mfs_root and > mfs_root_end, which I think means that rootfs_ in the above example needs > to be md_root_ instead so that we find it. Isnt this all handled by the loader? I think we have 2 slightly different cases here. THe one sjg shows up, where you actually load the md_image from a seperate file, and the case your talking about where you actually embed the kernel and image into a single file. > > You may need to have a custom kernel with 'options MD_ROOT_READONLY' > because isofs is read-only. > > And there's a small chance you may need to define ROOTDEVNAME in the build > as well to be "cd9660:/dev/md0.uzip" I do not think that is necessesary but I'll keep it in mind, at present I do over ride the vfs.root.mountfrom to point to my version specific root file system using some ipxe variables. > > Every time I do stuff like this I have to re-puzzle it out, alas, but these > should give you some guide posts. It should be better documented in md(4), > but isn't at the moment. Thanks for exposing what may be some pointy sticks to stumble on. > > I'd honestly try to get this setup working first loading all the files off > a local disk before layering in the networking on top of that. Probalby a good idea, as the usually failure mode in the diskless word is black screens leaving little detail about what went wrong. > Warner -- Rod Grimes rgrimes@freebsd.org From owner-freebsd-current@freebsd.org Wed Jun 17 18:37:11 2020 Return-Path: Delivered-To: freebsd-current@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id D86D1357B13 for ; Wed, 17 Jun 2020 18:37:11 +0000 (UTC) (envelope-from wlosh@bsdimp.com) Received: from mail-qv1-xf2a.google.com (mail-qv1-xf2a.google.com [IPv6:2607:f8b0:4864:20::f2a]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "GTS CA 1O1" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 49nDLt3Rhyz4JcS for ; Wed, 17 Jun 2020 18:37:10 +0000 (UTC) (envelope-from wlosh@bsdimp.com) Received: by mail-qv1-xf2a.google.com with SMTP id p15so1524544qvr.9 for ; Wed, 17 Jun 2020 11:37:10 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=bsdimp-com.20150623.gappssmtp.com; s=20150623; h=mime-version:references:in-reply-to:from:date:message-id:subject:to :cc; bh=46zAJEsk8xulCQO1EERbCte8tzVA+T03/i6/1AvNRVA=; b=AkHkW4MyJROMusOr9kgHraUplIxG3kCQW109oz2RPjoLNcWcQ3ygmrG23DwTTKUGWH FUqByNA5602l3vGAX3RZORRzERlUQD+Eyw2q85OeC+0Fudr/dl4N8aPXqeMF/hkp0JC5 PjTWcGJK3D23v6IYMSk1mxXwxoS/XhH3syyMXNf3PuzAyncnDU/QgrxdckXX0UI48u8I NU4lYx1VcfSo14hP3aXZGkhhYzG6vOsH0n8TTflmiOlf3jyDnYuc0N51Fl22eyVFxZsf WJuP8y8UWCKoWyTJo3OWE0tB7iShrR8t2pkaZIxPmRaHrgsMmCeo4jkr3N2XAMo4uhau 4jpg== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:references:in-reply-to:from:date :message-id:subject:to:cc; bh=46zAJEsk8xulCQO1EERbCte8tzVA+T03/i6/1AvNRVA=; b=Q9dVsgwMVRRf5trvQq2ceMNdiNfK/AjDOVpgVPrO5lEtAQZluHF5f2P8pV8Y179c8/ kYl2ViVB21A5xt1eLznKSsGIZs5kIrkmcvesMnLQwYM8o6ucXD+WCrZmgslJgtk9c7FK 48GJyD7Y3xfsGNzCxq1fQ3UXJdsg9qJ/RRvLobpxK0a1borV+IuBbGjqNJ2YncaUNJ6Z qmvDC0laf/agXwfQO72pemhv8W76QyISOeoZMiM3MJmFLjrzaUJNz8lqnjJr3x4MvLpt rdmPChTLVbGGCB4HnwXZhy1rSWKTbunLEnMsQ8yJpVLxR/DsX7pXjSQPV5WcFJddHESi nMcw== X-Gm-Message-State: AOAM531MDVWhX9CXHEghPa1W+sB1aE1nm2Nyow7YxZ5Sol9UqlUr85BU qRPL40RQ2OsKzMCcWRSIlwcEXTrgyHR7Kb2JkshEPUmpFiU= X-Google-Smtp-Source: ABdhPJxFHTm73IvPAr6C48kxyvHnd9S3+Seg9ISFroSlyv3tLe+apVay7wD7LOqDaHWr8hcFzIgsBnsfD97vIWqT/os= X-Received: by 2002:a0c:910c:: with SMTP id q12mr36667qvq.22.1592419029539; Wed, 17 Jun 2020 11:37:09 -0700 (PDT) MIME-Version: 1.0 References: <202006171819.05HIJBR2086575@gndrsh.dnsmgr.net> In-Reply-To: <202006171819.05HIJBR2086575@gndrsh.dnsmgr.net> From: Warner Losh Date: Wed, 17 Jun 2020 12:36:58 -0600 Message-ID: Subject: Re: CTF: UEFI HTTP boot support To: "Rodney W. Grimes" Cc: "Simon J. Gerraty" , Miguel C , FreeBSD Current X-Rspamd-Queue-Id: 49nDLt3Rhyz4JcS X-Spamd-Bar: - Authentication-Results: mx1.freebsd.org; dkim=pass header.d=bsdimp-com.20150623.gappssmtp.com header.s=20150623 header.b=AkHkW4My; dmarc=none; spf=none (mx1.freebsd.org: domain of wlosh@bsdimp.com has no SPF policy when checking 2607:f8b0:4864:20::f2a) smtp.mailfrom=wlosh@bsdimp.com X-Spamd-Result: default: False [-1.57 / 15.00]; RCVD_TLS_ALL(0.00)[]; ARC_NA(0.00)[]; R_DKIM_ALLOW(-0.20)[bsdimp-com.20150623.gappssmtp.com:s=20150623]; NEURAL_HAM_MEDIUM(-0.38)[-0.377]; FROM_HAS_DN(0.00)[]; RCPT_COUNT_THREE(0.00)[4]; NEURAL_HAM_LONG(-0.98)[-0.981]; MIME_GOOD(-0.10)[multipart/alternative,text/plain]; PREVIOUSLY_DELIVERED(0.00)[freebsd-current@freebsd.org]; DMARC_NA(0.00)[bsdimp.com]; TO_MATCH_ENVRCPT_SOME(0.00)[]; TO_DN_ALL(0.00)[]; DKIM_TRACE(0.00)[bsdimp-com.20150623.gappssmtp.com:+]; NEURAL_HAM_SHORT(-0.21)[-0.212]; RCVD_IN_DNSWL_NONE(0.00)[2607:f8b0:4864:20::f2a:from]; R_SPF_NA(0.00)[no SPF record]; FORGED_SENDER(0.30)[imp@bsdimp.com,wlosh@bsdimp.com]; MIME_TRACE(0.00)[0:+,1:+,2:~]; RCVD_COUNT_TWO(0.00)[2]; ASN(0.00)[asn:15169, ipnet:2607:f8b0::/32, country:US]; FROM_NEQ_ENVFROM(0.00)[imp@bsdimp.com,wlosh@bsdimp.com]; FREEMAIL_CC(0.00)[juniper.net,gmail.com,freebsd.org] Content-Type: text/plain; charset="UTF-8" X-Content-Filtered-By: Mailman/MimeDel 2.1.33 X-BeenThere: freebsd-current@freebsd.org X-Mailman-Version: 2.1.33 Precedence: list List-Id: Discussions about the use of FreeBSD-current List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 17 Jun 2020 18:37:11 -0000 On Wed, Jun 17, 2020 at 12:19 PM Rodney W. Grimes < freebsd-rwg@gndrsh.dnsmgr.net> wrote: > > On Wed, Jun 17, 2020 at 11:53 AM Rodney W. Grimes < > > freebsd-rwg@gndrsh.dnsmgr.net> wrote: > > > > > > Rodney W. Grimes wrote: > > > > > > The "fake cd drive" is in the kernel, loader just copies the iso > into > > > > > > memory like any other module, and by the time that's done you > just > > > > > > reboot into the newly installed system, which again uses > > > > > > > > > > > > vfs.root.mountfrom="cd9660:/dev/md0.uzip" > > > > > ^^^ > > > > > > > > > > Argh, the cd9660 confused me, I think your doing a > > > > > "root on mfs/md"? > > > > > > > > loader.conf says > > > > > > > > rootfs_load="yes" > > > > rootfs_name="contents.izo" > > > > rootfs_type="md_image" > > > > vfs.root.mountfrom="cd9660:/dev/md0.uzip" > > > > > > > > contents.izo is uzip'd contents.iso which file(1) > > > > describes as ISO 9660 CD-ROM filesystem data '' > > > > > > > > That's for normal boot, for the loader 'install' command > > > > it expects an uncompressed iso for rootfs. > > > > > > Ok, now the puzzle is how much work to get from a stock FreeBSD .iso > > > image to something that works with this. Obviously we need a non-stock > > > /boot/loader.conf file, or to type some commands manually at a loader > > > prompt. I believe the stock GENERIC kernel has the md_root support > > > for this already, so it may not be that hard to do. > > > > > > > Looking at the code, I think MD_ROOT alone is insufficient here... > > I was a bit worried about that, but hopefull. We do work out of the > box with a NFS root as long as the NIC is found during boot. And > given that I load the loader over NFS the loader can also find my > /boot/ directory and the files in it, so that part is already solved. > Yes. If you NFS mount root, it works. But if you are loading a full image, the boot loader has to do all that and pass the right meta-data to the kernel for the kernel to know what to use for root. > > If there's no MD root provided, we look for the symbols mfs_root and > > mfs_root_end, which I think means that rootfs_ in the above example needs > > to be md_root_ instead so that we find it. > > Isnt this all handled by the loader? I think we have 2 slightly > different cases here. THe one sjg shows up, where you actually > load the md_image from a seperate file, and the case your talking > about where you actually embed the kernel and image into a single > file. > No. I'm talking about dynamically loading as well. The loader sets up the symbols that point to the image, though I didn't thread my way all the way through that. The loader sets it all up, and the kernel just uses the hints the loader gives and the md driver does at least part of the heavy lifting to make it happen. > > > You may need to have a custom kernel with 'options MD_ROOT_READONLY' > > because isofs is read-only. > > > > And there's a small chance you may need to define ROOTDEVNAME in the > build > > as well to be "cd9660:/dev/md0.uzip" > > I do not think that is necessesary but I'll keep it in mind, at present > I do over ride the vfs.root.mountfrom to point to my version specific > root file system using some ipxe variables. > Usually that's enough, though when you want to use a MD device as root, it's configured in weird ways that appear from the code to be driven by ifdefs. And the default defines are for an uncompressed UFS filesystem inside that MD image. Others are possible, but I believe require compile time options. > Every time I do stuff like this I have to re-puzzle it out, alas, but > these > > should give you some guide posts. It should be better documented in > md(4), > > but isn't at the moment. > > Thanks for exposing what may be some pointy sticks to stumble on. > Yea, There be a dragon or two here. The ZRouter folks appear to have do a reroot to the cdrom:9660:/dev/md0.uzip after dd'ing the installer image onto it.... but otherwise they don't reply on md stuff running direclty out of flash that's been uncompressed. I'd thought sure they'd worked this out for network booting, but if so it's not in the copy of the scripts I have. > I'd honestly try to get this setup working first loading all the files off > > a local disk before layering in the networking on top of that. > > Probalby a good idea, as the usually failure mode in the diskless > word is black screens leaving little detail about what went wrong. > Yea. Having both serial and video consoles connected wouldn't hurt :) Good Luck! Warner > > Warner > -- > Rod Grimes > rgrimes@freebsd.org > From owner-freebsd-current@freebsd.org Wed Jun 17 18:56:41 2020 Return-Path: Delivered-To: freebsd-current@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 03C4D330046 for ; Wed, 17 Jun 2020 18:56:41 +0000 (UTC) (envelope-from sjg@juniper.net) Received: from mx0a-00273201.pphosted.com (mx0a-00273201.pphosted.com [208.84.65.16]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client CN "*.pphosted.com", Issuer "Thawte RSA CA 2018" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 49nDnN0Rxlz4Ktn for ; Wed, 17 Jun 2020 18:56:39 +0000 (UTC) (envelope-from sjg@juniper.net) Received: from pps.filterd (m0108158.ppops.net [127.0.0.1]) by mx0a-00273201.pphosted.com (8.16.0.42/8.16.0.42) with SMTP id 05HIWH0G001762; Wed, 17 Jun 2020 11:56:37 -0700 Received: from nam12-bn8-obe.outbound.protection.outlook.com (mail-bn8nam12lp2174.outbound.protection.outlook.com [104.47.55.174]) by mx0a-00273201.pphosted.com with ESMTP id 31qknbrpvg-1 (version=TLSv1.2 cipher=ECDHE-RSA-AES256-GCM-SHA384 bits=256 verify=NOT); Wed, 17 Jun 2020 11:56:36 -0700 ARC-Seal: i=1; a=rsa-sha256; s=arcselector9901; d=microsoft.com; cv=none; b=Nc/BMR0j+Oir8ri+aS3SxqWVKIfir5MdXf/LtRA209O67hFrIvnlaUQlfK1ecKGz1Z7THgbMcRSE6x19lje4YEsEoE7a/T6doWCk9doHNIIMgJIkGWu08YVGIxt7lfLVcTNP36r0nISLJOGMLtwiBA32NMs6aiKzfc/H2oSmtiWZ0DJk1EURms2yrFFEHpRiDB6NcyY/Wr+DofDz/YEadYTNWUlPYEfhmqL8iQTPS39VGzEiSNpiH2O/3j+g3S+PeFeQTEPk+wW4G3siWhrMzqLGygCjtYlBU6pJI58O99SoTpJgvP9cvSSLDrZXaUW9ZJ+L8Jdn7Yc5cTAfgohSdQ== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=microsoft.com; s=arcselector9901; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=3RC2+yNcLHNW+c8fpU8pQXN5C0EJ1FLP4Se/ewdiJxQ=; b=Gnq0Rmz5WuRlERjM9/j1+s8YZxlHIRgnVcWmlAh3sA4i32s57wtS5V15IAnja0kf1R/4qJCjDHAX2dgHxwu5ctcho24EamGBzZt0cW1WDzeJDIuYVuMTAHeY5f9Bq6QFKc3t0VAHQ56txuwB4PEfo7xJk/PRPqQJmJMLaASJZsOJxF84sik+s0/nftoNzvpK3uUTOWMpo0RzRggOFMaaegQeLKsauyAXsGePduOs6/gXZV1BrNETvvZpL1pdlPrN17S3l30heZ7hlOA1Rgx6lXhq9OgauFMBlhKwV56qXGA/1fOdMSVuwjZZ76xMYvUR2/hHepJa0uQKJa/BYs93gg== ARC-Authentication-Results: i=1; mx.microsoft.com 1; spf=softfail (sender ip is 66.129.242.12) smtp.rcpttodomain=gndrsh.dnsmgr.net smtp.mailfrom=juniper.net; dmarc=fail (p=reject sp=reject pct=100) action=oreject header.from=juniper.net; dkim=none (message not signed); arc=none Received: from CO1PR15CA0089.namprd15.prod.outlook.com (2603:10b6:101:20::33) by BN3PR05MB2625.namprd05.prod.outlook.com (2a01:111:e400:7bbd::19) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.3109.11; Wed, 17 Jun 2020 18:56:33 +0000 Received: from CO1NAM05FT041.eop-nam05.prod.protection.outlook.com (2603:10b6:101:20:cafe::e8) by CO1PR15CA0089.outlook.office365.com (2603:10b6:101:20::33) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.3109.22 via Frontend Transport; Wed, 17 Jun 2020 18:56:33 +0000 X-MS-Exchange-Authentication-Results: spf=softfail (sender IP is 66.129.242.12) smtp.mailfrom=juniper.net; gndrsh.dnsmgr.net; dkim=none (message not signed) header.d=none;gndrsh.dnsmgr.net; dmarc=fail action=oreject header.from=juniper.net; Received-SPF: SoftFail (protection.outlook.com: domain of transitioning juniper.net discourages use of 66.129.242.12 as permitted sender) Received: from P-EXFEND-EQX-01.jnpr.net (66.129.242.12) by CO1NAM05FT041.mail.protection.outlook.com (10.152.96.154) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_CBC_SHA384) id 15.20.3109.9 via Frontend Transport; Wed, 17 Jun 2020 18:56:32 +0000 Received: from P-EXBEND-EQX-01.jnpr.net (10.104.8.52) by P-EXFEND-EQX-01.jnpr.net (10.104.8.54) with Microsoft SMTP Server (TLS) id 15.0.1497.2; Wed, 17 Jun 2020 11:56:23 -0700 Received: from P-EXBEND-EQX-01.jnpr.net (10.104.8.52) by P-EXBEND-EQX-01.jnpr.net (10.104.8.52) with Microsoft SMTP Server (TLS) id 15.0.1497.2; Wed, 17 Jun 2020 11:56:23 -0700 Received: from p-mailhub01.juniper.net (10.104.20.6) by P-EXBEND-EQX-01.jnpr.net (10.104.8.52) with Microsoft SMTP Server (TLS) id 15.0.1497.2 via Frontend Transport; Wed, 17 Jun 2020 11:56:23 -0700 Received: from kaos.jnpr.net (kaos.jnpr.net [172.23.50.162]) by p-mailhub01.juniper.net (8.14.4/8.11.3) with ESMTP id 05HIuMYl014590; Wed, 17 Jun 2020 11:56:22 -0700 (envelope-from sjg@juniper.net) Received: by kaos.jnpr.net (Postfix, from userid 1377) id 893F3AE9F; Wed, 17 Jun 2020 11:56:22 -0700 (PDT) Received: from kaos.jnpr.net (localhost [127.0.0.1]) by kaos.jnpr.net (Postfix) with ESMTP id 88C1CAE9E; Wed, 17 Jun 2020 11:56:22 -0700 (PDT) To: Warner Losh CC: "Rodney W. Grimes" , Miguel C , FreeBSD Current , Subject: Re: CTF: UEFI HTTP boot support In-Reply-To: References: <46934.1592351291@kaos.jnpr.net> <202006171752.05HHqo0E086454@gndrsh.dnsmgr.net> Comments: In-reply-to: Warner Losh message dated "Wed, 17 Jun 2020 12:06:27 -0600." From: "Simon J. Gerraty" X-Mailer: MH-E 8.6+git; nmh 1.7.1; GNU Emacs 26.3 MIME-Version: 1.0 Content-Type: text/plain; charset="us-ascii" Content-ID: <45017.1592420182.1@kaos.jnpr.net> Content-Transfer-Encoding: quoted-printable Date: Wed, 17 Jun 2020 11:56:22 -0700 Message-ID: <48054.1592420182@kaos.jnpr.net> X-EXCLAIMER-MD-CONFIG: e3cb0ff2-54e7-4646-8a04-0dae4ac7b136 X-EOPAttributedMessage: 0 X-MS-Office365-Filtering-HT: Tenant X-Forefront-Antispam-Report: CIP:66.129.242.12; CTRY:US; LANG:en; SCL:1; SRV:; IPV:CAL; SFV:NSPM; H:P-EXFEND-EQX-01.jnpr.net; PTR:InfoDomainNonexistent; CAT:NONE; SFTY:; SFS:(4636009)(346002)(376002)(39860400002)(136003)(396003)(46966005)(7696005)(6916009)(7126003)(336012)(478600001)(8936002)(2906002)(26005)(5660300002)(70206006)(83380400001)(6266002)(81166007)(47076004)(316002)(186003)(82740400003)(70586007)(4326008)(107886003)(9686003)(82310400002)(55016002)(356005)(54906003)(8676002)(86362001); DIR:OUT; SFP:1102; X-MS-PublicTrafficType: Email X-MS-Office365-Filtering-Correlation-Id: de61d37c-7431-4aa8-2e9c-08d812f026f3 X-MS-TrafficTypeDiagnostic: BN3PR05MB2625: X-Microsoft-Antispam-PRVS: X-MS-Oob-TLC-OOBClassifiers: OLM:3383; X-Forefront-PRVS: 04371797A5 X-MS-Exchange-SenderADCheck: 1 X-Microsoft-Antispam: BCL:0; X-Microsoft-Antispam-Message-Info: 3oMN9TsitX+06CJDacC8tcH7gyeOCy/KY5lYDFCS3kS68CuZgkPOluk8upR/j6HJXSie5l1eclzdGd6f0ibg7TOnaasPsUDC8c2EgKhiFmJ5yieQA1tJLGWgP8Ps7idmr06KqSm9s5B7fRqWLqexK5xMYBVAGeBprfa2CXnBVYutKUbT77VLS5xPtx4xEbHsLEZswvRar8XU7HwxiWA+hUIWXvoCVMEeplxL1Wm1jrvSyGam5eESX3Zqgnrilo6n0bfUJrkigG/5QmLDlIt/fMMv+zxbb34cswLxngKqljlfVHyYYV7na6WxMke+tCLAIr3QINszS0yeiAJz7QxC2o6SqKKSFUF/AcgJRwBoTi4Fh4jCDdlURvcXFwP5EHjE/s/in3F4AElVS3d8OQRkoQ== X-OriginatorOrg: juniper.net X-MS-Exchange-CrossTenant-OriginalArrivalTime: 17 Jun 2020 18:56:32.6708 (UTC) X-MS-Exchange-CrossTenant-Network-Message-Id: de61d37c-7431-4aa8-2e9c-08d812f026f3 X-MS-Exchange-CrossTenant-Id: bea78b3c-4cdb-4130-854a-1d193232e5f4 X-MS-Exchange-CrossTenant-OriginalAttributedTenantConnectingIp: TenantId=bea78b3c-4cdb-4130-854a-1d193232e5f4; Ip=[66.129.242.12]; Helo=[P-EXFEND-EQX-01.jnpr.net] X-MS-Exchange-CrossTenant-FromEntityHeader: HybridOnPrem X-MS-Exchange-Transport-CrossTenantHeadersStamped: BN3PR05MB2625 X-Proofpoint-Virus-Version: vendor=fsecure engine=2.50.10434:6.0.216, 18.0.687 definitions=2020-06-17_10:2020-06-17, 2020-06-17 signatures=0 X-Proofpoint-Spam-Details: rule=outbound_spam_notspam policy=outbound_spam score=0 suspectscore=0 spamscore=0 mlxscore=0 lowpriorityscore=0 clxscore=1011 adultscore=0 impostorscore=0 priorityscore=1501 bulkscore=0 phishscore=0 malwarescore=0 cotscore=-2147483648 mlxlogscore=999 classifier=spam adjust=0 reason=mlx scancount=1 engine=8.12.0-2004280000 definitions=main-2006170143 X-Rspamd-Queue-Id: 49nDnN0Rxlz4Ktn X-Spamd-Bar: ----- X-Spamd-Result: default: False [-5.67 / 15.00]; NEURAL_HAM_MEDIUM(-0.99)[-0.991]; R_DKIM_ALLOW(-0.20)[juniper.net:s=PPS1017,juniper.net:s=selector1]; FROM_HAS_DN(0.00)[]; TO_DN_SOME(0.00)[]; R_SPF_ALLOW(-0.20)[+ip4:208.84.65.16]; NEURAL_HAM_LONG(-1.00)[-0.997]; MIME_GOOD(-0.10)[text/plain]; ARC_ALLOW(-1.00)[microsoft.com:s=arcselector9901:i=1]; RCPT_COUNT_FIVE(0.00)[5]; TO_MATCH_ENVRCPT_SOME(0.00)[]; DKIM_TRACE(0.00)[juniper.net:+]; DMARC_POLICY_ALLOW(-0.50)[juniper.net,reject]; NEURAL_HAM_SHORT(-1.58)[-1.580]; RCVD_IN_DNSWL_LOW(-0.10)[208.84.65.16:from]; FROM_EQ_ENVFROM(0.00)[]; MIME_TRACE(0.00)[0:+]; ASN(0.00)[asn:26211, ipnet:208.84.65.0/24, country:US]; RCVD_TLS_LAST(0.00)[]; RCVD_COUNT_SEVEN(0.00)[11]; FREEMAIL_CC(0.00)[gndrsh.dnsmgr.net,gmail.com,freebsd.org,juniper.net] X-BeenThere: freebsd-current@freebsd.org X-Mailman-Version: 2.1.33 Precedence: list List-Id: Discussions about the use of FreeBSD-current List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 17 Jun 2020 18:56:41 -0000 Warner Losh wrote: > > loader.conf says > > > > rootfs_load=3D"yes" > > rootfs_name=3D"contents.izo" > > rootfs_type=3D"md_image" > > vfs.root.mountfrom=3D"cd9660:/dev/md0.uzip" > > > > contents.izo is uzip'd contents.iso which file(1) > > describes as ISO 9660 CD-ROM filesystem data '' > > > > That's for normal boot, for the loader 'install' command > > it expects an uncompressed iso for rootfs. > = > Ok, now the puzzle is how much work to get from a stock FreeBSD .iso > image to something that works with this. Obviously we need a non-stock > /boot/loader.conf file, or to type some commands manually at a loader > prompt. I believe the stock GENERIC kernel has the md_root support > for this already, so it may not be that hard to do. So obviously we don't use the GENERIC kernel, but I don't think we have any magic except in 4th files and loader.conf and for the loader install command its all in the loader itself, and I've been keeping head up todate on recent fixes/improvements there since for UEFI I'm using loader.efi built from head. Oh and all the scripts run by init during boot are custom. > Looking at the code, I think MD_ROOT alone is insufficient here... > = > If there's no MD root provided, we look for the symbols mfs_root and > mfs_root_end, which I think means that rootfs_ in the above example > needs to be md_root_ instead so that we find it. FWIW our kernel options include options CD9660 options MD_ROOT options MD_ROOT_FSTYPE=3D\"cd9660\" > You may need to have a custom kernel with 'options MD_ROOT_READONLY' bec= ause isofs is read-only. > = > And there's a small chance you may need to define ROOTDEVNAME in the bui= ld as well to be "cd9660:/dev/md0.uzip" > Every time I do stuff like this I have to re-puzzle it out, alas, but > these should give you some guide posts. It should be better documented > in md(4), but isn't at the moment. = > = > I'd honestly try to get this setup working first loading all the files > off a local disk before layering in the networking on top of that. Agreed! Booting from say tftp://host/install.tar is far more fragile - the tar file needs to present all the files in correct order since we cannot seek backwards (much), and tftp sucks ;-) userboot is very handy for testing all this stuff, though building it to run on host (the way we do) seems broken in head. --sjg From owner-freebsd-current@freebsd.org Wed Jun 17 19:07:06 2020 Return-Path: Delivered-To: freebsd-current@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id CBF71330D8E for ; Wed, 17 Jun 2020 19:07:06 +0000 (UTC) (envelope-from wlosh@bsdimp.com) Received: from mail-qk1-x732.google.com (mail-qk1-x732.google.com [IPv6:2607:f8b0:4864:20::732]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "GTS CA 1O1" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 49nF1Q2V4dz4LKG for ; Wed, 17 Jun 2020 19:07:05 +0000 (UTC) (envelope-from wlosh@bsdimp.com) Received: by mail-qk1-x732.google.com with SMTP id 205so3155835qkg.3 for ; Wed, 17 Jun 2020 12:07:05 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=bsdimp-com.20150623.gappssmtp.com; s=20150623; h=mime-version:references:in-reply-to:from:date:message-id:subject:to :cc; bh=fzAcB6tKVSbeDmGtm/r2aOvAlCsa/QMVCC+zn9WxqnM=; b=Mwo5nLMTp2aoH39iP6RULf86WqdzqizzoL0QmX37BGGuQGarJGI1FF1KfJhhiezCkR GCaPEpQ7eyqFdgwK+zyx9woXv9554Cha7fcDpIlbcB75ZarLTLm7VT9E93buSChHc7i+ mlbScow7e7CpxQzv6bSZ8lMptjT3S0oCBKwB0TIvfKbdPy5YosWVFpLJ2AZ64ne054kA MAYPKB71XMPbbS0aJwg+sGwcfkaHy0oOr1V9/yKH5Mt8y3AntiHqtD13zGIIZBEDPKMz o0ZvEqbpOgB0tu4qitghDHM4ZXqiIZPzxYgAe6q85ISLxN5xXiQRHgw8hr1basRoJokY 5tvQ== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:references:in-reply-to:from:date :message-id:subject:to:cc; bh=fzAcB6tKVSbeDmGtm/r2aOvAlCsa/QMVCC+zn9WxqnM=; b=L7zuMf1d1Bu0dY2DBJCjVDVIBEAPjvVuHtOrEwJ1ax+QwCEZ9j553xZz83tksgVkZS PvRxPX+0Chsu0ggRVdtGesms2Zj/uJsGCmjDUf1PdzQET2iuDbOBgGv1f8LyalIWLxRL wXIPmNUOBpVISIBOd40wucasnjX4aU2ZvvnpsEnUzFJN7hjlOpvmpVdNsIBVPGwQhldi XqOUW2tU+TJhcU8qQP0JmiyBfr++ijEgeJMiMYIBEuuGs02gkFXEkwlDHsYIXOUbEK1w 8dFbMFWLUAW4Kds3yfqIH09DqC8qU8lo1STq89t1S0Fn1TTLTRfsn738oocfc3igfcvb ufpw== X-Gm-Message-State: AOAM532+u3i9yt/BIVahoRHXN1g2MxNAEDQewKVpqvJfQSOvAou74xLp bNQOamOj2ijTvLut2FF41lXxeYSb2+tfW0en71ABrg== X-Google-Smtp-Source: ABdhPJx9mUWjx/B0uQ9gkvrHMMmuEjkn20jwHECVNfJjQohLn0FjzOM1BbmwAWqldFdiOS47XCGwsg5J3Pma5SAT+ok= X-Received: by 2002:a37:392:: with SMTP id 140mr75213qkd.495.1592420825115; Wed, 17 Jun 2020 12:07:05 -0700 (PDT) MIME-Version: 1.0 References: <46934.1592351291@kaos.jnpr.net> <202006171752.05HHqo0E086454@gndrsh.dnsmgr.net> <48054.1592420182@kaos.jnpr.net> In-Reply-To: <48054.1592420182@kaos.jnpr.net> From: Warner Losh Date: Wed, 17 Jun 2020 13:06:52 -0600 Message-ID: Subject: Re: CTF: UEFI HTTP boot support To: "Simon J. Gerraty" Cc: "Rodney W. Grimes" , Miguel C , FreeBSD Current X-Rspamd-Queue-Id: 49nF1Q2V4dz4LKG X-Spamd-Bar: - Authentication-Results: mx1.freebsd.org; dkim=pass header.d=bsdimp-com.20150623.gappssmtp.com header.s=20150623 header.b=Mwo5nLMT; dmarc=none; spf=none (mx1.freebsd.org: domain of wlosh@bsdimp.com has no SPF policy when checking 2607:f8b0:4864:20::732) smtp.mailfrom=wlosh@bsdimp.com X-Spamd-Result: default: False [-1.57 / 15.00]; ARC_NA(0.00)[]; NEURAL_HAM_MEDIUM(-0.38)[-0.378]; RCVD_COUNT_TWO(0.00)[2]; R_DKIM_ALLOW(-0.20)[bsdimp-com.20150623.gappssmtp.com:s=20150623]; FROM_HAS_DN(0.00)[]; RCPT_COUNT_THREE(0.00)[4]; NEURAL_HAM_LONG(-0.98)[-0.981]; MIME_GOOD(-0.10)[multipart/alternative,text/plain]; PREVIOUSLY_DELIVERED(0.00)[freebsd-current@freebsd.org]; DMARC_NA(0.00)[bsdimp.com]; TO_MATCH_ENVRCPT_SOME(0.00)[]; TO_DN_ALL(0.00)[]; DKIM_TRACE(0.00)[bsdimp-com.20150623.gappssmtp.com:+]; NEURAL_HAM_SHORT(-0.21)[-0.212]; RCVD_IN_DNSWL_NONE(0.00)[2607:f8b0:4864:20::732:from]; R_SPF_NA(0.00)[no SPF record]; FORGED_SENDER(0.30)[imp@bsdimp.com,wlosh@bsdimp.com]; MIME_TRACE(0.00)[0:+,1:+,2:~]; ASN(0.00)[asn:15169, ipnet:2607:f8b0::/32, country:US]; FROM_NEQ_ENVFROM(0.00)[imp@bsdimp.com,wlosh@bsdimp.com]; RCVD_TLS_ALL(0.00)[]; FREEMAIL_CC(0.00)[gndrsh.dnsmgr.net,gmail.com,freebsd.org] Content-Type: text/plain; charset="UTF-8" X-Content-Filtered-By: Mailman/MimeDel 2.1.33 X-BeenThere: freebsd-current@freebsd.org X-Mailman-Version: 2.1.33 Precedence: list List-Id: Discussions about the use of FreeBSD-current List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 17 Jun 2020 19:07:06 -0000 On Wed, Jun 17, 2020 at 12:56 PM Simon J. Gerraty wrote: > Warner Losh wrote: > > > loader.conf says > > > > > > rootfs_load="yes" > > > rootfs_name="contents.izo" > > > rootfs_type="md_image" > > > vfs.root.mountfrom="cd9660:/dev/md0.uzip" > > > > > > contents.izo is uzip'd contents.iso which file(1) > > > describes as ISO 9660 CD-ROM filesystem data '' > > > > > > That's for normal boot, for the loader 'install' command > > > it expects an uncompressed iso for rootfs. > > > > Ok, now the puzzle is how much work to get from a stock FreeBSD .iso > > image to something that works with this. Obviously we need a non-stock > > /boot/loader.conf file, or to type some commands manually at a loader > > prompt. I believe the stock GENERIC kernel has the md_root support > > for this already, so it may not be that hard to do. > > So obviously we don't use the GENERIC kernel, but > I don't think we have any magic except in 4th files and loader.conf > and for the loader install command its all in the loader itself, > and I've been keeping head up todate on recent fixes/improvements there > since for UEFI I'm using loader.efi built from head. > Yea the loader will load the image, but the md driver looks for images of type md_image or md_root and will create md devices for those devices it finds. > Oh and all the scripts run by init during boot are custom. > > > Looking at the code, I think MD_ROOT alone is insufficient here... > > > > If there's no MD root provided, we look for the symbols mfs_root and > > mfs_root_end, which I think means that rootfs_ in the above example > > needs to be md_root_ instead so that we find it. > > FWIW our kernel options include > > options CD9660 > options MD_ROOT > options MD_ROOT_FSTYPE=\"cd9660\" > Yea, this lets you mout cd9660 images as root... It also drives setting rootdevnames[0] which is used to create the default mountroot script on loading the first md image. > > You may need to have a custom kernel with 'options MD_ROOT_READONLY' > because isofs is read-only. > > > > And there's a small chance you may need to define ROOTDEVNAME in the > build as well to be "cd9660:/dev/md0.uzip" > > > Every time I do stuff like this I have to re-puzzle it out, alas, but > > these should give you some guide posts. It should be better documented > > in md(4), but isn't at the moment. > > > > I'd honestly try to get this setup working first loading all the files > > off a local disk before layering in the networking on top of that. > > Agreed! Booting from say tftp://host/install.tar > is far more fragile - the tar file needs to present all the files in > correct order since we cannot seek backwards (much), and tftp sucks ;-) > > userboot is very handy for testing all this stuff, though building it to > run on host (the way we do) seems broken in head. > Yea, of course. that makes sense. I'd forgotten userboot helps a lot. The default build of it should be working, though... Warner > --sjg > From owner-freebsd-current@freebsd.org Wed Jun 17 19:50:55 2020 Return-Path: Delivered-To: freebsd-current@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 5D9953332B7 for ; Wed, 17 Jun 2020 19:50:55 +0000 (UTC) (envelope-from rebecca@bsdio.com) Received: from out03.mta.xmission.com (out03.mta.xmission.com [166.70.13.233]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 49nFzy3mbKz4P4j for ; Wed, 17 Jun 2020 19:50:51 +0000 (UTC) (envelope-from rebecca@bsdio.com) DKIM-Signature: v=1; a=rsa-sha256; q=dns/txt; c=simple/simple; d=bsdio.com; s=xmission; h=Subject:To:In-Reply-To:Cc:References:Message-Id:Date: Mime-Version:From:Content-Transfer-Encoding:Content-Type:Sender:Reply-To: Content-ID:Content-Description:Resent-Date:Resent-From:Resent-Sender: Resent-To:Resent-Cc:Resent-Message-ID:List-Id:List-Help:List-Unsubscribe: List-Subscribe:List-Post:List-Owner:List-Archive; bh=XYGaXlm12+4ii9c5RLzzgD7Rj4d0B5CElRtXy0BlLfg=; b=HB9odDl3Xs/xe664PKt6MisDfB 5JZ4nQ8WfSvin5EOreU7ooOSd4jsBeG9dRu5ivp4nIexQoiXf1XlQY+w653pAbxokx7YpoUKzds7e 3IFsDauvxHZ/kEQllKOYkgtoZwhlXzN+LvD3mSnhfqPqfWTpF9/dh9baPdLolZcZxfAo=; Received: from in01.mta.xmission.com ([166.70.13.51]) by out03.mta.xmission.com with esmtps (TLS1.2:ECDHE_RSA_AES_128_GCM_SHA256:128) (Exim 4.90_1) (envelope-from ) id 1jle55-0002Yn-12; Wed, 17 Jun 2020 13:50:43 -0600 Received: from mta5.zcs.xmission.com ([166.70.13.69]) by in01.mta.xmission.com with esmtps (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.87) (envelope-from ) id 1jle53-0008LR-Lu; Wed, 17 Jun 2020 13:50:42 -0600 Received: from localhost (localhost [127.0.0.1]) by mta5.zcs.xmission.com (Postfix) with ESMTP id 05F2A12802BB; Wed, 17 Jun 2020 13:50:41 -0600 (MDT) X-Amavis-Modified: Mail body modified (using disclaimer) - mta5.zcs.xmission.com Received: from mta5.zcs.xmission.com ([127.0.0.1]) by localhost (mta5.zcs.xmission.com [127.0.0.1]) (amavisd-new, port 10026) with ESMTP id G-M1Tw0ADLxe; Wed, 17 Jun 2020 13:50:40 -0600 (MDT) Received: from [IPv6:2607:fb90:f710:67:bd62:4da9:8a75:1be0] (unknown [172.58.79.206]) by mta5.zcs.xmission.com (Postfix) with ESMTPSA id 951C2128040E; Wed, 17 Jun 2020 13:50:40 -0600 (MDT) From: Rebecca Cran Mime-Version: 1.0 (1.0) Date: Wed, 17 Jun 2020 13:50:04 -0600 Message-Id: <890A1C97-31A1-46F9-BE9B-340F6039DD45@bsdio.com> References: Cc: "Rodney W. Grimes" , Miguel C , FreeBSD Current In-Reply-To: To: Warner Losh X-Mailer: iPhone Mail (17F80) X-XM-SPF: eid=1jle53-0008LR-Lu; ; ; mid=<890A1C97-31A1-46F9-BE9B-340F6039DD45@bsdio.com>; ; ; hst=in01.mta.xmission.com; ; ; ip=166.70.13.69; ; ; frm=rebecca@bsdio.com; ; ; spf=pass X-SA-Exim-Connect-IP: 166.70.13.69 X-SA-Exim-Mail-From: rebecca@bsdio.com X-Spam-Checker-Version: SpamAssassin 3.4.2 (2018-09-13) on sa08.xmission.com X-Spam-Level: X-Spam-Status: No, score=-0.2 required=8.0 tests=ALL_TRUSTED,BAYES_50, DCC_CHECK_NEGATIVE,HTML_MESSAGE,MIME_QP_LONG_LINE, T_TM2_M_HEADER_IN_MSG,XM_B_Unicode autolearn=disabled version=3.4.2 X-Spam-Report: * -1.0 ALL_TRUSTED Passed through trusted hosts only via SMTP * 0.8 BAYES_50 BODY: Bayes spam probability is 40 to 60% * [score: 0.4998] * 0.0 XM_B_Unicode BODY: Testing for specific types of unicode * 0.0 T_TM2_M_HEADER_IN_MSG BODY: No description available. * 0.0 HTML_MESSAGE BODY: HTML included in message * 0.0 MIME_QP_LONG_LINE RAW: Quoted-printable line longer than 76 * chars * -0.0 DCC_CHECK_NEGATIVE Not listed in DCC * [sa08 0; Body=1 Fuz1=1 Fuz2=1] X-Spam-DCC: ; sa08 0; Body=1 Fuz1=1 Fuz2=1 X-Spam-Combo: ;Warner Losh X-Spam-Relay-Country: X-Spam-Timing: total 986 ms - load_scoreonly_sql: 0.05 (0.0%), signal_user_changed: 15 (1.5%), b_tie_ro: 13 (1.3%), parse: 1.18 (0.1%), extract_message_metadata: 20 (2.0%), get_uri_detail_list: 1.45 (0.1%), tests_pri_-1000: 4.5 (0.5%), tests_pri_-950: 1.39 (0.1%), tests_pri_-900: 1.15 (0.1%), tests_pri_-90: 82 (8.3%), check_bayes: 80 (8.1%), b_tokenize: 6 (0.6%), b_tok_get_all: 7 (0.7%), b_comp_prob: 1.92 (0.2%), b_tok_touch_all: 61 (6.2%), b_finish: 1.33 (0.1%), tests_pri_0: 847 (85.8%), check_dkim_signature: 0.85 (0.1%), check_dkim_adsp: 627 (63.6%), poll_dns_idle: 610 (61.8%), tests_pri_10: 3.7 (0.4%), tests_pri_500: 9 (0.9%), rewrite_mail: 0.00 (0.0%) Subject: Re: CTF: UEFI HTTP boot support X-Spam-Flag: No X-SA-Exim-Version: 4.2.1 (built Thu, 05 May 2016 13:38:54 -0600) X-SA-Exim-Scanned: Yes (on in01.mta.xmission.com) X-Rspamd-Queue-Id: 49nFzy3mbKz4P4j X-Spamd-Bar: --- Authentication-Results: mx1.freebsd.org; dkim=pass header.d=bsdio.com header.s=xmission header.b=HB9odDl3; dmarc=none; spf=pass (mx1.freebsd.org: domain of rebecca@bsdio.com designates 166.70.13.233 as permitted sender) smtp.mailfrom=rebecca@bsdio.com X-Spamd-Result: default: False [-3.23 / 15.00]; RCVD_VIA_SMTP_AUTH(0.00)[]; ARC_NA(0.00)[]; RCVD_COUNT_FIVE(0.00)[6]; R_DKIM_ALLOW(-0.20)[bsdio.com:s=xmission]; FROM_HAS_DN(0.00)[]; RCPT_COUNT_THREE(0.00)[4]; MV_CASE(0.50)[]; R_SPF_ALLOW(-0.20)[+ip4:166.70.13.0/24]; MIME_GOOD(-0.10)[multipart/alternative,text/plain]; DMARC_NA(0.00)[bsdio.com]; NEURAL_HAM_LONG(-0.96)[-0.961]; RECEIVED_SPAMHAUS_PBL(0.00)[172.58.79.206:received]; TO_MATCH_ENVRCPT_SOME(0.00)[]; TO_DN_ALL(0.00)[]; DKIM_TRACE(0.00)[bsdio.com:+]; NEURAL_HAM_SHORT(-1.15)[-1.150]; NEURAL_HAM_MEDIUM(-1.02)[-1.018]; FROM_EQ_ENVFROM(0.00)[]; MIME_TRACE(0.00)[0:+,1:+,2:~]; RCVD_TLS_LAST(0.00)[]; ASN(0.00)[asn:6315, ipnet:166.70.0.0/16, country:US]; FREEMAIL_CC(0.00)[gndrsh.dnsmgr.net,gmail.com,freebsd.org]; MID_RHS_MATCH_FROM(0.00)[]; RCVD_IN_DNSWL_LOW(-0.10)[166.70.13.233:from] Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: quoted-printable X-Content-Filtered-By: Mailman/MimeDel 2.1.33 X-BeenThere: freebsd-current@freebsd.org X-Mailman-Version: 2.1.33 Precedence: list List-Id: Discussions about the use of FreeBSD-current List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 17 Jun 2020 19:50:55 -0000 > On Jun 17, 2020, at 12:12 PM, Warner Losh wrote: >=20 > I missed the start of this thread, so maybe I'm missing a key detail. Howe= ver, I thought UEFI didn't have a RAM-disk, per se, but that we could load m= emory areas and pass that into the kernel using freebsd-only methods. But UE= FI is a bit weird, so maybe it will generate a virtual cdrom... See https://uefi.org/sites/default/files/resources/FINAL%20Pres4%20UEFI%20HT= TP%20Boot.pdf =E2=80=9C RAM Disk Standard =E2=80=A2 UEFI 2.5 defined RAM Disk device path nodes - Standard access to a RAM Disk in UEFI - Supports Virtual Disk and Virtual CD (ISO image) in persistent or volatile memory=E2=80=9D =E2=80=94=20 Rebecca Cran= From owner-freebsd-current@freebsd.org Wed Jun 17 20:11:50 2020 Return-Path: Delivered-To: freebsd-current@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 4C29D33411F for ; Wed, 17 Jun 2020 20:11:50 +0000 (UTC) (envelope-from freebsd-rwg@gndrsh.dnsmgr.net) Received: from gndrsh.dnsmgr.net (br1.CN84in.dnsmgr.net [69.59.192.140]) (using TLSv1 with cipher DHE-RSA-AES256-SHA (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 49nGS46b2Nz4QtH for ; Wed, 17 Jun 2020 20:11:48 +0000 (UTC) (envelope-from freebsd-rwg@gndrsh.dnsmgr.net) Received: from gndrsh.dnsmgr.net (localhost [127.0.0.1]) by gndrsh.dnsmgr.net (8.13.3/8.13.3) with ESMTP id 05HKBSYZ087133; Wed, 17 Jun 2020 13:11:28 -0700 (PDT) (envelope-from freebsd-rwg@gndrsh.dnsmgr.net) Received: (from freebsd-rwg@localhost) by gndrsh.dnsmgr.net (8.13.3/8.13.3/Submit) id 05HKBS4q087132; Wed, 17 Jun 2020 13:11:28 -0700 (PDT) (envelope-from freebsd-rwg) From: "Rodney W. Grimes" Message-Id: <202006172011.05HKBS4q087132@gndrsh.dnsmgr.net> Subject: Re: CTF: UEFI HTTP boot support In-Reply-To: <890A1C97-31A1-46F9-BE9B-340F6039DD45@bsdio.com> To: Rebecca Cran Date: Wed, 17 Jun 2020 13:11:28 -0700 (PDT) CC: Warner Losh , "Rodney W. Grimes" , Miguel C , FreeBSD Current X-Mailer: ELM [version 2.4ME+ PL121h (25)] MIME-Version: 1.0 Content-Transfer-Encoding: 7bit Content-Type: text/plain; charset=US-ASCII X-Rspamd-Queue-Id: 49nGS46b2Nz4QtH X-Spamd-Bar: + Authentication-Results: mx1.freebsd.org; dkim=none; dmarc=none; spf=none (mx1.freebsd.org: domain of freebsd-rwg@gndrsh.dnsmgr.net has no SPF policy when checking 69.59.192.140) smtp.mailfrom=freebsd-rwg@gndrsh.dnsmgr.net X-Spamd-Result: default: False [1.44 / 15.00]; MIME_TRACE(0.00)[0:+]; ARC_NA(0.00)[]; FROM_HAS_DN(0.00)[]; NEURAL_SPAM_SHORT(0.26)[0.265]; NEURAL_HAM_LONG(-0.02)[-0.020]; MIME_GOOD(-0.10)[text/plain]; DMARC_NA(0.00)[dnsmgr.net]; AUTH_NA(1.00)[]; NEURAL_SPAM_MEDIUM(0.29)[0.294]; RCPT_COUNT_FIVE(0.00)[5]; TO_MATCH_ENVRCPT_SOME(0.00)[]; TO_DN_ALL(0.00)[]; R_SPF_NA(0.00)[no SPF record]; FROM_EQ_ENVFROM(0.00)[]; RCVD_TLS_LAST(0.00)[]; R_DKIM_NA(0.00)[]; ASN(0.00)[asn:13868, ipnet:69.59.192.0/19, country:US]; RCVD_COUNT_TWO(0.00)[2]; MID_RHS_MATCH_FROM(0.00)[]; FREEMAIL_CC(0.00)[bsdimp.com,gndrsh.dnsmgr.net,gmail.com,freebsd.org] X-BeenThere: freebsd-current@freebsd.org X-Mailman-Version: 2.1.33 Precedence: list List-Id: Discussions about the use of FreeBSD-current List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 17 Jun 2020 20:11:50 -0000 > > > On Jun 17, 2020, at 12:12 PM, Warner Losh wrote: > > > > I missed the start of this thread, so maybe I'm missing a key detail. However, I thought UEFI didn't have a RAM-disk, per se, but that we could load memory areas and pass that into the kernel using freebsd-only methods. But UEFI is a bit weird, so maybe it will generate a virtual cdrom... > > See https://uefi.org/sites/default/files/resources/FINAL%20Pres4%20UEFI%20HTTP%20Boot.pdf > > ? RAM Disk Standard > > ? UEFI 2.5 defined RAM Disk device path nodes > - Standard access to a RAM Disk in UEFI > - Supports Virtual Disk and Virtual CD (ISO image) in persistent or > volatile memory? Does freeBSD have any way to access these "Virtual Disk" or Virtual CD images once we leave the world of the loader? I believe we do not, as these are BIOS/UEFI devices that require calls into the UEFI code, which, IIRC is gone once we exit the loader and start the kernel proper, or shortly there after. As far as I know these devices well not be found by the FreeBSD cam layer ATA or AHCI drivers as they do not present an actual PCI device to find. > Rebecca Cran -- Rod Grimes rgrimes@freebsd.org From owner-freebsd-current@freebsd.org Wed Jun 17 20:28:43 2020 Return-Path: Delivered-To: freebsd-current@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 4E2D433454B for ; Wed, 17 Jun 2020 20:28:43 +0000 (UTC) (envelope-from dch@skunkwerks.at) Received: from out4-smtp.messagingengine.com (out4-smtp.messagingengine.com [66.111.4.28]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 49nGqZ2vTnz4SBj for ; Wed, 17 Jun 2020 20:28:42 +0000 (UTC) (envelope-from dch@skunkwerks.at) Received: from compute4.internal (compute4.nyi.internal [10.202.2.44]) by mailout.nyi.internal (Postfix) with ESMTP id B77765C0117; Wed, 17 Jun 2020 16:28:41 -0400 (EDT) Received: from imap6 ([10.202.2.56]) by compute4.internal (MEProxy); Wed, 17 Jun 2020 16:28:41 -0400 DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=skunkwerks.at; h=mime-version:message-id:in-reply-to:references:date:from:to :cc:subject:content-type; s=fm2; bh=5DAdnkBFXmG46eQ6owP4RQlDL7qA VQrGX1D9cS62Yus=; b=H5F4BDUlYPpdEGmisDU+BGCuytofr3ygIvYM79fKQyh4 JgC9mGORoq7Pj9SkPSmYJCi1rqPvDVe4yZ+lnBPrRLKsIvyz/VRfYW4G09ItbfSQ 2RWMB+BLY9YaV+zTWN/peGXeteOZi5ajVd+49u6WOjON+9lBAYgFO47UElaq+UkG UHxSMsmaYrIgRF7/QzDxhMXYIjY3PfBmlS8VuTu1zgyZYlJjMXeIpiVI7IEdtRRE /cBguAQyXOHFCAachuy32cftQRUpCqXVaod9Er6JblqLxV1p/Qzk8xYSQIDdD7pv ThtNIlfdQr8JNMT+TLIqir7rLOEvNOQ9O4wBuEDk+A== DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d= messagingengine.com; h=cc:content-type:date:from:in-reply-to :message-id:mime-version:references:subject:to:x-me-proxy :x-me-proxy:x-me-sender:x-me-sender:x-sasl-enc; s=fm3; bh=5DAdnk BFXmG46eQ6owP4RQlDL7qAVQrGX1D9cS62Yus=; b=UEwhZsI83mNKY5AlJ/zCdT WSO40whW09VjG9AxtKUMeq0odAGEpSXrGp2BHohDGmLv6UaefVyTom6tCW13P1ft G8C0PpOZNH+dM+b4WZgzjSw8smG7TRku15y64ddn9HW3aKyd0BzqtZeMvwjEJ15J TzhqTu/4PiKddR3JCUhOXOxkxnk4DvPgl/TJDlnxtMu7qEpv/E+bWBh9aO+Astuj UOvWteyT1XMpN7X4aP62m82pFZ314fD45kLrkaE5J80R6YmuiYcFOvfAfBdYPHCr nWajbGXPkeXCwMz5zKTeNdKruhVw0ZCsZHiIa3G2eXTiQndgBTHRtTb6SCUteQdQ == X-ME-Sender: X-ME-Proxy-Cause: gggruggvucftvghtrhhoucdtuddrgeduhedrudejvddgudeglecutefuodetggdotefrod ftvfcurfhrohhfihhlvgemucfhrghsthforghilhdpqfgfvfdpuffrtefokffrpgfnqfgh necuuegrihhlohhuthemuceftddtnecusecvtfgvtghiphhivghnthhsucdlqddutddtmd enucfjughrpefofgggkfgjfhffhffvufgtsehttdertderredtnecuhfhrohhmpedfffgr vhgvucevohhtthhlvghhuhgsvghrfdcuoegutghhsehskhhunhhkfigvrhhkshdrrghtqe enucggtffrrghtthgvrhhnpeetffevgfeffeeulefhfeejleegieeifefghfetvddugeff jeffudehhffgteeugfenucffohhmrghinhephhgrtghkmhgurdhiohdpvhigrdhskhdptg hotghhrghrugdrmhgvpdhgihhthhhusgdrtghomhenucevlhhushhtvghrufhiiigvpedt necurfgrrhgrmhepmhgrihhlfhhrohhmpegutghhsehskhhunhhkfigvrhhkshdrrght X-ME-Proxy: Received: by mailuser.nyi.internal (Postfix, from userid 501) id 57B6F1400A6; Wed, 17 Jun 2020 16:28:41 -0400 (EDT) X-Mailer: MessagingEngine.com Webmail Interface User-Agent: Cyrus-JMAP/3.3.0-dev0-529-g3ee424a-fm-20200611.001-g3ee424a1 Mime-Version: 1.0 Message-Id: In-Reply-To: <202006171752.05HHqo0E086454@gndrsh.dnsmgr.net> References: <202006171752.05HHqo0E086454@gndrsh.dnsmgr.net> Date: Wed, 17 Jun 2020 20:28:21 +0000 From: "Dave Cottlehuber" To: freebsd-current@freebsd.org, "Miguel C" Cc: "Rodney W. Grimes" , "Rebecca Cran" , "Warner Losh" Subject: Re: CTF: UEFI HTTP boot support Content-Type: text/plain X-Rspamd-Queue-Id: 49nGqZ2vTnz4SBj X-Spamd-Bar: -- Authentication-Results: mx1.freebsd.org; dkim=pass header.d=skunkwerks.at header.s=fm2 header.b=H5F4BDUl; dkim=pass header.d=messagingengine.com header.s=fm3 header.b=UEwhZsI8; dmarc=none; spf=pass (mx1.freebsd.org: domain of dch@skunkwerks.at designates 66.111.4.28 as permitted sender) smtp.mailfrom=dch@skunkwerks.at X-Spamd-Result: default: False [-2.77 / 15.00]; ARC_NA(0.00)[]; NEURAL_HAM_MEDIUM(-1.00)[-0.997]; R_DKIM_ALLOW(-0.20)[skunkwerks.at:s=fm2,messagingengine.com:s=fm3]; XM_UA_NO_VERSION(0.01)[]; FROM_HAS_DN(0.00)[]; TO_DN_SOME(0.00)[]; MV_CASE(0.50)[]; R_SPF_ALLOW(-0.20)[+ip4:66.111.4.28]; MIME_GOOD(-0.10)[text/plain]; DMARC_NA(0.00)[skunkwerks.at]; NEURAL_HAM_LONG(-0.96)[-0.964]; RWL_MAILSPIKE_GOOD(0.00)[66.111.4.28:from]; RCPT_COUNT_FIVE(0.00)[5]; RCVD_COUNT_THREE(0.00)[4]; TO_MATCH_ENVRCPT_SOME(0.00)[]; DKIM_TRACE(0.00)[skunkwerks.at:+,messagingengine.com:+]; NEURAL_HAM_SHORT(-1.22)[-1.218]; FREEMAIL_TO(0.00)[freebsd.org,gmail.com]; FROM_EQ_ENVFROM(0.00)[]; MIME_TRACE(0.00)[0:+]; RCVD_TLS_LAST(0.00)[]; ASN(0.00)[asn:11403, ipnet:66.111.4.0/24, country:US]; MID_RHS_WWW(0.50)[]; RCVD_IN_DNSWL_LOW(-0.10)[66.111.4.28:from] X-BeenThere: freebsd-current@freebsd.org X-Mailman-Version: 2.1.33 Precedence: list List-Id: Discussions about the use of FreeBSD-current List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 17 Jun 2020 20:28:43 -0000 On Wed, 17 Jun 2020, at 17:52, Rodney W. Grimes wrote: > > Rodney W. Grimes wrote: > > > > The "fake cd drive" is in the kernel, loader just copies the iso into > > > > memory like any other module, and by the time that's done you just > > > > reboot into the newly installed system, which again uses > > > > > > > > vfs.root.mountfrom="cd9660:/dev/md0.uzip" > > > ^^^ > > > > > > Argh, the cd9660 confused me, I think your doing a > > > "root on mfs/md"? > > > > loader.conf says > > > > rootfs_load="yes" > > rootfs_name="contents.izo" > > rootfs_type="md_image" > > vfs.root.mountfrom="cd9660:/dev/md0.uzip" > > > > contents.izo is uzip'd contents.iso which file(1) > > describes as ISO 9660 CD-ROM filesystem data '' > > > > That's for normal boot, for the loader 'install' command > > it expects an uncompressed iso for rootfs. > > Ok, now the puzzle is how much work to get from a stock FreeBSD .iso > image to something that works with this. Obviously we need a non-stock > /boot/loader.conf file, or to type some commands manually at a loader > prompt. I believe the stock GENERIC kernel has the md_root support > for this already, so it may not be that hard to do. Hi Miguel, all, I spent a bit of time on UEFI HTTP Boot earlier in the year in qemu, bhyve, and intel NUCs -- until everything in the world went to custard. I made some rough notes[1] and I'll go through them again tonight with a fresh build. Hopefully its useful. What I got stuck on was the final pivot, I have never debugged this setup before and I'm still not clear at what point things fail. Olivier's PXE booting and BSDRP were a fantastic reference, and I assume they work in BSDRP already for him. Worth noting that LE TLS certs didn't play well with the PXE UEFI implementation on my intel NUC, this comes up as a very unhelpful error. At least use plain HTTP to get started. While my notes are amd64 oriented I'm very interested in using this for aarch64 locally & in the clowd. My loader.conf follows: boot_multicons="YES" console="efi,comconsole" comconsole_speed="115200" boot_verbose="YES" # make booting somewhat less painful #entropy_cache_load="NO" #kern.random.initial_seeding.bypass_before_seeding="0" # entropy_cache_load="YES" # boot_single="YES" tmpfs_load="YES" autoboot_delay="-1" # dump net vars # exec="show boot.netif.hwaddr" # exec="show boot.netif.ip" # exec="show boot.netif.netmask" # exec="show boot.netif.gateway" # ensure we have enough ram for our image vm.kmem_size=2G vfs.root.mountfrom="ufs:/dev/md0" # vfs.root.mountfrom.options=ro mfs_load="YES" mfs_type="md_image" mfs_name="/boot/mfs-miniroot" interesting these are different from what's above in the thread. references: [1]: https://hackmd.io/@dch/H1X9RYEZr [mfsBSD]: https://mfsbsd.vx.sk/ still 150% awesome [olivier]: https://blog.cochard.me/2019/02/pxe-booting-of-freebsd-disk-image.html [BSDRP]: https://github.com/ocochard/BSDRP A+ Dave From owner-freebsd-current@freebsd.org Wed Jun 17 20:49:07 2020 Return-Path: Delivered-To: freebsd-current@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 47B8E335ADE for ; Wed, 17 Jun 2020 20:49:07 +0000 (UTC) (envelope-from rebecca@bsdio.com) Received: from out03.mta.xmission.com (out03.mta.xmission.com [166.70.13.233]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 49nHH626bWz4Tkm for ; Wed, 17 Jun 2020 20:49:05 +0000 (UTC) (envelope-from rebecca@bsdio.com) DKIM-Signature: v=1; a=rsa-sha256; q=dns/txt; c=simple/simple; d=bsdio.com; s=xmission; h=Subject:Content-Transfer-Encoding:Content-Type:In-Reply-To: MIME-Version:Date:Message-ID:From:References:Cc:To:Sender:Reply-To:Content-ID :Content-Description:Resent-Date:Resent-From:Resent-Sender:Resent-To: Resent-Cc:Resent-Message-ID:List-Id:List-Help:List-Unsubscribe:List-Subscribe :List-Post:List-Owner:List-Archive; bh=b37RcHi56k4q5xwJjlOHerwGvHL5nGNUfn+rHpklByY=; b=m2+LRgimSczqF7/NWyk93wJULV cTIhhwc8urJ4ldyemuvn2FWvdvoooWboM5RQ0suOKgM2LfHu0VY1pcS6uA1zcH58j3LbOOlS1vgcQ j7t8hvP4mXx/jR1aQqKOBayP6EhIXxvAacR+mAnVO75XyRg758oIOv2/JubiYBUWvsl0=; Received: from in01.mta.xmission.com ([166.70.13.51]) by out03.mta.xmission.com with esmtps (TLS1.2:ECDHE_RSA_AES_128_GCM_SHA256:128) (Exim 4.90_1) (envelope-from ) id 1jlezY-0003VL-C8; Wed, 17 Jun 2020 14:49:04 -0600 Received: from mta4.zcs.xmission.com ([166.70.13.68]) by in01.mta.xmission.com with esmtps (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.87) (envelope-from ) id 1jlezX-000235-QR; Wed, 17 Jun 2020 14:49:04 -0600 Received: from localhost (localhost [127.0.0.1]) by mta4.zcs.xmission.com (Postfix) with ESMTP id AE3D550043B; Wed, 17 Jun 2020 14:49:03 -0600 (MDT) X-Amavis-Modified: Mail body modified (using disclaimer) - mta4.zcs.xmission.com Received: from mta4.zcs.xmission.com ([127.0.0.1]) by localhost (mta4.zcs.xmission.com [127.0.0.1]) (amavisd-new, port 10026) with ESMTP id ln91gNm8BAq0; Wed, 17 Jun 2020 14:49:03 -0600 (MDT) Received: from [10.0.10.120] (c-174-52-16-57.hsd1.ut.comcast.net [174.52.16.57]) by mta4.zcs.xmission.com (Postfix) with ESMTPSA id 74196500089; Wed, 17 Jun 2020 14:49:03 -0600 (MDT) To: "Rodney W. Grimes" Cc: Warner Losh , Miguel C , FreeBSD Current References: <202006172011.05HKBS4q087132@gndrsh.dnsmgr.net> From: Rebecca Cran Message-ID: Date: Wed, 17 Jun 2020 14:49:02 -0600 User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:68.0) Gecko/20100101 Thunderbird/68.8.0 MIME-Version: 1.0 In-Reply-To: <202006172011.05HKBS4q087132@gndrsh.dnsmgr.net> Content-Type: text/plain; charset=utf-8; format=flowed Content-Transfer-Encoding: 7bit Content-Language: en-US X-XM-SPF: eid=1jlezX-000235-QR; ; ; mid=; ; ; hst=in01.mta.xmission.com; ; ; ip=166.70.13.68; ; ; frm=rebecca@bsdio.com; ; ; spf=pass X-SA-Exim-Connect-IP: 166.70.13.68 X-SA-Exim-Mail-From: rebecca@bsdio.com X-Spam-Checker-Version: SpamAssassin 3.4.2 (2018-09-13) on sa07.xmission.com X-Spam-Level: X-Spam-Status: No, score=-0.2 required=8.0 tests=ALL_TRUSTED,BAYES_50, DCC_CHECK_NEGATIVE,T_TM2_M_HEADER_IN_MSG autolearn=disabled version=3.4.2 X-Spam-Report: * -1.0 ALL_TRUSTED Passed through trusted hosts only via SMTP * 0.8 BAYES_50 BODY: Bayes spam probability is 40 to 60% * [score: 0.5000] * 0.0 T_TM2_M_HEADER_IN_MSG BODY: No description available. * -0.0 DCC_CHECK_NEGATIVE Not listed in DCC * [sa07 0; Body=1 Fuz1=1 Fuz2=1] X-Spam-DCC: ; sa07 0; Body=1 Fuz1=1 Fuz2=1 X-Spam-Combo: ;"Rodney W. Grimes" X-Spam-Relay-Country: X-Spam-Timing: total 317 ms - load_scoreonly_sql: 0.04 (0.0%), signal_user_changed: 12 (3.7%), b_tie_ro: 10 (3.2%), parse: 1.47 (0.5%), extract_message_metadata: 5 (1.6%), get_uri_detail_list: 0.81 (0.3%), tests_pri_-1000: 3.8 (1.2%), tests_pri_-950: 1.84 (0.6%), tests_pri_-900: 1.52 (0.5%), tests_pri_-90: 112 (35.4%), check_bayes: 110 (34.7%), b_tokenize: 8 (2.6%), b_tok_get_all: 6 (1.9%), b_comp_prob: 1.97 (0.6%), b_tok_touch_all: 90 (28.3%), b_finish: 1.01 (0.3%), tests_pri_0: 165 (52.1%), check_dkim_signature: 0.90 (0.3%), check_dkim_adsp: 10 (3.0%), poll_dns_idle: 0.33 (0.1%), tests_pri_10: 2.5 (0.8%), tests_pri_500: 8 (2.5%), rewrite_mail: 0.00 (0.0%) Subject: Re: CTF: UEFI HTTP boot support X-Spam-Flag: No X-SA-Exim-Version: 4.2.1 (built Thu, 05 May 2016 13:38:54 -0600) X-SA-Exim-Scanned: Yes (on in01.mta.xmission.com) X-Rspamd-Queue-Id: 49nHH626bWz4Tkm X-Spamd-Bar: -- Authentication-Results: mx1.freebsd.org; dkim=pass header.d=bsdio.com header.s=xmission header.b=m2+LRgim; dmarc=none; spf=pass (mx1.freebsd.org: domain of rebecca@bsdio.com designates 166.70.13.233 as permitted sender) smtp.mailfrom=rebecca@bsdio.com X-Spamd-Result: default: False [-2.91 / 15.00]; RCVD_VIA_SMTP_AUTH(0.00)[]; ARC_NA(0.00)[]; RCVD_COUNT_FIVE(0.00)[6]; R_DKIM_ALLOW(-0.20)[bsdio.com:s=xmission]; FROM_HAS_DN(0.00)[]; RCPT_COUNT_THREE(0.00)[4]; R_SPF_ALLOW(-0.20)[+ip4:166.70.13.0/24]; NEURAL_HAM_LONG(-0.96)[-0.964]; MIME_GOOD(-0.10)[text/plain]; DMARC_NA(0.00)[bsdio.com]; NEURAL_HAM_MEDIUM(-1.01)[-1.009]; RECEIVED_SPAMHAUS_PBL(0.00)[174.52.16.57:received]; TO_MATCH_ENVRCPT_SOME(0.00)[]; TO_DN_ALL(0.00)[]; DKIM_TRACE(0.00)[bsdio.com:+]; NEURAL_HAM_SHORT(-0.34)[-0.341]; FROM_EQ_ENVFROM(0.00)[]; MIME_TRACE(0.00)[0:+]; RCVD_TLS_LAST(0.00)[]; ASN(0.00)[asn:6315, ipnet:166.70.0.0/16, country:US]; FREEMAIL_CC(0.00)[bsdimp.com,gmail.com,freebsd.org]; MID_RHS_MATCH_FROM(0.00)[]; RCVD_IN_DNSWL_LOW(-0.10)[166.70.13.233:from] X-BeenThere: freebsd-current@freebsd.org X-Mailman-Version: 2.1.33 Precedence: list List-Id: Discussions about the use of FreeBSD-current List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 17 Jun 2020 20:49:07 -0000 On 6/17/20 2:11 PM, Rodney W. Grimes wrote: > Does freeBSD have any way to access these "Virtual Disk" > or Virtual CD images once we leave the world of the loader? > I believe we do not, as these are BIOS/UEFI devices that > require calls into the UEFI code, which, IIRC is gone > once we exit the loader and start the kernel proper, > or shortly there after. > > As far as I know these devices well not be found by the FreeBSD > cam layer ATA or AHCI drivers as they do not present an actual > PCI device to find. I just tried it on my Supermicro server and you're right, it doesn't show up under FreeBSD. I'm not sure if there's a way to access them via UEFI Runtime Services or if it's designed purely as a boot-time thing. -- Rebecca Cran From owner-freebsd-current@freebsd.org Wed Jun 17 21:29:18 2020 Return-Path: Delivered-To: freebsd-current@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 5C992337359 for ; Wed, 17 Jun 2020 21:29:18 +0000 (UTC) (envelope-from miguelmclara@gmail.com) Received: from mail-pg1-x52f.google.com (mail-pg1-x52f.google.com [IPv6:2607:f8b0:4864:20::52f]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "GTS CA 1O1" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 49nJ9T39cSz4Yc3 for ; Wed, 17 Jun 2020 21:29:17 +0000 (UTC) (envelope-from miguelmclara@gmail.com) Received: by mail-pg1-x52f.google.com with SMTP id e9so1896968pgo.9 for ; Wed, 17 Jun 2020 14:29:17 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=mime-version:references:in-reply-to:from:date:message-id:subject:to :cc; bh=t49oaKDkvtiOKj9OnVgsRZvoaFNvrMa2cjeD5fcDd1E=; b=UQQtnfq+JTZY+29DjtN3SNmHLMvl9MAMWnOgpiGjYVL3nOKdhEeevLOGMe74/2DUMw pRKHfvD8bVwFiqgzA4FZsun1zOOW7ODFSYTrTcrnXEDrd9i4LnlNyJCGVbI0+UDvm/Wc boo1eCSD5A+NFx1pn9RlxzuzevZVoLnmfBMIxFGAdJ4IJY+fToH0lAorckAH5t60qpFc tQpvck/mC1XPdnHZBzyTLz7dz7gXV7edUbsUIih0jdCduU0Okc77bEJJJ9A3Tb9ur9l5 xgU7FnRrxUT/XCXi30hAVGm6kbNG4JVzLTGPOvGQkC+xF+QkxgBg6oDPEjAoCcb4jo6O xSAA== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:references:in-reply-to:from:date :message-id:subject:to:cc; bh=t49oaKDkvtiOKj9OnVgsRZvoaFNvrMa2cjeD5fcDd1E=; b=TEhj9qhyH9/dygXmBNOU1UIefR3NTbPTPGMQCfRPdaPmjKt/kfB/l+35iJeUJdoQnQ XQwqsVBM/i4KLAym2d5tf3NxVWojy9egEnDWH2iVsmOadEMl8ffI2GxqEysOzLltQP4m naH4y1RuYfVoMjFxRgEDVs7LEjNHLcuOlSXYMlLBs+ucWPpOeLlTc+oRcTymXrCBsakm o8abYHXm7/JlSBWECIE4445yUdrnvcINkPdfQ5FE/HmhVdZiHI7bhexXgSNBB3P0YcQK RVOaFKM/dPudXI7akJsbNRAAjDbQEDUlPebQI/8MCHO2nHBiKaI+yQowLp+8LjIw7uXM LoRA== X-Gm-Message-State: AOAM530Bt0p3oNE1vtq1VfQPTXYspKDS33+tLBC2ZVqIIM+JbNHj/ZBL wJYo/Vfdm+VdDP+b9LoxdblLoyLgUhUr0HI3jUBXGXDwEoM= X-Google-Smtp-Source: ABdhPJxXvSS5r+1YezM9aqGEAAV9/49U4R1jf31W/U8p+E76NpYvWo5NdrdyyDz0AJFItV7C/0uVu157C9I5p4YCoNY= X-Received: by 2002:a63:8f46:: with SMTP id r6mr676095pgn.257.1592429355257; Wed, 17 Jun 2020 14:29:15 -0700 (PDT) MIME-Version: 1.0 References: <202006171800.05HI0jET086509@gndrsh.dnsmgr.net> In-Reply-To: <202006171800.05HI0jET086509@gndrsh.dnsmgr.net> From: Miguel C Date: Wed, 17 Jun 2020 22:28:38 +0100 Message-ID: Subject: Re: CTF: UEFI HTTP boot support To: "Rodney W. Grimes" Cc: Maxim Sobolev , FreeBSD Current X-Rspamd-Queue-Id: 49nJ9T39cSz4Yc3 X-Spamd-Bar: --- Authentication-Results: mx1.freebsd.org; dkim=pass header.d=gmail.com header.s=20161025 header.b=UQQtnfq+; dmarc=pass (policy=none) header.from=gmail.com; spf=pass (mx1.freebsd.org: domain of miguelmclara@gmail.com designates 2607:f8b0:4864:20::52f as permitted sender) smtp.mailfrom=miguelmclara@gmail.com X-Spamd-Result: default: False [-3.52 / 15.00]; ARC_NA(0.00)[]; NEURAL_HAM_MEDIUM(-1.00)[-1.002]; R_DKIM_ALLOW(-0.20)[gmail.com:s=20161025]; FROM_HAS_DN(0.00)[]; RCPT_COUNT_THREE(0.00)[3]; R_SPF_ALLOW(-0.20)[+ip6:2607:f8b0:4000::/36:c]; FREEMAIL_FROM(0.00)[gmail.com]; MIME_GOOD(-0.10)[multipart/alternative,text/plain]; PREVIOUSLY_DELIVERED(0.00)[freebsd-current@freebsd.org]; NEURAL_HAM_LONG(-0.99)[-0.989]; TO_MATCH_ENVRCPT_SOME(0.00)[]; TO_DN_ALL(0.00)[]; DKIM_TRACE(0.00)[gmail.com:+]; DMARC_POLICY_ALLOW(-0.50)[gmail.com,none]; RCVD_IN_DNSWL_NONE(0.00)[2607:f8b0:4864:20::52f:from]; NEURAL_HAM_SHORT(-0.52)[-0.524]; FROM_EQ_ENVFROM(0.00)[]; MIME_TRACE(0.00)[0:+,1:+,2:~]; FREEMAIL_ENVFROM(0.00)[gmail.com]; ASN(0.00)[asn:15169, ipnet:2607:f8b0::/32, country:US]; RCVD_COUNT_TWO(0.00)[2]; RCVD_TLS_ALL(0.00)[]; DWL_DNSWL_NONE(0.00)[gmail.com:dkim] Content-Type: text/plain; charset="UTF-8" X-Content-Filtered-By: Mailman/MimeDel 2.1.33 X-BeenThere: freebsd-current@freebsd.org X-Mailman-Version: 2.1.33 Precedence: list List-Id: Discussions about the use of FreeBSD-current List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 17 Jun 2020 21:29:18 -0000 On Wed, Jun 17, 2020 at 7:00 PM Rodney W. Grimes < freebsd-rwg@gndrsh.dnsmgr.net> wrote: > > On Tue., Jun. 16, 2020, 8:35 a.m. Rodney W. Grimes, < > > freebsd-rwg@gndrsh.dnsmgr.net> wrote: > > > > > > I've been trying out FreeBSD with raspberry Pi4 (4GB) and wanted to > see > > > > what the state of HTTP BOOT is in FreeBSD, so I bumped into this! > > > > > > > > I'm curious if it should be possible to point to a img/iso directly > (I > > > > tried to use the img.xz unpacked it and make it available on a local > web > > > > server and that didn't seem to work for me) but maybe thats cause > those > > > > images miss something, so arm64 aside does that work for amd64? I.E. > > > using > > > > the bootonly.iso? > > > > > > One problem you run into in attemtping this is even if you get an > > > image downloaded and started that image is being provided by some > > > memory device driver that emulates some type of iso device. > > > FreeBSD does not have a driver for that device so once the kernel > > > gets to the point of mounting its root file system it falls on > > > its face with a mountroot failure. > > > > > > > I donno what you are talking about Rodney, frankly! You information might > > be way outdated, like 15 years outdated. :) FreeBSD comes with very > decent > > compressed image support in MD(4)+geom_uzip, which could be just UFS > > snapshot or something created with mkimg utility. That said image could > be > > then either loaded after the kernel or embedded into one. Using this > > approach we deploy our systems here, both kernel and all root + python > > interpreter + custom gui installer fit into 40mb ISO but apart from > loader > > bits it's just two files. > > Max, > Let me try explain what this user is actually experienceing, > and that is taking a box stock linux distro, sticking it on a webserver > and using PXE/HTTP booting to a running system. FreeBSD can not > achieve that today WITHOUT some additional work. All that > stuff like UFS snapshot, mkimg utlity, embeding the image is a ton > of work compared to what others are doing. > Well actually I've been using opensbd to test not linux, I'm using https://rpi4-uefi.dev/ (not the sotck firmware). This firmware deos have UEFI HTTP support and as stated bellow UEFI 2.5 supports booting from just a iso or img file, ofc the OS needs to support this too. You can even point it to the internet FWIW but I was actually downloading miniroot67.img (openbsd installer) and serving it locally! Creating a HTTP Boot entry manually in UEFI works perfect with this and I can get to the shell, and even use it to install to a USB drive or sdcad. > > This person probably does not even have a running FreeBSD box to do > any of your suggested solutions on. > > No really I do have FreeBSD boxes, I just wanted to clarify that; I'm not too familiar with the process of making system images but I can learn. > So give me some credit, I have only been doing "diskless" since 1982, > and actually do exactly what the OP is doing with Esxi, Ubuntu, Windows > Installers, etc. Just my choice of protocol at the PXE layer is NFS > instead of HTTP, but my config files can do HTTP with 1 variable change > and point a web server at the root of my boot images tree. > > I even have a menu entry that sends me off to: > https://netboot.xyz/ Regards, > Rod > > > > > -Max > > > > > > > > > > > > And on the other hand is there any doc on how to set up dhcp/http > > > specific > > > > to FreeBSD similar to > https://en.opensuse.org/UEFI_HTTPBoot_Server_Setup > > > ? > > > > > > Since Linux uses this idea of a kernel payload and an initrd payload > > > to boot with it is much easier to get these 2 things over the network > > > and then have a workable system. FreeBSD does not have the initrd > > > payload and that complicates things, you need a functionaly filesystem > > > avaliable at the end of kernel initilization. > > > > > > > > I looked into > https://www.freebsd.org/doc/handbook/network-diskless.html > > > > but that doesn't seem to be up to date (or at least it focuses only > on > > > PXE > > > > and TFTP). > > > > > > Yes, old but workable. I have a more advanced system that supports NFS > > > booting using NFS support in PXE. The only thing done via tftp is to > > > upgrade the PXE running on the client to one that speaks NFS, then the > > > kernel is loaded via NFS and the root file system is later provided > > > via NFS. The use of NFS provides very fast boots, and I do not need > > > a web server to do it :-). > > > > > > > For clarification my ultimate goal is to use a few pi4's as "thin > > > clients", > > > > so eventually I will have to setup an image of the system with the > needed > > > > software (freerdp) but for starters I just wanted to check if > pointing > > > > directly to a img/iso would work and that does not seem to be the > case. > > > > > > I would strongly suggest use of NFS instead of trying to provide an > > > ISO image, as you no longer need to store the ISO in memory on the > > > client box, and with a pi4 your already memory contrained. > > > > > > > Thanks. > > > > _______________________________________________ > > > > freebsd-current@freebsd.org mailing list > > > > https://lists.freebsd.org/mailman/listinfo/freebsd-current > > > > To unsubscribe, send any mail to " > > > freebsd-current-unsubscribe@freebsd.org" > > > -- > > > Rod Grimes > > > rgrimes@freebsd.org > > > _______________________________________________ > > > freebsd-current@freebsd.org mailing list > > > https://lists.freebsd.org/mailman/listinfo/freebsd-current > > > To unsubscribe, send any mail to " > freebsd-current-unsubscribe@freebsd.org" > > > > > > > > -- > Rod Grimes > rgrimes@freebsd.org > From owner-freebsd-current@freebsd.org Wed Jun 17 21:33:09 2020 Return-Path: Delivered-To: freebsd-current@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 0F9E5337812 for ; Wed, 17 Jun 2020 21:33:09 +0000 (UTC) (envelope-from miguelmclara@gmail.com) Received: from mail-pg1-x533.google.com (mail-pg1-x533.google.com [IPv6:2607:f8b0:4864:20::533]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "GTS CA 1O1" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 49nJFw23Bfz4Z4Z for ; Wed, 17 Jun 2020 21:33:08 +0000 (UTC) (envelope-from miguelmclara@gmail.com) Received: by mail-pg1-x533.google.com with SMTP id u128so1894769pgu.13 for ; Wed, 17 Jun 2020 14:33:08 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=mime-version:references:in-reply-to:from:date:message-id:subject:to :cc; bh=IvMAOlxoKi79c4Ta2kbD0MGPQrr6MA8vMjyK4DBBc60=; b=f4xH+MKZDo5iHm0jXJc34TD1PErtF0zn70/64YpPj2vIrl16YuSiM32sXNEWD2rLoM ZIOgealbwJOedZp0zBebuArOej1UFO0NCmoYcTecLY2f5t+irxIkE7YplOHHoYrMbhVd gBBe88h/zIA4MRrHnmbYznGU3qcc6+0TrT6vMZKXT7rwAAXwv8yfdZ1n8ruzSWdtnwB5 8PP5pqpASeTiouFShgXBHEvWPunU6hQdrz8ucqOoYBU9mRNwGwOtmjgQHXmsoovhAyOn n5M6qNeSY9PV+VdaXFGKULGgi5DsM4mLtKS+oI6mYHSF+slzL7/pUfkY3Ne40GQR1ftn AU2w== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:references:in-reply-to:from:date :message-id:subject:to:cc; bh=IvMAOlxoKi79c4Ta2kbD0MGPQrr6MA8vMjyK4DBBc60=; b=PgzFkfXxSmThLuum2EmQMSgDtnIfxjpmVDOCrL28KZr1zXkgU2D8R+9Xhi01AYWFAl 9tma+LFjKazcXG0SEG/atyln0m2CHJoMvBvu2/z+B5JuHS7OBUeTZkUJpE5iIGu3zx+C OveBkdsE9sj88KPqGVwSxh5AA6rYxD8WzDsNEYfi6bip/Si2j8LY4jVp7VfsBAni0VR6 AakvHeSK1Mxe/KKZaspPdRHyAvdCEgoGYbI63sOdoMulOd4H4I55YCi3HPkFCS80/BhN /DRmoHJe6d8lUQz6GTM7G3T8ixyA1MBO7VHlGb8oZ3WygVQEEKetwuRHTN9H9gmZMjWe Zq/Q== X-Gm-Message-State: AOAM533b+bleV56UlYT2IZj7xUG4nKWvSxelJ6GFXcQ3qDPqfk9O/Xop qAr7Q8exsuwPt8ez8t5QrMDMdI1j5Doe5j0KSvwyMiZM61U= X-Google-Smtp-Source: ABdhPJzumBVYwY2daWlwsMBQ5chZ15+rs9qLqM3PpeLxp66+w2y3J56kABH+5pRFadaERTYv2hryViz1gL6W0aOwzWM= X-Received: by 2002:a62:8683:: with SMTP id x125mr665410pfd.211.1592429586700; Wed, 17 Jun 2020 14:33:06 -0700 (PDT) MIME-Version: 1.0 References: <202006171752.05HHqo0E086454@gndrsh.dnsmgr.net> In-Reply-To: From: Miguel C Date: Wed, 17 Jun 2020 22:32:29 +0100 Message-ID: Subject: Re: CTF: UEFI HTTP boot support To: Dave Cottlehuber Cc: freebsd-current , "Rodney W. Grimes" , Rebecca Cran , Warner Losh X-Rspamd-Queue-Id: 49nJFw23Bfz4Z4Z X-Spamd-Bar: --- Authentication-Results: mx1.freebsd.org; dkim=pass header.d=gmail.com header.s=20161025 header.b=f4xH+MKZ; dmarc=pass (policy=none) header.from=gmail.com; spf=pass (mx1.freebsd.org: domain of miguelmclara@gmail.com designates 2607:f8b0:4864:20::533 as permitted sender) smtp.mailfrom=miguelmclara@gmail.com X-Spamd-Result: default: False [-3.60 / 15.00]; ARC_NA(0.00)[]; NEURAL_HAM_MEDIUM(-1.00)[-1.001]; R_DKIM_ALLOW(-0.20)[gmail.com:s=20161025]; FROM_HAS_DN(0.00)[]; R_SPF_ALLOW(-0.20)[+ip6:2607:f8b0:4000::/36:c]; FREEMAIL_FROM(0.00)[gmail.com]; MIME_GOOD(-0.10)[multipart/alternative,text/plain]; PREVIOUSLY_DELIVERED(0.00)[freebsd-current@freebsd.org]; NEURAL_HAM_LONG(-0.99)[-0.993]; RCPT_COUNT_FIVE(0.00)[5]; TO_MATCH_ENVRCPT_SOME(0.00)[]; TO_DN_ALL(0.00)[]; DKIM_TRACE(0.00)[gmail.com:+]; DMARC_POLICY_ALLOW(-0.50)[gmail.com,none]; RCVD_IN_DNSWL_NONE(0.00)[2607:f8b0:4864:20::533:from]; NEURAL_HAM_SHORT(-0.61)[-0.608]; FROM_EQ_ENVFROM(0.00)[]; MIME_TRACE(0.00)[0:+,1:+,2:~]; FREEMAIL_ENVFROM(0.00)[gmail.com]; ASN(0.00)[asn:15169, ipnet:2607:f8b0::/32, country:US]; RCVD_COUNT_TWO(0.00)[2]; RCVD_TLS_ALL(0.00)[]; DWL_DNSWL_NONE(0.00)[gmail.com:dkim] Content-Type: text/plain; charset="UTF-8" X-Content-Filtered-By: Mailman/MimeDel 2.1.33 X-BeenThere: freebsd-current@freebsd.org X-Mailman-Version: 2.1.33 Precedence: list List-Id: Discussions about the use of FreeBSD-current List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 17 Jun 2020 21:33:09 -0000 On Wed, Jun 17, 2020 at 9:28 PM Dave Cottlehuber wrote: > On Wed, 17 Jun 2020, at 17:52, Rodney W. Grimes wrote: > > > Rodney W. Grimes wrote: > > > > > The "fake cd drive" is in the kernel, loader just copies the iso > into > > > > > memory like any other module, and by the time that's done you just > > > > > reboot into the newly installed system, which again uses > > > > > > > > > > vfs.root.mountfrom="cd9660:/dev/md0.uzip" > > > > ^^^ > > > > > > > > Argh, the cd9660 confused me, I think your doing a > > > > "root on mfs/md"? > > > > > > loader.conf says > > > > > > rootfs_load="yes" > > > rootfs_name="contents.izo" > > > rootfs_type="md_image" > > > vfs.root.mountfrom="cd9660:/dev/md0.uzip" > > > > > > contents.izo is uzip'd contents.iso which file(1) > > > describes as ISO 9660 CD-ROM filesystem data '' > > > > > > That's for normal boot, for the loader 'install' command > > > it expects an uncompressed iso for rootfs. > > > > Ok, now the puzzle is how much work to get from a stock FreeBSD .iso > > image to something that works with this. Obviously we need a non-stock > > /boot/loader.conf file, or to type some commands manually at a loader > > prompt. I believe the stock GENERIC kernel has the md_root support > > for this already, so it may not be that hard to do. > > > Hi Miguel, all, > > I spent a bit of time on UEFI HTTP Boot earlier in the year in qemu, > bhyve, and intel NUCs -- until everything in the world went to custard. I > made some rough notes[1] and I'll go through them again tonight with a > fresh build. Hopefully its useful. > > What I got stuck on was the final pivot, I have never debugged this setup > before and I'm still not clear at what point things fail. Olivier's PXE > booting and BSDRP were a fantastic reference, and I assume they work in > BSDRP already for him. > > Worth noting that LE TLS certs didn't play well with the PXE UEFI > implementation on my intel NUC, this comes up as a very unhelpful error. At > least use plain HTTP to get started. > > While my notes are amd64 oriented I'm very interested in using this for > aarch64 locally & in the clowd. > > My loader.conf follows: > > boot_multicons="YES" > console="efi,comconsole" > comconsole_speed="115200" > boot_verbose="YES" > # make booting somewhat less painful > #entropy_cache_load="NO" > #kern.random.initial_seeding.bypass_before_seeding="0" > # entropy_cache_load="YES" > # boot_single="YES" > tmpfs_load="YES" > autoboot_delay="-1" > # dump net vars > # exec="show boot.netif.hwaddr" > # exec="show boot.netif.ip" > # exec="show boot.netif.netmask" > # exec="show boot.netif.gateway" > # ensure we have enough ram for our image > vm.kmem_size=2G > vfs.root.mountfrom="ufs:/dev/md0" > # vfs.root.mountfrom.options=ro > mfs_load="YES" > mfs_type="md_image" > mfs_name="/boot/mfs-miniroot" > > interesting these are different from what's above in the thread. > > Ah thanks a lot for this and for the references, especially the first one with all the notes :D references: > > [1]: https://hackmd.io/@dch/H1X9RYEZr > [mfsBSD]: https://mfsbsd.vx.sk/ still 150% awesome > [olivier]: > https://blog.cochard.me/2019/02/pxe-booting-of-freebsd-disk-image.html > [BSDRP]: https://github.com/ocochard/BSDRP > > A+ > Dave > From owner-freebsd-current@freebsd.org Wed Jun 17 22:44:59 2020 Return-Path: Delivered-To: freebsd-current@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id B2D233388CC for ; Wed, 17 Jun 2020 22:44:59 +0000 (UTC) (envelope-from sobomax@sippysoft.com) Received: from mail-ej1-f67.google.com (mail-ej1-f67.google.com [209.85.218.67]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "GTS CA 1O1" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 49nKrp5dhSz4fN8 for ; Wed, 17 Jun 2020 22:44:58 +0000 (UTC) (envelope-from sobomax@sippysoft.com) Received: by mail-ej1-f67.google.com with SMTP id l12so4325685ejn.10 for ; Wed, 17 Jun 2020 15:44:58 -0700 (PDT) X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:references:in-reply-to:from:date :message-id:subject:to:cc; bh=q9DfuyB2K+6M7V/regQUu3EP6JGJ+zglGcjdS0XwRl0=; b=sEm3TdNYWg0rsuj7QpYucJAvNA20z2bk3o9EXtvekm7feENd8E/d8PqzQy3H+IjxnW 1TbJCr72tUChqkGoql1EpOMv1sFQ39nJyPhGTrmU5oW5/+dByHEVOYJy+0oAOzpQvtp7 h52/eDyuJWZj4NyQrPqzfyRl9m4PvbskJ2lX2N7zmugysBqtjCrryNYhq95gstaIMt/I cRIt2GOTOKY0n87yils+/adhONQr19OTQUlAbg9b5ezxDU8RT2EMQG68MMCPiynRiY8A PRVjF9t/sEY+boDz7FJWmFaeJQ3Bjm928zhvChBI02+gH2slgHZtSks6As0smN/b5hFo d5Eg== X-Gm-Message-State: AOAM533hw9M/Xz2dVd8z3g4mT+3E0u454OmbhJtvAHdplhLQ7+KZpyPW YEVpJm9I8aF4BFtJ62z7fKUbcraRBdJZxndE2RjECA== X-Google-Smtp-Source: ABdhPJyLhTB66GzTnS44UmaCUoXMbvjvCmI8J+TxUXKRHz1rzgx6mTUMEbWizJhFImWHFbRmFkJSn7Qeo5Eq8wyqgTQ= X-Received: by 2002:a17:906:af84:: with SMTP id mj4mr1213624ejb.473.1592433896041; Wed, 17 Jun 2020 15:44:56 -0700 (PDT) MIME-Version: 1.0 References: <202006171752.05HHqo0E086454@gndrsh.dnsmgr.net> In-Reply-To: From: Maxim Sobolev Date: Wed, 17 Jun 2020 15:44:44 -0700 Message-ID: Subject: Re: CTF: UEFI HTTP boot support To: Miguel C Cc: Dave Cottlehuber , freebsd-current , "Rodney W. Grimes" , Rebecca Cran , Warner Losh X-Rspamd-Queue-Id: 49nKrp5dhSz4fN8 X-Spamd-Bar: - Authentication-Results: mx1.freebsd.org; dkim=none; dmarc=none; spf=pass (mx1.freebsd.org: domain of sobomax@sippysoft.com designates 209.85.218.67 as permitted sender) smtp.mailfrom=sobomax@sippysoft.com X-Spamd-Result: default: False [-1.96 / 15.00]; RCVD_TLS_ALL(0.00)[]; ARC_NA(0.00)[]; NEURAL_HAM_MEDIUM(-0.55)[-0.546]; FROM_HAS_DN(0.00)[]; RWL_MAILSPIKE_GOOD(0.00)[209.85.218.67:from]; R_SPF_ALLOW(-0.20)[+ip4:209.85.128.0/17]; NEURAL_HAM_LONG(-0.91)[-0.914]; MIME_GOOD(-0.10)[multipart/alternative,text/plain]; PREVIOUSLY_DELIVERED(0.00)[freebsd-current@freebsd.org]; DMARC_NA(0.00)[freebsd.org]; RCPT_COUNT_FIVE(0.00)[6]; TO_MATCH_ENVRCPT_SOME(0.00)[]; TO_DN_ALL(0.00)[]; NEURAL_HAM_SHORT(-0.50)[-0.497]; RCVD_IN_DNSWL_NONE(0.00)[209.85.218.67:from]; FREEMAIL_TO(0.00)[gmail.com]; FORGED_SENDER(0.30)[sobomax@freebsd.org,sobomax@sippysoft.com]; R_DKIM_NA(0.00)[]; MIME_TRACE(0.00)[0:+,1:+,2:~]; ASN(0.00)[asn:15169, ipnet:209.85.128.0/17, country:US]; RCVD_COUNT_TWO(0.00)[2]; FROM_NEQ_ENVFROM(0.00)[sobomax@freebsd.org,sobomax@sippysoft.com] Content-Type: text/plain; charset="UTF-8" X-Content-Filtered-By: Mailman/MimeDel 2.1.33 X-BeenThere: freebsd-current@freebsd.org X-Mailman-Version: 2.1.33 Precedence: list List-Id: Discussions about the use of FreeBSD-current List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 17 Jun 2020 22:44:59 -0000 This is what we have running in AWS right now, kinda proof of concept but it's not that difficult to generalize: [root@ip-172-31-10-188 /usr/local/etc/freeswitch]# mdconfig -lv md0 preload 160M - [root@ip-172-31-10-188 /usr/local/etc/freeswitch]# df Filesystem 512-blocks Used Avail Capacity Mounted on /dev/ufs/root_20200617071427 1300080 1220480 79600 94% / devfs 2 2 0 100% /dev /dev/ufs/etc_20200617071427 9912 6384 2736 70% /etc /dev/ufs/local_20200617071427 2746992 2572144 174848 94% /usr/local /dev/ufs/boot_20200617071427 389560 361208 28352 93% /boot tmpfs 65536 624 64912 1% /tmp tmpfs 20480 16 20464 0% /usr/home/ssp-user tmpfs 524288 336816 187472 64% /var Root file system is untrimmed 1.2GB UFS, generated with mkuzip compressed down to 160MB with the UZIP, and pre-loaded along with the kernel. The /usr/local file system is read-only UFS+UZIP images placed directly onto the GPT and probed out with GEOM_LABEL. Out of those only /etc is read-write. The idea here is that the box should theoretically survive total loss of connectivity to both root and the /usr/local storage (or we can replace it on the fly with the new version). [root@ip-172-31-10-188 /usr/local/etc/freeswitch]# mount /dev/ufs/root_20200617071427 on / (ufs, local, read-only) devfs on /dev (devfs, local, multilabel) /dev/ufs/etc_20200617071427 on /etc (ufs, local, synchronous) /dev/ufs/local_20200617071427 on /usr/local (ufs, local, read-only) /dev/ufs/boot_20200617071427 on /boot (ufs, local, read-only) tmpfs on /tmp (tmpfs, local) tmpfs on /usr/home/ssp-user (tmpfs, local) tmpfs on /var (tmpfs, local) Configuration is dead simple: vfs.root.mountfrom="ufs:ufs/root_20200617071427" image_load="YES" image_name="/root.uzp" image_type="mfs_root" autoboot_delay="-1" It takes less than 100 lines of code I think to generate this out of buildworld/buildkernel. 0 third party tools. Replace loading root from disk with loading it from HTTP server and it would work just as good with the only need to load 1 or two files. There is only one catch there - with real UEFI hardware sometimes there is small(ish) region followed by a hole and then the much bigger region. Unfortunately our loader picks smaller region for its work area and md_image loading mechanism is not good enough to either place it entirely into a bigger segment, or do scatter-gather and split it out and make the kernel do some VM trick to re-assemble later. But with some post-installworld cleaning if you can compress down the full image to some 30-40MB that usually works and has everything one may need including kitchen sink (i.e. python 3.7 with few modules). As I said, no woodo magic like famous crunchgen, just a very liberal application of the rm -rf. With regards to ro vs. rw, recipy is "don't do it" :) If you want hard RO embedded into kernel - compress your image with mkuzip first and then embed it into kernel. This what FreeBSD/MIPS guys have mastered a lot (platform was very tight on flash), which is why geom_uzip is practically in every MIPS kernel config file. But that works (or should work) just as well on x64. Not only that would save lots of VM but also the RO proper attribute will be provided by the geom_uzip for free. I am by the way hacking some way to populate /var with something more interesting that just stock /etc/mtree/BSD.var.dist, there will be a review request soon. :) -Max On Wed, Jun 17, 2020 at 2:33 PM Miguel C wrote: > On Wed, Jun 17, 2020 at 9:28 PM Dave Cottlehuber > wrote: > > > On Wed, 17 Jun 2020, at 17:52, Rodney W. Grimes wrote: > > > > Rodney W. Grimes wrote: > > > > > > The "fake cd drive" is in the kernel, loader just copies the iso > > into > > > > > > memory like any other module, and by the time that's done you > just > > > > > > reboot into the newly installed system, which again uses > > > > > > > > > > > > vfs.root.mountfrom="cd9660:/dev/md0.uzip" > > > > > ^^^ > > > > > > > > > > Argh, the cd9660 confused me, I think your doing a > > > > > "root on mfs/md"? > > > > > > > > loader.conf says > > > > > > > > rootfs_load="yes" > > > > rootfs_name="contents.izo" > > > > rootfs_type="md_image" > > > > vfs.root.mountfrom="cd9660:/dev/md0.uzip" > > > > > > > > contents.izo is uzip'd contents.iso which file(1) > > > > describes as ISO 9660 CD-ROM filesystem data '' > > > > > > > > That's for normal boot, for the loader 'install' command > > > > it expects an uncompressed iso for rootfs. > > > > > > Ok, now the puzzle is how much work to get from a stock FreeBSD .iso > > > image to something that works with this. Obviously we need a non-stock > > > /boot/loader.conf file, or to type some commands manually at a loader > > > prompt. I believe the stock GENERIC kernel has the md_root support > > > for this already, so it may not be that hard to do. > > > > > > Hi Miguel, all, > > > > I spent a bit of time on UEFI HTTP Boot earlier in the year in qemu, > > bhyve, and intel NUCs -- until everything in the world went to custard. I > > made some rough notes[1] and I'll go through them again tonight with a > > fresh build. Hopefully its useful. > > > > What I got stuck on was the final pivot, I have never debugged this setup > > before and I'm still not clear at what point things fail. Olivier's PXE > > booting and BSDRP were a fantastic reference, and I assume they work in > > BSDRP already for him. > > > > Worth noting that LE TLS certs didn't play well with the PXE UEFI > > implementation on my intel NUC, this comes up as a very unhelpful error. > At > > least use plain HTTP to get started. > > > > While my notes are amd64 oriented I'm very interested in using this for > > aarch64 locally & in the clowd. > > > > My loader.conf follows: > > > > boot_multicons="YES" > > console="efi,comconsole" > > comconsole_speed="115200" > > boot_verbose="YES" > > # make booting somewhat less painful > > #entropy_cache_load="NO" > > #kern.random.initial_seeding.bypass_before_seeding="0" > > # entropy_cache_load="YES" > > # boot_single="YES" > > tmpfs_load="YES" > > autoboot_delay="-1" > > # dump net vars > > # exec="show boot.netif.hwaddr" > > # exec="show boot.netif.ip" > > # exec="show boot.netif.netmask" > > # exec="show boot.netif.gateway" > > # ensure we have enough ram for our image > > vm.kmem_size=2G > > vfs.root.mountfrom="ufs:/dev/md0" > > # vfs.root.mountfrom.options=ro > > mfs_load="YES" > > mfs_type="md_image" > > mfs_name="/boot/mfs-miniroot" > > > > interesting these are different from what's above in the thread. > > > > > Ah thanks a lot for this and for the references, especially the first one > with all the notes :D > > references: > > > > [1]: https://hackmd.io/@dch/H1X9RYEZr > > [mfsBSD]: https://mfsbsd.vx.sk/ still 150% awesome > > [olivier]: > > https://blog.cochard.me/2019/02/pxe-booting-of-freebsd-disk-image.html > > [BSDRP]: https://github.com/ocochard/BSDRP > > > > A+ > > Dave > > > _______________________________________________ > freebsd-current@freebsd.org mailing list > https://lists.freebsd.org/mailman/listinfo/freebsd-current > To unsubscribe, send any mail to "freebsd-current-unsubscribe@freebsd.org" > > From owner-freebsd-current@freebsd.org Thu Jun 18 02:17:38 2020 Return-Path: Delivered-To: freebsd-current@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 68F7133F8AC; Thu, 18 Jun 2020 02:17:38 +0000 (UTC) (envelope-from rajfbsd@gmail.com) Received: from mail-wr1-x42e.google.com (mail-wr1-x42e.google.com [IPv6:2a00:1450:4864:20::42e]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "GTS CA 1O1" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 49nQZ93pN1z3f2c; Thu, 18 Jun 2020 02:17:37 +0000 (UTC) (envelope-from rajfbsd@gmail.com) Received: by mail-wr1-x42e.google.com with SMTP id t18so4361572wru.6; Wed, 17 Jun 2020 19:17:37 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=mime-version:references:in-reply-to:from:date:message-id:subject:to :cc; bh=XXiDnmEKkjnAg4XAgGA1O7XQ7jSyDRc+roLFDS/DyTI=; b=g37cxN5l65ggQgMwnIR+16AuS7rgw1NeWSRy5aGFLhh9TNCTO5fAKlZ1lsWrUbZyQf aSeXM2h37xKdFvJP35Kv0YgRBUAO8eTcBoKxRGFeTebp3jM1IdeYGZx8dJDPKbkPSVvA eE7GVnDIOLxuv32MvT6EzQU4IZJaf9crb3zZfIT871LnhnkZEdaDsYc1vlz0kJ4dDLRx rNOIEkOfSkV7GitLKU66raN8zPgHrBcixu8yCyWK9X5ocEI1ZXMwhu0LFyT/295uSyqv qDDgGGpwG+KxAx72imVebCpy34sCMh0MZ8CBky5ZYlO1kfnbocozPoUNkIwYsteSlVGJ JiCQ== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:references:in-reply-to:from:date :message-id:subject:to:cc; bh=XXiDnmEKkjnAg4XAgGA1O7XQ7jSyDRc+roLFDS/DyTI=; b=o18XPp6AAG50baEXqTS/lmLeP2nrrtTiy910p3rFyFrHLj4w/u2N+32s9m58Apd31r rSvBkGR6LfbM5GUn/mwqbZGXMammktaRdVbuUETG5IOHk8fpcX+gGgHPgPNWCNzAfHdo +vG85lx7azRlqLKo8h1bo+Q8/wR53e8xRihinvaYMlgBV8UNYK0OTkFm7QuFlaOxjOpc lvQ19nATSk3eWOEdEPBBXccRM9VZpsIua6co6GLtHqU762ElxmfbQq7CVMk3t03D4eDn n/LSqM1QMd25ux18T2o90OtTR3a3W9mxnQHxiEpuSjUNMgrq2Srv53OqhambLrKf6CQl nxmA== X-Gm-Message-State: AOAM530e2eVrmazkEVx9+JMDK2iHMZPDLdKOP8X8DLRQ8XFFzHG2ujXR teYNM1fRwkqrt0WVNDAlyjLmiW7pxmZBwZ80a8P4Eg== X-Google-Smtp-Source: ABdhPJwX7cQmGtvug7Y/V4/YSVKSUpTSS+487S8hXX/1e2ySfIDplUXArZO05CK9f+fy6WkWEyRWmfnLsaxaWE07W3w= X-Received: by 2002:adf:a514:: with SMTP id i20mr2089589wrb.112.1592446654114; Wed, 17 Jun 2020 19:17:34 -0700 (PDT) MIME-Version: 1.0 References: In-Reply-To: From: Rajesh Kumar Date: Thu, 18 Jun 2020 07:47:22 +0530 Message-ID: Subject: Re: Building modules gives error: "invalid output constraint '=@cce' in asm" To: Andriy Gapon Cc: freebsd-current@freebsd.org, freebsd-drivers@freebsd.org X-Rspamd-Queue-Id: 49nQZ93pN1z3f2c X-Spamd-Bar: ---- Authentication-Results: mx1.freebsd.org; none X-Spamd-Result: default: False [-4.00 / 15.00]; REPLY(-4.00)[]; ASN(0.00)[asn:15169, ipnet:2a00:1450::/32, country:US] Content-Type: text/plain; charset="UTF-8" X-Content-Filtered-By: Mailman/MimeDel 2.1.33 X-BeenThere: freebsd-current@freebsd.org X-Mailman-Version: 2.1.33 Precedence: list List-Id: Discussions about the use of FreeBSD-current List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 18 Jun 2020 02:17:38 -0000 HI Andriy Gapon, Thanks. It works. On Wed, Jun 17, 2020 at 11:53 AM Andriy Gapon wrote: > On 17/06/2020 04:53, Rajesh Kumar wrote: > > Then, I am trying to compile the driver modules and hit the > > compilation error. I haven't done "install world" as I don't want the > base > > 12.0 to be disturbed. > > You should do `make buildenv` and then do the module build in the subshell. > This way you will be using a compiler (toolchain, in general) form the > buildworld, not the currently installed compiler. > > -- > Andriy Gapon > From owner-freebsd-current@freebsd.org Thu Jun 18 03:31:09 2020 Return-Path: Delivered-To: freebsd-current@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 94723341DA2 for ; Thu, 18 Jun 2020 03:31:09 +0000 (UTC) (envelope-from freebsd-rwg@gndrsh.dnsmgr.net) Received: from gndrsh.dnsmgr.net (br1.CN84in.dnsmgr.net [69.59.192.140]) (using TLSv1 with cipher DHE-RSA-AES256-SHA (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 49nSC05Hl8z41Nw for ; Thu, 18 Jun 2020 03:31:08 +0000 (UTC) (envelope-from freebsd-rwg@gndrsh.dnsmgr.net) Received: from gndrsh.dnsmgr.net (localhost [127.0.0.1]) by gndrsh.dnsmgr.net (8.13.3/8.13.3) with ESMTP id 05I3UkpO088547; Wed, 17 Jun 2020 20:30:46 -0700 (PDT) (envelope-from freebsd-rwg@gndrsh.dnsmgr.net) Received: (from freebsd-rwg@localhost) by gndrsh.dnsmgr.net (8.13.3/8.13.3/Submit) id 05I3UjsE088546; Wed, 17 Jun 2020 20:30:45 -0700 (PDT) (envelope-from freebsd-rwg) From: "Rodney W. Grimes" Message-Id: <202006180330.05I3UjsE088546@gndrsh.dnsmgr.net> Subject: Re: CTF: UEFI HTTP boot support In-Reply-To: To: Maxim Sobolev Date: Wed, 17 Jun 2020 20:30:45 -0700 (PDT) CC: Miguel C , Dave Cottlehuber , freebsd-current , "Rodney W. Grimes" , Rebecca Cran , Warner Losh X-Mailer: ELM [version 2.4ME+ PL121h (25)] MIME-Version: 1.0 Content-Transfer-Encoding: 7bit Content-Type: text/plain; charset=US-ASCII X-Rspamd-Queue-Id: 49nSC05Hl8z41Nw X-Spamd-Bar: + Authentication-Results: mx1.freebsd.org; dkim=none; dmarc=none; spf=none (mx1.freebsd.org: domain of freebsd-rwg@gndrsh.dnsmgr.net has no SPF policy when checking 69.59.192.140) smtp.mailfrom=freebsd-rwg@gndrsh.dnsmgr.net X-Spamd-Result: default: False [1.34 / 15.00]; ARC_NA(0.00)[]; FREEMAIL_CC(0.00)[gmail.com,skunkwerks.at,freebsd.org,gndrsh.dnsmgr.net,bsdio.com,bsdimp.com]; FROM_HAS_DN(0.00)[]; NEURAL_SPAM_SHORT(0.31)[0.310]; MIME_GOOD(-0.10)[text/plain]; DMARC_NA(0.00)[dnsmgr.net]; AUTH_NA(1.00)[]; NEURAL_SPAM_MEDIUM(0.02)[0.025]; TO_MATCH_ENVRCPT_SOME(0.00)[]; TO_DN_ALL(0.00)[]; NEURAL_SPAM_LONG(0.10)[0.103]; RCPT_COUNT_SEVEN(0.00)[7]; R_SPF_NA(0.00)[no SPF record]; FROM_EQ_ENVFROM(0.00)[]; RCVD_TLS_LAST(0.00)[]; R_DKIM_NA(0.00)[]; RCVD_COUNT_TWO(0.00)[2]; MIME_TRACE(0.00)[0:+]; MID_RHS_MATCH_FROM(0.00)[]; ASN(0.00)[asn:13868, ipnet:69.59.192.0/19, country:US] X-BeenThere: freebsd-current@freebsd.org X-Mailman-Version: 2.1.33 Precedence: list List-Id: Discussions about the use of FreeBSD-current List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 18 Jun 2020 03:31:09 -0000 > This is what we have running in AWS right now, kinda proof of concept but > it's not that difficult to generalize: > > [root@ip-172-31-10-188 /usr/local/etc/freeswitch]# mdconfig -lv > md0 preload 160M - > > [root@ip-172-31-10-188 /usr/local/etc/freeswitch]# df > Filesystem 512-blocks Used Avail Capacity Mounted on > /dev/ufs/root_20200617071427 1300080 1220480 79600 94% / > devfs 2 2 0 100% /dev > /dev/ufs/etc_20200617071427 9912 6384 2736 70% /etc > /dev/ufs/local_20200617071427 2746992 2572144 174848 94% /usr/local > /dev/ufs/boot_20200617071427 389560 361208 28352 93% /boot > tmpfs 65536 624 64912 1% /tmp > tmpfs 20480 16 20464 0% > /usr/home/ssp-user > tmpfs 524288 336816 187472 64% /var > > Root file system is untrimmed 1.2GB UFS, generated with mkuzip compressed > down to 160MB with the UZIP, and pre-loaded along with the kernel. The > /usr/local file system is read-only UFS+UZIP images placed directly onto > the GPT and probed out with GEOM_LABEL. Out of those only /etc is > read-write. The idea here is that the box should theoretically survive > total loss of connectivity to both root and the /usr/local storage (or we > can replace it on the fly with the new version). > > [root@ip-172-31-10-188 /usr/local/etc/freeswitch]# mount > /dev/ufs/root_20200617071427 on / (ufs, local, read-only) > devfs on /dev (devfs, local, multilabel) > /dev/ufs/etc_20200617071427 on /etc (ufs, local, synchronous) > /dev/ufs/local_20200617071427 on /usr/local (ufs, local, read-only) > /dev/ufs/boot_20200617071427 on /boot (ufs, local, read-only) > tmpfs on /tmp (tmpfs, local) > tmpfs on /usr/home/ssp-user (tmpfs, local) > tmpfs on /var (tmpfs, local) > > Configuration is dead simple: > > vfs.root.mountfrom="ufs:ufs/root_20200617071427" > image_load="YES" > image_name="/root.uzp" > image_type="mfs_root" > autoboot_delay="-1" > > It takes less than 100 lines of code I think to generate this out of > buildworld/buildkernel. 0 third party tools. > > Replace loading root from disk with loading it from HTTP server and it > would work just as good with the only need to load 1 or two files. I think your understating several of the stumbling blocks that exist here. As Warner pointed out there are some pokey sticks around doing this over the net fs doing this from a local disk. > > There is only one catch there - with real UEFI hardware sometimes there is > small(ish) region followed by a hole and then the much bigger region. > Unfortunately our loader picks smaller region for its work area and > md_image loading mechanism is not good enough to either place it entirely > into a bigger segment, or do scatter-gather and split it out and make the > kernel do some VM trick to re-assemble later. But with some > post-installworld cleaning if you can compress down the full image to some > 30-40MB that usually works and has everything one may need including > kitchen sink (i.e. python 3.7 with few modules). As I said, no woodo magic > like famous crunchgen, just a very liberal application of the rm -rf. > > With regards to ro vs. rw, recipy is "don't do it" :) If you want hard RO > embedded into kernel - compress your image with mkuzip first and then embed > it into kernel. This what FreeBSD/MIPS guys have mastered a lot (platform > was very tight on flash), which is why geom_uzip is practically in every > MIPS kernel config file. But that works (or should work) just as well on > x64. Not only that would save lots of VM but also the RO proper attribute > will be provided by the geom_uzip for free. > > I am by the way hacking some way to populate /var with something more > interesting that just stock /etc/mtree/BSD.var.dist, there will be a review > request soon. :) You may want to look at /etc/rc.initdiskless, the /var and /etc population do have one existing solution. > > -Max > > On Wed, Jun 17, 2020 at 2:33 PM Miguel C wrote: > > > On Wed, Jun 17, 2020 at 9:28 PM Dave Cottlehuber > > wrote: > > > > > On Wed, 17 Jun 2020, at 17:52, Rodney W. Grimes wrote: > > > > > Rodney W. Grimes wrote: > > > > > > > The "fake cd drive" is in the kernel, loader just copies the iso > > > into > > > > > > > memory like any other module, and by the time that's done you > > just > > > > > > > reboot into the newly installed system, which again uses > > > > > > > > > > > > > > vfs.root.mountfrom="cd9660:/dev/md0.uzip" > > > > > > ^^^ > > > > > > > > > > > > Argh, the cd9660 confused me, I think your doing a > > > > > > "root on mfs/md"? > > > > > > > > > > loader.conf says > > > > > > > > > > rootfs_load="yes" > > > > > rootfs_name="contents.izo" > > > > > rootfs_type="md_image" > > > > > vfs.root.mountfrom="cd9660:/dev/md0.uzip" > > > > > > > > > > contents.izo is uzip'd contents.iso which file(1) > > > > > describes as ISO 9660 CD-ROM filesystem data '' > > > > > > > > > > That's for normal boot, for the loader 'install' command > > > > > it expects an uncompressed iso for rootfs. > > > > > > > > Ok, now the puzzle is how much work to get from a stock FreeBSD .iso > > > > image to something that works with this. Obviously we need a non-stock > > > > /boot/loader.conf file, or to type some commands manually at a loader > > > > prompt. I believe the stock GENERIC kernel has the md_root support > > > > for this already, so it may not be that hard to do. > > > > > > > > > Hi Miguel, all, > > > > > > I spent a bit of time on UEFI HTTP Boot earlier in the year in qemu, > > > bhyve, and intel NUCs -- until everything in the world went to custard. I > > > made some rough notes[1] and I'll go through them again tonight with a > > > fresh build. Hopefully its useful. > > > > > > What I got stuck on was the final pivot, I have never debugged this setup > > > before and I'm still not clear at what point things fail. Olivier's PXE > > > booting and BSDRP were a fantastic reference, and I assume they work in > > > BSDRP already for him. > > > > > > Worth noting that LE TLS certs didn't play well with the PXE UEFI > > > implementation on my intel NUC, this comes up as a very unhelpful error. > > At > > > least use plain HTTP to get started. > > > > > > While my notes are amd64 oriented I'm very interested in using this for > > > aarch64 locally & in the clowd. > > > > > > My loader.conf follows: > > > > > > boot_multicons="YES" > > > console="efi,comconsole" > > > comconsole_speed="115200" > > > boot_verbose="YES" > > > # make booting somewhat less painful > > > #entropy_cache_load="NO" > > > #kern.random.initial_seeding.bypass_before_seeding="0" > > > # entropy_cache_load="YES" > > > # boot_single="YES" > > > tmpfs_load="YES" > > > autoboot_delay="-1" > > > # dump net vars > > > # exec="show boot.netif.hwaddr" > > > # exec="show boot.netif.ip" > > > # exec="show boot.netif.netmask" > > > # exec="show boot.netif.gateway" > > > # ensure we have enough ram for our image > > > vm.kmem_size=2G > > > vfs.root.mountfrom="ufs:/dev/md0" > > > # vfs.root.mountfrom.options=ro > > > mfs_load="YES" > > > mfs_type="md_image" > > > mfs_name="/boot/mfs-miniroot" > > > > > > interesting these are different from what's above in the thread. > > > > > > > > Ah thanks a lot for this and for the references, especially the first one > > with all the notes :D > > > > references: > > > > > > [1]: https://hackmd.io/@dch/H1X9RYEZr > > > [mfsBSD]: https://mfsbsd.vx.sk/ still 150% awesome > > > [olivier]: > > > https://blog.cochard.me/2019/02/pxe-booting-of-freebsd-disk-image.html > > > [BSDRP]: https://github.com/ocochard/BSDRP > > > > > > A+ > > > Dave > > > > > _______________________________________________ > > freebsd-current@freebsd.org mailing list > > https://lists.freebsd.org/mailman/listinfo/freebsd-current > > To unsubscribe, send any mail to "freebsd-current-unsubscribe@freebsd.org" > > > > -- Rod Grimes rgrimes@freebsd.org From owner-freebsd-current@freebsd.org Thu Jun 18 03:41:05 2020 Return-Path: Delivered-To: freebsd-current@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 78E71341F56 for ; Thu, 18 Jun 2020 03:41:05 +0000 (UTC) (envelope-from wlosh@bsdimp.com) Received: from mail-qv1-xf2c.google.com (mail-qv1-xf2c.google.com [IPv6:2607:f8b0:4864:20::f2c]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "GTS CA 1O1" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 49nSQS2xVYz41dL for ; Thu, 18 Jun 2020 03:41:04 +0000 (UTC) (envelope-from wlosh@bsdimp.com) Received: by mail-qv1-xf2c.google.com with SMTP id di13so2121093qvb.12 for ; Wed, 17 Jun 2020 20:41:04 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=bsdimp-com.20150623.gappssmtp.com; s=20150623; h=mime-version:references:in-reply-to:from:date:message-id:subject:to :cc; bh=YOWxyY9ecbFBLt92Ri2OUh2dkVKotH91FpffvAjW1dY=; b=WIvYAgUD+com13jxYeBIZedu4JoHU1u3cZF7Q0AS9WMQi1t6kP2KY7KBLfXH3SiEJs SV02tjNsUEjUj8ulMOLnyx2jBsdnUDrZky5mgdhY+Le1g/ngDsHuOYnhXCaIsIWJGdYK SNpqATPLtKf96oUIgiMMQwUWw2oO+4y2TLy+NooPAVdOZRew2THB9HVzKITVrqKTdQ4/ x6dtPXWXRDik//d2tyVkey/HhMfAVAksx/gkmVtuajZQRHEwL1OdIQ6S9O2MYLbQw4oD IRk+0kpX2cEcyh1bWlWFSL4l+NmdeMnMoM1z/5WPpc/iN2umS53a4zFh2Xj4tEBafMr+ pq+w== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:references:in-reply-to:from:date :message-id:subject:to:cc; bh=YOWxyY9ecbFBLt92Ri2OUh2dkVKotH91FpffvAjW1dY=; b=dGVp9gKOCxodZSvSx1bGKHIGKrmGvLSWRTmPCL/mB3PnOuIIATBfboGs2LhAp2H7hV uO0rDtgprYOiWi5G1So4BqSOzLPNFCre5Jhdu+pxilqGKbqPwI/bYBLGhww7kHBmHgsy oy/HnYrp+osG5wrJMLUEQnN4536ZxJ72VF3NbDPRkh/5Jnx/QWbZn2RNDNEbkY24MvRx 0275iFv19HovXUW3v2xNcy9g4Fk3rpa4UO4OxBIXX/UMGltXfO3psJWL7iq2v3W/h5fP y95lm3CVQG1xsQLBapWD7jtctPsDN+QuYsgHZgmCScNbDQXQq6L8BxIFFDiDfupx/4WB GzMA== X-Gm-Message-State: AOAM531WiHqV9ZneFFa41dHJMif4pHQxi1BfR1p6nt2NSqlnCQRDlD1k toLBNOJc806Oy21tm19yP0Fh0q32elxwSzXzRYNO9pX29eQ= X-Google-Smtp-Source: ABdhPJwqUtKw54IWMOXqhBh4FKEEQ/fZLhkS34fYuXqzecyhmc6JVUH2t6Cw04NuSd+XZX7cESkh+w1OwE4uQqsJD1E= X-Received: by 2002:a0c:910c:: with SMTP id q12mr1814675qvq.22.1592451663254; Wed, 17 Jun 2020 20:41:03 -0700 (PDT) MIME-Version: 1.0 References: <202006180330.05I3UjsE088546@gndrsh.dnsmgr.net> In-Reply-To: <202006180330.05I3UjsE088546@gndrsh.dnsmgr.net> From: Warner Losh Date: Wed, 17 Jun 2020 21:40:52 -0600 Message-ID: Subject: Re: CTF: UEFI HTTP boot support To: "Rodney W. Grimes" Cc: Maxim Sobolev , Miguel C , Dave Cottlehuber , freebsd-current , Rebecca Cran X-Rspamd-Queue-Id: 49nSQS2xVYz41dL X-Spamd-Bar: - Authentication-Results: mx1.freebsd.org; dkim=pass header.d=bsdimp-com.20150623.gappssmtp.com header.s=20150623 header.b=WIvYAgUD; dmarc=none; spf=none (mx1.freebsd.org: domain of wlosh@bsdimp.com has no SPF policy when checking 2607:f8b0:4864:20::f2c) smtp.mailfrom=wlosh@bsdimp.com X-Spamd-Result: default: False [-1.82 / 15.00]; RCVD_TLS_ALL(0.00)[]; ARC_NA(0.00)[]; R_DKIM_ALLOW(-0.20)[bsdimp-com.20150623.gappssmtp.com:s=20150623]; NEURAL_HAM_MEDIUM(-0.80)[-0.799]; FROM_HAS_DN(0.00)[]; NEURAL_HAM_LONG(-0.98)[-0.976]; MIME_GOOD(-0.10)[multipart/alternative,text/plain]; PREVIOUSLY_DELIVERED(0.00)[freebsd-current@freebsd.org]; DMARC_NA(0.00)[bsdimp.com]; RCPT_COUNT_FIVE(0.00)[6]; TO_MATCH_ENVRCPT_SOME(0.00)[]; TO_DN_ALL(0.00)[]; DKIM_TRACE(0.00)[bsdimp-com.20150623.gappssmtp.com:+]; NEURAL_HAM_SHORT(-0.05)[-0.050]; RCVD_IN_DNSWL_NONE(0.00)[2607:f8b0:4864:20::f2c:from]; R_SPF_NA(0.00)[no SPF record]; FORGED_SENDER(0.30)[imp@bsdimp.com,wlosh@bsdimp.com]; MIME_TRACE(0.00)[0:+,1:+,2:~]; RCVD_COUNT_TWO(0.00)[2]; FREEMAIL_CC(0.00)[freebsd.org,gmail.com,skunkwerks.at,bsdio.com]; FROM_NEQ_ENVFROM(0.00)[imp@bsdimp.com,wlosh@bsdimp.com]; ASN(0.00)[asn:15169, ipnet:2607:f8b0::/32, country:US] Content-Type: text/plain; charset="UTF-8" X-Content-Filtered-By: Mailman/MimeDel 2.1.33 X-BeenThere: freebsd-current@freebsd.org X-Mailman-Version: 2.1.33 Precedence: list List-Id: Discussions about the use of FreeBSD-current List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 18 Jun 2020 03:41:05 -0000 On Wed, Jun 17, 2020 at 9:30 PM Rodney W. Grimes < freebsd-rwg@gndrsh.dnsmgr.net> wrote: > > This is what we have running in AWS right now, kinda proof of concept but > > it's not that difficult to generalize: > > > > [root@ip-172-31-10-188 /usr/local/etc/freeswitch]# mdconfig -lv > > md0 preload 160M - > > > > [root@ip-172-31-10-188 /usr/local/etc/freeswitch]# df > > Filesystem 512-blocks Used Avail Capacity > Mounted on > > /dev/ufs/root_20200617071427 1300080 1220480 79600 94% / > > devfs 2 2 0 100% /dev > > /dev/ufs/etc_20200617071427 9912 6384 2736 70% /etc > > /dev/ufs/local_20200617071427 2746992 2572144 174848 94% > /usr/local > > /dev/ufs/boot_20200617071427 389560 361208 28352 93% /boot > > tmpfs 65536 624 64912 1% /tmp > > tmpfs 20480 16 20464 0% > > /usr/home/ssp-user > > tmpfs 524288 336816 187472 64% /var > > > > Root file system is untrimmed 1.2GB UFS, generated with mkuzip compressed > > down to 160MB with the UZIP, and pre-loaded along with the kernel. The > > /usr/local file system is read-only UFS+UZIP images placed directly onto > > the GPT and probed out with GEOM_LABEL. Out of those only /etc is > > read-write. The idea here is that the box should theoretically survive > > total loss of connectivity to both root and the /usr/local storage (or we > > can replace it on the fly with the new version). > > > > [root@ip-172-31-10-188 /usr/local/etc/freeswitch]# mount > > /dev/ufs/root_20200617071427 on / (ufs, local, read-only) > > devfs on /dev (devfs, local, multilabel) > > /dev/ufs/etc_20200617071427 on /etc (ufs, local, synchronous) > > /dev/ufs/local_20200617071427 on /usr/local (ufs, local, read-only) > > /dev/ufs/boot_20200617071427 on /boot (ufs, local, read-only) > > tmpfs on /tmp (tmpfs, local) > > tmpfs on /usr/home/ssp-user (tmpfs, local) > > tmpfs on /var (tmpfs, local) > > > > Configuration is dead simple: > > > > vfs.root.mountfrom="ufs:ufs/root_20200617071427" > > image_load="YES" > > image_name="/root.uzp" > > image_type="mfs_root" > > autoboot_delay="-1" > > > > It takes less than 100 lines of code I think to generate this out of > > buildworld/buildkernel. 0 third party tools. > > > > Replace loading root from disk with loading it from HTTP server and it > > would work just as good with the only need to load 1 or two files. > > I think your understating several of the stumbling blocks > that exist here. As Warner pointed out there are some > pokey sticks around doing this over the net fs doing this > from a local disk. > BTW, I think this is an excellent area to move from kernel compile options to kernel env vars that maybe default to the kernel build options for compat. And, of course, the sharp bits would be less surprising if well documented... Warner From owner-freebsd-current@freebsd.org Thu Jun 18 07:19:16 2020 Return-Path: Delivered-To: freebsd-current@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 3E282346CAD for ; Thu, 18 Jun 2020 07:19:16 +0000 (UTC) (envelope-from agapon@gmail.com) Received: from mailman.nyi.freebsd.org (mailman.nyi.freebsd.org [IPv6:2610:1c1:1:606c::50:13]) by mx1.freebsd.org (Postfix) with ESMTP id 49nYGC6wL3z4DT5 for ; Thu, 18 Jun 2020 07:19:15 +0000 (UTC) (envelope-from agapon@gmail.com) Received: by mailman.nyi.freebsd.org (Postfix) id ED6AE346CAC; Thu, 18 Jun 2020 07:19:15 +0000 (UTC) Delivered-To: current@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id ED31D346C58 for ; Thu, 18 Jun 2020 07:19:15 +0000 (UTC) (envelope-from agapon@gmail.com) Received: from mail-lj1-f177.google.com (mail-lj1-f177.google.com [209.85.208.177]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "GTS CA 1O1" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 49nYGB6rB8z4DNR for ; Thu, 18 Jun 2020 07:19:14 +0000 (UTC) (envelope-from agapon@gmail.com) Received: by mail-lj1-f177.google.com with SMTP id s1so6003751ljo.0 for ; Thu, 18 Jun 2020 00:19:14 -0700 (PDT) X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:to:from:subject:openpgp:autocrypt:message-id :date:user-agent:mime-version:content-language :content-transfer-encoding; bh=4AIouJvrJKVKevyL+h0iZDs1g76Ehay/Y3K8C3AoyBw=; b=Ec72a5eWNZ51X0hree9Cgyuf0eSl3ahsl8gDyfEMUmyqH9K8MLiK4pl4VL/DhpzklD F9aexM4o2m7ixcai+jINJb45PSVaF8iAfPrJe8NoQ995P4O1+CcqCOVAJpdQOU8IVzDQ 1XxqRBnDzTz/Sykj28yM0hURS6sdIXt8fzwvKDnUqLaLMZmQqH+KthOh+LXqqeGgVKjJ SQOPCzUUiePA0rWdmMRq1SdR2m5RFUGt4jikQWxuYn5asJOVKGyr/yeT+2PVhu+M3X9w PL6Z/08I/OJaaD2+wz9ELVN6Ij2Gn3QDPTmHBHUAxo6yr6TY1qMTeYvqYsw0gCjB4uGy OTZQ== X-Gm-Message-State: AOAM533up93ZYCFtzq1kNoUgGV3+krQDqOde93+Rt6TLENirCgTHga6m Ptb3QjmrGQJxjGWCeUd3k70Ya5kkX7A= X-Google-Smtp-Source: ABdhPJzUbWqwa0LUq371oLe3jFIiznAej2Gxd945413Iako1Owbv3AXnVVSozgZ/cmg7XPq4TfQKpQ== X-Received: by 2002:a2e:83c7:: with SMTP id s7mr1663384ljh.68.1592464752639; Thu, 18 Jun 2020 00:19:12 -0700 (PDT) Received: from [192.168.0.88] (east.meadow.volia.net. [93.72.151.96]) by smtp.googlemail.com with ESMTPSA id s8sm447733ljh.101.2020.06.18.00.19.11 for (version=TLS1_3 cipher=TLS_AES_128_GCM_SHA256 bits=128/128); Thu, 18 Jun 2020 00:19:11 -0700 (PDT) To: FreeBSD Current From: Andriy Gapon Subject: [HEADSUP] snd/hda interrupt handling change Openpgp: preference=signencrypt Autocrypt: addr=avg@FreeBSD.org; prefer-encrypt=mutual; keydata= mQINBFm4LIgBEADNB/3lT7f15UKeQ52xCFQx/GqHkSxEdVyLFZTmY3KyNPQGBtyvVyBfprJ7 mAeXZWfhat6cKNRAGZcL5EmewdQuUfQfBdYmKjbw3a9GFDsDNuhDA2QwFt8BmkiVMRYyvI7l N0eVzszWCUgdc3qqM6qqcgBaqsVmJluwpvwp4ZBXmch5BgDDDb1MPO8AZ2QZfIQmplkj8Y6Z AiNMknkmgaekIINSJX8IzRzKD5WwMsin70psE8dpL/iBsA2cpJGzWMObVTtCxeDKlBCNqM1i gTXta1ukdUT7JgLEFZk9ceYQQMJJtUwzWu1UHfZn0Fs29HTqawfWPSZVbulbrnu5q55R4PlQ /xURkWQUTyDpqUvb4JK371zhepXiXDwrrpnyyZABm3SFLkk2bHlheeKU6Yql4pcmSVym1AS4 dV8y0oHAfdlSCF6tpOPf2+K9nW1CFA8b/tw4oJBTtfZ1kxXOMdyZU5fiG7xb1qDgpQKgHUX8 7Rd2T1UVLVeuhYlXNw2F+a2ucY+cMoqz3LtpksUiBppJhw099gEXehcN2JbUZ2TueJdt1FdS ztnZmsHUXLxrRBtGwqnFL7GSd6snpGIKuuL305iaOGODbb9c7ne1JqBbkw1wh8ci6vvwGlzx rexzimRaBzJxlkjNfMx8WpCvYebGMydNoeEtkWldtjTNVsUAtQARAQABtB5BbmRyaXkgR2Fw b24gPGF2Z0BGcmVlQlNELm9yZz6JAlQEEwEIAD4WIQS+LEO7ngQnXA4Bjr538m7TUc1yjwUC WbgsiAIbIwUJBaOagAULCQgHAgYVCAkKCwIEFgIDAQIeAQIXgAAKCRB38m7TUc1yj+JAEACV l9AK/nOWAt/9cufV2fRj0hdOqB1aCshtSrwHk/exXsDa4/FkmegxXQGY+3GWX3deIyesbVRL rYdtdK0dqJyT1SBqXK1h3/at9rxr9GQA6KWOxTjUFURsU7ok/6SIlm8uLRPNKO+yq0GDjgaO LzN+xykuBA0FlhQAXJnpZLcVfPJdWv7sSHGedL5ln8P8rxR+XnmsA5TUaaPcbhTB+mG+iKFj GghASDSfGqLWFPBlX/fpXikBDZ1gvOr8nyMY9nXhgfXpq3B6QCRYKPy58ChrZ5weeJZ29b7/ QdEO8NFNWHjSD9meiLdWQaqo9Y7uUxN3wySc/YUZxtS0bhAd8zJdNPsJYG8sXgKjeBQMVGuT eCAJFEYJqbwWvIXMfVWop4+O4xB+z2YE3jAbG/9tB/GSnQdVSj3G8MS80iLS58frnt+RSEw/ psahrfh0dh6SFHttE049xYiC+cM8J27Aaf0i9RflyITq57NuJm+AHJoU9SQUkIF0nc6lfA+o JRiyRlHZHKoRQkIg4aiKaZSWjQYRl5Txl0IZUP1dSWMX4s3XTMurC/pnja45dge/4ESOtJ9R 8XuIWg45Oq6MeIWdjKddGhRj3OohsltKgkEU3eLKYtB6qRTQypHHUawCXz88uYt5e3w4V16H lCpSTZV/EVHnNe45FVBlvK7k7HFfDDkryLkCDQRZuCyIARAAlq0slcsVboY/+IUJdcbEiJRW be9HKVz4SUchq0z9MZPX/0dcnvz/gkyYA+OuM78dNS7Mbby5dTvOqfpLJfCuhaNYOhlE0wY+ 1T6Tf1f4c/uA3U/YiadukQ3+6TJuYGAdRZD5EqYFIkreARTVWg87N9g0fT9BEqLw9lJtEGDY EWUE7L++B8o4uu3LQFEYxcrb4K/WKmgtmFcm77s0IKDrfcX4doV92QTIpLiRxcOmCC/OCYuO jB1oaaqXQzZrCutXRK0L5XN1Y1PYjIrEzHMIXmCDlLYnpFkK+itlXwlE2ZQxkfMruCWdQXye syl2fynAe8hvp7Mms9qU2r2K9EcJiR5N1t1C2/kTKNUhcRv7Yd/vwusK7BqJbhlng5ZgRx0m WxdntU/JLEntz3QBsBsWM9Y9wf2V4tLv6/DuDBta781RsCB/UrU2zNuOEkSixlUiHxw1dccI 6CVlaWkkJBxmHX22GdDFrcjvwMNIbbyfQLuBq6IOh8nvu9vuItup7qemDG3Ms6TVwA7BD3j+ 3fGprtyW8Fd/RR2bW2+LWkMrqHffAr6Y6V3h5kd2G9Q8ZWpEJk+LG6Mk3fhZhmCnHhDu6CwN MeUvxXDVO+fqc3JjFm5OxhmfVeJKrbCEUJyM8ESWLoNHLqjywdZga4Q7P12g8DUQ1mRxYg/L HgZY3zfKOqcAEQEAAYkCPAQYAQgAJhYhBL4sQ7ueBCdcDgGOvnfybtNRzXKPBQJZuCyIAhsM BQkFo5qAAAoJEHfybtNRzXKPBVwQAKfFy9P7N3OsLDMB56A4Kf+ZT+d5cIx0Yiaf4n6w7m3i ImHHHk9FIetI4Xe54a2IXh4Bq5UkAGY0667eIs+Z1Ea6I2i27Sdo7DxGwq09Qnm/Y65ADvXs 3aBvokCcm7FsM1wky395m8xUos1681oV5oxgqeRI8/76qy0hD9WR65UW+HQgZRIcIjSel9vR XDaD2HLGPTTGr7u4v00UeTMs6qvPsa2PJagogrKY8RXdFtXvweQFz78NbXhluwix2Tb9ETPk LIpDrtzV73CaE2aqBG/KrboXT2C67BgFtnk7T7Y7iKq4/XvEdDWscz2wws91BOXuMMd4c/c4 OmGW9m3RBLufFrOag1q5yUS9QbFfyqL6dftJP3Zq/xe+mr7sbWbhPVCQFrH3r26mpmy841ym dwQnNcsbIGiBASBSKksOvIDYKa2Wy8htPmWFTEOPRpFXdGQ27awcjjnB42nngyCK5ukZDHi6 w0qK5DNQQCkiweevCIC6wc3p67jl1EMFY5+z+zdTPb3h7LeVnGqW0qBQl99vVFgzLxchKcl0 R/paSFgwqXCZhAKMuUHncJuynDOP7z5LirUeFI8qsBAJi1rXpQoLJTVcW72swZ42IdPiboqx NbTMiNOiE36GqMcTPfKylCbF45JNX4nF9ElM0E+Y8gi4cizJYBRr2FBJgay0b9Cp Message-ID: Date: Thu, 18 Jun 2020 10:19:10 +0300 User-Agent: Mozilla/5.0 (X11; FreeBSD amd64; rv:60.0) Gecko/20100101 Firefox/60.0 Thunderbird/60.9.0 MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Language: en-US Content-Transfer-Encoding: 7bit X-Rspamd-Queue-Id: 49nYGB6rB8z4DNR X-Spamd-Bar: / Authentication-Results: mx1.freebsd.org; dkim=none; dmarc=none; spf=pass (mx1.freebsd.org: domain of agapon@gmail.com designates 209.85.208.177 as permitted sender) smtp.mailfrom=agapon@gmail.com X-Spamd-Result: default: False [0.30 / 15.00]; RCVD_VIA_SMTP_AUTH(0.00)[]; R_SPF_ALLOW(-0.20)[+ip4:209.85.128.0/17]; RCVD_COUNT_THREE(0.00)[3]; TO_DN_ALL(0.00)[]; FORGED_SENDER(0.30)[avg@FreeBSD.org,agapon@gmail.com]; RECEIVED_SPAMHAUS_PBL(0.00)[93.72.151.96:received]; MIME_TRACE(0.00)[0:+]; R_DKIM_NA(0.00)[]; FREEMAIL_ENVFROM(0.00)[gmail.com]; MID_RHS_MATCH_FROM(0.00)[]; FROM_NEQ_ENVFROM(0.00)[avg@FreeBSD.org,agapon@gmail.com]; ASN(0.00)[asn:15169, ipnet:209.85.128.0/17, country:US]; NEURAL_HAM_MEDIUM(-0.00)[-0.005]; ARC_NA(0.00)[]; TO_DOM_EQ_FROM_DOM(0.00)[]; FROM_HAS_DN(0.00)[]; TO_MATCH_ENVRCPT_ALL(0.00)[]; NEURAL_HAM_LONG(-0.53)[-0.530]; MIME_GOOD(-0.10)[text/plain]; PREVIOUSLY_DELIVERED(0.00)[current@freebsd.org]; DMARC_NA(0.00)[FreeBSD.org]; RCPT_COUNT_ONE(0.00)[1]; NEURAL_SPAM_SHORT(0.84)[0.839]; RCVD_IN_DNSWL_NONE(0.00)[209.85.208.177:from]; RWL_MAILSPIKE_POSSIBLE(0.00)[209.85.208.177:from]; RCVD_TLS_ALL(0.00)[] X-BeenThere: freebsd-current@freebsd.org X-Mailman-Version: 2.1.33 Precedence: list List-Id: Discussions about the use of FreeBSD-current List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 18 Jun 2020 07:19:16 -0000 If you get any problems with HDA sound driver, please be aware of r362294. Please let me know about any problems that appear to be related to that commit. It would be helpful to test if reverting the commit helps. Thanks. -- Andriy Gapon From owner-freebsd-current@freebsd.org Thu Jun 18 20:26:21 2020 Return-Path: Delivered-To: freebsd-current@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id D9211332CC4 for ; Thu, 18 Jun 2020 20:26:21 +0000 (UTC) (envelope-from yasu@utahime.org) Received: from gate.utahime.jp (gate.utahime.jp [183.180.29.210]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 49ntkN66nbz41rS for ; Thu, 18 Jun 2020 20:26:20 +0000 (UTC) (envelope-from yasu@utahime.org) Received: from eastasia.home.utahime.org (eastasia.home.utahime.org [192.168.174.1]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (No client certificate requested) by gate.utahime.jp (Postfix) with ESMTPS id 24BC1109F5 for ; Fri, 19 Jun 2020 05:26:16 +0900 (JST) DKIM-Signature: v=1; a=rsa-sha256; c=simple/simple; d=utahime.org; s=maybe2019112701; t=1592511976; bh=3QMQOtYbihwgtfY9nIEwlXSQCl3lD7qk740HmWkorQs=; h=Date:To:Subject:From; b=R1kx3lufKWECGZO9tk5iPomYPAvdDeuDZk7SRlpIAqC71uMYzhJw0KZzP8Sd4Me21 UGnlY6SiWUrJ2oe0U6yeC0M/DEOZzQyS5EwkwAIHydhN1fZlAGh97QzxdnW9rfDnNC 4EKHEx5d53LqHNoCQNSt2oFH8rRnNHf61K9crQdkwrX2uFjPHABMlhv7PrnrxkM1G5 vNlfmNYK0k9bypFYJxFAodogbBakmnOMzCHIBwzexQkFLYv0Vs7DBeBm16UrtScT9V OUgeOLC7ZrMYeDYw5m9lyb+NibGMqXBwmiAu8KLrItMG40UPKF7zDlMtJTRBYjLljk ZT5j150a7E84w== Received: from localhost (rolling.home.utahime.org [192.168.174.11]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange ECDHE (P-256) server-signature RSA-PSS (4096 bits) server-digest SHA256) (No client certificate requested) by eastasia.home.utahime.org (Postfix) with ESMTPSA id 3304858446; Fri, 19 Jun 2020 05:26:15 +0900 (JST) X-Virus-Status: Clean X-Virus-Scanned: clamav-milter 0.102.3 at eastasia.home.utahime.org Date: Fri, 19 Jun 2020 05:23:48 +0900 (JST) Message-Id: <20200619.052348.232031363704679601.yasu@utahime.org> To: freebsd-current@freebsd.org Subject: `shutdown -p now` fails to power off with VirtualBox UEFI boot From: Yasuhiro KIMURA X-Mailer: Mew version 6.8 on Emacs 26.3 Mime-Version: 1.0 Content-Type: Text/Plain; charset=us-ascii Content-Transfer-Encoding: 7bit X-Rspamd-Queue-Id: 49ntkN66nbz41rS X-Spamd-Bar: / Authentication-Results: mx1.freebsd.org; dkim=pass header.d=utahime.org header.s=maybe2019112701 header.b=R1kx3luf; dmarc=none; spf=pass (mx1.freebsd.org: domain of yasu@utahime.org designates 183.180.29.210 as permitted sender) smtp.mailfrom=yasu@utahime.org X-Spamd-Result: default: False [-0.76 / 15.00]; RCVD_VIA_SMTP_AUTH(0.00)[]; ARC_NA(0.00)[]; R_DKIM_ALLOW(-0.20)[utahime.org:s=maybe2019112701]; NEURAL_HAM_MEDIUM(-0.97)[-0.967]; FROM_HAS_DN(0.00)[]; MV_CASE(0.50)[]; TO_MATCH_ENVRCPT_ALL(0.00)[]; MIME_GOOD(-0.10)[text/plain]; PREVIOUSLY_DELIVERED(0.00)[freebsd-current@freebsd.org]; TO_DN_NONE(0.00)[]; RCPT_COUNT_ONE(0.00)[1]; NEURAL_HAM_LONG(-1.00)[-0.998]; RCVD_COUNT_THREE(0.00)[3]; DMARC_NA(0.00)[utahime.org]; R_SPF_ALLOW(-0.20)[+a:spf-authorized.utahime.org]; DKIM_TRACE(0.00)[utahime.org:+]; MID_CONTAINS_FROM(1.00)[]; NEURAL_SPAM_SHORT(0.20)[0.204]; FROM_EQ_ENVFROM(0.00)[]; MIME_TRACE(0.00)[0:+]; ASN(0.00)[asn:2519, ipnet:183.180.0.0/16, country:JP]; RCVD_TLS_ALL(0.00)[] X-BeenThere: freebsd-current@freebsd.org X-Mailman-Version: 2.1.33 Precedence: list List-Id: Discussions about the use of FreeBSD-current List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 18 Jun 2020 20:26:21 -0000 I have VirtualBox VM running 13-CURRENT. In order to switch from legacy BIOS to UEFI I reinstalled OS by using FreeBSD-13.0-CURRENT-amd64-20200611-r362037-disc1.iso. After that `shutdow -p now` (or select 'ACPI shutdown' in VM menu) fails to power off. Shutdown itself completes successfully. But power off never happens and CPU usage keeps high until either closing or resetting VM. I reinstalled OS by using FreeBSD-13.0-CURRENT-amd64-20200618-r362292-disc1.iso but the problem still happens. If I switch back to legacy BIOS then the problem disappears. And it doesn't happen with either 11.4-RELEASE and 12.1-RELEASE. --- Yasuhiro KIMURA From owner-freebsd-current@freebsd.org Fri Jun 19 03:42:41 2020 Return-Path: Delivered-To: freebsd-current@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 7B2BA33D15C for ; Fri, 19 Jun 2020 03:42:41 +0000 (UTC) (envelope-from rmacklem@uoguelph.ca) Received: from CAN01-QB1-obe.outbound.protection.outlook.com (mail-eopbgr660068.outbound.protection.outlook.com [40.107.66.68]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client CN "mail.protection.outlook.com", Issuer "GlobalSign Organization Validation CA - SHA256 - G3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 49p4Pq6D9xz4SGh; Fri, 19 Jun 2020 03:42:39 +0000 (UTC) (envelope-from rmacklem@uoguelph.ca) ARC-Seal: i=1; a=rsa-sha256; s=arcselector9901; d=microsoft.com; cv=none; b=MS9areNl4o/tHbT+a4qUFCaiw7qp3O6WVGk2tu0uPh3dEDnA331IEt+gPyydGR4hjjFmAMYzBrR/xtaW4Z3UOMqfFB3yrMEBkkHizLUBdIH9grtXjZ5h5g98MpuUX3I96VIev8VkriwljFL7V5RL0zjQYeaQ9N87XNxqtvLFsEm7CFqeJM2+ZqEC6LiCx7uRxDfv9K1ksdHfQGMMKi0KNWsWzJJRdUywFmLWdt+UEx+iu2EEEfJzmwthn0BZea4JqrMigc6tN2+VA1cqxYLK8kGjyiaHKaiAFFE8ZyKgs3EhXLgj4Xo0W+cNlMK2C7A2GYkocHg7dpQTJCBh7T5tjQ== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=microsoft.com; s=arcselector9901; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=qRV7gxaHsZBxIt7B9V60I79HzSX6eGq52HAu1lphQAw=; b=g8m7KSK1TWna1rF8dlPY9BsjjvJe+8qSqePymfcOP8TxuqGFe0as8HwbXCvFugqkfEXNy24ghAwQEFeOl/iOV26joom5pmTrnEtyrT/ss5DyxDBUYk3Q3DoVeSyVYT6AurwHYC9dBV60zBy2Ax43sY4/cRpAT0lJ4fHAx1xg1h/3uZbjxueGVMRd0XU7pQfeHAj/l8eNcyyvNKTQZiYOSYKRMD9JEpIjZE7cPweAJkUa8J3Fr/s7w+YmHuY10RY2D3FgQmyIlpnp2R2Qti6BH7QyVDliF7jq5zI+sFLMWlhat9vPdA36RFGj+gU40oxebaO6Whk0A/wUshwseEjvEw== ARC-Authentication-Results: i=1; mx.microsoft.com 1; spf=pass smtp.mailfrom=uoguelph.ca; dmarc=pass action=none header.from=uoguelph.ca; dkim=pass header.d=uoguelph.ca; arc=none DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=uoguelph.ca; s=selector1; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=qRV7gxaHsZBxIt7B9V60I79HzSX6eGq52HAu1lphQAw=; b=H42XS1uCyJ4EafctTYwvv0E9tAmYXTEuz7TZZUst/4lX1oyw+9qU2w3yDj1HPoRI0WoVfWfcOwJQ4aAovv5MCnvuMzkatJirBPXqsR37n6nZT55xG1v6gTwlkCfz1YX3d+ByER0B7w6e97e4fZGT+6nb90S5p1ByokXDLoHsaHtW+xINMnNRnv/2duA47IyKxin24UPZ82/8AE20vsQTDmgZlDwIxTtmVwb+/sfMX2jTnWJSy0ebDXd5EzP473XQb/vcSMkG1U8eXA7Aqj8IFR0uUWc/defpttAP6ZpPKTjr4Vu821EMbcgP0O03A4itgxNRxQWS6pYo2pUUHPYcTQ== Received: from QB1PR01MB3364.CANPRD01.PROD.OUTLOOK.COM (2603:10b6:c00:38::14) by QB1PR01MB2354.CANPRD01.PROD.OUTLOOK.COM (2603:10b6:c00:33::11) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.3109.23; Fri, 19 Jun 2020 03:42:37 +0000 Received: from QB1PR01MB3364.CANPRD01.PROD.OUTLOOK.COM ([fe80::60f3:4ca2:8a4a:1e91]) by QB1PR01MB3364.CANPRD01.PROD.OUTLOOK.COM ([fe80::60f3:4ca2:8a4a:1e91%7]) with mapi id 15.20.3109.021; Fri, 19 Jun 2020 03:42:37 +0000 From: Rick Macklem To: Ryan Libby CC: Konstantin Belousov , Jeff Roberson , "freebsd-current@freebsd.org" Subject: Re: r358252 causes intermittent hangs where processes are stuck sleeping on btalloc Thread-Topic: r358252 causes intermittent hangs where processes are stuck sleeping on btalloc Thread-Index: AQHWReusQxRwbcmYh0+wsR7fidfwjw== Date: Fri, 19 Jun 2020 03:42:36 +0000 Message-ID: References: In-Reply-To: Accept-Language: en-US Content-Language: en-US X-MS-Has-Attach: yes X-MS-TNEF-Correlator: x-ms-publictraffictype: Email x-ms-office365-filtering-correlation-id: 7f1c8690-75eb-480d-37b8-08d81402cf1f x-ms-traffictypediagnostic: QB1PR01MB2354: x-microsoft-antispam-prvs: x-ms-oob-tlc-oobclassifiers: OLM:6430; x-forefront-prvs: 0439571D1D x-ms-exchange-senderadcheck: 1 x-microsoft-antispam: BCL:0; x-microsoft-antispam-message-info: 4I1tlzBCBQ6v/k7koDnQk8t7h3SlmHcGd1cPsehGyimmLzKTGMALq6eAaMM3wjxvzBzIN9tDDuWJ7EzzZbAMfIPyh0xhBe69hzVyx0ZDqUuiR9FCn+ONEK3UxyLVYyUtOh9Jq+suTrlswkr6A7uNAMbdyC/4lXDeA7zfaY14HaLhT/ET+2nyaqqrOOPbq8+RWYLdK0msuKyaUIOU7S9S0YYOutsiiJ2erpKfNyX05FXKjabrRZ5tVg84wD8HHVWMuEx2KRWxbSKMm5B6CWeRVdyglKiPW7ozODAxx/YTTqp9PLUQIl0X3NztEHCvTxClhAUbEt1QYOwknoUVXQugvdVfOkZhDGqj3Nkadsld1cIwHlPYGpAktX5sxMijjUQvoB+CdI5vSpcOE23Qpke7YIk1/YisAoNaIuk2NoEO+v6y3fFAzlYk+8Qp/3gtckm6sPxcOpXUMTKLBjO9wfpO5A== x-forefront-antispam-report: CIP:255.255.255.255; CTRY:; LANG:en; SCL:1; SRV:; IPV:NLI; SFV:NSPM; H:QB1PR01MB3364.CANPRD01.PROD.OUTLOOK.COM; PTR:; CAT:NONE; SFTY:; SFS:(376002)(366004)(346002)(39860400002)(396003)(136003)(6916009)(6506007)(53546011)(55016002)(33656002)(71200400001)(2906002)(186003)(66616009)(76116006)(66946007)(66556008)(66476007)(64756008)(8676002)(99936003)(9686003)(66446008)(86362001)(8936002)(4326008)(966005)(30864003)(7696005)(478600001)(52536014)(54906003)(5660300002)(316002)(2940100002)(786003)(450100002)(83380400001)(299355004); DIR:OUT; SFP:1101; x-ms-exchange-antispam-messagedata: kv/BiZraRYeYjN21iBSD/dtT4joPa2tdSMPNVUqOF9X7hVCNirhwUkt1ZeoGYniemPWvM+PW+wEV+DEcjWjT3S6jtmD0kkxbgUfgNRK6jYzeY/okhX6rht0x0AK4W2tl77lnPumjPvAAnpFCvUmWIpmrC1E9KwPRv2ZLW1KKNuqv/LMKE9k6X86lnZYU3ye0c8qDgTWoGO00MESWTSuKYpJJQMrGNUL9EJzLtbbM4VDTroibOJ71JiOOckXSprGJbWzqduvddpkQlfBdhy3SloFDBRk3XqNnlx71LHdPU3gxkgnNWHq9zREk4bxqyY0cq4d07FFus+YaZOYo6PGDPDmtRauK/OMoeqlybZ77n84PxPxDRGcsckeTRqP/Ct7MxQPmacXW48wqL2Jl22ZWIuv2no0Ljpx72i2FQCwk/Ss0+4Haa1wkyO5Akp2MBQoYXIpW9e+TJn9BiEr77wrdpS9G0nOhat7JSnOR8zJ5E3YZAp9FUK1km3FVCfrypobSFCwaLMNOyzs4sCsSK8RqkNQ3Ro5K1E5Gu1Rj6toE5MiZ+R8CNjDLoWD+0+wief0E x-ms-exchange-transport-forked: True Content-Type: multipart/mixed; boundary="_002_QB1PR01MB33649F146649F6C8BA0788B5DD980QB1PR01MB3364CANP_" MIME-Version: 1.0 X-OriginatorOrg: uoguelph.ca X-MS-Exchange-CrossTenant-Network-Message-Id: 7f1c8690-75eb-480d-37b8-08d81402cf1f X-MS-Exchange-CrossTenant-originalarrivaltime: 19 Jun 2020 03:42:36.9655 (UTC) X-MS-Exchange-CrossTenant-fromentityheader: Hosted X-MS-Exchange-CrossTenant-id: be62a12b-2cad-49a1-a5fa-85f4f3156a7d X-MS-Exchange-CrossTenant-mailboxtype: HOSTED X-MS-Exchange-CrossTenant-userprincipalname: hA/u3DVDspUtnPUOO8JccaCNoqB5RJ1BBJtxscRm16E4wnk9NHb4nVcx/MPY4AtZKmb9cuAf9i2cYdyIu7Xwaw== X-MS-Exchange-Transport-CrossTenantHeadersStamped: QB1PR01MB2354 X-Rspamd-Queue-Id: 49p4Pq6D9xz4SGh X-Spamd-Bar: ----- Authentication-Results: mx1.freebsd.org; dkim=pass header.d=uoguelph.ca header.s=selector1 header.b=H42XS1uC; dmarc=none; spf=pass (mx1.freebsd.org: domain of rmacklem@uoguelph.ca designates 40.107.66.68 as permitted sender) smtp.mailfrom=rmacklem@uoguelph.ca X-Spamd-Result: default: False [-5.68 / 15.00]; TO_DN_EQ_ADDR_SOME(0.00)[]; NEURAL_HAM_MEDIUM(-1.03)[-1.027]; R_DKIM_ALLOW(-0.20)[uoguelph.ca:s=selector1]; FROM_HAS_DN(0.00)[]; RCPT_COUNT_THREE(0.00)[4]; TO_DN_SOME(0.00)[]; TO_MATCH_ENVRCPT_ALL(0.00)[]; MIME_GOOD(-0.10)[multipart/mixed,text/plain]; HAS_ATTACHMENT(0.00)[]; DMARC_NA(0.00)[uoguelph.ca]; R_SPF_ALLOW(-0.20)[+ip4:40.107.0.0/16]; DWL_DNSWL_LOW(-1.00)[uoguelph.ca:dkim]; RCVD_COUNT_THREE(0.00)[3]; DKIM_TRACE(0.00)[uoguelph.ca:+]; NEURAL_HAM_SHORT(-1.15)[-1.145]; RCVD_IN_DNSWL_NONE(0.00)[40.107.66.68:from]; NEURAL_HAM_LONG(-1.01)[-1.011]; FROM_EQ_ENVFROM(0.00)[]; MIME_TRACE(0.00)[0:+,1:+,2:~]; RCVD_TLS_LAST(0.00)[]; ASN(0.00)[asn:8075, ipnet:40.104.0.0/14, country:US]; ARC_ALLOW(-1.00)[microsoft.com:s=arcselector9901:i=1]; RWL_MAILSPIKE_POSSIBLE(0.00)[40.107.66.68:from] X-BeenThere: freebsd-current@freebsd.org X-Mailman-Version: 2.1.33 Precedence: list List-Id: Discussions about the use of FreeBSD-current List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 19 Jun 2020 03:42:41 -0000 --_002_QB1PR01MB33649F146649F6C8BA0788B5DD980QB1PR01MB3364CANP_ Content-Type: text/plain; charset="iso-8859-1" Content-Transfer-Encoding: quoted-printable Ryan Libby wrote:=0A= >On Mon, Jun 15, 2020 at 5:06 PM Rick Macklem wrote:= =0A= >>=0A= >> Rick Macklem wrote:=0A= >> >r358098 will hang fairly easily, in 1-3 cycles of the kernel build over= =3D=0A= NFS.=0A= >> >I thought this was the culprit, since I did 6 cycles of r358097 without= =3D=0A= a hang.=0A= >> >However, I just got a hang with r358097, but it looks rather different.= =0A= >> >The r358097 hang did not have any processes sleeping on btalloc. They= =0A= >> >appeared to be waiting on two different locks in the buffer cache.=0A= >> >As such, I think it might be a different problem. (I'll admit I should = h=3D=0A= ave=0A= >> >made notes about this one before rebooting, but I was flustrated that= =0A= >> >it happened and rebooted before looking at it mush detail.)=0A= >> Ok, so I did 10 cycles of the kernel build over NFS for r358096 and neve= r=0A= >> got a hang.=0A= >> --> It seems that r358097 is the culprit and r358098 makes it easier=0A= >> to reproduce.=0A= >> --> Basically runs out of kernel memory.=0A= >>=0A= >> It is not obvious if I can revert these two commits without reverting=0A= >> other ones, since there were a bunch of vm changes after these.=0A= >>=0A= >> I'll take a look, but if you guys have any ideas on how to fix this, ple= a=3D=0A= se=0A= >> let me know.=0A= >>=0A= >> Thanks, rick=0A= >=0A= >Interesting. Could you try re-adding UMA_ZONE_NOFREE to the vmem btag=0A= >zone to see if that rescues it, on whatever base revision gets you a=0A= >reliable repro?=0A= Good catch! That seems to fix it. I've done 8 cycles of kernel build over= =0A= NFS without a hang (normally I'd get one in the first 1-3 cycles).=0A= =0A= I don't know if the intend was to delete UMA_ZONE_VM and r358097=0A= had a typo in it and deleted UMA_ZONE_NOFREE or ???=0A= =0A= Anyhow, I just put it back to UMA_ZONE_VM | UMA_ZONE_NOFREE and=0A= the hangs seem to have gone away.=0A= =0A= The small patch I did is attached, in case that isn't what you meant.=0A= =0A= I'll run a few more cycles just in case, but I think this fixes it.=0A= =0A= Thanks, rick=0A= =0A= >=0A= > Jeff, to fill you in, I have been getting intermittent hangs on a Pentium= =3D=0A= 4=0A= > (single core i386) with 1.25Gbytes ram when doing kernel builds using=0A= > head kernels from this winter. (I also saw one when doing a kernel build= =0A= > on UFS, so they aren't NFS specific, although easier to reproduce that wa= =3D=0A= y.)=0A= > After a typical hang, there will be a bunch of processes sleeping on "bta= =3D=0A= lloc"=0A= > and several processes holding the following lock:=0A= > exclusive sx lock @ vm/vm_map.c:4761=0A= > - I have seen hangs where that is the only lock held by any process excep= =3D=0A= t=0A= > the interrupt thread.=0A= > - I have also seen processes waiting on the following locks:=0A= > kern/subr_vmem.c:1343=0A= > kern/subr_vmem.c:633=0A= >=0A= > I can't be absolutely sure r358098 is the culprit, but it seems to make t= =3D=0A= he=0A= > problem more reproducible.=0A= >=0A= > If anyone has a patch suggestion, I can test it.=0A= > Otherwise, I will continue to test r358097 and earlier, to try and see wh= =3D=0A= at hangs=0A= > occur. (I've done 8 cycles of testing of r356776 without difficulties, bu= =3D=0A= t that=0A= > doesn't guarantee it isn't broken.)=0A= >=0A= > There is a bunch more of the stuff I got for Kostik and Ryan below.=0A= > I can do "db" when it is hung, but it is a screen console, so I need to= =0A= > transcribe the output to email by hand. (ie. If you need something=0A= > specific I can do that, but trying to do everything Kostik and Ryan asked= =0A= > for isn't easy.)=0A= >=0A= > rick=0A= >=0A= >=0A= >=0A= > Konstantin Belousov wrote:=0A= > >On Fri, May 22, 2020 at 11:46:26PM +0000, Rick Macklem wrote:=0A= > >> Konstantin Belousov wrote:=0A= > >> >On Wed, May 20, 2020 at 11:58:50PM -0700, Ryan Libby wrote:=0A= > >> >> On Wed, May 20, 2020 at 6:04 PM Rick Macklem = =3D=0A= wrote:=0A= > >> >> >=0A= > >> >> > Hi,=0A= > >> >> >=0A= > >> >> > Since I hadn't upgraded a kernel through the winter, it took me a= =3D=0A= while=0A= > >> >> > to bisect this, but r358252 seems to be the culprit.=0A= > No longer true. I succeeded in reproducing the hang to-day running a=0A= > r358251 kernel.=0A= >=0A= > I haven't had much luck sofar, but see below for what I have learned.=0A= >=0A= > >> >> >=0A= > >> >> > If I do a kernel build over NFS using my not so big Pentium 4 (si= =3D=0A= ngle core,=0A= > >> >> > 1.25Gbytes RAM, i386), about every second attempt will hang.=0A= > >> >> > When I do a "ps" in the debugger, I see processes sleeping on bta= =3D=0A= lloc.=0A= > >> >> > If I revert to r358251, I cannot reproduce this.=0A= > As above, this is no longer true.=0A= >=0A= > >> >> >=0A= > >> >> > Any ideas?=0A= > >> >> >=0A= > >> >> > I can easily test any change you might suggest to see if it fixes= =3D=0A= the=0A= > >> >> > problem.=0A= > >> >> >=0A= > >> >> > If you want more debug info, let me know, since I can easily=0A= > >> >> > reproduce it.=0A= > >> >> >=0A= > >> >> > Thanks, rick=0A= > >> >>=0A= > >> >> Nothing obvious to me. I can maybe try a repro on a VM...=0A= > >> >>=0A= > >> >> ddb ps, acttrace, alltrace, show all vmem, show page would be welco= =3D=0A= me.=0A= > >> >>=0A= > >> >> "btalloc" is "We're either out of address space or lost a fill race= =3D=0A= ."=0A= > From what I see, I think it is "out of address space".=0A= > For one of the hangs, when I did "show alllocks", everything except the= =0A= > intr thread, was waiting for the=0A= > exclusive sx lock @ vm/vm_map.c:4761=0A= >=0A= > >> >=0A= > >> >Yes, I would be not surprised to be out of something on 1G i386 machi= =3D=0A= ne.=0A= > >> >Please also add 'show alllocks'.=0A= > >> Ok, I used an up to date head kernel and it took longer to reproduce a= =3D=0A= hang.=0A= > Go down to Kostik's comment about kern.maxvnodes for the rest of what I'v= =3D=0A= e=0A= > learned. (The time it takes to reproduce one of these varies greatly, but= =3D=0A= I usually=0A= > get one within 3 cycles of a full kernel build over NFS. I have had it ha= =3D=0A= ppen=0A= > once when doing a kernel build over UFS.)=0A= >=0A= > >> This time, none of the processes are stuck on "btalloc".=0A= > > I'll try and give you most of the above, but since I have to type it in= =3D=0A= by hand=0A= > > from the screen, I might not get it all. (I'm no real typist;-)=0A= > > > show alllocks=0A= > > exclusive lockmgr ufs (ufs) r =3D3D 0 locked @ kern/vfs_subr.c: 3259=0A= > > exclusive lockmgr nfs (nfs) r =3D3D 0 locked @ kern/vfs_lookup.c:737=0A= > > exclusive sleep mutex kernel area domain (kernel arena domain) r =3D3D = 0 =3D=0A= locked @ kern/subr_vmem.c:1343=0A= > > exclusive lockmgr bufwait (bufwait) r =3D3D 0 locked @ kern/vfs_bio.c:1= 66=3D=0A= 3=0A= > > exclusive lockmgr ufs (ufs) r =3D3D 0 locked @ kern/vfs_subr.c:2930=0A= > > exclusive lockmgr syncer (syncer) r =3D3D 0 locked @ kern/vfs_subr.c:24= 74=0A= > > Process 12 (intr) thread 0x.. (1000008)=0A= > > exclusive sleep mutex Giant (Giant) r =3D3D 0 locked @ kern/kern_intr.c= :1=3D=0A= 152=0A= > >=0A= > > > ps=0A= > > - Not going to list them all, but here are the ones that seem interesti= =3D=0A= ng...=0A= > > 18 0 0 0 DL vlruwt 0x11d939cc [vnlru]=0A= > > 16 0 0 0 DL (threaded) [bufdaemon]=0A= > > 100069 D qsleep [bufdaemon]=0A= > > 100074 D - [bufspacedaemon-0]=0A= > > 100084 D sdflush 0x11923284 [/ worker]=0A= > > - and more of these for the other UFS file systems=0A= > > 9 0 0 0 DL psleep 0x1e2f830 [vmdaemon]=0A= > > 8 0 0 0 DL (threaded) [pagedaemon]=0A= > > 100067 D psleep 0x1e2e95c [dom0]=0A= > > 100072 D launds 0x1e2e968 [laundry: dom0]=0A= > > 100073 D umarcl 0x12cc720 [uma]=0A= > > =3DE2=3D80=3DA6 a bunch of usb and cam ones=0A= > > 100025 D - 0x1b2ee40 [doneq0]=0A= > > =3DE2=3D80=3DA6=0A= > > 12 0 0 0 RL (threaded) [intr]=0A= > > 100007 I [swi6: task queue]=0A= > > 100008 Run CPU 0 [swi6: Giant taskq]=0A= > > =3DE2=3D80=3DA6=0A= > > 100000 D swapin 0x1d96dfc [swapper]=0A= > > - and a bunch more in D state.=0A= > > Does this mean the swapper was trying to swap in?=0A= > >=0A= > > > acttrace=0A= > > - just shows the keyboard=0A= > > kdb_enter() at kdb_enter+0x35/frame=0A= > > vt_kbdevent() at vt_kdbevent+0x329/frame=0A= > > kdbmux_intr() at kbdmux_intr+0x19/frame=0A= > > taskqueue_run_locked() at taskqueue_run_locked+0x175/frame=0A= > > taskqueue_run() at taskqueue_run+0x44/frame=0A= > > taskqueue_swi_giant_run(0) at taskqueue_swi_giant_run+0xe/frame=0A= > > ithread_loop() at ithread_loop+0x237/frame=0A= > > fork_exit() at fork_exit+0x6c/frame=0A= > > fork_trampoline() at 0x../frame=0A= > >=0A= > > > show all vmem=0A= > > vmem 0x.. 'transient arena'=0A= > > quantum: 4096=0A= > > size: 23592960=0A= > > inuse: 0=0A= > > free: 23592960=0A= > > busy tags: 0=0A= > > free tags: 2=0A= > > inuse size free size=0A= > > 16777216 0 0 1 23592960=0A= > > vmem 0x.. 'buffer arena'=0A= > > quantum: 4096=0A= > > size: 94683136=0A= > > inuse: 94502912=0A= > > free: 180224=0A= > > busy tags: 1463=0A= > > free tags: 3=0A= > > inuse size free size=0A= > > 16384 2 32768 1 16384=0A= > > 32768 39 1277952 1 32768=0A= > > 65536 1422 93192192 0 0=0A= > > 131072 0 0 1 131072=0A= > > vmem 0x.. 'i386trampoline'=0A= > > quantum: 1=0A= > > size: 24576=0A= > > inuse: 20860=0A= > > free: 3716=0A= > > busy tags: 9=0A= > > free tags: 3=0A= > > inuse size free size=0A= > > 32 1 48 1 52=0A= > > 64 2 208 0 0=0A= > > 128 2 280 0 0=0A= > > 2048 1 2048 1 3664=0A= > > 4096 2 8192 0 0=0A= > > 8192 1 10084 0 0=0A= > > vmem 0x.. 'kernel rwx arena'=0A= > > quantum: 4096=0A= > > size: 0=0A= > > inuse: 0=0A= > > free: 0=0A= > > busy tags: 0=0A= > > free tags: 0=0A= > > vmem 0x.. 'kernel area dom'=0A= > > quantum: 4096=0A= > > size: 56623104=0A= > > inuse: 56582144=0A= > >> free: 40960=0A= > >> busy tags: 11224=0A= > >> free tags: 3=0A= > >I think this is the trouble.=0A= > >=0A= > >Did you tried to reduce kern.maxvnodes ? What is the default value for= =0A= > >the knob on your machine ?=0A= > The default is 84342.=0A= > I have tried 64K, 32K and 128K and they all hung sooner or later.=0A= > For the 32K case, I did see vnodes being recycled for a while before it g= =3D=0A= ot hung,=0A= > so it isn't just when it hits the limit.=0A= >=0A= > Although it is much easier for me to reproduce on an NFS mount, I did see= =0A= > a hang while doing a kernel build on UFS (no NFS mount on the machine at= =0A= > that time).=0A= >=0A= > So, I now know that the problem pre-dates r358252 and is not NFS specific= =3D=0A= .=0A= >=0A= > I'm not bisecting back further to try and isolate the commit that causes = =3D=0A= this.=0A= > (Unfortunately, each test cycle can take days. I now know that I have to = =3D=0A= do=0A= > several of these kernel builds, which take hours each, to see if a hang i= =3D=0A= s going=0A= > to happen.)=0A= >=0A= > I'll post if/when I have more, rick=0A= >=0A= > We scaled maxvnodes for ZFS and UFS, might be NFS is even more demanding,= =0A= > having larger node size.=0A= >=0A= > > inuse size free size=0A= > > 4096 11091 45428736 0 0=0A= > > 8192 63 516096 0 0=0A= > > 16384 12 196608 0 0=0A= > > 32768 6 196608 0 0=0A= > > 40960 2 81920 1 40960=0A= > > 65536 16 1048576 0 0=0A= > > 94208 1 94208 0 0=0A= > > 110592 1 110592 0 0=0A= > > 131072 15 2441216 0 0=0A= > > 262144 15 3997696 0 0=0A= > > 524288 1 524288 0 0=0A= > > 1048576 1 1945600 0 0=0A= > > vmem 0x.. 'kernel arena'=0A= > > quantum: 4096=0A= > > size: 390070272=0A= > > inuse: 386613248=0A= > > free: 3457024=0A= > > busy tags: 873=0A= > > free tags: 3=0A= > > inuse size free size=0A= > > 4096 35 143360 1 4096=0A= > > 8192 2 16384 2 16384=0A= > > 12288 1 12288 0 0=0A= > > 16384 30 491520 0 0=0A= > > 20480 140 2867200 0 0=0A= > > 65536 1 65536 0 0=0A= > > 131072 631 82706432 0 0=0A= > > 1048576 0 0 1 1339392=0A= > > 2097152 27 56623104 1 2097152=0A= > > 8388608 1 13774848 0 0=0A= > > 16777216 3 74883072 0 0=0A= > > 33554432 1 36753408 0 0=0A= > > 67108864 1 118276096 0 0=0A= > >=0A= > > > alltrace=0A= > > - I can't face typing too much more, but I'll put a few=0A= > > here that look interesting=0A= > >=0A= > > - for csh=0A= > > sched_switch()=0A= > > mi_switch()=0A= > > kern_yield()=0A= > > getblkx()=0A= > > breadn_flags()=0A= > > ffs_update()=0A= > > ufs_inactive()=0A= > > VOP_INACTIVE()=0A= > > vinactivef()=0A= > > vput_final()=0A= > > vm_object_deallocate()=0A= > > vm_map_process_deferred()=0A= > > kern_munmap()=0A= > > sys_munmap()=0A= > >=0A= > > - For cc=0A= > > sched_switch()=0A= > > mi_switch()=0A= > > sleepq_switch()=0A= > > sleepq_timedwait()=0A= > > _sleep()=0A= > > pause_sbt()=0A= > > vmem_bt_alloc()=0A= > > keg_alloc_slab()=0A= > > zone_import()=0A= > > cache_alloc()=0A= > > cache_alloc_retry()=0A= > > uma_zalloc_arg()=0A= > > bt_fill()=0A= > > vmem_xalloc()=0A= > > vmem_alloc()=0A= > > kmem_alloc()=0A= > > kmem_malloc_domainset()=0A= > > page_alloc()=0A= > > keg_alloc_slab()=0A= > > zone_import()=0A= > > cache_alloc()=0A= > > cache_alloc_retry()=0A= > > uma_zalloc_arg()=0A= > > nfscl_nget()=0A= > > nfs_create()=0A= > > vop_sigdefer()=0A= > > nfs_vnodeops_bypass()=0A= > > VOP_CREATE_APV()=0A= > > vn_open_cred()=0A= > > vn_open()=0A= > > kern_openat()=0A= > > sys_openat()=0A= > >=0A= > > Then there are a bunch of these... for cc, make=0A= > > sched_switch()=0A= > > mi_switch()=0A= > > sleepq_switch()=0A= > > sleepq_catch_signals()=0A= > > sleepq_wait_sig()=0A= > > kern_wait6()=0A= > > sys_wait4()=0A= > >=0A= > > - for vnlru=0A= > > sched_switch()=0A= > > mi_switch()=0A= > > sleepq_switch()=0A= > > sleepq_timedwait()=0A= > > _sleep()=0A= > > vnlru_proc()=0A= > > fork_exit()=0A= > > fork_trampoline()=0A= > >=0A= > > - for syncer=0A= > > sched_switch()=0A= > > mi_switch()=0A= > > critical_exit_preempt()=0A= > > intr_event_handle()=0A= > > intr_execute_handlers()=0A= > > lapic_handle_intr()=0A= > > Xapic_isr1()=0A= > > - interrupt=0A= > > memset()=0A= > > cache_alloc()=0A= > > cache_alloc_retry()=0A= > > uma_zalloc_arg()=0A= > > vmem_xalloc()=0A= > > vmem_bt_alloc()=0A= > > keg_alloc_slab()=0A= > > zone_import()=0A= > > cache_alloc()=0A= > > cache_alloc_retry()=0A= > > uma_zalloc_arg()=0A= > > bt_fill()=0A= > > vmem_xalloc()=0A= > > vmem_alloc()=0A= > > bufkva_alloc()=0A= > > getnewbuf()=0A= > > getblkx()=0A= > > breadn_flags()=0A= > > ffs_update()=0A= > > ffs_sync()=0A= > > sync_fsync()=0A= > > VOP_FSYNC_APV()=0A= > > sched_sync()=0A= > > fork_exit()=0A= > > fork_trampoline()=0A= > >=0A= > > - For bufdaemon (a bunch of these)=0A= > > sched_switch()=0A= > > mi_switch()=0A= > > sleepq_switch()=0A= > > sleepq_timedwait()=0A= > > _sleep()=0A= > > buf_daemon()=0A= > > fork_exit()=0A= > > fork_trampoline()=0A= > >=0A= > > vmdaemon and pagedaemon are basically just like above,=0A= > > sleeping in=0A= > > vm_daemon()=0A= > > or=0A= > > vm_pageout_worker()=0A= > > or=0A= > > vm_pageout_laundry_worker()=0A= > > or=0A= > > uma_reclaim_worker()=0A= > >=0A= > > That's all the typing I can take right now.=0A= > > I can probably make this happen again if you want more specific stuff.= =0A= > >=0A= > > rick=0A= > >=0A= > >=0A= > >=0A= > >=0A= > _______________________________________________=0A= > freebsd-current@freebsd.org mailing list=0A= > https://lists.freebsd.org/mailman/listinfo/freebsd-current=0A= > To unsubscribe, send any mail to "freebsd-current-unsubscribe@freebsd.org= =3D=0A= "=0A= > _______________________________________________=0A= > freebsd-current@freebsd.org mailing list=0A= > https://lists.freebsd.org/mailman/listinfo/freebsd-current=0A= > To unsubscribe, send any mail to "freebsd-current-unsubscribe@freebsd.org= =3D=0A= "=0A= > _______________________________________________=0A= > freebsd-current@freebsd.org mailing list=0A= > https://lists.freebsd.org/mailman/listinfo/freebsd-current=0A= > To unsubscribe, send any mail to "freebsd-current-unsubscribe@freebsd.org= =0A= --_002_QB1PR01MB33649F146649F6C8BA0788B5DD980QB1PR01MB3364CANP_ Content-Type: application/octet-stream; name="vmem.patch" Content-Description: vmem.patch Content-Disposition: attachment; filename="vmem.patch"; size=497; creation-date="Fri, 19 Jun 2020 03:42:27 GMT"; modification-date="Fri, 19 Jun 2020 03:42:27 GMT" Content-Transfer-Encoding: base64 LS0tIGtlcm4vc3Vicl92bWVtLmMubm9mcmVlCTIwMjAtMDYtMTUgMTk6NTY6MDcuMzg5MTg3MDAw IC0wNzAwCisrKyBrZXJuL3N1YnJfdm1lbS5jCTIwMjAtMDYtMTUgMTk6NTk6MTYuODExMDM2MDAw IC0wNzAwCkBAIC02NzAsNyArNjcwLDcgQEAgdm1lbV9zdGFydHVwKHZvaWQpCiAJICAgIFVNQV9B TElHTl9QVFIsIDApOwogCXZtZW1fYnRfem9uZSA9IHVtYV96Y3JlYXRlKCJ2bWVtIGJ0YWciLAog CSAgICBzaXplb2Yoc3RydWN0IHZtZW1fYnRhZyksIE5VTEwsIE5VTEwsIE5VTEwsIE5VTEwsCi0J ICAgIFVNQV9BTElHTl9QVFIsIFVNQV9aT05FX1ZNKTsKKwkgICAgVU1BX0FMSUdOX1BUUiwgVU1B X1pPTkVfVk0gfCBVTUFfWk9ORV9OT0ZSRUUpOwogI2lmbmRlZiBVTUFfTURfU01BTExfQUxMT0MK IAltdHhfaW5pdCgmdm1lbV9idF9sb2NrLCAiYnRhZyBsb2NrIiwgTlVMTCwgTVRYX0RFRik7CiAJ dW1hX3ByZWFsbG9jKHZtZW1fYnRfem9uZSwgQlRfTUFYQUxMT0MpOwo= --_002_QB1PR01MB33649F146649F6C8BA0788B5DD980QB1PR01MB3364CANP_-- From owner-freebsd-current@freebsd.org Fri Jun 19 16:02:56 2020 Return-Path: Delivered-To: freebsd-current@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id DB55F33125A for ; Fri, 19 Jun 2020 16:02:56 +0000 (UTC) (envelope-from steffen@sdaoden.eu) Received: from mailman.nyi.freebsd.org (mailman.nyi.freebsd.org [IPv6:2610:1c1:1:606c::50:13]) by mx1.freebsd.org (Postfix) with ESMTP id 49pNr04GC4z4M3j for ; Fri, 19 Jun 2020 16:02:56 +0000 (UTC) (envelope-from steffen@sdaoden.eu) Received: by mailman.nyi.freebsd.org (Postfix) id 9237F330F43; Fri, 19 Jun 2020 16:02:56 +0000 (UTC) Delivered-To: current@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 91FE2330EEB for ; Fri, 19 Jun 2020 16:02:56 +0000 (UTC) (envelope-from steffen@sdaoden.eu) Received: from sdaoden.eu (sdaoden.eu [217.144.132.164]) by mx1.freebsd.org (Postfix) with ESMTP id 49pNqy66xhz4MVW for ; Fri, 19 Jun 2020 16:02:54 +0000 (UTC) (envelope-from steffen@sdaoden.eu) Received: by sdaoden.eu (Postfix, from userid 1000) id A465616054; Fri, 19 Jun 2020 17:54:19 +0200 (CEST) Date: Fri, 19 Jun 2020 17:54:19 +0200 From: Steffen Nurpmeso To: current@freebsd.org Subject: Happy birthday. Message-ID: <20200619155419.FmJic%steffen@sdaoden.eu> Mail-Followup-To: current@freebsd.org User-Agent: s-nail v14.9.19-60-g74aff022 OpenPGP: id=EE19E1C1F2F7054F8D3954D8308964B51883A0DD; url=https://ftp.sdaoden.eu/steffen.asc; preference=signencrypt BlahBlahBlah: Any stupid boy can crush a beetle. But all the professors in the world can make no bugs. X-Rspamd-Queue-Id: 49pNqy66xhz4MVW X-Spamd-Bar: / Authentication-Results: mx1.freebsd.org; dkim=none; dmarc=none; spf=pass (mx1.freebsd.org: domain of steffen@sdaoden.eu designates 217.144.132.164 as permitted sender) smtp.mailfrom=steffen@sdaoden.eu X-Spamd-Result: default: False [0.38 / 15.00]; ARC_NA(0.00)[]; NEURAL_HAM_MEDIUM(-0.10)[-0.095]; FROM_HAS_DN(0.00)[]; TO_MATCH_ENVRCPT_ALL(0.00)[]; R_SPF_ALLOW(-0.20)[+a]; MIME_GOOD(-0.10)[text/plain]; TO_DN_NONE(0.00)[]; DMARC_NA(0.00)[sdaoden.eu]; RCPT_COUNT_ONE(0.00)[1]; NEURAL_HAM_SHORT(-0.31)[-0.315]; NEURAL_SPAM_LONG(0.09)[0.087]; MID_CONTAINS_FROM(1.00)[]; RCVD_COUNT_ZERO(0.00)[0]; FROM_EQ_ENVFROM(0.00)[]; R_DKIM_NA(0.00)[]; MIME_TRACE(0.00)[0:+]; ASN(0.00)[asn:15987, ipnet:217.144.128.0/20, country:DE] X-BeenThere: freebsd-current@freebsd.org X-Mailman-Version: 2.1.33 Precedence: list List-Id: Discussions about the use of FreeBSD-current List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 19 Jun 2020 16:02:56 -0000 Just saw it and have seen nothing yet, and having reread GDBE paper from BSDCON 2003 today: happy birthday FreeBSD! You seem to have reached the age of Janis Joplin, Jim Morrison and Jimmi (Hendrix)! That makes optimistical. --steffen | |Der Kragenbaer, The moon bear, |der holt sich munter he cheerfully and one by one |einen nach dem anderen runter wa.ks himself off |(By Robert Gernhardt) From owner-freebsd-current@freebsd.org Fri Jun 19 22:36:22 2020 Return-Path: Delivered-To: freebsd-current@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id D8B5933AFAB for ; Fri, 19 Jun 2020 22:36:22 +0000 (UTC) (envelope-from yuripv@yuripv.dev) Received: from mailman.nyi.freebsd.org (mailman.nyi.freebsd.org [IPv6:2610:1c1:1:606c::50:13]) by mx1.freebsd.org (Postfix) with ESMTP id 49pYYy4FSSz3dTv for ; Fri, 19 Jun 2020 22:36:22 +0000 (UTC) (envelope-from yuripv@yuripv.dev) Received: by mailman.nyi.freebsd.org (Postfix) id 8D99833A879; Fri, 19 Jun 2020 22:36:22 +0000 (UTC) Delivered-To: current@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 8D5B133A878 for ; Fri, 19 Jun 2020 22:36:22 +0000 (UTC) (envelope-from yuripv@yuripv.dev) Received: from out2-smtp.messagingengine.com (out2-smtp.messagingengine.com [66.111.4.26]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 49pYYx5wyzz3dWT for ; Fri, 19 Jun 2020 22:36:21 +0000 (UTC) (envelope-from yuripv@yuripv.dev) Received: from compute2.internal (compute2.nyi.internal [10.202.2.42]) by mailout.nyi.internal (Postfix) with ESMTP id 5170C5C00A0 for ; Fri, 19 Jun 2020 18:28:11 -0400 (EDT) Received: from mailfrontend1 ([10.202.2.162]) by compute2.internal (MEProxy); Fri, 19 Jun 2020 18:28:11 -0400 DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=yuripv.dev; h=to :from:subject:message-id:date:mime-version:content-type :content-transfer-encoding; s=fm1; bh=IucLZpqlSrm5HPgOUoAAGO9Pjp iuvVyxD3MTk9NXt9Y=; b=XUMfbHHqdHhEgxojbh6dh0/jcr1x0A5hf3LhPXrQ/r NWuE09HKAonFxLswEA9JwNOl90z31H0ldGJiyr5VN3tPy/bsSQsnYz6SYkmuijAi XU0O183JqyFVkN3cuQHQi1xWZCrl3bZqzsLMRIbpE67ffozzRk0OfmhoyrIaWACD y6WATSVvK/b/bzaJoHwZpe99gyNKB3+F4zXvqeksLeDdlUQB7dgvq/CzsUxTpgkc WO7ElMhzeg17VFcZTr0HKlFW3PcNQPFTtpUyx96Zvc4MzsYksFdkSXgllMaCamsH ieFRZ6ZMXOQIt+oJ29fEOXr1XRDE8B+NKHF05+3GroKA== DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d= messagingengine.com; h=content-transfer-encoding:content-type :date:from:message-id:mime-version:subject:to:x-me-proxy :x-me-proxy:x-me-sender:x-me-sender:x-sasl-enc; s=fm3; bh=IucLZp qlSrm5HPgOUoAAGO9PjpiuvVyxD3MTk9NXt9Y=; b=G2dbNoXH3W9iOHUuYl9Zda 8ZuxU3FtGufWQq9hLejATctuREUGPhQn28Uj+qP1gOWGPf+XvftMBmwViek6YAeo wxoOD3aUwXijX6ov/luRI9LKClKjHq3FI3ttJ7dnvGtEwWHLuzs/vFO+8Ht05kwU MzDY1F+EMnyN59ht345KESxvF3x6ckhK7GQnTpy2piJu8k8ZlJvmm6M4L9SO6fkY wcjCwVFfKdLFrjYaGUI4Y5QhxeztTgBbGBEBmNr4VwJ4GxLlZwZbQ/cngynJvNnA 9h2239+qbA8ZhcFl1e/9uw6KYXWtR9l9eRellQwvF5dCk5jAY5VfHAkgFdrCU3BA == X-ME-Sender: X-ME-Proxy-Cause: gggruggvucftvghtrhhoucdtuddrgeduhedrudejjedguddtucetufdoteggodetrfdotf fvucfrrhhofhhilhgvmecuhfgrshhtofgrihhlpdfqfgfvpdfurfetoffkrfgpnffqhgen uceurghilhhouhhtmecufedttdenucenucfjughrpefvhffukffffgggtgfgsehtjeertd dtfeejnecuhfhrohhmpegjuhhrihcurfgrnhhkohhvuceohihurhhiphhvseihuhhrihhp vhdruggvvheqnecuggftrfgrthhtvghrnhepgfelheevieekueevkeetueegfeelhfehle efkeegtdfghfelfefhvdfftefhvdfgnecukfhppeeluddrvdegtddruddvgedrudefjeen ucevlhhushhtvghrufhiiigvpedtnecurfgrrhgrmhepmhgrihhlfhhrohhmpeihuhhrih hpvheshihurhhiphhvrdguvghv X-ME-Proxy: Received: from mercury.yuripv.dev (unknown [91.240.124.137]) by mail.messagingengine.com (Postfix) with ESMTPA id BD65B3280063 for ; Fri, 19 Jun 2020 18:28:10 -0400 (EDT) To: current@freebsd.org From: Yuri Pankov Subject: uma_zalloc_debug warnings after r362231 Message-ID: Date: Sat, 20 Jun 2020 01:28:09 +0300 User-Agent: Mozilla/5.0 (X11; FreeBSD amd64; rv:68.0) Gecko/20100101 Thunderbird/68.9.0 MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8; format=flowed Content-Language: en-US Content-Transfer-Encoding: 7bit X-Rspamd-Queue-Id: 49pYYx5wyzz3dWT X-Spamd-Bar: +++++++++ Authentication-Results: mx1.freebsd.org; dkim=pass header.d=yuripv.dev header.s=fm1 header.b=XUMfbHHq; dkim=pass header.d=messagingengine.com header.s=fm3 header.b=G2dbNoXH; dmarc=none; spf=pass (mx1.freebsd.org: domain of yuripv@yuripv.dev designates 66.111.4.26 as permitted sender) smtp.mailfrom=yuripv@yuripv.dev X-Spamd-Result: default: False [9.77 / 15.00]; RCVD_VIA_SMTP_AUTH(0.00)[]; SEM_URIBL_FRESH15(3.00)[yuripv.dev:dkim]; R_SPF_ALLOW(0.00)[+ip4:66.111.4.26:c]; RWL_MAILSPIKE_GOOD(0.00)[66.111.4.26:from]; TO_DN_NONE(0.00)[]; RCVD_COUNT_THREE(0.00)[4]; DKIM_TRACE(0.00)[yuripv.dev:+,messagingengine.com:+]; FROM_EQ_ENVFROM(0.00)[]; MIME_TRACE(0.00)[0:+]; RCVD_TLS_LAST(0.00)[]; ASN(0.00)[asn:11403, ipnet:66.111.4.0/24, country:US]; MID_RHS_MATCH_FROM(0.00)[]; RCVD_IN_DNSWL_LOW(-0.10)[66.111.4.26:from]; ARC_NA(0.00)[]; RECEIVED_SPAMHAUS_XBL(5.00)[91.240.124.137:received]; R_DKIM_ALLOW(0.00)[yuripv.dev:s=fm1,messagingengine.com:s=fm3]; FROM_HAS_DN(0.00)[]; TO_MATCH_ENVRCPT_ALL(0.00)[]; NEURAL_SPAM_SHORT(0.00)[0.002]; MIME_GOOD(-0.10)[text/plain]; PREVIOUSLY_DELIVERED(0.00)[current@freebsd.org]; DMARC_NA(0.00)[yuripv.dev]; NEURAL_SPAM_MEDIUM(0.94)[0.937]; RCPT_COUNT_ONE(0.00)[1]; BAD_REP_POLICIES(0.10)[]; NEURAL_SPAM_LONG(0.93)[0.934]; GREYLIST(0.00)[pass,body] X-Spam: Yes X-BeenThere: freebsd-current@freebsd.org X-Mailman-Version: 2.1.33 Precedence: list List-Id: Discussions about the use of FreeBSD-current List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 19 Jun 2020 22:36:22 -0000 I've started getting the following after r362231 (I think) when plugging USB drive, not seeing any real issues though: ugen0.9: at usbus0 umass0 numa-domain 0 on uhub4 umass0: on usbus0 umass0: SCSI over Bulk-Only; quirks = 0xc101 umass0:2:0: Attached to scbus2 uma_zalloc_debug: zone "kenv" with the following non-sleepable locks held: exclusive sleep mutex CAM device lock (CAM device lock) r = 0 (0xfffff8000dcb6cd0) locked @ /usr/src/sys/cam/scsi/scsi_pass.c:674 stack backtrace: #0 0xffffffff80c32981 at witness_debugger+0x71 #1 0xffffffff80c3391d at witness_warn+0x40d #2 0xffffffff80efe426 at uma_zalloc_arg+0x46 #3 0xffffffff80b741da at getenv_string_buffer+0x3a #4 0xffffffff80b74907 at getenv_quad+0x17 #5 0xffffffff80b748d2 at getenv_int+0x12 #6 0xffffffff803a7f1a at daregister+0x1ea #7 0xffffffff8037445b at cam_periph_alloc+0x57b #8 0xffffffff803a7872 at daasync+0x2c2 #9 0xffffffff80381aa2 at xpt_async_process_dev+0x152 #10 0xffffffff8037d682 at xpt_async_process+0x312 #11 0xffffffff8037ddf2 at xpt_done_process+0x382 #12 0xffffffff8037fdb5 at xpt_done_td+0xf5 #13 0xffffffff80b831e0 at fork_exit+0x80 #14 0xffffffff810413ce at fork_trampoline+0xe da0 at umass-sim0 bus 0 scbus2 target 0 lun 0 da0: Fixed Direct Access SPC-4 SCSI device da0: Serial Number 575845314136394150553136 da0: 40.000MB/s transfers da0: 953837MB (1953458176 512 byte sectors) da0: quirks=0x2 From owner-freebsd-current@freebsd.org Sat Jun 20 15:47:46 2020 Return-Path: Delivered-To: freebsd-current@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id C97433547B1 for ; Sat, 20 Jun 2020 15:47:46 +0000 (UTC) (envelope-from mad@madpilot.net) Received: from mailman.nyi.freebsd.org (mailman.nyi.freebsd.org [IPv6:2610:1c1:1:606c::50:13]) by mx1.freebsd.org (Postfix) with ESMTP id 49q0S22p8Rz4BVs for ; Sat, 20 Jun 2020 15:47:46 +0000 (UTC) (envelope-from mad@madpilot.net) Received: by mailman.nyi.freebsd.org (Postfix) id 5FFCB35472B; Sat, 20 Jun 2020 15:47:46 +0000 (UTC) Delivered-To: current@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 5FC0C35483A for ; Sat, 20 Jun 2020 15:47:46 +0000 (UTC) (envelope-from mad@madpilot.net) Received: from mail.madpilot.net (vogon.madpilot.net [159.69.1.99]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 49q0S123s3z4BYN; Sat, 20 Jun 2020 15:47:44 +0000 (UTC) (envelope-from mad@madpilot.net) Received: from mail (mail [192.168.254.3]) by mail.madpilot.net (Postfix) with ESMTP id 49q0Rs3Qtfz6dSt; Sat, 20 Jun 2020 17:47:37 +0200 (CEST) Received: from mail.madpilot.net ([192.168.254.3]) by mail (mail.madpilot.net [192.168.254.3]) (amavisd-new, port 10026) with ESMTP id shD2oCrJXr90; Sat, 20 Jun 2020 17:47:35 +0200 (CEST) Subject: Re: [HEADSUP] snd/hda interrupt handling change To: Andriy Gapon , FreeBSD Current References: From: Guido Falsi Autocrypt: addr=mad@madpilot.net; keydata= mQENBE+G+l0BCADi/WBQ0aRJfnE7LBPsM0G3m/m3Yx7OPu4iYFvS84xawmRHtCNjWIntsxuX fptkmEo3Rsw816WUrek8dxoUAYdHd+EcpBcnnDzfDH5LW/TZ4gbrFezrHPdRp7wdxi23GN80 qPwHEwXuF0X4Wy5V0OO8B6VT/nA0ADYnBDhXS52HGIJ/GCUjgqJn+phDTdCFLvrSFdmgx4Wl c0W5Z1p5cmDF9l8L/hc959AeyNf7I9dXnjekGM9gVv7UDUYzCifR3U8T0fnfdMmS8NeI9NC+ wuREpRO4lKOkTnj9TtQJRiptlhcHQiAlG1cFqs7EQo57Tqq6cxD1FycZJLuC32bGbgalABEB AAG0Hkd1aWRvIEZhbHNpIDxtYWRAbWFkcGlsb3QubmV0PokBOQQTAQgAIwIbAwIeAQIXgAUL CQgHAwUVCgkICwQWAgMBBQJS79AgAhkBAAoJEBrmhg5Wy9KTc0kH/RO64ORBlTbTHaUaOj8F Je5O5NU2Pt9Cyt5ZWBRvxntr1zPTJGKRPS9ihlIfqT4ZvEngQGp57EUyFbCpI0UWasTerImM tt5WACnGmCzUTB39UXx8Oy4b1EgWeTJQ747e/F1mQLXTNa6ijRBE9fYlTb4gAkPN88/wVV9v 3PZozKLTg16ghBzHM/P7Lk8L7clPEZChX1FTa/6eSt3nvzfCuTMZbBPJF/ph+q1KyPqRgVfh tyhu5dvgMoPz/ni41IfeSrkJTD5RXzdyGR9q4Z1NYeBsLkRjC4LxKAP5KqUsvlOUjKvO1byj ApYdMarol+IGkaSk9e3zVYAJkWKjn/ni8Xa5Ag0EUxB7QQEQAKFhrDceoPdK/IHDSmoj6SQY isvM7VdhcleS7E9DoEAVt7yMbf6HbbMVTTY6ckvwTWQssywLBXNVqxgc4WLJjzfUhgef+WE7 5M3+WFYlOVQLGZY/zEVgma1raYnOHNAOzeHLDmEXjbZP6vGAeDyBbGfQPpE7qGYZ7ubeT3Xw QO+PklcCrvOPj2ZPcAxGNS2xVU/LzONqCrJqLMJSIcCdsbiSP4G5PnDFHtMokaTY6OEr8OEQ fOAerhcHUa/z7Uu8YtmaqKH+QGkE/WEgaRqSiTnv0JOTD+DxehaqvoKPPZ++2NpCZMHB2i6A /xifmQwEiIjEXtcueBRzkNUQkxhqZyS13SrhocL9ydtaVPBzZatAEjUDDEJmAMLVFs45qfyh MiNapHJo2n3MW/E5omqCvEkDdWX/en3P7CK2TemeaDghMsgkNKax/z0wNo5UZCkOPOz0xpNi UilOVbkuezZZNg65741qee2lfXhQIaZ66yT7hphc/N/z3PIAtLeze4u1VR2EXAuZ2sWAdlKC NTlJMsaU/x70BV11Wd/ypnVzM68dfdQIIAj1iMFAD/lXGlEUmKXg5Ov2VQDlTntQoanCYrAg +8CttPzjrydgLZFq3hrtQmfc0se5yv1WHS69+BsUOG09RvvawUDZxUjW19kyeN9THaNRgow3 kSuArUp6zSmJABEBAAGJAR8EGAEIAAkFAlMQe0ECGwwACgkQGuaGDlbL0pMN5wgA4bCkX/qw EVC06ToeR6C2putmSWQMgpDaqrv65Hubo+QGmg2P4ewTYQQ4g6oYWS03qHxqVVWhKz7FjfrV +dH8qbCLfSgIcvdBha7ayGZVrsiuMLKGbw36fcmkZPpSDOfHcP0XH8Z+u9CWj0xUkTxAlZ/7 i6gYSUpG2JWNtdmE/X8VVEyXusCLwy0K0BI60A/4dRTIX3C4QKrJ3ZbUXegz70ynjHf+lQMZ 9IZKASoRMuS5FozPQh6abvmwZEPdf5I9riUElzvHrqJ8Bx0t3Pujdoth+yNHpnBxrtO8LkQd rQ58P0SwcaIX33T2U9pG8bhu5YVR88FQ8OQ0cEsPBpDncrkBDQRPhvpdAQgAsd6mrOq1GSZw lzRscNQa9W2WB/3Tj4ON4PL2e9B+hc9lT/ny2zB3agXu5wbsXTzwxgJpQT7hNHkCSckW98h3 HRjFfhZPNCgInuUGsjcNyVguQh+/47ckhph0s7U+6B4yNuIiqQZk4mo8WgCNj1YIihVmGWEs gDOwMaajbDYZ0r1/3GkKlYjOXeUuT/WgourrSR5oZJVNA/k4X2H7M3JUr1BSc32L7BJt8M7A ntul6k17J0L8GmkvLvTUtQTO+p+DYQMna2ngD3PbAvQRcbEGnkg9ABrdEF0Wp4Gx+gGGWsyF KlHvPdMtgWAy3JsS+rQapG6LoW3yUJpwpEpA86KdBwARAQABiQEfBCgBCAAJBQJTEH0NAh0B AAoJEBrmhg5Wy9KTMZcIAMSsidGF4KpjGcKzhkNK0sEpevcelQ6DzgT7kcXuq6LQ6YOrbof2 /KPgGie9/ToFZfJXH8zE5GefqkKvHZbYssWilFvkI90F9n138kG205NB/2zlaQb74/v9ZMXJ XcipnIx+T2tOMCBgHJU41IMJmB+NfRt5A6CDytJdhWxqppsEo5jjy/7tJM1Nn47G87tAV8qV NUtzbS6zdnbHB4W2BJwCObbVv8epL3hu/L5efV2j2tSbVTmyvK/ClYMBqdtUo3uPX75GF/Ku YDCOP1BTA5zzmzp4PMVd+gmHcMgCZKY6lvcEtdi5FLI0we2kcY8ffPvM2d6MNhFsGLaVI95J 0oqJAR8EGAECAAkFAk+G+l0CGwwACgkQGuaGDlbL0pM18Qf9HTNNhu8N0ISKtmR8lgPhJuu8 9rOEa8KKEatr4fQ7gL+hmYOEqZ/yHLcPQvGxbAlLR7F0SheKvAEk4B1aFwGULPo0SzuO0d/W tVMEbGa95JTm/6mfiymWMlWf8UifD1MDKzzPR7Om0ybeoPM8S/RQTboUU1WLpwd4mg9pVJlK 0xr55GOSHNf4m7S+P1kvl3xgmEj14zVMq9yJBNWFlsQK5ciifh7sFpfuxWdEVbtgIdxpzImK LXSLA0vOroKAvxFTGBrBq3vxV6eUmaKyd5HbbWejmafY1ua5dcnew9lxpWKLdqkC27Vt0Cku +LtTY3325V+BChncwNcJJS7IMmBz6w== Message-ID: Date: Sat, 20 Jun 2020 17:47:34 +0200 In-Reply-To: Content-Type: text/plain; charset=utf-8 Content-Language: en-US Content-Transfer-Encoding: 7bit X-Rspamd-Queue-Id: 49q0S123s3z4BYN X-Spamd-Bar: - X-Spamd-Result: default: False [-1.42 / 15.00]; ARC_NA(0.00)[]; NEURAL_HAM_MEDIUM(-1.03)[-1.033]; R_DKIM_ALLOW(-0.20)[madpilot.net:s=bjowvop61wgh]; FROM_HAS_DN(0.00)[]; MISSING_MIME_VERSION(2.00)[]; TO_MATCH_ENVRCPT_ALL(0.00)[]; MIME_GOOD(-0.10)[text/plain]; R_SPF_ALLOW(-0.20)[+mx]; NEURAL_HAM_LONG(-1.02)[-1.019]; RCVD_COUNT_THREE(0.00)[3]; TO_DN_ALL(0.00)[]; DKIM_TRACE(0.00)[madpilot.net:+]; RCPT_COUNT_TWO(0.00)[2]; DMARC_POLICY_ALLOW(-0.50)[madpilot.net,quarantine]; NEURAL_HAM_SHORT(-0.37)[-0.369]; FROM_EQ_ENVFROM(0.00)[]; MIME_TRACE(0.00)[0:+]; RCVD_TLS_LAST(0.00)[]; ASN(0.00)[asn:24940, ipnet:159.69.0.0/16, country:DE]; MID_RHS_MATCH_FROM(0.00)[] X-BeenThere: freebsd-current@freebsd.org X-Mailman-Version: 2.1.33 Precedence: list List-Id: Discussions about the use of FreeBSD-current List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 20 Jun 2020 15:47:46 -0000 On 18/06/20 09:19, Andriy Gapon wrote: > > If you get any problems with HDA sound driver, please be aware of r362294. > Please let me know about any problems that appear to be related to that commit. > It would be helpful to test if reverting the commit helps. > Thanks. > I was experiencing this issue on my laptop, and your patch fixes it perfectly. I was trying to gather information to file a bug report but you fixed it before I could act. No ill effects on other computers I tested this on. So Thank you! -- Guido Falsi