From owner-freebsd-arm@freebsd.org Sun Nov 1 02:22:51 2020 Return-Path: Delivered-To: freebsd-arm@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 8E7FE45F473 for ; Sun, 1 Nov 2020 02:22:51 +0000 (UTC) (envelope-from fbsd@www.zefox.net) Received: from www.zefox.net (www.zefox.net [50.1.20.27]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "www.zefox.com", Issuer "www.zefox.com" (not verified)) by mx1.freebsd.org (Postfix) with ESMTPS id 4CP0FQ2xGdz4LgX for ; Sun, 1 Nov 2020 02:22:50 +0000 (UTC) (envelope-from fbsd@www.zefox.net) Received: from www.zefox.net (localhost [127.0.0.1]) by www.zefox.net (8.15.2/8.15.2) with ESMTPS id 0A12Mw0h019519 (version=TLSv1.3 cipher=TLS_AES_256_GCM_SHA384 bits=256 verify=NO); Sat, 31 Oct 2020 19:22:58 -0700 (PDT) (envelope-from fbsd@www.zefox.net) Received: (from fbsd@localhost) by www.zefox.net (8.15.2/8.15.2/Submit) id 0A12Mvpl019518; Sat, 31 Oct 2020 19:22:57 -0700 (PDT) (envelope-from fbsd) Date: Sat, 31 Oct 2020 19:22:57 -0700 From: bob prohaska To: Stefan Parvu Cc: freebsd-arm@freebsd.org, bob prohaska Subject: Re: RPI3B+ disable HDMI Message-ID: <20201101022257.GA18863@www.zefox.net> References: <842D1575-F21A-4656-B81C-08D828286B6C@kronometrix.org> MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: <842D1575-F21A-4656-B81C-08D828286B6C@kronometrix.org> X-Rspamd-Queue-Id: 4CP0FQ2xGdz4LgX X-Spamd-Bar: / Authentication-Results: mx1.freebsd.org; dkim=none; dmarc=none; spf=none (mx1.freebsd.org: domain of fbsd@www.zefox.net has no SPF policy when checking 50.1.20.27) smtp.mailfrom=fbsd@www.zefox.net X-Spamd-Result: default: False [0.77 / 15.00]; RCVD_TLS_ALL(0.00)[]; ARC_NA(0.00)[]; WWW_DOT_DOMAIN(0.50)[]; MID_RHS_MATCH_FROM(0.00)[]; FROM_HAS_DN(0.00)[]; RCPT_COUNT_THREE(0.00)[3]; TO_DN_SOME(0.00)[]; NEURAL_HAM_LONG(-0.68)[-0.684]; MIME_GOOD(-0.10)[text/plain]; DMARC_NA(0.00)[zefox.net]; AUTH_NA(1.00)[]; TO_MATCH_ENVRCPT_SOME(0.00)[]; NEURAL_HAM_SHORT(-0.30)[-0.305]; NEURAL_HAM_MEDIUM(-0.14)[-0.137]; R_SPF_NA(0.00)[no SPF record]; FROM_EQ_ENVFROM(0.00)[]; R_DKIM_NA(0.00)[]; MIME_TRACE(0.00)[0:+]; ASN(0.00)[asn:7065, ipnet:50.1.16.0/20, country:US]; RCVD_COUNT_TWO(0.00)[2]; MAILMAN_DEST(0.00)[freebsd-arm]; MID_RHS_WWW(0.50)[] X-BeenThere: freebsd-arm@freebsd.org X-Mailman-Version: 2.1.33 Precedence: list List-Id: "Porting FreeBSD to ARM processors." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 01 Nov 2020 02:22:51 -0000 On Sat, Oct 31, 2020 at 09:59:38PM +0200, Stefan Parvu wrote: > Hi, > > We have started now testing our product using FreeBSD 12.2 on RPI3 and 3B+. > > I have a question how one can start to disable things from the board which are not needed, to save as much as possible power. For example starting with HDMI port. I am trying to do some basic tests running our data recorders with FreeBSD 12.2 only on batteries. (4 x 18650 Li-ion 3500 mAh). Would it boot from batteries. Has anyone tried before this? At one time ISTR that no monitor in the HDMI port on powerup turned off the port, at least to the extent that if a monitor was subsequently plugged in it got no signal. Not sure if this is still true, nor whether it actually reduced power consumption. hth, bob prohaska From owner-freebsd-arm@freebsd.org Sun Nov 1 11:28:27 2020 Return-Path: Delivered-To: freebsd-arm@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 447E244A6A6 for ; Sun, 1 Nov 2020 11:28:27 +0000 (UTC) (envelope-from ronald-lists@klop.ws) Received: from smarthost1.greenhost.nl (smarthost1.greenhost.nl [195.190.28.88]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4CPDLy1t83z42V7; Sun, 1 Nov 2020 11:28:26 +0000 (UTC) (envelope-from ronald-lists@klop.ws) Received: from smtp.greenhost.nl ([213.108.110.112]) by smarthost1.greenhost.nl with esmtps (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.89) (envelope-from ) id 1kZBX5-0003fh-Td; Sun, 01 Nov 2020 12:28:24 +0100 DKIM-Signature: v=1; a=rsa-sha256; q=dns/txt; c=relaxed/relaxed; d=klop.ws; s=mail; h=In-Reply-To:Message-ID:From:Content-Transfer-Encoding:MIME-Version: Date:References:Subject:Cc:To:Content-Type:Sender:Reply-To:Content-ID: Content-Description:Resent-Date:Resent-From:Resent-Sender:Resent-To:Resent-Cc :Resent-Message-ID:List-Id:List-Help:List-Unsubscribe:List-Subscribe: List-Post:List-Owner:List-Archive; bh=FXyCYuwa3kCSu70DEkGsICGdGYiMPH9cGHUqg1jPV6Q=; b=ojLfHx3Rxxfo2LQ8w97VUwcoIX UJNRsgRd5Vb4ompTFqL0sKlobccgNl+1Zjg43BHiOmTUhWlQ4yssx2a24se3tMEegRWNmEb226gzO gRoCEIBdmu8TSOER5vPhY+gw/sSrRyIx8c7sW9eLnHDpTGonZL3cGf2Zg3VeZ4toU96g=; Content-Type: text/plain; charset=utf-8; format=flowed; delsp=yes To: "Steve Wills" , "Kurt Jaeger" Cc: freebsd-arm@freebsd.org, "Cluster Administrators" Subject: Re: aarch64 pkg build seems broken/hanging References: <735767609.10.1597159067683@localhost> <504493339.1.1597829845980@localhost> <1268679721.21.1598955250524@localhost> <2128344036.116.1599572445531@localhost> <93ab93ce-8887-315e-c775-0929c716032a@FreeBSD.org> <20200909142039.GK53210@home.opsec.eu> Date: Sun, 01 Nov 2020 12:28:24 +0100 MIME-Version: 1.0 Content-Transfer-Encoding: 7bit From: "Ronald Klop" Message-ID: In-Reply-To: <20200909142039.GK53210@home.opsec.eu> User-Agent: Opera Mail/12.16 (FreeBSD) X-Authenticated-As-Hash: 398f5522cb258ce43cb679602f8cfe8b62a256d1 X-Virus-Scanned: by clamav at smarthost1.samage.net X-Spam-Level: / X-Spam-Score: -0.4 X-Spam-Status: No, score=-0.4 required=5.0 tests=ALL_TRUSTED, BAYES_50, DKIM_SIGNED, DKIM_VALID, DKIM_VALID_AU, DKIM_VALID_EF autolearn=disabled version=3.4.2 X-Scan-Signature: 739ba1b2be5fabc1cc6069058737919f X-Rspamd-Queue-Id: 4CPDLy1t83z42V7 X-Spamd-Bar: -- Authentication-Results: mx1.freebsd.org; dkim=pass header.d=klop.ws header.s=mail header.b=ojLfHx3R; dmarc=none; spf=pass (mx1.freebsd.org: domain of ronald-lists@klop.ws designates 195.190.28.88 as permitted sender) smtp.mailfrom=ronald-lists@klop.ws X-Spamd-Result: default: False [-2.15 / 15.00]; RCVD_TLS_ALL(0.00)[]; ARC_NA(0.00)[]; R_DKIM_ALLOW(-0.20)[klop.ws:s=mail]; NEURAL_HAM_MEDIUM(-0.99)[-0.990]; FROM_HAS_DN(0.00)[]; RCPT_COUNT_THREE(0.00)[4]; TO_DN_SOME(0.00)[]; R_SPF_ALLOW(-0.20)[+ip4:195.190.28.64/27]; MIME_GOOD(-0.10)[text/plain]; DMARC_NA(0.00)[klop.ws]; NEURAL_HAM_LONG(-0.99)[-0.990]; RWL_MAILSPIKE_GOOD(0.00)[195.190.28.88:from]; TO_MATCH_ENVRCPT_SOME(0.00)[]; DKIM_TRACE(0.00)[klop.ws:+]; NEURAL_HAM_SHORT(-0.17)[-0.167]; RCVD_IN_DNSWL_NONE(0.00)[195.190.28.88:from]; FROM_EQ_ENVFROM(0.00)[]; MIME_TRACE(0.00)[0:+]; MID_RHS_NOT_FQDN(0.50)[]; ASN(0.00)[asn:47172, ipnet:195.190.28.0/24, country:NL]; RCVD_COUNT_TWO(0.00)[2]; MAILMAN_DEST(0.00)[freebsd-arm] X-BeenThere: freebsd-arm@freebsd.org X-Mailman-Version: 2.1.33 Precedence: list List-Id: "Porting FreeBSD to ARM processors." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 01 Nov 2020 11:28:27 -0000 On Wed, 09 Sep 2020 16:20:39 +0200, Kurt Jaeger wrote: > Hi! > >> Sorry, but this is not a portmgr@ issue, this is a clusteradm@ issue. > > philip@ (with clusteradm@ hat) checked the issue and explained the > cause of the problem: > > The thunderx hardware currently in use in the cluster is a very early > version and has stability issues. A replacement is @work. > Dear clusteradm, I don't want to be pushing the issue, but do you have some information about the progress of the aarch64 hardware issues? Regards, Ronald. From owner-freebsd-arm@freebsd.org Sun Nov 1 18:48:48 2020 Return-Path: Delivered-To: freebsd-arm@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id D6BC84562AC; Sun, 1 Nov 2020 18:48:48 +0000 (UTC) (envelope-from kp@FreeBSD.org) Received: from smtp.freebsd.org (smtp.freebsd.org [96.47.72.83]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "smtp.freebsd.org", Issuer "Let's Encrypt Authority X3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4CPQ745KXpz4S1n; Sun, 1 Nov 2020 18:48:48 +0000 (UTC) (envelope-from kp@FreeBSD.org) Received: from venus.codepro.be (venus.codepro.be [5.9.86.228]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client CN "mx1.codepro.be", Issuer "Let's Encrypt Authority X3" (verified OK)) (Authenticated sender: kp) by smtp.freebsd.org (Postfix) with ESMTPSA id 81081263AE; Sun, 1 Nov 2020 18:48:48 +0000 (UTC) (envelope-from kp@FreeBSD.org) Received: by venus.codepro.be (Postfix, authenticated sender kp) id 59CCB3F557; Sun, 1 Nov 2020 19:48:46 +0100 (CET) From: "Kristof Provost" To: "Carsten =?utf-8?q?B=C3=A4cker?=" Cc: "John-Mark Gurney" , freebsd-hackers@freebsd.org, freebsd-arm@freebsd.org Subject: Re: Problem with checksum offloading on RPi3 (PF + Jails involved) Date: Sun, 01 Nov 2020 19:48:45 +0100 X-Mailer: MailMate (1.13.2r5673) Message-ID: In-Reply-To: References: <748edc3d-4ef7-c4de-291f-7c0b460a6052@gmx.de> <5130ee46-5832-d4df-d774-c6bd32e10b30@gmx.de> <20201029213622.GM31099@funkthat.com> <55713894-A896-4F12-ABB9-93DFEB2F16B9@FreeBSD.org> MIME-Version: 1.0 Content-Type: text/plain; charset="UTF-8"; format=flowed Content-Transfer-Encoding: 8bit X-BeenThere: freebsd-arm@freebsd.org X-Mailman-Version: 2.1.33 Precedence: list List-Id: "Porting FreeBSD to ARM processors." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 01 Nov 2020 18:48:48 -0000 On 31 Oct 2020, at 16:06, Carsten Bäcker wrote: > Am 29.10.2020 um 22:39 schrieb Kristof Provost: >> >> On 29 Oct 2020, at 22:36, John-Mark Gurney wrote: >> >> Kristof Provost wrote this message on Thu, Oct 29, 2020 at 21:30 >> +0100: >> >> On 29 Oct 2020, at 16:30, Carsten Bäcker wrote: >> >> Sure, i am willing to help. >> >> Device is a Raspberry Pi 3B (not +), using the >> onboard-ethernet. >> I attached a bunch of information. >> >> Configuration is stripped down to the minimum required to >> reproduce >> the >> problem. >> >> Okay, so that???s an SMC2 LAN9514_ETH device. >> That???s the dev/usb/net/if_smsc.c driver. >> >> However, before we dig into that driver we should make sure >> that we???re >> really looking at a checksum problem. >> It???s entirely normal for TX checksums to be incorrect when >> logged on >> the sending host itself (if the hardware does checksum >> offloading the >> checksum in the packet sent to the MAC is incorrect, and left >> to the >> hardware to fix). >> >> So, can you confirm that the `"[bad udp cksum 0xe58a -> >> 0x482d!]` you >> reported was on an inbound packet? And let???s be safe: try >> to >> capture >> packets on a different machine. That???ll give us the true >> packet, after >> the hardware has done checksum calculations. >> >> One interesting point is that the smsc driver claims to not do TX >> offload, >> and a brief check shows that it doesn't allow a user to set the >> TXCSUM. >> >> It does seem to do RX offload, and the comments in the driver suggest >> some .. ahem, creative hardware behaviour: >> >> |/* The checksum appears to be simplistically calculated * over the >> udp/tcp header and data up to the end of the * eth frame. Which means >> if the eth frame is padded * the csum calculation is incorrectly >> performed over * the padding bytes as well. Therefore to be safe we * >> ignore the H/W csum on frames less than or equal to * 64 bytes. * * >> Ignore H/W csum for non-IPv4 packets. */ | >> >> It’s not impossible that there’s some more issues like that in >> the >> hardware, or even that there are different chip revisions out there. >> >> That also matches up with |ifconfig ue0 -rxcsum| fixing things. >> >> Best regards, >> Kristof >> > Hello again, > > just gave it another try, using "ping heise.de" (twice) from within > the > jail. > > This is the output of tcpdump: > # tcpdump -i pflog0 -vv > tcpdump: listening on pflog0, link-type PFLOG (OpenBSD pflog file), > capture size 262144 bytes > 14:06:04.293996 IP (tos 0x0, ttl 64, id 19576, offset 0, flags [none], > proto UDP (17), length 54) >     PC-192-168-178-3.fritz.box.52421 > fritz.box.domain: [bad udp > cksum > 0xe589 -> 0x0a2c!] 64654+ A? heise.de. (26) > > Netstat: > # netstat -s -p udp | grep checksum >         4 with bad checksum >         0 with no checksum > > Packet-capture from the router is attached. > Okay… but that doesn’t actually demonstrate anything at all. It shows an outbound packet with an incorrect checksum. See what I’ve mentioned before about checksums potentially being calculated by hardware. Given that there’s been a reply to that DNS query the checksum clearly got set correctly after the packet was captured. Best, Kristof From owner-freebsd-arm@freebsd.org Sun Nov 1 19:25:17 2020 Return-Path: Delivered-To: freebsd-arm@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 660DF457897 for ; Sun, 1 Nov 2020 19:25:17 +0000 (UTC) (envelope-from guyyur@gmail.com) Received: from mail-wm1-x32f.google.com (mail-wm1-x32f.google.com [IPv6:2a00:1450:4864:20::32f]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "GTS CA 1O1" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4CPQx839tPz4V39 for ; Sun, 1 Nov 2020 19:25:16 +0000 (UTC) (envelope-from guyyur@gmail.com) Received: by mail-wm1-x32f.google.com with SMTP id h62so2627611wme.3 for ; Sun, 01 Nov 2020 11:25:16 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=from:subject:to:message-id:date:user-agent:mime-version :content-transfer-encoding:content-language; bh=BElR/rNyb6BfRf6KOicsugmCuJzFX4iNfyJaLYqBtl0=; b=Up940sLX+kecyODToe4FoPapYMFJ4xfZsqRNk6RMg6d7UOC07LuJG06usl7PgdfuD/ 6+FZFrckiusq6YLIOjQGYM4tV8E1v6xX6eha1IdziAb45f9CAkz0ArPD4vMooitr+HqG 7CZj2yRwSGSo+oZctTcoQDXwguyNzWRocgy1XdR90yM3KDrTKOOS0eoRnt51lFRQLzYh LSYsZ927IAEbuSX56/vlSIcdarb6NN1L7cXqLg4YKmqy/AbqZGq0eoPQNb6pL0bYAFSr VMW1Kj7D4jIxfpJQPRFqwkMOXGFLSC89aF45C+E699tjDPHTbjE+0NgoESQaiS8gk+PS rP1Q== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:from:subject:to:message-id:date:user-agent :mime-version:content-transfer-encoding:content-language; bh=BElR/rNyb6BfRf6KOicsugmCuJzFX4iNfyJaLYqBtl0=; b=QTof4eAATWIu+PenWj9qi5B3ycoqGYWE+CrKMZ1tcRCm6cY/7T7VNIE2Wp5OfOZed6 o33Ys9yk40s86vnycV5rIACcnYoa5KcOCsTb/RW76taWFc15AYH9vFyWPqFoiVtkl2Ej IYTMi0ZPEMWrxJTOtxyxztoNLAX0fGTvnDhX0cH6mE5YCiNmdxpQSWy0Kty3o3dpA135 1trBMPi9jfAgFQhC3F0XpMFadiibhTEfLv3vms2dA/c6XoGo6n0sndx1VgR/HBBMZ0ps dEFuRYbWtnQSWmA+nYbP/3tm0BLmWw35EMFwJW4H135kPdfABIW+ZXOcbVJx8/Rj5/rL G4Qw== X-Gm-Message-State: AOAM530SuUfe68buSAe0/Hyhl01UNSg0qUQDdvKbp4i4ArWmRWx9FBjX 97n4nGI5HFtuYLPttA7ataB+uFKC4OhY5A== X-Google-Smtp-Source: ABdhPJwyGy3TAqxFtFQenDpXufJAyYs10XGCJZ3XODAhq+ZrPZnIP8Ix6Aj4ckJpHRwICXnfZnQIGQ== X-Received: by 2002:a1c:60d4:: with SMTP id u203mr13884465wmb.103.1604258714338; Sun, 01 Nov 2020 11:25:14 -0800 (PST) Received: from ?IPv6:2a02:ed0:3374:ec01:6345:9de0:de1b:fc81? ([2a02:ed0:3374:ec01:6345:9de0:de1b:fc81]) by smtp.gmail.com with ESMTPSA id o184sm12575041wmo.37.2020.11.01.11.25.13 for (version=TLS1_3 cipher=TLS_AES_128_GCM_SHA256 bits=128/128); Sun, 01 Nov 2020 11:25:13 -0800 (PST) From: Guy Yur Subject: u-boot 2020.07 fails to see BOOTARM.EFI on fat partition with custom installation To: freebsd-arm@freebsd.org Message-ID: <18d7b209-959e-7c4b-1d5e-1c7b9506783c@gmail.com> Date: Sun, 1 Nov 2020 21:25:12 +0200 User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:68.0) Gecko/20100101 Thunderbird/68.12.0 MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8; format=flowed Content-Transfer-Encoding: 8bit Content-Language: en-US X-Rspamd-Queue-Id: 4CPQx839tPz4V39 X-Spamd-Bar: --- Authentication-Results: mx1.freebsd.org; dkim=pass header.d=gmail.com header.s=20161025 header.b=Up940sLX; dmarc=pass (policy=none) header.from=gmail.com; spf=pass (mx1.freebsd.org: domain of guyyur@gmail.com designates 2a00:1450:4864:20::32f as permitted sender) smtp.mailfrom=guyyur@gmail.com X-Spamd-Result: default: False [-3.26 / 15.00]; RCVD_VIA_SMTP_AUTH(0.00)[]; FREEMAIL_FROM(0.00)[gmail.com]; R_SPF_ALLOW(-0.20)[+ip6:2a00:1450:4000::/36]; TO_DN_NONE(0.00)[]; RCVD_COUNT_THREE(0.00)[3]; DKIM_TRACE(0.00)[gmail.com:+]; DMARC_POLICY_ALLOW(-0.50)[gmail.com,none]; NEURAL_HAM_SHORT(-0.28)[-0.283]; FROM_EQ_ENVFROM(0.00)[]; MIME_TRACE(0.00)[0:+]; FREEMAIL_ENVFROM(0.00)[gmail.com]; ASN(0.00)[asn:15169, ipnet:2a00:1450::/32, country:US]; MID_RHS_MATCH_FROM(0.00)[]; DWL_DNSWL_NONE(0.00)[gmail.com:dkim]; ARC_NA(0.00)[]; NEURAL_HAM_MEDIUM(-0.98)[-0.983]; R_DKIM_ALLOW(-0.20)[gmail.com:s=20161025]; FROM_HAS_DN(0.00)[]; TO_MATCH_ENVRCPT_ALL(0.00)[]; NEURAL_HAM_LONG(-0.99)[-0.991]; MIME_GOOD(-0.10)[text/plain]; PREVIOUSLY_DELIVERED(0.00)[freebsd-arm@freebsd.org]; RCPT_COUNT_ONE(0.00)[1]; RCVD_IN_DNSWL_NONE(0.00)[2a00:1450:4864:20::32f:from]; RCVD_TLS_ALL(0.00)[]; MAILMAN_DEST(0.00)[freebsd-arm] X-BeenThere: freebsd-arm@freebsd.org X-Mailman-Version: 2.1.33 Precedence: list List-Id: "Porting FreeBSD to ARM processors." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 01 Nov 2020 19:25:17 -0000 Hi, u-boot 2020.01 through 2020.07 have a regression where u-boot only sees shortname files on the fat filesystem if they have the archive attribute set. The issue was fixed in u-boot 2020.10: https://github.com/u-boot/u-boot/commit/1788a9697f51aebb25623e6216c09304756748ff Are there plans to update u-boot-master port to 2020.10? The issue doesn't affect images created by makefs which sets the flag. When doing custom steps (newfs_msdos, mount, copy loader.efi to EFI/BOOT/BOOTARM.EFI and umount),if the source file is on UFS, the target file will not have UF_ARCHIVE set. u-boot will fail to see BOOTARM.EFI and the system will not boot. Specifically, this happened to me with u-boot-orangepi-pc. 0040c440  42 4f 4f 54 41 52 4d 20  45 46 49 00 00 83 d3 9e |BOOTARM EFI.....| 0040c450  5f 51 5f 51 00 00 d3 9e  5f 51 8f 00 a8 a7 08 00  |_Q_Q...._Q......| Thanks, Guy Yur From owner-freebsd-arm@freebsd.org Sun Nov 1 20:43:05 2020 Return-Path: Delivered-To: freebsd-arm@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 09F6E459ABF for ; Sun, 1 Nov 2020 20:43:05 +0000 (UTC) (envelope-from manu@bidouilliste.com) Received: from mx.blih.net (mx.blih.net [212.83.155.74]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "mx.blih.net", Issuer "Let's Encrypt Authority X3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4CPSfv0nvDz4ZFF for ; Sun, 1 Nov 2020 20:43:02 +0000 (UTC) (envelope-from manu@bidouilliste.com) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=bidouilliste.com; s=mx; t=1604263374; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=Ba+Ja/TZHAhRU4/5EVq+EbaG+LlNjGJIAWdFrxXIla0=; b=CSiyGSI5k5h/erpWU/yGBs1afygDaIi/xtPB92wjAO7AOb3BsluKTJWbkNM2VASmDjbHNJ n55/SMC47aqrlShsqFfCcC0BZVdlxvuzpJkEN+N30T/9pVUKgEYCkrqMkIUpJTWDtVagnv fnIOkN6zGAGXJZRQ5rF9xjhyqnH/qjk= Received: from amy.home (lfbn-idf2-1-288-247.w82-123.abo.wanadoo.fr [82.123.126.247]) by mx.blih.net (OpenSMTPD) with ESMTPSA id a3da29a7 (TLSv1.3:TLS_AES_256_GCM_SHA384:256:NO); Sun, 1 Nov 2020 20:42:54 +0000 (UTC) Date: Sun, 1 Nov 2020 21:42:54 +0100 From: Emmanuel Vadot To: Guy Yur Cc: freebsd-arm@freebsd.org Subject: Re: u-boot 2020.07 fails to see BOOTARM.EFI on fat partition with custom installation Message-Id: <20201101214254.149936656f5cea099c85eb9c@bidouilliste.com> In-Reply-To: <18d7b209-959e-7c4b-1d5e-1c7b9506783c@gmail.com> References: <18d7b209-959e-7c4b-1d5e-1c7b9506783c@gmail.com> X-Mailer: Sylpheed 3.7.0 (GTK+ 2.24.32; amd64-portbld-freebsd13.0) Mime-Version: 1.0 Content-Type: text/plain; charset=ISO-8859-1 Content-Transfer-Encoding: quoted-printable X-Rspamd-Queue-Id: 4CPSfv0nvDz4ZFF X-Spamd-Bar: -- Authentication-Results: mx1.freebsd.org; dkim=pass header.d=bidouilliste.com header.s=mx header.b=CSiyGSI5; dmarc=pass (policy=none) header.from=bidouilliste.com; spf=pass (mx1.freebsd.org: domain of manu@bidouilliste.com designates 212.83.155.74 as permitted sender) smtp.mailfrom=manu@bidouilliste.com X-Spamd-Result: default: False [-2.62 / 15.00]; RCVD_TLS_ALL(0.00)[]; RCVD_VIA_SMTP_AUTH(0.00)[]; R_DKIM_ALLOW(-0.20)[bidouilliste.com:s=mx]; FREEFALL_USER(0.00)[manu]; FROM_HAS_DN(0.00)[]; TO_DN_SOME(0.00)[]; MV_CASE(0.50)[]; MID_RHS_MATCH_FROM(0.00)[]; MIME_GOOD(-0.10)[text/plain]; R_SPF_ALLOW(-0.20)[+mx]; ARC_NA(0.00)[]; NEURAL_HAM_LONG(-1.02)[-1.016]; TO_MATCH_ENVRCPT_SOME(0.00)[]; DKIM_TRACE(0.00)[bidouilliste.com:+]; RCPT_COUNT_TWO(0.00)[2]; DMARC_POLICY_ALLOW(-0.50)[bidouilliste.com,none]; NEURAL_HAM_SHORT(-0.13)[-0.128]; NEURAL_HAM_MEDIUM(-0.97)[-0.972]; FREEMAIL_TO(0.00)[gmail.com]; FROM_EQ_ENVFROM(0.00)[]; MIME_TRACE(0.00)[0:+]; ASN(0.00)[asn:12876, ipnet:212.83.128.0/19, country:FR]; RCVD_COUNT_TWO(0.00)[2]; MAILMAN_DEST(0.00)[freebsd-arm] X-BeenThere: freebsd-arm@freebsd.org X-Mailman-Version: 2.1.33 Precedence: list List-Id: "Porting FreeBSD to ARM processors." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 01 Nov 2020 20:43:05 -0000 On Sun, 1 Nov 2020 21:25:12 +0200 Guy Yur wrote: > Hi, >=20 > u-boot 2020.01 through 2020.07 have a regression where u-boot only sees > shortname files on the fat filesystem if they have the archive attribute= =20 > set. >=20 > The issue was fixed in u-boot 2020.10: > https://github.com/u-boot/u-boot/commit/1788a9697f51aebb25623e6216c093047= 56748ff >=20 > Are there plans to update u-boot-master port to 2020.10? Yes, I have the update ready but this broke a few things in the rockpro64 port. I'll backport the fix next week if I didn't find time to fix everything else needed for the 2020.10 update. Thanks for the report. > The issue doesn't affect images created by makefs which sets the flag. > When doing custom steps (newfs_msdos, mount, copy loader.efi to > EFI/BOOT/BOOTARM.EFI and umount),if the source file is on UFS, > the target file will not have UF_ARCHIVE set. > u-boot will fail to see BOOTARM.EFI and the system will not boot. >=20 > Specifically, this happened to me with u-boot-orangepi-pc. >=20 > 0040c440=A0 42 4f 4f 54 41 52 4d 20=A0 45 46 49 00 00 83 d3 9e |BOOTARM=20 > EFI.....| > 0040c450=A0 5f 51 5f 51 00 00 d3 9e=A0 5f 51 8f 00 a8 a7 08 00=A0=20 > |_Q_Q...._Q......| >=20 > Thanks, > Guy Yur >=20 > _______________________________________________ > freebsd-arm@freebsd.org mailing list > https://lists.freebsd.org/mailman/listinfo/freebsd-arm > To unsubscribe, send any mail to "freebsd-arm-unsubscribe@freebsd.org" --=20 Emmanuel Vadot From owner-freebsd-arm@freebsd.org Mon Nov 2 05:19:32 2020 Return-Path: Delivered-To: freebsd-arm@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 300F03F5172; Mon, 2 Nov 2020 05:19:32 +0000 (UTC) (envelope-from fbsd@www.zefox.net) Received: from www.zefox.net (www.zefox.net [50.1.20.27]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "www.zefox.com", Issuer "www.zefox.com" (not verified)) by mx1.freebsd.org (Postfix) with ESMTPS id 4CPh6p6cCwz43fd; Mon, 2 Nov 2020 05:19:30 +0000 (UTC) (envelope-from fbsd@www.zefox.net) Received: from www.zefox.net (localhost [127.0.0.1]) by www.zefox.net (8.15.2/8.15.2) with ESMTPS id 0A25Jcoe023334 (version=TLSv1.3 cipher=TLS_AES_256_GCM_SHA384 bits=256 verify=NO); Sun, 1 Nov 2020 21:19:38 -0800 (PST) (envelope-from fbsd@www.zefox.net) Received: (from fbsd@localhost) by www.zefox.net (8.15.2/8.15.2/Submit) id 0A25JblZ023333; Sun, 1 Nov 2020 21:19:37 -0800 (PST) (envelope-from fbsd) Date: Sun, 1 Nov 2020 21:19:37 -0800 From: bob prohaska To: freebsd-ports@freebsd.org, freebsd-arm@freebsd.org Subject: Re: [Bug 246982] www/chromium: fatal error: 'asm/hwcap.h' file not found Message-ID: <20201102051937.GA23325@www.zefox.net> References: MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: X-Rspamd-Queue-Id: 4CPh6p6cCwz43fd X-Spamd-Bar: + Authentication-Results: mx1.freebsd.org; dkim=none; dmarc=none; spf=none (mx1.freebsd.org: domain of fbsd@www.zefox.net has no SPF policy when checking 50.1.20.27) smtp.mailfrom=fbsd@www.zefox.net X-Spamd-Result: default: False [1.28 / 15.00]; RCVD_TLS_ALL(0.00)[]; ARC_NA(0.00)[]; WWW_DOT_DOMAIN(0.50)[]; MID_RHS_MATCH_FROM(0.00)[]; FROM_HAS_DN(0.00)[]; RCPT_COUNT_THREE(0.00)[3]; TO_DN_SOME(0.00)[]; NEURAL_HAM_LONG(-0.72)[-0.716]; MIME_GOOD(-0.10)[text/plain]; DMARC_NA(0.00)[zefox.net]; AUTH_NA(1.00)[]; NEURAL_SPAM_SHORT(0.45)[0.453]; TO_MATCH_ENVRCPT_SOME(0.00)[]; NEURAL_HAM_MEDIUM(-0.36)[-0.361]; R_SPF_NA(0.00)[no SPF record]; FROM_EQ_ENVFROM(0.00)[]; R_DKIM_NA(0.00)[]; MIME_TRACE(0.00)[0:+]; ASN(0.00)[asn:7065, ipnet:50.1.16.0/20, country:US]; RCVD_COUNT_TWO(0.00)[2]; MAILMAN_DEST(0.00)[freebsd-ports,freebsd-arm]; MID_RHS_WWW(0.50)[] X-BeenThere: freebsd-arm@freebsd.org X-Mailman-Version: 2.1.33 Precedence: list List-Id: "Porting FreeBSD to ARM processors." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 02 Nov 2020 05:19:32 -0000 Alas, the bug appears to be back with chromium-85.0.4183.121 Thanks for reading, bob prohaska On Wed, Jun 10, 2020 at 06:23:45PM +0000, bugzilla-noreply@freebsd.org wrote: > https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=246982 > > --- Comment #4 from commit-hook@freebsd.org --- > A commit references this bug: > > Author: mikael > Date: Wed Jun 10 18:23:25 UTC 2020 > New revision: 538423 > URL: https://svnweb.freebsd.org/changeset/ports/538423 > > Log: > www/chromium: fix build on aarch64 > > PR: 246982 > Approved by: portmgr (tier-2 blanket) > > Changes: > head/www/chromium/files/patch-third__party_zlib_BUILD.gn > head/www/chromium/files/patch-third_party_zlib_cpu__features.c > > -- > You are receiving this mail because: > You reported the bug. From owner-freebsd-arm@freebsd.org Mon Nov 2 05:50:20 2020 Return-Path: Delivered-To: freebsd-arm@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id E8E7C3F5BFC; Mon, 2 Nov 2020 05:50:20 +0000 (UTC) (envelope-from yklaxds@gmail.com) Received: from mail-io1-xd32.google.com (mail-io1-xd32.google.com [IPv6:2607:f8b0:4864:20::d32]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "GTS CA 1O1" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4CPhpM6tJCz448P; Mon, 2 Nov 2020 05:50:19 +0000 (UTC) (envelope-from yklaxds@gmail.com) Received: by mail-io1-xd32.google.com with SMTP id z5so13835388iob.1; Sun, 01 Nov 2020 21:50:19 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=mime-version:from:date:message-id:subject:to; bh=w47f/RVLY+BExDl+dF3XvHdQvXFgOKxxoCo3vS+vRCs=; b=PTznBCchF3h5AJl5vqzR6TTuOIIJbKGOs6SRBTC13bpybIIgevj4fVvNUR+DxNE1D1 8Dblgc2y2day2ItS+J3r9V9C5gSfEwZ/2u65Cjs2ktDuNEWZUPPFqNUMXdEO08VmKr7a koS6Xh4V5+tUrnYzjLq5GFR3cjByafbYQydn1aBjbxRsm+8iU8vPe64mRa/riijEi+gj U3PHccp9MNz+ezwwttI51QVBw0rQaLPvMpRqc9z2TnEH3pSP7OolyQg1SGbu/0K0zUgn DkrxW+1Bxy5g7zV6gVcwe9L1x0yrHfobVw0eYiDFvDKo8wLUfqbzLiANKNj2649PotVZ ZbIA== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:from:date:message-id:subject:to; bh=w47f/RVLY+BExDl+dF3XvHdQvXFgOKxxoCo3vS+vRCs=; b=YNBo3H0QhVe79D9Ot5jpy3CmyBnVXMiBylfZqx1d6audRSbaOrQMxKNdw0Q8pIT/bL 02RRaRxDx3AuaaUQd8Lldk0VK7rptA9f12HX5nS+vPhU1mHGrfuCrQoBb6YiTeNSEfi5 KGfubhQuzcaKdhYS6EF0QEvdJzvhOrAnkvkLo8GMkHzL/kkl5vn7oPbCF/OgYbIg47Gm cep4zYmQXW+e23bdV5ckXKzgi6BsnXYMtnegrVR/Zyu/xhq+fe0b+0j3Fl6LhSWpwCZD RLMx3FeugFvCBBSwaJuIj8sgOIv5psoxSfxUhOL63PrOARYB0Dg9RjCnYvcezi9iUM+j ZEhA== X-Gm-Message-State: AOAM532AI8yD/+Zbscqt8IB+D2wsaFUV1sH0YfKkEPq5X/wYPtvtjbao Az8QirV/fn9ePBSkQh9w2u7FlMjfPpGzGjjb8H/2/6WAsI0= X-Google-Smtp-Source: ABdhPJxj7tWvwascEBlVBA7g0zEWYK9sPmGzLMMFNDRre++H+VQDcT6mLgNpuqyfZ2rnamliQs7FZHPgu6P5sVoFlcA= X-Received: by 2002:a02:7c4:: with SMTP id f187mr10389984jaf.91.1604296218653; Sun, 01 Nov 2020 21:50:18 -0800 (PST) MIME-Version: 1.0 Received: by 2002:a92:a10e:0:0:0:0:0 with HTTP; Sun, 1 Nov 2020 21:50:18 -0800 (PST) From: ykla Date: Mon, 2 Nov 2020 13:50:18 +0800 Message-ID: Subject: Please update misc/raspberrypi-userland To: freebsd-arm@freebsd.org, freebsd-ports@freebsd.org X-Rspamd-Queue-Id: 4CPhpM6tJCz448P X-Spamd-Bar: --- Authentication-Results: mx1.freebsd.org; dkim=pass header.d=gmail.com header.s=20161025 header.b=PTznBCch; dmarc=pass (policy=none) header.from=gmail.com; spf=pass (mx1.freebsd.org: domain of yklaxds@gmail.com designates 2607:f8b0:4864:20::d32 as permitted sender) smtp.mailfrom=yklaxds@gmail.com X-Spamd-Result: default: False [-3.48 / 15.00]; RCVD_TLS_ALL(0.00)[]; ARC_NA(0.00)[]; R_DKIM_ALLOW(-0.20)[gmail.com:s=20161025]; NEURAL_HAM_MEDIUM(-0.99)[-0.988]; FROM_HAS_DN(0.00)[]; FREEMAIL_FROM(0.00)[gmail.com]; TO_MATCH_ENVRCPT_ALL(0.00)[]; MIME_GOOD(-0.10)[multipart/alternative,text/plain]; TO_DN_NONE(0.00)[]; NEURAL_HAM_LONG(-1.00)[-0.996]; R_SPF_ALLOW(-0.20)[+ip6:2607:f8b0:4000::/36]; DKIM_TRACE(0.00)[gmail.com:+]; RCPT_COUNT_TWO(0.00)[2]; RCVD_IN_DNSWL_NONE(0.00)[2607:f8b0:4864:20::d32:from]; NEURAL_HAM_SHORT(-0.50)[-0.500]; DMARC_POLICY_ALLOW(-0.50)[gmail.com,none]; FROM_EQ_ENVFROM(0.00)[]; MIME_TRACE(0.00)[0:+,1:+,2:~]; FREEMAIL_ENVFROM(0.00)[gmail.com]; ASN(0.00)[asn:15169, ipnet:2607:f8b0::/32, country:US]; RCVD_COUNT_TWO(0.00)[2]; MAILMAN_DEST(0.00)[freebsd-arm,freebsd-ports]; DWL_DNSWL_NONE(0.00)[gmail.com:dkim] Content-Type: text/plain; charset="UTF-8" X-Content-Filtered-By: Mailman/MimeDel 2.1.33 X-BeenThere: freebsd-arm@freebsd.org X-Mailman-Version: 2.1.33 Precedence: list List-Id: "Porting FreeBSD to ARM processors." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 02 Nov 2020 05:50:21 -0000 Hi, There is no maintainer for misc/raspberrypi-userland. And this package is not update for a long time. If someone could update It to support raspberry pi? thanks. From owner-freebsd-arm@freebsd.org Mon Nov 2 15:16:23 2020 Return-Path: Delivered-To: freebsd-arm@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 541FA4542C0 for ; Mon, 2 Nov 2020 15:16:23 +0000 (UTC) (envelope-from philip@freebsd.org) Received: from smtp.freebsd.org (smtp.freebsd.org [96.47.72.83]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "smtp.freebsd.org", Issuer "Let's Encrypt Authority X3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4CPxMW1YCyz4dwR; Mon, 2 Nov 2020 15:16:23 +0000 (UTC) (envelope-from philip@freebsd.org) Received: from weatherwax.trouble.is (weatherwax.trouble.is [46.235.227.50]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client CN "weatherwax.trouble.is", Issuer "Let's Encrypt Authority X3" (verified OK)) (Authenticated sender: philip/mail) by smtp.freebsd.org (Postfix) with ESMTPSA id 00F0B2FF7F; Mon, 2 Nov 2020 15:16:22 +0000 (UTC) (envelope-from philip@freebsd.org) Received: from rincewind.trouble.is (rincewind.trouble.is [IPv6:2a01:4f9:2a:1715::1:1]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) client-signature RSA-PSS (4096 bits)) (Client CN "rincewind.trouble.is", Issuer "Let's Encrypt Authority X3" (verified OK)) by weatherwax.trouble.is (Postfix) with ESMTPS id 4CPxMV1FfTz1kDp; Mon, 2 Nov 2020 15:16:22 +0000 (UTC) Received: by rincewind.trouble.is (Postfix, authenticated sender philip) id 4CPxMQ5Szbz516w; Mon, 2 Nov 2020 15:16:18 +0000 (UTC) From: "Philip Paeps" To: "Ronald Klop" Cc: "Steve Wills" , "Kurt Jaeger" , freebsd-arm@freebsd.org, "Cluster Administrators" Subject: Re: aarch64 pkg build seems broken/hanging Date: Mon, 02 Nov 2020 23:16:14 +0800 X-Clacks-Overhead: GNU Terry Pratchett X-Mailer: MailMate (1.13.2r5726) Message-ID: <4B49B4B6-FA22-4B73-BD50-E7023D889A97@freebsd.org> In-Reply-To: References: <735767609.10.1597159067683@localhost> <504493339.1.1597829845980@localhost> <1268679721.21.1598955250524@localhost> <2128344036.116.1599572445531@localhost> <93ab93ce-8887-315e-c775-0929c716032a@FreeBSD.org> <20200909142039.GK53210@home.opsec.eu> MIME-Version: 1.0 Content-Type: text/plain; format=flowed X-BeenThere: freebsd-arm@freebsd.org X-Mailman-Version: 2.1.33 Precedence: list List-Id: "Porting FreeBSD to ARM processors." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 02 Nov 2020 15:16:23 -0000 On 2020-11-01 19:28:24 (+0800), Ronald Klop wrote: > On Wed, 09 Sep 2020 16:20:39 +0200, Kurt Jaeger wrote: >>> Sorry, but this is not a portmgr@ issue, this is a clusteradm@ >>> issue. >> >> philip@ (with clusteradm@ hat) checked the issue and explained the >> cause of the problem: >> >> The thunderx hardware currently in use in the cluster is a very early >> version and has stability issues. A replacement is @work. > > I don't want to be pushing the issue, but do you have some information > about the progress of the aarch64 hardware issues? New hardware has reportedly been ordered and we're waiting for it to arrive at our NYI site. When the hardware turns up, we'll install it. Thanks for keeping our feet close to the fire! Philip -- Philip Paeps Senior Reality Engineer Alternative Enterprises From owner-freebsd-arm@freebsd.org Tue Nov 3 08:15:58 2020 Return-Path: Delivered-To: freebsd-arm@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 894BD45018F; Tue, 3 Nov 2020 08:15:58 +0000 (UTC) (envelope-from kp@FreeBSD.org) Received: from smtp.freebsd.org (smtp.freebsd.org [IPv6:2610:1c1:1:606c::24b:4]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "smtp.freebsd.org", Issuer "Let's Encrypt Authority X3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4CQMzy39W1z4lFR; Tue, 3 Nov 2020 08:15:58 +0000 (UTC) (envelope-from kp@FreeBSD.org) Received: from venus.codepro.be (venus.codepro.be [5.9.86.228]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client CN "mx1.codepro.be", Issuer "Let's Encrypt Authority X3" (verified OK)) (Authenticated sender: kp) by smtp.freebsd.org (Postfix) with ESMTPSA id 2437336CF2; Tue, 3 Nov 2020 08:15:58 +0000 (UTC) (envelope-from kp@FreeBSD.org) Received: by venus.codepro.be (Postfix, authenticated sender kp) id C46484D176; Tue, 3 Nov 2020 09:15:52 +0100 (CET) From: "Kristof Provost" To: "YongHyeon PYUN" Cc: "John-Mark Gurney" , "Carsten =?utf-8?q?B=C3=A4cker?=" , freebsd-hackers@freebsd.org, freebsd-arm@freebsd.org Subject: Re: Problem with checksum offloading on RPi3 (PF + Jails involved) Date: Tue, 03 Nov 2020 09:15:51 +0100 X-Mailer: MailMate (1.13.2r5673) Message-ID: In-Reply-To: <20201103045215.GA2524@michelle> References: <748edc3d-4ef7-c4de-291f-7c0b460a6052@gmx.de> <5130ee46-5832-d4df-d774-c6bd32e10b30@gmx.de> <20201029213622.GM31099@funkthat.com> <55713894-A896-4F12-ABB9-93DFEB2F16B9@FreeBSD.org> <20201103045215.GA2524@michelle> MIME-Version: 1.0 Content-Type: text/plain; charset="UTF-8"; format=flowed Content-Transfer-Encoding: quoted-printable X-BeenThere: freebsd-arm@freebsd.org X-Mailman-Version: 2.1.33 Precedence: list List-Id: "Porting FreeBSD to ARM processors." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 03 Nov 2020 08:15:58 -0000 On 3 Nov 2020, at 5:52, YongHyeon PYUN wrote: > > I'm not sure where the root cause is but it seems smsc(4) needs > improvement in RX checksum handling. That=E2=80=99s my thinking as well, yes. I=E2=80=99m not quite sure how t= hough, = because the received packet should contain full and correct checksums = regardless of the hardware=E2=80=99s checksum handling, so pf shouldn=E2=80= =99t have = any issues updating checksums. Ah, except that the driver also copies the checksum into the mbuf=E2=80=99= s = csum_data field, and if that checksum is wrong we would indeed see pf = update an incorrect checksum, and we=E2=80=99d get forwarded packets with= bad = checksums. That also matches with the observation that the problem goes = away when rx checksum offload is disabled. > Quick reading RX handler > indicates RX checksum offloading does not work when: > o IP datagram has IP options field > o TCP/UDP packet was fragmented > o UDP datagrams with 0 checksum value > See fxp(4), gem(4) and hme(4) for implementation. > > It looks like smsc(4) uses the following RX format but I don't > know actual RX format of H/W(no access to datasheet). > Happily Microchip do publish the datasheet: = http://ww1.microchip.com/downloads/en//softwarelibrary/man-lan95xx-dat/la= n9512_lan9512i%20databook%20rev.%201.2%20(03-01-12).pdf It may indeed be the case that this happens when the IP (or TCP) header = has options, but without a clear capture (or ideally, access to a setup = to reproduce the problem) it=E2=80=99s hard to tell. The datasheet has the great benefit of existing and being published, but = it does lack a bit of detail when it comes to the RX checksum offload = engine. > <---------------------------- actlen = > --------------------------------------------------> > <------------- pktlen ------------------------> > rxhdr(4 bytes) | padding (2 bytes) | RX frame | FCS(4 bytes) | partial = > checksum(2 bytes) > > If the format above is correct smsc(4) needs more strict RX length > validation(USB transfer size vs actual packet length). This > indicates smsc(4) does not have to copy FCS bytes. > Also given that H/W always appends FCS, it's also suspicious H/W > does not correctly compute RX checksum for frames less than or > equal to 64 bytes. > > I don't have H/W and some spare time to fix this though. :-( > Sadly I don=E2=80=99t have this hardware either. Best regards, Kristof From owner-freebsd-arm@freebsd.org Tue Nov 3 08:19:18 2020 Return-Path: Delivered-To: freebsd-arm@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 5EFCB45038F; Tue, 3 Nov 2020 08:19:18 +0000 (UTC) (envelope-from hps@selasky.org) Received: from mail.turbocat.net (turbocat.net [88.99.82.50]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4CQN3n10WZz4l5D; Tue, 3 Nov 2020 08:19:16 +0000 (UTC) (envelope-from hps@selasky.org) Received: from hps2020.home.selasky.org (unknown [178.17.145.105]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (2048 bits)) (No client certificate requested) by mail.turbocat.net (Postfix) with ESMTPSA id 82E582600E0; Tue, 3 Nov 2020 09:19:07 +0100 (CET) Subject: Re: Problem with checksum offloading on RPi3 (PF + Jails involved) To: YongHyeon PYUN , Kristof Provost Cc: John-Mark Gurney , =?UTF-8?Q?Carsten_B=c3=a4cker?= , freebsd-hackers@freebsd.org, freebsd-arm@freebsd.org References: <748edc3d-4ef7-c4de-291f-7c0b460a6052@gmx.de> <5130ee46-5832-d4df-d774-c6bd32e10b30@gmx.de> <20201029213622.GM31099@funkthat.com> <55713894-A896-4F12-ABB9-93DFEB2F16B9@FreeBSD.org> <20201103045215.GA2524@michelle> From: Hans Petter Selasky Message-ID: <46d08198-530c-cb4b-efa8-4edaf89471c1@selasky.org> Date: Tue, 3 Nov 2020 09:19:05 +0100 User-Agent: Mozilla/5.0 (X11; FreeBSD amd64; rv:68.0) Gecko/20100101 Thunderbird/68.10.0 MIME-Version: 1.0 In-Reply-To: <20201103045215.GA2524@michelle> Content-Type: text/plain; charset=utf-8; format=flowed Content-Language: en-US Content-Transfer-Encoding: 8bit X-Rspamd-Queue-Id: 4CQN3n10WZz4l5D X-Spamd-Bar: -- Authentication-Results: mx1.freebsd.org; dkim=none; dmarc=none; spf=pass (mx1.freebsd.org: domain of hps@selasky.org designates 88.99.82.50 as permitted sender) smtp.mailfrom=hps@selasky.org X-Spamd-Result: default: False [-2.10 / 15.00]; RCVD_TLS_ALL(0.00)[]; RCVD_VIA_SMTP_AUTH(0.00)[]; MID_RHS_MATCH_FROM(0.00)[]; FROM_HAS_DN(0.00)[]; TO_DN_SOME(0.00)[]; R_SPF_ALLOW(-0.20)[+a:mail.turbocat.net]; NEURAL_HAM_LONG(-1.02)[-1.023]; MIME_GOOD(-0.10)[text/plain]; DMARC_NA(0.00)[selasky.org]; ARC_NA(0.00)[]; RCPT_COUNT_FIVE(0.00)[6]; TO_MATCH_ENVRCPT_SOME(0.00)[]; NEURAL_SPAM_SHORT(0.19)[0.185]; NEURAL_HAM_MEDIUM(-0.96)[-0.964]; FREEMAIL_TO(0.00)[gmail.com,FreeBSD.org]; FROM_EQ_ENVFROM(0.00)[]; R_DKIM_NA(0.00)[]; MIME_TRACE(0.00)[0:+]; ASN(0.00)[asn:24940, ipnet:88.99.0.0/16, country:DE]; FREEMAIL_CC(0.00)[funkthat.com,gmx.de,freebsd.org]; MAILMAN_DEST(0.00)[freebsd-arm,freebsd-hackers]; RCVD_COUNT_TWO(0.00)[2] X-BeenThere: freebsd-arm@freebsd.org X-Mailman-Version: 2.1.33 Precedence: list List-Id: "Porting FreeBSD to ARM processors." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 03 Nov 2020 08:19:18 -0000 On 2020-11-03 05:52, YongHyeon PYUN wrote: > On Thu, Oct 29, 2020 at 10:39:39PM +0100, Kristof Provost wrote: > > [...] > >> It does seem to do RX offload, and the comments in the driver suggest some >> .. ahem, creative hardware behaviour: >> >> /* The checksum appears to be simplistically calculated >> * over the udp/tcp header and data up to the end of the >> * eth frame. Which means if the eth frame is padded >> * the csum calculation is incorrectly performed over >> * the padding bytes as well. Therefore to be safe we >> * ignore the H/W csum on frames less than or equal to >> * 64 bytes. >> * >> * Ignore H/W csum for non-IPv4 packets. >> */ >> >> It’s not impossible that there’s some more issues like that in the hardware, >> or even that there are different chip revisions out there. >> >> That also matches up with `ifconfig ue0 -rxcsum` fixing things. >> > > I'm not sure where the root cause is but it seems smsc(4) needs > improvement in RX checksum handling. Quick reading RX handler > indicates RX checksum offloading does not work when: > o IP datagram has IP options field > o TCP/UDP packet was fragmented > o UDP datagrams with 0 checksum value > See fxp(4), gem(4) and hme(4) for implementation. > > It looks like smsc(4) uses the following RX format but I don't > know actual RX format of H/W(no access to datasheet). > > <---------------------------- actlen --------------------------------------------------> > <------------- pktlen ------------------------> > rxhdr(4 bytes) | padding (2 bytes) | RX frame | FCS(4 bytes) | partial checksum(2 bytes) > > If the format above is correct smsc(4) needs more strict RX length > validation(USB transfer size vs actual packet length). This > indicates smsc(4) does not have to copy FCS bytes. > Also given that H/W always appends FCS, it's also suspicious H/W > does not correctly compute RX checksum for frames less than or > equal to 64 bytes. > > I don't have H/W and some spare time to fix this though. :-( I can review and test patches. Seems like there is need for a fix. --HPS From owner-freebsd-arm@freebsd.org Tue Nov 3 08:46:12 2020 Return-Path: Delivered-To: freebsd-arm@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 8F2C6450DF0; Tue, 3 Nov 2020 08:46:12 +0000 (UTC) (envelope-from hps@selasky.org) Received: from mail.turbocat.net (turbocat.net [88.99.82.50]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4CQNfq6JYSz4nXC; Tue, 3 Nov 2020 08:46:11 +0000 (UTC) (envelope-from hps@selasky.org) Received: from hps2020.home.selasky.org (unknown [178.17.145.105]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (2048 bits)) (No client certificate requested) by mail.turbocat.net (Postfix) with ESMTPSA id A99212600E0; Tue, 3 Nov 2020 09:46:09 +0100 (CET) Subject: Re: Problem with checksum offloading on RPi3 (PF + Jails involved) From: Hans Petter Selasky To: YongHyeon PYUN , Kristof Provost Cc: freebsd-arm@freebsd.org, freebsd-hackers@freebsd.org References: <748edc3d-4ef7-c4de-291f-7c0b460a6052@gmx.de> <5130ee46-5832-d4df-d774-c6bd32e10b30@gmx.de> <20201029213622.GM31099@funkthat.com> <55713894-A896-4F12-ABB9-93DFEB2F16B9@FreeBSD.org> <20201103045215.GA2524@michelle> <46d08198-530c-cb4b-efa8-4edaf89471c1@selasky.org> Message-ID: <4dfaa9a3-c085-8466-a6e4-19f988b5ed3d@selasky.org> Date: Tue, 3 Nov 2020 09:46:08 +0100 User-Agent: Mozilla/5.0 (X11; FreeBSD amd64; rv:68.0) Gecko/20100101 Thunderbird/68.10.0 MIME-Version: 1.0 In-Reply-To: <46d08198-530c-cb4b-efa8-4edaf89471c1@selasky.org> Content-Type: multipart/mixed; boundary="------------812ED0F32473780BBAF6ADAC" Content-Language: en-US X-Rspamd-Queue-Id: 4CQNfq6JYSz4nXC X-Spamd-Bar: -- Authentication-Results: mx1.freebsd.org; dkim=none; dmarc=none; spf=pass (mx1.freebsd.org: domain of hps@selasky.org designates 88.99.82.50 as permitted sender) smtp.mailfrom=hps@selasky.org X-Spamd-Result: default: False [-2.23 / 15.00]; ARC_NA(0.00)[]; RCVD_VIA_SMTP_AUTH(0.00)[]; RCVD_TLS_ALL(0.00)[]; FROM_HAS_DN(0.00)[]; RCPT_COUNT_THREE(0.00)[4]; R_SPF_ALLOW(-0.20)[+a:mail.turbocat.net:c]; MID_RHS_MATCH_FROM(0.00)[]; MIME_GOOD(-0.10)[multipart/mixed,text/plain,text/x-patch]; HAS_ATTACHMENT(0.00)[]; DMARC_NA(0.00)[selasky.org]; TO_DN_SOME(0.00)[]; NEURAL_SPAM_SHORT(0.17)[0.168]; NEURAL_HAM_LONG(-1.03)[-1.031]; TO_MATCH_ENVRCPT_SOME(0.00)[]; NEURAL_HAM_MEDIUM(-1.07)[-1.067]; FREEMAIL_TO(0.00)[gmail.com,FreeBSD.org]; FROM_EQ_ENVFROM(0.00)[]; R_DKIM_NA(0.00)[]; MIME_TRACE(0.00)[0:+,1:+,2:+]; ASN(0.00)[asn:24940, ipnet:88.99.0.0/16, country:DE]; RCVD_COUNT_TWO(0.00)[2]; MAILMAN_DEST(0.00)[freebsd-arm,freebsd-hackers] X-BeenThere: freebsd-arm@freebsd.org X-Mailman-Version: 2.1.33 Precedence: list List-Id: "Porting FreeBSD to ARM processors." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 03 Nov 2020 08:46:12 -0000 This is a multi-part message in MIME format. --------------812ED0F32473780BBAF6ADAC Content-Type: text/plain; charset=utf-8; format=flowed Content-Transfer-Encoding: 8bit On 2020-11-03 09:19, Hans Petter Selasky wrote: > It looks like smsc(4) uses the following RX format but I don't > know actual RX format of H/W(no access to datasheet). > > <---------------------------- actlen > --------------------------------------------------> >                 <------------- pktlen ------------------------> > rxhdr(4 bytes) | padding (2 bytes) | RX frame | FCS(4 bytes) | partial > checksum(2 bytes) Hi, I wonder if the checksum is zero, when not valid, and that we should check for this in the driver! Can you try this patch? Also enabling debugging in the SMSC driver would be useful. --HPS --------------812ED0F32473780BBAF6ADAC Content-Type: text/x-patch; charset=UTF-8; name="smsc.diff" Content-Transfer-Encoding: 7bit Content-Disposition: attachment; filename="smsc.diff" Index: sys/dev/usb/net/if_smsc.c =================================================================== --- sys/dev/usb/net/if_smsc.c (revision 367268) +++ sys/dev/usb/net/if_smsc.c (working copy) @@ -1020,7 +1020,7 @@ pktlen -= 2; /* The checksum appears to be simplistically calculated - * over the udp/tcp header and data up to the end of the + * over the UDP/TCP header and data up to the end of the * eth frame. Which means if the eth frame is padded * the csum calculation is incorrectly performed over * the padding bytes as well. Therefore to be safe we @@ -1031,27 +1031,21 @@ */ if ((be16toh(eh->ether_type) == ETHERTYPE_IP) && (pktlen > ETHER_MIN_LEN)) { - struct ip *ip; + /* Copy the TCP/UDP checksum from the last 2 bytes + * of the transfer and put in the csum_data field. + */ + usbd_copy_out(pc, (off + pktlen), &m->m_pkthdr.csum_data, 2); - ip = (struct ip *)(eh + 1); - if ((ip->ip_v == IPVERSION) && - ((ip->ip_p == IPPROTO_TCP) || - (ip->ip_p == IPPROTO_UDP))) { + /* The data is copied in network order, but the + * csum algorithm in the kernel expects it to be + * in host network order. + */ + m->m_pkthdr.csum_data = ntohs(m->m_pkthdr.csum_data); + + if (m->m_pkthdr.csum_data != 0) { /* Indicate the UDP/TCP csum has been calculated */ m->m_pkthdr.csum_flags |= CSUM_DATA_VALID; - /* Copy the TCP/UDP checksum from the last 2 bytes - * of the transfer and put in the csum_data field. - */ - usbd_copy_out(pc, (off + pktlen), - &m->m_pkthdr.csum_data, 2); - - /* The data is copied in network order, but the - * csum algorithm in the kernel expects it to be - * in host network order. - */ - m->m_pkthdr.csum_data = ntohs(m->m_pkthdr.csum_data); - smsc_dbg_printf(sc, "RX checksum offloaded (0x%04x)\n", m->m_pkthdr.csum_data); } --------------812ED0F32473780BBAF6ADAC-- From owner-freebsd-arm@freebsd.org Tue Nov 3 10:37:18 2020 Return-Path: Delivered-To: freebsd-arm@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 61E724548D5 for ; Tue, 3 Nov 2020 10:37:18 +0000 (UTC) (envelope-from sparvu@kronometrix.org) Received: from mail.kronometrix.org (mail.kronometrix.org [79.134.105.182]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mail.kronometrix.org", Issuer "mail.kronometrix.org" (not verified)) by mx1.freebsd.org (Postfix) with ESMTPS id 4CQR704PDFz3SNl for ; Tue, 3 Nov 2020 10:37:16 +0000 (UTC) (envelope-from sparvu@kronometrix.org) Received: from [192.168.1.151] (82-203-142-141.bb.dnainternet.fi [82.203.142.141]) (authenticated bits=0) by mail.kronometrix.org (8.16.1/8.15.2) with ESMTPSA id 0A3Ab2r7068602 (version=TLSv1.2 cipher=ECDHE-RSA-AES256-GCM-SHA384 bits=256 verify=NO) for ; Tue, 3 Nov 2020 10:37:08 GMT (envelope-from sparvu@kronometrix.org) X-Authentication-Warning: mail.kronometrix.org: Host 82-203-142-141.bb.dnainternet.fi [82.203.142.141] claimed to be [192.168.1.151] From: Stefan Parvu Content-Type: text/plain; charset=us-ascii Content-Transfer-Encoding: quoted-printable Mime-Version: 1.0 (Mac OS X Mail 13.4 \(3608.120.23.2.4\)) Subject: Re: RPI3B+ disable HDMI Date: Tue, 3 Nov 2020 12:36:57 +0200 References: <842D1575-F21A-4656-B81C-08D828286B6C@kronometrix.org> <20201101022257.GA18863@www.zefox.net> To: freebsd-arm@freebsd.org In-Reply-To: <20201101022257.GA18863@www.zefox.net> Message-Id: <050F146D-7A67-4143-97AC-5EFEAE502595@kronometrix.org> X-Mailer: Apple Mail (2.3608.120.23.2.4) X-Rspamd-Queue-Id: 4CQR704PDFz3SNl X-Spamd-Bar: -- Authentication-Results: mx1.freebsd.org; dkim=none; dmarc=none; spf=pass (mx1.freebsd.org: domain of sparvu@kronometrix.org designates 79.134.105.182 as permitted sender) smtp.mailfrom=sparvu@kronometrix.org X-Spamd-Result: default: False [-2.15 / 15.00]; RCVD_TLS_ALL(0.00)[]; RCVD_VIA_SMTP_AUTH(0.00)[]; MID_RHS_MATCH_FROM(0.00)[]; FROM_HAS_DN(0.00)[]; MV_CASE(0.50)[]; TO_MATCH_ENVRCPT_ALL(0.00)[]; MIME_GOOD(-0.10)[text/plain]; PREVIOUSLY_DELIVERED(0.00)[freebsd-arm@freebsd.org]; HAS_XAW(0.00)[]; RCPT_COUNT_ONE(0.00)[1]; NEURAL_HAM_LONG(-0.98)[-0.975]; TO_DN_NONE(0.00)[]; R_SPF_ALLOW(-0.20)[+a]; NEURAL_HAM_SHORT(-0.36)[-0.355]; DMARC_NA(0.00)[kronometrix.org]; ARC_NA(0.00)[]; NEURAL_HAM_MEDIUM(-1.02)[-1.020]; FROM_EQ_ENVFROM(0.00)[]; R_DKIM_NA(0.00)[]; MIME_TRACE(0.00)[0:+]; ASN(0.00)[asn:16302, ipnet:79.134.96.0/19, country:FI]; RCVD_COUNT_TWO(0.00)[2]; MAILMAN_DEST(0.00)[freebsd-arm] X-BeenThere: freebsd-arm@freebsd.org X-Mailman-Version: 2.1.33 Precedence: list List-Id: "Porting FreeBSD to ARM processors." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 03 Nov 2020 10:37:18 -0000 Thank you all for answers. Will experiment with these.=20 At least we got a basic 12hrs run on a single charge, running = Kronometrix data recorders (1 recorder up), ethernet cable on. Stefan > On 1. Nov 2020, at 4.22, bob prohaska wrote: >=20 > On Sat, Oct 31, 2020 at 09:59:38PM +0200, Stefan Parvu wrote: >> Hi, >>=20 >> We have started now testing our product using FreeBSD 12.2 on RPI3 = and 3B+.=20 >>=20 >> I have a question how one can start to disable things from the board = which are not needed, to save as much as possible power. For example = starting with HDMI port. I am trying to do some basic tests running our = data recorders with FreeBSD 12.2 only on batteries. (4 x 18650 Li-ion = 3500 mAh). Would it boot from batteries. Has anyone tried before this? >=20 > At one time ISTR that no monitor in the HDMI port on powerup turned = off > the port, at least to the extent that if a monitor was subsequently = plugged > in it got no signal. Not sure if this is still true, nor whether it = actually > reduced power consumption.=20 >=20 > hth, >=20 > bob prohaska >=20 From owner-freebsd-arm@freebsd.org Tue Nov 3 19:14:44 2020 Return-Path: Delivered-To: freebsd-arm@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 89D63460E82; Tue, 3 Nov 2020 19:14:44 +0000 (UTC) (envelope-from jmg@gold.funkthat.com) Received: from gold.funkthat.com (gate2.funkthat.com [208.87.223.18]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client CN "gate2.funkthat.com", Issuer "Let's Encrypt Authority X3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4CQfc32nmxz4JT7; Tue, 3 Nov 2020 19:14:42 +0000 (UTC) (envelope-from jmg@gold.funkthat.com) Received: from gold.funkthat.com (localhost [127.0.0.1]) by gold.funkthat.com (8.15.2/8.15.2) with ESMTPS id 0A3JEe3i035970 (version=TLSv1.2 cipher=DHE-RSA-AES256-GCM-SHA384 bits=256 verify=NO); Tue, 3 Nov 2020 11:14:40 -0800 (PST) (envelope-from jmg@gold.funkthat.com) Received: (from jmg@localhost) by gold.funkthat.com (8.15.2/8.15.2/Submit) id 0A3JEdop035969; Tue, 3 Nov 2020 11:14:39 -0800 (PST) (envelope-from jmg) Date: Tue, 3 Nov 2020 11:14:39 -0800 From: John-Mark Gurney To: Kristof Provost Cc: Carsten =?iso-8859-1?Q?B=E4cker?= , freebsd-hackers@freebsd.org, freebsd-arm@freebsd.org Subject: Re: Problem with checksum offloading on RPi3 (PF + Jails involved) Message-ID: <20201103191439.GV31099@funkthat.com> Mail-Followup-To: Kristof Provost , Carsten =?iso-8859-1?Q?B=E4cker?= , freebsd-hackers@freebsd.org, freebsd-arm@freebsd.org References: <748edc3d-4ef7-c4de-291f-7c0b460a6052@gmx.de> <5130ee46-5832-d4df-d774-c6bd32e10b30@gmx.de> <20201029213622.GM31099@funkthat.com> <55713894-A896-4F12-ABB9-93DFEB2F16B9@FreeBSD.org> MIME-Version: 1.0 Content-Type: text/plain; charset=iso-8859-1 Content-Disposition: inline Content-Transfer-Encoding: 8bit In-Reply-To: X-Operating-System: FreeBSD 11.3-STABLE amd64 X-PGP-Fingerprint: D87A 235F FB71 1F3F 55B7 ED9B D5FF 5A51 C0AC 3D65 X-Files: The truth is out there X-URL: https://www.funkthat.com/ X-Resume: https://www.funkthat.com/~jmg/resume.html X-TipJar: bitcoin:13Qmb6AeTgQecazTWph4XasEsP7nGRbAPE X-to-the-FBI-CIA-and-NSA: HI! HOW YA DOIN? can i haz chizburger? User-Agent: Mutt/1.6.1 (2016-04-27) X-Greylist: Sender IP whitelisted, not delayed by milter-greylist-4.4.3 (gold.funkthat.com [127.0.0.1]); Tue, 03 Nov 2020 11:14:40 -0800 (PST) X-Rspamd-Queue-Id: 4CQfc32nmxz4JT7 X-Spamd-Bar: - Authentication-Results: mx1.freebsd.org; dkim=none; dmarc=none; spf=none (mx1.freebsd.org: domain of jmg@gold.funkthat.com has no SPF policy when checking 208.87.223.18) smtp.mailfrom=jmg@gold.funkthat.com X-Spamd-Result: default: False [-1.24 / 15.00]; RCVD_TLS_ALL(0.00)[]; ARC_NA(0.00)[]; RCVD_COUNT_TWO(0.00)[2]; FREEFALL_USER(0.00)[jmg]; FROM_HAS_DN(0.00)[]; RCPT_COUNT_THREE(0.00)[4]; TO_DN_SOME(0.00)[]; MID_RHS_MATCH_FROM(0.00)[]; MIME_GOOD(-0.10)[text/plain]; DMARC_NA(0.00)[funkthat.com]; AUTH_NA(1.00)[]; NEURAL_HAM_LONG(-1.02)[-1.024]; TO_MATCH_ENVRCPT_SOME(0.00)[]; NEURAL_HAM_SHORT(-0.47)[-0.473]; NEURAL_HAM_MEDIUM(-0.94)[-0.943]; R_SPF_NA(0.00)[no SPF record]; FORGED_SENDER(0.30)[jmg@funkthat.com,jmg@gold.funkthat.com]; R_DKIM_NA(0.00)[]; MIME_TRACE(0.00)[0:+]; ASN(0.00)[asn:32354, ipnet:208.87.216.0/21, country:US]; FROM_NEQ_ENVFROM(0.00)[jmg@funkthat.com,jmg@gold.funkthat.com]; MAILMAN_DEST(0.00)[freebsd-hackers,freebsd-arm]; FREEMAIL_CC(0.00)[gmx.de,freebsd.org] X-BeenThere: freebsd-arm@freebsd.org X-Mailman-Version: 2.1.33 Precedence: list List-Id: "Porting FreeBSD to ARM processors." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 03 Nov 2020 19:14:44 -0000 Kristof Provost wrote this message on Sun, Nov 01, 2020 at 19:48 +0100: > On 31 Oct 2020, at 16:06, Carsten Bäcker wrote: > > Packet-capture from the router is attached. > > > Okay??? but that doesn???t actually demonstrate anything at all. > It shows an outbound packet with an incorrect checksum. See what I???ve > mentioned before about checksums potentially being calculated by > hardware. > Given that there???s been a reply to that DNS query the checksum clearly > got set correctly after the packet was captured. Actually, isn't that odd that the outbound checksum is wrong? Since the chip doesn't advertise (or it shouldn't) tx checksum handling, FreeBSD's stack should have computed the checksum. -- John-Mark Gurney Voice: +1 415 225 5579 "All that I will do, has been done, All that I have, has not." From owner-freebsd-arm@freebsd.org Tue Nov 3 19:20:06 2020 Return-Path: Delivered-To: freebsd-arm@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 17E13460CFC; Tue, 3 Nov 2020 19:20:06 +0000 (UTC) (envelope-from kp@FreeBSD.org) Received: from smtp.freebsd.org (smtp.freebsd.org [IPv6:2610:1c1:1:606c::24b:4]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "smtp.freebsd.org", Issuer "Let's Encrypt Authority X3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4CQfkF6x4bz4Jmp; Tue, 3 Nov 2020 19:20:05 +0000 (UTC) (envelope-from kp@FreeBSD.org) Received: from venus.codepro.be (venus.codepro.be [5.9.86.228]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client CN "mx1.codepro.be", Issuer "Let's Encrypt Authority X3" (verified OK)) (Authenticated sender: kp) by smtp.freebsd.org (Postfix) with ESMTPSA id B72D714554; Tue, 3 Nov 2020 19:20:05 +0000 (UTC) (envelope-from kp@FreeBSD.org) Received: by venus.codepro.be (Postfix, authenticated sender kp) id AE4A64E6A8; Tue, 3 Nov 2020 20:20:03 +0100 (CET) From: "Kristof Provost" To: "John-Mark Gurney" Cc: "Carsten =?utf-8?q?B=C3=A4cker?=" , freebsd-hackers@freebsd.org, freebsd-arm@freebsd.org Subject: Re: Problem with checksum offloading on RPi3 (PF + Jails involved) Date: Tue, 03 Nov 2020 20:20:02 +0100 X-Mailer: MailMate (1.13.2r5673) Message-ID: In-Reply-To: <20201103191439.GV31099@funkthat.com> References: <748edc3d-4ef7-c4de-291f-7c0b460a6052@gmx.de> <5130ee46-5832-d4df-d774-c6bd32e10b30@gmx.de> <20201029213622.GM31099@funkthat.com> <55713894-A896-4F12-ABB9-93DFEB2F16B9@FreeBSD.org> <20201103191439.GV31099@funkthat.com> MIME-Version: 1.0 Content-Type: text/plain; charset="UTF-8"; format=flowed Content-Transfer-Encoding: 8bit X-BeenThere: freebsd-arm@freebsd.org X-Mailman-Version: 2.1.33 Precedence: list List-Id: "Porting FreeBSD to ARM processors." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 03 Nov 2020 19:20:06 -0000 On 3 Nov 2020, at 20:14, John-Mark Gurney wrote: > Kristof Provost wrote this message on Sun, Nov 01, 2020 at 19:48 > +0100: >> On 31 Oct 2020, at 16:06, Carsten Bäcker wrote: >>> Packet-capture from the router is attached. >>> >> Okay??? but that doesn???t actually demonstrate anything at all. >> It shows an outbound packet with an incorrect checksum. See what >> I???ve >> mentioned before about checksums potentially being calculated by >> hardware. >> Given that there???s been a reply to that DNS query the checksum >> clearly >> got set correctly after the packet was captured. > > Actually, isn't that odd that the outbound checksum is wrong? Since > the chip doesn't advertise (or it shouldn't) tx checksum handling, > FreeBSD's stack should have computed the checksum. > Bear in mind that this capture was made with pflog, not the usual BTF_MTAP() in the driver. That means it was captured before the stack does checksum calculations. Just before it, in fact. See ip_output(). The checksum calculation is pretty much immediately after the pfil hook. Best regards, Kristof From owner-freebsd-arm@freebsd.org Tue Nov 3 23:10:14 2020 Return-Path: Delivered-To: freebsd-arm@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id C40B5466C5F for ; Tue, 3 Nov 2020 23:10:14 +0000 (UTC) (envelope-from swills@FreeBSD.org) Received: from mouf.net (mouf.net [IPv6:2607:fc50:0:4400:216:3eff:fe69:33b3]) (using TLSv1 with cipher DHE-RSA-AES256-SHA (256/256 bits)) (Client CN "mouf.net", Issuer "mouf.net" (not verified)) by mx1.freebsd.org (Postfix) with ESMTPS id 4CQlqp3L1wz4ZqL for ; Tue, 3 Nov 2020 23:10:14 +0000 (UTC) (envelope-from swills@FreeBSD.org) Received: from lrrr.mouf.net (cpe-76-182-16-135.nc.res.rr.com [76.182.16.135]) (authenticated bits=0) by mouf.net (8.14.9/8.14.9) with ESMTP id 0A3NA0iX017213 (version=TLSv1/SSLv3 cipher=AES128-SHA bits=128 verify=NOT) for ; Tue, 3 Nov 2020 23:10:06 GMT (envelope-from swills@FreeBSD.org) To: freebsd-arm@freebsd.org From: Steve Wills Subject: growfs triggering sdhc errors Message-ID: <2724d1d4-58a1-eef2-c6bb-ce1be0fa3123@FreeBSD.org> Date: Tue, 3 Nov 2020 18:09:55 -0500 User-Agent: Mozilla/5.0 (X11; FreeBSD amd64; rv:78.0) Gecko/20100101 Thunderbird/78.4.0 MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8; format=flowed Content-Language: en-US Content-Transfer-Encoding: 7bit X-Greylist: Sender succeeded SMTP AUTH, not delayed by milter-greylist-4.4.3 (mouf.net [199.48.129.64]); Tue, 03 Nov 2020 23:10:06 +0000 (UTC) X-Spam-Status: No, score=0.3 required=4.5 tests=KHOP_HELO_FCRDNS autolearn=no autolearn_force=no version=3.4.1 X-Spam-Checker-Version: SpamAssassin 3.4.1 (2015-04-28) on mouf.net X-Virus-Scanned: clamav-milter 0.99.2 at mouf.net X-Virus-Status: Clean X-Rspamd-Queue-Id: 4CQlqp3L1wz4ZqL X-Spamd-Bar: / Authentication-Results: mx1.freebsd.org; none X-Spamd-Result: default: False [0.00 / 15.00]; local_wl_from(0.00)[FreeBSD.org]; ASN(0.00)[asn:36236, ipnet:2607:fc50::/36, country:US] X-BeenThere: freebsd-arm@freebsd.org X-Mailman-Version: 2.1.33 Precedence: list List-Id: "Porting FreeBSD to ARM processors." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 03 Nov 2020 23:10:14 -0000 Hi, It seems that sometime between r362013 and r366608 of CURRENT, something broke such that growfs on my RPI3 breaks with: sdhci_bcm0-slot0: Got data interrupt 0x00600000, but there is no active command. followed by a register dump. Any ideas where to look? Thanks, Steve From owner-freebsd-arm@freebsd.org Tue Nov 3 23:39:46 2020 Return-Path: Delivered-To: freebsd-arm@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 4C9F24679D1 for ; Tue, 3 Nov 2020 23:39:46 +0000 (UTC) (envelope-from swills@FreeBSD.org) Received: from mouf.net (mouf.net [IPv6:2607:fc50:0:4400:216:3eff:fe69:33b3]) (using TLSv1 with cipher DHE-RSA-AES256-SHA (256/256 bits)) (Client CN "mouf.net", Issuer "mouf.net" (not verified)) by mx1.freebsd.org (Postfix) with ESMTPS id 4CQmTt1HKdz4cYm for ; Tue, 3 Nov 2020 23:39:45 +0000 (UTC) (envelope-from swills@FreeBSD.org) Received: from lrrr.mouf.net (cpe-76-182-16-135.nc.res.rr.com [76.182.16.135]) (authenticated bits=0) by mouf.net (8.14.9/8.14.9) with ESMTP id 0A3NdcKG019712 (version=TLSv1/SSLv3 cipher=AES128-SHA bits=128 verify=NOT) for ; Tue, 3 Nov 2020 23:39:44 GMT (envelope-from swills@FreeBSD.org) Subject: Re: growfs triggering sdhc errors To: freebsd-arm@freebsd.org References: <2724d1d4-58a1-eef2-c6bb-ce1be0fa3123@FreeBSD.org> From: Steve Wills Message-ID: <5f443e74-5e55-c8b2-f4c2-ea0034437aa0@FreeBSD.org> Date: Tue, 3 Nov 2020 18:39:33 -0500 User-Agent: Mozilla/5.0 (X11; FreeBSD amd64; rv:78.0) Gecko/20100101 Thunderbird/78.4.0 MIME-Version: 1.0 In-Reply-To: <2724d1d4-58a1-eef2-c6bb-ce1be0fa3123@FreeBSD.org> Content-Type: text/plain; charset=utf-8; format=flowed Content-Language: en-US Content-Transfer-Encoding: 7bit X-Greylist: Sender succeeded SMTP AUTH, not delayed by milter-greylist-4.4.3 (mouf.net [199.48.129.64]); Tue, 03 Nov 2020 23:39:44 +0000 (UTC) X-Spam-Status: No, score=0.0 required=4.5 tests=KHOP_HELO_FCRDNS, NICE_REPLY_A autolearn=unavailable autolearn_force=no version=3.4.1 X-Spam-Checker-Version: SpamAssassin 3.4.1 (2015-04-28) on mouf.net X-Virus-Scanned: clamav-milter 0.99.2 at mouf.net X-Virus-Status: Clean X-Rspamd-Queue-Id: 4CQmTt1HKdz4cYm X-Spamd-Bar: / Authentication-Results: mx1.freebsd.org; none X-Spamd-Result: default: False [0.00 / 15.00]; local_wl_from(0.00)[FreeBSD.org]; ASN(0.00)[asn:36236, ipnet:2607:fc50::/36, country:US] X-BeenThere: freebsd-arm@freebsd.org X-Mailman-Version: 2.1.33 Precedence: list List-Id: "Porting FreeBSD to ARM processors." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 03 Nov 2020 23:39:46 -0000 Just to add a little more detail here, the exact output of growfs is: https://reviews.freebsd.org/file/data/xxwzfra5fjqqwxd7ws36/PHID-FILE-h7epoca7bcj5vurlzajf/raw-paste-data.txt I see this using the official snapshots too: FreeBSD 13.0-CURRENT FreeBSD 13.0-CURRENT #0 b9403d7aae8-c254071(main): Thu Oct 29 10:38:29 UTC 2020 root@releng1.nyi.freebsd.org:/usr/obj/usr/src/arm64.aarch64/sys/GENERIC arm64 FreeBSD-13.0-CURRENT-arm64-aarch64-RPI3-20201029-b9403d7aae8.img Note growfs is triggered on firstboot via the /etc/rc.d/growfs script and having growfs_enable="YES" in /etc/rc.conf and the /firstboot file existing. The partitions (MBR and BSD) seem to grow fine (gpart) but the growfs triggers the issue. Steve On 11/3/20 6:09 PM, Steve Wills wrote: > Hi, > > It seems that sometime between r362013 and r366608 of CURRENT, something > broke such that growfs on my RPI3 breaks with: > > sdhci_bcm0-slot0: Got data interrupt 0x00600000, but there is no active > command. > > followed by a register dump. Any ideas where to look? > > Thanks, > Steve > _______________________________________________ > freebsd-arm@freebsd.org mailing list > https://lists.freebsd.org/mailman/listinfo/freebsd-arm > To unsubscribe, send any mail to "freebsd-arm-unsubscribe@freebsd.org" From owner-freebsd-arm@freebsd.org Wed Nov 4 01:30:24 2020 Return-Path: Delivered-To: freebsd-arm@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 05BA044A91D; Wed, 4 Nov 2020 01:30:24 +0000 (UTC) (envelope-from pyunyh@gmail.com) Received: from mail-pg1-x52b.google.com (mail-pg1-x52b.google.com [IPv6:2607:f8b0:4864:20::52b]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "GTS CA 1O1" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4CQpxV6Tthz3V4f; Wed, 4 Nov 2020 01:30:22 +0000 (UTC) (envelope-from pyunyh@gmail.com) Received: by mail-pg1-x52b.google.com with SMTP id f38so15170733pgm.2; Tue, 03 Nov 2020 17:30:22 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=date:from:to:cc:subject:message-id:references:mime-version :content-disposition:content-transfer-encoding:in-reply-to; bh=cpQ3S2rbVhd8LdJqsmdfB8QRGRwRUT8yneoStHUogpo=; b=kthhDJEvtdCiDWfG1OOsE/P6jPHxmYpph+skhbomoELHaH2JwMgZ/Bpx2/ynzEsnoT GkvL/8Bn/go7zvQ/7i/TG9StU6TwFc4Rn8vxrxSZANjEhmUhhsjqc737yoaYxLUnN4j+ 5YDJnJJzsY7qaZxxmfBFXHPGIAGFAdJKC1oP1mc6CZ2c02U8mUnZ+U59jYmrPI+wCadh eO8ClK10z6OAcmkYMzCGhpOu7SMIbR6UYIjMHz5mLyDaSbi1TcVRKDA63zUq+PJiVclH B6HWAQGNYdRjTrXlA18FhQPJ6elvpS2Z9N7id/mAb79XbMk77+NiS/ruAXxnc7sleMfT nmcg== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:date:from:to:cc:subject:message-id:references :mime-version:content-disposition:content-transfer-encoding :in-reply-to; bh=cpQ3S2rbVhd8LdJqsmdfB8QRGRwRUT8yneoStHUogpo=; b=SE9a32+FYIqfKpM1r9Y14nQzqJwsePaOtOkY6GWl0Tm5UvrsWyP2lIityX/PdRtHnd I0lEXxSUYsqrPqggXpJQXB9W4kz852Zfa9OxR9d2gpfXKPhUc1euB6gLqCvvfBtHZDYl bm9Y+ETlC9+tFMvJTFRpYYs7sZUYKZt6AUZfETr0BQJR3Z6NLhBRDpVcy0h57vgM7luv S3w/XWgz5akUiu0LGAwXkdT57VyQ8RGHRvMN7lOmE1kfRc7a40vNxtpcrrNdbUP9RySK PPomws92E8tH3hs8Hn7GhkjgZ4i3U8ZWGDkoGNZrIVmKUjYk5HV8JJzzS7Es8emhYeoz uYjQ== X-Gm-Message-State: AOAM533S0Mq0g1aJNjp/z8uoeWvWIFfw2LXZNjRj4wDIaSo52WIJrUcB bYC+AtqzOEENe4GX/eD7/i4= X-Google-Smtp-Source: ABdhPJw7y+SSoS0X5AvSvzzwpaD+Vf/J+QVMB0j/4mdYAzuJ1Q2QtrGEPOhQWpUo4iqdloVoPCYnjQ== X-Received: by 2002:a05:6a00:88d:b029:164:5a00:29b8 with SMTP id q13-20020a056a00088db02901645a0029b8mr29271628pfj.10.1604453420990; Tue, 03 Nov 2020 17:30:20 -0800 (PST) Received: from localhost ([210.108.244.139]) by smtp.gmail.com with ESMTPSA id d22sm191473pgv.87.2020.11.03.17.30.19 (version=TLS1_3 cipher=TLS_AES_256_GCM_SHA384 bits=256/256); Tue, 03 Nov 2020 17:30:20 -0800 (PST) Date: Wed, 4 Nov 2020 10:30:17 +0900 From: YongHyeon PYUN To: Lowell Gilbert Cc: freebsd-hackers@freebsd.org, freebsd-arm@freebsd.org Subject: Re: Problem with checksum offloading on RPi3 (PF + Jails involved) Message-ID: <20201104013017.GA48398@michelle> References: <748edc3d-4ef7-c4de-291f-7c0b460a6052@gmx.de> <5130ee46-5832-d4df-d774-c6bd32e10b30@gmx.de> <20201029213622.GM31099@funkthat.com> <55713894-A896-4F12-ABB9-93DFEB2F16B9@FreeBSD.org> <20201103045215.GA2524@michelle> <44zh3ybd0s.fsf@Be-Well.Ilk.Org> MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Disposition: inline Content-Transfer-Encoding: 8bit In-Reply-To: <44zh3ybd0s.fsf@Be-Well.Ilk.Org> X-Rspamd-Queue-Id: 4CQpxV6Tthz3V4f X-Spamd-Bar: --- Authentication-Results: mx1.freebsd.org; dkim=pass header.d=gmail.com header.s=20161025 header.b=kthhDJEv; dmarc=pass (policy=none) header.from=gmail.com; spf=pass (mx1.freebsd.org: domain of pyunyh@gmail.com designates 2607:f8b0:4864:20::52b as permitted sender) smtp.mailfrom=pyunyh@gmail.com X-Spamd-Result: default: False [-3.52 / 15.00]; RCVD_VIA_SMTP_AUTH(0.00)[]; ARC_NA(0.00)[]; R_DKIM_ALLOW(-0.20)[gmail.com:s=20161025]; NEURAL_HAM_MEDIUM(-0.97)[-0.975]; FROM_HAS_DN(0.00)[]; RCPT_COUNT_THREE(0.00)[3]; FREEMAIL_FROM(0.00)[gmail.com]; R_SPF_ALLOW(-0.20)[+ip6:2607:f8b0:4000::/36]; MIME_GOOD(-0.10)[text/plain]; MID_RHS_NOT_FQDN(0.50)[]; NEURAL_HAM_LONG(-1.06)[-1.056]; TO_DN_SOME(0.00)[]; RCVD_COUNT_THREE(0.00)[3]; TO_MATCH_ENVRCPT_SOME(0.00)[]; DKIM_TRACE(0.00)[gmail.com:+]; DMARC_POLICY_ALLOW(-0.50)[gmail.com,none]; RCVD_IN_DNSWL_NONE(0.00)[2607:f8b0:4864:20::52b:from]; NEURAL_HAM_SHORT(-0.99)[-0.992]; FROM_EQ_ENVFROM(0.00)[]; MIME_TRACE(0.00)[0:+]; FREEMAIL_ENVFROM(0.00)[gmail.com]; ASN(0.00)[asn:15169, ipnet:2607:f8b0::/32, country:US]; RCVD_TLS_ALL(0.00)[]; MAILMAN_DEST(0.00)[freebsd-hackers,freebsd-arm]; DWL_DNSWL_NONE(0.00)[gmail.com:dkim] X-BeenThere: freebsd-arm@freebsd.org X-Mailman-Version: 2.1.33 Precedence: list List-Id: "Porting FreeBSD to ARM processors." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 04 Nov 2020 01:30:24 -0000 On Tue, Nov 03, 2020 at 11:50:27AM -0500, Lowell Gilbert wrote: > YongHyeon PYUN writes: > > > On Thu, Oct 29, 2020 at 10:39:39PM +0100, Kristof Provost wrote: > > > > [...] > > > >> It does seem to do RX offload, and the comments in the driver suggest some > >> .. ahem, creative hardware behaviour: > >> > >> /* The checksum appears to be simplistically calculated > >> * over the udp/tcp header and data up to the end of the > >> * eth frame. Which means if the eth frame is padded > >> * the csum calculation is incorrectly performed over > >> * the padding bytes as well. Therefore to be safe we > >> * ignore the H/W csum on frames less than or equal to > >> * 64 bytes. > >> * > >> * Ignore H/W csum for non-IPv4 packets. > >> */ > >> > >> It’s not impossible that there’s some more issues like that in the hardware, > >> or even that there are different chip revisions out there. > >> > >> That also matches up with `ifconfig ue0 -rxcsum` fixing things. > >> > > > > I'm not sure where the root cause is but it seems smsc(4) needs > > improvement in RX checksum handling. Quick reading RX handler > > indicates RX checksum offloading does not work when: > > o IP datagram has IP options field > > o TCP/UDP packet was fragmented > > o UDP datagrams with 0 checksum value > > See fxp(4), gem(4) and hme(4) for implementation. > > > > It looks like smsc(4) uses the following RX format but I don't > > know actual RX format of H/W(no access to datasheet). > > > > <---------------------------- actlen --------------------------------------------------> > > <------------- pktlen ------------------------> > > rxhdr(4 bytes) | padding (2 bytes) | RX frame | FCS(4 bytes) | partial checksum(2 bytes) > > > > If the format above is correct smsc(4) needs more strict RX length > > validation(USB transfer size vs actual packet length). This > > indicates smsc(4) does not have to copy FCS bytes. > > Also given that H/W always appends FCS, it's also suspicious H/W > > does not correctly compute RX checksum for frames less than or > > equal to 64 bytes. > > For the 89530 at least, the data sheet states that checksum offload > and padding stripping are mutually exclusive. I would assume that > enabling both of them will produce incorrect results. I would *not* > assume that all chips covered by this driver behave the same way, > although it's likely. I see. Publicly available data sheet was too much sanitized such that it's useless to implement checksum offloading. Given that you have access to data sheet, could you describe exact RX format of H/W? FreeBSD's USB stack requires copy operation for received frames so driver does not need any padding in RX path and ethernet frame alignment in mbuf can be adjusted in the copy operation. Since FCS bytes have no use in upper stack at this moment, it would be even better to strip FCS if there is way to do that in H/W. For TX checksum offloading support, we need more information on H/W's TX handling(TX_CTRL_0 and TX_CTRL_1) too. I guess it needs special magic sequence of programming(i.e. existence of SMSC_TX_CTRL_0_FIRST_SEG and SMSC_TX_CTRL_0_LAST_SEG) but it could be greatly simplified to program the H/W for TX checksum offloading since driver also have to copy entire mbuf chain to USB stack(i.e single big TX segment for the H/W). From owner-freebsd-arm@freebsd.org Wed Nov 4 06:36:50 2020 Return-Path: Delivered-To: freebsd-arm@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 44D3945283B; Wed, 4 Nov 2020 06:36:50 +0000 (UTC) (envelope-from carbaecker@gmx.de) Received: from mout.gmx.net (mout.gmx.net [212.227.15.18]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange ECDHE (P-256) server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "mout.gmx.net", Issuer "TeleSec ServerPass Class 2 CA" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4CQxl52Mjmz4Js4; Wed, 4 Nov 2020 06:36:48 +0000 (UTC) (envelope-from carbaecker@gmx.de) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/simple; d=gmx.net; s=badeba3b8450; t=1604471806; bh=uFkcaMWwvRbtq0yolrsH/akSHbmxOHCVinz9rM6fO6Y=; h=X-UI-Sender-Class:Subject:To:Cc:References:From:Date:In-Reply-To; b=ITeMeXMmFD1JMk1uJ5udVmMkf8p1TSGjIA0Fi7ldrTVfApF80Zx6jCihN3S9KYMwy CA5m/IKWR6FfbjnmxBAkm52rIfUqSVVgYLjx1YGfrEYj8eO3wWCiEQcrhh90sH/zlN 5Eh0OuKg6D4g8CfemgE3d8Jll3BT5YvoBp1ncZn0= X-UI-Sender-Class: 01bb95c1-4bf8-414a-932a-4f6e2808ef9c Received: from [192.168.178.30] ([94.31.96.148]) by mail.gmx.com (mrgmx005 [212.227.17.190]) with ESMTPSA (Nemesis) id 1N7QxL-1kHtC708K5-017kbB; Wed, 04 Nov 2020 07:36:46 +0100 Subject: Re: Problem with checksum offloading on RPi3 (PF + Jails involved) To: Hans Petter Selasky , YongHyeon PYUN , Kristof Provost Cc: freebsd-arm@freebsd.org, freebsd-hackers@freebsd.org References: <748edc3d-4ef7-c4de-291f-7c0b460a6052@gmx.de> <5130ee46-5832-d4df-d774-c6bd32e10b30@gmx.de> <20201029213622.GM31099@funkthat.com> <55713894-A896-4F12-ABB9-93DFEB2F16B9@FreeBSD.org> <20201103045215.GA2524@michelle> <46d08198-530c-cb4b-efa8-4edaf89471c1@selasky.org> <4dfaa9a3-c085-8466-a6e4-19f988b5ed3d@selasky.org> From: =?UTF-8?Q?Carsten_B=c3=a4cker?= Message-ID: Date: Wed, 4 Nov 2020 07:36:44 +0100 User-Agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64; rv:78.0) Gecko/20100101 Thunderbird/78.4.0 MIME-Version: 1.0 In-Reply-To: <4dfaa9a3-c085-8466-a6e4-19f988b5ed3d@selasky.org> Content-Language: de-DE X-Provags-ID: V03:K1:YW7fqmbw0thFe1Tz4NTlGvCYR+MPZ6uJtHuaa/6S4FVSYCON2ed +FeN91vYYPO5hYAP470ue3TJHEsI6vmxGqpR22FPmKDHvCOJqjjtLppeSpllEHKD9Hczb9I 9+S3yX0y1nGhZzdjsN8BwJVjAjADKhlMbsw4VZNlIZj3AyNNCx8ZjX3WhJTpO7iv8Isi9dp q2nTkU4x5G38rBdHbt9Hw== X-Spam-Flag: NO X-UI-Out-Filterresults: notjunk:1;V03:K0:kHIykTro/iw=:e5f1MSIoG+QfkF46rED31a GHeK9oqISFXpybOBjyLREq8ss5pgVKWEdywelskSKv5d0qBEOqltIurgQyI6oJ1kH/hiK4KxV Wwp4MLiLvI8BrdQkPlqbrrFuigC5W/esScBkIqUD8/DS4cAu3LRaX8WM+sxiSUAotsX4WrDGG g7dZMXM73TGMnYhpxbslQUZZYK+qb+iKIBKjzoamYjJdBPo4jdvHbXzowXK3VL/M3Xtki888E FSFM1J/VSdbw7JwzYzsl7IYpInNMCqpnN92t8UdUjKeXR/1U9R0oxEo7P2sK/wcaq9Zqkgywg FN+h0kETGbGtLlRsgB/0AOHlVu0nw8vQlOTw15/v/TUjNKdFANZVuYAwkVNzs1oGq5iyE5PyP 1T0JYn0S0IfxLOt5aAWLAm/yZ8eBehiNRyH2LWjXZNQnfHgBRRA4w6khjnqRc+X2rM+uqIVzJ AnMjpi2hDjRP8icSLQoOUNwojJKRcVsGo77EZtJxKSoqHWLIulZmtRMarkJGCve8SSfSRiIPP E3GYAJhuX6BGABalmf0koAHzVvgdVfnTxKB2MZtZy+Ty481CySi4vlY88KCeAogPAPtRts+NU 4ZnSpX7yC42FfbUHYWwaJkLMsXvP+iU4VgnHs7sZXQ5/ObxQO/yhbE0vaMRbt7suevXV1V0uy 7Gsls0K6ipwbnrJ6MfKQ8yOsg6z3VMqkjyLvhEOiu7ImoEugwAno48LkKJdHFS8SDiP3Cs8ml SGO5Tv3oriK3dGeL88rNoJbZlXEnMCIOvn+K0RxdALxFyEd1Y+eMW5dV0rr7epriCIj7vFj2U lboMF5E1ELrV4v9m0Vz+uaCyaxrAZ6OIl5IiNskSGjcyGVIYRry8ALIcR+mZ3urr2S0UftLOo B/xBhlLQn6zP8812in8Q== X-Rspamd-Queue-Id: 4CQxl52Mjmz4Js4 X-Spamd-Bar: --- Authentication-Results: mx1.freebsd.org; dkim=pass header.d=gmx.net header.s=badeba3b8450 header.b=ITeMeXMm; dmarc=none; spf=pass (mx1.freebsd.org: domain of carbaecker@gmx.de designates 212.227.15.18 as permitted sender) smtp.mailfrom=carbaecker@gmx.de X-Spamd-Result: default: False [-3.25 / 15.00]; RCVD_VIA_SMTP_AUTH(0.00)[]; TO_DN_SOME(0.00)[]; FREEMAIL_FROM(0.00)[gmx.de]; R_SPF_ALLOW(-0.20)[+ip4:212.227.15.0/25]; RCPT_COUNT_FIVE(0.00)[5]; DKIM_TRACE(0.00)[gmx.net:+]; NEURAL_HAM_SHORT(-0.60)[-0.599]; FREEMAIL_TO(0.00)[selasky.org,gmail.com,FreeBSD.org]; RECEIVED_SPAMHAUS_PBL(0.00)[94.31.96.148:received]; FROM_EQ_ENVFROM(0.00)[]; MIME_TRACE(0.00)[0:+,1:+,2:~]; FREEMAIL_ENVFROM(0.00)[gmx.de]; MID_RHS_MATCH_FROM(0.00)[]; ASN(0.00)[asn:8560, ipnet:212.227.0.0/16, country:DE]; ARC_NA(0.00)[]; NEURAL_HAM_MEDIUM(-0.99)[-0.988]; R_DKIM_ALLOW(-0.20)[gmx.net:s=badeba3b8450]; RCVD_IN_DNSWL_LOW(-0.10)[212.227.15.18:from]; FROM_HAS_DN(0.00)[]; NEURAL_HAM_LONG(-1.06)[-1.064]; MIME_GOOD(-0.10)[multipart/alternative,text/plain]; DMARC_NA(0.00)[gmx.de]; TO_MATCH_ENVRCPT_SOME(0.00)[]; RWL_MAILSPIKE_POSSIBLE(0.00)[212.227.15.18:from]; RCVD_COUNT_TWO(0.00)[2]; RCVD_TLS_ALL(0.00)[]; MAILMAN_DEST(0.00)[freebsd-arm,freebsd-hackers] Content-Type: text/plain; charset=utf-8; format=flowed Content-Transfer-Encoding: quoted-printable X-Content-Filtered-By: Mailman/MimeDel 2.1.33 X-BeenThere: freebsd-arm@freebsd.org X-Mailman-Version: 2.1.33 Precedence: list List-Id: "Porting FreeBSD to ARM processors." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 04 Nov 2020 06:36:50 -0000 Am 03.11.2020 um 09:46 schrieb Hans Petter Selasky: > On 2020-11-03 09:19, Hans Petter Selasky wrote: >> It looks like smsc(4) uses the following RX format but I don't >> know actual RX format of H/W(no access to datasheet). >> >> <---------------------------- actlen >> --------------------------------------------------> >> =C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2= =A0=C2=A0=C2=A0=C2=A0=C2=A0 <------------- pktlen ------------------------= > >> rxhdr(4 bytes) | padding (2 bytes) | RX frame | FCS(4 bytes) | >> partial checksum(2 bytes) > > Hi, > > I wonder if the checksum is zero, when not valid, and that we should > check for this in the driver! > > Can you try this patch? > > Also enabling debugging in the SMSC driver would be useful. > > --HPS > > _______________________________________________ > freebsd-hackers@freebsd.org mailing list > https://lists.freebsd.org/mailman/listinfo/freebsd-hackers > To unsubscribe, send any mail to "freebsd-hackers-unsubscribe@freebsd.or= g" Hi, i applied the patch on -CURRENT but got a panic right after loading the kernel. Most likely an unrelated problem. But i was able to apply the patch on releng/12.2 (with an offset). Unfortunately it doesn't change the previously described behavior with rxcsum and i didn't manage to get any reasonable debug-output. Since i can easily reproduce the problem. How else can i help? Regards, Carsten From owner-freebsd-arm@freebsd.org Wed Nov 4 08:38:35 2020 Return-Path: Delivered-To: freebsd-arm@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 464664559EB for ; Wed, 4 Nov 2020 08:38:35 +0000 (UTC) (envelope-from soren.schmidt@gmail.com) Received: from mailman.nyi.freebsd.org (mailman.nyi.freebsd.org [IPv6:2610:1c1:1:606c::50:13]) by mx1.freebsd.org (Postfix) with ESMTP id 4CR0Rb0PhBz4Rgv for ; Wed, 4 Nov 2020 08:38:35 +0000 (UTC) (envelope-from soren.schmidt@gmail.com) Received: by mailman.nyi.freebsd.org (Postfix) id 0BFE24559EA; Wed, 4 Nov 2020 08:38:35 +0000 (UTC) Delivered-To: arm@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 0BB41455078 for ; Wed, 4 Nov 2020 08:38:35 +0000 (UTC) (envelope-from soren.schmidt@gmail.com) Received: from mail-wr1-x42b.google.com (mail-wr1-x42b.google.com [IPv6:2a00:1450:4864:20::42b]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "GTS CA 1O1" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4CR0RY6mqVz4RXx for ; Wed, 4 Nov 2020 08:38:33 +0000 (UTC) (envelope-from soren.schmidt@gmail.com) Received: by mail-wr1-x42b.google.com with SMTP id e6so3847727wro.1 for ; Wed, 04 Nov 2020 00:38:33 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=from:mime-version:subject:message-id:date:to; bh=UguBQZe5QZ8ceGEx73NQrBdfq2AIanHzqY6uYLFVZSE=; b=HxifIQytCjdBp7LWN62kTVcBXedZYRsrzFaYSh6HX4BYfvFTmq9oaGLaMCVvvdlVns dgAybjKxGRF4OB2okg7ZtDuai4rpK8uO6obLrfYuJh4YAIbva7AHeAO7zBGdG9bypmtk OjcK558G9l4ugJ2kwRO9thPXTcWvnaLezEYcq6/Xs0buRCTM01InmLx9kO3RgQKLhv7o jQ5j9Kd93Rp8qqickPiU367+a40eUpQ3vVwTzATtaSo18mxBvhgYHziIkFkq88PY/gRz bDYrT8jNzuP9XiMnz0SAmUF9ePmp68sfN/T2RTVsUNg1uX807G4/v9dsrOJ8WKskEKoG N4cQ== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:from:mime-version:subject:message-id:date:to; bh=UguBQZe5QZ8ceGEx73NQrBdfq2AIanHzqY6uYLFVZSE=; b=G+Z8NBj3XzSJtzl6cPomlxNtOE+ys4z3PUmRakUUhD8zEBsU4wbYZUzt5Sqmhp4had suex74XpVYyVy/w50RtYl1m4TZV7TncAnj14OEXv4ibQB61QxZ/9cU3DsywDlpvjs7SN TjKBwTyFxx0NjV+Nc8Et2CRkzyncOhiGQ4LZytgvtUEkkoirEyS60sYWhMdGHXhjZ35D SfH3VFgvCde/u9FKU2HR6y4jgzxEtPlZqk4f/uA8TAsVVwdSuRKpPqDJ4lP1YwM0Zwow BY0OUyPBESFoW858Gnk3YTzrCpOhY4odLNh2XnGNFd4ytT/UBNlz09Lm8fFczn9dhbNU pdhg== X-Gm-Message-State: AOAM530LPSBGYxiK4hAmnnFZNAbISZtnly0lmX8vPFLuyLco3OzRx7Tg n/BqNqWjOvMqFSaQ8zj95HcoM0c5vI0= X-Google-Smtp-Source: ABdhPJwUcRlKICWgElGP+iv29bnCpOpCzxzvS5fBLT2rmcBN+9PI6ygYBWixDKQ34m4A7coGz1EEKQ== X-Received: by 2002:adf:f381:: with SMTP id m1mr33915827wro.347.1604479112028; Wed, 04 Nov 2020 00:38:32 -0800 (PST) Received: from mac.deepcore.dk ([85.27.186.9]) by smtp.gmail.com with ESMTPSA id y2sm1617471wrh.0.2020.11.04.00.38.31 for (version=TLS1_2 cipher=ECDHE-ECDSA-AES128-GCM-SHA256 bits=128/128); Wed, 04 Nov 2020 00:38:31 -0800 (PST) From: =?utf-8?Q?S=C3=B8ren_Schmidt?= Mime-Version: 1.0 (Mac OS X Mail 13.4 \(3608.120.23.2.4\)) Subject: if_mvneta rx/tx byte counts wrong Message-Id: <57104A54-AC82-4102-A637-116BF8D2E17D@gmail.com> Date: Wed, 4 Nov 2020 09:38:30 +0100 To: "freebsd-arm@freebsd.org" X-Mailer: Apple Mail (2.3608.120.23.2.4) X-Rspamd-Queue-Id: 4CR0RY6mqVz4RXx X-Spamd-Bar: -- Authentication-Results: mx1.freebsd.org; dkim=pass header.d=gmail.com header.s=20161025 header.b=HxifIQyt; dmarc=pass (policy=none) header.from=gmail.com; spf=pass (mx1.freebsd.org: domain of sorenschmidt@gmail.com designates 2a00:1450:4864:20::42b as permitted sender) smtp.mailfrom=sorenschmidt@gmail.com X-Spamd-Result: default: False [-2.22 / 15.00]; RCVD_VIA_SMTP_AUTH(0.00)[]; FREEMAIL_FROM(0.00)[gmail.com]; MV_CASE(0.50)[]; R_SPF_ALLOW(-0.20)[+ip6:2a00:1450:4000::/36]; RCVD_COUNT_THREE(0.00)[3]; TO_DN_ALL(0.00)[]; DKIM_TRACE(0.00)[gmail.com:+]; DMARC_POLICY_ALLOW(-0.50)[gmail.com,none]; NEURAL_HAM_SHORT(-0.28)[-0.282]; FROM_EQ_ENVFROM(0.00)[]; MIME_TRACE(0.00)[0:+,1:+,2:~]; R_MIXED_CHARSET(0.62)[subject]; FREEMAIL_ENVFROM(0.00)[gmail.com]; ASN(0.00)[asn:15169, ipnet:2a00:1450::/32, country:US]; TAGGED_FROM(0.00)[]; DWL_DNSWL_NONE(0.00)[gmail.com:dkim]; ARC_NA(0.00)[]; NEURAL_HAM_MEDIUM(-1.02)[-1.016]; R_DKIM_ALLOW(-0.20)[gmail.com:s=20161025]; MID_RHS_MATCH_FROM(0.00)[]; FROM_HAS_DN(0.00)[]; TO_MATCH_ENVRCPT_ALL(0.00)[]; NEURAL_HAM_LONG(-1.04)[-1.044]; MIME_GOOD(-0.10)[multipart/alternative,text/plain]; PREVIOUSLY_DELIVERED(0.00)[arm@freebsd.org]; RCPT_COUNT_ONE(0.00)[1]; RCVD_IN_DNSWL_NONE(0.00)[2a00:1450:4864:20::42b:from]; RCVD_TLS_ALL(0.00)[]; MAILMAN_DEST(0.00)[arm] Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: quoted-printable X-Content-Filtered-By: Mailman/MimeDel 2.1.33 X-BeenThere: freebsd-arm@freebsd.org X-Mailman-Version: 2.1.33 Precedence: list List-Id: "Porting FreeBSD to ARM processors." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 04 Nov 2020 08:38:35 -0000 Hi gang While returning to my hacks on the Espressobin I noticed that netstat -w = gives some interesting results: root@EspressoBin:~ # netstat -w1 input (Total) output packets errs idrops bytes packets errs bytes colls 0 0 0 60 0 0 0 0 1 0 0 274877907008 0 0 0 0 0 0 0 60 0 0 0 0 1 0 0 274877907008 0 0 0 0 1 0 0 274877907315 0 0 0 0 3 0 1 1370094567743 0 0 0 0 0 0 0 60 0 0 0 0 1 0 0 274877909253 0 0 0 0 Looking at the sysctl=E2=80=99s its the same thing: dev.mvneta.0.mib.tx_good_oct: 3813930959736 dev.mvneta.0.mib.rx_good_oct: 443193380410133 First though there might be byteordering involved but looking at the raw = values that does not explain the behaviour, however the rx/tx count is = the only values that are 64bit, all others are 32bit and are working as = expected. Any ideas / fixes ? -- S=C3=B8ren Schmidt sos@deepcore.dk / sos@freebsd.org "So much code to hack, so little time" From owner-freebsd-arm@freebsd.org Wed Nov 4 08:52:30 2020 Return-Path: Delivered-To: freebsd-arm@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 42B674560C3; Wed, 4 Nov 2020 08:52:30 +0000 (UTC) (envelope-from hps@selasky.org) Received: from mail.turbocat.net (turbocat.net [IPv6:2a01:4f8:c17:6c4b::2]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4CR0ld1hq3z4SVT; Wed, 4 Nov 2020 08:52:28 +0000 (UTC) (envelope-from hps@selasky.org) Received: from hps2020.home.selasky.org (unknown [178.17.145.105]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (2048 bits)) (No client certificate requested) by mail.turbocat.net (Postfix) with ESMTPSA id DB066260198; Wed, 4 Nov 2020 09:52:25 +0100 (CET) Subject: Re: Problem with checksum offloading on RPi3 (PF + Jails involved) To: =?UTF-8?Q?Carsten_B=c3=a4cker?= , YongHyeon PYUN , Kristof Provost Cc: freebsd-arm@freebsd.org, freebsd-hackers@freebsd.org References: <748edc3d-4ef7-c4de-291f-7c0b460a6052@gmx.de> <5130ee46-5832-d4df-d774-c6bd32e10b30@gmx.de> <20201029213622.GM31099@funkthat.com> <55713894-A896-4F12-ABB9-93DFEB2F16B9@FreeBSD.org> <20201103045215.GA2524@michelle> <46d08198-530c-cb4b-efa8-4edaf89471c1@selasky.org> <4dfaa9a3-c085-8466-a6e4-19f988b5ed3d@selasky.org> From: Hans Petter Selasky Message-ID: <9e1f9407-e2ff-6486-256e-012626b534fb@selasky.org> Date: Wed, 4 Nov 2020 09:52:24 +0100 User-Agent: Mozilla/5.0 (X11; FreeBSD amd64; rv:68.0) Gecko/20100101 Thunderbird/68.10.0 MIME-Version: 1.0 In-Reply-To: Content-Type: text/plain; charset=utf-8; format=flowed Content-Language: en-US Content-Transfer-Encoding: 8bit X-Rspamd-Queue-Id: 4CR0ld1hq3z4SVT X-Spamd-Bar: -- Authentication-Results: mx1.freebsd.org; dkim=none; dmarc=none; spf=pass (mx1.freebsd.org: domain of hps@selasky.org designates 2a01:4f8:c17:6c4b::2 as permitted sender) smtp.mailfrom=hps@selasky.org X-Spamd-Result: default: False [-2.19 / 15.00]; RCVD_TLS_ALL(0.00)[]; RCVD_VIA_SMTP_AUTH(0.00)[]; MID_RHS_MATCH_FROM(0.00)[]; FROM_HAS_DN(0.00)[]; TO_DN_SOME(0.00)[]; R_SPF_ALLOW(-0.20)[+a:mail.turbocat.net]; NEURAL_HAM_LONG(-1.05)[-1.054]; MIME_GOOD(-0.10)[text/plain]; DMARC_NA(0.00)[selasky.org]; ARC_NA(0.00)[]; RCPT_COUNT_FIVE(0.00)[5]; TO_MATCH_ENVRCPT_SOME(0.00)[]; NEURAL_SPAM_SHORT(0.15)[0.153]; NEURAL_HAM_MEDIUM(-0.99)[-0.992]; FREEMAIL_TO(0.00)[gmx.de,gmail.com,FreeBSD.org]; FROM_EQ_ENVFROM(0.00)[]; R_DKIM_NA(0.00)[]; MIME_TRACE(0.00)[0:+]; ASN(0.00)[asn:24940, ipnet:2a01:4f8::/29, country:DE]; RCVD_COUNT_TWO(0.00)[2]; MAILMAN_DEST(0.00)[freebsd-arm,freebsd-hackers] X-BeenThere: freebsd-arm@freebsd.org X-Mailman-Version: 2.1.33 Precedence: list List-Id: "Porting FreeBSD to ARM processors." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 04 Nov 2020 08:52:30 -0000 On 2020-11-04 07:36, Carsten Bäcker wrote: > Am 03.11.2020 um 09:46 schrieb Hans Petter Selasky: >> On 2020-11-03 09:19, Hans Petter Selasky wrote: >>> It looks like smsc(4) uses the following RX format but I don't >>> know actual RX format of H/W(no access to datasheet). >>> >>> <---------------------------- actlen >>> --------------------------------------------------> >>>                  <------------- pktlen ------------------------> >>> rxhdr(4 bytes) | padding (2 bytes) | RX frame | FCS(4 bytes) | >>> partial checksum(2 bytes) >> >> Hi, >> >> I wonder if the checksum is zero, when not valid, and that we should >> check for this in the driver! >> >> Can you try this patch? >> >> Also enabling debugging in the SMSC driver would be useful. >> >> --HPS >> >> _______________________________________________ >> freebsd-hackers@freebsd.org mailing list >> https://lists.freebsd.org/mailman/listinfo/freebsd-hackers >> To unsubscribe, send any mail to >> "freebsd-hackers-unsubscribe@freebsd.org" > Hi, > > i applied the patch on -CURRENT but got a panic right after loading the > kernel. Most likely an unrelated problem. > > But i was able to apply the patch on releng/12.2 (with an offset). > Unfortunately it doesn't change the previously described behavior with > rxcsum and i didn't manage to get any reasonable debug-output. > > Since i can easily reproduce the problem. How else can i help? > Can you enable the debug knob for SMSC: sysctl hw.usb.smsc.debug=16 It will print the RX checksum per frame received. Just do this with the unpatched driver while doing some traffic. Capture log messages from dmesg or /var/log/messages. --HPS From owner-freebsd-arm@freebsd.org Wed Nov 4 12:26:56 2020 Return-Path: Delivered-To: freebsd-arm@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 29D7B45B6E8 for ; Wed, 4 Nov 2020 12:26:56 +0000 (UTC) (envelope-from jfc@mit.edu) Received: from mailman.nyi.freebsd.org (unknown [127.0.1.3]) by mx1.freebsd.org (Postfix) with ESMTP id 4CR5W36s5Vz3RXw for ; Wed, 4 Nov 2020 12:26:55 +0000 (UTC) (envelope-from jfc@mit.edu) Received: by mailman.nyi.freebsd.org (Postfix) id EB50845B962; Wed, 4 Nov 2020 12:26:55 +0000 (UTC) Delivered-To: arm@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id EB13945B961 for ; Wed, 4 Nov 2020 12:26:55 +0000 (UTC) (envelope-from jfc@mit.edu) Received: from outgoing-exchange-7.mit.edu (outgoing-exchange-7.mit.edu [18.9.28.58]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client CN "*.outgoing-exchange.mit.edu", Issuer "InCommon RSA Server CA" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4CR5W25vV0z3S8F for ; Wed, 4 Nov 2020 12:26:54 +0000 (UTC) (envelope-from jfc@mit.edu) Received: from oc11exedge1.exchange.mit.edu (OC11EXEDGE1.EXCHANGE.MIT.EDU [18.9.3.17]) by outgoing-exchange-7.mit.edu (8.14.7/8.12.4) with ESMTP id 0A4CQd7C024867; Wed, 4 Nov 2020 07:26:48 -0500 Received: from w92expo29.exchange.mit.edu (18.7.74.41) by oc11exedge1.exchange.mit.edu (18.9.3.17) with Microsoft SMTP Server (TLS) id 15.0.1293.2; Wed, 4 Nov 2020 07:26:08 -0500 Received: from OC11EXPO29.exchange.mit.edu (18.9.4.102) by w92expo29.exchange.mit.edu (18.7.74.41) with Microsoft SMTP Server (TLS) id 15.0.1365.1; Wed, 4 Nov 2020 07:26:45 -0500 Received: from OC11EXPO29.exchange.mit.edu ([18.9.4.102]) by oc11expo29.exchange.mit.edu ([18.9.4.102]) with mapi id 15.00.1365.000; Wed, 4 Nov 2020 07:26:45 -0500 From: John F Carr To: =?utf-8?B?U8O4cmVuIFNjaG1pZHQ=?= CC: "freebsd-arm@freebsd.org" Subject: Re: if_mvneta rx/tx byte counts wrong Thread-Topic: if_mvneta rx/tx byte counts wrong Thread-Index: AQHWsoXlhAdX79312EyV8P7M6BYhram4OkqA Date: Wed, 4 Nov 2020 12:26:45 +0000 Message-ID: <858E0BCD-C4E9-4997-A982-3C19DF21D161@exchange.mit.edu> References: <57104A54-AC82-4102-A637-116BF8D2E17D@gmail.com> In-Reply-To: <57104A54-AC82-4102-A637-116BF8D2E17D@gmail.com> Accept-Language: en-US Content-Language: en-US X-MS-Has-Attach: X-MS-TNEF-Correlator: x-ms-exchange-messagesentrepresentingtype: 1 x-ms-exchange-transport-fromentityheader: Hosted x-originating-ip: [108.7.221.50] Content-Type: text/plain; charset="utf-8" Content-ID: <2901B470EA5AB349B58492D63962AC68@exchange.mit.edu> Content-Transfer-Encoding: base64 MIME-Version: 1.0 X-Rspamd-Queue-Id: 4CR5W25vV0z3S8F X-Spamd-Bar: --- Authentication-Results: mx1.freebsd.org; dkim=none; dmarc=none; spf=pass (mx1.freebsd.org: domain of jfc@mit.edu designates 18.9.28.58 as permitted sender) smtp.mailfrom=jfc@mit.edu X-Spamd-Result: default: False [-3.13 / 15.00]; ARC_NA(0.00)[]; NEURAL_HAM_MEDIUM(-0.97)[-0.968]; RCVD_COUNT_FIVE(0.00)[5]; HAS_XOIP(0.00)[]; FROM_HAS_DN(0.00)[]; R_SPF_ALLOW(-0.20)[+ip4:18.9.28.0/24]; NEURAL_HAM_LONG(-1.05)[-1.045]; TAGGED_RCPT(0.00)[]; MIME_GOOD(-0.10)[text/plain]; DMARC_NA(0.00)[mit.edu]; TO_MATCH_ENVRCPT_SOME(0.00)[]; TO_DN_ALL(0.00)[]; NEURAL_HAM_SHORT(-0.92)[-0.916]; MIME_BASE64_TEXT(0.10)[]; RCPT_COUNT_TWO(0.00)[2]; FREEMAIL_TO(0.00)[gmail.com]; FROM_EQ_ENVFROM(0.00)[]; R_DKIM_NA(0.00)[]; MIME_TRACE(0.00)[0:+]; ASN(0.00)[asn:3, ipnet:18.9.0.0/16, country:US]; RCVD_TLS_LAST(0.00)[]; MAILMAN_DEST(0.00)[arm]; RWL_MAILSPIKE_POSSIBLE(0.00)[18.9.28.58:from] X-BeenThere: freebsd-arm@freebsd.org X-Mailman-Version: 2.1.33 Precedence: list List-Id: "Porting FreeBSD to ARM processors." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 04 Nov 2020 12:26:56 -0000 SWYgeW91IHZpZXcgaW4gaGV4LA0KDQokIHByaW50ZiAnJXggJXggJXhcbicgNDQzMTkzMzgwNDEw MTMzIDM4MTM5MzA5NTk3MzYgMjc0ODc3OTA3MDA4DQoxOTMxNTAwMDE5MzE1IDM3ODAwMDAwMzc4 IDQwMDAwMDAwNDANCg0KeW91IHNlZSBhIDMyIGJpdCB2YWx1ZSBkdXBsaWNhdGVkIGludG8gYm90 aCBoYWx2ZXMgb2YgYSA2NCBiaXQgdmFsdWUuDQoNCk9uIE5vdiA0LCAyMDIwLCBhdCAwMzozOCAs IFPDuHJlbiBTY2htaWR0IDxzb3Jlbi5zY2htaWR0QGdtYWlsLmNvbT4gd3JvdGU6DQo+IA0KPiBI aSBnYW5nDQo+IA0KPiBXaGlsZSByZXR1cm5pbmcgdG8gbXkgaGFja3Mgb24gdGhlIEVzcHJlc3Nv YmluIEkgbm90aWNlZCB0aGF0IG5ldHN0YXQgLXcgZ2l2ZXMgc29tZSBpbnRlcmVzdGluZyByZXN1 bHRzOg0KPiANCj4gcm9vdEBFc3ByZXNzb0Jpbjp+ICMgbmV0c3RhdCAtdzENCj4gICAgICAgICAg ICBpbnB1dCAgICAgICAgKFRvdGFsKSAgICAgICAgICAgb3V0cHV0DQo+ICAgcGFja2V0cyAgZXJy cyBpZHJvcHMgICAgICBieXRlcyAgICBwYWNrZXRzICBlcnJzICAgICAgYnl0ZXMgY29sbHMNCj4g ICAgICAgICAwICAgICAwICAgICAwICAgICAgICAgNjAgICAgICAgICAgMCAgICAgMCAgICAgICAg ICAwICAgICAwDQo+ICAgICAgICAgMSAgICAgMCAgICAgMCAyNzQ4Nzc5MDcwMDggICAgICAgICAg MCAgICAgMCAgICAgICAgICAwICAgICAwDQo+ICAgICAgICAgMCAgICAgMCAgICAgMCAgICAgICAg IDYwICAgICAgICAgIDAgICAgIDAgICAgICAgICAgMCAgICAgMA0KPiAgICAgICAgIDEgICAgIDAg ICAgIDAgMjc0ODc3OTA3MDA4ICAgICAgICAgIDAgICAgIDAgICAgICAgICAgMCAgICAgMA0KPiAg ICAgICAgIDEgICAgIDAgICAgIDAgMjc0ODc3OTA3MzE1ICAgICAgICAgIDAgICAgIDAgICAgICAg ICAgMCAgICAgMA0KPiAgICAgICAgIDMgICAgIDAgICAgIDEgMTM3MDA5NDU2Nzc0MyAgICAgICAg ICAwICAgICAwICAgICAgICAgIDAgICAgIDANCj4gICAgICAgICAwICAgICAwICAgICAwICAgICAg ICAgNjAgICAgICAgICAgMCAgICAgMCAgICAgICAgICAwICAgICAwDQo+ICAgICAgICAgMSAgICAg MCAgICAgMCAyNzQ4Nzc5MDkyNTMgICAgICAgICAgMCAgICAgMCAgICAgICAgICAwICAgICAwDQo+ IA0KPiBMb29raW5nIGF0IHRoZSBzeXNjdGzigJlzIGl0cyB0aGUgc2FtZSB0aGluZzoNCj4gDQo+ IGRldi5tdm5ldGEuMC5taWIudHhfZ29vZF9vY3Q6IDM4MTM5MzA5NTk3MzYNCj4gZGV2Lm12bmV0 YS4wLm1pYi5yeF9nb29kX29jdDogNDQzMTkzMzgwNDEwMTMzDQo+IA0KPiBGaXJzdCB0aG91Z2gg dGhlcmUgbWlnaHQgYmUgYnl0ZW9yZGVyaW5nIGludm9sdmVkIGJ1dCBsb29raW5nIGF0IHRoZSBy YXcgdmFsdWVzIHRoYXQgZG9lcyBub3QgZXhwbGFpbiB0aGUgYmVoYXZpb3VyLCBob3dldmVyIHRo ZSByeC90eCBjb3VudCBpcyB0aGUgb25seSB2YWx1ZXMgdGhhdCBhcmUgNjRiaXQsIGFsbCBvdGhl cnMgYXJlIDMyYml0IGFuZCBhcmUgd29ya2luZyBhcyBleHBlY3RlZC4NCj4gDQo+IEFueSBpZGVh cyAvIGZpeGVzID8NCj4gDQo+IC0tDQo+IFPDuHJlbiBTY2htaWR0DQo+IHNvc0BkZWVwY29yZS5k ayAvIHNvc0BmcmVlYnNkLm9yZw0KPiAiU28gbXVjaCBjb2RlIHRvIGhhY2ssIHNvIGxpdHRsZSB0 aW1lIg0KPiANCj4gDQo+IA0KPiBfX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19f X19fX19fX19fXw0KPiBmcmVlYnNkLWFybUBmcmVlYnNkLm9yZyBtYWlsaW5nIGxpc3QNCj4gaHR0 cHM6Ly9saXN0cy5mcmVlYnNkLm9yZy9tYWlsbWFuL2xpc3RpbmZvL2ZyZWVic2QtYXJtDQo+IFRv IHVuc3Vic2NyaWJlLCBzZW5kIGFueSBtYWlsIHRvICJmcmVlYnNkLWFybS11bnN1YnNjcmliZUBm cmVlYnNkLm9yZyINCg0K From owner-freebsd-arm@freebsd.org Wed Nov 4 12:39:18 2020 Return-Path: Delivered-To: freebsd-arm@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 8A86C45BE56 for ; Wed, 4 Nov 2020 12:39:18 +0000 (UTC) (envelope-from pi@freebsd.org) Received: from mailman.nyi.freebsd.org (mailman.nyi.freebsd.org [IPv6:2610:1c1:1:606c::50:13]) by mx1.freebsd.org (Postfix) with ESMTP id 4CR5nL38gGz3SZZ for ; Wed, 4 Nov 2020 12:39:18 +0000 (UTC) (envelope-from pi@freebsd.org) Received: by mailman.nyi.freebsd.org (Postfix) id 6C4DC45BEC9; Wed, 4 Nov 2020 12:39:18 +0000 (UTC) Delivered-To: arm@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 6C14145C115 for ; Wed, 4 Nov 2020 12:39:18 +0000 (UTC) (envelope-from pi@freebsd.org) Received: from home.opsec.eu (home.opsec.eu [IPv6:2001:14f8:200::1]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4CR5nL0bWNz3SpS for ; Wed, 4 Nov 2020 12:39:17 +0000 (UTC) (envelope-from pi@freebsd.org) Received: from pi by home.opsec.eu with local (Exim 4.94 (FreeBSD)) (envelope-from ) id 1kaI4D-000L5W-TG; Wed, 04 Nov 2020 13:39:09 +0100 Date: Wed, 4 Nov 2020 13:39:09 +0100 From: Kurt Jaeger To: John F Carr Cc: =?iso-8859-1?Q?S=F8ren?= Schmidt , "freebsd-arm@freebsd.org" Subject: Re: if_mvneta rx/tx byte counts wrong Message-ID: <20201104123909.GF53210@home.opsec.eu> References: <57104A54-AC82-4102-A637-116BF8D2E17D@gmail.com> <858E0BCD-C4E9-4997-A982-3C19DF21D161@exchange.mit.edu> MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: <858E0BCD-C4E9-4997-A982-3C19DF21D161@exchange.mit.edu> X-Rspamd-Queue-Id: 4CR5nL0bWNz3SpS X-Spamd-Bar: / Authentication-Results: mx1.freebsd.org; none X-Spamd-Result: default: False [0.00 / 15.00]; local_wl_from(0.00)[freebsd.org]; TAGGED_RCPT(0.00)[]; ASN(0.00)[asn:12502, ipnet:2001:14f8::/32, country:DE] X-BeenThere: freebsd-arm@freebsd.org X-Mailman-Version: 2.1.33 Precedence: list List-Id: "Porting FreeBSD to ARM processors." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 04 Nov 2020 12:39:18 -0000 Hi! > If you view in hex, > > $ printf '%x %x %x\n' 443193380410133 3813930959736 274877907008 > 1931500019315 37800000378 4000000040 > > you see a 32 bit value duplicated into both halves of a 64 bit value. Ah. I think Juniper switches have the same problem -- I heard that this is a timing/atomicity problem of writing 64bit values on arm32. -- pi@opsec.eu +49 171 3101372 Now what ? From owner-freebsd-arm@freebsd.org Wed Nov 4 12:43:51 2020 Return-Path: Delivered-To: freebsd-arm@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 5FD3245C330 for ; Wed, 4 Nov 2020 12:43:51 +0000 (UTC) (envelope-from soren.schmidt@gmail.com) Received: from mailman.nyi.freebsd.org (mailman.nyi.freebsd.org [IPv6:2610:1c1:1:606c::50:13]) by mx1.freebsd.org (Postfix) with ESMTP id 4CR5tb1543z3T3R for ; Wed, 4 Nov 2020 12:43:51 +0000 (UTC) (envelope-from soren.schmidt@gmail.com) Received: by mailman.nyi.freebsd.org (Postfix) id 24C3845C254; Wed, 4 Nov 2020 12:43:51 +0000 (UTC) Delivered-To: arm@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 2485645C494 for ; Wed, 4 Nov 2020 12:43:51 +0000 (UTC) (envelope-from soren.schmidt@gmail.com) Received: from mail-wr1-x42e.google.com (mail-wr1-x42e.google.com [IPv6:2a00:1450:4864:20::42e]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "GTS CA 1O1" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4CR5tZ37r1z3TJJ for ; Wed, 4 Nov 2020 12:43:50 +0000 (UTC) (envelope-from soren.schmidt@gmail.com) Received: by mail-wr1-x42e.google.com with SMTP id 33so11094240wrl.7 for ; Wed, 04 Nov 2020 04:43:50 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=from:message-id:mime-version:subject:date:in-reply-to:cc:to :references; bh=nu3wpNE5tdzEAH3BFgOZ870I/YxL5Ysjq07JKNZNU/U=; b=OScQdAFtd9hIOCGmnOWYkdbUmpbo8JiY3nFXfAMkuOjMbCJur21U/Ti0IK/bBWkQlN EvLfu03RSAxIzBhXNuoFqXRV8c0No/SsbAavFDmsttP1iHnuHYoODZL3ZzHf8aSNS9V5 98VVlh2he61cus3V45J+l6JMctRoJtpQLNNYdl4qZU7bmyxRPtclUjKMhHzHcTWJWXcT A0PHpWzc5Q5UiXNRk0gefIN/yTnud+kQvO+CmTavGEJP6vA0+74cyz0YJZoDY2d9giws 0Lv/B1SwUFKKDOcRnSySRm0pGHVOT7E9FUCWgR55TlNGSiegPotGh+MzgV3OpQif7xnf nSDA== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:from:message-id:mime-version:subject:date :in-reply-to:cc:to:references; bh=nu3wpNE5tdzEAH3BFgOZ870I/YxL5Ysjq07JKNZNU/U=; b=t2IXSojrj35+YgYJ8mPoQEFRYeZIMunho0LZZ2w+hOpnzyR5h1Lgp6CEvHDhFmbeqJ 1W9HhBTfIlTOR4ACNV3rHOGDAI/wR/VgwWbPhwSSw8+Qh+LBmDDmQJT4Y0fTNV671+YW VaAwq3hvlYjpkABIfkfR9rrQxnUcUJzpp/teHUfpxkWbduI1UwJXZEmFwV9ctTx1Y1qV p/YNqoggxxHWB1ICdDjo8uV5nX0LxSmagZRhd4cTW344XfTiR8SumppQ7HA0LAo7fUxN 0rA+aVkKArrBy6cQGsYPPzZzpdzDzTGulaSx7ZGVlPRXmQBa23uRqOkeosoVPDkQhMGa hVEQ== X-Gm-Message-State: AOAM532CjPXWfVxU2Z/plv7h7SvOA1s5SMBOX3cWx1N0QGl4OFkTZYd+ yDgF16SBd4oUsJaGMBFFawg= X-Google-Smtp-Source: ABdhPJyZ2x3M2yTeg8Qvt9LZTqwBc648AVNMePc+B/e2T9ri1Wl+bQHmkXmZuu7LDB6CkHZrCO49wQ== X-Received: by 2002:a05:6000:18f:: with SMTP id p15mr25512339wrx.185.1604493827504; Wed, 04 Nov 2020 04:43:47 -0800 (PST) Received: from mac.deepcore.dk ([85.27.186.9]) by smtp.gmail.com with ESMTPSA id f7sm2336809wrx.64.2020.11.04.04.43.46 (version=TLS1_2 cipher=ECDHE-ECDSA-AES128-GCM-SHA256 bits=128/128); Wed, 04 Nov 2020 04:43:46 -0800 (PST) From: =?utf-8?Q?S=C3=B8ren_Schmidt?= Message-Id: <5DD7380F-00C1-425F-B44F-1E755A4D30EE@gmail.com> Mime-Version: 1.0 (Mac OS X Mail 13.4 \(3608.120.23.2.4\)) Subject: Re: if_mvneta rx/tx byte counts wrong Date: Wed, 4 Nov 2020 13:43:46 +0100 In-Reply-To: <858E0BCD-C4E9-4997-A982-3C19DF21D161@exchange.mit.edu> Cc: "freebsd-arm@freebsd.org" To: John F Carr References: <57104A54-AC82-4102-A637-116BF8D2E17D@gmail.com> <858E0BCD-C4E9-4997-A982-3C19DF21D161@exchange.mit.edu> X-Mailer: Apple Mail (2.3608.120.23.2.4) X-Rspamd-Queue-Id: 4CR5tZ37r1z3TJJ X-Spamd-Bar: -- Authentication-Results: mx1.freebsd.org; dkim=pass header.d=gmail.com header.s=20161025 header.b=OScQdAFt; dmarc=pass (policy=none) header.from=gmail.com; spf=pass (mx1.freebsd.org: domain of sorenschmidt@gmail.com designates 2a00:1450:4864:20::42e as permitted sender) smtp.mailfrom=sorenschmidt@gmail.com X-Spamd-Result: default: False [-2.68 / 15.00]; RCVD_VIA_SMTP_AUTH(0.00)[]; R_SPF_ALLOW(-0.20)[+ip6:2a00:1450:4000::/36:c]; FREEMAIL_FROM(0.00)[gmail.com]; MV_CASE(0.50)[]; RCVD_COUNT_THREE(0.00)[3]; TO_DN_ALL(0.00)[]; DKIM_TRACE(0.00)[gmail.com:+]; RCPT_COUNT_TWO(0.00)[2]; DMARC_POLICY_ALLOW(-0.50)[gmail.com,none]; NEURAL_HAM_SHORT(-0.69)[-0.689]; FROM_EQ_ENVFROM(0.00)[]; MIME_TRACE(0.00)[0:+,1:+,2:~]; R_MIXED_CHARSET(0.56)[subject]; FREEMAIL_ENVFROM(0.00)[gmail.com]; ASN(0.00)[asn:15169, ipnet:2a00:1450::/32, country:US]; TAGGED_FROM(0.00)[]; DWL_DNSWL_NONE(0.00)[gmail.com:dkim]; ARC_NA(0.00)[]; NEURAL_HAM_MEDIUM(-0.99)[-0.986]; R_DKIM_ALLOW(-0.20)[gmail.com:s=20161025]; MID_RHS_MATCH_FROM(0.00)[]; FROM_HAS_DN(0.00)[]; NEURAL_HAM_LONG(-1.06)[-1.059]; MIME_GOOD(-0.10)[multipart/alternative,text/plain]; PREVIOUSLY_DELIVERED(0.00)[arm@freebsd.org]; TO_MATCH_ENVRCPT_SOME(0.00)[]; RCVD_IN_DNSWL_NONE(0.00)[2a00:1450:4864:20::42e:from]; RCVD_TLS_ALL(0.00)[]; MAILMAN_DEST(0.00)[arm] Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: quoted-printable X-Content-Filtered-By: Mailman/MimeDel 2.1.33 X-BeenThere: freebsd-arm@freebsd.org X-Mailman-Version: 2.1.33 Precedence: list List-Id: "Porting FreeBSD to ARM processors." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 04 Nov 2020 12:43:51 -0000 Hi John Good catch!, if I just use those as 32bit values it =E2=80=9Cjust = works=E2=80=9D seems the Marvell version has a bug or config problem = here.. > On 4 Nov 2020, at 13.26, John F Carr wrote: >=20 > If you view in hex, >=20 > $ printf '%x %x %x\n' 443193380410133 3813930959736 274877907008 > 1931500019315 37800000378 4000000040 >=20 > you see a 32 bit value duplicated into both halves of a 64 bit value. >=20 > On Nov 4, 2020, at 03:38 , S=C3=B8ren Schmidt = wrote: >>=20 >> Hi gang >>=20 >> While returning to my hacks on the Espressobin I noticed that netstat = -w gives some interesting results: >>=20 >> root@EspressoBin:~ # netstat -w1 >> input (Total) output >> packets errs idrops bytes packets errs bytes colls >> 0 0 0 60 0 0 0 0 >> 1 0 0 274877907008 0 0 0 0 >> 0 0 0 60 0 0 0 0 >> 1 0 0 274877907008 0 0 0 0 >> 1 0 0 274877907315 0 0 0 0 >> 3 0 1 1370094567743 0 0 0 0 >> 0 0 0 60 0 0 0 0 >> 1 0 0 274877909253 0 0 0 0 >>=20 >> Looking at the sysctl=E2=80=99s its the same thing: >>=20 >> dev.mvneta.0.mib.tx_good_oct: 3813930959736 >> dev.mvneta.0.mib.rx_good_oct: 443193380410133 >>=20 >> First though there might be byteordering involved but looking at the = raw values that does not explain the behaviour, however the rx/tx count = is the only values that are 64bit, all others are 32bit and are working = as expected. >>=20 >> Any ideas / fixes ? >>=20 >> -- >> S=C3=B8ren Schmidt >> sos@deepcore.dk / sos@freebsd.org >> "So much code to hack, so little time" >>=20 >>=20 >>=20 >> _______________________________________________ >> freebsd-arm@freebsd.org mailing list >> https://lists.freebsd.org/mailman/listinfo/freebsd-arm >> To unsubscribe, send any mail to = "freebsd-arm-unsubscribe@freebsd.org" >=20 -- S=C3=B8ren Schmidt sos@deepcore.dk / sos@freebsd.org "So much code to hack, so little time" From owner-freebsd-arm@freebsd.org Thu Nov 5 02:02:27 2020 Return-Path: Delivered-To: freebsd-arm@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 4034B46EAA5 for ; Thu, 5 Nov 2020 02:02:27 +0000 (UTC) (envelope-from swills@FreeBSD.org) Received: from mouf.net (mouf.net [IPv6:2607:fc50:0:4400:216:3eff:fe69:33b3]) (using TLSv1 with cipher DHE-RSA-AES256-SHA (256/256 bits)) (Client CN "mouf.net", Issuer "mouf.net" (not verified)) by mx1.freebsd.org (Postfix) with ESMTPS id 4CRRc26GWqz4c8j; Thu, 5 Nov 2020 02:02:26 +0000 (UTC) (envelope-from swills@FreeBSD.org) Received: from lrrr.mouf.net (cpe-76-182-16-135.nc.res.rr.com [76.182.16.135]) (authenticated bits=0) by mouf.net (8.14.9/8.14.9) with ESMTP id 0A5222SV077655 (version=TLSv1/SSLv3 cipher=AES128-SHA bits=128 verify=NOT); Thu, 5 Nov 2020 02:02:13 GMT (envelope-from swills@FreeBSD.org) Subject: Re: growfs triggering sdhc errors From: Steve Wills To: freebsd-arm@freebsd.org References: <2724d1d4-58a1-eef2-c6bb-ce1be0fa3123@FreeBSD.org> <5f443e74-5e55-c8b2-f4c2-ea0034437aa0@FreeBSD.org> Cc: Andrew Turner , Marcin Wojtas Message-ID: Date: Wed, 4 Nov 2020 21:01:57 -0500 User-Agent: Mozilla/5.0 (X11; FreeBSD amd64; rv:78.0) Gecko/20100101 Thunderbird/78.4.0 MIME-Version: 1.0 In-Reply-To: <5f443e74-5e55-c8b2-f4c2-ea0034437aa0@FreeBSD.org> Content-Type: text/plain; charset=utf-8; format=flowed Content-Language: en-US Content-Transfer-Encoding: 8bit X-Greylist: Sender succeeded SMTP AUTH, not delayed by milter-greylist-4.4.3 (mouf.net [199.48.129.64]); Thu, 05 Nov 2020 02:02:14 +0000 (UTC) X-Spam-Status: No, score=0.0 required=4.5 tests=KHOP_HELO_FCRDNS, NICE_REPLY_A autolearn=unavailable autolearn_force=no version=3.4.1 X-Spam-Checker-Version: SpamAssassin 3.4.1 (2015-04-28) on mouf.net X-Virus-Scanned: clamav-milter 0.99.2 at mouf.net X-Virus-Status: Clean X-Rspamd-Queue-Id: 4CRRc26GWqz4c8j X-Spamd-Bar: / Authentication-Results: mx1.freebsd.org; none X-Spamd-Result: default: False [0.00 / 15.00]; local_wl_from(0.00)[FreeBSD.org]; ASN(0.00)[asn:36236, ipnet:2607:fc50::/36, country:US] X-BeenThere: freebsd-arm@freebsd.org X-Mailman-Version: 2.1.33 Precedence: list List-Id: "Porting FreeBSD to ARM processors." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 05 Nov 2020 02:02:27 -0000 Hi, I seem to have narrowed this down to r366106. With commits before that, growfs works fine. After, it gives these errors. This seems to have been discovered already tho: https://lists.freebsd.org/pipermail/svn-src-head/2020-November/141284.html And yet, so for, no response. I will try the proposed patch. Steve On 11/3/20 6:39 PM, Steve Wills wrote: > Just to add a little more detail here, the exact output of growfs is: > > https://reviews.freebsd.org/file/data/xxwzfra5fjqqwxd7ws36/PHID-FILE-h7epoca7bcj5vurlzajf/raw-paste-data.txt > > > I see this using the official snapshots too: > > FreeBSD  13.0-CURRENT FreeBSD 13.0-CURRENT #0 b9403d7aae8-c254071(main): > Thu Oct 29 10:38:29 UTC 2020 > root@releng1.nyi.freebsd.org:/usr/obj/usr/src/arm64.aarch64/sys/GENERIC >  arm64 > > FreeBSD-13.0-CURRENT-arm64-aarch64-RPI3-20201029-b9403d7aae8.img > > Note growfs is triggered on firstboot via the /etc/rc.d/growfs script > and having growfs_enable="YES" in /etc/rc.conf and the /firstboot file > existing. The partitions (MBR and BSD) seem to grow fine (gpart) but the > growfs triggers the issue. > > Steve > > On 11/3/20 6:09 PM, Steve Wills wrote: >> Hi, >> >> It seems that sometime between r362013 and r366608 of CURRENT, >> something broke such that growfs on my RPI3 breaks with: >> >> sdhci_bcm0-slot0: Got data interrupt 0x00600000, but there is no >> active command. >> >> followed by a register dump. Any ideas where to look? >> >> Thanks, >> Steve >> _______________________________________________ >> freebsd-arm@freebsd.org mailing list >> https://lists.freebsd.org/mailman/listinfo/freebsd-arm >> To unsubscribe, send any mail to "freebsd-arm-unsubscribe@freebsd.org" > _______________________________________________ > freebsd-arm@freebsd.org mailing list > https://lists.freebsd.org/mailman/listinfo/freebsd-arm > To unsubscribe, send any mail to "freebsd-arm-unsubscribe@freebsd.org" From owner-freebsd-arm@freebsd.org Thu Nov 5 06:45:33 2020 Return-Path: Delivered-To: freebsd-arm@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 0314D44C998 for ; Thu, 5 Nov 2020 06:45:33 +0000 (UTC) (envelope-from melounmichal@gmail.com) Received: from mail-ej1-x633.google.com (mail-ej1-x633.google.com [IPv6:2a00:1450:4864:20::633]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "GTS CA 1O1" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4CRYth0sgRz4qsm for ; Thu, 5 Nov 2020 06:45:31 +0000 (UTC) (envelope-from melounmichal@gmail.com) Received: by mail-ej1-x633.google.com with SMTP id w13so969250eju.13 for ; Wed, 04 Nov 2020 22:45:31 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=sender:from:reply-to:subject:to:references:message-id:date :user-agent:mime-version:in-reply-to:content-language :content-transfer-encoding; bh=yeg/KbHjKpb67Q9hjOnnlVrfnM6gClS6RpTcbvljSGs=; b=AKR+4MuQa9XBEQZDPBS+23QYB8Vg7Ps48FD1sbmiIsBSh+hR8IfywWRq5ePysfaiJ0 NQUry0v6oX1LZ4JfTbR+1q65Zilsfgc1Gv6XVYGV+T59TjdejjJW3IXHIY1aQcxAUR66 eQuf6inW2k/280TbvAvZOEgtE+h6MfHX4kgZ3DVvDmXG9bnjCJOIHpLrKWq/aGy80QrU Y6wqh7Rw70vhtwdvBkbS3KftlUKDh4HKLMO3A58B/F4GLeVsRgCxYMahfAWArl6QIo3G aYaGMZbXv9dHtmgAkupHzf8AHM7rBSV90oiP8CDKMmafgNn74rijx2cYQjGH7GjJZyaZ rrKw== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:sender:from:reply-to:subject:to:references :message-id:date:user-agent:mime-version:in-reply-to :content-language:content-transfer-encoding; bh=yeg/KbHjKpb67Q9hjOnnlVrfnM6gClS6RpTcbvljSGs=; b=F0/HpiYUtpbpCGL7fPgkx4hTm2ZdD4Us3pyBGyThqC54jGYz90vUGTWJBqW9DhUap/ 1byxOiUrKoOOJSKoGb7EtFufCSYcsN/7Aq6RChuqNT9BKLhJ7KlxwDBF4mUaFDyvB7UL CAS8u16abrCGlz52HFRseCO1j8mMJbYRAWn/4FLA+eaQOBz+OAG2GnpePNWyhxo/TQTb mlP1abB87AWQPplPAVy6PLXcE/QojlC+UvV1ithyk/Aqh9/JzdKehFbqfCf2BAmZPrVk MyEfB4bvBA11cOfllkP1Tt3FGzam5a3jJVhu2t7/EiBBrEU5Lq0B3CuxUCjNNH33graT FGlA== X-Gm-Message-State: AOAM532iXfxIip3iCMo5AaUTEqY50CuFhNlkpdRfC2+h7D38bOxxeSbZ 7pzVrfk+uyWmk6D7jFsGjvRFRuVjxe0= X-Google-Smtp-Source: ABdhPJzbVgY54mu+km9bx9ycPExGjEFmTnpSFU+PhfCahZ76EbGI/vQWKpqVKe8/hud0BrvSC3wM3A== X-Received: by 2002:a17:906:b043:: with SMTP id bj3mr892021ejb.338.1604558730326; Wed, 04 Nov 2020 22:45:30 -0800 (PST) Received: from [88.208.79.100] (halouny.humusoft.cz. [88.208.79.100]) by smtp.gmail.com with ESMTPSA id y12sm343505ejj.95.2020.11.04.22.45.29 for (version=TLS1_3 cipher=TLS_AES_128_GCM_SHA256 bits=128/128); Wed, 04 Nov 2020 22:45:29 -0800 (PST) Sender: Michal Meloun From: Michal Meloun X-Google-Original-From: Michal Meloun Reply-To: mmel@freebsd.org Subject: Re: growfs triggering sdhc errors To: freebsd-arm@freebsd.org References: <2724d1d4-58a1-eef2-c6bb-ce1be0fa3123@FreeBSD.org> <5f443e74-5e55-c8b2-f4c2-ea0034437aa0@FreeBSD.org> Message-ID: <6780ae20-de0b-62ce-4090-43e1cb3f87d3@freebsd.org> Date: Thu, 5 Nov 2020 07:45:29 +0100 User-Agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64; rv:78.0) Gecko/20100101 Thunderbird/78.4.0 MIME-Version: 1.0 In-Reply-To: Content-Type: text/plain; charset=utf-8; format=flowed Content-Language: en-US Content-Transfer-Encoding: 8bit X-Rspamd-Queue-Id: 4CRYth0sgRz4qsm X-Spamd-Bar: -- Authentication-Results: mx1.freebsd.org; dkim=pass header.d=gmail.com header.s=20161025 header.b=AKR+4MuQ; dmarc=pass (policy=none) header.from=gmail.com; spf=pass (mx1.freebsd.org: domain of melounmichal@gmail.com designates 2a00:1450:4864:20::633 as permitted sender) smtp.mailfrom=melounmichal@gmail.com X-Spamd-Result: default: False [-2.28 / 15.00]; HAS_REPLYTO(0.00)[mmel@freebsd.org]; RCVD_VIA_SMTP_AUTH(0.00)[]; R_SPF_ALLOW(-0.20)[+ip6:2a00:1450:4000::/36:c]; FREEMAIL_FROM(0.00)[gmail.com]; TO_DN_NONE(0.00)[]; RCVD_COUNT_THREE(0.00)[3]; DKIM_TRACE(0.00)[gmail.com:+]; DMARC_POLICY_ALLOW(-0.50)[gmail.com,none]; NEURAL_HAM_SHORT(-0.31)[-0.309]; FROM_EQ_ENVFROM(0.00)[]; MIME_TRACE(0.00)[0:+]; FREEMAIL_ENVFROM(0.00)[gmail.com]; ASN(0.00)[asn:15169, ipnet:2a00:1450::/32, country:US]; TAGGED_FROM(0.00)[]; DWL_DNSWL_NONE(0.00)[gmail.com:dkim]; ARC_NA(0.00)[]; NEURAL_HAM_MEDIUM(-1.00)[-0.995]; R_DKIM_ALLOW(-0.20)[gmail.com:s=20161025]; FROM_HAS_DN(0.00)[]; TO_MATCH_ENVRCPT_ALL(0.00)[]; NEURAL_HAM_LONG(-0.97)[-0.974]; MIME_GOOD(-0.10)[text/plain]; REPLYTO_DOM_NEQ_FROM_DOM(0.00)[]; PREVIOUSLY_DELIVERED(0.00)[freebsd-arm@freebsd.org]; RCPT_COUNT_ONE(0.00)[1]; MID_RHS_MATCH_TO(1.00)[]; RCVD_IN_DNSWL_NONE(0.00)[2a00:1450:4864:20::633:from]; RCVD_TLS_ALL(0.00)[]; MAILMAN_DEST(0.00)[freebsd-arm] X-BeenThere: freebsd-arm@freebsd.org X-Mailman-Version: 2.1.33 Precedence: list List-Id: "Porting FreeBSD to ARM processors." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 05 Nov 2020 06:45:33 -0000 On 05.11.2020 3:01, Steve Wills wrote: > Hi, > > I seem to have narrowed this down to r366106. With commits before that, > growfs works fine. After, it gives these errors. This seems to have been > discovered already tho: > > https://lists.freebsd.org/pipermail/svn-src-head/2020-November/141284.html > > And yet, so for, no response. I will try the proposed patch. > > Steve > This problem should be fixed in another way by r367268. Can you, please, test a fresh current? Michal > On 11/3/20 6:39 PM, Steve Wills wrote: >> Just to add a little more detail here, the exact output of growfs is: >> >> https://reviews.freebsd.org/file/data/xxwzfra5fjqqwxd7ws36/PHID-FILE-h7epoca7bcj5vurlzajf/raw-paste-data.txt >> >> >> I see this using the official snapshots too: >> >> FreeBSD  13.0-CURRENT FreeBSD 13.0-CURRENT #0 >> b9403d7aae8-c254071(main): Thu Oct 29 10:38:29 UTC 2020 >> root@releng1.nyi.freebsd.org:/usr/obj/usr/src/arm64.aarch64/sys/GENERIC   arm64 >> >> >> FreeBSD-13.0-CURRENT-arm64-aarch64-RPI3-20201029-b9403d7aae8.img >> >> Note growfs is triggered on firstboot via the /etc/rc.d/growfs script >> and having growfs_enable="YES" in /etc/rc.conf and the /firstboot file >> existing. The partitions (MBR and BSD) seem to grow fine (gpart) but >> the growfs triggers the issue. >> >> Steve >> >> On 11/3/20 6:09 PM, Steve Wills wrote: >>> Hi, >>> >>> It seems that sometime between r362013 and r366608 of CURRENT, >>> something broke such that growfs on my RPI3 breaks with: >>> >>> sdhci_bcm0-slot0: Got data interrupt 0x00600000, but there is no >>> active command. >>> >>> followed by a register dump. Any ideas where to look? >>> >>> Thanks, >>> Steve >>> _______________________________________________ >>> freebsd-arm@freebsd.org mailing list >>> https://lists.freebsd.org/mailman/listinfo/freebsd-arm >>> To unsubscribe, send any mail to "freebsd-arm-unsubscribe@freebsd.org" >> _______________________________________________ >> freebsd-arm@freebsd.org mailing list >> https://lists.freebsd.org/mailman/listinfo/freebsd-arm >> To unsubscribe, send any mail to "freebsd-arm-unsubscribe@freebsd.org" > _______________________________________________ > freebsd-arm@freebsd.org mailing list > https://lists.freebsd.org/mailman/listinfo/freebsd-arm > To unsubscribe, send any mail to "freebsd-arm-unsubscribe@freebsd.org" From owner-freebsd-arm@freebsd.org Thu Nov 5 06:47:23 2020 Return-Path: Delivered-To: freebsd-arm@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id ADDEB44C6AB; Thu, 5 Nov 2020 06:47:23 +0000 (UTC) (envelope-from carbaecker@gmx.de) Received: from mout.gmx.net (mout.gmx.net [212.227.17.21]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange ECDHE (P-256) server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "mout.gmx.net", Issuer "TeleSec ServerPass Class 2 CA" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4CRYwp3GK5z4r4j; Thu, 5 Nov 2020 06:47:22 +0000 (UTC) (envelope-from carbaecker@gmx.de) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/simple; d=gmx.net; s=badeba3b8450; t=1604558839; bh=Z6qBi7u8kRLlV+NAl9BsbXYZfr9cQYzsekFoSDwoNHc=; h=X-UI-Sender-Class:Subject:To:Cc:References:From:Date:In-Reply-To; b=C4NiT1T9sJSZ3zCnH9mjY9OkoLhrPGOqcvZv9WEHJN2I9QoAKfpJubUAHTKzCmPsh 2p/gWcnvztizVmvoIOSZ7SG85rpfwOBrXcFBYYjOVu1FBwx5LJhd6uQqvVn0jHGegH W8yyAgH++aLY6+nvQK2TYepOFDpa4bHYtf2l+zJE= X-UI-Sender-Class: 01bb95c1-4bf8-414a-932a-4f6e2808ef9c Received: from [192.168.178.30] ([94.31.96.148]) by mail.gmx.com (mrgmx104 [212.227.17.168]) with ESMTPSA (Nemesis) id 1MAwbp-1kTiM336Xh-00BJYO; Thu, 05 Nov 2020 07:47:18 +0100 Subject: Re: Problem with checksum offloading on RPi3 (PF + Jails involved) To: Hans Petter Selasky , YongHyeon PYUN , Kristof Provost Cc: freebsd-arm@freebsd.org, freebsd-hackers@freebsd.org References: <748edc3d-4ef7-c4de-291f-7c0b460a6052@gmx.de> <5130ee46-5832-d4df-d774-c6bd32e10b30@gmx.de> <20201029213622.GM31099@funkthat.com> <55713894-A896-4F12-ABB9-93DFEB2F16B9@FreeBSD.org> <20201103045215.GA2524@michelle> <46d08198-530c-cb4b-efa8-4edaf89471c1@selasky.org> <4dfaa9a3-c085-8466-a6e4-19f988b5ed3d@selasky.org> <9e1f9407-e2ff-6486-256e-012626b534fb@selasky.org> From: =?UTF-8?Q?Carsten_B=c3=a4cker?= Message-ID: <5b9e2422-e43c-c1d6-a2ba-5e7544618881@gmx.de> Date: Thu, 5 Nov 2020 07:47:17 +0100 User-Agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64; rv:78.0) Gecko/20100101 Thunderbird/78.4.0 MIME-Version: 1.0 In-Reply-To: <9e1f9407-e2ff-6486-256e-012626b534fb@selasky.org> Content-Type: multipart/mixed; boundary="------------EE2C18579A1D26EAA6F28607" Content-Language: de-DE X-Provags-ID: V03:K1:10w26K1BDwRJgz41NysnxpbYBHptBNd3lf6XVDRz9HrQ8agrLCu G8/P8P6n9cKIp3tHA2PwtBuM6k0IlJ1pGSft+5A/mcsMtAx4PNCyrCVQEzhcKgvRh+4NXf8 otSXFS97ybt0QaxXkFYJpt5/Q4HtSs4Yrkk/PgodT7Sta22odIKA5JL7EzObbJ9S0r5jMAp 6iEWSBVqWugdqd3ifgfNg== X-Spam-Flag: NO X-UI-Out-Filterresults: notjunk:1;V03:K0:HMyUbYUbkos=:rOFQvgzSRV7e0G2hIAPsDu nmS/lwIjRkbSJPMutrjVSWB8BqXGQ8zKe46JJZgkQLObeRkNPlrNZ5/puRnEblWmgwTp5GkdD NA3AaoVJGXRb8duRCjRkbpvaQEUVwEZft0rbstny+t6DYhOyAtMEhT6RhyJpTNh5GfZCM7NkX PaUIPd+r1llvW0jlHFBiKUVMqtw7Ul099FIKjqvC+04gZ5eEKf6yRZTPu86No1B0oCpqyqFZM ABVsLTKwbpB8TJjcMhHifwqDIdElNopQuM0Tn40ZkDEx3Tlk4Kcd0x1uskkX+3g8oJWcNCHyP fWNhkyzPzV14M2WzPZnhEh78h22n7QtoyO9w8ecLgVmVSclJEZe6WeFvOlWKSo5oXCU1nfyc9 agzLjgn6/lIUcpuJ98TjHj1GUZZCU804RzbyXa70ylbzNJrhYWSP1Z5Y9QJTgpjVYX6CmNib1 Eyu3/v/Y0SRxjpUBFjilU3r0g0bA6EfurtOmklp3EKsnxJEUUB54F8aL0oA8f5J9uEyklHt/b D653lfGs7Rm9Qqg4wY0o+ATpMmZZcmk/4bSjDtg3nJH+nXc42vDSK6ml1MxXOb6/16579nsgm +ndzOj/pTOWHSZFXu5RNDT+2eL9eB3qcfqnS2T797XitQsuagvREttWDZjCsKE4A4y2OdpuUg RweLf183X7kFoza4s6ZL6YMxCLLCNtifuVOQJq84SR3fTAbRqluR1GoIfDQZtXd+GPmynqRpb WXX0++AhjIs50c25RGEE9+hi6vuTE8+OoK1eEQ92u4cl4jefRjs7AGFfEXV3l2/PUDMt8qQdL +cKa9Kd9HHlBYJXU/xIOpxRY9re2exNoQyFcVgMTeCRrZB0CT62E38El8Ph3o09T+3HPtPp8I 08eUAfwHmQNpJfwkV0Kw== X-Rspamd-Queue-Id: 4CRYwp3GK5z4r4j X-Spamd-Bar: / Authentication-Results: mx1.freebsd.org; dkim=pass header.d=gmx.net header.s=badeba3b8450 header.b=C4NiT1T9; dmarc=none; spf=pass (mx1.freebsd.org: domain of carbaecker@gmx.de designates 212.227.17.21 as permitted sender) smtp.mailfrom=carbaecker@gmx.de X-Spamd-Result: default: False [-0.90 / 15.00]; RCVD_VIA_SMTP_AUTH(0.00)[]; TO_DN_SOME(0.00)[]; FREEMAIL_FROM(0.00)[gmx.de]; R_SPF_ALLOW(-0.20)[+ip4:212.227.17.0/27]; HAS_ATTACHMENT(0.00)[]; MIME_BASE64_TEXT_BOGUS(1.00)[]; RCPT_COUNT_FIVE(0.00)[5]; DKIM_TRACE(0.00)[gmx.net:+]; MIME_BASE64_TEXT(0.10)[]; CTYPE_MIXED_BOGUS(1.00)[]; NEURAL_HAM_SHORT(-0.41)[-0.411]; FREEMAIL_TO(0.00)[selasky.org,gmail.com,FreeBSD.org]; FROM_EQ_ENVFROM(0.00)[]; MIME_TRACE(0.00)[0:+,1:+,2:+,3:+,4:+]; FREEMAIL_ENVFROM(0.00)[gmx.de]; ASN(0.00)[asn:8560, ipnet:212.227.0.0/16, country:DE]; MID_RHS_MATCH_FROM(0.00)[]; RCVD_IN_DNSWL_LOW(-0.10)[212.227.17.21:from]; ARC_NA(0.00)[]; NEURAL_HAM_MEDIUM(-0.97)[-0.971]; R_DKIM_ALLOW(-0.20)[gmx.net:s=badeba3b8450]; RECEIVED_SPAMHAUS_PBL(0.00)[94.31.96.148:received]; FROM_HAS_DN(0.00)[]; NEURAL_HAM_LONG(-1.02)[-1.020]; MIME_GOOD(-0.10)[multipart/mixed,text/plain]; DMARC_NA(0.00)[gmx.de]; TO_MATCH_ENVRCPT_SOME(0.00)[]; RWL_MAILSPIKE_POSSIBLE(0.00)[212.227.17.21:from]; RCVD_COUNT_TWO(0.00)[2]; RCVD_TLS_ALL(0.00)[]; MAILMAN_DEST(0.00)[freebsd-hackers,freebsd-arm] X-BeenThere: freebsd-arm@freebsd.org X-Mailman-Version: 2.1.33 Precedence: list List-Id: "Porting FreeBSD to ARM processors." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 05 Nov 2020 06:47:23 -0000 This is a multi-part message in MIME format. --------------EE2C18579A1D26EAA6F28607 Content-Type: text/plain; charset=utf-8; format=flowed Content-Transfer-Encoding: quoted-printable Am 04.11.2020 um 09:52 schrieb Hans Petter Selasky: > On 2020-11-04 07:36, Carsten B=C3=A4cker wrote: >> Am 03.11.2020 um 09:46 schrieb Hans Petter Selasky: >>> On 2020-11-03 09:19, Hans Petter Selasky wrote: >>>> It looks like smsc(4) uses the following RX format but I don't >>>> know actual RX format of H/W(no access to datasheet). >>>> >>>> <---------------------------- actlen >>>> --------------------------------------------------> >>>> =C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2= =A0=C2=A0=C2=A0=C2=A0=C2=A0 <------------- pktlen ------------------------= > >>>> rxhdr(4 bytes) | padding (2 bytes) | RX frame | FCS(4 bytes) | >>>> partial checksum(2 bytes) >>> >>> Hi, >>> >>> I wonder if the checksum is zero, when not valid, and that we should >>> check for this in the driver! >>> >>> Can you try this patch? >>> >>> Also enabling debugging in the SMSC driver would be useful. >>> >>> --HPS >>> >>> _______________________________________________ >>> freebsd-hackers@freebsd.org mailing list >>> https://lists.freebsd.org/mailman/listinfo/freebsd-hackers >>> To unsubscribe, send any mail to >>> "freebsd-hackers-unsubscribe@freebsd.org" >> Hi, >> >> i applied the patch on -CURRENT but got a panic right after loading the >> kernel. Most likely an unrelated problem. >> >> But i was able to apply the patch on releng/12.2 (with an offset). >> Unfortunately it doesn't change the previously described behavior with >> rxcsum and i didn't manage to get any reasonable debug-output. >> >> Since i can easily reproduce the problem. How else can i help? >> > > Can you enable the debug knob for SMSC: > > sysctl hw.usb.smsc.debug=3D16 > > It will print the RX checksum per frame received. Just do this with > the unpatched driver while doing some traffic. Capture log messages > from dmesg or /var/log/messages. > > --HPS > _______________________________________________ > freebsd-hackers@freebsd.org mailing list > https://lists.freebsd.org/mailman/listinfo/freebsd-hackers > To unsubscribe, send any mail to > "freebsd-hackers-unsubscribe@freebsd.org" Hi, please see the attached the logs. Following command was issued from host + jail: "sysctl hw.usb.smsc.debug=3D16 && sleep 1 && [jexec www-public] ping -c 1 heise.de && sleep 1 && sysctl hw.usb.smsc.debug=3D0" The host-log doesn't show any "RX checksum offloaded", probably the packet length... Changes from the patch have been reverted. Kernel config has been modified to include USB_DEBUG. While there i removed "smsc", so we can load it as a module for easier testing. Meanwhile i upgraded to 12.2: FreeBSD 12.2-RELEASE #5 r367195M: Thu Nov=C2=A0 5 05:52:39 UTC 2020 root@sysbuild:/usr/obj/usr/src_12.2/arm64.aarch64/sys/GENERIC_DBG arm64 aarch64 Regards, Carsten --------------EE2C18579A1D26EAA6F28607 Content-Type: text/plain; charset=UTF-8; name="host_rxcsum" Content-Transfer-Encoding: base64 Content-Disposition: attachment; filename="host_rxcsum" Ck5vdiAgNSAwNjoxODozNiBnZW5lcmljIGtlcm5lbDogc21zYzA6IGRlYnVnOiByeCA6IGFj dGxlbiAxMTYKTm92ICA1IDA2OjE4OjM2IGdlbmVyaWMga2VybmVsOiBzbXNjMDogZGVidWc6 IHJ4IDogcnhoZHIgMHgwMDZlMDAyMCA6IHBrdGxlbiAxMTAgOiBhY3RsZW4gMTE2IDogb2Zm IDYKTm92ICA1IDA2OjE4OjM2IGdlbmVyaWMga2VybmVsOiBzbXNjMDogZGVidWc6IHJ4IDog YWN0bGVuIDExMApOb3YgIDUgMDY6MTg6MzYgZ2VuZXJpYyBrZXJuZWw6IHNtc2MwOiBkZWJ1 ZzogcnggOiByeGhkciAweDAwNjgwMDIwIDogcGt0bGVuIDEwNCA6IGFjdGxlbiAxMTAgOiBv ZmYgNgpOb3YgIDUgMDY6MTg6MzYgZ2VuZXJpYyBrZXJuZWw6IHNtc2MwOiBkZWJ1Zzogcngg OiBhY3RsZW4gNzIKTm92ICA1IDA2OjE4OjM2IGdlbmVyaWMga2VybmVsOiBzbXNjMDogZGVi dWc6IHJ4IDogcnhoZHIgMHgwMDQyMjQyMCA6IHBrdGxlbiA2NiA6IGFjdGxlbiA3MiA6IG9m ZiA2Ck5vdiAgNSAwNjoxODozNiBnZW5lcmljIGtlcm5lbDogc21zYzA6IGRlYnVnOiByeCA6 IGFjdGxlbiA3MgpOb3YgIDUgMDY6MTg6MzYgZ2VuZXJpYyBrZXJuZWw6IHNtc2MwOiBkZWJ1 ZzogcnggOiByeGhkciAweDAwNDIyNDIwIDogcGt0bGVuIDY2IDogYWN0bGVuIDcyIDogb2Zm IDYK --------------EE2C18579A1D26EAA6F28607 Content-Type: text/plain; charset=UTF-8; name="jail_norxcsum" Content-Transfer-Encoding: base64 Content-Disposition: attachment; filename="jail_norxcsum" Ck5vdiAgNSAwNjoxOToyNiBnZW5lcmljIGtlcm5lbDogc21zYzA6IGRlYnVnOiByeCA6IGFj dGxlbiAyMDAKTm92ICA1IDA2OjE5OjI2IGdlbmVyaWMga2VybmVsOiBzbXNjMDogZGVidWc6 IHJ4IDogcnhoZHIgMHgwMGMyMDAyMCA6IHBrdGxlbiAxOTQgOiBhY3RsZW4gMjAwIDogb2Zm IDYKTm92ICA1IDA2OjE5OjI2IGdlbmVyaWMga2VybmVsOiBzbXNjMDogZGVidWc6IHJ4IDog YWN0bGVuIDMyNApOb3YgIDUgMDY6MTk6MjYgZ2VuZXJpYyBrZXJuZWw6IHNtc2MwOiBkZWJ1 ZzogcnggOiByeGhkciAweDAxM2UwMDIwIDogcGt0bGVuIDMxOCA6IGFjdGxlbiAzMjQgOiBv ZmYgNgpOb3YgIDUgMDY6MTk6MjYgZ2VuZXJpYyBrZXJuZWw6IHNtc2MwOiBkZWJ1Zzogcngg OiBhY3RsZW4gMzI0Ck5vdiAgNSAwNjoxOToyNiBnZW5lcmljIGtlcm5lbDogc21zYzA6IGRl YnVnOiByeCA6IHJ4aGRyIDB4MDEzZTAwMjAgOiBwa3RsZW4gMzE4IDogYWN0bGVuIDMyNCA6 IG9mZiA2Ck5vdiAgNSAwNjoxOToyNiBnZW5lcmljIGtlcm5lbDogc21zYzA6IGRlYnVnOiBy eCA6IGFjdGxlbiAxMDAKTm92ICA1IDA2OjE5OjI2IGdlbmVyaWMga2VybmVsOiBzbXNjMDog ZGVidWc6IHJ4IDogcnhoZHIgMHgwMDVlMDAyMCA6IHBrdGxlbiA5NCA6IGFjdGxlbiAxMDAg OiBvZmYgNgpOb3YgIDUgMDY6MTk6MjYgZ2VuZXJpYyBrZXJuZWw6IHNtc2MwOiBkZWJ1Zzog cnggOiBhY3RsZW4gMjAwCk5vdiAgNSAwNjoxOToyNiBnZW5lcmljIGtlcm5lbDogc21zYzA6 IGRlYnVnOiByeCA6IHJ4aGRyIDB4MDBjMjAwMjAgOiBwa3RsZW4gMTk0IDogYWN0bGVuIDIw MCA6IG9mZiA2Ck5vdiAgNSAwNjoxOToyNiBnZW5lcmljIGtlcm5lbDogc21zYzA6IGRlYnVn OiByeCA6IGFjdGxlbiAxOTYKTm92ICA1IDA2OjE5OjI2IGdlbmVyaWMga2VybmVsOiBzbXNj MDogZGVidWc6IHJ4IDogcnhoZHIgMHgwMGJlMDAyMCA6IHBrdGxlbiAxOTAgOiBhY3RsZW4g MTk2IDogb2ZmIDYKTm92ICA1IDA2OjE5OjI2IGdlbmVyaWMga2VybmVsOiBzbXNjMDogZGVi dWc6IHJ4IDogYWN0bGVuIDMyNApOb3YgIDUgMDY6MTk6MjYgZ2VuZXJpYyBrZXJuZWw6IHNt c2MwOiBkZWJ1ZzogcnggOiByeGhkciAweDAxM2UwMDIwIDogcGt0bGVuIDMxOCA6IGFjdGxl biAzMjQgOiBvZmYgNgpOb3YgIDUgMDY6MTk6MjYgZ2VuZXJpYyBrZXJuZWw6IHNtc2MwOiBk ZWJ1ZzogcnggOiBhY3RsZW4gNzAKTm92ICA1IDA2OjE5OjI2IGdlbmVyaWMga2VybmVsOiBz bXNjMDogZGVidWc6IHJ4IDogcnhoZHIgMHgwMDQwMjQyMCA6IHBrdGxlbiA2NCA6IGFjdGxl biA3MCA6IG9mZiA2Ck5vdiAgNSAwNjoxOToyNyBnZW5lcmljIGtlcm5lbDogc21zYzA6IGRl YnVnOiByeCA6IGFjdGxlbiAxOTYKTm92ICA1IDA2OjE5OjI3IGdlbmVyaWMga2VybmVsOiBz bXNjMDogZGVidWc6IHJ4IDogcnhoZHIgMHgwMGJlMDAyMCA6IHBrdGxlbiAxOTAgOiBhY3Rs ZW4gMTk2IDogb2ZmIDYKTm92ICA1IDA2OjE5OjI3IGdlbmVyaWMga2VybmVsOiBzbXNjMDog ZGVidWc6IHJ4IDogYWN0bGVuIDMyNApOb3YgIDUgMDY6MTk6MjcgZ2VuZXJpYyBrZXJuZWw6 IHNtc2MwOiBkZWJ1ZzogcnggOiByeGhkciAweDAxM2UwMDIwIDogcGt0bGVuIDMxOCA6IGFj dGxlbiAzMjQgOiBvZmYgNgpOb3YgIDUgMDY6MTk6MjcgZ2VuZXJpYyBrZXJuZWw6IHNtc2Mw OiBkZWJ1ZzogcnggOiBhY3RsZW4gMjAwCk5vdiAgNSAwNjoxOToyNyBnZW5lcmljIGtlcm5l bDogc21zYzA6IGRlYnVnOiByeCA6IHJ4aGRyIDB4MDBjMjAwMjAgOiBwa3RsZW4gMTk0IDog YWN0bGVuIDIwMCA6IG9mZiA2Ck5vdiAgNSAwNjoxOToyNyBnZW5lcmljIGtlcm5lbDogc21z YzA6IGRlYnVnOiByeCA6IGFjdGxlbiAzMjQKTm92ICA1IDA2OjE5OjI3IGdlbmVyaWMga2Vy bmVsOiBzbXNjMDogZGVidWc6IHJ4IDogcnhoZHIgMHgwMTNlMDAyMCA6IHBrdGxlbiAzMTgg OiBhY3RsZW4gMzI0IDogb2ZmIDYKTm92ICA1IDA2OjE5OjI3IGdlbmVyaWMga2VybmVsOiBz bXNjMDogZGVidWc6IHJ4IDogYWN0bGVuIDMyNApOb3YgIDUgMDY6MTk6MjcgZ2VuZXJpYyBr ZXJuZWw6IHNtc2MwOiBkZWJ1ZzogcnggOiByeGhkciAweDAxM2UwMDIwIDogcGt0bGVuIDMx OCA6IGFjdGxlbiAzMjQgOiBvZmYgNgpOb3YgIDUgMDY6MTk6MjcgZ2VuZXJpYyBrZXJuZWw6 IHNtc2MwOiBkZWJ1ZzogcnggOiBhY3RsZW4gMzI0Ck5vdiAgNSAwNjoxOToyNyBnZW5lcmlj IGtlcm5lbDogc21zYzA6IGRlYnVnOiByeCA6IHJ4aGRyIDB4MDEzZTAwMjAgOiBwa3RsZW4g MzE4IDogYWN0bGVuIDMyNCA6IG9mZiA2Ck5vdiAgNSAwNjoxOToyNyBnZW5lcmljIGtlcm5l bDogc21zYzA6IGRlYnVnOiByeCA6IGFjdGxlbiAyMDAKTm92ICA1IDA2OjE5OjI3IGdlbmVy aWMga2VybmVsOiBzbXNjMDogZGVidWc6IHJ4IDogcnhoZHIgMHgwMGMyMDAyMCA6IHBrdGxl biAxOTQgOiBhY3RsZW4gMjAwIDogb2ZmIDYKTm92ICA1IDA2OjE5OjI3IGdlbmVyaWMga2Vy bmVsOiBzbXNjMDogZGVidWc6IHJ4IDogYWN0bGVuIDMyNApOb3YgIDUgMDY6MTk6MjcgZ2Vu ZXJpYyBrZXJuZWw6IHNtc2MwOiBkZWJ1ZzogcnggOiByeGhkciAweDAxM2UwMDIwIDogcGt0 bGVuIDMxOCA6IGFjdGxlbiAzMjQgOiBvZmYgNgpOb3YgIDUgMDY6MTk6MjcgZ2VuZXJpYyBr ZXJuZWw6IHNtc2MwOiBkZWJ1ZzogcnggOiBhY3RsZW4gMjAwCk5vdiAgNSAwNjoxOToyNyBn ZW5lcmljIGtlcm5lbDogc21zYzA6IGRlYnVnOiByeCA6IHJ4aGRyIDB4MDBjMjAwMjAgOiBw a3RsZW4gMTk0IDogYWN0bGVuIDIwMCA6IG9mZiA2Ck5vdiAgNSAwNjoxOToyNyBnZW5lcmlj IGtlcm5lbDogc21zYzA6IGRlYnVnOiByeCA6IGFjdGxlbiAzMjQKTm92ICA1IDA2OjE5OjI3 IGdlbmVyaWMga2VybmVsOiBzbXNjMDogZGVidWc6IHJ4IDogcnhoZHIgMHgwMTNlMDAyMCA6 IHBrdGxlbiAzMTggOiBhY3RsZW4gMzI0IDogb2ZmIDYKTm92ICA1IDA2OjE5OjI3IGdlbmVy aWMga2VybmVsOiBzbXNjMDogZGVidWc6IHJ4IDogYWN0bGVuIDIwMApOb3YgIDUgMDY6MTk6 MjcgZ2VuZXJpYyBrZXJuZWw6IHNtc2MwOiBkZWJ1ZzogcnggOiByeGhkciAweDAwYzIwMDIw IDogcGt0bGVuIDE5NCA6IGFjdGxlbiAyMDAgOiBvZmYgNgpOb3YgIDUgMDY6MTk6MjcgZ2Vu ZXJpYyBrZXJuZWw6IHNtc2MwOiBkZWJ1ZzogcnggOiBhY3RsZW4gMzI0Ck5vdiAgNSAwNjox OToyNyBnZW5lcmljIGtlcm5lbDogc21zYzA6IGRlYnVnOiByeCA6IHJ4aGRyIDB4MDEzZTAw MjAgOiBwa3RsZW4gMzE4IDogYWN0bGVuIDMyNCA6IG9mZiA2Ck5vdiAgNSAwNjoxOToyNyBn ZW5lcmljIGtlcm5lbDogc21zYzA6IGRlYnVnOiByeCA6IGFjdGxlbiAzMjQKTm92ICA1IDA2 OjE5OjI3IGdlbmVyaWMga2VybmVsOiBzbXNjMDogZGVidWc6IHJ4IDogcnhoZHIgMHgwMTNl MDAyMCA6IHBrdGxlbiAzMTggOiBhY3RsZW4gMzI0IDogb2ZmIDYKTm92ICA1IDA2OjE5OjI3 IGdlbmVyaWMga2VybmVsOiBzbXNjMDogZGVidWc6IHJ4IDogYWN0bGVuIDIwMApOb3YgIDUg MDY6MTk6MjcgZ2VuZXJpYyBrZXJuZWw6IHNtc2MwOiBkZWJ1ZzogcnggOiByeGhkciAweDAw YzIwMDIwIDogcGt0bGVuIDE5NCA6IGFjdGxlbiAyMDAgOiBvZmYgNgpOb3YgIDUgMDY6MTk6 MjcgZ2VuZXJpYyBrZXJuZWw6IHNtc2MwOiBkZWJ1ZzogcnggOiBhY3RsZW4gMzI0Ck5vdiAg NSAwNjoxOToyNyBnZW5lcmljIGtlcm5lbDogc21zYzA6IGRlYnVnOiByeCA6IHJ4aGRyIDB4 MDEzZTAwMjAgOiBwa3RsZW4gMzE4IDogYWN0bGVuIDMyNCA6IG9mZiA2Ck5vdiAgNSAwNjox OToyNyBnZW5lcmljIGtlcm5lbDogc21zYzA6IGRlYnVnOiByeCA6IGFjdGxlbiAyMDAKTm92 ICA1IDA2OjE5OjI3IGdlbmVyaWMga2VybmVsOiBzbXNjMDogZGVidWc6IHJ4IDogcnhoZHIg MHgwMGMyMDAyMCA6IHBrdGxlbiAxOTQgOiBhY3RsZW4gMjAwIDogb2ZmIDYKTm92ICA1IDA2 OjE5OjI3IGdlbmVyaWMga2VybmVsOiBzbXNjMDogZGVidWc6IHJ4IDogYWN0bGVuIDMyNApO b3YgIDUgMDY6MTk6MjcgZ2VuZXJpYyBrZXJuZWw6IHNtc2MwOiBkZWJ1ZzogcnggOiByeGhk ciAweDAxM2UwMDIwIDogcGt0bGVuIDMxOCA6IGFjdGxlbiAzMjQgOiBvZmYgNgpOb3YgIDUg MDY6MTk6MjcgZ2VuZXJpYyBrZXJuZWw6IHNtc2MwOiBkZWJ1ZzogcnggOiBhY3RsZW4gMjAw Ck5vdiAgNSAwNjoxOToyNyBnZW5lcmljIGtlcm5lbDogc21zYzA6IGRlYnVnOiByeCA6IHJ4 aGRyIDB4MDBjMjAwMjAgOiBwa3RsZW4gMTk0IDogYWN0bGVuIDIwMCA6IG9mZiA2Ck5vdiAg NSAwNjoxOToyNyBnZW5lcmljIGtlcm5lbDogc21zYzA6IGRlYnVnOiByeCA6IGFjdGxlbiAx OTYKTm92ICA1IDA2OjE5OjI3IGdlbmVyaWMga2VybmVsOiBzbXNjMDogZGVidWc6IHJ4IDog cnhoZHIgMHgwMGJlMDAyMCA6IHBrdGxlbiAxOTAgOiBhY3RsZW4gMTk2IDogb2ZmIDYKTm92 ICA1IDA2OjE5OjI3IGdlbmVyaWMga2VybmVsOiBzbXNjMDogZGVidWc6IHJ4IDogYWN0bGVu IDMyNApOb3YgIDUgMDY6MTk6MjcgZ2VuZXJpYyBrZXJuZWw6IHNtc2MwOiBkZWJ1Zzogcngg OiByeGhkciAweDAxM2UwMDIwIDogcGt0bGVuIDMxOCA6IGFjdGxlbiAzMjQgOiBvZmYgNgpO b3YgIDUgMDY6MTk6MjcgZ2VuZXJpYyBrZXJuZWw6IHNtc2MwOiBkZWJ1ZzogcnggOiBhY3Rs ZW4gMjAwCk5vdiAgNSAwNjoxOToyNyBnZW5lcmljIGtlcm5lbDogc21zYzA6IGRlYnVnOiBy eCA6IHJ4aGRyIDB4MDBjMjAwMjAgOiBwa3RsZW4gMTk0IDogYWN0bGVuIDIwMCA6IG9mZiA2 Ck5vdiAgNSAwNjoxOToyNyBnZW5lcmljIGtlcm5lbDogc21zYzA6IGRlYnVnOiByeCA6IGFj dGxlbiAzMjQKTm92ICA1IDA2OjE5OjI3IGdlbmVyaWMga2VybmVsOiBzbXNjMDogZGVidWc6 IHJ4IDogcnhoZHIgMHgwMTNlMDAyMCA6IHBrdGxlbiAzMTggOiBhY3RsZW4gMzI0IDogb2Zm IDYKTm92ICA1IDA2OjE5OjI3IGdlbmVyaWMga2VybmVsOiBzbXNjMDogZGVidWc6IHJ4IDog YWN0bGVuIDIwMApOb3YgIDUgMDY6MTk6MjcgZ2VuZXJpYyBrZXJuZWw6IHNtc2MwOiBkZWJ1 ZzogcnggOiByeGhkciAweDAwYzIwMDIwIDogcGt0bGVuIDE5NCA6IGFjdGxlbiAyMDAgOiBv ZmYgNgpOb3YgIDUgMDY6MTk6MjcgZ2VuZXJpYyBrZXJuZWw6IHNtc2MwOiBkZWJ1Zzogcngg OiBhY3RsZW4gMzI0Ck5vdiAgNSAwNjoxOToyNyBnZW5lcmljIGtlcm5lbDogc21zYzA6IApO b3YgIDUgMDY6MTk6MjcgZ2VuZXJpYyBrZXJuZWw6IGRlYnVnOiByeCA6IHJ4aGRyIDB4MDEz ZTAwMjAgOiBwa3RsZW4gMzE4IDogYWN0bGVuIDMyNCA6IG9mZiA2Ck5vdiAgNSAwNjoxOToy NyBnZW5lcmljIGtlcm5lbDogc21zYzA6IGRlYnVnOiByeCA6IGFjdGxlbiAyMDAKTm92ICA1 IDA2OjE5OjI3IGdlbmVyaWMga2VybmVsOiBzbXNjMDogZGVidWc6IHJ4IDogcnhoZHIgMHgw MGMyMDAyMCA6IHBrdGxlbiAxOTQgOiBhY3RsZW4gMjAwIDogb2ZmIDYKTm92ICA1IDA2OjE5 OjI3IGdlbmVyaWMga2VybmVsOiBzbXNjMDogZGVidWc6IHJ4IDogYWN0bGVuIDMyNApOb3Yg IDUgMDY6MTk6MjcgZ2VuZXJpYyBrZXJuZWw6IHNtc2MwOiBkZWJ1ZzogcnggOiByeGhkciAw eDAxM2UwMDIwIDogcGt0bGVuIDMxOCA6IGFjdGxlbiAzMjQgOiBvZmYgNgpOb3YgIDUgMDY6 MTk6MjcgZ2VuZXJpYyBrZXJuZWw6IHNtc2MwOiBkZWJ1ZzogcnggOiBhY3RsZW4gMzI0Ck5v diAgNSAwNjoxOToyNyBnZW5lcmljIGtlcm5lbDogc21zYzA6IGRlYnVnOiByeCA6IHJ4aGRy IDB4MDEzZTAwMjAgOiBwa3RsZW4gMzE4IDogYWN0bGVuIDMyNCA6IG9mZiA2Ck5vdiAgNSAw NjoxOToyNyBnZW5lcmljIGtlcm5lbDogc21zYzA6IGRlYnVnOiByeCA6IGFjdGxlbiAyMDAK Tm92ICA1IDA2OjE5OjI3IGdlbmVyaWMga2VybmVsOiBzbXNjMDogZGVidWc6IHJ4IDogcnho ZHIgMHgwMGMyMDAyMCA6IHBrdGxlbiAxOTQgOiBhY3RsZW4gMjAwIDogb2ZmIDYKTm92ICA1 IDA2OjE5OjI3IGdlbmVyaWMga2VybmVsOiBzbXNjMDogZGVidWc6IHJ4IDogYWN0bGVuIDMy NApOb3YgIDUgMDY6MTk6MjcgZ2VuZXJpYyBrZXJuZWw6IHNtc2MwOiBkZWJ1ZzogcnggOiBy eGhkciAweDAxM2UwMDIwIDogcGt0bGVuIDMxOCA6IGFjdGxlbiAzMjQgOiBvZmYgNgpOb3Yg IDUgMDY6MTk6MjcgZ2VuZXJpYyBrZXJuZWw6IHNtc2MwOiBkZWJ1ZzogcnggOiBhY3RsZW4g MjAwCk5vdiAgNSAwNjoxOToyNyBnZW5lcmljIGtlcm5lbDogc21zYzA6IGRlYnVnOiByeCA6 IHJ4aGRyIDB4MDBjMjAwMjAgOiBwa3RsZW4gMTk0IDogYWN0bGVuIDIwMCA6IG9mZiA2Ck5v diAgNSAwNjoxOToyNyBnZW5lcmljIGtlcm5lbDogc21zYzA6IGRlYnVnOiByeCA6IGFjdGxl biAzMjQKTm92ICA1IDA2OjE5OjI3IGdlbmVyaWMga2VybmVsOiBzbXNjMDogZGVidWc6IHJ4 IDogcnhoZHIgMHgwMTNlMDAyMCA6IHBrdGxlbiAzMTggOiBhY3RsZW4gMzI0IDogb2ZmIDYK Tm92ICA1IDA2OjE5OjI3IGdlbmVyaWMga2VybmVsOiBzbXNjMDogZGVidWc6IHJ4IDogYWN0 bGVuIDIwMApOb3YgIDUgMDY6MTk6MjcgZ2VuZXJpYyBrZXJuZWw6IHNtc2MwOiBkZWJ1Zzog cnggOiByeGhkciAweDAwYzIwMDIwIDogcGt0bGVuIDE5NCA6IGFjdGxlbiAyMDAgOiBvZmYg NgpOb3YgIDUgMDY6MTk6MjcgZ2VuZXJpYyBrZXJuZWw6IHNtc2MwOiBkZWJ1ZzogcnggOiBh Y3RsZW4gMTk2Ck5vdiAgNSAwNjoxOToyNyBnZW5lcmljIGtlcm5lbDogc21zYzA6IGRlYnVn OiByeCA6IHJ4aGRyIDB4MDBiZTAwMjAgOiBwa3RsZW4gMTkwIDogYWN0bGVuIDE5NiA6IG9m ZiA2Ck5vdiAgNSAwNjoxOToyNyBnZW5lcmljIGtlcm5lbDogc21zYzA6IGRlYnVnOiByeCA6 IGFjdGxlbiAzMjQKTm92ICA1IDA2OjE5OjI3IGdlbmVyaWMga2VybmVsOiBzbXNjMDogZGVi dWc6IHJ4IDogcnhoZHIgMHgwMTNlMDAyMCA6IHBrdGxlbiAzMTggOiBhY3RsZW4gMzI0IDog b2ZmIDYKTm92ICA1IDA2OjE5OjI3IGdlbmVyaWMga2VybmVsOiBzbXNjMDogZGVidWc6IHJ4 IDogYWN0bGVuIDMyNApOb3YgIDUgMDY6MTk6MjcgZ2VuZXJpYyBrZXJuZWw6IHNtc2MwOiBk ZWJ1ZzogcnggOiByeGhkciAweDAxM2UwMDIwIDogcGt0bGVuIDMxOCA6IGFjdGxlbiAzMjQg OiBvZmYgNgpOb3YgIDUgMDY6MTk6MjcgZ2VuZXJpYyBrZXJuZWw6IHNtc2MwOiBkZWJ1Zzog cnggOiBhY3RsZW4gMjAwCk5vdiAgNSAwNjoxOToyNyBnZW5lcmljIGtlcm5lbDogc21zYzA6 IGRlYnVnOiByeCA6IHJ4aGRyIDB4MDBjMjAwMjAgOiBwa3RsZW4gMTk0IDogYWN0bGVuIDIw MCA6IG9mZiA2Ck5vdiAgNSAwNjoxOToyNyBnZW5lcmljIGtlcm5lbDogc21zYzA6IGRlYnVn OiByeCA6IGFjdGxlbiAzMjQKTm92ICA1IDA2OjE5OjI3IGdlbmVyaWMga2VybmVsOiBzbXNj MDogZGVidWc6IHJ4IDogcnhoZHIgMHgwMTNlMDAyMCA6IHBrdGxlbiAzMTggOiBhY3RsZW4g MzI0IDogb2ZmIDYKTm92ICA1IDA2OjE5OjI3IGdlbmVyaWMga2VybmVsOiBzbXNjMDogZGVi dWc6IHJ4IDogYWN0bGVuIDIwMApOb3YgIDUgMDY6MTk6MjcgZ2VuZXJpYyBrZXJuZWw6IHNt c2MwOiBkZWJ1ZzogcnggOiByeGhkciAweDAwYzIwMDIwIDogcGt0bGVuIDE5NCA6IGFjdGxl biAyMDAgOiBvZmYgNgpOb3YgIDUgMDY6MTk6MjcgZ2VuZXJpYyBrZXJuZWw6IHNtc2MwOiBk ZWJ1ZzogcnggOiBhY3RsZW4gMTk2Ck5vdiAgNSAwNjoxOToyNyBnZW5lcmljIGtlcm5lbDog c21zYzA6IGRlYnVnOiByeCA6IHJ4aGRyIDB4MDBiZTAwMjAgOiBwa3RsZW4gMTkwIDogYWN0 bGVuIDE5NiA6IG9mZiA2Ck5vdiAgNSAwNjoxOToyNyBnZW5lcmljIGtlcm5lbDogc21zYzA6 IGRlYnVnOiByeCA6IGFjdGxlbiAzMjQKTm92ICA1IDA2OjE5OjI3IGdlbmVyaWMga2VybmVs OiBzbXNjMDogZGVidWc6IHJ4IDogcnhoZHIgMHgwMTNlMDAyMCA6IHBrdGxlbiAzMTggOiBh Y3RsZW4gMzI0IDogb2ZmIDYKTm92ICA1IDA2OjE5OjI3IGdlbmVyaWMga2VybmVsOiBzbXNj MDogZGVidWc6IHJ4IDogYWN0bGVuIDIwMApOb3YgIDUgMDY6MTk6MjcgZ2VuZXJpYyBrZXJu ZWw6IHNtc2MwOiBkZWJ1ZzogcnggOiByeGhkciAweDAwYzIwMDIwIDogcGt0bGVuIDE5NCA6 IGFjdGxlbiAyMDAgOiBvZmYgNgpOb3YgIDUgMDY6MTk6MjcgZ2VuZXJpYyBrZXJuZWw6IHNt c2MwOiBkZWJ1ZzogcnggOiBhY3RsZW4gMTk2Ck5vdiAgNSAwNjoxOToyNyBnZW5lcmljIGtl cm5lbDogc21zYzA6IGRlYnVnOiByeCA6IHJ4aGRyIDB4MDBiZTAwMjAgOiBwa3RsZW4gMTkw IDogYWN0bGVuIDE5NiA6IG9mZiA2Ck5vdiAgNSAwNjoxOToyNyBnZW5lcmljIGtlcm5lbDog c21zYzA6IGRlYnVnOiByeCA6IGFjdGxlbiAzMjQKTm92ICA1IDA2OjE5OjI3IGdlbmVyaWMg a2VybmVsOiBzbXNjMDogZGVidWc6IHJ4IDogcnhoZHIgMHgwMTNlMDAyMCA6IHBrdGxlbiAz MTggOiBhY3RsZW4gMzI0IDogb2ZmIDYKTm92ICA1IDA2OjE5OjI3IGdlbmVyaWMga2VybmVs OiBzbXNjMDogZGVidWc6IHJ4IDogYWN0bGVuIDIwMApOb3YgIDUgMDY6MTk6MjcgZ2VuZXJp YyBrZXJuZWw6IHNtc2MwOiBkZWJ1ZzogcnggOiByeGhkciAweDAwYzIwMDIwIDogcGt0bGVu IDE5NCA6IGFjdGxlbiAyMDAgOiBvZmYgNgpOb3YgIDUgMDY6MTk6MjcgZ2VuZXJpYyBrZXJu ZWw6IHNtc2MwOiBkZWJ1ZzogcnggOiBhY3RsZW4gMTk2Ck5vdiAgNSAwNjoxOToyNyBnZW5l cmljIGtlcm5lbDogc21zYzA6IGRlYnVnOiByeCA6IHJ4aGRyIDB4MDBiZTAwMjAgOiBwa3Rs ZW4gMTkwIDogYWN0bGVuIDE5NiA6IG9mZiA2Ck5vdiAgNSAwNjoxOToyNyBnZW5lcmljIGtl cm5lbDogc21zYzA6IGRlYnVnOiByeCA6IGFjdGxlbiAzMjQKTm92ICA1IDA2OjE5OjI3IGdl bmVyaWMga2VybmVsOiBzbXNjMDogZGVidWc6IHJ4IDogcnhoZHIgMHgwMTNlMDAyMCA6IHBr dGxlbiAzMTggOiBhY3RsZW4gMzI0IDogb2ZmIDYKTm92ICA1IDA2OjE5OjI3IGdlbmVyaWMg a2VybmVsOiBzbXNjMDogZGVidWc6IHJ4IDogYWN0bGVuIDIwMApOb3YgIDUgMDY6MTk6Mjcg Z2VuZXJpYyBrZXJuZWw6IHNtc2MwOiBkZWJ1ZzogcnggOiByeGhkciAweDAwYzIwMDIwIDog cGt0bGVuIDE5NCA6IGFjdGxlbiAyMDAgOiBvZmYgNgpOb3YgIDUgMDY6MTk6MjcgZ2VuZXJp YyBrZXJuZWw6IHNtc2MwOiBkZWJ1ZzogcnggOiBhY3RsZW4gMzI0Ck5vdiAgNSAwNjoxOToy NyBnZW5lcmljIGtlcm5lbDogc21zYzA6IGRlYnVnOiByeCA6IHJ4aGRyIDB4MDEzZTAwMjAg OiBwa3RsZW4gMzE4IDogYWN0bGVuIDMyNCA6IG9mZiA2Ck5vdiAgNSAwNjoxOToyNyBnZW5l cmljIGtlcm5lbDogc21zYzA6IGRlYnVnOiByeCA6IGFjdGxlbiAyMDAKTm92ICA1IDA2OjE5 OjI3IGdlbmVyaWMga2VybmVsOiBzbXNjMDogZGVidWc6IHJ4IDogcnhoZHIgMHgwMGMyMDAy MCA6IHBrdGxlbiAxOTQgOiBhY3RsZW4gMjAwIDogb2ZmIDYKTm92ICA1IDA2OjE5OjI3IGdl bmVyaWMga2VybmVsOiBzbXNjMDogZGVidWc6IHJ4IDogYWN0bGVuIDE5NgpOb3YgIDUgMDY6 MTk6MjcgZ2VuZXJpYyBrZXJuZWw6IHNtc2MwOiBkZWJ1ZzogcnggOiByeGhkciAweDAwYmUw MDIwIDogcGt0bGVuIDE5MCA6IGFjdGxlbiAxOTYgOiBvZmYgNgpOb3YgIDUgMDY6MTk6Mjcg Z2VuZXJpYyBrZXJuZWw6IHNtc2MwOiBkZWJ1ZzogcnggOiBhY3RsZW4gMzI0Ck5vdiAgNSAw NjoxOToyNyBnZW5lcmljIGtlcm5lbDogc21zYzA6IGRlYnVnOiByeCA6IHJ4aGRyIDB4MDEz ZTAwMjAgOiBwa3RsZW4gMzE4IDogYWN0bGVuIDMyNCA6IG9mZiA2Ck5vdiAgNSAwNjoxOToy NyBnZW5lcmljIGtlcm5lbDogc21zYzA6IGRlYnVnOiByeCA6IGFjdGxlbiAyMDAKTm92ICA1 IDA2OjE5OjI3IGdlbmVyaWMga2VybmVsOiBzbXNjMDogZGVidWc6IHJ4IDogcnhoZHIgMHgw MGMyMDAyMCA6IHBrdGxlbiAxOTQgOiBhY3RsZW4gMjAwIDogb2ZmIDYKTm92ICA1IDA2OjE5 OjI3IGdlbmVyaWMga2VybmVsOiBzbXNjMDogZGVidWc6IHJ4IDogYWN0bGVuIDMyNApOb3Yg IDUgMDY6MTk6MjcgZ2VuZXJpYyBrZXJuZWw6IHNtc2MwOiBkZWJ1ZzogcnggOiByeGhkciAw eDAxM2UwMDIwIDogcGt0bGVuIDMxOCA6IGFjdGxlbiAzMjQgOiBvZmYgNgpOb3YgIDUgMDY6 MTk6MjcgZ2VuZXJpYyBrZXJuZWw6IHNtc2MwOiBkZWJ1ZzogcnggOiBhY3RsZW4gMjAwCk5v diAgNSAwNjoxOToyNyBnZW5lcmljIGtlcm5lbDogc21zYzA6IGRlYnVnOiByeCA6IHJ4aGRy IDB4MDBjMjAwMjAgOiBwa3RsZW4gMTk0IDogYWN0bGVuIDIwMCA6IG9mZiA2Ck5vdiAgNSAw NjoxOToyNyBnZW5lcmljIGtlcm5lbDogc21zYzA6IGRlYnVnOiByeCA6IGFjdGxlbiAzMjQK Tm92ICA1IDA2OjE5OjI3IGdlbmVyaWMga2VybmVsOiBzbXNjMDogZGVidWc6IHJ4IDogcnho ZHIgMHgwMTNlMDAyMCA6IHBrdGxlbiAzMTggOiBhY3RsZW4gMzI0IDogb2ZmIDYKTm92ICA1 IDA2OjE5OjI3IGdlbmVyaWMga2VybmVsOiBzbXNjMDogZGVidWc6IHJ4IDogYWN0bGVuIDIw MApOb3YgIDUgMDY6MTk6MjcgZ2VuZXJpYyBrZXJuZWw6IHNtc2MwOiBkZWJ1ZzogcnggOiBy eGhkciAweDAwYzIwMDIwIDogcGt0bGVuIDE5NCA6IGFjdGxlbiAyMDAgOiBvZmYgNgpOb3Yg IDUgMDY6MTk6MjcgZ2VuZXJpYyBrZXJuZWw6IHNtc2MwOiBkZWJ1ZzogcnggOiBhY3RsZW4g MzI0Ck5vdiAgNSAwNjoxOToyNyBnZW5lcmljIGtlcm5lbDogc21zYzA6IGRlYnVnOiByeCA6 IHJ4aGRyIDB4MDEzZTAwMjAgOiBwa3RsZW4gMzE4IDogYWN0bGVuIDMyNCA6IG9mZiA2Ck5v diAgNSAwNjoxOToyNyBnZW5lcmljIGtlcm5lbDogc21zYzA6IGRlYnVnOiByeCA6IGFjdGxl biAyMDAKTm92ICA1IDA2OjE5OjI3IGdlbmVyaWMga2VybmVsOiBzbXNjMDogZGVidWc6IHJ4 IDogcnhoZHIgMHgwMGMyMDAyMCA6IHBrdGxlbiAxOTQgOiBhY3RsZW4gMjAwIDogb2ZmIDYK Tm92ICA1IDA2OjE5OjI3IGdlbmVyaWMga2VybmVsOiBzbXNjMDogZGVidWc6IHJ4IDogYWN0 bGVuIDMyNApOb3YgIDUgMDY6MTk6MjcgZ2VuZXJpYyBrZXJuZWw6IHNtc2MwOiBkZWJ1Zzog cnggOiByeGhkciAweDAxM2UwMDIwIDogcGt0bGVuIDMxOCA6IGFjdGxlbiAzMjQgOiBvZmYg NgpOb3YgIDUgMDY6MTk6MjcgZ2VuZXJpYyBrZXJuZWw6IHNtc2MwOiBkZWJ1ZzogcnggOiBh Y3RsZW4gMjAwCk5vdiAgNSAwNjoxOToyNyBnZW5lcmljIGtlcm5lbDogc21zYzA6IGRlYnVn OiByeCA6IHJ4aGRyIDB4MDBjMjAwMjAgOiBwa3RsZW4gMTk0IDogYWN0bGVuIDIwMCA6IG9m ZiA2Ck5vdiAgNSAwNjoxOToyNyBnZW5lcmljIGtlcm5lbDogc21zYzA6IGRlYnVnOiByeCA6 IGFjdGxlbiAxOTYKTm92ICA1IDA2OjE5OjI3IGdlbmVyaWMga2VybmVsOiBzbXNjMDogZGVi dWc6IHJ4IDogcnhoZHIgMHgwMGJlMDAyMCA6IHBrdGxlbiAxOTAgOiBhY3RsZW4gMTk2IDog b2ZmIDYKTm92ICA1IDA2OjE5OjI3IGdlbmVyaWMga2VybmVsOiBzbXNjMDogZGVidWc6IHJ4 IDogYWN0bGVuIDMyNApOb3YgIDUgMDY6MTk6MjcgZ2VuZXJpYyBrZXJuZWw6IHNtc2MwOiBk ZWJ1ZzogcnggOiByeGhkciAweDAxM2UwMDIwIDogcGt0bGVuIDMxOCA6IGFjdGxlbiAzMjQg OiBvZmYgNgpOb3YgIDUgMDY6MTk6MjggZ2VuZXJpYyBrZXJuZWw6IHNtc2MwOiBkZWJ1Zzog cnggOiBhY3RsZW4gMzI0Ck5vdiAgNSAwNjoxOToyOCBnZW5lcmljIGtlcm5lbDogc21zYzA6 IGRlYnVnOiByeCA6IHJ4aGRyIDB4MDEzZTAwMjAgOiBwa3RsZW4gMzE4IDogYWN0bGVuIDMy NCA6IG9mZiA2Ck5vdiAgNSAwNjoxOToyOCBnZW5lcmljIGtlcm5lbDogc21zYzA6IGRlYnVn OiByeCA6IGFjdGxlbiAyMDAKTm92ICA1IDA2OjE5OjI4IGdlbmVyaWMga2VybmVsOiBzbXNj MDogZGVidWc6IHJ4IDogcnhoZHIgMHgwMGMyMDAyMCA6IHBrdGxlbiAxOTQgOiBhY3RsZW4g MjAwIDogb2ZmIDYKTm92ICA1IDA2OjE5OjI4IGdlbmVyaWMga2VybmVsOiBzbXNjMDogZGVi dWc6IHJ4IDogYWN0bGVuIDE5MgpOb3YgIDUgMDY6MTk6MjggZ2VuZXJpYyBrZXJuZWw6IHNt c2MwOiBkZWJ1ZzogcnggOiByeGhkciAweDAwYmEwMDIwIDogcGt0bGVuIDE4NiA6IGFjdGxl biAxOTIgOiBvZmYgNgpOb3YgIDUgMDY6MTk6MjggZ2VuZXJpYyBrZXJuZWw6IHNtc2MwOiBk ZWJ1ZzogcnggOiBhY3RsZW4gMjAwCk5vdiAgNSAwNjoxOToyOCBnZW5lcmljIGtlcm5lbDog c21zYzA6IGRlYnVnOiByeCA6IHJ4aGRyIDB4MDBjMjAwMjAgOiBwa3RsZW4gMTk0IDogYWN0 bGVuIDIwMCA6IG9mZiA2Ck5vdiAgNSAwNjoxOToyOCBnZW5lcmljIGtlcm5lbDogc21zYzA6 IGRlYnVnOiByeCA6IGFjdGxlbiAzMjQKTm92ICA1IDA2OjE5OjI4IGdlbmVyaWMga2VybmVs OiBzbXNjMDogZGVidWc6IHJ4IDogcnhoZHIgMHgwMTNlMDAyMCA6IHBrdGxlbiAzMTggOiBh Y3RsZW4gMzI0IDogb2ZmIDYKTm92ICA1IDA2OjE5OjI4IGdlbmVyaWMga2VybmVsOiBzbXNj MDogZGVidWc6IHJ4IDogYWN0bGVuIDIwMApOb3YgIDUgMDY6MTk6MjggZ2VuZXJpYyBrZXJu ZWw6IHNtc2MwOiBkZWJ1ZzogcnggOiByeGhkciAweDAwYzIwMDIwIDogcGt0bGVuIDE5NCA6 IGFjdGxlbiAyMDAgOiBvZmYgNgpOb3YgIDUgMDY6MTk6MjggZ2VuZXJpYyBrZXJuZWw6IHNt c2MwOiBkZWJ1ZzogcnggOiBhY3RsZW4gOTQKTm92ICA1IDA2OjE5OjI4IGdlbmVyaWMga2Vy bmVsOiBzbXNjMDogZGVidWc6IHJ4IDogcnhoZHIgMHgwMDU4MDAyMCA6IHBrdGxlbiA4OCA6 IGFjdGxlbiA5NCA6IG9mZiA2Ck5vdiAgNSAwNjoxOToyOCBnZW5lcmljIGtlcm5lbDogc21z YzA6IGRlYnVnOiByeCA6IGFjdGxlbiAxMDgKTm92ICA1IDA2OjE5OjI4IGdlbmVyaWMga2Vy bmVsOiBzbXNjMDogZGVidWc6IHJ4IDogcnhoZHIgMHgwMDY2MDAyMCA6IHBrdGxlbiAxMDIg OiBhY3RsZW4gMTA4IDogb2ZmIDYKTm92ICA1IDA2OjE5OjI4IGdlbmVyaWMga2VybmVsOiBz bXNjMDogZGVidWc6IHJ4IDogYWN0bGVuIDEwMApOb3YgIDUgMDY6MTk6MjggZ2VuZXJpYyBr ZXJuZWw6IHNtc2MwOiBkZWJ1ZzogcnggOiByeGhkciAweDAwNWUwMDIwIDogcGt0bGVuIDk0 IDogYWN0bGVuIDEwMCA6IG9mZiA2Ck5vdiAgNSAwNjoxOToyOCBnZW5lcmljIGtlcm5lbDog c21zYzA6IGRlYnVnOiByeCA6IGFjdGxlbiA3MApOb3YgIDUgMDY6MTk6MjggZ2VuZXJpYyBr ZXJuZWw6IHNtc2MwOiBkZWJ1ZzogcnggOiByeGhkciAweDAwNDAyNDIwIDogcGt0bGVuIDY0 IDogYWN0bGVuIDcwIDogb2ZmIDYKTm92ICA1IDA2OjE5OjI4IGdlbmVyaWMga2VybmVsOiBz bXNjMDogZGVidWc6IHJ4IDogYWN0bGVuIDcwCk5vdiAgNSAwNjoxOToyOCBnZW5lcmljIGtl cm5lbDogc21zYzA6IGRlYnVnOiByeCA6IHJ4aGRyIDB4MDA0MDI0MjAgOiBwa3RsZW4gNjQg OiBhY3RsZW4gNzAgOiBvZmYgNgo= --------------EE2C18579A1D26EAA6F28607 Content-Type: text/plain; charset=UTF-8; name="jail_rxcsum" Content-Transfer-Encoding: base64 Content-Disposition: attachment; filename="jail_rxcsum" Ck5vdiAgNSAwNjoxNzo1NyBnZW5lcmljIGtlcm5lbDogc21zYzA6IGRlYnVnOiByeCA6IGFj dGxlbiA3MgpOb3YgIDUgMDY6MTc6NTcgZ2VuZXJpYyBrZXJuZWw6IHNtc2MwOiBkZWJ1Zzog cnggOiByeGhkciAweDAwNDIyNDIwIDogcGt0bGVuIDY2IDogYWN0bGVuIDcyIDogb2ZmIDYK Tm92ICA1IDA2OjE3OjU3IGdlbmVyaWMga2VybmVsOiBzbXNjMDogZGVidWc6IHJ4IDogYWN0 bGVuIDcyCk5vdiAgNSAwNjoxNzo1NyBnZW5lcmljIGtlcm5lbDogc21zYzA6IGRlYnVnOiBy eCA6IHJ4aGRyIDB4MDA0MjI0MjAgOiBwa3RsZW4gNjYgOiBhY3RsZW4gNzIgOiBvZmYgNgpO b3YgIDUgMDY6MTc6NTcgZ2VuZXJpYyBrZXJuZWw6IHNtc2MwOiBkZWJ1ZzogcnggOiBhY3Rs ZW4gNzIKTm92ICA1IDA2OjE3OjU3IGdlbmVyaWMga2VybmVsOiBzbXNjMDogZGVidWc6IHJ4 IDogcnhoZHIgMHgwMDQyMjQyMCA6IHBrdGxlbiA2NiA6IGFjdGxlbiA3MiA6IG9mZiA2Ck5v diAgNSAwNjoxNzo1NyBnZW5lcmljIGtlcm5lbDogc21zYzA6IGRlYnVnOiByeCA6IGFjdGxl biAyMDIKTm92ICA1IDA2OjE3OjU3IGdlbmVyaWMga2VybmVsOiBzbXNjMDogZGVidWc6IHJ4 IDogcnhoZHIgMHgwMGM0MDAyMCA6IHBrdGxlbiAxOTYgOiBhY3RsZW4gMjAyIDogb2ZmIDYK Tm92ICA1IDA2OjE3OjU3IGdlbmVyaWMga2VybmVsOiBzbXNjMDogZGVidWc6IFJYIGNoZWNr c3VtIG9mZmxvYWRlZCAoMHgxOWZlKQpOb3YgIDUgMDY6MTc6NTcgZ2VuZXJpYyBrZXJuZWw6 IHNtc2MwOiBkZWJ1ZzogcnggOiBhY3RsZW4gMzI2Ck5vdiAgNSAwNjoxNzo1NyBnZW5lcmlj IGtlcm5lbDogc21zYzA6IGRlYnVnOiByeCA6IHJ4aGRyIDB4MDE0MDAwMjAgOiBwa3RsZW4g MzIwIDogYWN0bGVuIDMyNiA6IG9mZiA2Ck5vdiAgNSAwNjoxNzo1NyBnZW5lcmljIGtlcm5l bDogc21zYzA6IGRlYnVnOiBSWCBjaGVja3N1bSBvZmZsb2FkZWQgKDB4MTk4MikKTm92ICA1 IDA2OjE3OjU3IGdlbmVyaWMga2VybmVsOiBzbXNjMDogZGVidWc6IHJ4IDogYWN0bGVuIDMy NgpOb3YgIDUgMDY6MTc6NTcgZ2VuZXJpYyBrZXJuZWw6IHNtc2MwOiBkZWJ1ZzogcnggOiBy eGhkciAweDAxNDAwMDIwIDogcGt0bGVuIDMyMCA6IGFjdGxlbiAzMjYgOiBvZmYgNgpOb3Yg IDUgMDY6MTc6NTcgZ2VuZXJpYyBrZXJuZWw6IHNtc2MwOiBkZWJ1ZzogUlggY2hlY2tzdW0g b2ZmbG9hZGVkICgweDE5ODIpCk5vdiAgNSAwNjoxNzo1NyBnZW5lcmljIGtlcm5lbDogc21z YzA6IGRlYnVnOiByeCA6IGFjdGxlbiAyMDIKTm92ICA1IDA2OjE3OjU3IGdlbmVyaWMga2Vy bmVsOiBzbXNjMDogZGVidWc6IHJ4IDogcnhoZHIgMHgwMGM0MDAyMCA6IHBrdGxlbiAxOTYg OiBhY3RsZW4gMjAyIDogb2ZmIDYKTm92ICA1IDA2OjE3OjU3IGdlbmVyaWMga2VybmVsOiBz bXNjMDogZGVidWc6IFJYIGNoZWNrc3VtIG9mZmxvYWRlZCAoMHgxOWZlKQpOb3YgIDUgMDY6 MTc6NTcgZ2VuZXJpYyBrZXJuZWw6IHNtc2MwOiBkZWJ1ZzogcnggOiBhY3RsZW4gMTk4Ck5v diAgNSAwNjoxNzo1NyBnZW5lcmljIGtlcm5lbDogc21zYzA6IGRlYnVnOiByeCA6IHJ4aGRy IDB4MDBjMDAwMjAgOiBwa3RsZW4gMTkyIDogYWN0bGVuIDE5OCA6IG9mZiA2Ck5vdiAgNSAw NjoxNzo1NyBnZW5lcmljIGtlcm5lbDogc21zYzA6IGRlYnVnOiBSWCBjaGVja3N1bSBvZmZs b2FkZWQgKDB4MWEwMikKTm92ICA1IDA2OjE3OjU3IGdlbmVyaWMga2VybmVsOiBzbXNjMDog ZGVidWc6IHJ4IDogYWN0bGVuIDMyNgpOb3YgIDUgMDY6MTc6NTcgZ2VuZXJpYyBrZXJuZWw6 IHNtc2MwOiBkZWJ1ZzogcnggOiByeGhkciAweDAxNDAwMDIwIDogcGt0bGVuIDMyMCA6IGFj dGxlbiAzMjYgOiBvZmYgNgpOb3YgIDUgMDY6MTc6NTcgZ2VuZXJpYyBrZXJuZWw6IHNtc2Mw OiBkZWJ1ZzogUlggY2hlY2tzdW0gb2ZmbG9hZGVkICgweDE5ODIpCk5vdiAgNSAwNjoxNzo1 NyBnZW5lcmljIGtlcm5lbDogc21zYzA6IGRlYnVnOiByeCA6IGFjdGxlbiA3MgpOb3YgIDUg MDY6MTc6NTcgZ2VuZXJpYyBrZXJuZWw6IHNtc2MwOiBkZWJ1ZzogcnggOiByeGhkciAweDAw NDIwNDIwIDogcGt0bGVuIDY2IDogYWN0bGVuIDcyIDogb2ZmIDYKTm92ICA1IDA2OjE3OjU3 IGdlbmVyaWMga2VybmVsOiBzbXNjMDogZGVidWc6IHJ4IDogYWN0bGVuIDMyNgpOb3YgIDUg MDY6MTc6NTcgZ2VuZXJpYyBrZXJuZWw6IHNtc2MwOiBkZWJ1ZzogcnggOiByeGhkciAweDAx NDAwMDIwIDogcGt0bGVuIDMyMCA6IGFjdGxlbiAzMjYgOiBvZmYgNgpOb3YgIDUgMDY6MTc6 NTcgZ2VuZXJpYyBrZXJuZWw6IHNtc2MwOiBkZWJ1ZzogUlggY2hlY2tzdW0gb2ZmbG9hZGVk ICgweDE5ODIpCk5vdiAgNSAwNjoxNzo1NyBnZW5lcmljIGtlcm5lbDogc21zYzA6IGRlYnVn OiByeCA6IGFjdGxlbiAxOTgKTm92ICA1IDA2OjE3OjU3IGdlbmVyaWMga2VybmVsOiBzbXNj MDogZGVidWc6IHJ4IDogcnhoZHIgMHgwMGMwMDAyMCA6IHBrdGxlbiAxOTIgOiBhY3RsZW4g MTk4IDogb2ZmIDYKTm92ICA1IDA2OjE3OjU3IGdlbmVyaWMga2VybmVsOiBzbXNjMDogZGVi dWc6IFJYIGNoZWNrc3VtIG9mZmxvYWRlZCAoMHgxYTAyKQpOb3YgIDUgMDY6MTc6NTcgZ2Vu ZXJpYyBrZXJuZWw6IHNtc2MwOiBkZWJ1ZzogcnggOiBhY3RsZW4gMzI2Ck5vdiAgNSAwNjox Nzo1NyBnZW5lcmljIGtlcm5lbDogc21zYzA6IGRlYnVnOiByeCA6IHJ4aGRyIDB4MDE0MDAw MjAgOiBwa3RsZW4gMzIwIDogYWN0bGVuIDMyNiA6IG9mZiA2Ck5vdiAgNSAwNjoxNzo1NyBn ZW5lcmljIGtlcm5lbDogc21zYzA6IGRlYnVnOiBSWCBjaGVja3N1bSBvZmZsb2FkZWQgKDB4 MTk4MikKTm92ICA1IDA2OjE3OjU3IGdlbmVyaWMga2VybmVsOiBzbXNjMDogZGVidWc6IHJ4 IDogYWN0bGVuIDIwMgpOb3YgIDUgMDY6MTc6NTcgZ2VuZXJpYyBrZXJuZWw6IHNtc2MwOiBk ZWJ1ZzogcnggOiByeGhkciAweDAwYzQwMDIwIDogcGt0bGVuIDE5NiA6IGFjdGxlbiAyMDIg OiBvZmYgNgpOb3YgIDUgMDY6MTc6NTcgZ2VuZXJpYyBrZXJuZWw6IHNtc2MwOiBkZWJ1Zzog UlggY2hlY2tzdW0gb2ZmbG9hZGVkICgweDE5ZmUpCk5vdiAgNSAwNjoxNzo1NyBnZW5lcmlj IGtlcm5lbDogc21zYzA6IGRlYnVnOiByeCA6IGFjdGxlbiAzMjYKTm92ICA1IDA2OjE3OjU3 IGdlbmVyaWMga2VybmVsOiBzbXNjMDogZGVidWc6IHJ4IDogcnhoZHIgMHgwMTQwMDAyMCA6 IHBrdGxlbiAzMjAgOiBhY3RsZW4gMzI2IDogb2ZmIDYKTm92ICA1IDA2OjE3OjU3IGdlbmVy aWMga2VybmVsOiBzbXNjMDogZGVidWc6IFJYIGNoZWNrc3VtIG9mZmxvYWRlZCAoMHgxOTgy KQpOb3YgIDUgMDY6MTc6NTcgZ2VuZXJpYyBrZXJuZWw6IHNtc2MwOiBkZWJ1ZzogcnggOiBh Y3RsZW4gMzI2Ck5vdiAgNSAwNjoxNzo1NyBnZW5lcmljIGtlcm5lbDogc21zYzA6IGRlYnVn OiByeCA6IHJ4aGRyIDB4MDE0MDAwMjAgOiBwa3RsZW4gMzIwIDogYWN0bGVuIDMyNiA6IG9m ZiA2Ck5vdiAgNSAwNjoxNzo1NyBnZW5lcmljIGtlcm5lbDogc21zYzA6IGRlYnVnOiBSWCBj aGVja3N1bSBvZmZsb2FkZWQgKDB4MTk4MikKTm92ICA1IDA2OjE3OjU3IGdlbmVyaWMga2Vy bmVsOiBzbXNjMDogZGVidWc6IHJ4IDogYWN0bGVuIDMyNgpOb3YgIDUgMDY6MTc6NTcgZ2Vu ZXJpYyBrZXJuZWw6IHNtc2MwOiBkZWJ1ZzogcnggOiByeGhkciAweDAxNDAwMDIwIDogcGt0 bGVuIDMyMCA6IGFjdGxlbiAzMjYgOiBvZmYgNgpOb3YgIDUgMDY6MTc6NTcgZ2VuZXJpYyBr ZXJuZWw6IHNtc2MwOiBkZWJ1ZzogUlggY2hlY2tzdW0gb2ZmbG9hZGVkICgweDE5ODIpCk5v diAgNSAwNjoxNzo1NyBnZW5lcmljIGtlcm5lbDogc21zYzA6IGRlYnVnOiByeCA6IGFjdGxl biAyMDIKTm92ICA1IDA2OjE3OjU3IGdlbmVyaWMga2VybmVsOiBzbXNjMDogZGVidWc6IHJ4 IDogcnhoZHIgMHgwMGM0MDAyMCA6IHBrdGxlbiAxOTYgOiBhY3RsZW4gMjAyIDogb2ZmIDYK Tm92ICA1IDA2OjE3OjU3IGdlbmVyaWMga2VybmVsOiBzbXNjMDogZGVidWc6IFJYIGNoZWNr c3VtIG9mZmxvYWRlZCAoMHgxOWZlKQpOb3YgIDUgMDY6MTc6NTcgZ2VuZXJpYyBrZXJuZWw6 IHNtc2MwOiBkZWJ1ZzogcnggOiBhY3RsZW4gMzI2Ck5vdiAgNSAwNjoxNzo1NyBnZW5lcmlj IGtlcm5lbDogc21zYzA6IGRlYnVnOiByeCA6IHJ4aGRyIDB4MDE0MDAwMjAgOiBwa3RsZW4g MzIwIDogYWN0bGVuIDMyNiA6IG9mZiA2Ck5vdiAgNSAwNjoxNzo1NyBnZW5lcmljIGtlcm5l bDogc21zYzA6IGRlYnVnOiBSWCBjaGVja3N1bSBvZmZsb2FkZWQgKDB4MTk4MikKTm92ICA1 IDA2OjE3OjU3IGdlbmVyaWMga2VybmVsOiBzbXNjMDogZGVidWc6IHJ4IDogYWN0bGVuIDIw MgpOb3YgIDUgMDY6MTc6NTcgZ2VuZXJpYyBrZXJuZWw6IHNtc2MwOiBkZWJ1ZzogcnggOiBy eGhkciAweDAwYzQwMDIwIDogcGt0bGVuIDE5NiA6IGFjdGxlbiAyMDIgOiBvZmYgNgpOb3Yg IDUgMDY6MTc6NTcgZ2VuZXJpYyBrZXJuZWw6IHNtc2MwOiBkZWJ1ZzogUlggY2hlY2tzdW0g b2ZmbG9hZGVkICgweDE5ZmUpCk5vdiAgNSAwNjoxNzo1NyBnZW5lcmljIGtlcm5lbDogc21z YzA6IGRlYnVnOiByeCA6IGFjdGxlbiAzMjYKTm92ICA1IDA2OjE3OjU3IGdlbmVyaWMga2Vy bmVsOiBzbXNjMDogZGVidWc6IHJ4IDogcnhoZHIgMHgwMTQwMDAyMCA6IHBrdGxlbiAzMjAg OiBhY3RsZW4gMzI2IDogb2ZmIDYKTm92ICA1IDA2OjE3OjU3IGdlbmVyaWMga2VybmVsOiBz bXNjMDogZGVidWc6IFJYIGNoZWNrc3VtIG9mZmxvYWRlZCAoMHgxOTgyKQpOb3YgIDUgMDY6 MTc6NTcgZ2VuZXJpYyBrZXJuZWw6IHNtc2MwOiBkZWJ1ZzogcnggOiBhY3RsZW4gMjAyCk5v diAgNSAwNjoxNzo1NyBnZW5lcmljIGtlcm5lbDogc21zYzA6IGRlYnVnOiByeCA6IHJ4aGRy IDB4MDBjNDAwMjAgOiBwa3RsZW4gMTk2IDogYWN0bGVuIDIwMiA6IG9mZiA2Ck5vdiAgNSAw NjoxNzo1NyBnZW5lcmljIGtlcm5lbDogc21zYzA6IGRlYnVnOiBSWCBjaGVja3N1bSBvZmZs b2FkZWQgKDB4MTlmZSkKTm92ICA1IDA2OjE3OjU3IGdlbmVyaWMga2VybmVsOiBzbXNjMDog ZGVidWc6IHJ4IDogYWN0bGVuIDMyNgpOb3YgIDUgMDY6MTc6NTcgZ2VuZXJpYyBrZXJuZWw6 IHNtc2MwOiBkZWJ1ZzogcnggOiByeGhkciAweDAxNDAwMDIwIDogcGt0bGVuIDMyMCA6IGFj dGxlbiAzMjYgOiBvZmYgNgpOb3YgIDUgMDY6MTc6NTcgZ2VuZXJpYyBrZXJuZWw6IHNtc2Mw OiBkZWJ1ZzogUlggY2hlY2tzdW0gb2ZmbG9hZGVkICgweDE5ODIpCk5vdiAgNSAwNjoxNzo1 OCBnZW5lcmljIGtlcm5lbDogc21zYzA6IGRlYnVnOiByeCA6IGFjdGxlbiAzMjYKTm92ICA1 IDA2OjE3OjU4IGdlbmVyaWMga2VybmVsOiBzbXNjMDogZGVidWc6IHJ4IDogcnhoZHIgMHgw MTQwMDAyMCA6IHBrdGxlbiAzMjAgOiBhY3RsZW4gMzI2IDogb2ZmIDYKTm92ICA1IDA2OjE3 OjU4IGdlbmVyaWMga2VybmVsOiBzbXNjMDogZGVidWc6IFJYIGNoZWNrc3VtIG9mZmxvYWRl ZCAoMHgxOTgyKQpOb3YgIDUgMDY6MTc6NTggZ2VuZXJpYyBrZXJuZWw6IHNtc2MwOiBkZWJ1 ZzogcnggOiBhY3RsZW4gMjAyCk5vdiAgNSAwNjoxNzo1OCBnZW5lcmljIGtlcm5lbDogc21z YzA6IGRlYnVnOiByeCA6IHJ4aGRyIDB4MDBjNDAwMjAgOiBwa3RsZW4gMTk2IDogYWN0bGVu IDIwMiA6IG9mZiA2Ck5vdiAgNSAwNjoxNzo1OCBnZW5lcmljIGtlcm5lbDogc21zYzA6IGRl YnVnOiBSWCBjaGVja3N1bSBvZmZsb2FkZWQgKDB4MTlmZSkKTm92ICA1IDA2OjE3OjU4IGdl bmVyaWMga2VybmVsOiBzbXNjMDogZGVidWc6IHJ4IDogYWN0bGVuIDMyNgpOb3YgIDUgMDY6 MTc6NTggZ2VuZXJpYyBrZXJuZWw6IHNtc2MwOiBkZWJ1ZzogcnggOiByeGhkciAweDAxNDAw MDIwIDogcGt0bGVuIDMyMCA6IGFjdGxlbiAzMjYgOiBvZmYgNgpOb3YgIDUgMDY6MTc6NTgg Z2VuZXJpYyBrZXJuZWw6IHNtc2MwOiBkZWJ1ZzogUlggY2hlY2tzdW0gb2ZmbG9hZGVkICgw eDE5ODIpCk5vdiAgNSAwNjoxNzo1OCBnZW5lcmljIGtlcm5lbDogc21zYzA6IGRlYnVnOiBy eCA6IGFjdGxlbiAyMDIKTm92ICA1IDA2OjE3OjU4IGdlbmVyaWMga2VybmVsOiBzbXNjMDog ZGVidWc6IHJ4IDogcnhoZHIgMHgwMGM0MDAyMCA6IHBrdGxlbiAxOTYgOiBhY3RsZW4gMjAy IDogb2ZmIDYKTm92ICA1IDA2OjE3OjU4IGdlbmVyaWMga2VybmVsOiBzbXNjMDogZGVidWc6 IFJYIGNoZWNrc3VtIG9mZmxvYWRlZCAoMHgxOWZlKQpOb3YgIDUgMDY6MTc6NTggZ2VuZXJp YyBrZXJuZWw6IHNtc2MwOiBkZWJ1ZzogcnggOiBhY3RsZW4gMzI2Ck5vdiAgNSAwNjoxNzo1 OCBnZW5lcmljIGtlcm5lbDogc21zYzA6IGRlYnVnOiByeCA6IHJ4aGRyIDB4MDE0MDAwMjAg OiBwa3RsZW4gMzIwIDogYWN0bGVuIDMyNiA6IG9mZiA2Ck5vdiAgNSAwNjoxNzo1OCBnZW5l cmljIGtlcm5lbDogc21zYzA6IGRlYnVnOiBSWCBjaGVja3N1bSBvZmZsb2FkZWQgKDB4MTk4 MikKTm92ICA1IDA2OjE3OjU4IGdlbmVyaWMga2VybmVsOiBzbXNjMDogZGVidWc6IHJ4IDog YWN0bGVuIDIwMgpOb3YgIDUgMDY6MTc6NTggZ2VuZXJpYyBrZXJuZWw6IHNtc2MwOiBkZWJ1 ZzogcnggOiByeGhkciAweDAwYzQwMDIwIDogcGt0bGVuIDE5NiA6IGFjdGxlbiAyMDIgOiBv ZmYgNgpOb3YgIDUgMDY6MTc6NTggZ2VuZXJpYyBrZXJuZWw6IHNtc2MwOiBkZWJ1ZzogUlgg Y2hlY2tzdW0gb2ZmbG9hZGVkICgweDE5ZmUpCk5vdiAgNSAwNjoxNzo1OCBnZW5lcmljIGtl cm5lbDogc21zYzA6IGRlYnVnOiByeCA6IGFjdGxlbiAzMjYKTm92ICA1IDA2OjE3OjU4IGdl bmVyaWMga2VybmVsOiBzbXNjMDogZGVidWc6IHJ4IDogcnhoZHIgMHgwMTQwMDAyMCA6IHBr dGxlbiAzMjAgOiBhY3RsZW4gMzI2IDogb2ZmIDYKTm92ICA1IDA2OjE3OjU4IGdlbmVyaWMg a2VybmVsOiBzbXNjMDogZGVidWc6IFJYIGNoZWNrc3VtIG9mZmxvYWRlZCAoMHgxOTgyKQpO b3YgIDUgMDY6MTc6NTggZ2VuZXJpYyBrZXJuZWw6IHNtc2MwOiBkZWJ1ZzogcnggOiBhY3Rs ZW4gMzI2Ck5vdiAgNSAwNjoxNzo1OCBnZW5lcmljIGtlcm5lbDogc21zYzA6IGRlYnVnOiBy eCA6IHJ4aGRyIDB4MDE0MDAwMjAgOiBwa3RsZW4gMzIwIDogYWN0bGVuIDMyNiA6IG9mZiA2 Ck5vdiAgNSAwNjoxNzo1OCBnZW5lcmljIGtlcm5lbDogc21zYzA6IGRlYnVnOiBSWCBjaGVj a3N1bSBvZmZsb2FkZWQgKDB4MTk4MikKTm92ICA1IDA2OjE3OjU4IGdlbmVyaWMga2VybmVs OiBzbXNjMDogZGVidWc6IHJ4IDogYWN0bGVuIDMyNgpOb3YgIDUgMDY6MTc6NTggZ2VuZXJp YyBrZXJuZWw6IHNtc2MwOiBkZWJ1ZzogcnggOiByeGhkciAweDAxNDAwMDIwIDogcGt0bGVu IDMyMCA6IGFjdGxlbiAzMjYgOiBvZmYgNgpOb3YgIDUgMDY6MTc6NTggZ2VuZXJpYyBrZXJu ZWw6IHNtc2MwOiBkZWJ1ZzogUlggY2hlY2tzdW0gb2ZmbG9hZGVkICgweDE5ODIpCk5vdiAg NSAwNjoxNzo1OCBnZW5lcmljIGtlcm5lbDogc21zYzA6IGRlYnVnOiByeCA6IGFjdGxlbiAx OTgKTm92ICA1IDA2OjE3OjU4IGdlbmVyaWMga2VybmVsOiBzbXNjMDogZGVidWc6IHJ4IDog cnhoZHIgMHgwMGMwMDAyMCA6IHBrdGxlbiAxOTIgOiBhY3RsZW4gMTk4IDogb2ZmIDYKTm92 ICA1IDA2OjE3OjU4IGdlbmVyaWMga2VybmVsOiBzbXNjMDogZGVidWc6IFJYIGNoZWNrc3Vt IG9mZmxvYWRlZCAoMHgxYTAyKQpOb3YgIDUgMDY6MTc6NTggZ2VuZXJpYyBrZXJuZWw6IHNt c2MwOiBkZWJ1ZzogcnggOiBhY3RsZW4gMzI2Ck5vdiAgNSAwNjoxNzo1OCBnZW5lcmljIGtl cm5lbDogc21zYzA6IGRlYnVnOiByeCA6IHJ4aGRyIDB4MDE0MDAwMjAgOiBwa3RsZW4gMzIw IDogYWN0bGVuIDMyNiA6IG9mZiA2Ck5vdiAgNSAwNjoxNzo1OCBnZW5lcmljIGtlcm5lbDog c21zYzA6IGRlYnVnOiBSWCBjaGVja3N1bSBvZmZsb2FkZWQgKDB4MTk4MikKTm92ICA1IDA2 OjE3OjU4IGdlbmVyaWMga2VybmVsOiBzbXNjMDogZGVidWc6IHJ4IDogYWN0bGVuIDIwMgpO b3YgIDUgMDY6MTc6NTggZ2VuZXJpYyBrZXJuZWw6IHNtc2MwOiBkZWJ1ZzogcnggOiByeGhk ciAweDAwYzQwMDIwIDogcGt0bGVuIDE5NiA6IGFjdGxlbiAyMDIgOiBvZmYgNgpOb3YgIDUg MDY6MTc6NTggZ2VuZXJpYyBrZXJuZWw6IHNtc2MwOiBkZWJ1ZzogUlggY2hlY2tzdW0gb2Zm bG9hZGVkICgweDE5ZmUpCk5vdiAgNSAwNjoxNzo1OCBnZW5lcmljIGtlcm5lbDogc21zYzA6 IGRlYnVnOiByeCA6IGFjdGxlbiAzMjYKTm92ICA1IDA2OjE3OjU4IGdlbmVyaWMga2VybmVs OiBzbXNjMDogZGVidWc6IHJ4IDogcnhoZHIgMHgwMTQwMDAyMCA6IHBrdGxlbiAzMjAgOiBh Y3RsZW4gMzI2IDogb2ZmIDYKTm92ICA1IDA2OjE3OjU4IGdlbmVyaWMga2VybmVsOiBzbXNj MDogZGVidWc6IFJYIGNoZWNrc3VtIG9mZmxvYWRlZCAoMHgxOTgyKQpOb3YgIDUgMDY6MTc6 NTggZ2VuZXJpYyBrZXJuZWw6IHNtc2MwOiBkZWJ1ZzogcnggOiBhY3RsZW4gNzIKTm92ICA1 IDA2OjE3OjU4IGdlbmVyaWMga2VybmVsOiBzbXNjMDogZGVidWc6IHJ4IDogcnhoZHIgMHgw MDQyMjQyMCA6IHBrdGxlbiA2NiA6IGFjdGxlbiA3MiA6IG9mZiA2Ck5vdiAgNSAwNjoxNzo1 OCBnZW5lcmljIGtlcm5lbDogc21zYzA6IGRlYnVnOiByeCA6IGFjdGxlbiAyMDIKTm92ICA1 IDA2OjE3OjU4IGdlbmVyaWMga2VybmVsOiBzbXNjMDogZGVidWc6IHJ4IDogcnhoZHIgMHgw MGM0MDAyMCA6IHBrdGxlbiAxOTYgOiBhY3RsZW4gMjAyIDogb2ZmIDYKTm92ICA1IDA2OjE3 OjU4IGdlbmVyaWMga2VybmVsOiBzbXNjMDogZGVidWc6IFJYIGNoZWNrc3VtIG9mZmxvYWRl ZCAoMHgxOWZlKQpOb3YgIDUgMDY6MTc6NTggZ2VuZXJpYyBrZXJuZWw6IHNtc2MwOiBkZWJ1 ZzogcnggOiBhY3RsZW4gMzI2Ck5vdiAgNSAwNjoxNzo1OCBnZW5lcmljIGtlcm5lbDogc21z YzA6IGRlYnVnOiByeCA6IHJ4aGRyIDB4MDE0MDAwMjAgOiBwa3RsZW4gMzIwIDogYWN0bGVu IDMyNiA6IG9mZiA2Ck5vdiAgNSAwNjoxNzo1OCBnZW5lcmljIGtlcm5lbDogc21zYzA6IGRl YnVnOiBSWCBjaGVja3N1bSBvZmZsb2FkZWQgKDB4MTk4MikKTm92ICA1IDA2OjE3OjU4IGdl bmVyaWMga2VybmVsOiBzbXNjMDogZGVidWc6IHJ4IDogYWN0bGVuIDIwMgpOb3YgIDUgMDY6 MTc6NTggZ2VuZXJpYyBrZXJuZWw6IHNtc2MwOiBkZWJ1ZzogcnggOiByeGhkciAweDAwYzQw MDIwIDogcGt0bGVuIDE5NiA6IGFjdGxlbiAyMDIgOiBvZmYgNgpOb3YgIDUgMDY6MTc6NTgg Z2VuZXJpYyBrZXJuZWw6IHNtc2MwOiBkZWJ1ZzogUlggY2hlY2tzdW0gb2ZmbG9hZGVkICgw eDE5ZmUpCk5vdiAgNSAwNjoxNzo1OCBnZW5lcmljIGtlcm5lbDogc21zYzA6IGRlYnVnOiBy eCA6IGFjdGxlbiAzMjYKTm92ICA1IDA2OjE3OjU4IGdlbmVyaWMga2VybmVsOiBzbXNjMDog ZGVidWc6IHJ4IDogcnhoZHIgMHgwMTQwMDAyMCA6IHBrdGxlbiAzMjAgOiBhY3RsZW4gMzI2 IDogb2ZmIDYKTm92ICA1IDA2OjE3OjU4IGdlbmVyaWMga2VybmVsOiBzbXNjMDogZGVidWc6 IFJYIGNoZWNrc3VtIG9mZmxvYWRlZCAoMHgxOTgyKQpOb3YgIDUgMDY6MTc6NTggZ2VuZXJp YyBrZXJuZWw6IHNtc2MwOiBkZWJ1ZzogcnggOiBhY3RsZW4gMzI2Ck5vdiAgNSAwNjoxNzo1 OCBnZW5lcmljIGtlcm5lbDogc21zYzA6IGRlYnVnOiByeCA6IHJ4aGRyIDB4MDE0MDAwMjAg OiBwa3RsZW4gMzIwIDogYWN0bGVuIDMyNiA6IG9mZiA2Ck5vdiAgNSAwNjoxNzo1OCBnZW5l cmljIGtlcm5lbDogc21zYzA6IGRlYnVnOiBSWCBjaGVja3N1bSBvZmZsb2FkZWQgKDB4MTk4 MikKTm92ICA1IDA2OjE3OjU4IGdlbmVyaWMga2VybmVsOiBzbXNjMDogZGVidWc6IHJ4IDog YWN0bGVuIDIwMgpOb3YgIDUgMDY6MTc6NTggZ2VuZXJpYyBrZXJuZWw6IHNtc2MwOiAKTm92 ICA1IDA2OjE3OjU4IGdlbmVyaWMga2VybmVsOiBkZWJ1ZzogcnggOiByeGhkciAweDAwYzQw MDIwIDogcGt0bGVuIDE5NiA6IGFjdGxlbiAyMDIgOiBvZmYgNgpOb3YgIDUgMDY6MTc6NTgg Z2VuZXJpYyBrZXJuZWw6IHNtc2MwOiBkZWJ1ZzogUlggY2hlY2tzdW0gb2ZmbG9hZGVkICgw eDE5ZmUpCk5vdiAgNSAwNjoxNzo1OCBnZW5lcmljIGtlcm5lbDogc21zYzA6IGRlYnVnOiBy eCA6IGFjdGxlbiAzMjYKTm92ICA1IDA2OjE3OjU4IGdlbmVyaWMga2VybmVsOiBzbXNjMDog Ck5vdiAgNSAwNjoxNzo1OCBnZW5lcmljIGtlcm5lbDogZGVidWc6IHJ4IDogcnhoZHIgMHgw MTQwMDAyMCA6IHBrdGxlbiAzMjAgOiBhY3RsZW4gMzI2IDogb2ZmIDYKTm92ICA1IDA2OjE3 OjU4IGdlbmVyaWMga2VybmVsOiBzbXNjMDogZGVidWc6IFJYIGNoZWNrc3VtIG9mZmxvYWRl ZCAoMHgxOTgyKQpOb3YgIDUgMDY6MTc6NTggZ2VuZXJpYyBrZXJuZWw6IHNtc2MwOiBkZWJ1 ZzogcnggOiBhY3RsZW4gMjAyCk5vdiAgNSAwNjoxNzo1OCBnZW5lcmljIGtlcm5lbDogc21z YzA6IGRlYnVnOiByeCA6IHJ4aGRyIDB4MDBjNDAwMjAgOiBwa3RsZW4gMTk2IDogYWN0bGVu IDIwMiA6IG9mZiA2Ck5vdiAgNSAwNjoxNzo1OCBnZW5lcmljIGtlcm5lbDogc21zYzA6IGRl YnVnOiBSWCBjaGVja3N1bSBvZmZsb2FkZWQgKDB4MTlmZSkKTm92ICA1IDA2OjE3OjU4IGdl bmVyaWMga2VybmVsOiBzbXNjMDogZGVidWc6IHJ4IDogYWN0bGVuIDMyNgpOb3YgIDUgMDY6 MTc6NTggZ2VuZXJpYyBrZXJuZWw6IHNtc2MwOiBkZWJ1ZzogcnggOiByeGhkciAweDAxNDAw MDIwIDogcGt0bGVuIDMyMCA6IGFjdGxlbiAzMjYgOiBvZmYgNgpOb3YgIDUgMDY6MTc6NTgg Z2VuZXJpYyBrZXJuZWw6IHNtc2MwOiBkZWJ1ZzogUlggY2hlY2tzdW0gb2ZmbG9hZGVkICgw eDE5ODIpCk5vdiAgNSAwNjoxNzo1OCBnZW5lcmljIGtlcm5lbDogc21zYzA6IGRlYnVnOiBy eCA6IGFjdGxlbiAyMDIKTm92ICA1IDA2OjE3OjU4IGdlbmVyaWMga2VybmVsOiBzbXNjMDog ZGVidWc6IHJ4IDogcnhoZHIgMHgwMGM0MDAyMCA6IHBrdGxlbiAxOTYgOiBhY3RsZW4gMjAy IDogb2ZmIDYKTm92ICA1IDA2OjE3OjU4IGdlbmVyaWMga2VybmVsOiBzbXNjMDogZGVidWc6 IFJYIGNoZWNrc3VtIG9mZmxvYWRlZCAoMHgxOWZlKQpOb3YgIDUgMDY6MTc6NTggZ2VuZXJp YyBrZXJuZWw6IHNtc2MwOiBkZWJ1ZzogcnggOiBhY3RsZW4gMTk4Ck5vdiAgNSAwNjoxNzo1 OCBnZW5lcmljIGtlcm5lbDogc21zYzA6IGRlYnVnOiByeCA6IHJ4aGRyIDB4MDBjMDAwMjAg OiBwa3RsZW4gMTkyIDogYWN0bGVuIDE5OCA6IG9mZiA2Ck5vdiAgNSAwNjoxNzo1OCBnZW5l cmljIGtlcm5lbDogc21zYzA6IGRlYnVnOiBSWCBjaGVja3N1bSBvZmZsb2FkZWQgKDB4MWEw MikKTm92ICA1IDA2OjE3OjU4IGdlbmVyaWMga2VybmVsOiBzbXNjMDogZGVidWc6IHJ4IDog YWN0bGVuIDMyNgpOb3YgIDUgMDY6MTc6NTggZ2VuZXJpYyBrZXJuZWw6IHNtc2MwOiBkZWJ1 ZzogcnggOiByeGhkciAweDAxNDAwMDIwIDogcGt0bGVuIDMyMCA6IGFjdGxlbiAzMjYgOiBv ZmYgNgpOb3YgIDUgMDY6MTc6NTggZ2VuZXJpYyBrZXJuZWw6IHNtc2MwOiBkZWJ1ZzogUlgg Y2hlY2tzdW0gb2ZmbG9hZGVkICgweDE5ODIpCk5vdiAgNSAwNjoxNzo1OCBnZW5lcmljIGtl cm5lbDogc21zYzA6IGRlYnVnOiByeCA6IGFjdGxlbiAzMjYKTm92ICA1IDA2OjE3OjU4IGdl bmVyaWMga2VybmVsOiBzbXNjMDogZGVidWc6IHJ4IDogcnhoZHIgMHgwMTQwMDAyMCA6IHBr dGxlbiAzMjAgOiBhY3RsZW4gMzI2IDogb2ZmIDYKTm92ICA1IDA2OjE3OjU4IGdlbmVyaWMg a2VybmVsOiBzbXNjMDogZGVidWc6IFJYIGNoZWNrc3VtIG9mZmxvYWRlZCAoMHgxOTgyKQpO b3YgIDUgMDY6MTc6NTggZ2VuZXJpYyBrZXJuZWw6IHNtc2MwOiBkZWJ1ZzogcnggOiBhY3Rs ZW4gMjAyCk5vdiAgNSAwNjoxNzo1OCBnZW5lcmljIGtlcm5lbDogc21zYzA6IGRlYnVnOiBy eCA6IHJ4aGRyIDB4MDBjNDAwMjAgOiBwa3RsZW4gMTk2IDogYWN0bGVuIDIwMiA6IG9mZiA2 Ck5vdiAgNSAwNjoxNzo1OCBnZW5lcmljIGtlcm5lbDogc21zYzA6IGRlYnVnOiBSWCBjaGVj a3N1bSBvZmZsb2FkZWQgKDB4MTlmZSkKTm92ICA1IDA2OjE3OjU4IGdlbmVyaWMga2VybmVs OiBzbXNjMDogZGVidWc6IHJ4IDogYWN0bGVuIDMyNgpOb3YgIDUgMDY6MTc6NTggZ2VuZXJp YyBrZXJuZWw6IHNtc2MwOiBkZWJ1ZzogcnggOiByeGhkciAweDAxNDAwMDIwIDogcGt0bGVu IDMyMCA6IGFjdGxlbiAzMjYgOiBvZmYgNgpOb3YgIDUgMDY6MTc6NTggZ2VuZXJpYyBrZXJu ZWw6IHNtc2MwOiBkZWJ1ZzogUlggY2hlY2tzdW0gb2ZmbG9hZGVkICgweDE5ODIpCk5vdiAg NSAwNjoxNzo1OCBnZW5lcmljIGtlcm5lbDogc21zYzA6IGRlYnVnOiByeCA6IGFjdGxlbiAy MDIKTm92ICA1IDA2OjE3OjU4IGdlbmVyaWMga2VybmVsOiBzbXNjMDogZGVidWc6IHJ4IDog cnhoZHIgMHgwMGM0MDAyMCA6IHBrdGxlbiAxOTYgOiBhY3RsZW4gMjAyIDogb2ZmIDYKTm92 ICA1IDA2OjE3OjU4IGdlbmVyaWMga2VybmVsOiBzbXNjMDogZGVidWc6IFJYIGNoZWNrc3Vt IG9mZmxvYWRlZCAoMHgxOWZlKQpOb3YgIDUgMDY6MTc6NTggZ2VuZXJpYyBrZXJuZWw6IHNt c2MwOiBkZWJ1ZzogcnggOiBhY3RsZW4gMTk4Ck5vdiAgNSAwNjoxNzo1OCBnZW5lcmljIGtl cm5lbDogc21zYzA6IGRlYnVnOiByeCA6IHJ4aGRyIDB4MDBjMDAwMjAgOiBwa3RsZW4gMTky IDogYWN0bGVuIDE5OCA6IG9mZiA2Ck5vdiAgNSAwNjoxNzo1OCBnZW5lcmljIGtlcm5lbDog c21zYzA6IGRlYnVnOiBSWCBjaGVja3N1bSBvZmZsb2FkZWQgKDB4MWEwMikKTm92ICA1IDA2 OjE3OjU4IGdlbmVyaWMga2VybmVsOiBzbXNjMDogZGVidWc6IHJ4IDogYWN0bGVuIDMyNgpO b3YgIDUgMDY6MTc6NTggZ2VuZXJpYyBrZXJuZWw6IHNtc2MwOiBkZWJ1ZzogcnggOiByeGhk ciAweDAxNDAwMDIwIDogcGt0bGVuIDMyMCA6IGFjdGxlbiAzMjYgOiBvZmYgNgpOb3YgIDUg MDY6MTc6NTggZ2VuZXJpYyBrZXJuZWw6IHNtc2MwOiBkZWJ1ZzogUlggY2hlY2tzdW0gb2Zm bG9hZGVkICgweDE5ODIpCk5vdiAgNSAwNjoxNzo1OCBnZW5lcmljIGtlcm5lbDogc21zYzA6 IGRlYnVnOiByeCA6IGFjdGxlbiAyMDIKTm92ICA1IDA2OjE3OjU4IGdlbmVyaWMga2VybmVs OiBzbXNjMDogZGVidWc6IHJ4IDogcnhoZHIgMHgwMGM0MDAyMCA6IHBrdGxlbiAxOTYgOiBh Y3RsZW4gMjAyIDogb2ZmIDYKTm92ICA1IDA2OjE3OjU4IGdlbmVyaWMga2VybmVsOiBzbXNj MDogZGVidWc6IFJYIGNoZWNrc3VtIG9mZmxvYWRlZCAoMHgxOWZlKQpOb3YgIDUgMDY6MTc6 NTggZ2VuZXJpYyBrZXJuZWw6IHNtc2MwOiBkZWJ1ZzogcnggOiBhY3RsZW4gMTk4Ck5vdiAg NSAwNjoxNzo1OCBnZW5lcmljIGtlcm5lbDogc21zYzA6IGRlYnVnOiByeCA6IHJ4aGRyIDB4 MDBjMDAwMjAgOiBwa3RsZW4gMTkyIDogYWN0bGVuIDE5OCA6IG9mZiA2Ck5vdiAgNSAwNjox Nzo1OCBnZW5lcmljIGtlcm5lbDogc21zYzA6IGRlYnVnOiBSWCBjaGVja3N1bSBvZmZsb2Fk ZWQgKDB4MWEwMikKTm92ICA1IDA2OjE3OjU4IGdlbmVyaWMga2VybmVsOiBzbXNjMDogZGVi dWc6IHJ4IDogYWN0bGVuIDMyNgpOb3YgIDUgMDY6MTc6NTggZ2VuZXJpYyBrZXJuZWw6IHNt c2MwOiBkZWJ1ZzogcnggOiByeGhkciAweDAxNDAwMDIwIDogcGt0bGVuIDMyMCA6IGFjdGxl biAzMjYgOiBvZmYgNgpOb3YgIDUgMDY6MTc6NTggZ2VuZXJpYyBrZXJuZWw6IHNtc2MwOiBk ZWJ1ZzogUlggY2hlY2tzdW0gb2ZmbG9hZGVkICgweDE5ODIpCk5vdiAgNSAwNjoxNzo1OCBn ZW5lcmljIGtlcm5lbDogc21zYzA6IGRlYnVnOiByeCA6IGFjdGxlbiAyMDIKTm92ICA1IDA2 OjE3OjU4IGdlbmVyaWMga2VybmVsOiBzbXNjMDogZGVidWc6IHJ4IDogcnhoZHIgMHgwMGM0 MDAyMCA6IHBrdGxlbiAxOTYgOiBhY3RsZW4gMjAyIDogb2ZmIDYKTm92ICA1IDA2OjE3OjU4 IGdlbmVyaWMga2VybmVsOiBzbXNjMDogZGVidWc6IFJYIGNoZWNrc3VtIG9mZmxvYWRlZCAo MHgxOWZlKQpOb3YgIDUgMDY6MTc6NTggZ2VuZXJpYyBrZXJuZWw6IHNtc2MwOiBkZWJ1Zzog cnggOiBhY3RsZW4gMTk4Ck5vdiAgNSAwNjoxNzo1OCBnZW5lcmljIGtlcm5lbDogc21zYzA6 IGRlYnVnOiByeCA6IHJ4aGRyIDB4MDBjMDAwMjAgOiBwa3RsZW4gMTkyIDogYWN0bGVuIDE5 OCA6IG9mZiA2Ck5vdiAgNSAwNjoxNzo1OCBnZW5lcmljIGtlcm5lbDogc21zYzA6IGRlYnVn OiBSWCBjaGVja3N1bSBvZmZsb2FkZWQgKDB4MWEwMikKTm92ICA1IDA2OjE3OjU4IGdlbmVy aWMga2VybmVsOiBzbXNjMDogZGVidWc6IHJ4IDogYWN0bGVuIDMyNgpOb3YgIDUgMDY6MTc6 NTggZ2VuZXJpYyBrZXJuZWw6IHNtc2MwOiBkZWJ1ZzogcnggOiByeGhkciAweDAxNDAwMDIw IDogcGt0bGVuIDMyMCA6IGFjdGxlbiAzMjYgOiBvZmYgNgpOb3YgIDUgMDY6MTc6NTggZ2Vu ZXJpYyBrZXJuZWw6IHNtc2MwOiBkZWJ1ZzogUlggY2hlY2tzdW0gb2ZmbG9hZGVkICgweDE5 ODIpCk5vdiAgNSAwNjoxNzo1OCBnZW5lcmljIGtlcm5lbDogc21zYzA6IGRlYnVnOiByeCA6 IGFjdGxlbiAyMDIKTm92ICA1IDA2OjE3OjU4IGdlbmVyaWMga2VybmVsOiBzbXNjMDogZGVi dWc6IHJ4IDogcnhoZHIgMHgwMGM0MDAyMCA6IHBrdGxlbiAxOTYgOiBhY3RsZW4gMjAyIDog b2ZmIDYKTm92ICA1IDA2OjE3OjU4IGdlbmVyaWMga2VybmVsOiBzbXNjMDogZGVidWc6IFJY IGNoZWNrc3VtIG9mZmxvYWRlZCAoMHgxOWZlKQpOb3YgIDUgMDY6MTc6NTggZ2VuZXJpYyBr ZXJuZWw6IHNtc2MwOiBkZWJ1ZzogcnggOiBhY3RsZW4gMzI2Ck5vdiAgNSAwNjoxNzo1OCBn ZW5lcmljIGtlcm5lbDogc21zYzA6IGRlYnVnOiByeCA6IHJ4aGRyIDB4MDE0MDAwMjAgOiBw a3RsZW4gMzIwIDogYWN0bGVuIDMyNiA6IG9mZiA2Ck5vdiAgNSAwNjoxNzo1OCBnZW5lcmlj IGtlcm5lbDogc21zYzA6IGRlYnVnOiBSWCBjaGVja3N1bSBvZmZsb2FkZWQgKDB4MTk4MikK Tm92ICA1IDA2OjE3OjU4IGdlbmVyaWMga2VybmVsOiBzbXNjMDogZGVidWc6IHJ4IDogYWN0 bGVuIDIwMgpOb3YgIDUgMDY6MTc6NTggZ2VuZXJpYyBrZXJuZWw6IHNtc2MwOiBkZWJ1Zzog cnggOiByeGhkciAweDAwYzQwMDIwIDogcGt0bGVuIDE5NiA6IGFjdGxlbiAyMDIgOiBvZmYg NgpOb3YgIDUgMDY6MTc6NTggZ2VuZXJpYyBrZXJuZWw6IHNtc2MwOiBkZWJ1ZzogUlggY2hl Y2tzdW0gb2ZmbG9hZGVkICgweDE5ZmUpCk5vdiAgNSAwNjoxNzo1OCBnZW5lcmljIGtlcm5l bDogc21zYzA6IGRlYnVnOiByeCA6IGFjdGxlbiAxOTgKTm92ICA1IDA2OjE3OjU4IGdlbmVy aWMga2VybmVsOiBzbXNjMDogZGVidWc6IHJ4IDogcnhoZHIgMHgwMGMwMDAyMCA6IHBrdGxl biAxOTIgOiBhY3RsZW4gMTk4IDogb2ZmIDYKTm92ICA1IDA2OjE3OjU4IGdlbmVyaWMga2Vy bmVsOiBzbXNjMDogZGVidWc6IFJYIGNoZWNrc3VtIG9mZmxvYWRlZCAoMHgxYTAyKQpOb3Yg IDUgMDY6MTc6NTggZ2VuZXJpYyBrZXJuZWw6IHNtc2MwOiBkZWJ1ZzogcnggOiBhY3RsZW4g MzI2Ck5vdiAgNSAwNjoxNzo1OCBnZW5lcmljIGtlcm5lbDogc21zYzA6IGRlYnVnOiByeCA6 IHJ4aGRyIDB4MDE0MDAwMjAgOiBwa3RsZW4gMzIwIDogYWN0bGVuIDMyNiA6IG9mZiA2Ck5v diAgNSAwNjoxNzo1OCBnZW5lcmljIGtlcm5lbDogc21zYzA6IGRlYnVnOiBSWCBjaGVja3N1 bSBvZmZsb2FkZWQgKDB4MTk4MikKTm92ICA1IDA2OjE3OjU4IGdlbmVyaWMga2VybmVsOiBz bXNjMDogZGVidWc6IHJ4IDogYWN0bGVuIDIwMgpOb3YgIDUgMDY6MTc6NTggZ2VuZXJpYyBr ZXJuZWw6IHNtc2MwOiBkZWJ1ZzogcnggOiByeGhkciAweDAwYzQwMDIwIDogcGt0bGVuIDE5 NiA6IGFjdGxlbiAyMDIgOiBvZmYgNgpOb3YgIDUgMDY6MTc6NTggZ2VuZXJpYyBrZXJuZWw6 IHNtc2MwOiBkZWJ1ZzogUlggY2hlY2tzdW0gb2ZmbG9hZGVkICgweDE5ZmUpCk5vdiAgNSAw NjoxNzo1OCBnZW5lcmljIGtlcm5lbDogc21zYzA6IGRlYnVnOiByeCA6IGFjdGxlbiAzMjYK Tm92ICA1IDA2OjE3OjU4IGdlbmVyaWMga2VybmVsOiBzbXNjMDogZGVidWc6IHJ4IDogcnho ZHIgMHgwMTQwMDAyMCA6IHBrdGxlbiAzMjAgOiBhY3RsZW4gMzI2IDogb2ZmIDYKTm92ICA1 IDA2OjE3OjU4IGdlbmVyaWMga2VybmVsOiBzbXNjMDogZGVidWc6IFJYIGNoZWNrc3VtIG9m ZmxvYWRlZCAoMHgxOTgyKQpOb3YgIDUgMDY6MTc6NTggZ2VuZXJpYyBrZXJuZWw6IHNtc2Mw OiBkZWJ1ZzogcnggOiBhY3RsZW4gMjAyCk5vdiAgNSAwNjoxNzo1OCBnZW5lcmljIGtlcm5l bDogc21zYzA6IGRlYnVnOiByeCA6IHJ4aGRyIDB4MDBjNDAwMjAgOiBwa3RsZW4gMTk2IDog YWN0bGVuIDIwMiA6IG9mZiA2Ck5vdiAgNSAwNjoxNzo1OCBnZW5lcmljIGtlcm5lbDogc21z YzA6IGRlYnVnOiBSWCBjaGVja3N1bSBvZmZsb2FkZWQgKDB4MTlmZSkKTm92ICA1IDA2OjE3 OjU4IGdlbmVyaWMga2VybmVsOiBzbXNjMDogZGVidWc6IHJ4IDogYWN0bGVuIDMyNgpOb3Yg IDUgMDY6MTc6NTggZ2VuZXJpYyBrZXJuZWw6IHNtc2MwOiBkZWJ1ZzogcnggOiByeGhkciAw eDAxNDAwMDIwIDogcGt0bGVuIDMyMCA6IGFjdGxlbiAzMjYgOiBvZmYgNgpOb3YgIDUgMDY6 MTc6NTggZ2VuZXJpYyBrZXJuZWw6IHNtc2MwOiBkZWJ1ZzogUlggY2hlY2tzdW0gb2ZmbG9h ZGVkICgweDE5ODIpCk5vdiAgNSAwNjoxNzo1OCBnZW5lcmljIGtlcm5lbDogc21zYzA6IGRl YnVnOiByeCA6IGFjdGxlbiAxNDQKTm92ICA1IDA2OjE3OjU4IGdlbmVyaWMga2VybmVsOiBz bXNjMDogZGVidWc6IHJ4IDogcnhoZHIgMHgwMDQyMjQyMCA6IHBrdGxlbiA2NiA6IGFjdGxl biAxNDQgOiBvZmYgNgpOb3YgIDUgMDY6MTc6NTggZ2VuZXJpYyBrZXJuZWw6IHNtc2MwOiBk ZWJ1ZzogcnggOiByeGhkciAweDAwNDIyNDIwIDogcGt0bGVuIDY2IDogYWN0bGVuIDE0NCA6 IG9mZiA3OApOb3YgIDUgMDY6MTc6NTggZ2VuZXJpYyBrZXJuZWw6IHNtc2MwOiBkZWJ1Zzog cnggOiBhY3RsZW4gMjAyCk5vdiAgNSAwNjoxNzo1OCBnZW5lcmljIGtlcm5lbDogc21zYzA6 IGRlYnVnOiByeCA6IHJ4aGRyIDB4MDBjNDAwMjAgOiBwa3RsZW4gMTk2IDogYWN0bGVuIDIw MiA6IG9mZiA2Ck5vdiAgNSAwNjoxNzo1OCBnZW5lcmljIGtlcm5lbDogc21zYzA6IGRlYnVn OiBSWCBjaGVja3N1bSBvZmZsb2FkZWQgKDB4MTlmZSkKTm92ICA1IDA2OjE3OjU4IGdlbmVy aWMga2VybmVsOiBzbXNjMDogZGVidWc6IHJ4IDogYWN0bGVuIDMyNgpOb3YgIDUgMDY6MTc6 NTggZ2VuZXJpYyBrZXJuZWw6IHNtc2MwOiBkZWJ1ZzogcnggOiByeGhkciAweDAxNDAwMDIw IDogcGt0bGVuIDMyMCA6IGFjdGxlbiAzMjYgOiBvZmYgNgpOb3YgIDUgMDY6MTc6NTggZ2Vu ZXJpYyBrZXJuZWw6IHNtc2MwOiBkZWJ1ZzogUlggY2hlY2tzdW0gb2ZmbG9hZGVkICgweDE5 ODIpCk5vdiAgNSAwNjoxNzo1OCBnZW5lcmljIGtlcm5lbDogc21zYzA6IGRlYnVnOiByeCA6 IGFjdGxlbiAyMDIKTm92ICA1IDA2OjE3OjU4IGdlbmVyaWMga2VybmVsOiBzbXNjMDogZGVi dWc6IHJ4IDogcnhoZHIgMHgwMGM0MDAyMCA6IHBrdGxlbiAxOTYgOiBhY3RsZW4gMjAyIDog b2ZmIDYKTm92ICA1IDA2OjE3OjU4IGdlbmVyaWMga2VybmVsOiBzbXNjMDogZGVidWc6IFJY IGNoZWNrc3VtIG9mZmxvYWRlZCAoMHgxOWZlKQpOb3YgIDUgMDY6MTc6NTggZ2VuZXJpYyBr ZXJuZWw6IHNtc2MwOiBkZWJ1ZzogcnggOiBhY3RsZW4gMzI2Ck5vdiAgNSAwNjoxNzo1OCBn ZW5lcmljIGtlcm5lbDogc21zYzA6IGRlYnVnOiByeCA6IHJ4aGRyIDB4MDE0MDAwMjAgOiBw a3RsZW4gMzIwIDogYWN0bGVuIDMyNiA6IG9mZiA2Ck5vdiAgNSAwNjoxNzo1OCBnZW5lcmlj IGtlcm5lbDogc21zYzA6IGRlYnVnOiBSWCBjaGVja3N1bSBvZmZsb2FkZWQgKDB4MTk4MikK Tm92ICA1IDA2OjE3OjU4IGdlbmVyaWMga2VybmVsOiBzbXNjMDogZGVidWc6IHJ4IDogYWN0 bGVuIDIwMgpOb3YgIDUgMDY6MTc6NTggZ2VuZXJpYyBrZXJuZWw6IHNtc2MwOiBkZWJ1Zzog cnggOiByeGhkciAweDAwYzQwMDIwIDogcGt0bGVuIDE5NiA6IGFjdGxlbiAyMDIgOiBvZmYg NgpOb3YgIDUgMDY6MTc6NTggZ2VuZXJpYyBrZXJuZWw6IHNtc2MwOiBkZWJ1ZzogUlggY2hl Y2tzdW0gb2ZmbG9hZGVkICgweDE5ZmUpCk5vdiAgNSAwNjoxNzo1OCBnZW5lcmljIGtlcm5l bDogc21zYzA6IGRlYnVnOiByeCA6IGFjdGxlbiAxOTgKTm92ICA1IDA2OjE3OjU4IGdlbmVy aWMga2VybmVsOiBzbXNjMDogZGVidWc6IHJ4IDogcnhoZHIgMHgwMGMwMDAyMCA6IHBrdGxl biAxOTIgOiBhY3RsZW4gMTk4IDogb2ZmIDYKTm92ICA1IDA2OjE3OjU4IGdlbmVyaWMga2Vy bmVsOiBzbXNjMDogZGVidWc6IFJYIGNoZWNrc3VtIG9mZmxvYWRlZCAoMHgxYTAyKQpOb3Yg IDUgMDY6MTc6NTkgZ2VuZXJpYyBrZXJuZWw6IHNtc2MwOiBkZWJ1ZzogcnggOiBhY3RsZW4g MzI2Ck5vdiAgNSAwNjoxNzo1OSBnZW5lcmljIGtlcm5lbDogc21zYzA6IGRlYnVnOiByeCA6 IHJ4aGRyIDB4MDE0MDAwMjAgOiBwa3RsZW4gMzIwIDogYWN0bGVuIDMyNiA6IG9mZiA2Ck5v diAgNSAwNjoxNzo1OSBnZW5lcmljIGtlcm5lbDogc21zYzA6IGRlYnVnOiBSWCBjaGVja3N1 bSBvZmZsb2FkZWQgKDB4MTk4MikKTm92ICA1IDA2OjE3OjU5IGdlbmVyaWMga2VybmVsOiBz bXNjMDogZGVidWc6IHJ4IDogYWN0bGVuIDMyNgpOb3YgIDUgMDY6MTc6NTkgZ2VuZXJpYyBr ZXJuZWw6IHNtc2MwOiBkZWJ1ZzogcnggOiByeGhkciAweDAxNDAwMDIwIDogcGt0bGVuIDMy MCA6IGFjdGxlbiAzMjYgOiBvZmYgNgpOb3YgIDUgMDY6MTc6NTkgZ2VuZXJpYyBrZXJuZWw6 IHNtc2MwOiBkZWJ1ZzogUlggY2hlY2tzdW0gb2ZmbG9hZGVkICgweDE5ODIpCk5vdiAgNSAw NjoxNzo1OSBnZW5lcmljIGtlcm5lbDogc21zYzA6IGRlYnVnOiByeCA6IGFjdGxlbiAyMDIK Tm92ICA1IDA2OjE3OjU5IGdlbmVyaWMga2VybmVsOiBzbXNjMDogZGVidWc6IHJ4IDogcnho ZHIgMHgwMGM0MDAyMCA6IHBrdGxlbiAxOTYgOiBhY3RsZW4gMjAyIDogb2ZmIDYKTm92ICA1 IDA2OjE3OjU5IGdlbmVyaWMga2VybmVsOiBzbXNjMDogZGVidWc6IFJYIGNoZWNrc3VtIG9m ZmxvYWRlZCAoMHgxOWZlKQpOb3YgIDUgMDY6MTc6NTkgZ2VuZXJpYyBrZXJuZWw6IHNtc2Mw OiBkZWJ1ZzogcnggOiBhY3RsZW4gMTk0Ck5vdiAgNSAwNjoxNzo1OSBnZW5lcmljIGtlcm5l bDogc21zYzA6IGRlYnVnOiByeCA6IHJ4aGRyIDB4MDBiYzAwMjAgOiBwa3RsZW4gMTg4IDog YWN0bGVuIDE5NCA6IG9mZiA2Ck5vdiAgNSAwNjoxNzo1OSBnZW5lcmljIGtlcm5lbDogc21z YzA6IGRlYnVnOiBSWCBjaGVja3N1bSBvZmZsb2FkZWQgKDB4MWEwNikKTm92ICA1IDA2OjE3 OjU5IGdlbmVyaWMga2VybmVsOiBzbXNjMDogZGVidWc6IHJ4IDogYWN0bGVuIDIwMgpOb3Yg IDUgMDY6MTc6NTkgZ2VuZXJpYyBrZXJuZWw6IHNtc2MwOiBkZWJ1ZzogcnggOiByeGhkciAw eDAwYzQwMDIwIDogcGt0bGVuIDE5NiA6IGFjdGxlbiAyMDIgOiBvZmYgNgpOb3YgIDUgMDY6 MTc6NTkgZ2VuZXJpYyBrZXJuZWw6IHNtc2MwOiBkZWJ1ZzogUlggY2hlY2tzdW0gb2ZmbG9h ZGVkICgweDE5ZmUpCk5vdiAgNSAwNjoxNzo1OSBnZW5lcmljIGtlcm5lbDogc21zYzA6IGRl YnVnOiByeCA6IGFjdGxlbiAzMjYKTm92ICA1IDA2OjE3OjU5IGdlbmVyaWMga2VybmVsOiBz bXNjMDogZGVidWc6IHJ4IDogcnhoZHIgMHgwMTQwMDAyMCA6IHBrdGxlbiAzMjAgOiBhY3Rs ZW4gMzI2IDogb2ZmIDYKTm92ICA1IDA2OjE3OjU5IGdlbmVyaWMga2VybmVsOiBzbXNjMDog ZGVidWc6IFJYIGNoZWNrc3VtIG9mZmxvYWRlZCAoMHgxOTgyKQpOb3YgIDUgMDY6MTc6NTkg Z2VuZXJpYyBrZXJuZWw6IHNtc2MwOiBkZWJ1ZzogcnggOiBhY3RsZW4gMjAyCk5vdiAgNSAw NjoxNzo1OSBnZW5lcmljIGtlcm5lbDogc21zYzA6IGRlYnVnOiByeCA6IHJ4aGRyIDB4MDBj NDAwMjAgOiBwa3RsZW4gMTk2IDogYWN0bGVuIDIwMiA6IG9mZiA2Ck5vdiAgNSAwNjoxNzo1 OSBnZW5lcmljIGtlcm5lbDogc21zYzA6IGRlYnVnOiBSWCBjaGVja3N1bSBvZmZsb2FkZWQg KDB4MTlmZSkKTm92ICA1IDA2OjE3OjU5IGdlbmVyaWMga2VybmVsOiBzbXNjMDogZGVidWc6 IHJ4IDogYWN0bGVuIDk2Ck5vdiAgNSAwNjoxNzo1OSBnZW5lcmljIGtlcm5lbDogc21zYzA6 IGRlYnVnOiByeCA6IHJ4aGRyIDB4MDA1YTAwMjAgOiBwa3RsZW4gOTAgOiBhY3RsZW4gOTYg OiBvZmYgNgpOb3YgIDUgMDY6MTc6NTkgZ2VuZXJpYyBrZXJuZWw6IHNtc2MwOiBkZWJ1Zzog UlggY2hlY2tzdW0gb2ZmbG9hZGVkICgweDFhNjYpCk5vdiAgNSAwNjoxNzo1OSBnZW5lcmlj IGtlcm5lbDogc21zYzA6IGRlYnVnOiByeCA6IGFjdGxlbiA3MgpOb3YgIDUgMDY6MTc6NTkg Z2VuZXJpYyBrZXJuZWw6IHNtc2MwOiBkZWJ1ZzogcnggOiByeGhkciAweDAwNDIyNDIwIDog cGt0bGVuIDY2IDogYWN0bGVuIDcyIDogb2ZmIDYKTm92ICA1IDA2OjE4OjAwIGdlbmVyaWMg a2VybmVsOiBzbXNjMDogZGVidWc6IHJ4IDogYWN0bGVuIDIwMgpOb3YgIDUgMDY6MTg6MDAg Z2VuZXJpYyBrZXJuZWw6IHNtc2MwOiBkZWJ1ZzogcnggOiByeGhkciAweDAwYzQwMDIwIDog cGt0bGVuIDE5NiA6IGFjdGxlbiAyMDIgOiBvZmYgNgpOb3YgIDUgMDY6MTg6MDAgZ2VuZXJp YyBrZXJuZWw6IHNtc2MwOiBkZWJ1ZzogUlggY2hlY2tzdW0gb2ZmbG9hZGVkICgweDE5ZmUp Ck5vdiAgNSAwNjoxODowMCBnZW5lcmljIGtlcm5lbDogc21zYzA6IGRlYnVnOiByeCA6IGFj dGxlbiAzMjYKTm92ICA1IDA2OjE4OjAwIGdlbmVyaWMga2VybmVsOiBzbXNjMDogZGVidWc6 IHJ4IDogcnhoZHIgMHgwMTQwMDAyMCA6IHBrdGxlbiAzMjAgOiBhY3RsZW4gMzI2IDogb2Zm IDYKTm92ICA1IDA2OjE4OjAwIGdlbmVyaWMga2VybmVsOiBzbXNjMDogZGVidWc6IFJYIGNo ZWNrc3VtIG9mZmxvYWRlZCAoMHgxOTgyKQpOb3YgIDUgMDY6MTg6MDAgZ2VuZXJpYyBrZXJu ZWw6IHNtc2MwOiBkZWJ1ZzogcnggOiBhY3RsZW4gMjAyCk5vdiAgNSAwNjoxODowMCBnZW5l cmljIGtlcm5lbDogc21zYzA6IGRlYnVnOiByeCA6IHJ4aGRyIDB4MDBjNDAwMjAgOiBwa3Rs ZW4gMTk2IDogYWN0bGVuIDIwMiA6IG9mZiA2Ck5vdiAgNSAwNjoxODowMCBnZW5lcmljIGtl cm5lbDogc21zYzA6IGRlYnVnOiBSWCBjaGVja3N1bSBvZmZsb2FkZWQgKDB4MTlmZSkKTm92 ICA1IDA2OjE4OjAwIGdlbmVyaWMga2VybmVsOiBzbXNjMDogZGVidWc6IHJ4IDogYWN0bGVu IDIwMgpOb3YgIDUgMDY6MTg6MDAgZ2VuZXJpYyBrZXJuZWw6IHNtc2MwOiBkZWJ1Zzogcngg OiByeGhkciAweDAwYzQwMDIwIDogcGt0bGVuIDE5NiA6IGFjdGxlbiAyMDIgOiBvZmYgNgpO b3YgIDUgMDY6MTg6MDAgZ2VuZXJpYyBrZXJuZWw6IHNtc2MwOiBkZWJ1ZzogUlggY2hlY2tz dW0gb2ZmbG9hZGVkICgweDE5ZmUpCk5vdiAgNSAwNjoxODowMCBnZW5lcmljIGtlcm5lbDog c21zYzA6IGRlYnVnOiByeCA6IGFjdGxlbiAzMjYKTm92ICA1IDA2OjE4OjAwIGdlbmVyaWMg a2VybmVsOiBzbXNjMDogZGVidWc6IHJ4IDogcnhoZHIgMHgwMTQwMDAyMCA6IHBrdGxlbiAz MjAgOiBhY3RsZW4gMzI2IDogb2ZmIDYKTm92ICA1IDA2OjE4OjAwIGdlbmVyaWMga2VybmVs OiBzbXNjMDogZGVidWc6IFJYIGNoZWNrc3VtIG9mZmxvYWRlZCAoMHgxOTgyKQpOb3YgIDUg MDY6MTg6MDAgZ2VuZXJpYyBrZXJuZWw6IHNtc2MwOiBkZWJ1ZzogcnggOiBhY3RsZW4gMzI2 Ck5vdiAgNSAwNjoxODowMCBnZW5lcmljIGtlcm5lbDogc21zYzA6IGRlYnVnOiByeCA6IHJ4 aGRyIDB4MDE0MDAwMjAgOiBwa3RsZW4gMzIwIDogYWN0bGVuIDMyNiA6IG9mZiA2Ck5vdiAg NSAwNjoxODowMCBnZW5lcmljIGtlcm5lbDogc21zYzA6IGRlYnVnOiBSWCBjaGVja3N1bSBv ZmZsb2FkZWQgKDB4MTk4MikKTm92ICA1IDA2OjE4OjAwIGdlbmVyaWMga2VybmVsOiBzbXNj MDogZGVidWc6IHJ4IDogYWN0bGVuIDE5NApOb3YgIDUgMDY6MTg6MDAgZ2VuZXJpYyBrZXJu ZWw6IHNtc2MwOiBkZWJ1ZzogcnggOiByeGhkciAweDAwYmMwMDIwIDogcGt0bGVuIDE4OCA6 IGFjdGxlbiAxOTQgOiBvZmYgNgpOb3YgIDUgMDY6MTg6MDAgZ2VuZXJpYyBrZXJuZWw6IHNt c2MwOiBkZWJ1ZzogUlggY2hlY2tzdW0gb2ZmbG9hZGVkICgweDFhMDYpCk5vdiAgNSAwNjox ODowMCBnZW5lcmljIGtlcm5lbDogc21zYzA6IGRlYnVnOiByeCA6IGFjdGxlbiAyMDIKTm92 ICA1IDA2OjE4OjAwIGdlbmVyaWMga2VybmVsOiBzbXNjMDogZGVidWc6IHJ4IDogcnhoZHIg MHgwMGM0MDAyMCA6IHBrdGxlbiAxOTYgOiBhY3RsZW4gMjAyIDogb2ZmIDYKTm92ICA1IDA2 OjE4OjAwIGdlbmVyaWMga2VybmVsOiBzbXNjMDogZGVidWc6IFJYIGNoZWNrc3VtIG9mZmxv YWRlZCAoMHgxOWZlKQpOb3YgIDUgMDY6MTg6MDAgZ2VuZXJpYyBrZXJuZWw6IHNtc2MwOiBk ZWJ1ZzogcnggOiBhY3RsZW4gMTY2Ck5vdiAgNSAwNjoxODowMCBnZW5lcmljIGtlcm5lbDog c21zYzA6IGRlYnVnOiByeCA6IHJ4aGRyIDB4MDBhMDAwMjAgOiBwa3RsZW4gMTYwIDogYWN0 bGVuIDE2NiA6IG9mZiA2Ck5vdiAgNSAwNjoxODowMCBnZW5lcmljIGtlcm5lbDogc21zYzA6 IGRlYnVnOiBSWCBjaGVja3N1bSBvZmZsb2FkZWQgKDB4MWEyMikKTm92ICA1IDA2OjE4OjAw IGdlbmVyaWMga2VybmVsOiBzbXNjMDogZGVidWc6IHJ4IDogYWN0bGVuIDcyCk5vdiAgNSAw NjoxODowMCBnZW5lcmljIGtlcm5lbDogc21zYzA6IGRlYnVnOiByeCA6IHJ4aGRyIDB4MDA0 MjI0MjAgOiBwa3RsZW4gNjYgOiBhY3RsZW4gNzIgOiBvZmYgNgpOb3YgIDUgMDY6MTg6MDAg Z2VuZXJpYyBrZXJuZWw6IHNtc2MwOiBkZWJ1ZzogcnggOiBhY3RsZW4gMTk0Ck5vdiAgNSAw NjoxODowMCBnZW5lcmljIGtlcm5lbDogc21zYzA6IGRlYnVnOiByeCA6IHJ4aGRyIDB4MDBi YzAwMjAgOiBwa3RsZW4gMTg4IDogYWN0bGVuIDE5NCA6IG9mZiA2Ck5vdiAgNSAwNjoxODow MCBnZW5lcmljIGtlcm5lbDogc21zYzA6IGRlYnVnOiBSWCBjaGVja3N1bSBvZmZsb2FkZWQg KDB4MWEwNikKTm92ICA1IDA2OjE4OjAwIGdlbmVyaWMga2VybmVsOiBzbXNjMDogZGVidWc6 IHJ4IDogYWN0bGVuIDMyNgpOb3YgIDUgMDY6MTg6MDAgZ2VuZXJpYyBrZXJuZWw6IHNtc2Mw OiBkZWJ1ZzogcnggOiByeGhkciAweDAxNDAwMDIwIDogcGt0bGVuIDMyMCA6IGFjdGxlbiAz MjYgOiBvZmYgNgpOb3YgIDUgMDY6MTg6MDAgZ2VuZXJpYyBrZXJuZWw6IHNtc2MwOiBkZWJ1 ZzogUlggY2hlY2tzdW0gb2ZmbG9hZGVkICgweDE5ODIpCk5vdiAgNSAwNjoxODowMCBnZW5l cmljIGtlcm5lbDogc21zYzA6IGRlYnVnOiByeCA6IGFjdGxlbiAyMDIKTm92ICA1IDA2OjE4 OjAwIGdlbmVyaWMga2VybmVsOiBzbXNjMDogZGVidWc6IHJ4IDogcnhoZHIgMHgwMGM0MDAy MCA6IHBrdGxlbiAxOTYgOiBhY3RsZW4gMjAyIDogb2ZmIDYKTm92ICA1IDA2OjE4OjAwIGdl bmVyaWMga2VybmVsOiBzbXNjMDogZGVidWc6IFJYIGNoZWNrc3VtIG9mZmxvYWRlZCAoMHgx OWZlKQpOb3YgIDUgMDY6MTg6MDAgZ2VuZXJpYyBrZXJuZWw6IHNtc2MwOiBkZWJ1Zzogcngg OiBhY3RsZW4gMjAyCk5vdiAgNSAwNjoxODowMCBnZW5lcmljIGtlcm5lbDogc21zYzA6IGRl YnVnOiByeCA6IHJ4aGRyIDB4MDBjNDAwMjAgOiBwa3RsZW4gMTk2IDogYWN0bGVuIDIwMiA6 IG9mZiA2Ck5vdiAgNSAwNjoxODowMCBnZW5lcmljIGtlcm5lbDogc21zYzA6IGRlYnVnOiBS WCBjaGVja3N1bSBvZmZsb2FkZWQgKDB4MTlmZSkKTm92ICA1IDA2OjE4OjAwIGdlbmVyaWMg a2VybmVsOiBzbXNjMDogZGVidWc6IHJ4IDogYWN0bGVuIDIwMgpOb3YgIDUgMDY6MTg6MDAg Z2VuZXJpYyBrZXJuZWw6IHNtc2MwOiBkZWJ1ZzogcnggOiByeGhkciAweDAwYzQwMDIwIDog cGt0bGVuIDE5NiA6IGFjdGxlbiAyMDIgOiBvZmYgNgpOb3YgIDUgMDY6MTg6MDAgZ2VuZXJp YyBrZXJuZWw6IHNtc2MwOiBkZWJ1ZzogUlggY2hlY2tzdW0gb2ZmbG9hZGVkICgweDE5ZmUp Ck5vdiAgNSAwNjoxODowMCBnZW5lcmljIGtlcm5lbDogc21zYzA6IGRlYnVnOiByeCA6IGFj dGxlbiAxOTgKTm92ICA1IDA2OjE4OjAwIGdlbmVyaWMga2VybmVsOiBzbXNjMDogZGVidWc6 IHJ4IDogcnhoZHIgMHgwMGMwMDAyMCA6IHBrdGxlbiAxOTIgOiBhY3RsZW4gMTk4IDogb2Zm IDYKTm92ICA1IDA2OjE4OjAwIGdlbmVyaWMga2VybmVsOiBzbXNjMDogZGVidWc6IFJYIGNo ZWNrc3VtIG9mZmxvYWRlZCAoMHgxYTAyKQpOb3YgIDUgMDY6MTg6MDAgZ2VuZXJpYyBrZXJu ZWw6IHNtc2MwOiBkZWJ1ZzogcnggOiBhY3RsZW4gNzIKTm92ICA1IDA2OjE4OjAwIGdlbmVy aWMga2VybmVsOiBzbXNjMDogZGVidWc6IHJ4IDogcnhoZHIgMHgwMDQyMjQyMCA6IHBrdGxl biA2NiA6IGFjdGxlbiA3MiA6IG9mZiA2Ck5vdiAgNSAwNjoxODowMCBnZW5lcmljIGtlcm5l bDogc21zYzA6IGRlYnVnOiByeCA6IGFjdGxlbiA3MgpOb3YgIDUgMDY6MTg6MDAgZ2VuZXJp YyBrZXJuZWw6IHNtc2MwOiBkZWJ1ZzogcnggOiByeGhkciAweDAwNDIyNDIwIDogcGt0bGVu IDY2IDogYWN0bGVuIDcyIDogb2ZmIDYKTm92ICA1IDA2OjE4OjAyIGdlbmVyaWMga2VybmVs OiBzbXNjMDogZGVidWc6IHJ4IDogYWN0bGVuIDcyCk5vdiAgNSAwNjoxODowMiBnZW5lcmlj IGtlcm5lbDogc21zYzA6IGRlYnVnOiByeCA6IHJ4aGRyIDB4MDA0MjI0MjAgOiBwa3RsZW4g NjYgOiBhY3RsZW4gNzIgOiBvZmYgNgpOb3YgIDUgMDY6MTg6MDIgZ2VuZXJpYyBrZXJuZWw6 IHNtc2MwOiBkZWJ1ZzogcnggOiBhY3RsZW4gNzIKTm92ICA1IDA2OjE4OjAyIGdlbmVyaWMg a2VybmVsOiBzbXNjMDogZGVidWc6IHJ4IDogcnhoZHIgMHgwMDQyMjQyMCA6IHBrdGxlbiA2 NiA6IGFjdGxlbiA3MiA6IG9mZiA2Ck5vdiAgNSAwNjoxODowNCBnZW5lcmljIGtlcm5lbDog c21zYzA6IGRlYnVnOiByeCA6IGFjdGxlbiA5NgpOb3YgIDUgMDY6MTg6MDQgZ2VuZXJpYyBr ZXJuZWw6IHNtc2MwOiBkZWJ1ZzogcnggOiByeGhkciAweDAwNWEwMDIwIDogcGt0bGVuIDkw IDogYWN0bGVuIDk2IDogb2ZmIDYKTm92ICA1IDA2OjE4OjA0IGdlbmVyaWMga2VybmVsOiBz bXNjMDogCk5vdiAgNSAwNjoxODowNCBnZW5lcmljIGtlcm5lbDogZGVidWc6IFJYIGNoZWNr c3VtIG9mZmxvYWRlZCAoMHgxYTY2KQpOb3YgIDUgMDY6MTg6MDQgZ2VuZXJpYyBrZXJuZWw6 IHNtc2MwOiBkZWJ1ZzogcnggOiBhY3RsZW4gNzIKTm92ICA1IDA2OjE4OjA0IGdlbmVyaWMg a2VybmVsOiBzbXNjMDogZGVidWc6IHJ4IDogcnhoZHIgMHgwMDQyMjQyMCA6IHBrdGxlbiA2 NiA6IGFjdGxlbiA3MiA6IG9mZiA2Ck5vdiAgNSAwNjoxODowNCBnZW5lcmljIGtlcm5lbDog c21zYzA6IGRlYnVnOiByeCA6IGFjdGxlbiA3MgpOb3YgIDUgMDY6MTg6MDQgZ2VuZXJpYyBr ZXJuZWw6IHNtc2MwOiBkZWJ1ZzogcnggOiByeGhkciAweDAwNDIyNDIwIDogcGt0bGVuIDY2 IDogYWN0bGVuIDcyIDogb2ZmIDYKTm92ICA1IDA2OjE4OjA2IGdlbmVyaWMga2VybmVsOiBz bXNjMDogZGVidWc6IHJ4IDogYWN0bGVuIDcyCk5vdiAgNSAwNjoxODowNiBnZW5lcmljIGtl cm5lbDogc21zYzA6IGRlYnVnOiByeCA6IHJ4aGRyIDB4MDA0MjI0MjAgOiBwa3RsZW4gNjYg OiBhY3RsZW4gNzIgOiBvZmYgNgpOb3YgIDUgMDY6MTg6MDYgZ2VuZXJpYyBrZXJuZWw6IHNt c2MwOiBkZWJ1ZzogcnggOiBhY3RsZW4gNzIKTm92ICA1IDA2OjE4OjA2IGdlbmVyaWMga2Vy bmVsOiBzbXNjMDogZGVidWc6IHJ4IDogcnhoZHIgMHgwMDQyMjQyMCA6IHBrdGxlbiA2NiA6 IGFjdGxlbiA3MiA6IG9mZiA2Ck5vdiAgNSAwNjoxODowOCBnZW5lcmljIGtlcm5lbDogc21z YzA6IGRlYnVnOiByeCA6IGFjdGxlbiA3MgpOb3YgIDUgMDY6MTg6MDggZ2VuZXJpYyBrZXJu ZWw6IHNtc2MwOiBkZWJ1ZzogcnggOiByeGhkciAweDAwNDIyNDIwIDogcGt0bGVuIDY2IDog YWN0bGVuIDcyIDogb2ZmIDYKTm92ICA1IDA2OjE4OjEwIGdlbmVyaWMga2VybmVsOiBzbXNj MDogZGVidWc6IHJ4IDogYWN0bGVuIDcyCk5vdiAgNSAwNjoxODoxMCBnZW5lcmljIGtlcm5l bDogc21zYzA6IGRlYnVnOiByeCA6IHJ4aGRyIDB4MDA0MjI0MjAgOiBwa3RsZW4gNjYgOiBh Y3RsZW4gNzIgOiBvZmYgNgpOb3YgIDUgMDY6MTg6MTAgZ2VuZXJpYyBrZXJuZWw6IHNtc2Mw OiBkZWJ1ZzogcnggOiBhY3RsZW4gNzIKTm92ICA1IDA2OjE4OjEwIGdlbmVyaWMga2VybmVs OiBzbXNjMDogZGVidWc6IHJ4IDogcnhoZHIgMHgwMDQyMjQyMCA6IHBrdGxlbiA2NiA6IGFj dGxlbiA3MiA6IG9mZiA2Ck5vdiAgNSAwNjoxODoxMiBnZW5lcmljIGtlcm5lbDogc21zYzA6 IGRlYnVnOiByeCA6IGFjdGxlbiA3MgpOb3YgIDUgMDY6MTg6MTIgZ2VuZXJpYyBrZXJuZWw6 IHNtc2MwOiBkZWJ1ZzogcnggOiByeGhkciAweDAwNDIyNDIwIDogcGt0bGVuIDY2IDogYWN0 bGVuIDcyIDogb2ZmIDYKTm92ICA1IDA2OjE4OjEyIGdlbmVyaWMga2VybmVsOiBzbXNjMDog ZGVidWc6IHJ4IDogYWN0bGVuIDcyCk5vdiAgNSAwNjoxODoxMiBnZW5lcmljIGtlcm5lbDog c21zYzA6IGRlYnVnOiByeCA6IHJ4aGRyIDB4MDA0MjI0MjAgOiBwa3RsZW4gNjYgOiBhY3Rs ZW4gNzIgOiBvZmYgNgpOb3YgIDUgMDY6MTg6MTQgZ2VuZXJpYyBrZXJuZWw6IHNtc2MwOiBk ZWJ1ZzogcnggOiBhY3RsZW4gNzIKTm92ICA1IDA2OjE4OjE0IGdlbmVyaWMga2VybmVsOiBz bXNjMDogZGVidWc6IHJ4IDogcnhoZHIgMHgwMDQyMjQyMCA6IHBrdGxlbiA2NiA6IGFjdGxl biA3MiA6IG9mZiA2Ck5vdiAgNSAwNjoxODoxNCBnZW5lcmljIGtlcm5lbDogc21zYzA6IGRl YnVnOiByeCA6IGFjdGxlbiA3MgpOb3YgIDUgMDY6MTg6MTQgZ2VuZXJpYyBrZXJuZWw6IHNt c2MwOiBkZWJ1ZzogcnggOiByeGhkciAweDAwNDIyNDIwIDogcGt0bGVuIDY2IDogYWN0bGVu IDcyIDogb2ZmIDYK --------------EE2C18579A1D26EAA6F28607-- From owner-freebsd-arm@freebsd.org Thu Nov 5 15:28:59 2020 Return-Path: Delivered-To: freebsd-arm@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 20ABF46A795 for ; Thu, 5 Nov 2020 15:28:59 +0000 (UTC) (envelope-from ian@freebsd.org) Received: from mailman.nyi.freebsd.org (unknown [127.0.1.3]) by mx1.freebsd.org (Postfix) with ESMTP id 4CRnVg021Rz4nlh for ; Thu, 5 Nov 2020 15:28:59 +0000 (UTC) (envelope-from ian@freebsd.org) Received: by mailman.nyi.freebsd.org (Postfix) id F34E446A3D9; Thu, 5 Nov 2020 15:28:58 +0000 (UTC) Delivered-To: arm@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id F314846A4CA for ; Thu, 5 Nov 2020 15:28:58 +0000 (UTC) (envelope-from ian@freebsd.org) Received: from outbound5a.ore.mailhop.org (outbound5a.ore.mailhop.org [44.233.67.66]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4CRnVf3r17z4nr6 for ; Thu, 5 Nov 2020 15:28:58 +0000 (UTC) (envelope-from ian@freebsd.org) ARC-Seal: i=1; a=rsa-sha256; t=1604590131; cv=none; d=outbound.mailhop.org; s=arc-outbound20181012; b=fLTyWcFOXx9lHuNtW2sRqhK6VM6e+lVrLIh3nj2VkjHWZ96S7FCagvuTr2Or0MN7ykClKKnWaOEWy 03Nu3JhDD/IEmC6wULjW14SakbVzvPI8LwGebre2MwTGwwt7ptpjXwluMUHVwlKAoonyCPQ97tw6Fs 6tZFA1Yq4WQNR6q9u0BfHUN5OuzOaYmcuhMyn5gewezbP8GM8cgfKU6xv64mCenSLSylM7iqgcb7AI b0wJiYew+XXfrqgMqXYmVHdh/b+l+4UbVPIaJwyNvhWEk3jL2xXFz5gNU0THXQZqXFLXv/E5pO/3lq yERLEMIz7cBxQcD4lGuZRCDmEDvd6mg== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=outbound.mailhop.org; s=arc-outbound20181012; h=content-transfer-encoding:mime-version:content-type:references:in-reply-to: date:cc:to:from:subject:message-id:dkim-signature:from; bh=ofDdpoSTzycQsnoMTnuZEpejIsHzglF+cZtG3rgsH4w=; b=Yyp09f2JM6YPfgKSqASUv4o16lPhlMboT43TBBK4ZhSk8VPBhnRcrgRvEOA+stFbKmYaBUe78e7lF KQ5SJ0PVSbGAE3gKFiNFEyHGs3SMktpxRa5JAFq4H3blgFGiUCNZVmJtYgwjVy8nPMhXnVuEvSfbFR nk7Bzgw3f1e0YTo2HnPeA0m+kU5kmcIaxfV3rM6mwxKfnqsxx2PA5RyH1e/pUGOYC4m1Tw/E1uxuYB DCXX4xdngOuQsp95lsyeovIG5E4AQXo/jC8VoJNHcFX97vb4pOw9RYT6JR8LrF9g7RGKulfwAQhLbA YDtqddkgzYDU8u3w7eEqivTb3SmzPKw== ARC-Authentication-Results: i=1; outbound3.ore.mailhop.org; spf=softfail smtp.mailfrom=freebsd.org smtp.remote-ip=67.177.211.60; dmarc=none header.from=freebsd.org; arc=none header.oldest-pass=0; DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=outbound.mailhop.org; s=dkim-high; h=content-transfer-encoding:mime-version:content-type:references:in-reply-to: date:cc:to:from:subject:message-id:from; bh=ofDdpoSTzycQsnoMTnuZEpejIsHzglF+cZtG3rgsH4w=; b=gPmIH2gcGZggR3B/1zF2TyVH+FpUF8yEBV0EIVYDHao0TxMk7XI8fR9h4Yx70/Qf93xmtvw1A3ZRB BoG7/IX5n5c8txmXozChDVogeHD1/mzrsFZLFcexQQFoz0X0Rtz/e3AL/zY5VUjJHZxL3RT5U9142a XSQpKQCIVYtzGNUqEmCDC8D7Ai6m0iHvx5Lf+nYKVAvO9pkxOeQBlRBKcBybWO59ALHNNrI4cO+Uv0 OL7b4BfSDfDBaWaWp9I9fkU7E3hJ2OfAXgiQFspiEi9w5t3q74kkosLyUo4+uYRAn3G25G6AajgUir eZOGBp1Fxlm3JVz4zr3DXT5SwPPSDFw== X-MHO-RoutePath: aGlwcGll X-MHO-User: 98fc2d21-1f7b-11eb-8b38-614106969e8d X-Report-Abuse-To: https://support.duocircle.com/support/solutions/articles/5000540958-duocircle-standard-smtp-abuse-information X-Originating-IP: 67.177.211.60 X-Mail-Handler: DuoCircle Outbound SMTP Received: from ilsoft.org (c-67-177-211-60.hsd1.co.comcast.net [67.177.211.60]) by outbound3.ore.mailhop.org (Halon) with ESMTPSA id 98fc2d21-1f7b-11eb-8b38-614106969e8d; Thu, 05 Nov 2020 15:28:49 +0000 (UTC) Received: from rev (rev [172.22.42.240]) by ilsoft.org (8.15.2/8.15.2) with ESMTP id 0A5FSk4h097271; Thu, 5 Nov 2020 08:28:46 -0700 (MST) (envelope-from ian@freebsd.org) Message-ID: <9b2c7b09be7524fc736c741487b1cfb039ce6eda.camel@freebsd.org> Subject: Re: if_mvneta rx/tx byte counts wrong From: Ian Lepore To: Kurt Jaeger , John F Carr Cc: "freebsd-arm@freebsd.org" Date: Thu, 05 Nov 2020 08:28:46 -0700 In-Reply-To: <20201104123909.GF53210@home.opsec.eu> References: <57104A54-AC82-4102-A637-116BF8D2E17D@gmail.com> <858E0BCD-C4E9-4997-A982-3C19DF21D161@exchange.mit.edu> <20201104123909.GF53210@home.opsec.eu> Content-Type: text/plain; charset="ASCII" X-Mailer: Evolution 3.28.5 FreeBSD GNOME Team Mime-Version: 1.0 Content-Transfer-Encoding: 7bit X-Rspamd-Queue-Id: 4CRnVf3r17z4nr6 X-Spamd-Bar: / Authentication-Results: mx1.freebsd.org; none X-Spamd-Result: default: False [0.00 / 15.00]; local_wl_from(0.00)[freebsd.org]; ASN(0.00)[asn:16509, ipnet:44.224.0.0/11, country:US] X-BeenThere: freebsd-arm@freebsd.org X-Mailman-Version: 2.1.34 Precedence: list List-Id: "Porting FreeBSD to ARM processors." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 05 Nov 2020 15:28:59 -0000 On Wed, 2020-11-04 at 13:39 +0100, Kurt Jaeger wrote: > Hi! > > > If you view in hex, > > > > $ printf '%x %x %x\n' 443193380410133 3813930959736 274877907008 > > 1931500019315 37800000378 4000000040 > > > > you see a 32 bit value duplicated into both halves of a 64 bit > > value. > > Ah. I think Juniper switches have the same problem -- I heard > that this is a timing/atomicity problem of writing 64bit values > on arm32. > I don't think that's likely to be true. We'd see the problem in a lot more places, and the problem would be intermittent, which doesn't appear to be the case here. I would more tend to suspect the arm 32-bit implementation of bus_space_read/write_8(). -- Ian From owner-freebsd-arm@freebsd.org Thu Nov 5 18:19:18 2020 Return-Path: Delivered-To: freebsd-arm@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id AD6B746DA7F for ; Thu, 5 Nov 2020 18:19:18 +0000 (UTC) (envelope-from swills@FreeBSD.org) Received: from mouf.net (mouf.net [IPv6:2607:fc50:0:4400:216:3eff:fe69:33b3]) (using TLSv1 with cipher DHE-RSA-AES256-SHA (256/256 bits)) (Client CN "mouf.net", Issuer "mouf.net" (not verified)) by mx1.freebsd.org (Postfix) with ESMTPS id 4CRsHB2vsHz3FX8; Thu, 5 Nov 2020 18:19:17 +0000 (UTC) (envelope-from swills@FreeBSD.org) Received: from lrrr.mouf.net (2603-6080-7702-bf01-e921-3cf1-8f08-98be.res6.spectrum.com [IPv6:2603:6080:7702:bf01:e921:3cf1:8f08:98be]) (authenticated bits=0) by mouf.net (8.14.9/8.14.9) with ESMTP id 0A5IJ9fL075492 (version=TLSv1/SSLv3 cipher=AES128-SHA bits=128 verify=NOT); Thu, 5 Nov 2020 18:19:15 GMT (envelope-from swills@FreeBSD.org) Subject: Re: growfs triggering sdhc errors To: mmel@freebsd.org, freebsd-arm@freebsd.org References: <2724d1d4-58a1-eef2-c6bb-ce1be0fa3123@FreeBSD.org> <5f443e74-5e55-c8b2-f4c2-ea0034437aa0@FreeBSD.org> <6780ae20-de0b-62ce-4090-43e1cb3f87d3@freebsd.org> From: Steve Wills Message-ID: Date: Thu, 5 Nov 2020 13:19:02 -0500 User-Agent: Mozilla/5.0 (X11; FreeBSD amd64; rv:78.0) Gecko/20100101 Thunderbird/78.4.0 MIME-Version: 1.0 In-Reply-To: <6780ae20-de0b-62ce-4090-43e1cb3f87d3@freebsd.org> Content-Type: text/plain; charset=utf-8; format=flowed Content-Language: en-US Content-Transfer-Encoding: 7bit X-Greylist: Sender succeeded SMTP AUTH, not delayed by milter-greylist-4.4.3 (mouf.net [IPv6:2607:fc50:0:4400:216:3eff:fe69:33b3]); Thu, 05 Nov 2020 18:19:15 +0000 (UTC) X-Spam-Status: No, score=0.0 required=4.5 tests=KHOP_HELO_FCRDNS, NICE_REPLY_A autolearn=unavailable autolearn_force=no version=3.4.1 X-Spam-Checker-Version: SpamAssassin 3.4.1 (2015-04-28) on mouf.net X-Virus-Scanned: clamav-milter 0.99.2 at mouf.net X-Virus-Status: Clean X-Rspamd-Queue-Id: 4CRsHB2vsHz3FX8 X-Spamd-Bar: / Authentication-Results: mx1.freebsd.org; none X-Spamd-Result: default: False [0.00 / 15.00]; local_wl_from(0.00)[FreeBSD.org]; ASN(0.00)[asn:36236, ipnet:2607:fc50::/36, country:US] X-BeenThere: freebsd-arm@freebsd.org X-Mailman-Version: 2.1.34 Precedence: list List-Id: "Porting FreeBSD to ARM processors." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 05 Nov 2020 18:19:18 -0000 Hi, On 11/5/20 1:45 AM, Michal Meloun wrote: > > > On 05.11.2020 3:01, Steve Wills wrote: >> Hi, >> >> I seem to have narrowed this down to r366106. With commits before >> that, growfs works fine. After, it gives these errors. This seems to >> have been discovered already tho: >> >> https://lists.freebsd.org/pipermail/svn-src-head/2020-November/141284.html >> >> >> And yet, so for, no response. I will try the proposed patch. >> >> Steve >> > This problem should be fixed in another way by r367268. Can you, please, > test a fresh current? Thanks for the reply, I've tested with r367383 but I'm still seeing the same issue, as soon as growfs runs, I get errors then continual sdhc register dumps: OK to grow filesystem on /dev/mmcsd0s2a, mounted on /, from 5.4GB to 30GB? [yes/no] yes mmcsd0: Error indicated: 6 NO MEMORY gmmcsd0: Error indicated: 1 Timeout vm_fault: pager read error, pid 34 (growfs) pid 34 (growfs), jid 0, uid 0: exited on signal 10 mmcsd0: Error indicated: 1 Timeout mmcsd0: Error indicated: 1 Timeout mmcsd0: Error indicated: 1 Timeout rdfs: read error: 10258176: vm_fault: pager read error, pid 25 (sh) pid 25 (sh), jid 0, uid 0: exited on signal 10 vm_fault: pager read error, pid 1 (init) vm_fault: pager read error, pid 1 (init) sdhci_bcm0-slot0: Got data interrupt 0x00600000, but there is no active command. vm_fault: pager read error, pid 1 (init) sdhci_bcm0-slot0: ============== REGISTER DUMP ============== sdhci_bcm0-slot0: Sys addr: 0x00000000 | Version: 0x00009902 sdhci_bcm0-slot0: Blk size: 0x00000200 | Blk cnt: 0x00000040 sdhci_bcm0-slot0: Argument: 0x00657d40 | Trn mode: 0x00000036 sdhci_bcm0-slot0: Present: 0x010f0000 | Host ctl: 0x00000002 sdhci_bcm0-slot0: Power: 0x0000000f | Blk gap: 0x00000000 sdhci_bcm0-slot0: Wake-up: 0x00000000 | Clock: 0x00000207 sdhci_bcm0-slot0: Timeout: 0x0000000e | Int stat: 0x00000000 sdhci_bcm0-slot0: Int enab: 0x01ff00bb | Sig enab: 0x01ff00bb sdhci_bcm0-slot0: AC12 err: 0x00000000 | Host ctl2:0x00000000 sdhci_bcm0-slot0: Caps: 0x00000000 | Caps2: 0x00000000 sdhci_bcm0-slot0: Max curr: 0x00000001 | ADMA err: 0x00000000 sdhci_bcm0-slot0: ADMA addr:0x00000000 | Slot int: 0x00000000 sdhci_bcm0-slot0: =========================================== Perhaps it's something local? FWIW, I'm testing on RPI3 Model B v1.2. Thanks, Steve From owner-freebsd-arm@freebsd.org Fri Nov 6 16:56:55 2020 Return-Path: Delivered-To: freebsd-arm@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 20221443856; Fri, 6 Nov 2020 16:56:55 +0000 (UTC) (envelope-from andrei.cos.martin@gmail.com) Received: from mail-ed1-x52f.google.com (mail-ed1-x52f.google.com [IPv6:2a00:1450:4864:20::52f]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "GTS CA 1O1" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4CSRPf2jDJz4VSc; Fri, 6 Nov 2020 16:56:54 +0000 (UTC) (envelope-from andrei.cos.martin@gmail.com) Received: by mail-ed1-x52f.google.com with SMTP id e18so1964161edy.6; Fri, 06 Nov 2020 08:56:54 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=from:mime-version:subject:message-id:date:to; bh=8It0Iws1KmFR+ocdnM7v8Lq9H2QNxnEj09+rd0DfcOM=; b=CQggjE2Irg2k48mORyAI1/NBrXmWGxZooFTd8UV2FhKS6D8Y4Mu5nXJSZYmcftHN0j NezNY0nx5b7GFVG/faVJBtlKZzwvuVQfT80WqgoY9euElRVXWhbPPVU1BZ4H99XcHlZ3 lUjch76JX4NUh914tqVHRaXUEoj6/l4jvnByHpo7kfklJVbulg7egjM7PiT5NF3SV+sd XzN6TLA7DqnK/EO0ApHlzW5e6Ll24OlaHNakKqfWSQtw5Yjk57TJxvWpTPB+vuFU+1Vs w2kY2rDClsw40rFFbOWMQc/u5+zGxrkevLaY7bsBThYq76f1dI2rATMK9s5Oai+agX44 Qw3g== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:from:mime-version:subject:message-id:date:to; bh=8It0Iws1KmFR+ocdnM7v8Lq9H2QNxnEj09+rd0DfcOM=; b=cQIQ6UnDFsHZHwC/4dZ7LanfgiMIl1dJ0gYn0skoQeBUr8WrHjRNDgVvnqemVoMc5f FwCZZqfm3j88jBubPEuu9teUkFjpLLMul/VF7+v+6R0kkzrS1PNUCLzfNJ+fSKhME0zK vEdQqBH08aLO0kuoduN+vb/jnfSmcoUVwc5aE8mWvW7aJDkq/9Mmh1l5/xmfcPkrkIWM L6uFjTcUk9KVoXxSoPXuE1vMxpJUQuyNGr6A6db6n0Du4q8dzh+KV/lJcN/uHUUQrX4n 9jpaJ+6ij5obV8YW1po91OmNWaB/YfWUBISitsE3OvvJRrBN/2p7epzscoIY3bs07lV1 n5Kw== X-Gm-Message-State: AOAM533jAq5H/QNlZ/ZrIZdLVujWVLTwXoPYW9bMm333FgT77n/JwnOJ Qs9c0LWqponiB/gUMPY73kHYFUyRb6FMmQ== X-Google-Smtp-Source: ABdhPJzd1T0sYFyBlEyDv4B9bchLQ8Kh3p5DNf4JXJdvaYGlDWpThrboby34rhIaF3vDpTAncvEk7g== X-Received: by 2002:aa7:da44:: with SMTP id w4mr3004168eds.131.1604681811843; Fri, 06 Nov 2020 08:56:51 -0800 (PST) Received: from [192.168.0.115] ([31.5.53.36]) by smtp.gmail.com with ESMTPSA id h24sm1405099ejk.31.2020.11.06.08.56.50 (version=TLS1_2 cipher=ECDHE-ECDSA-AES128-GCM-SHA256 bits=128/128); Fri, 06 Nov 2020 08:56:51 -0800 (PST) From: Andrei Martin Mime-Version: 1.0 (Mac OS X Mail 13.4 \(3608.80.23.2.2\)) Subject: [arm64][bhyve] Hypervisor implementation proposal Message-Id: <92471791-E6DC-47E4-9124-79558DDCA7D0@gmail.com> Date: Fri, 6 Nov 2020 18:56:49 +0200 To: freebsd-virtualization@freebsd.org, freebsd-arm@freebsd.org X-Mailer: Apple Mail (2.3608.80.23.2.2) X-Rspamd-Queue-Id: 4CSRPf2jDJz4VSc X-Spamd-Bar: -- Authentication-Results: mx1.freebsd.org; dkim=pass header.d=gmail.com header.s=20161025 header.b=CQggjE2I; dmarc=pass (policy=none) header.from=gmail.com; spf=pass (mx1.freebsd.org: domain of andreicosmartin@gmail.com designates 2a00:1450:4864:20::52f as permitted sender) smtp.mailfrom=andreicosmartin@gmail.com X-Spamd-Result: default: False [-2.50 / 15.00]; RCVD_VIA_SMTP_AUTH(0.00)[]; R_SPF_ALLOW(-0.20)[+ip6:2a00:1450:4000::/36:c]; FREEMAIL_FROM(0.00)[gmail.com]; MV_CASE(0.50)[]; TO_DN_NONE(0.00)[]; RCVD_COUNT_THREE(0.00)[3]; DKIM_TRACE(0.00)[gmail.com:+]; RCPT_COUNT_TWO(0.00)[2]; DMARC_POLICY_ALLOW(-0.50)[gmail.com,none]; NEURAL_HAM_SHORT(-1.00)[-1.000]; RECEIVED_SPAMHAUS_PBL(0.00)[31.5.53.36:received]; FROM_EQ_ENVFROM(0.00)[]; MIME_TRACE(0.00)[0:+,1:+,2:~]; FREEMAIL_ENVFROM(0.00)[gmail.com]; MID_RHS_MATCH_FROM(0.00)[]; TAGGED_FROM(0.00)[]; ASN(0.00)[asn:15169, ipnet:2a00:1450::/32, country:US]; ARC_NA(0.00)[]; RBL_DBL_DONT_QUERY_IPS(0.00)[2a00:1450:4864:20::52f:from]; R_DKIM_ALLOW(-0.20)[gmail.com:s=20161025]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; FROM_HAS_DN(0.00)[]; DWL_DNSWL_NONE(0.00)[gmail.com:dkim]; TO_MATCH_ENVRCPT_ALL(0.00)[]; MIME_GOOD(-0.10)[multipart/alternative,text/plain]; SPAMHAUS_ZRD(0.00)[2a00:1450:4864:20::52f:from:127.0.2.255]; RCVD_IN_DNSWL_NONE(0.00)[2a00:1450:4864:20::52f:from]; RCVD_TLS_ALL(0.00)[]; MAILMAN_DEST(0.00)[freebsd-virtualization,freebsd-arm] Content-Type: text/plain; charset=us-ascii Content-Transfer-Encoding: 7bit X-Content-Filtered-By: Mailman/MimeDel 2.1.34 X-BeenThere: freebsd-arm@freebsd.org X-Mailman-Version: 2.1.34 Precedence: list List-Id: "Porting FreeBSD to ARM processors." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 06 Nov 2020 16:56:55 -0000 Hello, The UPB team made a revision for the bhyve on arm/arm64 on phabricator[1]. Any feedback is greatly appreciated. [1] https://reviews.freebsd.org/D26976 Thanks, Andrei From owner-freebsd-arm@freebsd.org Sat Nov 7 10:57:38 2020 Return-Path: Delivered-To: freebsd-arm@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 302222EC4CF for ; Sat, 7 Nov 2020 10:57:38 +0000 (UTC) (envelope-from freebsd-arm@dino.sk) Received: from mailhost.netlabit.sk (mailhost.netlabit.sk [84.245.65.72]) (using TLSv1 with cipher DHE-RSA-CAMELLIA256-SHA (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4CSvNc6Jlgz4g7g for ; Sat, 7 Nov 2020 10:57:36 +0000 (UTC) (envelope-from freebsd-arm@dino.sk) Received: from zeta.dino.sk (fw3.dino.sk [84.245.95.254]) (AUTH: LOGIN milan) by mailhost.netlabit.sk with ESMTPA; Sat, 07 Nov 2020 11:57:28 +0100 id 00C2C801.5FA67D98.000183CC Date: Sat, 7 Nov 2020 11:57:22 +0100 From: Milan Obuch To: freebsd-arm@freebsd.org Subject: FreeBSD/RockPro64 experience Message-ID: <20201107115722.38effe4e@zeta.dino.sk> X-Mailer: Claws Mail 3.17.7 (GTK+ 2.24.32; i386-portbld-freebsd11.4) MIME-Version: 1.0 Content-Type: text/plain; charset=US-ASCII Content-Transfer-Encoding: 7bit X-Rspamd-Queue-Id: 4CSvNc6Jlgz4g7g X-Spamd-Bar: - Authentication-Results: mx1.freebsd.org; dkim=none; dmarc=none; spf=pass (mx1.freebsd.org: domain of freebsd-arm@dino.sk designates 84.245.65.72 as permitted sender) smtp.mailfrom=freebsd-arm@dino.sk X-Spamd-Result: default: False [-1.30 / 15.00]; RCVD_VIA_SMTP_AUTH(0.00)[]; RBL_DBL_DONT_QUERY_IPS(0.00)[84.245.65.72:from]; ARC_NA(0.00)[]; FROM_HAS_DN(0.00)[]; TO_MATCH_ENVRCPT_ALL(0.00)[]; R_SPF_ALLOW(-0.20)[+mx]; MIME_GOOD(-0.10)[text/plain]; TO_DN_NONE(0.00)[]; DMARC_NA(0.00)[dino.sk]; RCPT_COUNT_ONE(0.00)[1]; SPAMHAUS_ZRD(0.00)[84.245.65.72:from:127.0.2.255]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; NEURAL_SPAM_SHORT(1.00)[1.000]; NEURAL_HAM_LONG(-1.00)[-1.000]; FROM_EQ_ENVFROM(0.00)[]; RCVD_TLS_LAST(0.00)[]; R_DKIM_NA(0.00)[]; ASN(0.00)[asn:16160, ipnet:84.245.64.0/18, country:SK]; MIME_TRACE(0.00)[0:+]; MAILMAN_DEST(0.00)[freebsd-arm]; RCVD_COUNT_TWO(0.00)[2] X-BeenThere: freebsd-arm@freebsd.org X-Mailman-Version: 2.1.34 Precedence: list List-Id: "Porting FreeBSD to ARM processors." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 07 Nov 2020 10:57:38 -0000 Hi, today I had an opportunity to check $subject configuration for a while. I downloaded from ftp.freebsd.org file I put on uSD card - FreeBSD-13.0-CURRENT-arm64-aarch64-ROCKPRO64-20201029-b9403d7aae8.img Using serial console, I was able to see the whole boot process, just one small observation - at the beginning, there is short notice from BL31: NOTICE: BL31: v2.3(): NOTICE: BL31: Built : 06:52:32, Oct 29 2020 which is sent over wire at 115200 bps (or 115.2 kpbs if you prefer), then speed is switched to 1500000 bps (or 1.5 Mbps, put the other way). First lines: U-Boot TPL 2020.07 (Oct 29 2020 - 06:56:20) Channel 0: LPDDR4, 50MHz BW=32 Col=10 Bk=8 CS0 Row=16/15 CS=1 Die BW=16 Size=2048MB Channel 1: LPDDR4, 50MHz BW=32 Col=10 Bk=8 CS0 Row=16/15 CS=1 Die BW=16 Size=2048MB 256B stride 256B stride lpddr4_set_rate: change freq to 400000000 mhz 0, 1 lpddr4_set_rate: change freq to 800000000 mhz 1, 0 Trying to boot from BOOTROM Returning to boot ROM... It looks to me this BL31 notice is put there only on power up, but I still think it would be better if speed is not switched. Other than that, this board looks working quite well out of the box, just suitable uSD card needs to be put in. Regards, Milan From owner-freebsd-arm@freebsd.org Sat Nov 7 11:44:41 2020 Return-Path: Delivered-To: freebsd-arm@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 7C3F82ED282 for ; Sat, 7 Nov 2020 11:44:41 +0000 (UTC) (envelope-from hlh@restart.be) Received: from tignes.restart.be (tignes.restart.be [37.187.123.11]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "tignes.restart.be", Issuer "CA master" (not verified)) by mx1.freebsd.org (Postfix) with ESMTPS id 4CSwQv4wxbz4jmn for ; Sat, 7 Nov 2020 11:44:39 +0000 (UTC) (envelope-from hlh@restart.be) X-Comment: SPF check N/A for local connections - client-ip=192.168.25.127; helo=restart.be; envelope-from=hlh@restart.be; receiver= DKIM-Filter: OpenDKIM Filter v2.10.3 tignes.restart.be 4CSwQl5WFYzf Received: from restart.be (norquay.tunnel.bel [192.168.25.127]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (2048 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.restart.be", Issuer "CA master" (verified OK)) by tignes.restart.be (Postfix) with ESMTPS id 4CSwQl5WFYzf; Sat, 7 Nov 2020 12:44:30 +0100 (CET) Received: from morzine.restart.bel (morzine.restart.be [IPv6:2001:41d0:a:f40b:1:1:0:1]) (authenticated bits=0) by restart.be (8.16.1/8.16.1) with ESMTPSA id 0A7BiQDe068833 (version=TLSv1.3 cipher=TLS_AES_128_GCM_SHA256 bits=128 verify=OK); Sat, 7 Nov 2020 12:44:29 +0100 (CET) (envelope-from hlh@restart.be) X-Authentication-Warning: norquay.restart.bel: Host morzine.restart.be [IPv6:2001:41d0:a:f40b:1:1:0:1] claimed to be morzine.restart.bel Subject: Re: FreeBSD/RockPro64 experience To: Milan Obuch , freebsd-arm@freebsd.org References: <20201107115722.38effe4e@zeta.dino.sk> From: Henri Hennebert Message-ID: <41a6844e-1da3-c906-3775-045fb93a61bd@restart.be> Date: Sat, 7 Nov 2020 12:44:26 +0100 User-Agent: Mozilla/5.0 (X11; FreeBSD amd64; rv:78.0) Gecko/20100101 Thunderbird/78.4.0 MIME-Version: 1.0 In-Reply-To: <20201107115722.38effe4e@zeta.dino.sk> Content-Type: text/plain; charset=windows-1252; format=flowed Content-Language: en-US Content-Transfer-Encoding: 7bit X-Rspamd-Queue-Id: 4CSwQv4wxbz4jmn X-Spamd-Bar: -- X-Spamd-Result: default: False [-2.00 / 15.00]; RCVD_VIA_SMTP_AUTH(0.00)[]; ARC_NA(0.00)[]; R_DKIM_ALLOW(-0.20)[restart.be:s=tignes]; MID_RHS_MATCH_FROM(0.00)[]; FROM_HAS_DN(0.00)[]; TO_DN_SOME(0.00)[]; R_SPF_ALLOW(-0.20)[+ip4:37.187.123.11/32]; NEURAL_HAM_LONG(-1.00)[-1.000]; MIME_GOOD(-0.10)[text/plain]; HAS_XAW(0.00)[]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; NEURAL_SPAM_SHORT(1.00)[1.000]; SPAMHAUS_ZRD(0.00)[37.187.123.11:from:127.0.2.255]; RCVD_COUNT_THREE(0.00)[3]; TO_MATCH_ENVRCPT_SOME(0.00)[]; DKIM_TRACE(0.00)[restart.be:+]; RCPT_COUNT_TWO(0.00)[2]; DMARC_POLICY_ALLOW(-0.50)[restart.be,reject]; FROM_EQ_ENVFROM(0.00)[]; MIME_TRACE(0.00)[0:+]; RBL_DBL_DONT_QUERY_IPS(0.00)[37.187.123.11:from]; ASN(0.00)[asn:16276, ipnet:37.187.0.0/16, country:FR]; RCVD_TLS_ALL(0.00)[]; MAILMAN_DEST(0.00)[freebsd-arm] X-BeenThere: freebsd-arm@freebsd.org X-Mailman-Version: 2.1.34 Precedence: list List-Id: "Porting FreeBSD to ARM processors." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 07 Nov 2020 11:44:41 -0000 On 11/7/20 11:57 AM, Milan Obuch wrote: > Hi, > > today I had an opportunity to check $subject configuration for a while. > I downloaded from ftp.freebsd.org file I put on uSD card - > FreeBSD-13.0-CURRENT-arm64-aarch64-ROCKPRO64-20201029-b9403d7aae8.img > > Using serial console, I was able to see the whole boot process, just > one small observation - at the beginning, there is short notice from > BL31: > > NOTICE: BL31: v2.3(): > NOTICE: BL31: Built : 06:52:32, Oct 29 2020 > > which is sent over wire at 115200 bps (or 115.2 kpbs if you prefer), > then speed is switched to 1500000 bps (or 1.5 Mbps, put the other way). To solve this I add this file in /usr/ports/sysutils/u-boot-master/files cat patch-configs_rockpro64-rk3399_defconfig --- configs/rockpro64-rk3399_defconfig 2020-04-13 17:02:18.000000000 +0200 +++ configs/rockpro64-rk3399_defconfig.orig 2020-04-27 15:39:12.866611000 +0200 @@ -52,7 +52,7 @@ CONFIG_PWM_ROCKCHIP=y CONFIG_RAM_RK3399_LPDDR4=y CONFIG_DM_RESET=y -CONFIG_BAUDRATE=1500000 +CONFIG_BAUDRATE=115200 CONFIG_DEBUG_UART_SHIFT=2 CONFIG_ROCKCHIP_SPI=y CONFIG_SYSRESET=y And rebuild /usr/ports/sysutils/u-boot-rockpro64 Henri > > First lines: > > U-Boot TPL 2020.07 (Oct 29 2020 - 06:56:20) > Channel 0: LPDDR4, 50MHz > BW=32 Col=10 Bk=8 CS0 Row=16/15 CS=1 Die BW=16 Size=2048MB > Channel 1: LPDDR4, 50MHz > BW=32 Col=10 Bk=8 CS0 Row=16/15 CS=1 Die BW=16 Size=2048MB > 256B stride > 256B stride > lpddr4_set_rate: change freq to 400000000 mhz 0, 1 > lpddr4_set_rate: change freq to 800000000 mhz 1, 0 > Trying to boot from BOOTROM > Returning to boot ROM... > > It looks to me this BL31 notice is put there only on power up, but I > still think it would be better if speed is not switched. Other than > that, this board looks working quite well out of the box, just suitable > uSD card needs to be put in. > > Regards, > Milan > _______________________________________________ > freebsd-arm@freebsd.org mailing list > https://lists.freebsd.org/mailman/listinfo/freebsd-arm > To unsubscribe, send any mail to "freebsd-arm-unsubscribe@freebsd.org" > From owner-freebsd-arm@freebsd.org Sat Nov 7 17:03:32 2020 Return-Path: Delivered-To: freebsd-arm@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id B151E465485 for ; Sat, 7 Nov 2020 17:03:32 +0000 (UTC) (envelope-from freebsd-arm@dino.sk) Received: from mailhost.netlabit.sk (mailhost.netlabit.sk [84.245.65.72]) (using TLSv1 with cipher DHE-RSA-CAMELLIA256-SHA (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4CT3Vq4WBXz3Kb0 for ; Sat, 7 Nov 2020 17:03:31 +0000 (UTC) (envelope-from freebsd-arm@dino.sk) Received: from zeta.dino.sk (fw3.dino.sk [84.245.95.254]) (AUTH: LOGIN milan) by mailhost.netlabit.sk with ESMTPA; Sat, 07 Nov 2020 18:03:28 +0100 id 003E897B.5FA6D360.00002621 Date: Sat, 7 Nov 2020 18:03:26 +0100 From: Milan Obuch To: Henri Hennebert Cc: freebsd-arm@freebsd.org Subject: Re: FreeBSD/RockPro64 experience Message-ID: <20201107180326.0713999d@zeta.dino.sk> In-Reply-To: <41a6844e-1da3-c906-3775-045fb93a61bd@restart.be> References: <20201107115722.38effe4e@zeta.dino.sk> <41a6844e-1da3-c906-3775-045fb93a61bd@restart.be> X-Mailer: Claws Mail 3.17.7 (GTK+ 2.24.32; i386-portbld-freebsd11.4) MIME-Version: 1.0 Content-Type: text/plain; charset=US-ASCII Content-Transfer-Encoding: 7bit X-Rspamd-Queue-Id: 4CT3Vq4WBXz3Kb0 X-Spamd-Bar: --- Authentication-Results: mx1.freebsd.org; dkim=none; dmarc=none; spf=pass (mx1.freebsd.org: domain of freebsd-arm@dino.sk designates 84.245.65.72 as permitted sender) smtp.mailfrom=freebsd-arm@dino.sk X-Spamd-Result: default: False [-3.24 / 15.00]; RCVD_VIA_SMTP_AUTH(0.00)[]; ARC_NA(0.00)[]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; FROM_HAS_DN(0.00)[]; TO_DN_SOME(0.00)[]; R_SPF_ALLOW(-0.20)[+mx]; NEURAL_HAM_LONG(-1.00)[-1.000]; MIME_GOOD(-0.10)[text/plain]; DMARC_NA(0.00)[dino.sk]; RBL_DBL_DONT_QUERY_IPS(0.00)[84.245.65.72:from]; SPAMHAUS_ZRD(0.00)[84.245.65.72:from:127.0.2.255]; TO_MATCH_ENVRCPT_SOME(0.00)[]; NEURAL_HAM_SHORT(-0.94)[-0.945]; RCPT_COUNT_TWO(0.00)[2]; FROM_EQ_ENVFROM(0.00)[]; RCVD_TLS_LAST(0.00)[]; R_DKIM_NA(0.00)[]; ASN(0.00)[asn:16160, ipnet:84.245.64.0/18, country:SK]; MIME_TRACE(0.00)[0:+]; MAILMAN_DEST(0.00)[freebsd-arm]; RCVD_COUNT_TWO(0.00)[2] X-BeenThere: freebsd-arm@freebsd.org X-Mailman-Version: 2.1.34 Precedence: list List-Id: "Porting FreeBSD to ARM processors." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 07 Nov 2020 17:03:32 -0000 On Sat, 7 Nov 2020 12:44:26 +0100, Henri Hennebert wrote: > On 11/7/20 11:57 AM, Milan Obuch wrote: > > Hi, > > > > today I had an opportunity to check $subject configuration for a > > while. I downloaded from ftp.freebsd.org file I put on uSD card - > > FreeBSD-13.0-CURRENT-arm64-aarch64-ROCKPRO64-20201029-b9403d7aae8.img > > > > Using serial console, I was able to see the whole boot process, just > > one small observation - at the beginning, there is short notice from > > BL31: > > > > NOTICE: BL31: v2.3(): > > NOTICE: BL31: Built : 06:52:32, Oct 29 2020 > > > > which is sent over wire at 115200 bps (or 115.2 kpbs if you prefer), > > then speed is switched to 1500000 bps (or 1.5 Mbps, put the other > > way). > > To solve this I add this file in > /usr/ports/sysutils/u-boot-master/files > > cat patch-configs_rockpro64-rk3399_defconfig > --- configs/rockpro64-rk3399_defconfig 2020-04-13 > 17:02:18.000000000 +0200 +++ > configs/rockpro64-rk3399_defconfig.orig 2020-04-27 > 15:39:12.866611000 +0200 @@ -52,7 +52,7 @@ CONFIG_PWM_ROCKCHIP=y > CONFIG_RAM_RK3399_LPDDR4=y > CONFIG_DM_RESET=y > -CONFIG_BAUDRATE=1500000 > +CONFIG_BAUDRATE=115200 > CONFIG_DEBUG_UART_SHIFT=2 > CONFIG_ROCKCHIP_SPI=y > CONFIG_SYSRESET=y > > And rebuild /usr/ports/sysutils/u-boot-rockpro64 > > Henri > I did not investigate more as I can not test it any longer, but proposed solution is good for me. Regards, Milan From owner-freebsd-arm@freebsd.org Sat Nov 7 19:01:58 2020 Return-Path: Delivered-To: freebsd-arm@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id E95A646798C for ; Sat, 7 Nov 2020 19:01:58 +0000 (UTC) (envelope-from manu@bidouilliste.com) Received: from mx.blih.net (mx.blih.net [212.83.155.74]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "mx.blih.net", Issuer "Let's Encrypt Authority X3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4CT67T5zVQz3RJK for ; Sat, 7 Nov 2020 19:01:57 +0000 (UTC) (envelope-from manu@bidouilliste.com) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=bidouilliste.com; s=mx; t=1604775710; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=tFcQYGjfDNvuf0TtcSjUK8NtuBlE9U4nD3etjDWljgw=; b=Ic4hAMd2R8Qu3Lu2sYH9ghrLLvJsT4lzBy7ponZAAjrr2bGcvhZi44kI1tMCMhMwpEjZGR PdgTORXVjLthTvJ/ZBDYQsTGOnLKHYHr8ByqvqaT8lsdVjYQC8+tYEF8hPjimZRqP2K5fd LcaFgA06agyBUI6tB/HYaUjZ72ApZ+g= Received: from skull.home.blih.net (lfbn-idf2-1-288-247.w82-123.abo.wanadoo.fr [82.123.126.247]) by mx.blih.net (OpenSMTPD) with ESMTPSA id 6aee6f19 (TLSv1.3:TLS_AES_256_GCM_SHA384:256:NO); Sat, 7 Nov 2020 19:01:50 +0000 (UTC) Date: Sat, 7 Nov 2020 20:01:49 +0100 From: Emmanuel Vadot To: Guy Yur Cc: freebsd-arm@freebsd.org Subject: Re: u-boot 2020.07 fails to see BOOTARM.EFI on fat partition with custom installation Message-Id: <20201107200149.09adb38e8b29687e4e012074@bidouilliste.com> In-Reply-To: <20201101214254.149936656f5cea099c85eb9c@bidouilliste.com> References: <18d7b209-959e-7c4b-1d5e-1c7b9506783c@gmail.com> <20201101214254.149936656f5cea099c85eb9c@bidouilliste.com> X-Mailer: Sylpheed 3.7.0 (GTK+ 2.24.32; amd64-portbld-freebsd13.0) Mime-Version: 1.0 Content-Type: text/plain; charset=ISO-8859-1 Content-Transfer-Encoding: quoted-printable X-Rspamd-Queue-Id: 4CT67T5zVQz3RJK X-Spamd-Bar: --- Authentication-Results: mx1.freebsd.org; dkim=pass header.d=bidouilliste.com header.s=mx header.b=Ic4hAMd2; dmarc=pass (policy=none) header.from=bidouilliste.com; spf=pass (mx1.freebsd.org: domain of manu@bidouilliste.com designates 212.83.155.74 as permitted sender) smtp.mailfrom=manu@bidouilliste.com X-Spamd-Result: default: False [-3.50 / 15.00]; RCVD_VIA_SMTP_AUTH(0.00)[]; TO_DN_SOME(0.00)[]; MV_CASE(0.50)[]; R_SPF_ALLOW(-0.20)[+mx]; DKIM_TRACE(0.00)[bidouilliste.com:+]; RCPT_COUNT_TWO(0.00)[2]; DMARC_POLICY_ALLOW(-0.50)[bidouilliste.com,none]; NEURAL_HAM_SHORT(-1.00)[-0.999]; FREEMAIL_TO(0.00)[gmail.com]; FROM_EQ_ENVFROM(0.00)[]; MIME_TRACE(0.00)[0:+]; RBL_DBL_DONT_QUERY_IPS(0.00)[212.83.155.74:from]; ASN(0.00)[asn:12876, ipnet:212.83.128.0/19, country:FR]; MID_RHS_MATCH_FROM(0.00)[]; ARC_NA(0.00)[]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; R_DKIM_ALLOW(-0.20)[bidouilliste.com:s=mx]; FREEFALL_USER(0.00)[manu]; FROM_HAS_DN(0.00)[]; NEURAL_HAM_LONG(-1.00)[-1.000]; MIME_GOOD(-0.10)[text/plain]; SPAMHAUS_ZRD(0.00)[212.83.155.74:from:127.0.2.255]; TO_MATCH_ENVRCPT_SOME(0.00)[]; RCVD_COUNT_TWO(0.00)[2]; RCVD_TLS_ALL(0.00)[]; MAILMAN_DEST(0.00)[freebsd-arm] X-BeenThere: freebsd-arm@freebsd.org X-Mailman-Version: 2.1.34 Precedence: list List-Id: "Porting FreeBSD to ARM processors." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 07 Nov 2020 19:01:59 -0000 On Sun, 1 Nov 2020 21:42:54 +0100 Emmanuel Vadot wrote: > On Sun, 1 Nov 2020 21:25:12 +0200 > Guy Yur wrote: >=20 > > Hi, > >=20 > > u-boot 2020.01 through 2020.07 have a regression where u-boot only sees > > shortname files on the fat filesystem if they have the archive attribut= e=20 > > set. > >=20 > > The issue was fixed in u-boot 2020.10: > > https://github.com/u-boot/u-boot/commit/1788a9697f51aebb25623e6216c0930= 4756748ff > >=20 > > Are there plans to update u-boot-master port to 2020.10? >=20 > Yes, I have the update ready but this broke a few things in the > rockpro64 port. I'll backport the fix next week if I didn't find time > to fix everything else needed for the 2020.10 update. >=20 > Thanks for the report. >=20 > > The issue doesn't affect images created by makefs which sets the flag. > > When doing custom steps (newfs_msdos, mount, copy loader.efi to > > EFI/BOOT/BOOTARM.EFI and umount),if the source file is on UFS, > > the target file will not have UF_ARCHIVE set. > > u-boot will fail to see BOOTARM.EFI and the system will not boot. > >=20 > > Specifically, this happened to me with u-boot-orangepi-pc. > >=20 > > 0040c440=A0 42 4f 4f 54 41 52 4d 20=A0 45 46 49 00 00 83 d3 9e |BOOTARM= =20 > > EFI.....| > > 0040c450=A0 5f 51 5f 51 00 00 d3 9e=A0 5f 51 8f 00 a8 a7 08 00=A0=20 > > |_Q_Q...._Q......| > >=20 > > Thanks, > > Guy Yur > >=20 > > _______________________________________________ > > freebsd-arm@freebsd.org mailing list > > https://lists.freebsd.org/mailman/listinfo/freebsd-arm > > To unsubscribe, send any mail to "freebsd-arm-unsubscribe@freebsd.org" Just commited 2020.10, let me know if you have any problems. Thanks, --=20 Emmanuel Vadot From owner-freebsd-arm@freebsd.org Sat Nov 7 22:51:45 2020 Return-Path: Delivered-To: freebsd-arm@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id A246A2D3CBE for ; Sat, 7 Nov 2020 22:51:45 +0000 (UTC) (envelope-from guyyur@gmail.com) Received: from mail-lj1-x231.google.com (mail-lj1-x231.google.com [IPv6:2a00:1450:4864:20::231]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "GTS CA 1O1" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4CTCDc6W47z3tfF for ; Sat, 7 Nov 2020 22:51:44 +0000 (UTC) (envelope-from guyyur@gmail.com) Received: by mail-lj1-x231.google.com with SMTP id t13so5521705ljk.12 for ; Sat, 07 Nov 2020 14:51:44 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=mime-version:references:in-reply-to:from:date:message-id:subject:to :cc; bh=jAkJPK5EgW2MPtC00SlJ+BpRBZN6hh7LuJBS/d1YdYs=; b=TdZdIHEUn8PiTi4sKf8ZbZo76XrXiP1PSCwvyNAxds67OrTFtJllR6QVI72U9kGbWP Jg3m0syX6TPxQ57y6GvwYQnUB+ynlqctlJgsDIPph27ah/dr3ADtzxucYMXl3NdrQ5Db emeKv+W9RD7kXBR985V7cojZhUTALFNZWeMdjhKgIHLMtTGP3r1qvNqIjTR/VrUUIwtO ThlCfwAvCFlooI/uHcw06xnS4AoyCbYRJ5KL7lKx4uPJzb6fD+p/c8pnJndslm360ZRI XHZFi2Ri985eLqsS3CCXF6wlZg5vAFftKNqrnJTuwr/6PsIWjZlIV9+XyY17w8gRSiS6 XQJA== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:references:in-reply-to:from:date :message-id:subject:to:cc; bh=jAkJPK5EgW2MPtC00SlJ+BpRBZN6hh7LuJBS/d1YdYs=; b=Ic+F+JvBr2cnFSA42BKrx9gg1LhjKLd7oLbNphP+73kS+rK2PsKycNAY2VSKB74B9W aPyyvuE/UTC53vJ0z+AEl4cqeVFUhB0Trf6Mrr5kcqUvEPb/aFaekvOaKDi22WUUBOg4 gJOcGYW0lUnY4imW2RyJEjJxXji20lJ9N5vcEe1EhI0j0s0JsbTQ8zighMB63oxE5StV eubpqqXlrtPuBAz+1X9w7prFLt3NouI2jITCKKcNt6FAcg4u0aIl0e3T+JjQldIwrZo3 BBG4fKX/vK0gvRgH8n2Zj9thXmxwT/BxJsvPEG7tPhg+f+l4p2EDN+XqIw1jTKVr2ZMq OqDw== X-Gm-Message-State: AOAM531jnq9H2EsL7cGVSK0tbPC1s+K+T36yEKaKUm+MbknfGMAW0R/U UHzybro4fBeg4vU0ShDXv56eiID0RYuXMnFNGRUYh2i2dxM/Bw== X-Google-Smtp-Source: ABdhPJz9Y5TstJRjLD2JpvbZUi12K4+SJ6GQY+HZ1w67U5a24zHS1L3YVOe3UAuRQdp8SEfTlY8beQeJpNl2UPeaR8A= X-Received: by 2002:a2e:6f13:: with SMTP id k19mr1292758ljc.74.1604789502411; Sat, 07 Nov 2020 14:51:42 -0800 (PST) MIME-Version: 1.0 References: <18d7b209-959e-7c4b-1d5e-1c7b9506783c@gmail.com> <20201101214254.149936656f5cea099c85eb9c@bidouilliste.com> <20201107200149.09adb38e8b29687e4e012074@bidouilliste.com> In-Reply-To: <20201107200149.09adb38e8b29687e4e012074@bidouilliste.com> From: Guy Yur Date: Sun, 8 Nov 2020 00:51:31 +0200 Message-ID: Subject: Re: u-boot 2020.07 fails to see BOOTARM.EFI on fat partition with custom installation To: Emmanuel Vadot Cc: freebsd-arm Content-Type: text/plain; charset="UTF-8" X-Rspamd-Queue-Id: 4CTCDc6W47z3tfF X-Spamd-Bar: --- Authentication-Results: mx1.freebsd.org; dkim=pass header.d=gmail.com header.s=20161025 header.b=TdZdIHEU; dmarc=pass (policy=none) header.from=gmail.com; spf=pass (mx1.freebsd.org: domain of guyyur@gmail.com designates 2a00:1450:4864:20::231 as permitted sender) smtp.mailfrom=guyyur@gmail.com X-Spamd-Result: default: False [-4.00 / 15.00]; R_SPF_ALLOW(-0.20)[+ip6:2a00:1450:4000::/36:c]; FREEMAIL_FROM(0.00)[gmail.com]; TO_DN_ALL(0.00)[]; DKIM_TRACE(0.00)[gmail.com:+]; RCPT_COUNT_TWO(0.00)[2]; DMARC_POLICY_ALLOW(-0.50)[gmail.com,none]; NEURAL_HAM_SHORT(-1.00)[-0.998]; FROM_EQ_ENVFROM(0.00)[]; MIME_TRACE(0.00)[0:+]; RBL_DBL_DONT_QUERY_IPS(0.00)[2a00:1450:4864:20::231:from]; FREEMAIL_ENVFROM(0.00)[gmail.com]; ASN(0.00)[asn:15169, ipnet:2a00:1450::/32, country:US]; DWL_DNSWL_NONE(0.00)[gmail.com:dkim]; ARC_NA(0.00)[]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; R_DKIM_ALLOW(-0.20)[gmail.com:s=20161025]; FROM_HAS_DN(0.00)[]; NEURAL_HAM_LONG(-1.00)[-1.000]; MIME_GOOD(-0.10)[text/plain]; PREVIOUSLY_DELIVERED(0.00)[freebsd-arm@freebsd.org]; SPAMHAUS_ZRD(0.00)[2a00:1450:4864:20::231:from:127.0.2.255]; TO_MATCH_ENVRCPT_SOME(0.00)[]; RCVD_IN_DNSWL_NONE(0.00)[2a00:1450:4864:20::231:from]; RCVD_COUNT_TWO(0.00)[2]; RCVD_TLS_ALL(0.00)[]; MAILMAN_DEST(0.00)[freebsd-arm] X-BeenThere: freebsd-arm@freebsd.org X-Mailman-Version: 2.1.34 Precedence: list List-Id: "Porting FreeBSD to ARM processors." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 07 Nov 2020 22:51:45 -0000 On Sat, Nov 7, 2020 at 9:01 PM Emmanuel Vadot wrote: > > On Sun, 1 Nov 2020 21:42:54 +0100 > Emmanuel Vadot wrote: > > > On Sun, 1 Nov 2020 21:25:12 +0200 > > Guy Yur wrote: > > > > > ... > > > > ... > > Just commited 2020.10, let me know if you have any problems. > > Thanks, > > -- > Emmanuel Vadot Hi, Tested 2020.10 on Orange Pi PC (u-boot on sd card) and Orange Pi PC 2 (u-boot on SPI). Both booted without problems. Thanks, Guy Yur