From nobody Mon Aug 23 19:18:49 2021 X-Original-To: freebsd-current@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id A02C81780869 for ; Mon, 23 Aug 2021 19:18:53 +0000 (UTC) (envelope-from grahamperrin@gmail.com) Received: from mail-wm1-x332.google.com (mail-wm1-x332.google.com [IPv6:2a00:1450:4864:20::332]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "GTS CA 1O1" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4Gthqc4VBGz3MSp for ; Mon, 23 Aug 2021 19:18:52 +0000 (UTC) (envelope-from grahamperrin@gmail.com) Received: by mail-wm1-x332.google.com with SMTP id g138so11222255wmg.4 for ; Mon, 23 Aug 2021 12:18:52 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=to:from:subject:message-id:date:user-agent:mime-version :content-transfer-encoding:content-language; bh=OnonCGiwr2lD+vpmf1R1dENOYtE43/L+bbb9l8qmBGI=; b=tyL+viDrB91GM0iYrc+2Nd2kybnQp5XifgoTOyyU58qSUhuIonR1hc+TwTqsNcapAp a8oiNn+tyBEf9J6VSY/si0h4sSmePONOUNS5sNV4irkOmrZVJ5/Nrz5C5AtrZsr/MOGa HF4inecANdRbklf1C3tNl11DFPgHezjwS27Zlwcgjygc5hPNHMTfBuwiKaRhkAuhdOxh VrI4iCWnx7Pym29YnVBvfyAWlNdiSifoY5GTEg0SKGb+Reumaa6ZYbjxbrlz1bh5JPJ8 fCDaSmRvfvZQPTBj7DqH4xeRXlf2wp2a991UOe49yVGPc4QiKYQeKxinmgHROl48ECcu PLtg== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:to:from:subject:message-id:date:user-agent :mime-version:content-transfer-encoding:content-language; bh=OnonCGiwr2lD+vpmf1R1dENOYtE43/L+bbb9l8qmBGI=; b=LetY3QHRyMEeS5cIO2WbHFE/v8lEa4uKMb8AiWjngSjSQd8DcLne8OqeZWiDlVq8RM cx4+ASBk8MBsMz4qXkBE/pE2oqKWi2QoML/6+XJFUTLcAm9StV4s+wNTzbvuHnegfK7u FoMWax8U3FikT0swEz+Xy6GFtAbbEmWIkwPkZDfEkzsKaLfa/aF+wTYD4Agw1Ite7v1R 7gY42YHwn0oIiV+GhnVH6rHhNoXqvmJC808csD/tx8DYFvbi/KY/nelhO8rUXbL8dtHT JAqkZCjzyWCManP7JIsl4QmuInFfQ1W5lYVSPasWut50WIEHE1Wa34MiMMpMDuA1gass 2+dw== X-Gm-Message-State: AOAM531+9TMuycPoj/oGJEsZfLY+/7UJ9vERBdqZcs+sHDOgvlCsemB0 h+uyinLcZR/WAjl3zTYCv6jMJaSD/Le+Yw== X-Google-Smtp-Source: ABdhPJy2GwoHpZi3SnpqI013sAy4fzPN3SeTrmQt46AzVNiH6j9L3CdxicmaBbztLgkZT0J1Ry0WFw== X-Received: by 2002:a1c:1dcc:: with SMTP id d195mr111675wmd.85.1629746331357; Mon, 23 Aug 2021 12:18:51 -0700 (PDT) Received: from ?IPv6:2001:470:1f1c:a0::2? (tunnel642390-pt.tunnel.tserv1.lon2.ipv6.he.net. [2001:470:1f1c:a0::2]) by smtp.gmail.com with ESMTPSA id u5sm15629672wrr.94.2021.08.23.12.18.50 for (version=TLS1_3 cipher=TLS_AES_128_GCM_SHA256 bits=128/128); Mon, 23 Aug 2021 12:18:50 -0700 (PDT) To: FreeBSD CURRENT From: Graham Perrin Subject: rescue/sh check failed, installation aborted Message-ID: <0577ca44-86c2-d54c-33b7-c7174632e569@gmail.com> Date: Mon, 23 Aug 2021 20:18:49 +0100 User-Agent: Mozilla/5.0 (X11; FreeBSD amd64; rv:78.0) Gecko/20100101 Thunderbird/78.13.0 List-Id: Discussions about the use of FreeBSD-current List-Archive: https://lists.freebsd.org/archives/freebsd-current List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-current@freebsd.org MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8; format=flowed Content-Transfer-Encoding: 8bit Content-Language: en-GB X-Rspamd-Queue-Id: 4Gthqc4VBGz3MSp X-Spamd-Bar: -- Authentication-Results: mx1.freebsd.org; dkim=pass header.d=gmail.com header.s=20161025 header.b=tyL+viDr; dmarc=pass (policy=none) header.from=gmail.com; spf=pass (mx1.freebsd.org: domain of grahamperrin@gmail.com designates 2a00:1450:4864:20::332 as permitted sender) smtp.mailfrom=grahamperrin@gmail.com X-Spamd-Result: default: False [-2.09 / 15.00]; ARC_NA(0.00)[]; RCVD_VIA_SMTP_AUTH(0.00)[]; R_DKIM_ALLOW(-0.20)[gmail.com:s=20161025]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; FROM_HAS_DN(0.00)[]; R_SPF_ALLOW(-0.20)[+ip6:2a00:1450:4000::/36:c]; FREEMAIL_FROM(0.00)[gmail.com]; MIME_GOOD(-0.10)[text/plain]; PREVIOUSLY_DELIVERED(0.00)[freebsd-current@freebsd.org]; RCPT_COUNT_ONE(0.00)[1]; RCVD_COUNT_THREE(0.00)[3]; TO_DN_ALL(0.00)[]; DKIM_TRACE(0.00)[gmail.com:+]; DMARC_POLICY_ALLOW(-0.50)[gmail.com,none]; RCVD_IN_DNSWL_NONE(0.00)[2a00:1450:4864:20::332:from]; NEURAL_HAM_SHORT(-1.00)[-1.000]; TO_MATCH_ENVRCPT_ALL(0.00)[]; NEURAL_SPAM_LONG(0.91)[0.912]; FROM_EQ_ENVFROM(0.00)[]; MIME_TRACE(0.00)[0:+]; FREEMAIL_ENVFROM(0.00)[gmail.com]; ASN(0.00)[asn:15169, ipnet:2a00:1450::/32, country:US]; RCVD_TLS_ALL(0.00)[]; MID_RHS_MATCH_FROM(0.00)[]; DWL_DNSWL_NONE(0.00)[gmail.com:dkim] X-ThisMailContainsUnwantedMimeParts: N Encountered whilst attempting to build and install 14.0-CURRENT over 13.0-RELEASE-p3 (experimental, helloSystem): Background, condensed, to the best of my recollection: cd /usr/src make buildworld    # succeeded make kernel    # failed make clean LOCAL_MODULES=    # added to /etc/src.conf make kernel-toolchain make kernel restarted in single user mode mount -uw / service zfs start cd /usr/src make installworld – failed as pictured. I see , fixed in 2018. Any suggestions? TIA From nobody Mon Aug 23 21:26:57 2021 X-Original-To: freebsd-current@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id F16581791A34 for ; Mon, 23 Aug 2021 21:27:00 +0000 (UTC) (envelope-from jhb@FreeBSD.org) Received: from smtp.freebsd.org (smtp.freebsd.org [IPv6:2610:1c1:1:606c::24b:4]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "smtp.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4GtlgS6Wvvz4nx5; Mon, 23 Aug 2021 21:27:00 +0000 (UTC) (envelope-from jhb@FreeBSD.org) Received: from John-Baldwins-MacBook-Pro.local (ralph.baldwin.cx [66.234.199.215]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client did not present a certificate) (Authenticated sender: jhb) by smtp.freebsd.org (Postfix) with ESMTPSA id 7C5552134A; Mon, 23 Aug 2021 21:27:00 +0000 (UTC) (envelope-from jhb@FreeBSD.org) Subject: Re: rescue/sh check failed, installation aborted To: Graham Perrin , FreeBSD CURRENT References: <0577ca44-86c2-d54c-33b7-c7174632e569@gmail.com> From: John Baldwin Message-ID: Date: Mon, 23 Aug 2021 14:26:57 -0700 User-Agent: Mozilla/5.0 (Macintosh; Intel Mac OS X 10.14; rv:78.0) Gecko/20100101 Thunderbird/78.13.0 List-Id: Discussions about the use of FreeBSD-current List-Archive: https://lists.freebsd.org/archives/freebsd-current List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-current@freebsd.org MIME-Version: 1.0 In-Reply-To: <0577ca44-86c2-d54c-33b7-c7174632e569@gmail.com> Content-Type: text/plain; charset=utf-8; format=flowed Content-Language: en-US Content-Transfer-Encoding: 8bit X-ThisMailContainsUnwantedMimeParts: N On 8/23/21 12:18 PM, Graham Perrin wrote: > Encountered whilst attempting to build and install 14.0-CURRENT over > 13.0-RELEASE-p3 (experimental, helloSystem): > > > > Background, condensed, to the best of my recollection: > > cd /usr/src > make buildworld    # succeeded > make kernel    # failed > make clean > LOCAL_MODULES=    # added to /etc/src.conf > make kernel-toolchain > make kernel > restarted in single user mode > mount -uw / > service zfs start > cd /usr/src > make installworld – failed as pictured. > > I see , fixed > in 2018. > > Any suggestions? I'm not sure what the 'make clean' would have done. Did you mean 'make cleanworld'? If so, you will need to do a 'make buildworld' again before trying to do 'make installworld'. The error message implies that there is no 'make buildworld' output in /usr/obj (as if you had run 'make cleanworld' up above where you list 'make clean') -- John Baldwin From nobody Wed Aug 25 21:19:12 2021 X-Original-To: freebsd-current@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 5E7B7178E929 for ; Wed, 25 Aug 2021 21:19:30 +0000 (UTC) (envelope-from asomers@gmail.com) Received: from mail-oi1-f175.google.com (mail-oi1-f175.google.com [209.85.167.175]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "GTS CA 1O1" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4GvzPs3c9Jz4dgn for ; Wed, 25 Aug 2021 21:19:29 +0000 (UTC) (envelope-from asomers@gmail.com) Received: by mail-oi1-f175.google.com with SMTP id c79so1258325oib.11 for ; Wed, 25 Aug 2021 14:19:29 -0700 (PDT) X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:from:date:message-id:subject:to; bh=Cew+JNlcECTAMDr9Mt2tvYlDKWri1VA29iCdhWAdZDo=; b=LlZe1ybJk+PDSRO47YPEibX+q0Ced5J5OkKbHitPxWqFSogUN0CtK9esc8WcJIjNSF CV12I14mHMrApUey2Ss253nfbbm0ZnWaYxj93Rs+3c+WsunURtCu8mn1+lSm+nVtjfow YTFjw/oqF8gTsinT9bYPDGL/lyowbuM7izgBDTwGI36X/b6ugjZOZ0OBBgQAY+qO6Ouq Pel09VlV3wE/kSHiJ4uU9/q7UV6W2gEQK47vQA5sbAlPkW7kEJh8r/Ji3HGZ4vpKVfQU WKpJmHO3ePwyz5mrug6R/XDLRei82bM4K5yJ7p7CrYa3rqAnCMwCU1ouu6Ypph4dm8bU nNMA== X-Gm-Message-State: AOAM531upaMFySo688P2AEqQV26ODFqElXiv6/sPjprK5oQUJgNMy2t+ iU8NMC9x0Theo46n8xmfX0QWSTkbZy5fp2u7FtDYvJ9T X-Google-Smtp-Source: ABdhPJyzIRLG14EPPhZznzu2mVcobFwLvQPCnnhpKEXEbxOAVVoRCcMcrL86eLplGo1XgyLp3ol8HTr6HhyDgtTZER8= X-Received: by 2002:a54:4e94:: with SMTP id c20mr43534oiy.57.1629926362944; Wed, 25 Aug 2021 14:19:22 -0700 (PDT) List-Id: Discussions about the use of FreeBSD-current List-Archive: https://lists.freebsd.org/archives/freebsd-current List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-current@freebsd.org MIME-Version: 1.0 From: Alan Somers Date: Wed, 25 Aug 2021 15:19:12 -0600 Message-ID: Subject: ses ioctl API/ABI stability To: FreeBSD CURRENT Content-Type: multipart/alternative; boundary="000000000000df9a4705ca68cda8" X-Rspamd-Queue-Id: 4GvzPs3c9Jz4dgn X-Spamd-Bar: / Authentication-Results: mx1.freebsd.org; dkim=none; dmarc=none; spf=pass (mx1.freebsd.org: domain of asomers@gmail.com designates 209.85.167.175 as permitted sender) smtp.mailfrom=asomers@gmail.com X-Spamd-Result: default: False [-0.84 / 15.00]; ARC_NA(0.00)[]; RCVD_COUNT_TWO(0.00)[2]; FREEFALL_USER(0.00)[asomers]; FROM_HAS_DN(0.00)[]; R_SPF_ALLOW(-0.20)[+ip4:209.85.128.0/17:c]; TO_MATCH_ENVRCPT_ALL(0.00)[]; MIME_GOOD(-0.10)[multipart/alternative,text/plain]; PREVIOUSLY_DELIVERED(0.00)[freebsd-current@freebsd.org]; DMARC_NA(0.00)[freebsd.org]; NEURAL_SPAM_MEDIUM(1.00)[1.000]; RCPT_COUNT_ONE(0.00)[1]; NEURAL_HAM_LONG(-1.00)[-1.000]; TO_DN_ALL(0.00)[]; NEURAL_HAM_SHORT(-0.84)[-0.842]; RCVD_TLS_ALL(0.00)[]; RCVD_IN_DNSWL_NONE(0.00)[209.85.167.175:from]; FORGED_SENDER(0.30)[asomers@freebsd.org,asomers@gmail.com]; RWL_MAILSPIKE_POSSIBLE(0.00)[209.85.167.175:from]; R_DKIM_NA(0.00)[]; MIME_TRACE(0.00)[0:+,1:+,2:~]; ASN(0.00)[asn:15169, ipnet:209.85.128.0/17, country:US]; FROM_NEQ_ENVFROM(0.00)[asomers@freebsd.org,asomers@gmail.com]; FREEMAIL_ENVFROM(0.00)[gmail.com]; TO_DOM_EQ_FROM_DOM(0.00)[] X-ThisMailContainsUnwantedMimeParts: Y --000000000000df9a4705ca68cda8 Content-Type: text/plain; charset="UTF-8" We usually try to maintain backwards compatibility forever. But is that necessary for the ses(4) ioctls? There are several problems with them as currently defined. They lack type safety, lack automatic copyin/copyout handling, and one of them can overrun a user buffer. I would like to fix them, but adding backwards-compatibility versions would almost negate the benefit. Or, can we consider this to be an internal API, changeable at will, as long as sesutil's CLI remains the same? -Alan --000000000000df9a4705ca68cda8-- From nobody Thu Aug 26 08:18:56 2021 X-Original-To: freebsd-current@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id D122C1775F1F for ; Thu, 26 Aug 2021 08:18:57 +0000 (UTC) (envelope-from theraven@FreeBSD.org) Received: from smtp.freebsd.org (smtp.freebsd.org [96.47.72.83]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "smtp.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4GwG2n3bMvz3DB3 for ; Thu, 26 Aug 2021 08:18:57 +0000 (UTC) (envelope-from theraven@FreeBSD.org) Received: from smtp.theravensnest.org (smtp.theravensnest.org [45.77.103.195]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) (Authenticated sender: theraven) by smtp.freebsd.org (Postfix) with ESMTPSA id 560DFDE78 for ; Thu, 26 Aug 2021 08:18:57 +0000 (UTC) (envelope-from theraven@FreeBSD.org) Received: from [192.168.1.202] (host86-148-130-214.range86-148.btcentralplus.com [86.148.130.214]) by smtp.theravensnest.org (Postfix) with ESMTPSA id 574952C71B for ; Thu, 26 Aug 2021 09:18:56 +0100 (BST) Subject: Re: ses ioctl API/ABI stability To: freebsd-current@freebsd.org References: From: David Chisnall Message-ID: <3e491c4f-0c86-a860-d0ed-b657ce653e74@FreeBSD.org> Date: Thu, 26 Aug 2021 09:18:56 +0100 User-Agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64; rv:78.0) Gecko/20100101 Thunderbird/78.13.0 List-Id: Discussions about the use of FreeBSD-current List-Archive: https://lists.freebsd.org/archives/freebsd-current List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-current@freebsd.org MIME-Version: 1.0 In-Reply-To: Content-Type: text/plain; charset=utf-8; format=flowed Content-Language: en-GB Content-Transfer-Encoding: 7bit X-ThisMailContainsUnwantedMimeParts: N On 25/08/2021 22:19, Alan Somers wrote: > We usually try to maintain backwards compatibility forever. But is that > necessary for the ses(4) ioctls? There are several problems with them as > currently defined. They lack type safety, lack automatic copyin/copyout > handling, and one of them can overrun a user buffer. I would like to fix > them, but adding backwards-compatibility versions would almost negate the > benefit. Or, can we consider this to be an internal API, changeable at > will, as long as sesutil's CLI remains the same? > -Alan I've been pondering for a little while the possibility of using CUSE for compat ioctls (particularly for jails, but potentially in general). This might be a good candidate. If you rename ses and provide a CUSE implementation of ses that runs in a Capsicum sandbox with access to the new device then the worst that a type-safety bug can do is issue the wrong ioctl (but not an invalid one, because the kernel will catch that with the new interfaces). sesutil can move to the new interface and so only things that want to directly talk to the old interface (for example, sesutil in a FreeBSD 12 jail) will need to load the userspace compat interface. David From nobody Thu Aug 26 15:50:01 2021 X-Original-To: freebsd-current@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 2F310179D0B2 for ; Thu, 26 Aug 2021 15:50:13 +0000 (UTC) (envelope-from asomers@gmail.com) Received: from mail-oi1-f175.google.com (mail-oi1-f175.google.com [209.85.167.175]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "GTS CA 1O1" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4GwS3T0gWzz3m2J; Thu, 26 Aug 2021 15:50:13 +0000 (UTC) (envelope-from asomers@gmail.com) Received: by mail-oi1-f175.google.com with SMTP id r26so5494616oij.2; Thu, 26 Aug 2021 08:50:13 -0700 (PDT) X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:references:in-reply-to:from:date :message-id:subject:to:cc; bh=WgY3W4a3IWNg51+RAQ+Y+k4YyIfeIRwgQTQ3Yv0uSHM=; b=ggXcxU9y9dEVETobtjnjoXd7BXn4nghdrvaW35E+jXocNn+3TS0F6mF3TOiMmNt1sS 6TAPud1UVr3BRUZVcJAjEX9d1+FKjm7JYnDZO3eRa1j9h9sHauUw/mKXGllMhGmePrDi vG5Ks4Y7aA/3GQoyy1jb1+XWfFWWPBlSe2FLt79UHH8H1yr/YPvwDdv3kVW/TUJnraRd TZz8LSgpxLSb2uLAj2vrvGeaa53L6DENnwepckKFODjd0J6AHa6w58ZzayGSuoXPQq1g AMzJvQdiR4k+rp9B4xbdahOL6FoDOB71wzgJ+U5OJypJJOPY6aaaFjubAXc8OQU1IoIj +XMw== X-Gm-Message-State: AOAM531RSD7IuspFNRoXwRy4QIlwqLESn+fdPz0Tx8l/A6E4xOR7m4xv G0Z4Y8+HdyvB2xI5wc1SeRRAZMYPZuu+XbGyw9MnTUNa X-Google-Smtp-Source: ABdhPJyByIEW0qjdRgGJU/6lAH4VfpGge9M5mp7Miype4hs6z2DpTsHaPL6FFVrMBEoB//6ws9ajO55hLwdigl7CmV4= X-Received: by 2002:a54:4812:: with SMTP id j18mr11364190oij.55.1629993012330; Thu, 26 Aug 2021 08:50:12 -0700 (PDT) List-Id: Discussions about the use of FreeBSD-current List-Archive: https://lists.freebsd.org/archives/freebsd-current List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-current@freebsd.org MIME-Version: 1.0 References: <3e491c4f-0c86-a860-d0ed-b657ce653e74@FreeBSD.org> In-Reply-To: <3e491c4f-0c86-a860-d0ed-b657ce653e74@FreeBSD.org> From: Alan Somers Date: Thu, 26 Aug 2021 09:50:01 -0600 Message-ID: Subject: Re: ses ioctl API/ABI stability To: David Chisnall Cc: FreeBSD CURRENT Content-Type: multipart/alternative; boundary="0000000000007c83bd05ca785245" X-Rspamd-Queue-Id: 4GwS3T0gWzz3m2J X-Spamd-Bar: ---- Authentication-Results: mx1.freebsd.org; none X-Spamd-Result: default: False [-4.00 / 15.00]; REPLY(-4.00)[] X-ThisMailContainsUnwantedMimeParts: Y --0000000000007c83bd05ca785245 Content-Type: text/plain; charset="UTF-8" On Thu, Aug 26, 2021 at 2:21 AM David Chisnall wrote: > On 25/08/2021 22:19, Alan Somers wrote: > > We usually try to maintain backwards compatibility forever. But is that > > necessary for the ses(4) ioctls? There are several problems with them as > > currently defined. They lack type safety, lack automatic copyin/copyout > > handling, and one of them can overrun a user buffer. I would like to fix > > them, but adding backwards-compatibility versions would almost negate the > > benefit. Or, can we consider this to be an internal API, changeable at > > will, as long as sesutil's CLI remains the same? > > -Alan > > I've been pondering for a little while the possibility of using CUSE for > compat ioctls (particularly for jails, but potentially in general). > This might be a good candidate. If you rename ses and provide a CUSE > implementation of ses that runs in a Capsicum sandbox with access to the > new device then the worst that a type-safety bug can do is issue the > wrong ioctl (but not an invalid one, because the kernel will catch that > with the new interfaces). sesutil can move to the new interface and so > only things that want to directly talk to the old interface (for > example, sesutil in a FreeBSD 12 jail) will need to load the userspace > compat interface. > > David > Wild. I never thought about doing it that way. In this case though, ses isn't terribly useful for jails. I'm going to use imp's gone_in API instead, which I only discovered just this morning. --0000000000007c83bd05ca785245-- From nobody Fri Aug 27 07:57:46 2021 X-Original-To: freebsd-current@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id D74C8178C9F8 for ; Fri, 27 Aug 2021 07:57:54 +0000 (UTC) (envelope-from grahamperrin@gmail.com) Received: from mail-wr1-x42c.google.com (mail-wr1-x42c.google.com [IPv6:2a00:1450:4864:20::42c]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "GTS CA 1O1" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4GwsX21Cygz4Vsj for ; Fri, 27 Aug 2021 07:57:54 +0000 (UTC) (envelope-from grahamperrin@gmail.com) Received: by mail-wr1-x42c.google.com with SMTP id u16so9054008wrn.5 for ; Fri, 27 Aug 2021 00:57:54 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=to:from:subject:message-id:date:user-agent:mime-version :content-transfer-encoding:content-language; bh=5lOcYy21XMyf/DZk6qesOQqLZ1OtGayPe28kli2t5o0=; b=u9wAMSaKLP5sHVBnKmwtibdPY4GHEKkj6sPv9EAPZpJlfoLIopJwaxGgIITxF9NUyc C7CSGxDYERqpZ+v7ufs2ASTe5DKCAxzcZsX20eENmxtFcG8HHLmMQexPaRoiiocSwGoC wXrPnHv/lAJq6MLBREB8S3zZo231n8UMtZuUXL5PIzik7TgS+OP5a4kZAsAOMAOVam+5 Ft8nFTfKzvsAzIstcFEFQaj7bUUwE+mP6HhZTmNo1wOdRu5f4qT5JsuZPQ4v8yrYwxNt h+NKv0Svsk33+33b1JrEsxgXhv6fsyCrPZZL/7HL2OuGqtD4Fza8Rp3OdSksmvF2gOiF R5yQ== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:to:from:subject:message-id:date:user-agent :mime-version:content-transfer-encoding:content-language; bh=5lOcYy21XMyf/DZk6qesOQqLZ1OtGayPe28kli2t5o0=; b=Mhe+mYIUleut1+Ys2dzoEfN+ewf4Wvib4aXRUlNkl7QLiF/lpIo++TGhN/NaaWL5O1 E3y6g8Y0JKRsAghtmUJkkTQsv7pkyzMOW778sGmojNlTzIMWxtZkZ2EhoAddVIvl3dwM nRNzU5EcXNUDFNHLCRXaRZSYYxSTUhSTGJScPuoGrvLLiB7tjNt5cLtZD8/+3RnSruTR 1xKgGYkx40ASLRpdxIQHZtVEAAMzKI7/NxeqPMxhLQtfFyZ6KSg+zx3nxsqO5EDCYGLS 9+Qlrg9C0yElYLDIWebpDrWpqNE0oDXM+XeyQ1iTzBme663zWdWL+XbcapSDyy/W5Srg mhfA== X-Gm-Message-State: AOAM530UaeHZ4uBphM55xxWCcBdCWkxILqyYaHWdbHq/lwIMdY6jn4sl kP/ezqqhoLfetDsZUWKgVn3/KwNQCVPjyw== X-Google-Smtp-Source: ABdhPJxv51aGYth0xShTvEztpm9pz2yDX9T4QkDlsNpxVlfac6lubGHRxQJtAbtmmm/d7kEkbRjS+w== X-Received: by 2002:a05:6000:92:: with SMTP id m18mr8628141wrx.293.1630051067066; Fri, 27 Aug 2021 00:57:47 -0700 (PDT) Received: from ?IPv6:2001:470:1f1c:a0::2? (tunnel642390-pt.tunnel.tserv1.lon2.ipv6.he.net. [2001:470:1f1c:a0::2]) by smtp.gmail.com with ESMTPSA id b62sm98441wmb.17.2021.08.27.00.57.46 for (version=TLS1_3 cipher=TLS_AES_128_GCM_SHA256 bits=128/128); Fri, 27 Aug 2021 00:57:46 -0700 (PDT) To: FreeBSD CURRENT From: Graham Perrin Subject: Encrypted swap partition no longer encrypted Message-ID: Date: Fri, 27 Aug 2021 08:57:46 +0100 User-Agent: Mozilla/5.0 (X11; FreeBSD amd64; rv:78.0) Gecko/20100101 Thunderbird/78.13.0 List-Id: Discussions about the use of FreeBSD-current List-Archive: https://lists.freebsd.org/archives/freebsd-current List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-current@freebsd.org MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8; format=flowed Content-Transfer-Encoding: 8bit Content-Language: en-GB X-Rspamd-Queue-Id: 4GwsX21Cygz4Vsj X-Spamd-Bar: --- Authentication-Results: mx1.freebsd.org; dkim=pass header.d=gmail.com header.s=20161025 header.b=u9wAMSaK; dmarc=pass (policy=none) header.from=gmail.com; spf=pass (mx1.freebsd.org: domain of grahamperrin@gmail.com designates 2a00:1450:4864:20::42c as permitted sender) smtp.mailfrom=grahamperrin@gmail.com X-Spamd-Result: default: False [-4.00 / 15.00]; ARC_NA(0.00)[]; RCVD_VIA_SMTP_AUTH(0.00)[]; R_DKIM_ALLOW(-0.20)[gmail.com:s=20161025]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; FROM_HAS_DN(0.00)[]; R_SPF_ALLOW(-0.20)[+ip6:2a00:1450:4000::/36:c]; FREEMAIL_FROM(0.00)[gmail.com]; MIME_GOOD(-0.10)[text/plain]; PREVIOUSLY_DELIVERED(0.00)[freebsd-current@freebsd.org]; NEURAL_HAM_LONG(-1.00)[-1.000]; RCPT_COUNT_ONE(0.00)[1]; RCVD_COUNT_THREE(0.00)[3]; TO_DN_ALL(0.00)[]; DKIM_TRACE(0.00)[gmail.com:+]; DMARC_POLICY_ALLOW(-0.50)[gmail.com,none]; RCVD_IN_DNSWL_NONE(0.00)[2a00:1450:4864:20::42c:from]; NEURAL_HAM_SHORT(-1.00)[-0.999]; TO_MATCH_ENVRCPT_ALL(0.00)[]; FROM_EQ_ENVFROM(0.00)[]; MIME_TRACE(0.00)[0:+]; FREEMAIL_ENVFROM(0.00)[gmail.com]; ASN(0.00)[asn:15169, ipnet:2a00:1450::/32, country:US]; RCVD_TLS_ALL(0.00)[]; MID_RHS_MATCH_FROM(0.00)[]; DWL_DNSWL_NONE(0.00)[gmail.com:dkim] X-ThisMailContainsUnwantedMimeParts: N Yesterday afternoon I installed FreeBSD-CURRENT to a hard disk drive, whilst it was in a dock on USB, and chose encrypted swap. Then, ZFS send and receive to replicate data from a pool that was on the internal drive. Finally, I replaced the internal drive with the one from the dock. Now: swap is not encrypted, this was not my intention. Might the accident have resulted from an inappropriate change to /etc/fstab followed by a swapon command? I did, at one point, activate and boot the wrong boot environment (because `bectl list -c creation` can no longer show the true (original) dates of creation of boot environments that were replicated). ---- root@mowa219-gjp4-8570p-freebsd:~ # bectl mount default /tmp/huh Successfully mounted default at /tmp/huh root@mowa219-gjp4-8570p-freebsd:~ # cat /tmp/huh/etc/fstab # Device                Mountpoint      FStype  Options Dump    Pass# /dev/da0p1              /boot/efi       msdosfs rw 2       2 /dev/da0p2.eli          none    swap    sw              0       0 root@mowa219-gjp4-8570p-freebsd:~ # bectl umount default root@mowa219-gjp4-8570p-freebsd:~ # grep swap /etc/fstab | grep -v \# /dev/ada0p2     none                    swap sw,late                    0     0 root@mowa219-gjp4-8570p-freebsd:~ # grep ada0 /etc/rc.conf dumpdev="/dev/ada0p2" root@mowa219-gjp4-8570p-freebsd:~ # bectl list -c creation BE                             Active Mountpoint Space Created default                        -      -          789M  2021-08-26 16:33 n247565-b49ba74deeb-f          -      -          39.6G 2021-08-26 19:50 n248685-c9f833abf1d-f          NR     /          49.3G 2021-08-26 21:13 14.0-CURRENT_2021-08-19_045942 -      -          1.09G 2021-08-26 22:41 n248269-941650aae97-e          -      -          40.5M 2021-08-26 22:54 n247798-f39dd6a9784-a          -      -          22.9M 2021-08-26 22:54 n248139-3a57f08b504-b          -      -          1.21G 2021-08-26 22:54 n248478-f3a3b061216-a          -      -          51.0M 2021-08-26 22:54 14.0-CURRENT_2021-08-08_145838 -      -          365M  2021-08-26 22:54 n248269-941650aae97-b          -      -          524M  2021-08-26 22:54 n248269-941650aae97-f          -      -          29.3M 2021-08-26 22:54 n248478-f3a3b061216-e          -      -          579M  2021-08-26 22:54 n248478-f3a3b061216-b          -      -          56.7M 2021-08-26 22:55 n247798-f39dd6a9784-e          -      -          328M  2021-08-26 22:55 n248269-941650aae97-d          -      -          260M  2021-08-26 22:55 n248685-c9f833abf1d-e          -      -          216M  2021-08-26 22:55 n247798-f39dd6a9784-j          -      -          4.98G 2021-08-26 22:55 n248478-f3a3b061216-d          -      -          310M  2021-08-26 22:55 n248478-f3a3b061216-c          -      -          101M  2021-08-26 22:55 root@mowa219-gjp4-8570p-freebsd:~ # bectl list | sort 14.0-CURRENT_2021-08-08_145838 -      -          365M  2021-08-26 22:54 14.0-CURRENT_2021-08-19_045942 -      -          1.09G 2021-08-26 22:41 BE                             Active Mountpoint Space Created default                        -      -          789M  2021-08-26 16:33 n247565-b49ba74deeb-f          -      -          39.6G 2021-08-26 19:50 n247798-f39dd6a9784-a          -      -          22.9M 2021-08-26 22:54 n247798-f39dd6a9784-e          -      -          328M  2021-08-26 22:55 n247798-f39dd6a9784-j          -      -          4.98G 2021-08-26 22:55 n248139-3a57f08b504-b          -      -          1.21G 2021-08-26 22:54 n248269-941650aae97-b          -      -          524M  2021-08-26 22:54 n248269-941650aae97-d          -      -          260M  2021-08-26 22:55 n248269-941650aae97-e          -      -          40.5M 2021-08-26 22:54 n248269-941650aae97-f          -      -          29.3M 2021-08-26 22:54 n248478-f3a3b061216-a          -      -          51.0M 2021-08-26 22:54 n248478-f3a3b061216-b          -      -          56.7M 2021-08-26 22:55 n248478-f3a3b061216-c          -      -          101M  2021-08-26 22:55 n248478-f3a3b061216-d          -      -          310M  2021-08-26 22:55 n248478-f3a3b061216-e          -      -          579M  2021-08-26 22:54 n248685-c9f833abf1d-e          -      -          216M  2021-08-26 22:55 n248685-c9f833abf1d-f          NR     /          49.3G 2021-08-26 21:13 root@mowa219-gjp4-8570p-freebsd:~ # uname -KU 1400030 1400030 root@mowa219-gjp4-8570p-freebsd:~ # uname -a FreeBSD mowa219-gjp4-8570p-freebsd 14.0-CURRENT FreeBSD 14.0-CURRENT #105 main-n248685-c9f833abf1d: Fri Aug 13 20:24:43 BST 2021 root@mowa219-gjp4-zbook-freebsd:/usr/obj/usr/src/amd64.amd64/sys/GENERIC-NODEBUG amd64 root@mowa219-gjp4-8570p-freebsd:~ # From nobody Fri Aug 27 09:10:26 2021 X-Original-To: freebsd-current@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id ED35117806B7 for ; Fri, 27 Aug 2021 09:10:27 +0000 (UTC) (envelope-from SRS0=bVb0=NS=klop.ws=ronald-lists@realworks.nl) Received: from smtp-relay-int.realworks.nl (smtp-relay-int.realworks.nl [194.109.157.24]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4Gwv7l0Yghz4vwj for ; Fri, 27 Aug 2021 09:10:27 +0000 (UTC) (envelope-from SRS0=bVb0=NS=klop.ws=ronald-lists@realworks.nl) Date: Fri, 27 Aug 2021 11:10:26 +0200 (CEST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=klop.ws; s=rw2; t=1630055426; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: in-reply-to:in-reply-to:references:references; bh=2QKTiwu5SSncqRayephwYQ4bBBAkB/bt0reSYBPjqe0=; b=bYMAZZAgapuLXgFzBQdraMH8BcQ9fssN72LrhBPOkXhmuH+R7c7e4du9grbnpkIssqSdUQ ldbbQpa9BxxHEH0Bl3+E9ZThUIPgsf1bC+FpwdpXU5qdTa70m3ArfWvySNCwf39akjhEXA HGkQmAK1nWKbm041rHKOIpTmvQzYiGOJhdERECQjXXsimE25zV4wjN+wvYSFVyQAIwJ4uS 8v1RnvRpOpcCEA94t0ImzQYTIg1xayq0/26rYCixyB7C/FDOEqmQrasQkpUCjjHysGhE9G /taED+TRfg/FBVlw+bFxLN2SVkb7ez08AcRP4sBwQ1Bv742vrmSAVFWZyfj1vA== From: Ronald Klop To: FreeBSD CURRENT Message-ID: <149845085.13.1630055426223@localhost> In-Reply-To: References: Subject: Re: Encrypted swap partition no longer encrypted List-Id: Discussions about the use of FreeBSD-current List-Archive: https://lists.freebsd.org/archives/freebsd-current List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-current@freebsd.org MIME-Version: 1.0 Content-Type: multipart/alternative; boundary="----=_Part_12_1080740010.1630055426170" X-Mailer: Realworks (574.746.c373083) Importance: Normal X-Priority: 3 (Normal) X-Rspamd-Queue-Id: 4Gwv7l0Yghz4vwj X-Spamd-Bar: --- Authentication-Results: mx1.freebsd.org; dkim=pass header.d=klop.ws header.s=rw2 header.b=bYMAZZAg; dmarc=pass (policy=none) header.from=klop.ws; spf=pass (mx1.freebsd.org: domain of "SRS0=bVb0=NS=klop.ws=ronald-lists@realworks.nl" designates 194.109.157.24 as permitted sender) smtp.mailfrom="SRS0=bVb0=NS=klop.ws=ronald-lists@realworks.nl" X-Spamd-Result: default: False [-3.20 / 15.00]; ARC_NA(0.00)[]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; R_DKIM_ALLOW(-0.20)[klop.ws:s=rw2]; FROM_HAS_DN(0.00)[]; R_SPF_ALLOW(-0.20)[+ip4:194.109.157.0/24:c]; TO_MATCH_ENVRCPT_ALL(0.00)[]; MIME_GOOD(-0.10)[multipart/alternative,text/plain]; NEURAL_HAM_LONG(-1.00)[-1.000]; RCPT_COUNT_ONE(0.00)[1]; NEURAL_HAM_SHORT(-1.00)[-0.998]; TO_DN_ALL(0.00)[]; DKIM_TRACE(0.00)[klop.ws:+]; DMARC_POLICY_ALLOW(-0.50)[klop.ws,none]; HAS_X_PRIO_THREE(0.00)[3]; RCVD_IN_DNSWL_NONE(0.00)[194.109.157.24:from]; FORGED_SENDER(0.30)[ronald-lists@klop.ws,SRS0=bVb0=NS=klop.ws=ronald-lists@realworks.nl]; RCVD_COUNT_ZERO(0.00)[0]; RWL_MAILSPIKE_POSSIBLE(0.00)[194.109.157.24:from]; MIME_TRACE(0.00)[0:+,1:+,2:~]; MID_RHS_NOT_FQDN(0.50)[]; ASN(0.00)[asn:3265, ipnet:194.109.0.0/16, country:NL]; FROM_NEQ_ENVFROM(0.00)[ronald-lists@klop.ws,SRS0=bVb0=NS=klop.ws=ronald-lists@realworks.nl] X-ThisMailContainsUnwantedMimeParts: Y ------=_Part_12_1080740010.1630055426170 Content-Type: text/plain; charset=us-ascii; format=flowed Content-Transfer-Encoding: 7bit Hi, For encrypted swap you can put ".eli" behind the device name in fstab. So change "/dev/ada0p2" to "/dev/ada0p2.eli" in the new fstab and reboot. NB: after encryption is enabled the device is not available as dumpdev anymore. I don't know what caused the change for you. Regards, Ronald. Van: Graham Perrin Datum: vrijdag, 27 augustus 2021 09:57 Aan: FreeBSD CURRENT Onderwerp: Encrypted swap partition no longer encrypted > > Yesterday afternoon I installed FreeBSD-CURRENT to a hard disk drive, whilst it was in a dock on USB, and chose encrypted swap. > > Then, ZFS send and receive to replicate data from a pool that was on the internal drive. Finally, I replaced the internal drive with the one from the dock. > > Now: swap is not encrypted, this was not my intention. > > Might the accident have resulted from an inappropriate change to /etc/fstab followed by a swapon command? > > I did, at one point, activate and boot the wrong boot environment (because `bectl list -c creation` can no longer show the true (original) dates of creation of boot environments that were replicated). > > ---- > > root@mowa219-gjp4-8570p-freebsd:~ # bectl mount default /tmp/huh > Successfully mounted default at /tmp/huh > root@mowa219-gjp4-8570p-freebsd:~ # cat /tmp/huh/etc/fstab > # Device Mountpoint FStype Options Dump Pass# > /dev/da0p1 /boot/efi msdosfs rw 2 2 > /dev/da0p2.eli none swap sw 0 0 > root@mowa219-gjp4-8570p-freebsd:~ # bectl umount default > root@mowa219-gjp4-8570p-freebsd:~ # grep swap /etc/fstab | grep -v \# > /dev/ada0p2 none swap sw,late 0 0 > root@mowa219-gjp4-8570p-freebsd:~ # grep ada0 /etc/rc.conf > dumpdev="/dev/ada0p2" > root@mowa219-gjp4-8570p-freebsd:~ # bectl list -c creation > BE Active Mountpoint Space Created > default - - 789M 2021-08-26 16:33 > n247565-b49ba74deeb-f - - 39.6G 2021-08-26 19:50 > n248685-c9f833abf1d-f NR / 49.3G 2021-08-26 21:13 > 14.0-CURRENT_2021-08-19_045942 - - 1.09G 2021-08-26 22:41 > n248269-941650aae97-e - - 40.5M 2021-08-26 22:54 > n247798-f39dd6a9784-a - - 22.9M 2021-08-26 22:54 > n248139-3a57f08b504-b - - 1.21G 2021-08-26 22:54 > n248478-f3a3b061216-a - - 51.0M 2021-08-26 22:54 > 14.0-CURRENT_2021-08-08_145838 - - 365M 2021-08-26 22:54 > n248269-941650aae97-b - - 524M 2021-08-26 22:54 > n248269-941650aae97-f - - 29.3M 2021-08-26 22:54 > n248478-f3a3b061216-e - - 579M 2021-08-26 22:54 > n248478-f3a3b061216-b - - 56.7M 2021-08-26 22:55 > n247798-f39dd6a9784-e - - 328M 2021-08-26 22:55 > n248269-941650aae97-d - - 260M 2021-08-26 22:55 > n248685-c9f833abf1d-e - - 216M 2021-08-26 22:55 > n247798-f39dd6a9784-j - - 4.98G 2021-08-26 22:55 > n248478-f3a3b061216-d - - 310M 2021-08-26 22:55 > n248478-f3a3b061216-c - - 101M 2021-08-26 22:55 > root@mowa219-gjp4-8570p-freebsd:~ # bectl list | sort > 14.0-CURRENT_2021-08-08_145838 - - 365M 2021-08-26 22:54 > 14.0-CURRENT_2021-08-19_045942 - - 1.09G 2021-08-26 22:41 > BE Active Mountpoint Space Created > default - - 789M 2021-08-26 16:33 > n247565-b49ba74deeb-f - - 39.6G 2021-08-26 19:50 > n247798-f39dd6a9784-a - - 22.9M 2021-08-26 22:54 > n247798-f39dd6a9784-e - - 328M 2021-08-26 22:55 > n247798-f39dd6a9784-j - - 4.98G 2021-08-26 22:55 > n248139-3a57f08b504-b - - 1.21G 2021-08-26 22:54 > n248269-941650aae97-b - - 524M 2021-08-26 22:54 > n248269-941650aae97-d - - 260M 2021-08-26 22:55 > n248269-941650aae97-e - - 40.5M 2021-08-26 22:54 > n248269-941650aae97-f - - 29.3M 2021-08-26 22:54 > n248478-f3a3b061216-a - - 51.0M 2021-08-26 22:54 > n248478-f3a3b061216-b - - 56.7M 2021-08-26 22:55 > n248478-f3a3b061216-c - - 101M 2021-08-26 22:55 > n248478-f3a3b061216-d - - 310M 2021-08-26 22:55 > n248478-f3a3b061216-e - - 579M 2021-08-26 22:54 > n248685-c9f833abf1d-e - - 216M 2021-08-26 22:55 > n248685-c9f833abf1d-f NR / 49.3G 2021-08-26 21:13 > root@mowa219-gjp4-8570p-freebsd:~ # uname -KU > 1400030 1400030 > root@mowa219-gjp4-8570p-freebsd:~ # uname -a > FreeBSD mowa219-gjp4-8570p-freebsd 14.0-CURRENT FreeBSD 14.0-CURRENT #105 main-n248685-c9f833abf1d: Fri Aug 13 20:24:43 BST 2021 root@mowa219-gjp4-zbook-freebsd:/usr/obj/usr/src/amd64.amd64/sys/GENERIC-NODEBUG amd64 > root@mowa219-gjp4-8570p-freebsd:~ # > > > > > ------=_Part_12_1080740010.1630055426170-- From nobody Fri Aug 27 10:38:23 2021 X-Original-To: freebsd-current@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 8F2EA1791F47 for ; Fri, 27 Aug 2021 10:38:32 +0000 (UTC) (envelope-from david@catwhisker.org) Received: from mx.catwhisker.org (mx.catwhisker.org [107.204.234.170]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4Gwx5N28FGz3v5K for ; Fri, 27 Aug 2021 10:38:32 +0000 (UTC) (envelope-from david@catwhisker.org) Received: from albert.catwhisker.org (localhost [127.0.0.1]) by albert.catwhisker.org (8.16.1/8.15.2) with ESMTP id 17RAcPda065133; Fri, 27 Aug 2021 10:38:25 GMT (envelope-from david@albert.catwhisker.org) Received: (from david@localhost) by albert.catwhisker.org (8.16.1/8.16.1/Submit) id 17RAcNmL065132; Fri, 27 Aug 2021 03:38:23 -0700 (PDT) (envelope-from david) Date: Fri, 27 Aug 2021 03:38:23 -0700 From: David Wolfskill To: Ronald Klop Cc: FreeBSD CURRENT Subject: Re: Encrypted swap partition no longer encrypted Message-ID: Reply-To: current@freebsd.org Mail-Followup-To: current@freebsd.org, Ronald Klop , FreeBSD CURRENT References: <149845085.13.1630055426223@localhost> List-Id: Discussions about the use of FreeBSD-current List-Archive: https://lists.freebsd.org/archives/freebsd-current List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-current@freebsd.org MIME-Version: 1.0 Content-Type: multipart/signed; micalg=pgp-sha512; protocol="application/pgp-signature"; boundary="I+jJ9KV3mEhwMKrr" Content-Disposition: inline In-Reply-To: <149845085.13.1630055426223@localhost> X-Rspamd-Queue-Id: 4Gwx5N28FGz3v5K X-Spamd-Bar: ---- Authentication-Results: mx1.freebsd.org; none X-Spamd-Result: default: False [-4.00 / 15.00]; REPLY(-4.00)[] X-ThisMailContainsUnwantedMimeParts: N --I+jJ9KV3mEhwMKrr Content-Type: text/plain; charset=us-ascii Content-Disposition: inline Content-Transfer-Encoding: quoted-printable On Fri, Aug 27, 2021 at 11:10:26AM +0200, Ronald Klop wrote: > Hi, >=20 > For encrypted swap you can put ".eli" behind the device name in fstab. >=20 > So change "/dev/ada0p2" to "/dev/ada0p2.eli" in the new fstab and reboot. > NB: after encryption is enabled the device is not available as dumpdev an= ymore. If one uses "sw,late" in the "Options" field of the swap fstab entry, thus: # Device Mountpoint FStype Options Dump Pas= s# /dev/ada0s4b.eli none swap sw,late 0 0 I find that it permits (in this case) /dev/ada0s4b to be used for the dumpdev, whlie using /dev/ada0s4b.eli for swap. (This is for stable/12, stable/13, and head -- though I haven't updated since 10 August.) > ... Peace, david --=20 David H. Wolfskill david@catwhisker.org Life is not intended to be a zero-sum game. See https://www.catwhisker.org/~david/publickey.gpg for my public key. --I+jJ9KV3mEhwMKrr Content-Type: application/pgp-signature; name="signature.asc" -----BEGIN PGP SIGNATURE----- iQGTBAEBCgB9FiEE4owz2QxMJyaxAefyQLJg+bY2PckFAmEowJ9fFIAAAAAALgAo aXNzdWVyLWZwckBub3RhdGlvbnMub3BlbnBncC5maWZ0aGhvcnNlbWFuLm5ldEUy OEMzM0Q5MEM0QzI3MjZCMTAxRTdGMjQwQjI2MEY5QjYzNjNEQzkACgkQQLJg+bY2 PcmiSQf+NSDULM/wsoY/dpLpbijd9ZG3Z6PLzJMKInRRkqZaSCcUFL3aBzOGbXoT fgfcElWcC4RqLz282TrhkGqkcWhzzTe/7D/1OMwTnt7gxOmcDoleaelDFnaOYE7e e9rgaV1LSWo8f809Qj1Nrthl7qyJGwRtxCgNT+7H2F8U0SgoZ7s7Zw4CJzsM37V7 GPBzaDQiQHYZseOpx929tVpoq9YHfTJ8yv2PWpvy+PSQkW/LtAkSkRLnoj2ZSqlZ 8qG2OPxwIcuKNqcKwT9XwecE8p8PpTDi7c6+re24hvOzP90iAayPfiJNaUkDJFoI LenCbvMje7rCutnxQevk2zR+exBEMw== =YZxY -----END PGP SIGNATURE----- --I+jJ9KV3mEhwMKrr-- From nobody Fri Aug 27 11:22:36 2021 X-Original-To: freebsd-current@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 1E62A17A7E00 for ; Fri, 27 Aug 2021 11:22:40 +0000 (UTC) (envelope-from grahamperrin@gmail.com) Received: from mail-wm1-x32f.google.com (mail-wm1-x32f.google.com [IPv6:2a00:1450:4864:20::32f]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "GTS CA 1O1" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4Gwy4G6mnHz4gD2 for ; Fri, 27 Aug 2021 11:22:38 +0000 (UTC) (envelope-from grahamperrin@gmail.com) Received: by mail-wm1-x32f.google.com with SMTP id g135so3627875wme.5 for ; Fri, 27 Aug 2021 04:22:38 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=subject:to:references:from:message-id:date:user-agent:mime-version :in-reply-to:content-transfer-encoding:content-language; bh=hExiQQszVw1baai9XcX7WX0r1qVTnlNdIWAzJddPCrc=; b=Sg48WC2lKYPZkUVolJ9yey9Hmyzw18dqHbJhaiWMSw8CIrh7HCMd72koL8jKU9y7AF 3BS5m8PaYIYbni96/DLvrLe8nCt/Ad0hqA+oCGMIyCO2iYUoU9enzy/1kdn08LLQOFxH OrL0J6MWLrnf7WrurlAzpKNDTdUoIjYfBkuTpZx0CmlXJ/cdbtZsxxKOHsITRs8480Pw GTmf6L5PejAzo2fNw94wdWaUvg2v3X98UkblTEv1mdpEc14p0DOCQtm3Q7YeKSz9+iyf Af9FUaLly1IF4Z0c3Y5c5HGY8t6SLbzf0RwsFTlbqwLz1FbFCMAGgU1JP8rD56l8JfwC CtVg== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:subject:to:references:from:message-id:date :user-agent:mime-version:in-reply-to:content-transfer-encoding :content-language; bh=hExiQQszVw1baai9XcX7WX0r1qVTnlNdIWAzJddPCrc=; b=fKEPvGgiQELcnv1Rav5eTDnHt/neWyLJ6f0w1ErpbQM7lKPkzJvwpgahUa+NOc7ko3 zdwgfiZ64JBCDe77m/pUkDyPXt50JDESFjihmJY69ARy/uGcs1TfMx2KkCJJU7qQXLDt 7llt9kT0mID6PTrTIBS/DHAUpCbsPhCQMNZAYgVzK2o1wuYTgdEs9TmZ3Vn+PN2l1uyd 99ub3PfVJMA2NpHu0i/TXiOA5VpmQQIeoZJJXcIXW1A46GhqUvY9qzkfDpwlTq7XjPJk IqWfLHEcxmUBcOBvX0v3UXvyjY6SHNlHuaUkn+zJWnseM2pficesOp+E5KLLlBGdcwvf LfFw== X-Gm-Message-State: AOAM533IVDCeGrhgg/sqYBZJ3+yxywqqhnyANpSNeIIZPtwdgivO2J09 0vD5sXePYVJZxc/m2ltRUJN8pBjjQKsKWA== X-Google-Smtp-Source: ABdhPJwUdaBZ0n7dHIRVbo3x/P12c+AAUUdMzT5GzzKux3WgH7UTNQuoWXqP2n9l/ZLCj8+xeDfvNQ== X-Received: by 2002:a7b:c401:: with SMTP id k1mr12068957wmi.141.1630063357628; Fri, 27 Aug 2021 04:22:37 -0700 (PDT) Received: from ?IPv6:2001:470:1f1c:a0::2? (tunnel642390-pt.tunnel.tserv1.lon2.ipv6.he.net. [2001:470:1f1c:a0::2]) by smtp.gmail.com with ESMTPSA id g5sm6051072wrq.80.2021.08.27.04.22.37 for (version=TLS1_3 cipher=TLS_AES_128_GCM_SHA256 bits=128/128); Fri, 27 Aug 2021 04:22:37 -0700 (PDT) Subject: Re: Encrypted swap partition no longer encrypted To: freebsd-current@freebsd.org References: <149845085.13.1630055426223@localhost> From: Graham Perrin Message-ID: Date: Fri, 27 Aug 2021 12:22:36 +0100 User-Agent: Mozilla/5.0 (X11; FreeBSD amd64; rv:78.0) Gecko/20100101 Thunderbird/78.13.0 List-Id: Discussions about the use of FreeBSD-current List-Archive: https://lists.freebsd.org/archives/freebsd-current List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-current@freebsd.org MIME-Version: 1.0 In-Reply-To: <149845085.13.1630055426223@localhost> Content-Type: text/plain; charset=utf-8; format=flowed Content-Transfer-Encoding: 8bit Content-Language: en-GB X-Rspamd-Queue-Id: 4Gwy4G6mnHz4gD2 X-Spamd-Bar: --- Authentication-Results: mx1.freebsd.org; dkim=pass header.d=gmail.com header.s=20161025 header.b=Sg48WC2l; dmarc=pass (policy=none) header.from=gmail.com; spf=pass (mx1.freebsd.org: domain of grahamperrin@gmail.com designates 2a00:1450:4864:20::32f as permitted sender) smtp.mailfrom=grahamperrin@gmail.com X-Spamd-Result: default: False [-4.00 / 15.00]; ARC_NA(0.00)[]; RCVD_VIA_SMTP_AUTH(0.00)[]; R_DKIM_ALLOW(-0.20)[gmail.com:s=20161025]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; FROM_HAS_DN(0.00)[]; R_SPF_ALLOW(-0.20)[+ip6:2a00:1450:4000::/36:c]; FREEMAIL_FROM(0.00)[gmail.com]; MIME_GOOD(-0.10)[text/plain]; PREVIOUSLY_DELIVERED(0.00)[freebsd-current@freebsd.org]; TO_DN_NONE(0.00)[]; RCPT_COUNT_ONE(0.00)[1]; NEURAL_HAM_LONG(-1.00)[-1.000]; RCVD_COUNT_THREE(0.00)[3]; TO_MATCH_ENVRCPT_ALL(0.00)[]; DKIM_TRACE(0.00)[gmail.com:+]; DMARC_POLICY_ALLOW(-0.50)[gmail.com,none]; RCVD_IN_DNSWL_NONE(0.00)[2a00:1450:4864:20::32f:from]; NEURAL_HAM_SHORT(-1.00)[-0.998]; FROM_EQ_ENVFROM(0.00)[]; MIME_TRACE(0.00)[0:+]; FREEMAIL_ENVFROM(0.00)[gmail.com]; ASN(0.00)[asn:15169, ipnet:2a00:1450::/32, country:US]; RCVD_TLS_ALL(0.00)[]; MID_RHS_MATCH_FROM(0.00)[]; DWL_DNSWL_NONE(0.00)[gmail.com:dkim] X-ThisMailContainsUnwantedMimeParts: N On 27/08/2021 10:10, Ronald Klop wrote: > … change "/dev/ada0p2" to "/dev/ada0p2.eli" in the new fstab and reboot. … Strange, I thought I tried that before writing. One of the first things that I would have tried. Anyhow: now, it has the required effect. ---- An additional mystery. Before replacement of the internal hard disk, I had swap at: /dev/ada0p3.eli With that disk now external, in the dock on USB, metadata can not be read (geli attach fails). I'm happy for this to remain mysterious; assume that non-encrypted data somehow crept in, use sswap(1) to securely delete whatever might be there. ---- % swapinfo Device          1M-blocks     Used    Avail Capacity /dev/ada0p2.eli     16384        0    16384     0% % sysrc dumpdev dumpdev: /dev/ada0p2.eli % grep swap /etc/fstab | grep -v \# /dev/ada0p2.eli none                    swap sw,late                    0     0 % sudo geli attach /dev/da0p3 grahamperrin's password: geli: Cannot read metadata from /dev/da0p3: Invalid argument. geli: There was an error with at least one provider. % lsblk DEVICE         MAJ:MIN SIZE TYPE                                          LABEL MOUNT ada0             0:121 932G GPT                                               - -   ada0p1         0:123 260M efi gpt/efiboot0 -            -:-   1.0M -                                                 - -   ada0p2         0:125  16G freebsd-swap                              gpt/swap0 SWAP   ada0p2.eli     2:67   16G freebsd-swap                                      - SWAP   ada0p3         0:127 915G freebsd-zfs                                gpt/zfs0   ada0p3.eli     0:135 915G zfs                                               - -            -:-   708K -                                                 - - cd0              0:129   0B -                                                 - - da0              0:184 466G GPT                                               - -   da0p1          0:189 200M efi msdosfs/EFISYS -   da0p2          0:192 512K freebsd-boot gpt/gptboot0 -            -:-   492K -                                                 - -   da0p3          0:193  16G freebsd-swap                              gpt/swap0 SWAP   da0p4          0:194 450G freebsd-zfs                                gpt/zfs0   da0p4.eli      0:198 450G zfs                                               - -            -:-   4.0K -                                                 - - da1              0:199   0B -                                                 - - da2              0:200   0B -                                                 - - da3              0:203   0B -                                                 - - da4              0:208   0B -                                                 - - da5              0:217 466G GPT                                               - -            -:-   1.0M -                                                 - -   da5p1          0:218 466G freebsd-zfs gpt/Transcend da6              0:225  14G GPT                                               - -            -:-   1.0M -                                                 - -   da6p1          0:226  14G freebsd-zfs gpt/cache-transcend da7              0:247  29G GPT                                               - -   da7p1          0:248  29G freebsd-zfs gpt/cache-august % sudo geli attach da0p3 geli: Cannot read metadata from da0p3: Invalid argument. geli: There was an error with at least one provider. % fstyp /dev/da0p3 fstyp: /dev/da0p3: filesystem not recognized % From nobody Fri Aug 27 11:26:50 2021 X-Original-To: freebsd-current@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 3000E17742D8 for ; Fri, 27 Aug 2021 11:27:00 +0000 (UTC) (envelope-from grahamperrin@gmail.com) Received: from mail-wr1-x42d.google.com (mail-wr1-x42d.google.com [IPv6:2a00:1450:4864:20::42d]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "GTS CA 1O1" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4Gwy9G6LmHz4kJk for ; Fri, 27 Aug 2021 11:26:58 +0000 (UTC) (envelope-from grahamperrin@gmail.com) Received: by mail-wr1-x42d.google.com with SMTP id x6so1657267wrv.13 for ; Fri, 27 Aug 2021 04:26:58 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=subject:from:to:references:message-id:date:user-agent:mime-version :in-reply-to:content-transfer-encoding:content-language; bh=b1vqkxEeN9SpAHyyZYaagd2Ydyy8y5hUx+d9IpnUaiY=; b=YmwVwmKg02e891/HhdVpyPzVrdODNef+P28VwhPBtk9vKExHngIgnFHg30/KJ+bniM US4WsDeDemAwCVkKxZFnRhn1oXYPSrttCOE4lSm2GQYNtVLc+ysqr6cy8Tx2Osd66Tnl W1PvlJovsWBqMjGKpjnlxEfKpseDLXYQXfaQnXhoKR2KcP+c1++6+G3S5PcioYFEPX/A cI+ciJWg+VxW6JCZXsA19OlvKbPj6Jkae2Jw9nfEV80KaAE4L+C0vMdHAcbxUURcxRQY GVO3EatNbtIf8dokvkCUTgWN0zySmd/NBWDeM0Tx+qA/okdriAc6XgZO4R6o0/+aX0V4 V48w== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:subject:from:to:references:message-id:date :user-agent:mime-version:in-reply-to:content-transfer-encoding :content-language; bh=b1vqkxEeN9SpAHyyZYaagd2Ydyy8y5hUx+d9IpnUaiY=; b=WkEwxESQKt7aqGeQ5BBMkoV6P/Bq7lzKq5Cf0k+ymI1ie3faXd83dGNRvZiB32IMAr P3B/xXtZyvXxEb3fJuYhLXpR/cR1i80SoaSqEndSjFrXns+oagFZzNpY5GjBvM6QvEud nq3SXBzGRAwsRcOzI27rNlT+Gaug/aqBLulB40vVGZUkCt7xiF7/LfQfy8/zmr1djnlN axM226e4S/DZJeQIm6J3YA11UkzYSRDfeEheToSFmQwCevAPYjKSrTzl9dpw8yICvQIz QqWbvxm/U/1E3gDlUVJsss3IcF1m91mWVaMjm3bOkDq2fD+T8pKGnDk3sPqO5D/lz03R 0Xfw== X-Gm-Message-State: AOAM533dQgmFALu7dEsJ4fNVOrKBIG+f7nfCEVzXeh+69GcKCKymn1td HMhWju86PG9oEI0oKhWu7MtOAqnjiHcyKA== X-Google-Smtp-Source: ABdhPJxQAvW3o78ximJOW62cM88/du/Vq/vYLKjoHqPkFhrJCQ3M7Bbl0z+cWBzt+4WJ4A5jymfIKA== X-Received: by 2002:adf:eb8d:: with SMTP id t13mr9851052wrn.4.1630063611873; Fri, 27 Aug 2021 04:26:51 -0700 (PDT) Received: from ?IPv6:2001:470:1f1c:a0::2? (tunnel642390-pt.tunnel.tserv1.lon2.ipv6.he.net. [2001:470:1f1c:a0::2]) by smtp.gmail.com with ESMTPSA id y6sm7234126wrm.54.2021.08.27.04.26.51 for (version=TLS1_3 cipher=TLS_AES_128_GCM_SHA256 bits=128/128); Fri, 27 Aug 2021 04:26:51 -0700 (PDT) Subject: dumpdev and encrypted swap From: Graham Perrin To: freebsd-current@freebsd.org References: <149845085.13.1630055426223@localhost> Message-ID: Date: Fri, 27 Aug 2021 12:26:50 +0100 User-Agent: Mozilla/5.0 (X11; FreeBSD amd64; rv:78.0) Gecko/20100101 Thunderbird/78.13.0 List-Id: Discussions about the use of FreeBSD-current List-Archive: https://lists.freebsd.org/archives/freebsd-current List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-current@freebsd.org MIME-Version: 1.0 In-Reply-To: Content-Type: text/plain; charset=utf-8; format=flowed Content-Transfer-Encoding: 7bit Content-Language: en-GB X-Rspamd-Queue-Id: 4Gwy9G6LmHz4kJk X-Spamd-Bar: --- Authentication-Results: mx1.freebsd.org; dkim=pass header.d=gmail.com header.s=20161025 header.b=YmwVwmKg; dmarc=pass (policy=none) header.from=gmail.com; spf=pass (mx1.freebsd.org: domain of grahamperrin@gmail.com designates 2a00:1450:4864:20::42d as permitted sender) smtp.mailfrom=grahamperrin@gmail.com X-Spamd-Result: default: False [-3.98 / 15.00]; RCVD_VIA_SMTP_AUTH(0.00)[]; ARC_NA(0.00)[]; R_DKIM_ALLOW(-0.20)[gmail.com:s=20161025]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; FROM_HAS_DN(0.00)[]; FREEMAIL_FROM(0.00)[gmail.com]; TO_MATCH_ENVRCPT_ALL(0.00)[]; MIME_GOOD(-0.10)[text/plain]; PREVIOUSLY_DELIVERED(0.00)[freebsd-current@freebsd.org]; TO_DN_NONE(0.00)[]; RCPT_COUNT_ONE(0.00)[1]; NEURAL_HAM_LONG(-1.00)[-1.000]; RCVD_COUNT_THREE(0.00)[3]; R_SPF_ALLOW(-0.20)[+ip6:2a00:1450:4000::/36]; DKIM_TRACE(0.00)[gmail.com:+]; DMARC_POLICY_ALLOW(-0.50)[gmail.com,none]; RCVD_IN_DNSWL_NONE(0.00)[2a00:1450:4864:20::42d:from]; NEURAL_HAM_SHORT(-0.98)[-0.978]; FROM_EQ_ENVFROM(0.00)[]; MIME_TRACE(0.00)[0:+]; FREEMAIL_ENVFROM(0.00)[gmail.com]; ASN(0.00)[asn:15169, ipnet:2a00:1450::/32, country:US]; RCVD_TLS_ALL(0.00)[]; MID_RHS_MATCH_FROM(0.00)[]; DWL_DNSWL_NONE(0.00)[gmail.com:dkim] X-ThisMailContainsUnwantedMimeParts: N On 27/08/2021 12:22, Graham Perrin wrote: > % sysrc dumpdev > dumpdev: /dev/ada0p2.eli Correcting myself dumpdev: /dev/ada0p2 From nobody Fri Aug 27 11:40:33 2021 X-Original-To: freebsd-current@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 170841785398 for ; Fri, 27 Aug 2021 11:40:53 +0000 (UTC) (envelope-from jlehen@gmail.com) Received: from mail-il1-f182.google.com (mail-il1-f182.google.com [209.85.166.182]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "GTS CA 1O1" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4GwyTH63Glz4qYl for ; Fri, 27 Aug 2021 11:40:51 +0000 (UTC) (envelope-from jlehen@gmail.com) Received: by mail-il1-f182.google.com with SMTP id x5so6699314ill.3 for ; Fri, 27 Aug 2021 04:40:51 -0700 (PDT) X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:from:date:message-id:subject:to; bh=zFkLd+nXJbmXqWvn8oV8tF4KwBoZBdXcD7RDHUzT/nU=; b=n6XCt2O1zYZ4ytGSbPYIr1G1gzPFN+bvfrryI69w6YFRcosixyCPEHQxMZsh/GaRdb 1ebtgfVTwpnxbYG+VnzV20xop+UgnvEngueKBtTB6o4PQHNFT+dILkJ5bYgdhj1tBXdp sWkSu0KHPYGO75FrshykGvYbAN2GwvFvL9Gz7K5QFMs+KYizq6K35CNG90tey52vZcco qW0C8pApB3/ZHpsAfMrjFMGHoN7qxm1Qh+kgvruUj+F5v/7kUU9r6U3KdspcYkqW2hcw cPNstnEXAFHOfxXjbcNOMJntacZsfftjq4MCykRV7xcfo7VjSJIk9qLXSFi1ire075me Nq7g== X-Gm-Message-State: AOAM532x1TtRpnAxThsXkv1vYE4ZNWbjZBDa5flzjfmxOJjvoKVEp/9d gPg7IfHEPpuaumXCNCvQ6Xx7V5RPqFH2bCCy7tC09bMnbTLx9bBD X-Google-Smtp-Source: ABdhPJztgRt17Dey1jDr1XIV4kwaSw4nSsBjdt/E2jAnGYfh9pG4Sk+X9Knf8trDUoDY/4T6/1sfvlgpuGMAZXbCXbw= X-Received: by 2002:a92:4b02:: with SMTP id m2mr3296430ilg.94.1630064444574; Fri, 27 Aug 2021 04:40:44 -0700 (PDT) List-Id: Discussions about the use of FreeBSD-current List-Archive: https://lists.freebsd.org/archives/freebsd-current List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-current@freebsd.org MIME-Version: 1.0 From: Jeremie Le Hen Date: Fri, 27 Aug 2021 13:40:33 +0200 Message-ID: Subject: ZFS crash with -CURRENT from Aug 23rd To: FreeBSD Current Content-Type: text/plain; charset="UTF-8" X-Rspamd-Queue-Id: 4GwyTH63Glz4qYl X-Spamd-Bar: -- Authentication-Results: mx1.freebsd.org; dkim=none; dmarc=none; spf=pass (mx1.freebsd.org: domain of jlehen@gmail.com designates 209.85.166.182 as permitted sender) smtp.mailfrom=jlehen@gmail.com X-Spamd-Result: default: False [-2.66 / 15.00]; ARC_NA(0.00)[]; FREEMAIL_ENVFROM(0.00)[gmail.com]; RCVD_TLS_ALL(0.00)[]; FROM_HAS_DN(0.00)[]; R_SPF_ALLOW(-0.20)[+ip4:209.85.128.0/17:c]; TO_MATCH_ENVRCPT_ALL(0.00)[]; MIME_GOOD(-0.10)[text/plain]; PREVIOUSLY_DELIVERED(0.00)[freebsd-current@freebsd.org]; DMARC_NA(0.00)[freebsd.org]; RCPT_COUNT_ONE(0.00)[1]; NEURAL_HAM_LONG(-0.71)[-0.706]; NEURAL_HAM_MEDIUM(-1.00)[-0.999]; TO_DN_ALL(0.00)[]; NEURAL_HAM_SHORT(-0.95)[-0.952]; RCVD_IN_DNSWL_NONE(0.00)[209.85.166.182:from]; FORGED_SENDER(0.30)[jlh@freebsd.org,jlehen@gmail.com]; RWL_MAILSPIKE_POSSIBLE(0.00)[209.85.166.182:from]; R_DKIM_NA(0.00)[]; MIME_TRACE(0.00)[0:+]; RCVD_COUNT_TWO(0.00)[2]; ASN(0.00)[asn:15169, ipnet:209.85.128.0/17, country:US]; FROM_NEQ_ENVFROM(0.00)[jlh@freebsd.org,jlehen@gmail.com]; TO_DOM_EQ_FROM_DOM(0.00)[] X-ThisMailContainsUnwantedMimeParts: N Hey, I can consistently crash my machine by creating a directory using Samba: Tracing pid 57242 tid 270954 td 0xfffffe01446941e0 kdb_enter() at kdb_enter+0x37/frame 0xfffffe0147380210 vpanic() at vpanic+0x1b2/frame 0xfffffe0147380260 spl_panic() at spl_panic+0x3a/frame 0xfffffe01473802c0 zfs_sa_get_xattr() at zfs_sa_get_xattr+0x1ac/frame 0xfffffe0147380300 zfs_ensure_xattr_cached() at zfs_ensure_xattr_cached+0x6c/frame 0xfffffe0147380330 zfs_deleteextattr_sa() at zfs_deleteextattr_sa+0x1e/frame 0xfffffe0147380360 zfs_setextattr() at zfs_setextattr+0x1e3/frame 0xfffffe01473804e0 VOP_SETEXTATTR_APV() at VOP_SETEXTATTR_APV+0x40/frame 0xfffffe0147380500 null_bypass() at null_bypass+0xf6/frame 0xfffffe0147380680 VOP_SETEXTATTR_APV() at VOP_SETEXTATTR_APV+0x40/frame 0xfffffe01473806a0 extattr_set_vp() at extattr_set_vp+0x11d/frame 0xfffffe0147380770 kern_extattr_set_path() at kern_extattr_set_path+0x181/frame 0xfffffe01473809a0 sys_extattr_set_file() at sys_extattr_set_file+0x29/frame 0xfffffe01473809c0 amd64_syscall() at amd64_syscall+0x12e/frame 0xfffffe0147380af0 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe0147380af0 Let me know if I can provide further information. -- Jeremie Le Hen jlh@FreeBSD.org From nobody Fri Aug 27 13:41:30 2021 X-Original-To: freebsd-current@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 3EBDB179FAA2 for ; Fri, 27 Aug 2021 13:41:42 +0000 (UTC) (envelope-from tijl@freebsd.org) Received: from mailsec216.isp.belgacom.be (mailsec216.isp.belgacom.be [195.238.22.112]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client CN "relay.skynet.be", Issuer "GlobalSign RSA OV SSL CA 2018" (not verified)) by mx1.freebsd.org (Postfix) with ESMTPS id 4Gx18j3BkNz4WRN; Fri, 27 Aug 2021 13:41:41 +0000 (UTC) (envelope-from tijl@freebsd.org) IronPort-SDR: 8qN7Ko9WjiI+CVUCOH0Dfykg1M/6UvhLHi10NbKIYWO29YQ7u0InPAWN9IovD9ja22/eNI3GNA XMm6K4JdfpN6pI0QzdCFuNQ9uilnlEW7AyKcB4qB1nF3cDrIScubrDkxzqztn+OoZ2KQ39sPlS z9CLkzvD9+znCR/2uTtxj0AGMqyox3fX4I/lhSjmWj64pu1+uxPXMBChbdLEz/niHFGOOx9QQZ 9/MRw202wGL+0JjpU5hZtb6NtNnc469NVXPagicXYCsw2x/8hSaUXLps0/M07fJS+V8hsQvDGz 0Q4= X-IPAS-Result: =?us-ascii?q?A2AnAABu6ihh/wSs8lFaHAEBAQEBAQcBARIBAQQEAQFAC?= =?us-ascii?q?YE8BwEBCwGDDGsBUY0FYIVigl8Bgm2YUYF8CwEBAQEBAQEBAUoEAQGHHyY0C?= =?us-ascii?q?Q4BAgQBAQEBAwIDAQEBAQUBAQYBAQEBAQEFBAGBI4UvRoI1IoQsaIEVAYYPq?= =?us-ascii?q?nWBM4EBhGiDZ4EngToBiX2EP4FLQoZOiG0EinWfSp1+glpbnkBHlViRJJYXp?= =?us-ascii?q?zJmgS5NMAiDJU8ZD44sFo4wPwNoAgYLAQEDCY8cAQ?= IronPort-PHdr: A9a23:rN6+Yh8Ziy0Eqv9uWdO8ngc9DxPPW53KNwIYoqAql6hJOvz6uci4Z AqGvK4m1geBdL6YwsoMs/DRvaHkVD5Iyre6m1dGTqZxUQQYg94dhQ0qDZ3NI0T6KPn3c35yR 5waBxdq8H6hLEdaBtv1aUHMrX2u9z4SHQj0ORZoKujvFYPekdi72/qv95HObQhEiySxba9vJ xiqsAvdsdUbj5F/Iagr0BvJpXVIe+VSxWx2IF+Yggjx6MSt8pN96ipco/0u+dJOXqX8ZKQ4U KdXDC86PGAv5c3krgfMQA2S7XYBSGoWkx5IAw/Y7BHmW5r6ryX3uvZh1CScIMb7S60/Vza/4 KdxUBLmhicJOSAk/m/UhcN/kK1VrQm9pxF92YPYfJ2ZOOZgcq7bYNgURXBBXsFUVyFZHI2+a o8PBPcfMOZfqIn9vEUBrR6kCgmqH+Pk1zhFhmP33a041+QsCgHI3BY+EN0QrXnasdv7OL0VU eCvw6nF1DPOZO5Z1jnh8obHaAwhoe2SUrJqd8rc0UsiGgDKgFiOp4LrMC6Y2+ADvmWG4ORuV eGihWEjpgx1pjWi28gihpXIi48axF3K+zh0zokpKNO3S0N2b8OoHIdWuiqHNIV2WtsvTmJ1t Cog1LELtoC3cDIXxJkl2RLTcfOKfo6V6Rz5TumROy13hHd9dbK6gBa97Favx/XnVsmxzFZKt i1FksTQtnwV1xzc9MyHSvxl80eiwzmP0wHT6uRaLkAukqrXMYIhwr8ylpoXq0jMAij2mELtj KCIc0Ur4O6o6//9brXhvJ+cOJd4igD4MqswhsyyGec1PhUUU2SF9umwyqfv8VD7TblUlPE7n bHVsJXAKsQaoq65DRVV0oEm6xunEzem0dYYnX0cIVJLYhKIkZbmNErVIP/lF/u/hE6skDhzy /DcIrLhGonNLmTEkLr5c7Z98VBTxxQowtBE+p1YE60OIO/pWk/rqtPYCAM5Phe6w+b9Ftpyy JgRWXmSDaODN6PSq1CI7Po1I+aQfI8VpCr9K/896vHzjH85nEQQfaez3ZQJdn+3Be9mLFiDb XrrmNcBHjRCgg1rYO3viUGYQHZ6YXqoXql0sj06DaqIF4rObLuBxrub03H/VpNMa21MEVzJG mrybYiCR98ici+fCPRN1DseWuuPUYgkgC1JsEfRzL18I+/d/DZQ4Y7i1txdyffemDsJ2XpzF cvLgDLFdH19gm5dH2x+56t4u0Eokj++ IronPort-HdrOrdr: A9a23:LcqnMKnmb7bYZ0OF/5OqKMJNXiPpDfLz3DAbv31ZSRFFG/Fw9v re+8jzuiWatN6OMEtQ4OxoVJPvfZq+z+8Q3WByB8bBYOCOggLBR+sOgbcKpQeBJ8VmndQts5 uIXJIeNDSaNykesS+V2njaLz6WreP3i5yAtKPi6VcoYTBSV5pPxzpUKivzKDwNeOGRaKBJaa a01456gwDIQwVuUviG X-IronPort-Anti-Spam-Filtered: true Received: from 4.172-242-81.adsl-dyn.isp.belgacom.be (HELO kalimero.tijl.coosemans.org) ([81.242.172.4]) by relay.proximus.be with ESMTP; 27 Aug 2021 15:41:33 +0200 Received: from localhost (localhost [127.0.0.1]) by kalimero.tijl.coosemans.org (8.16.1/8.16.1) with ESMTP id 17RDfVK4002405; Fri, 27 Aug 2021 15:41:31 +0200 (CEST) (envelope-from tijl@FreeBSD.org) Date: Fri, 27 Aug 2021 15:41:30 +0200 From: =?UTF-8?B?VMSzbA==?= Coosemans To: Dimitry Andric , freebsd-current@FreeBSD.org Subject: i386 kernel modules unusable due to .plt sections Message-ID: <20210827154130.7a5b141c@FreeBSD.org> List-Id: Discussions about the use of FreeBSD-current List-Archive: https://lists.freebsd.org/archives/freebsd-current List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-current@freebsd.org MIME-Version: 1.0 Content-Type: text/plain; charset=US-ASCII Content-Transfer-Encoding: 7bit X-Rspamd-Queue-Id: 4Gx18j3BkNz4WRN X-Spamd-Bar: / Authentication-Results: mx1.freebsd.org; none X-Spamd-Result: default: False [0.00 / 15.00]; local_wl_from(0.00)[freebsd.org]; ASN(0.00)[asn:5432, ipnet:195.238.0.0/19, country:BE] X-ThisMailContainsUnwantedMimeParts: N Hi, I use devel/llvm* to build base and just switched to llvm12. It seems that on i386 clang12 uses R_386_PLT32 relocations for some calls to at least memset, memcpy and __stack_chk_fail (clang11 uses R_386_PC32). These are converted to R_386_JMP_SLOT relocations by the linker which aren't supported by the kernel, e.g. loading linux.ko gives "kldload: unexpected relocation type" from sys/i386/i386/elf_machdep.c. The PLT entries also depend on a base pointer in %ebx but kernel modules aren't compiled with -fPIC, so this can't work and I suspect this is a regression in clang12. The following code shows the difference between clang11 and clang12: -------- #include void * test_memset(void *p, int c, size_t len) { return (memset(p, c, len)); } void * test_memcpy(void *dst, const void *src, size_t len) { return (memcpy(dst, src, len)); } void * test_memmove(void *dst, const void *src, size_t len) { return (memmove(dst, src, len)); } -------- Output of "readelf -r test.o" when compiled with "clang12 -c test.c -m32": r_offset r_info r_type st_value st_name 0000002c 00000504 R_386_PLT32 00000000 memset 00000067 00000304 R_386_PLT32 00000000 memcpy 000000a7 00000402 R_386_PC32 00000000 memmove With clang11: r_offset r_info r_type st_value st_name 00000036 00000502 R_386_PC32 00000000 memset 00000083 00000302 R_386_PC32 00000000 memcpy 000000d2 00000402 R_386_PC32 00000000 memmove From nobody Fri Aug 27 14:24:58 2021 X-Original-To: freebsd-current@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 1519E178DACD for ; Fri, 27 Aug 2021 14:25:12 +0000 (UTC) (envelope-from kostikbel@gmail.com) Received: from kib.kiev.ua (kib.kiev.ua [IPv6:2001:470:d5e7:1::1]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4Gx26v5bNbz4mMM; Fri, 27 Aug 2021 14:25:11 +0000 (UTC) (envelope-from kostikbel@gmail.com) Received: from tom.home (kib@localhost [127.0.0.1]) by kib.kiev.ua (8.16.1/8.16.1) with ESMTPS id 17REOwIL055119 (version=TLSv1.3 cipher=TLS_AES_256_GCM_SHA384 bits=256 verify=NO); Fri, 27 Aug 2021 17:25:01 +0300 (EEST) (envelope-from kostikbel@gmail.com) DKIM-Filter: OpenDKIM Filter v2.10.3 kib.kiev.ua 17REOwIL055119 Received: (from kostik@localhost) by tom.home (8.16.1/8.16.1/Submit) id 17REOwlN055118; Fri, 27 Aug 2021 17:24:58 +0300 (EEST) (envelope-from kostikbel@gmail.com) X-Authentication-Warning: tom.home: kostik set sender to kostikbel@gmail.com using -f Date: Fri, 27 Aug 2021 17:24:58 +0300 From: Konstantin Belousov To: =?utf-8?Q?T=C4=B3l?= Coosemans Cc: Dimitry Andric , freebsd-current@freebsd.org Subject: Re: i386 kernel modules unusable due to .plt sections Message-ID: References: <20210827154130.7a5b141c@FreeBSD.org> List-Id: Discussions about the use of FreeBSD-current List-Archive: https://lists.freebsd.org/archives/freebsd-current List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-current@freebsd.org MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Disposition: inline Content-Transfer-Encoding: 8bit In-Reply-To: <20210827154130.7a5b141c@FreeBSD.org> X-Spam-Status: No, score=-1.0 required=5.0 tests=ALL_TRUSTED,BAYES_00, DKIM_ADSP_CUSTOM_MED,FORGED_GMAIL_RCVD,FREEMAIL_FROM, NML_ADSP_CUSTOM_MED autolearn=no autolearn_force=no version=3.4.5 X-Spam-Checker-Version: SpamAssassin 3.4.5 (2021-03-20) on tom.home X-Rspamd-Queue-Id: 4Gx26v5bNbz4mMM X-Spamd-Bar: ---- Authentication-Results: mx1.freebsd.org; none X-Spamd-Result: default: False [-4.00 / 15.00]; REPLY(-4.00)[] X-ThisMailContainsUnwantedMimeParts: N On Fri, Aug 27, 2021 at 03:41:30PM +0200, Tijl Coosemans wrote: > Hi, > > I use devel/llvm* to build base and just switched to llvm12. It seems > that on i386 clang12 uses R_386_PLT32 relocations for some calls to at > least memset, memcpy and __stack_chk_fail (clang11 uses R_386_PC32). > These are converted to R_386_JMP_SLOT relocations by the linker which > aren't supported by the kernel, e.g. loading linux.ko gives "kldload: > unexpected relocation type" from sys/i386/i386/elf_machdep.c. The PLT > entries also depend on a base pointer in %ebx but kernel modules aren't > compiled with -fPIC, so this can't work and I suspect this is a > regression in clang12. > > The following code shows the difference between clang11 and clang12: > > -------- > #include > > void * > test_memset(void *p, int c, size_t len) { > return (memset(p, c, len)); > } > > void * > test_memcpy(void *dst, const void *src, size_t len) { > return (memcpy(dst, src, len)); > } > > void * > test_memmove(void *dst, const void *src, size_t len) { > return (memmove(dst, src, len)); > } > -------- > > Output of "readelf -r test.o" when compiled with "clang12 -c test.c -m32": > r_offset r_info r_type st_value st_name > 0000002c 00000504 R_386_PLT32 00000000 memset > 00000067 00000304 R_386_PLT32 00000000 memcpy > 000000a7 00000402 R_386_PC32 00000000 memmove > > With clang11: > r_offset r_info r_type st_value st_name > 00000036 00000502 R_386_PC32 00000000 memset > 00000083 00000302 R_386_PC32 00000000 memcpy > 000000d2 00000402 R_386_PC32 00000000 memmove Are you asking (for somebody) to add R_386_JMP_SLOT to i386/elf_machdep.c? Like this, not even built. diff --git a/sys/i386/i386/elf_machdep.c b/sys/i386/i386/elf_machdep.c index 3754b36d9e33..a26a4189e0ee 100644 --- a/sys/i386/i386/elf_machdep.c +++ b/sys/i386/i386/elf_machdep.c @@ -245,6 +245,7 @@ elf_reloc_internal(linker_file_t lf, Elf_Addr relocbase, const void *data, break; case R_386_GLOB_DAT: /* S */ + case R_386_JMP_SLOT: error = lookup(lf, symidx, 1, &addr); if (error != 0) return (-1); From nobody Fri Aug 27 14:59:27 2021 X-Original-To: freebsd-current@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id F1EC6179F7E6 for ; Fri, 27 Aug 2021 14:59:30 +0000 (UTC) (envelope-from grahamperrin@gmail.com) Received: from mail-wr1-x430.google.com (mail-wr1-x430.google.com [IPv6:2a00:1450:4864:20::430]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "GTS CA 1O1" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4Gx2tT6cjGz3H6p for ; Fri, 27 Aug 2021 14:59:29 +0000 (UTC) (envelope-from grahamperrin@gmail.com) Received: by mail-wr1-x430.google.com with SMTP id u16so10905488wrn.5 for ; Fri, 27 Aug 2021 07:59:29 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=subject:from:to:references:message-id:date:user-agent:mime-version :in-reply-to:content-language; bh=YMvsS9Eoi0/xQ3/B+2BmqDNoaCrXsijDTtpibR1J2+U=; b=UaY+ls+pNt+NppfEL9/VXz+q47TUqYhVMXxSxf9Oy38Zhh6coOOTMLJiXJdg4l1zmi zhLcftkiAvDhWyzfjdGLWrmPGMczfmdMA1Y1LXM0UZ/TbUkhiNFPABtLp6/O4EwLxX3f J0KvrMxhOQ7g1sstXg+csRN0a0xZOyRxF7NafQrrM3tzDFLKC+uyAhBxyLl68IR702EC InPygcihHcrru0IK0OqFZI8O1ZLBSukwpi6ba17Xk9vY1GYVw2LpIHZreBHu/BWp/MNT aT2lKxj5QYFBb2OBfJvZeeMMeosYe01r06sfyJGo7HMgb7SobkldJl/Qi0/5965LvYPa +Ifw== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:subject:from:to:references:message-id:date :user-agent:mime-version:in-reply-to:content-language; bh=YMvsS9Eoi0/xQ3/B+2BmqDNoaCrXsijDTtpibR1J2+U=; b=Nqx6uelVEF5eqT4FqiQX7GA8RZ3zH9S5R+G/W92SFWCymkEwHMpIBRf7dXLlO6CkFV uWty1VZXKZcAn7vpy8fIEoQ/uWek9R0aFGlCvUlV1Py6cDTvj/mzPmVaqZ1ul2BOaODj Q/Hhx0MJ2PE7cJdCCuezpFM1TUJUYuWXhz5PkzdHf+WU+M6vc+MSkPNU025qILN3iCz/ SOCvX5cVYEOBhcGrf4WBkvu9U4CsaRcp7mJBCDzLqtMpluN8s4JrCBZ/kr8sVK6DSwTS FzgPInK2O/0bPKVlC/tjmeB1KPbhiP1tG8TTtXGufCXpajBd+uU8XF+0op8vWKD0ZBMF 7K+g== X-Gm-Message-State: AOAM530t5hWT0UJrt9eaJUg4Ya5UuQmB3mswUe6He1fVlb1dpidS1WdM KPpNQjgNGDUISd01YZ82VLnR9CQLJn088w== X-Google-Smtp-Source: ABdhPJx3qGDF3+NygYSD9jVLLdGXTkXiJflFKkM+7iEv527IiZtTHxFDSU/XBQ1Sjj60RO5mpXYu1w== X-Received: by 2002:adf:ebcd:: with SMTP id v13mr10786410wrn.400.1630076368634; Fri, 27 Aug 2021 07:59:28 -0700 (PDT) Received: from ?IPv6:2001:470:1f1c:a0::2? (tunnel642390-pt.tunnel.tserv1.lon2.ipv6.he.net. [2001:470:1f1c:a0::2]) by smtp.gmail.com with ESMTPSA id w14sm6382436wrt.23.2021.08.27.07.59.27 for (version=TLS1_3 cipher=TLS_AES_128_GCM_SHA256 bits=128/128); Fri, 27 Aug 2021 07:59:28 -0700 (PDT) Subject: Experiments with sswap(1), srm(1), wipe(1), gdisk(8), lsblk and gpart(8) From: Graham Perrin To: FreeBSD CURRENT References: <149845085.13.1630055426223@localhost> Message-ID: Date: Fri, 27 Aug 2021 15:59:27 +0100 User-Agent: Mozilla/5.0 (X11; FreeBSD amd64; rv:78.0) Gecko/20100101 Thunderbird/78.13.0 List-Id: Discussions about the use of FreeBSD-current List-Archive: https://lists.freebsd.org/archives/freebsd-current List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-current@freebsd.org MIME-Version: 1.0 In-Reply-To: Content-Type: multipart/mixed; boundary="------------E96EBDC44C99AF98F1A56E5D" Content-Language: en-GB X-Rspamd-Queue-Id: 4Gx2tT6cjGz3H6p X-Spamd-Bar: - Authentication-Results: mx1.freebsd.org; dkim=pass header.d=gmail.com header.s=20161025 header.b=UaY+ls+p; dmarc=pass (policy=none) header.from=gmail.com; spf=pass (mx1.freebsd.org: domain of grahamperrin@gmail.com designates 2a00:1450:4864:20::430 as permitted sender) smtp.mailfrom=grahamperrin@gmail.com X-Spamd-Result: default: False [-1.90 / 15.00]; RCVD_VIA_SMTP_AUTH(0.00)[]; R_SPF_ALLOW(-0.20)[+ip6:2a00:1450:4000::/36:c]; FREEMAIL_FROM(0.00)[gmail.com]; HAS_ATTACHMENT(0.00)[]; MIME_BASE64_TEXT_BOGUS(1.00)[]; RCVD_COUNT_THREE(0.00)[3]; TO_DN_ALL(0.00)[]; DKIM_TRACE(0.00)[gmail.com:+]; MIME_BASE64_TEXT(0.10)[]; CTYPE_MIXED_BOGUS(1.00)[]; NEURAL_HAM_SHORT(-1.00)[-1.000]; DMARC_POLICY_ALLOW(-0.50)[gmail.com,none]; FROM_EQ_ENVFROM(0.00)[]; MIME_TRACE(0.00)[0:+,1:+,2:+]; FREEMAIL_ENVFROM(0.00)[gmail.com]; ASN(0.00)[asn:15169, ipnet:2a00:1450::/32, country:US]; MID_RHS_MATCH_FROM(0.00)[]; DWL_DNSWL_NONE(0.00)[gmail.com:dkim]; ARC_NA(0.00)[]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; R_DKIM_ALLOW(-0.20)[gmail.com:s=20161025]; FROM_HAS_DN(0.00)[]; TO_MATCH_ENVRCPT_ALL(0.00)[]; NEURAL_HAM_LONG(-1.00)[-1.000]; MIME_GOOD(-0.10)[multipart/mixed,text/plain]; PREVIOUSLY_DELIVERED(0.00)[freebsd-current@freebsd.org]; RCPT_COUNT_ONE(0.00)[1]; RCVD_IN_DNSWL_NONE(0.00)[2a00:1450:4864:20::430:from]; RCVD_TLS_ALL(0.00)[] X-ThisMailContainsUnwantedMimeParts: N This is a multi-part message in MIME format. --------------E96EBDC44C99AF98F1A56E5D Content-Type: text/plain; charset=utf-8; format=flowed Content-Transfer-Encoding: 8bit On 27/08/2021 12:22, Graham Perrin wrote: > … sswap(1) to securely delete whatever might be there. … I took an opportunity to experiment with some of the other utilities that were recently installed by security/secure_delete and security/wipe. All new to me. With reference to the attached file, a few points of interest. Some of it's PEBKAM, I don't mind sharing my mistakes. I'll report what might be an obscure bug in lsblk. ---- Line 5, misuse of srm – `srm -lv /dev/da0p3` – was followed by peculiar output from a run of lsblk. No surprise there. Lines 131–139, gdisk should have added freebsd-swap at /dev/da0p3, I ignored the suggestion to remove the hard disk drive ("Warning: The kernel may continue to use old or deleted partitions."), gpart then showed nothing (free space) where da0p3 was expected. Line 152, I used gpart to add freebsd-swap at da0p3. Lines 288–297, gdisk should have deleted /dev/da0p3, I ignored the suggestion to remove the drive, lsblk showed da0p3 still present. Lines 301–359, tail of /var/log/messages whilst I disconnected then reconnected the multi-purpose dock in which the drive was seated. Line 375, with nothing in the SD card reader at da0, lsblk showed freebsd-swap. Lines 379–383, with the hard disk drive at da4, lsblk showed nothing (free space) between da4p2 and da4p4 – the preceding deletion by gdisk was a success. Lines 418–430, gdisk succesfully added freebsd-swap at /dev/da4p3 – the partition was detected by lsblk _without_ the need to disconnect then reconnect the dock. ---- I disconnected then reconnected the dock, lsblk continues to show what I might describe as a 'ghost' where truly there's nothing in the SD card reader at da0. da0, where previously there was the hard disk drive on the JMicron USB to ATA/ATAPI bridge. --------------E96EBDC44C99AF98F1A56E5D Content-Type: text/plain; charset=UTF-8; name="2021-08-27 14-46 Konsole.txt" Content-Transfer-Encoding: base64 Content-Disposition: attachment; filename="2021-08-27 14-46 Konsole.txt" cm9vdEBtb3dhMjE5LWdqcDQtODU3MHAtZnJlZWJzZDp+ICMgc3N3YXAgLWx2IC9kZXYvZGEw cDMKRXJyb3I6IFRhcmdldCBpcyBub3QgYSBibG9jayBkZXZpY2UgLSAvZGV2L2RhMHAzCnJv b3RAbW93YTIxOS1nanA0LTg1NzBwLWZyZWVic2Q6fiAjIHNzd2FwIC1sdiBkYTBwMwpFcnJv cjogQ2FuJ3Qgb3BlbiBkYTBwMyBmb3Igd3JpdGluZy5ObyBzdWNoIGZpbGUgb3IgZGlyZWN0 b3J5CnJvb3RAbW93YTIxOS1nanA0LTg1NzBwLWZyZWVic2Q6fiAjIHNybSAtbHYgL2Rldi9k YTBwMwpVc2luZyAvZGV2L3VyYW5kb20gZm9yIHJhbmRvbSBpbnB1dC4KV2lwZSBtb2RlIGlz IGluc2VjdXJlICh0d28gcGFzc2VzIFsweGZmL3JhbmRvbV0pCldpcGluZyAvZGV2L2RhMHAz IFdhcm5pbmc6IC9kZXYvZGEwcDMgaXMgbm90IGEgcmVndWxhciBmaWxlLCByZW5hbWUvdW5s aW5rIG9ubHkhV2FybmluZzogQ291bGRuJ3QgcmVuYW1lIC9kZXYvZGEwcDMgLSBPcGVyYXRp b24gbm90IHN1cHBvcnRlZAogUmVtb3ZlZCBmaWxlIC9kZXYvZGEwcDMgLi4uIERvbmUKcm9v dEBtb3dhMjE5LWdqcDQtODU3MHAtZnJlZWJzZDp+ICMgd2lwZSAtbnYgL2Rldi9kYTBwMwp3 aXBlOiBjYW5ub3Qgc3RhdCBgL2Rldi9kYTBwMyc6IE5vIHN1Y2ggZmlsZSBvciBkaXJlY3Rv cnkKcm9vdEBtb3dhMjE5LWdqcDQtODU3MHAtZnJlZWJzZDp+ICMgbHNibGsgZGEwCkRFVklD RSAgICAgICAgIE1BSjpNSU4gU0laRSBUWVBFICAgICAgICAgICAgICAgICAgICAgICAgICAg ICAgICAgICAgICAgICAgTEFCRUwgTU9VTlQKZGEwICAgICAgICAgICAgICAwOjE4MSA0NjZH IEdQVCAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgLSAt CiAgZGEwcDEgICAgICAgICAgMDoxODQgMjAwTSBlZmkgICAgICAgICAgICAgICAgICAgICAg ICAgICAgICAgICAgbXNkb3Nmcy9FRklTWVMgLQogIGRhMHAyICAgICAgICAgIDA6MTg4IDUx MksgZnJlZWJzZC1ib290ICAgICAgICAgICAgICAgICAgICAgICAgICAgZ3B0L2dwdGJvb3Qw IC0KICA8RlJFRT4gICAgICAgICAtOi0gICA0OTJLIC0gICAgICAgICAgICAgICAgICAgICAg ICAgICAgICAgICAgICAgICAgICAgICAgICAgLSAtCnN0YXQ6IC9kZXYvZGEwcDM6IHN0YXQ6 IE5vIHN1Y2ggZmlsZSBvciBkaXJlY3RvcnkKc3RhdDogL2Rldi9kYTBwMzogc3RhdDogTm8g c3VjaCBmaWxlIG9yIGRpcmVjdG9yeQogIGRhMHAzICAgICAgICAxNkc6ZnJlZWJzZC1zd2Fw ICAgIC0gU1dBUCAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAg ICAgIAogIGRhMHA0ICAgICAgICAgIDA6MTkzIDQ1MEcgZnJlZWJzZC16ZnMgICAgICAgICAg ICAgICAgICAgICAgICAgICAgICAgIGdwdC96ZnMwIDxaRlM+CiAgZGEwcDQuZWxpICAgICAg MDoxOTYgNDUwRyB6ZnMgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAg ICAgICAgIC0gLQogIDxGUkVFPiAgICAgICAgIC06LSAgIDQuMEsgLSAgICAgICAgICAgICAg ICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAtIC0Kcm9vdEBtb3dhMjE5LWdq cDQtODU3MHAtZnJlZWJzZDp+ICMgZ2Rpc2sgL2Rldi9kYTAKR1BUIGZkaXNrIChnZGlzaykg dmVyc2lvbiAxLjAuOAoKTk9URTogV3JpdGUgdGVzdCBmYWlsZWQgd2l0aCBlcnJvciBudW1i ZXIgMS4gSXQgd2lsbCBiZSBpbXBvc3NpYmxlIHRvIHNhdmUKY2hhbmdlcyB0byB0aGlzIGRp c2sncyBwYXJ0aXRpb24gdGFibGUhCllvdSBtYXkgYmUgYWJsZSB0byBlbmFibGUgd3JpdGVz IGJ5IGV4aXRpbmcgdGhpcyBwcm9ncmFtLCB0eXBpbmcKJ3N5c2N0bCBrZXJuLmdlb20uZGVi dWdmbGFncz0xNicgYXQgYSBzaGVsbCBwcm9tcHQsIGFuZCByZS1ydW5uaW5nIHRoaXMKcHJv Z3JhbS4KClBhcnRpdGlvbiB0YWJsZSBzY2FuOgogIE1CUjogcHJvdGVjdGl2ZQogIEJTRDog bm90IHByZXNlbnQKICBBUE06IG5vdCBwcmVzZW50CiAgR1BUOiBwcmVzZW50CgpGb3VuZCB2 YWxpZCBHUFQgd2l0aCBwcm90ZWN0aXZlIE1CUjsgdXNpbmcgR1BULgoKQ29tbWFuZCAoPyBm b3IgaGVscCk6IHEKcm9vdEBtb3dhMjE5LWdqcDQtODU3MHAtZnJlZWJzZDp+ICMgbW91bnQg fCBncmVwIGRhMApyb290QG1vd2EyMTktZ2pwNC04NTcwcC1mcmVlYnNkOn4gIyBncGFydCBz aG93IGRhMAo9PiAgICAgICA0MCAgOTc2NzczMDg4ICBkYTAgIEdQVCAgKDQ2NkcpCiAgICAg ICAgIDQwICAgICA0MDk2MDAgICAgMSAgZWZpICAoMjAwTSkKICAgICA0MDk2NDAgICAgICAg MTAyNCAgICAyICBmcmVlYnNkLWJvb3QgICg1MTJLKQogICAgIDQxMDY2NCAgICAgICAgOTg0 ICAgICAgIC0gZnJlZSAtICAoNDkySykKICAgICA0MTE2NDggICAzMzU1NDQzMiAgICAzICBm cmVlYnNkLXN3YXAgICgxNkcpCiAgIDMzOTY2MDgwICA5NDI4MDcwNDAgICAgNCAgZnJlZWJz ZC16ZnMgICg0NTBHKQogIDk3Njc3MzEyMCAgICAgICAgICA4ICAgICAgIC0gZnJlZSAtICAo NC4wSykKCnJvb3RAbW93YTIxOS1nanA0LTg1NzBwLWZyZWVic2Q6fiAjIGdkaXNrIC9kZXYv ZGEwCkdQVCBmZGlzayAoZ2Rpc2spIHZlcnNpb24gMS4wLjgKCk5PVEU6IFdyaXRlIHRlc3Qg ZmFpbGVkIHdpdGggZXJyb3IgbnVtYmVyIDEuIEl0IHdpbGwgYmUgaW1wb3NzaWJsZSB0byBz YXZlCmNoYW5nZXMgdG8gdGhpcyBkaXNrJ3MgcGFydGl0aW9uIHRhYmxlIQpZb3UgbWF5IGJl IGFibGUgdG8gZW5hYmxlIHdyaXRlcyBieSBleGl0aW5nIHRoaXMgcHJvZ3JhbSwgdHlwaW5n CidzeXNjdGwga2Vybi5nZW9tLmRlYnVnZmxhZ3M9MTYnIGF0IGEgc2hlbGwgcHJvbXB0LCBh bmQgcmUtcnVubmluZyB0aGlzCnByb2dyYW0uCgpQYXJ0aXRpb24gdGFibGUgc2NhbjoKICBN QlI6IHByb3RlY3RpdmUKICBCU0Q6IG5vdCBwcmVzZW50CiAgQVBNOiBub3QgcHJlc2VudAog IEdQVDogcHJlc2VudAoKRm91bmQgdmFsaWQgR1BUIHdpdGggcHJvdGVjdGl2ZSBNQlI7IHVz aW5nIEdQVC4KCkNvbW1hbmQgKD8gZm9yIGhlbHApOiBxCnJvb3RAbW93YTIxOS1nanA0LTg1 NzBwLWZyZWVic2Q6fiAjIGdwYXJ0IGRlbGV0ZSAtaSAzIGRhMApkYTBwMyBkZWxldGVkCnJv b3RAbW93YTIxOS1nanA0LTg1NzBwLWZyZWVic2Q6fiAjIGdkaXNrIC9kZXYvZGEwCkdQVCBm ZGlzayAoZ2Rpc2spIHZlcnNpb24gMS4wLjgKCk5PVEU6IFdyaXRlIHRlc3QgZmFpbGVkIHdp dGggZXJyb3IgbnVtYmVyIDEuIEl0IHdpbGwgYmUgaW1wb3NzaWJsZSB0byBzYXZlCmNoYW5n ZXMgdG8gdGhpcyBkaXNrJ3MgcGFydGl0aW9uIHRhYmxlIQpZb3UgbWF5IGJlIGFibGUgdG8g ZW5hYmxlIHdyaXRlcyBieSBleGl0aW5nIHRoaXMgcHJvZ3JhbSwgdHlwaW5nCidzeXNjdGwg a2Vybi5nZW9tLmRlYnVnZmxhZ3M9MTYnIGF0IGEgc2hlbGwgcHJvbXB0LCBhbmQgcmUtcnVu bmluZyB0aGlzCnByb2dyYW0uCgpQYXJ0aXRpb24gdGFibGUgc2NhbjoKICBNQlI6IHByb3Rl Y3RpdmUKICBCU0Q6IG5vdCBwcmVzZW50CiAgQVBNOiBub3QgcHJlc2VudAogIEdQVDogcHJl c2VudAoKRm91bmQgdmFsaWQgR1BUIHdpdGggcHJvdGVjdGl2ZSBNQlI7IHVzaW5nIEdQVC4K CkNvbW1hbmQgKD8gZm9yIGhlbHApOiBxCnJvb3RAbW93YTIxOS1nanA0LTg1NzBwLWZyZWVi c2Q6fiAjIGxzYmxrIGRhMApERVZJQ0UgICAgICAgICBNQUo6TUlOIFNJWkUgVFlQRSAgICAg ICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgIExBQkVMIE1PVU5UCmRhMCAg ICAgICAgICAgICAgMDoxODEgNDY2RyBHUFQgICAgICAgICAgICAgICAgICAgICAgICAgICAg ICAgICAgICAgICAgICAgICAgIC0gLQogIGRhMHAxICAgICAgICAgIDA6MTg0IDIwME0gZWZp ICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgIG1zZG9zZnMvRUZJU1lTIC0KICBk YTBwMiAgICAgICAgICAwOjE4OCA1MTJLIGZyZWVic2QtYm9vdCAgICAgICAgICAgICAgICAg ICAgICAgICAgIGdwdC9ncHRib290MCAtCiAgPEZSRUU+ICAgICAgICAgLTotICAgIDE2RyAt ICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgIC0gLQog IGRhMHA0ICAgICAgICAgIDA6MTkzIDQ1MEcgZnJlZWJzZC16ZnMgICAgICAgICAgICAgICAg ICAgICAgICAgICAgICAgIGdwdC96ZnMwIDxaRlM+CiAgZGEwcDQuZWxpICAgICAgMDoxOTYg NDUwRyB6ZnMgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAg IC0gLQogIDxGUkVFPiAgICAgICAgIC06LSAgIDQuMEsgLSAgICAgICAgICAgICAgICAgICAg ICAgICAgICAgICAgICAgICAgICAgICAgICAgICAtIC0Kcm9vdEBtb3dhMjE5LWdqcDQtODU3 MHAtZnJlZWJzZDp+ICMgc3lzY3RsIGtlcm4uZ2VvbS5kZWJ1Z2ZsYWdzPTE2Cmtlcm4uZ2Vv bS5kZWJ1Z2ZsYWdzOiAwIC0+IDE2CnJvb3RAbW93YTIxOS1nanA0LTg1NzBwLWZyZWVic2Q6 fiAjIGdkaXNrIC9kZXYvZGEwCkdQVCBmZGlzayAoZ2Rpc2spIHZlcnNpb24gMS4wLjgKClBh cnRpdGlvbiB0YWJsZSBzY2FuOgogIE1CUjogcHJvdGVjdGl2ZQogIEJTRDogbm90IHByZXNl bnQKICBBUE06IG5vdCBwcmVzZW50CiAgR1BUOiBwcmVzZW50CgpGb3VuZCB2YWxpZCBHUFQg d2l0aCBwcm90ZWN0aXZlIE1CUjsgdXNpbmcgR1BULgoKQ29tbWFuZCAoPyBmb3IgaGVscCk6 IG4KUGFydGl0aW9uIG51bWJlciAoMy0xMjgsIGRlZmF1bHQgMyk6IApGaXJzdCBzZWN0b3Ig KDQxMDY2NC05NzY3NzMxMjcsIGRlZmF1bHQgPSA0MTA2NjQpIG9yIHsrLX1zaXple0tNR1RQ fTogCkxhc3Qgc2VjdG9yICg0MTA2NjQtMzM5NjYwNzksIGRlZmF1bHQgPSAzMzk2NjA3OSkg b3IgeystfXNpemV7S01HVFB9OiAKQ3VycmVudCB0eXBlIGlzIEE1MDMgKEZyZWVCU0QgVUZT KQpIZXggY29kZSBvciBHVUlEIChMIHRvIHNob3cgY29kZXMsIEVudGVyID0gQTUwMyk6IEwK VHlwZSBzZWFyY2ggc3RyaW5nLCBvciA8RW50ZXI+IHRvIHNob3cgYWxsIGNvZGVzOiBzd2Fw CjgyMDAgTGludXggc3dhcCAgICAgICAgICAgICAgICAgICAgICAgICAgYTUwMiBGcmVlQlNE IHN3YXAgICAgICAgICAgICAgICAgICAgICAgCmE1ODIgTWlkbmlnaHQgQlNEIHN3YXAgICAg ICAgICAgICAgICAgICAgYTkwMSBOZXRCU0Qgc3dhcCAgICAgICAgICAgICAgICAgICAgICAg CmJmMDIgU29sYXJpcyBzd2FwICAgICAgICAgICAgICAgICAgICAgICAgCkhleCBjb2RlIG9y IEdVSUQgKEwgdG8gc2hvdyBjb2RlcywgRW50ZXIgPSBhNTAzKTogYTUwMgpDaGFuZ2VkIHR5 cGUgb2YgcGFydGl0aW9uIHRvICdGcmVlQlNEIHN3YXAnCgpDb21tYW5kICg/IGZvciBoZWxw KTogdwoKRmluYWwgY2hlY2tzIGNvbXBsZXRlLiBBYm91dCB0byB3cml0ZSBHUFQgZGF0YS4g VEhJUyBXSUxMIE9WRVJXUklURSBFWElTVElORwpQQVJUSVRJT05TISEKCkRvIHlvdSB3YW50 IHRvIHByb2NlZWQ/IChZL04pOiB5Ck9LOyB3cml0aW5nIG5ldyBHVUlEIHBhcnRpdGlvbiB0 YWJsZSAoR1BUKSB0byAvZGV2L2RhMC4KV2FybmluZzogVGhlIGtlcm5lbCBtYXkgY29udGlu dWUgdG8gdXNlIG9sZCBvciBkZWxldGVkIHBhcnRpdGlvbnMuCllvdSBzaG91bGQgcmVib290 IG9yIHJlbW92ZSB0aGUgZHJpdmUuClRoZSBvcGVyYXRpb24gaGFzIGNvbXBsZXRlZCBzdWNj ZXNzZnVsbHkuCnJvb3RAbW93YTIxOS1nanA0LTg1NzBwLWZyZWVic2Q6fiAjIGdwYXJ0IHNo b3cgZGEwCj0+ICAgICAgIDQwICA5NzY3NzMwODggIGRhMCAgR1BUICAoNDY2RykKICAgICAg ICAgNDAgICAgIDQwOTYwMCAgICAxICBlZmkgICgyMDBNKQogICAgIDQwOTY0MCAgICAgICAx MDI0ICAgIDIgIGZyZWVic2QtYm9vdCAgKDUxMkspCiAgICAgNDEwNjY0ICAgMzM1NTU0MTYg ICAgICAgLSBmcmVlIC0gICgxNkcpCiAgIDMzOTY2MDgwICA5NDI4MDcwNDAgICAgNCAgZnJl ZWJzZC16ZnMgICg0NTBHKQogIDk3Njc3MzEyMCAgICAgICAgICA4ICAgICAgIC0gZnJlZSAt ICAoNC4wSykKCnJvb3RAbW93YTIxOS1nanA0LTg1NzBwLWZyZWVic2Q6fiAjIGxzYmxrIGRh MApERVZJQ0UgICAgICAgICBNQUo6TUlOIFNJWkUgVFlQRSAgICAgICAgICAgICAgICAgICAg ICAgICAgICAgICAgICAgICAgICAgIExBQkVMIE1PVU5UCmRhMCAgICAgICAgICAgICAgMDox ODEgNDY2RyBHUFQgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAg ICAgIC0gLQogIGRhMHAxICAgICAgICAgIDA6MTg0IDIwME0gZWZpICAgICAgICAgICAgICAg ICAgICAgICAgICAgICAgICAgIG1zZG9zZnMvRUZJU1lTIC0KICBkYTBwMiAgICAgICAgICAw OjE4OCA1MTJLIGZyZWVic2QtYm9vdCAgICAgICAgICAgICAgICAgICAgICAgICAgIGdwdC9n cHRib290MCAtCiAgPEZSRUU+ICAgICAgICAgLTotICAgIDE2RyAtICAgICAgICAgICAgICAg ICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgIC0gLQogIGRhMHA0ICAgICAgICAg IDA6MTkzIDQ1MEcgZnJlZWJzZC16ZnMgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAg IGdwdC96ZnMwIDxaRlM+CiAgZGEwcDQuZWxpICAgICAgMDoxOTYgNDUwRyB6ZnMgICAgICAg ICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgIC0gLQogIDxGUkVFPiAg ICAgICAgIC06LSAgIDQuMEsgLSAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAg ICAgICAgICAgICAgICAtIC0Kcm9vdEBtb3dhMjE5LWdqcDQtODU3MHAtZnJlZWJzZDp+ICMg Z3BhcnQgYWRkIC10IGZyZWVic2Qtc3dhcCAtaSAzIGRhMApkYTBwMyBhZGRlZApyb290QG1v d2EyMTktZ2pwNC04NTcwcC1mcmVlYnNkOn4gIyBsc2JsayBkYTAKREVWSUNFICAgICAgICAg TUFKOk1JTiBTSVpFIFRZUEUgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAg ICAgICBMQUJFTCBNT1VOVApkYTAgICAgICAgICAgICAgIDA6MTgxIDQ2NkcgR1BUICAgICAg ICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAtIC0KICBkYTBwMSAg ICAgICAgICAwOjE4NCAyMDBNIGVmaSAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAg ICBtc2Rvc2ZzL0VGSVNZUyAtCiAgZGEwcDIgICAgICAgICAgMDoxODggNTEySyBmcmVlYnNk LWJvb3QgICAgICAgICAgICAgICAgICAgICAgICAgICBncHQvZ3B0Ym9vdDAgLQogIGRhMHAz ICAgICAgICAgIDI6ODkgICAxNkcgZnJlZWJzZC1zd2FwICAgICAgICAgICAgICAgICAgICAg ICAgICAgICAgICAgICAgICAtIFNXQVAKICBkYTBwNCAgICAgICAgICAwOjE5MyA0NTBHIGZy ZWVic2QtemZzICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICBncHQvemZzMCA8WkZT PgogIGRhMHA0LmVsaSAgICAgIDA6MTk2IDQ1MEcgemZzICAgICAgICAgICAgICAgICAgICAg ICAgICAgICAgICAgICAgICAgICAgICAgICAtIC0KICA8RlJFRT4gICAgICAgICAtOi0gICA0 LjBLIC0gICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAg LSAtCnJvb3RAbW93YTIxOS1nanA0LTg1NzBwLWZyZWVic2Q6fiAjIHNtYXJ0Y3RsIC1hIC9k ZXYvZGEwIHwgZ3JlcCBSZWFsbG9jYXRlZAogIDUgUmVhbGxvY2F0ZWRfU2VjdG9yX0N0ICAg MHgwMDMzICAgMTAwICAgMTAwICAgMDA1ICAgIFByZS1mYWlsICBBbHdheXMgICAgICAgLSAg ICAgICAzMjggKDAgNDApCjE5NiBSZWFsbG9jYXRlZF9FdmVudF9Db3VudCAweDAwMzIgICAx MDAgICAxMDAgICAwMDAgICAgT2xkX2FnZSAgIEFsd2F5cyAgICAgICAtICAgICAgIDQwCnJv b3RAbW93YTIxOS1nanA0LTg1NzBwLWZyZWVic2Q6fiAjIHNzd2FwIC1sdiAvZGV2L2RhMHAz CkVycm9yOiBUYXJnZXQgaXMgbm90IGEgYmxvY2sgZGV2aWNlIC0gL2Rldi9kYTBwMwpyb290 QG1vd2EyMTktZ2pwNC04NTcwcC1mcmVlYnNkOn4gIyBsc2JsayBkYTAKREVWSUNFICAgICAg ICAgTUFKOk1JTiBTSVpFIFRZUEUgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAg ICAgICAgICBMQUJFTCBNT1VOVApkYTAgICAgICAgICAgICAgIDA6MTgxIDQ2NkcgR1BUICAg ICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAtIC0KICBkYTBw MSAgICAgICAgICAwOjE4NCAyMDBNIGVmaSAgICAgICAgICAgICAgICAgICAgICAgICAgICAg ICAgICBtc2Rvc2ZzL0VGSVNZUyAtCiAgZGEwcDIgICAgICAgICAgMDoxODggNTEySyBmcmVl YnNkLWJvb3QgICAgICAgICAgICAgICAgICAgICAgICAgICBncHQvZ3B0Ym9vdDAgLQogIGRh MHAzICAgICAgICAgIDI6ODkgICAxNkcgZnJlZWJzZC1zd2FwICAgICAgICAgICAgICAgICAg ICAgICAgICAgICAgICAgICAgICAtIFNXQVAKICBkYTBwNCAgICAgICAgICAwOjE5MyA0NTBH IGZyZWVic2QtemZzICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICBncHQvemZzMCA8 WkZTPgogIGRhMHA0LmVsaSAgICAgIDA6MTk2IDQ1MEcgemZzICAgICAgICAgICAgICAgICAg ICAgICAgICAgICAgICAgICAgICAgICAgICAgICAtIC0KICA8RlJFRT4gICAgICAgICAtOi0g ICA0LjBLIC0gICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAg ICAgLSAtCnJvb3RAbW93YTIxOS1nanA0LTg1NzBwLWZyZWVic2Q6fiAjIHdpcGUgLW52IC9k ZXYvZGEwcDMKd2lwZTogemVybyBsZW5ndGgsIHNraXBwaW5nIGAvZGV2L2RhMHAzJwpyb290 QG1vd2EyMTktZ2pwNC04NTcwcC1mcmVlYnNkOn4gIyB3aXBlIC12IC1vIHwgYnVmZmVyID4g L2Rldi9kYTBwMwpidWZmZXI6IENvbW1hbmQgbm90IGZvdW5kLgpyb290QG1vd2EyMTktZ2pw NC04NTcwcC1mcmVlYnNkOn4gIyB3aXBlIC12IC1vIHwgZ2RkIGJzPTEwTSBvZj0vZGV2L2Rh MHAzCl5DMCs5MjU0MyByZWNvcmRzIGluCjArOTI1NDMgcmVjb3JkcyBvdXQKNjA2NDg5ODA0 OCBieXRlcyAoNi4xIEdCLCA1LjYgR2lCKSBjb3BpZWQsIDE5Mi4yNTUgcywgMzEuNSBNQi9z CnJvb3RAbW93YTIxOS1nanA0LTg1NzBwLWZyZWVic2Q6fiAjIHBrZyBwcm92aWRlcyBiaW4v YnVmZmVyCk5hbWUgICAgOiBwaWdsaXQtMjAyMDA5MTBfMQpEZXNjICAgIDogQXV0b21hdGVk IE9wZW5HTCBhbmQgT3BlbkNMIHRlc3RzdWl0ZQpSZXBvICAgIDogRnJlZUJTRApGaWxlbmFt ZTogdXNyL2xvY2FsL2xpYi9waWdsaXQvYmluL2J1ZmZlcnN0b3JhZ2UtcGVyc2lzdGVudF9n bGVzMwogICAgICAgICAgdXNyL2xvY2FsL2xpYi9waWdsaXQvYmluL2J1ZmZlcnN0b3JhZ2Ut cGVyc2lzdGVudAoKTmFtZSAgICA6IGJ1ZmZlci0xLjE5CkRlc2MgICAgOiBCdWZmZXIgc3Bv cmFkaWMgSS9PIGZvciBmYXN0ZXIgdGFwZSBhbmQgcGlwZSB0aHJvdWdocHV0ClJlcG8gICAg OiBGcmVlQlNECkZpbGVuYW1lOiB1c3IvbG9jYWwvYmluL2J1ZmZlcgpyb290QG1vd2EyMTkt Z2pwNC04NTcwcC1mcmVlYnNkOn4gIyBwa2cgaW5zdGFsbCAtLXF1aWV0IC0teWVzIGJ1ZmZl cgo9PT09PQpNZXNzYWdlIGZyb20gYnVmZmVyLTEuMTk6CgotLQo9PT0+ICAgTk9USUNFOgoK VGhlIGJ1ZmZlciBwb3J0IGN1cnJlbnRseSBkb2VzIG5vdCBoYXZlIGEgbWFpbnRhaW5lci4g QXMgYSByZXN1bHQsIGl0IGlzCm1vcmUgbGlrZWx5IHRvIGhhdmUgdW5yZXNvbHZlZCBpc3N1 ZXMsIG5vdCBiZSB1cC10by1kYXRlLCBvciBldmVuIGJlIHJlbW92ZWQgaW4KdGhlIGZ1dHVy ZS4gVG8gdm9sdW50ZWVyIHRvIG1haW50YWluIHRoaXMgcG9ydCwgcGxlYXNlIGNyZWF0ZSBh biBpc3N1ZSBhdDoKCmh0dHBzOi8vYnVncy5mcmVlYnNkLm9yZy9idWd6aWxsYQoKTW9yZSBp bmZvcm1hdGlvbiBhYm91dCBwb3J0IG1haW50YWluZXJzaGlwIGlzIGF2YWlsYWJsZSBhdDoK Cmh0dHBzOi8vZG9jcy5mcmVlYnNkLm9yZy9lbi9hcnRpY2xlcy9jb250cmlidXRpbmcvI3Bv cnRzLWNvbnRyaWJ1dGluZwpyb290QG1vd2EyMTktZ2pwNC04NTcwcC1mcmVlYnNkOn4gIyB3 aXBlIC12IC1vIHwgYnVmZmVyID4gL2Rldi9kYTBwMwpeQ3Jvb3RAbW93YTIxOS1nanA0LTg1 NzBwLWZyZWVic2Q6fiAKcm9vdEBtb3dhMjE5LWdqcDQtODU3MHAtZnJlZWJzZDp+ICMgdGlt ZSB3aXBlIC12IC1vIHwgYnVmZmVyID4gL2Rldi9kYTBwMwpidWZmZXIgKHdyaXRlcik6IHdy aXRlIG9mIGRhdGEgZmFpbGVkOiBObyBlcnJvcjogMApieXRlcyB0byB3cml0ZT0xMDI0MCwg Ynl0ZXMgd3JpdHRlbj04MTkyLCB0b3RhbCB3cml0dGVuICAgMTY3Nzc3MDBLCjIxLjk4NXUg NS40NDZzIDIxOjMzLjQ5IDIuMSUgICAgMjQrMTY4ayAwKzBpbyAwcGYrMHcKcm9vdEBtb3dh MjE5LWdqcDQtODU3MHAtZnJlZWJzZDp+ICMgc21hcnRjdGwgLWEgL2Rldi9kYTAgfCBncmVw IFJlYWxsb2NhdGVkCiAgNSBSZWFsbG9jYXRlZF9TZWN0b3JfQ3QgICAweDAwMzMgICAxMDAg ICAxMDAgICAwMDUgICAgUHJlLWZhaWwgIEFsd2F5cyAgICAgICAtICAgICAgIDMyOCAoMCA0 MCkKMTk2IFJlYWxsb2NhdGVkX0V2ZW50X0NvdW50IDB4MDAzMiAgIDEwMCAgIDEwMCAgIDAw MCAgICBPbGRfYWdlICAgQWx3YXlzICAgICAgIC0gICAgICAgNDAKcm9vdEBtb3dhMjE5LWdq cDQtODU3MHAtZnJlZWJzZDp+ICMgd2lwZSAtdiAtbyB8IGdkZCBzdGF0dXM9cHJvZ3Jlc3Mg YnM9MjRNIG9mPS9kZXYvZGEwcDMKMTcxNTA4MzY3MzYgYnl0ZXMgKDE3IEdCLCAxNiBHaUIp IGNvcGllZCwgNTM3IHMsIDMxLjkgTUIvcyAKZ2RkOiBlcnJvciB3cml0aW5nICcvZGV2L2Rh MHAzJzogTm8gc3BhY2UgbGVmdCBvbiBkZXZpY2UKMCsyNjIxNTIgcmVjb3JkcyBpbgowKzI2 MjE1MSByZWNvcmRzIG91dAoxNzE4MDM3Mjk5MiBieXRlcyAoMTcgR0IsIDE2IEdpQikgY29w aWVkLCA1MzcuOTUgcywgMzEuOSBNQi9zCnJvb3RAbW93YTIxOS1nanA0LTg1NzBwLWZyZWVi c2Q6fiAjIHNtYXJ0Y3RsIC1hIC9kZXYvZGEwIHwgZ3JlcCBSZWFsbG9jYXRlZAogIDUgUmVh bGxvY2F0ZWRfU2VjdG9yX0N0ICAgMHgwMDMzICAgMTAwICAgMTAwICAgMDA1ICAgIFByZS1m YWlsICBBbHdheXMgICAgICAgLSAgICAgICAzMjggKDAgNDApCjE5NiBSZWFsbG9jYXRlZF9F dmVudF9Db3VudCAweDAwMzIgICAxMDAgICAxMDAgICAwMDAgICAgT2xkX2FnZSAgIEFsd2F5 cyAgICAgICAtICAgICAgIDQwCnJvb3RAbW93YTIxOS1nanA0LTg1NzBwLWZyZWVic2Q6fiAj IHN5c2N0bCBrZXJuLmdlb20uZGVidWdmbGFncz0wCmtlcm4uZ2VvbS5kZWJ1Z2ZsYWdzOiAx NiAtPiAwCnJvb3RAbW93YTIxOS1nanA0LTg1NzBwLWZyZWVic2Q6fiAjIGdkaXNrIC9kZXYv ZGEwCkdQVCBmZGlzayAoZ2Rpc2spIHZlcnNpb24gMS4wLjgKCk5PVEU6IFdyaXRlIHRlc3Qg ZmFpbGVkIHdpdGggZXJyb3IgbnVtYmVyIDEuIEl0IHdpbGwgYmUgaW1wb3NzaWJsZSB0byBz YXZlCmNoYW5nZXMgdG8gdGhpcyBkaXNrJ3MgcGFydGl0aW9uIHRhYmxlIQpZb3UgbWF5IGJl IGFibGUgdG8gZW5hYmxlIHdyaXRlcyBieSBleGl0aW5nIHRoaXMgcHJvZ3JhbSwgdHlwaW5n CidzeXNjdGwga2Vybi5nZW9tLmRlYnVnZmxhZ3M9MTYnIGF0IGEgc2hlbGwgcHJvbXB0LCBh bmQgcmUtcnVubmluZyB0aGlzCnByb2dyYW0uCgpQYXJ0aXRpb24gdGFibGUgc2NhbjoKICBN QlI6IHByb3RlY3RpdmUKICBCU0Q6IG5vdCBwcmVzZW50CiAgQVBNOiBub3QgcHJlc2VudAog IEdQVDogcHJlc2VudAoKRm91bmQgdmFsaWQgR1BUIHdpdGggcHJvdGVjdGl2ZSBNQlI7IHVz aW5nIEdQVC4KCkNvbW1hbmQgKD8gZm9yIGhlbHApOiBxCnJvb3RAbW93YTIxOS1nanA0LTg1 NzBwLWZyZWVic2Q6fiAjIHN5c2N0bCBrZXJuLmdlb20uZGVidWdmbGFncz0xNgprZXJuLmdl b20uZGVidWdmbGFnczogMCAtPiAxNgpyb290QG1vd2EyMTktZ2pwNC04NTcwcC1mcmVlYnNk On4gIyBnZGlzayAvZGV2L2RhMApHUFQgZmRpc2sgKGdkaXNrKSB2ZXJzaW9uIDEuMC44CgpQ YXJ0aXRpb24gdGFibGUgc2NhbjoKICBNQlI6IHByb3RlY3RpdmUKICBCU0Q6IG5vdCBwcmVz ZW50CiAgQVBNOiBub3QgcHJlc2VudAogIEdQVDogcHJlc2VudAoKRm91bmQgdmFsaWQgR1BU IHdpdGggcHJvdGVjdGl2ZSBNQlI7IHVzaW5nIEdQVC4KCkNvbW1hbmQgKD8gZm9yIGhlbHAp OiBwCkRpc2sgL2Rldi9kYTA6IDk3Njc3MzE2OCBzZWN0b3JzLCA0NjUuOCBHaUIKU2VjdG9y IHNpemUgKGxvZ2ljYWwpOiA1MTIgYnl0ZXMKRGlzayBpZGVudGlmaWVyIChHVUlEKTogOTQz NDEwN0UtMDVBNi0xMUU5LTlENDctRDg5RDY3RDM3OTY3ClBhcnRpdGlvbiB0YWJsZSBob2xk cyB1cCB0byAxMjggZW50cmllcwpNYWluIHBhcnRpdGlvbiB0YWJsZSBiZWdpbnMgYXQgc2Vj dG9yIDIgYW5kIGVuZHMgYXQgc2VjdG9yIDMzCkZpcnN0IHVzYWJsZSBzZWN0b3IgaXMgNDAs IGxhc3QgdXNhYmxlIHNlY3RvciBpcyA5NzY3NzMxMjcKUGFydGl0aW9ucyB3aWxsIGJlIGFs aWduZWQgb24gOC1zZWN0b3IgYm91bmRhcmllcwpUb3RhbCBmcmVlIHNwYWNlIGlzIDggc2Vj dG9ycyAoNC4wIEtpQikKCk51bWJlciAgU3RhcnQgKHNlY3RvcikgICAgRW5kIChzZWN0b3Ip ICBTaXplICAgICAgIENvZGUgIE5hbWUKICAgMSAgICAgICAgICAgICAgNDAgICAgICAgICAg NDA5NjM5ICAgMjAwLjAgTWlCICAgRUYwMCAgZWZpYm9vdDAKICAgMiAgICAgICAgICA0MDk2 NDAgICAgICAgICAgNDEwNjYzICAgNTEyLjAgS2lCICAgQTUwMSAgZ3B0Ym9vdDAKICAgMyAg ICAgICAgICA0MTA2NjQgICAgICAgIDMzOTY2MDc5ICAgMTYuMCBHaUIgICAgQTUwMiAgCiAg IDQgICAgICAgIDMzOTY2MDgwICAgICAgIDk3Njc3MzExOSAgIDQ0OS42IEdpQiAgIEE1MDQg IHpmczAKCkNvbW1hbmQgKD8gZm9yIGhlbHApOiBkClBhcnRpdGlvbiBudW1iZXIgKDEtNCk6 IDMKCkNvbW1hbmQgKD8gZm9yIGhlbHApOiB3CgpGaW5hbCBjaGVja3MgY29tcGxldGUuIEFi b3V0IHRvIHdyaXRlIEdQVCBkYXRhLiBUSElTIFdJTEwgT1ZFUldSSVRFIEVYSVNUSU5HClBB UlRJVElPTlMhIQoKRG8geW91IHdhbnQgdG8gcHJvY2VlZD8gKFkvTik6IHkKT0s7IHdyaXRp bmcgbmV3IEdVSUQgcGFydGl0aW9uIHRhYmxlIChHUFQpIHRvIC9kZXYvZGEwLgpXYXJuaW5n OiBUaGUga2VybmVsIG1heSBjb250aW51ZSB0byB1c2Ugb2xkIG9yIGRlbGV0ZWQgcGFydGl0 aW9ucy4KWW91IHNob3VsZCByZWJvb3Qgb3IgcmVtb3ZlIHRoZSBkcml2ZS4KVGhlIG9wZXJh dGlvbiBoYXMgY29tcGxldGVkIHN1Y2Nlc3NmdWxseS4Kcm9vdEBtb3dhMjE5LWdqcDQtODU3 MHAtZnJlZWJzZDp+ICMgbHNibGsgZGEwCkRFVklDRSAgICAgICAgIE1BSjpNSU4gU0laRSBU WVBFICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgTEFCRUwgTU9V TlQKZGEwICAgICAgICAgICAgICAwOjE4MSA0NjZHIEdQVCAgICAgICAgICAgICAgICAgICAg ICAgICAgICAgICAgICAgICAgICAgICAgICAgLSAtCiAgZGEwcDEgICAgICAgICAgMDoxODQg MjAwTSBlZmkgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgbXNkb3Nmcy9FRklT WVMgLQogIGRhMHAyICAgICAgICAgIDA6MTg4IDUxMksgZnJlZWJzZC1ib290ICAgICAgICAg ICAgICAgICAgICAgICAgICAgZ3B0L2dwdGJvb3QwIC0KICBkYTBwMyAgICAgICAgICAyOjg5 ICAgMTZHIGZyZWVic2Qtc3dhcCAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAg ICAgLSBTV0FQCiAgZGEwcDQgICAgICAgICAgMDoxOTMgNDUwRyBmcmVlYnNkLXpmcyAgICAg ICAgICAgICAgICAgICAgICAgICAgICAgICAgZ3B0L3pmczAgPFpGUz4KICBkYTBwNC5lbGkg ICAgICAwOjE5NiA0NTBHIHpmcyAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAg ICAgICAgICAgICAgLSAtCiAgPEZSRUU+ICAgICAgICAgLTotICAgNC4wSyAtICAgICAgICAg ICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgIC0gLQpyb290QG1vd2Ey MTktZ2pwNC04NTcwcC1mcmVlYnNkOn4gIyB0YWlsIC1mIC1uIDAgL3Zhci9sb2cvbWVzc2Fn ZXMKQXVnIDI3IDE0OjIyOjM1IG1vd2EyMTktZ2pwNC04NTcwcC1mcmVlYnNkIGtlcm5lbDog dWdlbjAuNTogPEpNaWNyb24gVVNCIHRvIEFUQS9BVEFQSSBicmlkZ2U+IGF0IHVzYnVzMCAo ZGlzY29ubmVjdGVkKQpBdWcgMjcgMTQ6MjI6MzUgbW93YTIxOS1nanA0LTg1NzBwLWZyZWVi c2Qga2VybmVsOiB1bWFzczA6IGF0IHVodWI2LCBwb3J0IDEsIGFkZHIgNCAoZGlzY29ubmVj dGVkKQpBdWcgMjcgMTQ6MjI6MzUgbW93YTIxOS1nanA0LTg1NzBwLWZyZWVic2Qga2VybmVs OiBkYTAgYXQgdW1hc3Mtc2ltMCBidXMgMCBzY2J1czQgdGFyZ2V0IDAgbHVuIDAKQXVnIDI3 IDE0OjIyOjM1IG1vd2EyMTktZ2pwNC04NTcwcC1mcmVlYnNkIGtlcm5lbDogZGEwOiA8SEdT VCBIVFMgNzI1MDUwQTdFNjMwID4gIHMvbiBGMDUwMDkwNjgxRkYgZGV0YWNoZWQKQXVnIDI3 IDE0OjIyOjM1IG1vd2EyMTktZ2pwNC04NTcwcC1mcmVlYnNkIGtlcm5lbDogR0VPTV9FTEk6 IERldmljZSBkYTBwNC5lbGkgZGVzdHJveWVkLgpBdWcgMjcgMTQ6MjI6MzUgbW93YTIxOS1n anA0LTg1NzBwLWZyZWVic2Qga2VybmVsOiAoZGEwOnVtYXNzLXNpbTA6MDowOjApOiBQZXJp cGggZGVzdHJveWVkCkF1ZyAyNyAxNDoyMjozNSBtb3dhMjE5LWdqcDQtODU3MHAtZnJlZWJz ZCBrZXJuZWw6IHVtYXNzMDogZGV0YWNoZWQKQXVnIDI3IDE0OjIyOjM1IG1vd2EyMTktZ2pw NC04NTcwcC1mcmVlYnNkIGtlcm5lbDogdWdlbjAuNjogPEdlbmVyaWMgTWFzcyBTdG9yYWdl IERldmljZT4gYXQgdXNidXMwIChkaXNjb25uZWN0ZWQpCkF1ZyAyNyAxNDoyMjozNSBtb3dh MjE5LWdqcDQtODU3MHAtZnJlZWJzZCBrZXJuZWw6IHVtYXNzMTogYXQgdWh1YjYsIHBvcnQg NCwgYWRkciA1IChkaXNjb25uZWN0ZWQpCkF1ZyAyNyAxNDoyMjozNSBtb3dhMjE5LWdqcDQt ODU3MHAtZnJlZWJzZCBrZXJuZWw6IGRhMSBhdCB1bWFzcy1zaW0xIGJ1cyAxIHNjYnVzNSB0 YXJnZXQgMCBsdW4gMApBdWcgMjcgMTQ6MjI6MzUgbW93YTIxOS1nanA0LTg1NzBwLWZyZWVi c2Qga2VybmVsOiBkYTE6IDxHZW5lcmljIFVTQiBTRCBSZWFkZXIgMS4wMD4gIHMvbiAwNThG MzEyRDgxQiBkZXRhY2hlZApBdWcgMjcgMTQ6MjI6MzUgbW93YTIxOS1nanA0LTg1NzBwLWZy ZWVic2Qga2VybmVsOiBkYTIgYXQgdW1hc3Mtc2ltMSBidXMgMSBzY2J1czUgdGFyZ2V0IDAg bHVuIDEKQXVnIDI3IDE0OjIyOjM1IG1vd2EyMTktZ2pwNC04NTcwcC1mcmVlYnNkIGtlcm5l bDogZGEyOiA8R2VuZXJpYyBVU0IgQ0YgUmVhZGVyIDEuMDE+ICBzL24gMDU4RjMxMkQ4MUIg ZGV0YWNoZWQKQXVnIDI3IDE0OjIyOjM1IG1vd2EyMTktZ2pwNC04NTcwcC1mcmVlYnNkIGtl cm5lbDogZGEzIGF0IHVtYXNzLXNpbTEgYnVzIDEgc2NidXM1IHRhcmdldCAwIGx1biAyCkF1 ZyAyNyAxNDoyMjozNSBtb3dhMjE5LWdqcDQtODU3MHAtZnJlZWJzZCBrZXJuZWw6IGRhMzog PEdlbmVyaWMgVVNCIFNNIFJlYWRlciAxLjAyPiAgcy9uIDA1OEYzMTJEODFCIGRldGFjaGVk CkF1ZyAyNyAxNDoyMjozNSBtb3dhMjE5LWdqcDQtODU3MHAtZnJlZWJzZCBrZXJuZWw6IChk YTE6dW1hc3Mtc2ltMToxOjA6MCk6IFBlcmlwaCBkZXN0cm95ZWQKQXVnIDI3IDE0OjIyOjM1 IG1vd2EyMTktZ2pwNC04NTcwcC1mcmVlYnNkIGtlcm5lbDogZGE0IGF0IHVtYXNzLXNpbTEg YnVzIDEgc2NidXM1IHRhcmdldCAwIGx1biAzCkF1ZyAyNyAxNDoyMjozNSBtb3dhMjE5LWdq cDQtODU3MHAtZnJlZWJzZCBrZXJuZWw6IGRhNDogPEdlbmVyaWMgVVNCIE1TIFJlYWRlciAx LjAzPiAgcy9uIDA1OEYzMTJEODFCIGRldGFjaGVkCkF1ZyAyNyAxNDoyMjozNSBtb3dhMjE5 LWdqcDQtODU3MHAtZnJlZWJzZCBrZXJuZWw6IChkYTM6dW1hc3Mtc2ltMToxOjA6Mik6IFBl cmlwaCBkZXN0cm95ZWQKQXVnIDI3IDE0OjIyOjM1IG1vd2EyMTktZ2pwNC04NTcwcC1mcmVl YnNkIGtlcm5lbDogKGRhMjp1bWFzcy1zaW0xOjE6MDoxKTogUGVyaXBoIGRlc3Ryb3llZApB dWcgMjcgMTQ6MjI6MzUgbW93YTIxOS1nanA0LTg1NzBwLWZyZWVic2Qga2VybmVsOiAoZGE0 OnVtYXNzLXNpbTE6MTowOjMpOiBQZXJpcGggZGVzdHJveWVkCkF1ZyAyNyAxNDoyMjozNSBt b3dhMjE5LWdqcDQtODU3MHAtZnJlZWJzZCBrZXJuZWw6IHVtYXNzMTogZGV0YWNoZWQKQXVn IDI3IDE0OjIyOjQxIG1vd2EyMTktZ2pwNC04NTcwcC1mcmVlYnNkIGtlcm5lbDogdWdlbjAu NTogPEdlbmVyaWMgTWFzcyBTdG9yYWdlIERldmljZT4gYXQgdXNidXMwCkF1ZyAyNyAxNDoy Mjo0MSBtb3dhMjE5LWdqcDQtODU3MHAtZnJlZWJzZCBrZXJuZWw6IHVtYXNzMCBvbiB1aHVi NgpBdWcgMjcgMTQ6MjI6NDEgbW93YTIxOS1nanA0LTg1NzBwLWZyZWVic2Qga2VybmVsOiB1 bWFzczA6IDxHZW5lcmljIE1hc3MgU3RvcmFnZSBEZXZpY2UsIGNsYXNzIDAvMCwgcmV2IDIu MDAvMS4yOSwgYWRkciAxMT4gb24gdXNidXMwCkF1ZyAyNyAxNDoyMjo0MSBtb3dhMjE5LWdq cDQtODU3MHAtZnJlZWJzZCBrZXJuZWw6IGRhMCBhdCB1bWFzcy1zaW0wIGJ1cyAwIHNjYnVz NCB0YXJnZXQgMCBsdW4gMApBdWcgMjcgMTQ6MjI6NDEgbW93YTIxOS1nanA0LTg1NzBwLWZy ZWVic2Qga2VybmVsOiBkYTA6IDxHZW5lcmljIFVTQiBTRCBSZWFkZXIgMS4wMD4gUmVtb3Zh YmxlIERpcmVjdCBBY2Nlc3MgU0NTSSBkZXZpY2UKQXVnIDI3IDE0OjIyOjQxIG1vd2EyMTkt Z2pwNC04NTcwcC1mcmVlYnNkIGtlcm5lbDogZGEwOiBTZXJpYWwgTnVtYmVyIDA1OEYzMTJE ODFCCkF1ZyAyNyAxNDoyMjo0MSBtb3dhMjE5LWdqcDQtODU3MHAtZnJlZWJzZCBrZXJuZWw6 IGRhMDogNDAuMDAwTUIvcyB0cmFuc2ZlcnMKQXVnIDI3IDE0OjIyOjQxIG1vd2EyMTktZ2pw NC04NTcwcC1mcmVlYnNkIGtlcm5lbDogZGEwOiBBdHRlbXB0IHRvIHF1ZXJ5IGRldmljZSBz aXplIGZhaWxlZDogTk9UIFJFQURZLCBNZWRpdW0gbm90IHByZXNlbnQKQXVnIDI3IDE0OjIy OjQxIG1vd2EyMTktZ2pwNC04NTcwcC1mcmVlYnNkIGtlcm5lbDogZGEwOiBxdWlya3M9MHgy PE5PXzZfQllURT4KQXVnIDI3IDE0OjIyOjQyIG1vd2EyMTktZ2pwNC04NTcwcC1mcmVlYnNk IGtlcm5lbDogZGExIGF0IHVtYXNzLXNpbTAgYnVzIDAgc2NidXM0IHRhcmdldCAwIGx1biAx CkF1ZyAyNyAxNDoyMjo0MiBtb3dhMjE5LWdqcDQtODU3MHAtZnJlZWJzZCBrZXJuZWw6IGRh MTogPEdlbmVyaWMgVVNCIENGIFJlYWRlciAxLjAxPiBSZW1vdmFibGUgRGlyZWN0IEFjY2Vz cyBTQ1NJIGRldmljZQpBdWcgMjcgMTQ6MjI6NDIgbW93YTIxOS1nanA0LTg1NzBwLWZyZWVi c2Qga2VybmVsOiBkYTE6IFNlcmlhbCBOdW1iZXIgMDU4RjMxMkQ4MUIKQXVnIDI3IDE0OjIy OjQyIG1vd2EyMTktZ2pwNC04NTcwcC1mcmVlYnNkIGtlcm5lbDogZGExOiA0MC4wMDBNQi9z IHRyYW5zZmVycwpBdWcgMjcgMTQ6MjI6NDIgbW93YTIxOS1nanA0LTg1NzBwLWZyZWVic2Qg a2VybmVsOiBkYTE6IEF0dGVtcHQgdG8gcXVlcnkgZGV2aWNlIHNpemUgZmFpbGVkOiBOT1Qg UkVBRFksIE1lZGl1bSBub3QgcHJlc2VudApBdWcgMjcgMTQ6MjI6NDIgbW93YTIxOS1nanA0 LTg1NzBwLWZyZWVic2Qga2VybmVsOiBkYTE6IHF1aXJrcz0weDI8Tk9fNl9CWVRFPgpBdWcg MjcgMTQ6MjI6NDIgbW93YTIxOS1nanA0LTg1NzBwLWZyZWVic2Qga2VybmVsOiBkYTIgYXQg dW1hc3Mtc2ltMCBidXMgMCBzY2J1czQgdGFyZ2V0IDAgbHVuIDIKQXVnIDI3IDE0OjIyOjQy IG1vd2EyMTktZ2pwNC04NTcwcC1mcmVlYnNkIGtlcm5lbDogZGEyOiA8R2VuZXJpYyBVU0Ig U00gUmVhZGVyIDEuMDI+IFJlbW92YWJsZSBEaXJlY3QgQWNjZXNzIFNDU0kgZGV2aWNlCkF1 ZyAyNyAxNDoyMjo0MiBtb3dhMjE5LWdqcDQtODU3MHAtZnJlZWJzZCBrZXJuZWw6IGRhMjog U2VyaWFsIE51bWJlciAwNThGMzEyRDgxQgpBdWcgMjcgMTQ6MjI6NDIgbW93YTIxOS1nanA0 LTg1NzBwLWZyZWVic2Qga2VybmVsOiBkYTI6IDQwLjAwME1CL3MgdHJhbnNmZXJzCkF1ZyAy NyAxNDoyMjo0MiBtb3dhMjE5LWdqcDQtODU3MHAtZnJlZWJzZCBrZXJuZWw6IGRhMjogQXR0 ZW1wdCB0byBxdWVyeSBkZXZpY2Ugc2l6ZSBmYWlsZWQ6IE5PVCBSRUFEWSwgTWVkaXVtIG5v dCBwcmVzZW50CkF1ZyAyNyAxNDoyMjo0MiBtb3dhMjE5LWdqcDQtODU3MHAtZnJlZWJzZCBr ZXJuZWw6IGRhMjogcXVpcmtzPTB4MjxOT182X0JZVEU+CkF1ZyAyNyAxNDoyMjo0MiBtb3dh MjE5LWdqcDQtODU3MHAtZnJlZWJzZCBrZXJuZWw6IGRhMyBhdCB1bWFzcy1zaW0wIGJ1cyAw IHNjYnVzNCB0YXJnZXQgMCBsdW4gMwpBdWcgMjcgMTQ6MjI6NDIgbW93YTIxOS1nanA0LTg1 NzBwLWZyZWVic2Qga2VybmVsOiBkYTM6IDxHZW5lcmljIFVTQiBNUyBSZWFkZXIgMS4wMz4g UmVtb3ZhYmxlIERpcmVjdCBBY2Nlc3MgU0NTSSBkZXZpY2UKQXVnIDI3IDE0OjIyOjQyIG1v d2EyMTktZ2pwNC04NTcwcC1mcmVlYnNkIGtlcm5lbDogZGEzOiBTZXJpYWwgTnVtYmVyIDA1 OEYzMTJEODFCCkF1ZyAyNyAxNDoyMjo0MiBtb3dhMjE5LWdqcDQtODU3MHAtZnJlZWJzZCBr ZXJuZWw6IGRhMzogNDAuMDAwTUIvcyB0cmFuc2ZlcnMKQXVnIDI3IDE0OjIyOjQyIG1vd2Ey MTktZ2pwNC04NTcwcC1mcmVlYnNkIGtlcm5lbDogZGEzOiBBdHRlbXB0IHRvIHF1ZXJ5IGRl dmljZSBzaXplIGZhaWxlZDogTk9UIFJFQURZLCBNZWRpdW0gbm90IHByZXNlbnQKQXVnIDI3 IDE0OjIyOjQyIG1vd2EyMTktZ2pwNC04NTcwcC1mcmVlYnNkIGtlcm5lbDogZGEzOiBxdWly a3M9MHgyPE5PXzZfQllURT4KQXVnIDI3IDE0OjIyOjQ2IG1vd2EyMTktZ2pwNC04NTcwcC1m cmVlYnNkIGtlcm5lbDogdWdlbjAuNjogPEpNaWNyb24gVVNCIHRvIEFUQS9BVEFQSSBicmlk Z2U+IGF0IHVzYnVzMApBdWcgMjcgMTQ6MjI6NDYgbW93YTIxOS1nanA0LTg1NzBwLWZyZWVi c2Qga2VybmVsOiB1bWFzczEgb24gdWh1YjYKQXVnIDI3IDE0OjIyOjQ2IG1vd2EyMTktZ2pw NC04NTcwcC1mcmVlYnNkIGtlcm5lbDogdW1hc3MxOiA8TVNDIEJ1bGstT25seSBUcmFuc2Zl cj4gb24gdXNidXMwCkF1ZyAyNyAxNDoyMjo0NiBtb3dhMjE5LWdqcDQtODU3MHAtZnJlZWJz ZCBrZXJuZWw6IGRhNCBhdCB1bWFzcy1zaW0xIGJ1cyAxIHNjYnVzNSB0YXJnZXQgMCBsdW4g MApBdWcgMjcgMTQ6MjI6NDYgbW93YTIxOS1nanA0LTg1NzBwLWZyZWVic2Qga2VybmVsOiBk YTQ6IDxIR1NUIEhUUyA3MjUwNTBBN0U2MzAgPiBGaXhlZCBEaXJlY3QgQWNjZXNzIFNDU0kt MiBkZXZpY2UKQXVnIDI3IDE0OjIyOjQ2IG1vd2EyMTktZ2pwNC04NTcwcC1mcmVlYnNkIGtl cm5lbDogZGE0OiBTZXJpYWwgTnVtYmVyIEYwNTAwOTA2ODFGRgpBdWcgMjcgMTQ6MjI6NDYg bW93YTIxOS1nanA0LTg1NzBwLWZyZWVic2Qga2VybmVsOiBkYTQ6IDQwLjAwME1CL3MgdHJh bnNmZXJzCkF1ZyAyNyAxNDoyMjo0NiBtb3dhMjE5LWdqcDQtODU3MHAtZnJlZWJzZCBrZXJu ZWw6IGRhNDogNDc2OTQwTUIgKDk3Njc3MzE2OCA1MTIgYnl0ZSBzZWN0b3JzKQpBdWcgMjcg MTQ6MjI6NDYgbW93YTIxOS1nanA0LTg1NzBwLWZyZWVic2Qga2VybmVsOiBkYTQ6IHF1aXJr cz0weDI8Tk9fNl9CWVRFPgpeQwpyb290QG1vd2EyMTktZ2pwNC04NTcwcC1mcmVlYnNkOn4g IyBsc2JsayBkYTAKREVWSUNFICAgICAgICAgTUFKOk1JTiBTSVpFIFRZUEUgICAgICAgICAg ICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICBMQUJFTCBNT1VOVApkYTAgICAgICAg ICAgICAgIDI6OTUgICAgMEIgZnJlZWJzZC1zd2FwICAgICAgICAgICAgICAgICAgICAgICAg ICAgICAgICAgICAgICAtIFNXQVAKcm9vdEBtb3dhMjE5LWdqcDQtODU3MHAtZnJlZWJzZDp+ ICMgbHNibGsgCkRFVklDRSAgICAgICAgIE1BSjpNSU4gU0laRSBUWVBFICAgICAgICAgICAg ICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgTEFCRUwgTU9VTlQKYWRhMCAgICAgICAg ICAgICAwOjEyMSA5MzJHIEdQVCAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAg ICAgICAgICAgICAgLSAtCiAgYWRhMHAxICAgICAgICAgMDoxMjMgMjYwTSBlZmkgICAgICAg ICAgICAgICAgICAgICAgICAgICAgICAgICAgICBncHQvZWZpYm9vdDAgLQogIDxGUkVFPiAg ICAgICAgIC06LSAgIDEuME0gLSAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAg ICAgICAgICAgICAgICAtIC0KICBhZGEwcDIgICAgICAgICAwOjEyNSAgMTZHIGZyZWVic2Qt c3dhcCAgICAgICAgICAgICAgICAgICAgICAgICAgICAgIGdwdC9zd2FwMCBTV0FQCiAgYWRh MHAyLmVsaSAgICAgMjo2NyAgIDE2RyBmcmVlYnNkLXN3YXAgICAgICAgICAgICAgICAgICAg ICAgICAgICAgICAgICAgICAgIC0gU1dBUAogIGFkYTBwMyAgICAgICAgIDA6MTI3IDkxNUcg ZnJlZWJzZC16ZnMgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgIGdwdC96ZnMwIDxa RlM+CiAgYWRhMHAzLmVsaSAgICAgMDoxMzQgOTE1RyB6ZnMgICAgICAgICAgICAgICAgICAg ICAgICAgICAgICAgICAgICAgICAgICAgICAgIC0gLQogIDxGUkVFPiAgICAgICAgIC06LSAg IDcwOEsgLSAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAg ICAtIC0KY2QwICAgICAgICAgICAgICAwOjEyOSAgIDBCIC0gICAgICAgICAgICAgICAgICAg ICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgLSAtCmRhMCAgICAgICAgICAgICAgMjo5 NSAgICAwQiBmcmVlYnNkLXN3YXAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAg ICAgIC0gU1dBUApkYTEgICAgICAgICAgICAgIDI6OTYgICAgMEIgLSAgICAgICAgICAgICAg ICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAtIC0KZGEyICAgICAgICAgICAg ICAyOjk3ICAgIDBCIC0gICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAg ICAgICAgICAgLSAtCmRhMyAgICAgICAgICAgICAgMjo5OCAgICAwQiAtICAgICAgICAgICAg ICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgIC0gLQpkYTQgICAgICAgICAg ICAgIDI6MTA0IDQ2NkcgR1BUICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAg ICAgICAgICAgICAtIC0KICBkYTRwMSAgICAgICAgICAyOjEwNSAyMDBNIGVmaSAgICAgICAg ICAgICAgICAgICAgICAgICAgICAgICAgICBtc2Rvc2ZzL0VGSVNZUyAtCiAgZGE0cDIgICAg ICAgICAgMjoxMDYgNTEySyBmcmVlYnNkLWJvb3QgICAgICAgICAgICAgICAgICAgICAgICAg ICBncHQvZ3B0Ym9vdDAgLQogIDxGUkVFPiAgICAgICAgIC06LSAgICAxNkcgLSAgICAgICAg ICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAtIC0KICBkYTRwNCAg ICAgICAgICAyOjEwNyA0NTBHIGZyZWVic2QtemZzICAgICAgICAgICAgICAgICAgICAgICAg ICAgICAgICBncHQvemZzMCA8WkZTPgogIDxGUkVFPiAgICAgICAgIC06LSAgIDQuMEsgLSAg ICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAtIC0KZGE1 ICAgICAgICAgICAgICAwOjIxNSA0NjZHIEdQVCAgICAgICAgICAgICAgICAgICAgICAgICAg ICAgICAgICAgICAgICAgICAgICAgLSAtCiAgPEZSRUU+ICAgICAgICAgLTotICAgMS4wTSAt ICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgIC0gLQog IGRhNXAxICAgICAgICAgIDA6MjE2IDQ2NkcgZnJlZWJzZC16ZnMgICAgICAgICAgICAgICAg ICAgICAgICAgICBncHQvVHJhbnNjZW5kIDxaRlM+CmRhNiAgICAgICAgICAgICAgMDoyMjMg IDE0RyBHUFQgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAg IC0gLQogIDxGUkVFPiAgICAgICAgIC06LSAgIDEuME0gLSAgICAgICAgICAgICAgICAgICAg ICAgICAgICAgICAgICAgICAgICAgICAgICAgICAtIC0KICBkYTZwMSAgICAgICAgICAwOjIy NCAgMTRHIGZyZWVic2QtemZzICAgICAgICAgICAgICAgICAgICAgZ3B0L2NhY2hlLXRyYW5z Y2VuZCA8WkZTPgpkYTcgICAgICAgICAgICAgIDA6MjQ3ICAyOUcgR1BUICAgICAgICAgICAg ICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAtIC0KICBkYTdwMSAgICAgICAg ICAwOjI0OCAgMjlHIGZyZWVic2QtemZzICAgICAgICAgICAgICAgICAgICAgICAgZ3B0L2Nh Y2hlLWF1Z3VzdCA8WkZTPgpyb290QG1vd2EyMTktZ2pwNC04NTcwcC1mcmVlYnNkOn4gIyBn ZGlzayAvZGV2L2RhNApHUFQgZmRpc2sgKGdkaXNrKSB2ZXJzaW9uIDEuMC44CgpQYXJ0aXRp b24gdGFibGUgc2NhbjoKICBNQlI6IHByb3RlY3RpdmUKICBCU0Q6IG5vdCBwcmVzZW50CiAg QVBNOiBub3QgcHJlc2VudAogIEdQVDogcHJlc2VudAoKRm91bmQgdmFsaWQgR1BUIHdpdGgg cHJvdGVjdGl2ZSBNQlI7IHVzaW5nIEdQVC4KCkNvbW1hbmQgKD8gZm9yIGhlbHApOiBuClBh cnRpdGlvbiBudW1iZXIgKDMtMTI4LCBkZWZhdWx0IDMpOiAKRmlyc3Qgc2VjdG9yICg0MTA2 NjQtOTc2NzczMTI3LCBkZWZhdWx0ID0gNDEwNjY0KSBvciB7Ky19c2l6ZXtLTUdUUH06IApM YXN0IHNlY3RvciAoNDEwNjY0LTMzOTY2MDc5LCBkZWZhdWx0ID0gMzM5NjYwNzkpIG9yIHsr LX1zaXple0tNR1RQfTogCkN1cnJlbnQgdHlwZSBpcyBBNTAzIChGcmVlQlNEIFVGUykKSGV4 IGNvZGUgb3IgR1VJRCAoTCB0byBzaG93IGNvZGVzLCBFbnRlciA9IEE1MDMpOiBhNTAyCkNo YW5nZWQgdHlwZSBvZiBwYXJ0aXRpb24gdG8gJ0ZyZWVCU0Qgc3dhcCcKCkNvbW1hbmQgKD8g Zm9yIGhlbHApOiB3CgpGaW5hbCBjaGVja3MgY29tcGxldGUuIEFib3V0IHRvIHdyaXRlIEdQ VCBkYXRhLiBUSElTIFdJTEwgT1ZFUldSSVRFIEVYSVNUSU5HClBBUlRJVElPTlMhIQoKRG8g eW91IHdhbnQgdG8gcHJvY2VlZD8gKFkvTik6IHkKT0s7IHdyaXRpbmcgbmV3IEdVSUQgcGFy dGl0aW9uIHRhYmxlIChHUFQpIHRvIC9kZXYvZGE0LgpXYXJuaW5nOiBUaGUga2VybmVsIG1h eSBjb250aW51ZSB0byB1c2Ugb2xkIG9yIGRlbGV0ZWQgcGFydGl0aW9ucy4KWW91IHNob3Vs ZCByZWJvb3Qgb3IgcmVtb3ZlIHRoZSBkcml2ZS4KVGhlIG9wZXJhdGlvbiBoYXMgY29tcGxl dGVkIHN1Y2Nlc3NmdWxseS4Kcm9vdEBtb3dhMjE5LWdqcDQtODU3MHAtZnJlZWJzZDp+ICMg bHNibGsgZGEwCkRFVklDRSAgICAgICAgIE1BSjpNSU4gU0laRSBUWVBFICAgICAgICAgICAg ICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgTEFCRUwgTU9VTlQKZGEwICAgICAgICAg ICAgICAyOjk1ICAgIDBCIGZyZWVic2Qtc3dhcCAgICAgICAgICAgICAgICAgICAgICAgICAg ICAgICAgICAgICAgLSBTV0FQCnJvb3RAbW93YTIxOS1nanA0LTg1NzBwLWZyZWVic2Q6fiAj IGxzYmxrIGRhNApERVZJQ0UgICAgICAgICBNQUo6TUlOIFNJWkUgVFlQRSAgICAgICAgICAg ICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgIExBQkVMIE1PVU5UCmRhNCAgICAgICAg ICAgICAgMjoxMDQgNDY2RyBHUFQgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAg ICAgICAgICAgICAgIC0gLQogIGRhNHAxICAgICAgICAgIDA6MTg0IDIwME0gZWZpICAgICAg ICAgICAgICAgICAgICAgICAgICAgICAgICAgIG1zZG9zZnMvRUZJU1lTIC0KICBkYTRwMiAg ICAgICAgICAwOjE4NSA1MTJLIGZyZWVic2QtYm9vdCAgICAgICAgICAgICAgICAgICAgICAg ICAgIGdwdC9ncHRib290MCAtCiAgZGE0cDMgICAgICAgICAgMDoxODYgIDE2RyBmcmVlYnNk LXN3YXAgICAgICAgICAgICAgICAgICAgICBncHQvRnJlZUJTRCUyMHN3YXAgLQogIGRhNHA0 ICAgICAgICAgIDA6MTg3IDQ1MEcgZnJlZWJzZC16ZnMgICAgICAgICAgICAgICAgICAgICAg ICAgICAgICAgIGdwdC96ZnMwIDxaRlM+CiAgPEZSRUU+ICAgICAgICAgLTotICAgNC4wSyAt ICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgIC0gLQpy b290QG1vd2EyMTktZ2pwNC04NTcwcC1mcmVlYnNkOn4gIyBzbWFydGN0bCAtYSAvZGV2L2Rh MCB8IGdyZXAgUmVhbGxvY2F0ZWQKcm9vdEBtb3dhMjE5LWdqcDQtODU3MHAtZnJlZWJzZDp+ ICMgc21hcnRjdGwgLWEgL2Rldi9kYTQgfCBncmVwIFJlYWxsb2NhdGVkCiAgNSBSZWFsbG9j YXRlZF9TZWN0b3JfQ3QgICAweDAwMzMgICAxMDAgICAxMDAgICAwMDUgICAgUHJlLWZhaWwg IEFsd2F5cyAgICAgICAtICAgICAgIDMyOCAoMCA0MCkKMTk2IFJlYWxsb2NhdGVkX0V2ZW50 X0NvdW50IDB4MDAzMiAgIDEwMCAgIDEwMCAgIDAwMCAgICBPbGRfYWdlICAgQWx3YXlzICAg ICAgIC0gICAgICAgNDAKcm9vdEBtb3dhMjE5LWdqcDQtODU3MHAtZnJlZWJzZDp+ICMgdGFp bCAtZiAtbiAwIC92YXIvbG9nL21lc3NhZ2VzCkF1ZyAyNyAxNDoyNjo0OCBtb3dhMjE5LWdq cDQtODU3MHAtZnJlZWJzZCBrZXJuZWw6IHVnZW4wLjY6IDxKTWljcm9uIFVTQiB0byBBVEEv QVRBUEkgYnJpZGdlPiBhdCB1c2J1czAgKGRpc2Nvbm5lY3RlZCkKQXVnIDI3IDE0OjI2OjQ4 IG1vd2EyMTktZ2pwNC04NTcwcC1mcmVlYnNkIGtlcm5lbDogdW1hc3MxOiBhdCB1aHViNiwg cG9ydCAxLCBhZGRyIDEyIChkaXNjb25uZWN0ZWQpCkF1ZyAyNyAxNDoyNjo0OSBtb3dhMjE5 LWdqcDQtODU3MHAtZnJlZWJzZCBrZXJuZWw6IGRhNCBhdCB1bWFzcy1zaW0xIGJ1cyAxIHNj YnVzNSB0YXJnZXQgMCBsdW4gMApBdWcgMjcgMTQ6MjY6NDkgbW93YTIxOS1nanA0LTg1NzBw LWZyZWVic2Qga2VybmVsOiBkYTQ6IDxIR1NUIEhUUyA3MjUwNTBBN0U2MzAgPiAgcy9uIEYw NTAwOTA2ODFGRiBkZXRhY2hlZApBdWcgMjcgMTQ6MjY6NDkgbW93YTIxOS1nanA0LTg1NzBw LWZyZWVic2Qga2VybmVsOiAoZGE0OnVtYXNzLXNpbTE6MTowOjApOiBQZXJpcGggZGVzdHJv eWVkCkF1ZyAyNyAxNDoyNjo0OSBtb3dhMjE5LWdqcDQtODU3MHAtZnJlZWJzZCBrZXJuZWw6 IHVtYXNzMTogZGV0YWNoZWQKQXVnIDI3IDE0OjI2OjQ5IG1vd2EyMTktZ2pwNC04NTcwcC1m cmVlYnNkIGtlcm5lbDogdWdlbjAuNTogPEdlbmVyaWMgTWFzcyBTdG9yYWdlIERldmljZT4g YXQgdXNidXMwIChkaXNjb25uZWN0ZWQpCkF1ZyAyNyAxNDoyNjo0OSBtb3dhMjE5LWdqcDQt ODU3MHAtZnJlZWJzZCBrZXJuZWw6IHVtYXNzMDogYXQgdWh1YjYsIHBvcnQgNCwgYWRkciAx MSAoZGlzY29ubmVjdGVkKQpBdWcgMjcgMTQ6MjY6NDkgbW93YTIxOS1nanA0LTg1NzBwLWZy ZWVic2Qga2VybmVsOiBkYTAgYXQgdW1hc3Mtc2ltMCBidXMgMCBzY2J1czQgdGFyZ2V0IDAg bHVuIDAKQXVnIDI3IDE0OjI2OjQ5IG1vd2EyMTktZ2pwNC04NTcwcC1mcmVlYnNkIGtlcm5l bDogZGEwOiA8R2VuZXJpYyBVU0IgU0QgUmVhZGVyIDEuMDA+ICBzL24gMDU4RjMxMkQ4MUIg ZGV0YWNoZWQKQXVnIDI3IDE0OjI2OjQ5IG1vd2EyMTktZ2pwNC04NTcwcC1mcmVlYnNkIGtl cm5lbDogZGExIGF0IHVtYXNzLXNpbTAgYnVzIDAgc2NidXM0IHRhcmdldCAwIGx1biAxCkF1 ZyAyNyAxNDoyNjo0OSBtb3dhMjE5LWdqcDQtODU3MHAtZnJlZWJzZCBrZXJuZWw6IGRhMTog PEdlbmVyaWMgVVNCIENGIFJlYWRlciAxLjAxPiAgcy9uIDA1OEYzMTJEODFCIGRldGFjaGVk CkF1ZyAyNyAxNDoyNjo0OSBtb3dhMjE5LWdqcDQtODU3MHAtZnJlZWJzZCBrZXJuZWw6IGRh MiBhdCB1bWFzcy1zaW0wIGJ1cyAwIHNjYnVzNCB0YXJnZXQgMCBsdW4gMgpBdWcgMjcgMTQ6 MjY6NDkgbW93YTIxOS1nanA0LTg1NzBwLWZyZWVic2Qga2VybmVsOiBkYTI6IDxHZW5lcmlj IFVTQiBTTSBSZWFkZXIgMS4wMj4gIHMvbiAwNThGMzEyRDgxQiBkZXRhY2hlZApBdWcgMjcg MTQ6MjY6NDkgbW93YTIxOS1nanA0LTg1NzBwLWZyZWVic2Qga2VybmVsOiAoZGEwOnVtYXNz LXNpbTA6MDowOjApOiBQZXJpcGggZGVzdHJveWVkCkF1ZyAyNyAxNDoyNjo0OSBtb3dhMjE5 LWdqcDQtODU3MHAtZnJlZWJzZCBrZXJuZWw6IGRhMyBhdCB1bWFzcy1zaW0wIGJ1cyAwIHNj YnVzNCB0YXJnZXQgMCBsdW4gMwpBdWcgMjcgMTQ6MjY6NDkgbW93YTIxOS1nanA0LTg1NzBw LWZyZWVic2Qga2VybmVsOiBkYTM6IDxHZW5lcmljIFVTQiBNUyBSZWFkZXIgMS4wMz4gIHMv biAwNThGMzEyRDgxQiBkZXRhY2hlZApBdWcgMjcgMTQ6MjY6NDkgbW93YTIxOS1nanA0LTg1 NzBwLWZyZWVic2Qga2VybmVsOiAoZGExOnVtYXNzLXNpbTA6MDowOjEpOiBQZXJpcGggZGVz dHJveWVkCkF1ZyAyNyAxNDoyNjo0OSBtb3dhMjE5LWdqcDQtODU3MHAtZnJlZWJzZCBrZXJu ZWw6IChkYTM6dW1hc3Mtc2ltMDowOjA6Myk6IFBlcmlwaCBkZXN0cm95ZWQKQXVnIDI3IDE0 OjI2OjQ5IG1vd2EyMTktZ2pwNC04NTcwcC1mcmVlYnNkIGtlcm5lbDogKGRhMjp1bWFzcy1z aW0wOjA6MDoyKTogUGVyaXBoIGRlc3Ryb3llZApBdWcgMjcgMTQ6MjY6NDkgbW93YTIxOS1n anA0LTg1NzBwLWZyZWVic2Qga2VybmVsOiB1bWFzczA6IGRldGFjaGVkCl5DCnJvb3RAbW93 YTIxOS1nanA0LTg1NzBwLWZyZWVic2Q6fiAjIGxzYmxrIApERVZJQ0UgICAgICAgICBNQUo6 TUlOIFNJWkUgVFlQRSAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAg IExBQkVMIE1PVU5UCmFkYTAgICAgICAgICAgICAgMDoxMjEgOTMyRyBHUFQgICAgICAgICAg ICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgIC0gLQogIGFkYTBwMSAgICAg ICAgIDA6MTIzIDI2ME0gZWZpICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAg Z3B0L2VmaWJvb3QwIC0KICA8RlJFRT4gICAgICAgICAtOi0gICAxLjBNIC0gICAgICAgICAg ICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgLSAtCiAgYWRhMHAyICAg ICAgICAgMDoxMjUgIDE2RyBmcmVlYnNkLXN3YXAgICAgICAgICAgICAgICAgICAgICAgICAg ICAgICBncHQvc3dhcDAgU1dBUAogIGFkYTBwMi5lbGkgICAgIDI6NjcgICAxNkcgZnJlZWJz ZC1zd2FwICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAtIFNXQVAKICBh ZGEwcDMgICAgICAgICAwOjEyNyA5MTVHIGZyZWVic2QtemZzICAgICAgICAgICAgICAgICAg ICAgICAgICAgICAgICBncHQvemZzMCA8WkZTPgogIGFkYTBwMy5lbGkgICAgIDA6MTM0IDkx NUcgemZzICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAt IC0KICA8RlJFRT4gICAgICAgICAtOi0gICA3MDhLIC0gICAgICAgICAgICAgICAgICAgICAg ICAgICAgICAgICAgICAgICAgICAgICAgICAgLSAtCmNkMCAgICAgICAgICAgICAgMDoxMjkg ICAwQiAtICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAg IC0gLQpkYTUgICAgICAgICAgICAgIDA6MjE1IDQ2NkcgR1BUICAgICAgICAgICAgICAgICAg ICAgICAgICAgICAgICAgICAgICAgICAgICAgICAtIC0KICA8RlJFRT4gICAgICAgICAtOi0g ICAxLjBNIC0gICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAg ICAgLSAtCiAgZGE1cDEgICAgICAgICAgMDoyMTYgNDY2RyBmcmVlYnNkLXpmcyAgICAgICAg ICAgICAgICAgICAgICAgICAgIGdwdC9UcmFuc2NlbmQgPFpGUz4KZGE2ICAgICAgICAgICAg ICAwOjIyMyAgMTRHIEdQVCAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAg ICAgICAgICAgLSAtCiAgPEZSRUU+ICAgICAgICAgLTotICAgMS4wTSAtICAgICAgICAgICAg ICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgIC0gLQogIGRhNnAxICAgICAg ICAgIDA6MjI0ICAxNEcgZnJlZWJzZC16ZnMgICAgICAgICAgICAgICAgICAgICBncHQvY2Fj aGUtdHJhbnNjZW5kIDxaRlM+CmRhNyAgICAgICAgICAgICAgMDoyNDcgIDI5RyBHUFQgICAg ICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgIC0gLQogIGRhN3Ax ICAgICAgICAgIDA6MjQ4ICAyOUcgZnJlZWJzZC16ZnMgICAgICAgICAgICAgICAgICAgICAg ICBncHQvY2FjaGUtYXVndXN0IDxaRlM+CnJvb3RAbW93YTIxOS1nanA0LTg1NzBwLWZyZWVi c2Q6fiAjIHRhaWwgLWYgLW4gMCAvdmFyL2xvZy9tZXNzYWdlcwpBdWcgMjcgMTQ6Mjc6Mjgg bW93YTIxOS1nanA0LTg1NzBwLWZyZWVic2Qga2VybmVsOiB1Z2VuMC41OiA8R2VuZXJpYyBN YXNzIFN0b3JhZ2UgRGV2aWNlPiBhdCB1c2J1czAKQXVnIDI3IDE0OjI3OjI4IG1vd2EyMTkt Z2pwNC04NTcwcC1mcmVlYnNkIGtlcm5lbDogdW1hc3MwIG9uIHVodWI2CkF1ZyAyNyAxNDoy NzoyOCBtb3dhMjE5LWdqcDQtODU3MHAtZnJlZWJzZCBrZXJuZWw6IHVtYXNzMDogPEdlbmVy aWMgTWFzcyBTdG9yYWdlIERldmljZSwgY2xhc3MgMC8wLCByZXYgMi4wMC8xLjI5LCBhZGRy IDEzPiBvbiB1c2J1czAKQXVnIDI3IDE0OjI3OjI4IG1vd2EyMTktZ2pwNC04NTcwcC1mcmVl YnNkIGtlcm5lbDogZGEwIGF0IHVtYXNzLXNpbTAgYnVzIDAgc2NidXM0IHRhcmdldCAwIGx1 biAwCkF1ZyAyNyAxNDoyNzoyOCBtb3dhMjE5LWdqcDQtODU3MHAtZnJlZWJzZCBrZXJuZWw6 IGRhMDogPEdlbmVyaWMgVVNCIFNEIFJlYWRlciAxLjAwPiBSZW1vdmFibGUgRGlyZWN0IEFj Y2VzcyBTQ1NJIGRldmljZQpBdWcgMjcgMTQ6Mjc6MjggbW93YTIxOS1nanA0LTg1NzBwLWZy ZWVic2Qga2VybmVsOiBkYTA6IFNlcmlhbCBOdW1iZXIgMDU4RjMxMkQ4MUIKQXVnIDI3IDE0 OjI3OjI4IG1vd2EyMTktZ2pwNC04NTcwcC1mcmVlYnNkIGtlcm5lbDogZGEwOiA0MC4wMDBN Qi9zIHRyYW5zZmVycwpBdWcgMjcgMTQ6Mjc6MjggbW93YTIxOS1nanA0LTg1NzBwLWZyZWVi c2Qga2VybmVsOiBkYTA6IEF0dGVtcHQgdG8gcXVlcnkgZGV2aWNlIHNpemUgZmFpbGVkOiBO T1QgUkVBRFksIE1lZGl1bSBub3QgcHJlc2VudApBdWcgMjcgMTQ6Mjc6MjggbW93YTIxOS1n anA0LTg1NzBwLWZyZWVic2Qga2VybmVsOiBkYTA6IHF1aXJrcz0weDI8Tk9fNl9CWVRFPgpB dWcgMjcgMTQ6Mjc6MjggbW93YTIxOS1nanA0LTg1NzBwLWZyZWVic2Qga2VybmVsOiBkYTEg YXQgdW1hc3Mtc2ltMCBidXMgMCBzY2J1czQgdGFyZ2V0IDAgbHVuIDEKQXVnIDI3IDE0OjI3 OjI4IG1vd2EyMTktZ2pwNC04NTcwcC1mcmVlYnNkIGtlcm5lbDogZGExOiA8R2VuZXJpYyBV U0IgQ0YgUmVhZGVyIDEuMDE+IFJlbW92YWJsZSBEaXJlY3QgQWNjZXNzIFNDU0kgZGV2aWNl CkF1ZyAyNyAxNDoyNzoyOCBtb3dhMjE5LWdqcDQtODU3MHAtZnJlZWJzZCBrZXJuZWw6IGRh MTogU2VyaWFsIE51bWJlciAwNThGMzEyRDgxQgpBdWcgMjcgMTQ6Mjc6MjggbW93YTIxOS1n anA0LTg1NzBwLWZyZWVic2Qga2VybmVsOiBkYTE6IDQwLjAwME1CL3MgdHJhbnNmZXJzCkF1 ZyAyNyAxNDoyNzoyOCBtb3dhMjE5LWdqcDQtODU3MHAtZnJlZWJzZCBrZXJuZWw6IGRhMTog QXR0ZW1wdCB0byBxdWVyeSBkZXZpY2Ugc2l6ZSBmYWlsZWQ6IE5PVCBSRUFEWSwgTWVkaXVt IG5vdCBwcmVzZW50CkF1ZyAyNyAxNDoyNzoyOCBtb3dhMjE5LWdqcDQtODU3MHAtZnJlZWJz ZCBrZXJuZWw6IGRhMTogcXVpcmtzPTB4MjxOT182X0JZVEU+CkF1ZyAyNyAxNDoyNzoyOCBt b3dhMjE5LWdqcDQtODU3MHAtZnJlZWJzZCBrZXJuZWw6IGRhMiBhdCB1bWFzcy1zaW0wIGJ1 cyAwIHNjYnVzNCB0YXJnZXQgMCBsdW4gMgpBdWcgMjcgMTQ6Mjc6MjggbW93YTIxOS1nanA0 LTg1NzBwLWZyZWVic2Qga2VybmVsOiBkYTI6IDxHZW5lcmljIFVTQiBTTSBSZWFkZXIgMS4w Mj4gUmVtb3ZhYmxlIERpcmVjdCBBY2Nlc3MgU0NTSSBkZXZpY2UKQXVnIDI3IDE0OjI3OjI4 IG1vd2EyMTktZ2pwNC04NTcwcC1mcmVlYnNkIGtlcm5lbDogZGEyOiBTZXJpYWwgTnVtYmVy IDA1OEYzMTJEODFCCkF1ZyAyNyAxNDoyNzoyOCBtb3dhMjE5LWdqcDQtODU3MHAtZnJlZWJz ZCBrZXJuZWw6IGRhMjogNDAuMDAwTUIvcyB0cmFuc2ZlcnMKQXVnIDI3IDE0OjI3OjI4IG1v d2EyMTktZ2pwNC04NTcwcC1mcmVlYnNkIGtlcm5lbDogZGEyOiBBdHRlbXB0IHRvIHF1ZXJ5 IGRldmljZSBzaXplIGZhaWxlZDogTk9UIFJFQURZLCBNZWRpdW0gbm90IHByZXNlbnQKQXVn IDI3IDE0OjI3OjI4IG1vd2EyMTktZ2pwNC04NTcwcC1mcmVlYnNkIGtlcm5lbDogZGEyOiBx dWlya3M9MHgyPE5PXzZfQllURT4KQXVnIDI3IDE0OjI3OjI4IG1vd2EyMTktZ2pwNC04NTcw cC1mcmVlYnNkIGtlcm5lbDogZGEzIGF0IHVtYXNzLXNpbTAgYnVzIDAgc2NidXM0IHRhcmdl dCAwIGx1biAzCkF1ZyAyNyAxNDoyNzoyOCBtb3dhMjE5LWdqcDQtODU3MHAtZnJlZWJzZCBr ZXJuZWw6IGRhMzogPEdlbmVyaWMgVVNCIE1TIFJlYWRlciAxLjAzPiBSZW1vdmFibGUgRGly ZWN0IEFjY2VzcyBTQ1NJIGRldmljZQpBdWcgMjcgMTQ6Mjc6MjggbW93YTIxOS1nanA0LTg1 NzBwLWZyZWVic2Qga2VybmVsOiBkYTM6IFNlcmlhbCBOdW1iZXIgMDU4RjMxMkQ4MUIKQXVn IDI3IDE0OjI3OjI4IG1vd2EyMTktZ2pwNC04NTcwcC1mcmVlYnNkIGtlcm5lbDogZGEzOiA0 MC4wMDBNQi9zIHRyYW5zZmVycwpBdWcgMjcgMTQ6Mjc6MjggbW93YTIxOS1nanA0LTg1NzBw LWZyZWVic2Qga2VybmVsOiBkYTM6IEF0dGVtcHQgdG8gcXVlcnkgZGV2aWNlIHNpemUgZmFp bGVkOiBOT1QgUkVBRFksIE1lZGl1bSBub3QgcHJlc2VudApBdWcgMjcgMTQ6Mjc6MjggbW93 YTIxOS1nanA0LTg1NzBwLWZyZWVic2Qga2VybmVsOiBkYTM6IHF1aXJrcz0weDI8Tk9fNl9C WVRFPgpBdWcgMjcgMTQ6Mjc6MzIgbW93YTIxOS1nanA0LTg1NzBwLWZyZWVic2Qga2VybmVs OiB1Z2VuMC42OiA8Sk1pY3JvbiBVU0IgdG8gQVRBL0FUQVBJIGJyaWRnZT4gYXQgdXNidXMw CkF1ZyAyNyAxNDoyNzozMiBtb3dhMjE5LWdqcDQtODU3MHAtZnJlZWJzZCBrZXJuZWw6IHVt YXNzMSBvbiB1aHViNgpBdWcgMjcgMTQ6Mjc6MzIgbW93YTIxOS1nanA0LTg1NzBwLWZyZWVi c2Qga2VybmVsOiB1bWFzczE6IDxNU0MgQnVsay1Pbmx5IFRyYW5zZmVyPiBvbiB1c2J1czAK QXVnIDI3IDE0OjI3OjMyIG1vd2EyMTktZ2pwNC04NTcwcC1mcmVlYnNkIGtlcm5lbDogZGE0 IGF0IHVtYXNzLXNpbTEgYnVzIDEgc2NidXM1IHRhcmdldCAwIGx1biAwCkF1ZyAyNyAxNDoy NzozMiBtb3dhMjE5LWdqcDQtODU3MHAtZnJlZWJzZCBrZXJuZWw6IGRhNDogPEhHU1QgSFRT IDcyNTA1MEE3RTYzMCA+IEZpeGVkIERpcmVjdCBBY2Nlc3MgU0NTSS0yIGRldmljZQpBdWcg MjcgMTQ6Mjc6MzIgbW93YTIxOS1nanA0LTg1NzBwLWZyZWVic2Qga2VybmVsOiBkYTQ6IFNl cmlhbCBOdW1iZXIgRjA1MDA5MDY4MUZGCkF1ZyAyNyAxNDoyNzozMiBtb3dhMjE5LWdqcDQt ODU3MHAtZnJlZWJzZCBrZXJuZWw6IGRhNDogNDAuMDAwTUIvcyB0cmFuc2ZlcnMKQXVnIDI3 IDE0OjI3OjMyIG1vd2EyMTktZ2pwNC04NTcwcC1mcmVlYnNkIGtlcm5lbDogZGE0OiA0NzY5 NDBNQiAoOTc2NzczMTY4IDUxMiBieXRlIHNlY3RvcnMpCkF1ZyAyNyAxNDoyNzozMiBtb3dh MjE5LWdqcDQtODU3MHAtZnJlZWJzZCBrZXJuZWw6IGRhNDogcXVpcmtzPTB4MjxOT182X0JZ VEU+Cl5DCnJvb3RAbW93YTIxOS1nanA0LTg1NzBwLWZyZWVic2Q6fiAjIGxzYmxrCkRFVklD RSAgICAgICAgIE1BSjpNSU4gU0laRSBUWVBFICAgICAgICAgICAgICAgICAgICAgICAgICAg ICAgICAgICAgICAgICAgTEFCRUwgTU9VTlQKYWRhMCAgICAgICAgICAgICAwOjEyMSA5MzJH IEdQVCAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgLSAt CiAgYWRhMHAxICAgICAgICAgMDoxMjMgMjYwTSBlZmkgICAgICAgICAgICAgICAgICAgICAg ICAgICAgICAgICAgICBncHQvZWZpYm9vdDAgLQogIDxGUkVFPiAgICAgICAgIC06LSAgIDEu ME0gLSAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAt IC0KICBhZGEwcDIgICAgICAgICAwOjEyNSAgMTZHIGZyZWVic2Qtc3dhcCAgICAgICAgICAg ICAgICAgICAgICAgICAgICAgIGdwdC9zd2FwMCBTV0FQCiAgYWRhMHAyLmVsaSAgICAgMjo2 NyAgIDE2RyBmcmVlYnNkLXN3YXAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAg ICAgIC0gU1dBUAogIGFkYTBwMyAgICAgICAgIDA6MTI3IDkxNUcgZnJlZWJzZC16ZnMgICAg ICAgICAgICAgICAgICAgICAgICAgICAgICAgIGdwdC96ZnMwIDxaRlM+CiAgYWRhMHAzLmVs aSAgICAgMDoxMzQgOTE1RyB6ZnMgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAg ICAgICAgICAgICAgIC0gLQogIDxGUkVFPiAgICAgICAgIC06LSAgIDcwOEsgLSAgICAgICAg ICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAtIC0KY2QwICAgICAg ICAgICAgICAwOjEyOSAgIDBCIC0gICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAg ICAgICAgICAgICAgICAgLSAtCmRhMCAgICAgICAgICAgICAgMDoxOTQgICAwQiBmcmVlYnNk LXN3YXAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgIC0gU1dBUApkYTEg ICAgICAgICAgICAgIDA6MTk1ICAgMEIgLSAgICAgICAgICAgICAgICAgICAgICAgICAgICAg ICAgICAgICAgICAgICAgICAgICAtIC0KZGEyICAgICAgICAgICAgICAwOjE5NiAgIDBCIC0g ICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgLSAtCmRh MyAgICAgICAgICAgICAgMDoxOTcgICAwQiAtICAgICAgICAgICAgICAgICAgICAgICAgICAg ICAgICAgICAgICAgICAgICAgICAgIC0gLQpkYTQgICAgICAgICAgICAgIDI6MTA2IDQ2Nkcg R1BUICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAtIC0K ICBkYTRwMSAgICAgICAgICAyOjEwNyAyMDBNIGVmaSAgICAgICAgICAgICAgICAgICAgICAg ICAgICAgICAgICBtc2Rvc2ZzL0VGSVNZUyAtCiAgZGE0cDIgICAgICAgICAgMjoxMDggNTEy SyBmcmVlYnNkLWJvb3QgICAgICAgICAgICAgICAgICAgICAgICAgICBncHQvZ3B0Ym9vdDAg LQogIGRhNHAzICAgICAgICAgIDI6MTA5ICAxNkcgZnJlZWJzZC1zd2FwICAgICAgICAgICAg ICAgICAgICAgZ3B0L0ZyZWVCU0QlMjBzd2FwIC0KICBkYTRwNCAgICAgICAgICAyOjExMCA0 NTBHIGZyZWVic2QtemZzICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICBncHQvemZz MCA8WkZTPgogIDxGUkVFPiAgICAgICAgIC06LSAgIDQuMEsgLSAgICAgICAgICAgICAgICAg ICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAtIC0KZGE1ICAgICAgICAgICAgICAw OjIxNSA0NjZHIEdQVCAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAg ICAgICAgLSAtCiAgPEZSRUU+ICAgICAgICAgLTotICAgMS4wTSAtICAgICAgICAgICAgICAg ICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgIC0gLQogIGRhNXAxICAgICAgICAg IDA6MjE2IDQ2NkcgZnJlZWJzZC16ZnMgICAgICAgICAgICAgICAgICAgICAgICAgICBncHQv VHJhbnNjZW5kIDxaRlM+CmRhNiAgICAgICAgICAgICAgMDoyMjMgIDE0RyBHUFQgICAgICAg ICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgIC0gLQogIDxGUkVFPiAg ICAgICAgIC06LSAgIDEuME0gLSAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAg ICAgICAgICAgICAgICAtIC0KICBkYTZwMSAgICAgICAgICAwOjIyNCAgMTRHIGZyZWVic2Qt emZzICAgICAgICAgICAgICAgICAgICAgZ3B0L2NhY2hlLXRyYW5zY2VuZCA8WkZTPgpkYTcg ICAgICAgICAgICAgIDA6MjQ3ICAyOUcgR1BUICAgICAgICAgICAgICAgICAgICAgICAgICAg ICAgICAgICAgICAgICAgICAgICAtIC0KICBkYTdwMSAgICAgICAgICAwOjI0OCAgMjlHIGZy ZWVic2QtemZzICAgICAgICAgICAgICAgICAgICAgICAgZ3B0L2NhY2hlLWF1Z3VzdCA8WkZT Pgpyb290QG1vd2EyMTktZ2pwNC04NTcwcC1mcmVlYnNkOn4gIyBzeW5jCnJvb3RAbW93YTIx OS1nanA0LTg1NzBwLWZyZWVic2Q6fiAjIGdlb20gZGlzayBsaXN0Ckdlb20gbmFtZTogYWRh MApQcm92aWRlcnM6CjEuIE5hbWU6IGFkYTAKICAgTWVkaWFzaXplOiAxMDAwMjA0ODg2MDE2 ICg5MzJHKQogICBTZWN0b3JzaXplOiA1MTIKICAgU3RyaXBlc2l6ZTogNDA5NgogICBTdHJp cGVvZmZzZXQ6IDAKICAgTW9kZTogcjJ3MmU0CiAgIGRlc2NyOiBIR1NUIEhUUzcyMTAxMEE5 RTYzMAogICBsdW5pZDogNTAwMGNjYThjOGY2NjlkMgogICBpZGVudDogSlIxMDAwRDMzVlBT QkUKICAgcm90YXRpb25yYXRlOiA3MjAwCiAgIGZ3c2VjdG9yczogNjMKICAgZndoZWFkczog MTYKCkdlb20gbmFtZTogY2QwClByb3ZpZGVyczoKMS4gTmFtZTogY2QwCiAgIE1lZGlhc2l6 ZTogMCAoMEIpCiAgIFNlY3RvcnNpemU6IDIwNDgKICAgTW9kZTogcjB3MGUwCiAgIGRlc2Ny OiBocCBEVkRSQU0gR1Q4ME4KICAgaWRlbnQ6IChudWxsKQogICByb3RhdGlvbnJhdGU6IHVu a25vd24KICAgZndzZWN0b3JzOiAwCiAgIGZ3aGVhZHM6IDAKCkdlb20gbmFtZTogZGE1ClBy b3ZpZGVyczoKMS4gTmFtZTogZGE1CiAgIE1lZGlhc2l6ZTogNTAwMTA3ODYyMDE2ICg0NjZH KQogICBTZWN0b3JzaXplOiA1MTIKICAgU3RyaXBlc2l6ZTogNDA5NgogICBTdHJpcGVvZmZz ZXQ6IDAKICAgTW9kZTogcjF3MWUzCiAgIGRlc2NyOiBTdG9yZUpldCBUcmFuc2NlbmQKICAg bHVuaWQ6IDUwMDAwMDAwMDAwMDAwMDEKICAgaWRlbnQ6IFgzRTFTQUtSUwogICByb3RhdGlv bnJhdGU6IHVua25vd24KICAgZndzZWN0b3JzOiA2MwogICBmd2hlYWRzOiAyNTUKCkdlb20g bmFtZTogZGE2ClByb3ZpZGVyczoKMS4gTmFtZTogZGE2CiAgIE1lZGlhc2l6ZTogMTU1MTg5 MjQ4MDAgKDE0RykKICAgU2VjdG9yc2l6ZTogNTEyCiAgIE1vZGU6IHIxdzFlMwogICBkZXNj cjogS2luZ3N0b24gRGF0YVRyYXZlbGVyIDMuMAogICBsdW5uYW1lOiBLaW5nc3RvbkRhdGFU cmF2ZWxlciAzLjAKICAgbHVuaWQ6IEtpbmdzdG9uRGF0YVRyYXZlbGVyIDMuMAogICBpZGVu dDogNjBBNDRDM0ZBQ0M5MzExMEI5OTcwMDQ1CiAgIHJvdGF0aW9ucmF0ZTogMAogICBmd3Nl Y3RvcnM6IDYzCiAgIGZ3aGVhZHM6IDI1NQoKR2VvbSBuYW1lOiBkYTcKUHJvdmlkZXJzOgox LiBOYW1lOiBkYTcKICAgTWVkaWFzaXplOiAzMDk0Mzk5NTkwNCAoMjlHKQogICBTZWN0b3Jz aXplOiA1MTIKICAgTW9kZTogcjF3MWUzCiAgIGRlc2NyOiBLaW5nc3RvbiBEYXRhVHJhdmVs ZXIgMy4wCiAgIGlkZW50OiBFMEQ1NUVBMUM4NEZGMzkwQTk1MDBGREEKICAgcm90YXRpb25y YXRlOiB1bmtub3duCiAgIGZ3c2VjdG9yczogNjMKICAgZndoZWFkczogMjU1CgpHZW9tIG5h bWU6IGRhMApQcm92aWRlcnM6CjEuIE5hbWU6IGRhMAogICBNZWRpYXNpemU6IDAgKDBCKQog ICBTZWN0b3JzaXplOiA1MTIKICAgTW9kZTogcjB3MGUwCiAgIGRlc2NyOiBHZW5lcmljIFVT QiBTRCBSZWFkZXIKICAgaWRlbnQ6IDA1OEYzMTJEODFCCiAgIHJvdGF0aW9ucmF0ZTogdW5r bm93bgogICBmd3NlY3RvcnM6IDAKICAgZndoZWFkczogMAoKR2VvbSBuYW1lOiBkYTEKUHJv dmlkZXJzOgoxLiBOYW1lOiBkYTEKICAgTWVkaWFzaXplOiAwICgwQikKICAgU2VjdG9yc2l6 ZTogNTEyCiAgIE1vZGU6IHIwdzBlMAogICBkZXNjcjogR2VuZXJpYyBVU0IgQ0YgUmVhZGVy CiAgIGlkZW50OiAwNThGMzEyRDgxQgogICByb3RhdGlvbnJhdGU6IHVua25vd24KICAgZndz ZWN0b3JzOiAwCiAgIGZ3aGVhZHM6IDAKCkdlb20gbmFtZTogZGEyClByb3ZpZGVyczoKMS4g TmFtZTogZGEyCiAgIE1lZGlhc2l6ZTogMCAoMEIpCiAgIFNlY3RvcnNpemU6IDUxMgogICBN b2RlOiByMHcwZTAKICAgZGVzY3I6IEdlbmVyaWMgVVNCIFNNIFJlYWRlcgogICBpZGVudDog MDU4RjMxMkQ4MUIKICAgcm90YXRpb25yYXRlOiB1bmtub3duCiAgIGZ3c2VjdG9yczogMAog ICBmd2hlYWRzOiAwCgpHZW9tIG5hbWU6IGRhMwpQcm92aWRlcnM6CjEuIE5hbWU6IGRhMwog ICBNZWRpYXNpemU6IDAgKDBCKQogICBTZWN0b3JzaXplOiA1MTIKICAgTW9kZTogcjB3MGUw CiAgIGRlc2NyOiBHZW5lcmljIFVTQiBNUyBSZWFkZXIKICAgaWRlbnQ6IDA1OEYzMTJEODFC CiAgIHJvdGF0aW9ucmF0ZTogdW5rbm93bgogICBmd3NlY3RvcnM6IDAKICAgZndoZWFkczog MAoKR2VvbSBuYW1lOiBkYTQKUHJvdmlkZXJzOgoxLiBOYW1lOiBkYTQKICAgTWVkaWFzaXpl OiA1MDAxMDc4NjIwMTYgKDQ2NkcpCiAgIFNlY3RvcnNpemU6IDUxMgogICBNb2RlOiByMHcw ZTAKICAgZGVzY3I6IEhHU1QgSFRTIDcyNTA1MEE3RTYzMAogICBsdW5uYW1lOiBKTWljcm9u IFVTQiB0byBBVEEvQVRBUEkgYnJpZGdlCiAgIGx1bmlkOiBKTWljcm9uIFVTQiB0byBBVEEv QVRBUEkgYnJpZGdlCiAgIGlkZW50OiBGMDUwMDkwNjgxRkYKICAgcm90YXRpb25yYXRlOiB1 bmtub3duCiAgIGZ3c2VjdG9yczogNjMKICAgZndoZWFkczogMjU1Cgpyb290QG1vd2EyMTkt Z2pwNC04NTcwcC1mcmVlYnNkOn4gIyBzeXNjdGwga2Vybi5nZW9tLmRlYnVnZmxhZ3M9MApr ZXJuLmdlb20uZGVidWdmbGFnczogMTYgLT4gMApyb290QG1vd2EyMTktZ2pwNC04NTcwcC1m cmVlYnNkOn4gIyAK --------------E96EBDC44C99AF98F1A56E5D-- From nobody Fri Aug 27 15:19:22 2021 X-Original-To: freebsd-current@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 44EA01783669 for ; Fri, 27 Aug 2021 15:19:40 +0000 (UTC) (envelope-from jlehen@gmail.com) Received: from mail-il1-f172.google.com (mail-il1-f172.google.com [209.85.166.172]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "GTS CA 1O1" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4Gx3Kl3zv7z3QLT for ; Fri, 27 Aug 2021 15:19:39 +0000 (UTC) (envelope-from jlehen@gmail.com) Received: by mail-il1-f172.google.com with SMTP id x5so7358814ill.3 for ; Fri, 27 Aug 2021 08:19:39 -0700 (PDT) X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:references:in-reply-to:from:date :message-id:subject:to; bh=5tjP3szgk4GJZFl19e+4Fdxt22Ua4p3jOVuMRPg31Rk=; b=SL0R/Xz9mv5Y2emak1zdl9OmPt4ngU4knJPznrBA8EdgL0kBTc3rwCrAIFDt2UCqUQ bRlfEpbqI1cl424FrQO7MTbAhFwmjr5849Z03BAnVZmQ6JRGHM8iIBnDhsI0sN5JaJ2A qwqwdURlPQHmIDxioBeCnYo5Q7/dekuCBmx/VLu4AGcNid5ztYuVplABZalbXoLbr8On 9hhNPYcS8V7zkXeE8/jbknzv7RoidVMBkbedIeZAY2XXrNcTSTNppC+CKOfWb90iuIrc Zsuj2yKZi937Rhl/YDpg7yt4l1cG/p8NfWKAvK40K9wCNSUeCPx4HSVgZm/gsD1PMXkl 3P6Q== X-Gm-Message-State: AOAM530+Hfm23grkwqClUCOy+FE3j9Zp2YfXOxh/P+RsWgz2cCXAfLqB mXmLsTvgrAE5i5qZFm5k6RG6SC0jej7rcpu97WfsoU/UU/rsFNej X-Google-Smtp-Source: ABdhPJyfgPKlCjj4OqtUUtUE+E2uHvqbKbbz8rER1dYQIY9OBoREev4w1iYsLk+ZZ/PdIdN5PyB0xGjlkG3/9rVgenk= X-Received: by 2002:a92:4b02:: with SMTP id m2mr3983836ilg.94.1630077573407; Fri, 27 Aug 2021 08:19:33 -0700 (PDT) List-Id: Discussions about the use of FreeBSD-current List-Archive: https://lists.freebsd.org/archives/freebsd-current List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-current@freebsd.org MIME-Version: 1.0 References: In-Reply-To: From: Jeremie Le Hen Date: Fri, 27 Aug 2021 17:19:22 +0200 Message-ID: Subject: Re: ZFS crash with -CURRENT from Aug 23rd To: FreeBSD Current Content-Type: text/plain; charset="UTF-8" X-Rspamd-Queue-Id: 4Gx3Kl3zv7z3QLT X-Spamd-Bar: -- Authentication-Results: mx1.freebsd.org; dkim=none; dmarc=none; spf=pass (mx1.freebsd.org: domain of jlehen@gmail.com designates 209.85.166.172 as permitted sender) smtp.mailfrom=jlehen@gmail.com X-Spamd-Result: default: False [-2.64 / 15.00]; ARC_NA(0.00)[]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; RCVD_COUNT_TWO(0.00)[2]; RCVD_TLS_ALL(0.00)[]; FROM_HAS_DN(0.00)[]; R_SPF_ALLOW(-0.20)[+ip4:209.85.128.0/17:c]; TO_MATCH_ENVRCPT_ALL(0.00)[]; MIME_GOOD(-0.10)[text/plain]; PREVIOUSLY_DELIVERED(0.00)[freebsd-current@freebsd.org]; DMARC_NA(0.00)[freebsd.org]; RCPT_COUNT_ONE(0.00)[1]; NEURAL_HAM_LONG(-0.71)[-0.712]; TO_DN_ALL(0.00)[]; NEURAL_HAM_SHORT(-0.92)[-0.924]; RCVD_IN_DNSWL_NONE(0.00)[209.85.166.172:from]; FORGED_SENDER(0.30)[jlh@freebsd.org,jlehen@gmail.com]; RWL_MAILSPIKE_POSSIBLE(0.00)[209.85.166.172:from]; R_DKIM_NA(0.00)[]; MIME_TRACE(0.00)[0:+]; ASN(0.00)[asn:15169, ipnet:209.85.128.0/17, country:US]; FROM_NEQ_ENVFROM(0.00)[jlh@freebsd.org,jlehen@gmail.com]; FREEMAIL_ENVFROM(0.00)[gmail.com]; TO_DOM_EQ_FROM_DOM(0.00)[] X-ThisMailContainsUnwantedMimeParts: N On Fri, Aug 27, 2021 at 1:40 PM Jeremie Le Hen wrote: > > Hey, > > I can consistently crash my machine by creating a directory using Samba: > > Tracing pid 57242 tid 270954 td 0xfffffe01446941e0 > kdb_enter() at kdb_enter+0x37/frame 0xfffffe0147380210 > vpanic() at vpanic+0x1b2/frame 0xfffffe0147380260 > spl_panic() at spl_panic+0x3a/frame 0xfffffe01473802c0 > zfs_sa_get_xattr() at zfs_sa_get_xattr+0x1ac/frame 0xfffffe0147380300 > zfs_ensure_xattr_cached() at zfs_ensure_xattr_cached+0x6c/frame > 0xfffffe0147380330 > zfs_deleteextattr_sa() at zfs_deleteextattr_sa+0x1e/frame 0xfffffe0147380360 > zfs_setextattr() at zfs_setextattr+0x1e3/frame 0xfffffe01473804e0 > VOP_SETEXTATTR_APV() at VOP_SETEXTATTR_APV+0x40/frame 0xfffffe0147380500 > null_bypass() at null_bypass+0xf6/frame 0xfffffe0147380680 > VOP_SETEXTATTR_APV() at VOP_SETEXTATTR_APV+0x40/frame 0xfffffe01473806a0 > extattr_set_vp() at extattr_set_vp+0x11d/frame 0xfffffe0147380770 > kern_extattr_set_path() at kern_extattr_set_path+0x181/frame 0xfffffe01473809a0 > sys_extattr_set_file() at sys_extattr_set_file+0x29/frame 0xfffffe01473809c0 > amd64_syscall() at amd64_syscall+0x12e/frame 0xfffffe0147380af0 > fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe0147380af0 > > Let me know if I can provide further information. Actually this may help too Dump header from device: /dev/gptid/25d0ef97-914b-11e4-9b8e-f44d30620eeb Architecture: amd64 Architecture Version: 4 Dump Length: 422400 Blocksize: 512 Compression: none Dumptime: 2021-08-27 11:27:30 +0200 Hostname: obiwan.local Magic: FreeBSD Text Dump Version String: FreeBSD 14.0-CURRENT #7 main-n248866-72a92f91f466: Mon Aug 23 14:24:56 CEST 2021 root@obiwan.local:/usr/obj/usr/src.git/amd64.amd64/sys/OBIWAN Panic String: VERIFY(zp->z_is_sa) failed Dump Parity: 1322125898 Bounds: 3 Dump Status: good -- Jeremie Le Hen jlh@FreeBSD.org From nobody Fri Aug 27 15:29:34 2021 X-Original-To: freebsd-current@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 5FE60178A371 for ; Fri, 27 Aug 2021 15:29:43 +0000 (UTC) (envelope-from tijl@freebsd.org) Received: from mailsec218.isp.belgacom.be (mailsec218.isp.belgacom.be [195.238.22.114]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client CN "relay.skynet.be", Issuer "GlobalSign RSA OV SSL CA 2018" (not verified)) by mx1.freebsd.org (Postfix) with ESMTPS id 4Gx3YL6vv5z3l3j; Fri, 27 Aug 2021 15:29:42 +0000 (UTC) (envelope-from tijl@freebsd.org) IronPort-SDR: 1VmJvCRCcD+HnTI9gxDlzuUyzE2oQOqF/lFxQu/0sVC9HP/ZtK6GgGMXdVGE0zqhcd7WSltIEg rIzLhvctJIQbPYuS+YbhhGvlP+vWe2K+3CWiN0N2bF3NScCDBrMaeW/Q9BPCYomLq4a5VZtvXm 1KOWzcv8/X3x75sO97MWfnUM9H1/GxVA4fznnUOD7P+LWrCq4zWFj02JzNij01ne36ly1LYeHp LvZzExKbmmS5/4LFVJcdZFRi/iWxG/yCjI0DMxRpgs/dqiDa7GwS3JAuYt9ql+eE818kWhLOTA D8M= X-IPAS-Result: =?us-ascii?q?A2AlAACnAylh/wSs8lFaHAEBAQEBAQcBARIBAQQEAQFAC?= =?us-ascii?q?YE8BwEBCwGDDGsBa4RHiCRghWKCJzgBiieRF4F8CwEBAQEBAQEBAUoEAQErh?= =?us-ascii?q?DcKAoIyJjQJDgECBAEBAQEDAgMBAQEBBQEBBgEBAQEBAQUEAYEjhS9GgjUig?= =?us-ascii?q?2wBBSNWEAsOCgICJgICITYGE4VHAzOrBoExgQGEaII5DYEhgSeBECoBjXlDg?= =?us-ascii?q?UtChD4+giCCJIMXgmQEhj2BAoM2vGpeglpbmHOFTUeVWJEkphKQOYZ+ghRNM?= =?us-ascii?q?AiDJFAZD44sFo4wPwMwOAIGAQoBAQMJgkWMVwE?= IronPort-PHdr: A9a23:7u4aXxHZLJ3GTxjT4vLMZZ1Gf/ZMhN3EVzX9CrIZgr5DOp6u447ld BSGo6k31BmQBN6QsaoMotGVmpioYXYH75eFvSJKW713fDhBt/8rmRc9CtWOE0zxIa2iRSU7G MNfSA0tpCnjYgBaF8nkelLdvGC54yIMFRXjLwp1Ifn+FpLPg8it2O2+5YHfbx9ViDagb75+I wu6oRnMvcQKnIVuLbo8xAHUqXVSYeRWwm1oJVOXnxni48q74YBu/SdNtf8/7sBMSar1cbg2Q rxeFzQmLns65Nb3uhnZTAuA/WUTX2MLmRdVGQfF7RX6XpDssivms+d2xSeXMdHqQb0yRD+v6 bpgRh31hycdLzM3/mHZhNJtgqxYoh2hqRNwzJLbboyOKPp+Z7nQcc8GSWZdXMtcUTFKDIOmb 4sICuoMJfhWrYz5p1ATsxa+Ag6sBPjxxT9NnHD227Y62PkmHAHa3QwgHdYOvW/UotXvKqgdT /24wrTGwznZaPNWwzj95ZHOfxs8rv6CQah+ftDNyUkzCQzFlFOQpJTrMT6V1+kAsHWW4vdiW O6zlmMqqgF8rDeyy8oiioTHiJwZxk7E+Ch2wIg4O9+1RFN5bNO5E5ZduSWXOYRqTs0sRWxjp SU0yqUetJO4YSQG0ooryhHBZ/CdboSF4AzvWPyeLDp+mXlrYqiwhwyo/kil0uD8U86030tUo SddidnMs2wN1wTU6siaVvtx5keh1iiL1wDU8uxEIlo7la7aK54k3LEwjJ0TvV7fHi/3mkX2i LWaeVkj+uiv8OTofLDmqYWaN49vkA3+Nb4umsOnDeQ5NAgBQXSb9Py/2bH+50H1XrpHguMsn qXEsp3WO94Xq6GhDw9QyIkj6hK/Dzm80NQfmHkKNE5FeBOFj4jtIFzOLur4AumhjFu3izdk2 urKPrr7ApXCNnTDiqvufa5h605Azwo+1d5f54hKBb4fO/3zQVL+uMXEAR8kKQy02fjoCNNh1 o4FV2KPGLGWP73Jvl+T++0jOe6MZJUauDzlMfgq++bujWMlmV8aZaSmwJoXaHWjE/RoOUWWf 2TjjcwaEWgXpAY+S/bqiFKaWz5Je3myR7485i08CI++DofDQZutgKCA3Ce4BZJZeGRGB0uDE XftbYqEWvMMZDiOLc9mlzxXHYSmHqwm0wqyvQnmyrwvBOfQ/TADsoyrgNty/PHSlhs/8RR7C s2c1yeGSGQizU0SQDpj4Ed76Wd6zUyO1KF+mLQMCd1R49tnSAo3H6XwietgBIahCUr6Yt6VR QP+EZ2dCjYrQ4dpq+I= IronPort-HdrOrdr: A9a23:50CXIKuDJi24rl/lW0iKsN5O7skDr9V00zEX/kB9WHVpm62j5r 2TdZEgviMc5wxxZJheo6HnBEDtex/hHN1OkPAs1M6ZLXLbUTKTXftfBOjZskHd8k/FltK1vJ 0IG8JD4bvLYmSS5vyW3ODXKbgdKKTuytHRuQ4L9QYOcekXA5sQiDuRcjzrcXGeszM2YabRva Dsg/Z6mw== X-IronPort-Anti-Spam-Filtered: true Received: from 4.172-242-81.adsl-dyn.isp.belgacom.be (HELO kalimero.tijl.coosemans.org) ([81.242.172.4]) by relay.proximus.be with ESMTP; 27 Aug 2021 17:29:35 +0200 Received: from localhost (localhost [127.0.0.1]) by kalimero.tijl.coosemans.org (8.16.1/8.16.1) with ESMTP id 17RFTYtN002639; Fri, 27 Aug 2021 17:29:34 +0200 (CEST) (envelope-from tijl@FreeBSD.org) Date: Fri, 27 Aug 2021 17:29:34 +0200 From: =?UTF-8?B?VMSzbA==?= Coosemans To: Konstantin Belousov Cc: Dimitry Andric , freebsd-current@freebsd.org Subject: Re: i386 kernel modules unusable due to .plt sections Message-ID: <20210827172934.41e3a3f4@FreeBSD.org> In-Reply-To: References: <20210827154130.7a5b141c@FreeBSD.org> List-Id: Discussions about the use of FreeBSD-current List-Archive: https://lists.freebsd.org/archives/freebsd-current List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-current@freebsd.org MIME-Version: 1.0 Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: quoted-printable X-Rspamd-Queue-Id: 4Gx3YL6vv5z3l3j X-Spamd-Bar: ---- Authentication-Results: mx1.freebsd.org; none X-Spamd-Result: default: False [-4.00 / 15.00]; REPLY(-4.00)[] X-ThisMailContainsUnwantedMimeParts: N On Fri, 27 Aug 2021 17:24:58 +0300 Konstantin Belousov wrote: > On Fri, Aug 27, 2021 at 03:41:30PM +0200, T=C4=B3l Coosemans wrote: >> I use devel/llvm* to build base and just switched to llvm12. It seems >> that on i386 clang12 uses R_386_PLT32 relocations for some calls to at >> least memset, memcpy and __stack_chk_fail (clang11 uses R_386_PC32). >> These are converted to R_386_JMP_SLOT relocations by the linker which >> aren't supported by the kernel, e.g. loading linux.ko gives "kldload: >> unexpected relocation type" from sys/i386/i386/elf_machdep.c. The PLT >> entries also depend on a base pointer in %ebx but kernel modules aren't >> compiled with -fPIC, so this can't work and I suspect this is a >> regression in clang12. >>=20 >> The following code shows the difference between clang11 and clang12: >>=20 >> -------- >> #include >>=20 >> void * >> test_memset(void *p, int c, size_t len) { >> return (memset(p, c, len)); >> } >>=20 >> void * >> test_memcpy(void *dst, const void *src, size_t len) { >> return (memcpy(dst, src, len)); >> } >>=20 >> void * >> test_memmove(void *dst, const void *src, size_t len) { >> return (memmove(dst, src, len)); >> } >> -------- >>=20 >> Output of "readelf -r test.o" when compiled with "clang12 -c test.c -m32= ": >> r_offset r_info r_type st_value st_name >> 0000002c 00000504 R_386_PLT32 00000000 memset >> 00000067 00000304 R_386_PLT32 00000000 memcpy >> 000000a7 00000402 R_386_PC32 00000000 memmove >>=20 >> With clang11: >> r_offset r_info r_type st_value st_name >> 00000036 00000502 R_386_PC32 00000000 memset >> 00000083 00000302 R_386_PC32 00000000 memcpy >> 000000d2 00000402 R_386_PC32 00000000 memmove =20 >=20 > Are you asking (for somebody) to add R_386_JMP_SLOT to i386/elf_machdep.c? > Like this, not even built. >=20 > diff --git a/sys/i386/i386/elf_machdep.c b/sys/i386/i386/elf_machdep.c > index 3754b36d9e33..a26a4189e0ee 100644 > --- a/sys/i386/i386/elf_machdep.c > +++ b/sys/i386/i386/elf_machdep.c > @@ -245,6 +245,7 @@ elf_reloc_internal(linker_file_t lf, Elf_Addr relocba= se, const void *data, > break; > =20 > case R_386_GLOB_DAT: /* S */ > + case R_386_JMP_SLOT: > error =3D lookup(lf, symidx, 1, &addr); > if (error !=3D 0) > return (-1); No, I've tried that. It handles the relocation but callers still don't setup %ebx as PIC register. I'm looking for someone to confirm it's a compiler bug and not a missing flag or something. I tried -fno-plt and that has no effect. From nobody Fri Aug 27 15:32:43 2021 X-Original-To: freebsd-current@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 7839F178DB20 for ; Fri, 27 Aug 2021 15:33:00 +0000 (UTC) (envelope-from markjdb@gmail.com) Received: from mail-qt1-x82a.google.com (mail-qt1-x82a.google.com [IPv6:2607:f8b0:4864:20::82a]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "GTS CA 1O1" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4Gx3d82Yvxz3pBr; Fri, 27 Aug 2021 15:33:00 +0000 (UTC) (envelope-from markjdb@gmail.com) Received: by mail-qt1-x82a.google.com with SMTP id 2so1063793qtw.1; Fri, 27 Aug 2021 08:33:00 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=sender:date:from:to:cc:subject:message-id:references:mime-version :content-disposition:content-transfer-encoding:in-reply-to; bh=EK7UnSmVEaLnGscwDSCmHBkCcV+4HAnAaOReIFjb4CM=; b=GF8IJOiOl+T+/aBYxxHJMp2HXqzLdsgLjN4kuMIJ1muxhrCWlEWhVgrjHtt8235i7M 1fm0TfIwmgaDMxz2eO3JBVhiJa5SCCF6WNYgZEXbng0o70543jSwcuKu5c8U/dZDV2iD jkkZJ70LnkjYbhJqbC9a7bbMdiE1JCnOyFjPkdZ1FkNbzo2zVz2iZ1T6q6YUsRvAyBEo okvFTZv5Ktu+LGXTKznhaui/fI9OEz/POd8h7FfewF2wxPDnLWgZq3aVmNKZohXEBrTA LXnfS0XmWqDqp3Wzg/jajiNR9WJIPX69guhhOYFu9/UeJrVWpDU+xybX4chfLLvOAqrW Leig== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:sender:date:from:to:cc:subject:message-id :references:mime-version:content-disposition :content-transfer-encoding:in-reply-to; bh=EK7UnSmVEaLnGscwDSCmHBkCcV+4HAnAaOReIFjb4CM=; b=fyTA1Owf+N9qzW5pRGBoiNYng8DH68S1nrHV5gGmcWz7AtDFCJx/75g75FrQXuy9yE n2iZ8E7ncD23affsv6br/Hbwabj340+vKcSAHkjAjX3G8NQ/JQs5MfElQEHDH65b3n0F mRRStxFzFShQTPNdvSp4wFwpn+8TIU7u70Aix7cwiGsfGROup5OoyYxDws+pXOQZo494 bgfDbUSs+Z3J+5DPci4H7vh19ssxsK4OkS2KEi9NWB0AFWWL9aacsB5A1nqUg+JbEkaC wKGZ1ucOi/LUPqKHvd0UqzTZxx6l8cX20B6vCMQN0S4SaJnicbS6VDYT7Ohd72xw1guq 2npA== X-Gm-Message-State: AOAM533QWn+zymRcoFhvt2xANotTunzOtxRKSxzPH+/gXGprrEaLEJQZ iui5bjjChpJJBLzQAaItb+nH4aBQ71At6w== X-Google-Smtp-Source: ABdhPJz3aQCRWcLvbMGI0qUfn/NXgNl2GDYYCko3gegpnLh/QGNs6/gJnu1vkQ36/xiIk0NQDXBN6Q== X-Received: by 2002:a05:622a:1704:: with SMTP id h4mr8695123qtk.9.1630078373896; Fri, 27 Aug 2021 08:32:53 -0700 (PDT) Received: from nuc ([142.126.162.193]) by smtp.gmail.com with ESMTPSA id i19sm4551720qka.53.2021.08.27.08.32.52 (version=TLS1_3 cipher=TLS_AES_256_GCM_SHA384 bits=256/256); Fri, 27 Aug 2021 08:32:53 -0700 (PDT) Date: Fri, 27 Aug 2021 11:32:43 -0400 From: Mark Johnston To: =?utf-8?Q?T=C4=B3l?= Coosemans Cc: Konstantin Belousov , Dimitry Andric , freebsd-current@freebsd.org Subject: Re: i386 kernel modules unusable due to .plt sections Message-ID: References: <20210827154130.7a5b141c@FreeBSD.org> <20210827172934.41e3a3f4@FreeBSD.org> List-Id: Discussions about the use of FreeBSD-current List-Archive: https://lists.freebsd.org/archives/freebsd-current List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-current@freebsd.org MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Disposition: inline Content-Transfer-Encoding: 8bit In-Reply-To: <20210827172934.41e3a3f4@FreeBSD.org> X-Rspamd-Queue-Id: 4Gx3d82Yvxz3pBr X-Spamd-Bar: ---- Authentication-Results: mx1.freebsd.org; none X-Spamd-Result: default: False [-4.00 / 15.00]; REPLY(-4.00)[] X-ThisMailContainsUnwantedMimeParts: N On Fri, Aug 27, 2021 at 05:29:34PM +0200, Tijl Coosemans wrote: > On Fri, 27 Aug 2021 17:24:58 +0300 Konstantin Belousov > wrote: > > On Fri, Aug 27, 2021 at 03:41:30PM +0200, Tijl Coosemans wrote: > >> I use devel/llvm* to build base and just switched to llvm12. It seems > >> that on i386 clang12 uses R_386_PLT32 relocations for some calls to at > >> least memset, memcpy and __stack_chk_fail (clang11 uses R_386_PC32). > >> These are converted to R_386_JMP_SLOT relocations by the linker which > >> aren't supported by the kernel, e.g. loading linux.ko gives "kldload: > >> unexpected relocation type" from sys/i386/i386/elf_machdep.c. The PLT > >> entries also depend on a base pointer in %ebx but kernel modules aren't > >> compiled with -fPIC, so this can't work and I suspect this is a > >> regression in clang12. > >> > >> The following code shows the difference between clang11 and clang12: > >> > >> -------- > >> #include > >> > >> void * > >> test_memset(void *p, int c, size_t len) { > >> return (memset(p, c, len)); > >> } > >> > >> void * > >> test_memcpy(void *dst, const void *src, size_t len) { > >> return (memcpy(dst, src, len)); > >> } > >> > >> void * > >> test_memmove(void *dst, const void *src, size_t len) { > >> return (memmove(dst, src, len)); > >> } > >> -------- > >> > >> Output of "readelf -r test.o" when compiled with "clang12 -c test.c -m32": > >> r_offset r_info r_type st_value st_name > >> 0000002c 00000504 R_386_PLT32 00000000 memset > >> 00000067 00000304 R_386_PLT32 00000000 memcpy > >> 000000a7 00000402 R_386_PC32 00000000 memmove > >> > >> With clang11: > >> r_offset r_info r_type st_value st_name > >> 00000036 00000502 R_386_PC32 00000000 memset > >> 00000083 00000302 R_386_PC32 00000000 memcpy > >> 000000d2 00000402 R_386_PC32 00000000 memmove > > > > Are you asking (for somebody) to add R_386_JMP_SLOT to i386/elf_machdep.c? > > Like this, not even built. > > > > diff --git a/sys/i386/i386/elf_machdep.c b/sys/i386/i386/elf_machdep.c > > index 3754b36d9e33..a26a4189e0ee 100644 > > --- a/sys/i386/i386/elf_machdep.c > > +++ b/sys/i386/i386/elf_machdep.c > > @@ -245,6 +245,7 @@ elf_reloc_internal(linker_file_t lf, Elf_Addr relocbase, const void *data, > > break; > > > > case R_386_GLOB_DAT: /* S */ > > + case R_386_JMP_SLOT: > > error = lookup(lf, symidx, 1, &addr); > > if (error != 0) > > return (-1); > > No, I've tried that. It handles the relocation but callers still don't > setup %ebx as PIC register. I'm looking for someone to confirm it's a > compiler bug and not a missing flag or something. I tried -fno-plt and > that has no effect. Does disabling -zifunc-noplt fix the problem? I believe it's set by default for i386. From nobody Fri Aug 27 15:35:48 2021 X-Original-To: freebsd-current@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 20005178F8FC for ; Fri, 27 Aug 2021 15:35:50 +0000 (UTC) (envelope-from freqlabs@FreeBSD.org) Received: from smtp.freebsd.org (smtp.freebsd.org [96.47.72.83]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "smtp.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4Gx3hP59Mvz3r6Q for ; Fri, 27 Aug 2021 15:35:49 +0000 (UTC) (envelope-from freqlabs@FreeBSD.org) Received: from Ryans-MBP.attlocal.net (unknown [IPv6:2600:1700:358a:c660:61b4:ab15:75e9:930b]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client did not present a certificate) (Authenticated sender: freqlabs/mail) by smtp.freebsd.org (Postfix) with ESMTPSA id 72EBE2D73D for ; Fri, 27 Aug 2021 15:35:49 +0000 (UTC) (envelope-from freqlabs@FreeBSD.org) Subject: Re: ZFS crash with -CURRENT from Aug 23rd To: freebsd-current@freebsd.org References: From: Ryan Moeller Message-ID: Date: Fri, 27 Aug 2021 11:35:48 -0400 User-Agent: Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:78.0) Gecko/20100101 Thunderbird/78.13.0 List-Id: Discussions about the use of FreeBSD-current List-Archive: https://lists.freebsd.org/archives/freebsd-current List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-current@freebsd.org MIME-Version: 1.0 In-Reply-To: Content-Type: text/plain; charset=utf-8; format=flowed Content-Transfer-Encoding: 7bit Content-Language: en-US X-ThisMailContainsUnwantedMimeParts: N >> zfs_deleteextattr_sa() at zfs_deleteextattr_sa+0x1e/frame 0xfffffe0147380360 >> zfs_setextattr() at zfs_setextattr+0x1e3/frame 0xfffffe01473804e0 >> >> Panic String: VERIFY(zp->z_is_sa) failed I see the issue, thanks! -Ryan From nobody Fri Aug 27 16:10:24 2021 X-Original-To: freebsd-current@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 587281782A78 for ; Fri, 27 Aug 2021 16:10:33 +0000 (UTC) (envelope-from tijl@freebsd.org) Received: from mailsec117.isp.belgacom.be (mailsec117.isp.belgacom.be [195.238.20.113]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client CN "relay.skynet.be", Issuer "GlobalSign RSA OV SSL CA 2018" (not verified)) by mx1.freebsd.org (Postfix) with ESMTPS id 4Gx4SS5nFCz4b0b; Fri, 27 Aug 2021 16:10:32 +0000 (UTC) (envelope-from tijl@freebsd.org) IronPort-SDR: szIQCz6Lutc1adW95PTfdBo4uGCmoCx3R7YCSl5KEzGrNGd/Lu2XKwX8rLYAn3DtAKj0zWD94M nf75QaEYqXP1MFgRZOpGVB1MJ03+xdUOT4CYKALXDbpubOvA3JN4ynHThUYK2VHuX/qSwYGZQP vhME26uMZhyLpQc+EXmiNUQfGHeIfrJjybxNk/FhrmdKrUjJZaNEk1jsurrNpI4Q7omuP4W919 JJ4CREDxXXbBZCg6LOW0LRCZ5UVVfUx1lWawoQ6LpMjAmB5gQ2E2Dld7ff6oEcNlOA5BcBqzZ5 haI= X-IPAS-Result: =?us-ascii?q?A2ADAABvDSlh/wSs8lFaGgEBAQEBAQEBAQEDAQEBARIBA?= =?us-ascii?q?QEBAgIBAQEBQAmBPAUBAQEBCwGDDBVWAVEahEeIJGCFYoIkAzgBiieRF4F8C?= =?us-ascii?q?wEBAQEBAQEBATYUBAEBK4Q3CgKCMiY0CQ4BAgQBAQEBAwIDAQEBAQUBAQYBA?= =?us-ascii?q?QEBAQEFBAGBI4UvOQ2CNSkBg2QBBSNWEAsYAgImAgIhNgYTgnKCVQMzqwGBM?= =?us-ascii?q?YEBhyENgSGBJ4EQKgGNeUOBS0KEPj6BUk6CJIMXgmQEhj2BAoIEOXmUOqZ7g?= =?us-ascii?q?TVeglpbikCOM4VNR4UtkCuRJKYSkDmGfoIUfQiDJAlHGQ+OLBaHb4ZBPwMwO?= =?us-ascii?q?AIGAQoBAQMJgkWMVgEB?= IronPort-PHdr: A9a23:gQR+fhOOapfT4TPzHXQl6nZCChdPi9zP1u491JMrhvp0f7i5+Ny6Z QqDv60r1QaSFt+Do9t/yMPu+5j6XmIB5ZvT+FsjS7drEyE/tMMNggY7C9SEA0CoZNTjbig9A dgQHAQ9pyLzPkdaAtvxaEPPqXOu8zESBg//NQ1oLejpB4Lelcu62/6u95HJfglEmTSwbbxsI BmqsA7cqtQYjYx+J6gr1xDHuGFIe+NYxWNpIVKcgRPx7dqu8ZBg7ipdpesv+9ZPXqvmcas4S 6dYDCk9PGAu+MLrrxjDQhCR6XYaT24bjwBHAwnB7BH9Q5fxri73vfdz1SWGIcH7S60/VC+85 Kl3VhDnlCYHNyY48G7JjMxwkLlbqw+lqxBm3oLYfJ2ZOP94c6jAf90VWHBBU95fWSJBHI2yc ogBAOgPPelXs4bzqEADrQenBQS2GO/j1iNEi33w0KYn0+ohCwbG3Ak4EtwQtXbUqMj+ObkVU eCy16nH0zDDYOlQ2Tfm9YPFdQwhofCOXbJ0asffyVMvGB3bgViNtILrMSmZ1uMXs2iU9udtU /+khGE7pQ9ruDev2tsshZfThoIT0l3K9SF0zYQ7K9C4VkJ3f9GqHYZNuiyaK4d7X8EvT39nt Sg6yrMLpZ22cSoOxZknxRPSZeKKfoyJ7x/9WuidPyl1iXR4c7yxgBay9FKvyuz6VsSsyFZKt DRKnsPJtnAO0RHY98uJSuNl80qixDqDzR7f5+5aLUwuiKbWKYAtzqQ/m5cVrE/NBDX5mF/sg 6+Tbkgk/++o5Pn5bbj+vZ+cMpN0ihn5MqQzhsyzGeQ4PRYKX2ic4em816fs/Un4QLVPkPI2i K7ZvIrGJcQapK65BxVZ3Zok6xa4FDepztEYkmMBLFJeYh6HiJLpO17WLPD5C/ewnUisnS9oy vzbJLHtHJrAImbZnLv8f7tx9VRQxQUrwdBa/Z1UC7UBIPzpWk/2sdzVFgM5Mw22w+bjE9h92 JkeVnyRDaCCK6PdrEWE5uU1I+mDfIMVoiryK+A55/7yin80gVEdfbO30pQJc3+4BelpL1yFb nrxmNcBC3kFvgwiTOHxhl2CSyBcaGipUKIn+z43EoWmDZ3MRoq1mryOwD+7HoFKZmBBEl2DD Hbod4CfVvcCciKdPNFunScfVbe8UYMh0guutADiwbp9MuXU4jEYtY7k1NVt5O3Tkgoy9SB1D 8SeyG6CUWV0k3gHRz8zxq9/oEh9xk2f3qh/hvxSDcZT6O9RUgcmKZ7cyPR3C9XoVQLbfdeJS k2rQtu8AT4vUN0+2MQObFtnF9WllBDD0HniP7hAsrWRB9QW9aLaxGT2IY4pzn/c16sJgUMrT 8FUOSuhnKEppCbJAIucr6Kd342tcr8R2SfL7y/X0WuMuGl2SgN9e57pG3cFaR2F/pzC+kreQ ur2WvwcOQxbxJvHc/MSAuA= IronPort-HdrOrdr: A9a23:7jFqaq8n03k7a7UA+g9uk+DVI+orL9Y04lQ7vn2ZKCYlFvBw8v rEoB1173HJYVoqNU3I4OrhBEDiewK4yXcW2+Ms1N6ZNWHbUQ2TTb2KhrGM/9SPIUHDHug079 YDT0B7YOeAbmRHsQ== X-IronPort-Anti-Spam-Filtered: true X-ProximusIPWarmup: true Received: from 4.172-242-81.adsl-dyn.isp.belgacom.be (HELO kalimero.tijl.coosemans.org) ([81.242.172.4]) by relay.proximus.be with ESMTP; 27 Aug 2021 18:10:25 +0200 Received: from localhost (localhost [127.0.0.1]) by kalimero.tijl.coosemans.org (8.16.1/8.16.1) with ESMTP id 17RGAO4f002752; Fri, 27 Aug 2021 18:10:25 +0200 (CEST) (envelope-from tijl@FreeBSD.org) Date: Fri, 27 Aug 2021 18:10:24 +0200 From: =?UTF-8?B?VMSzbA==?= Coosemans To: Mark Johnston Cc: Konstantin Belousov , Dimitry Andric , freebsd-current@freebsd.org Subject: Re: i386 kernel modules unusable due to .plt sections Message-ID: <20210827181024.06f26328@FreeBSD.org> In-Reply-To: References: <20210827154130.7a5b141c@FreeBSD.org> <20210827172934.41e3a3f4@FreeBSD.org> List-Id: Discussions about the use of FreeBSD-current List-Archive: https://lists.freebsd.org/archives/freebsd-current List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-current@freebsd.org MIME-Version: 1.0 Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: quoted-printable X-Rspamd-Queue-Id: 4Gx4SS5nFCz4b0b X-Spamd-Bar: ---- Authentication-Results: mx1.freebsd.org; none X-Spamd-Result: default: False [-4.00 / 15.00]; REPLY(-4.00)[] X-ThisMailContainsUnwantedMimeParts: N On Fri, 27 Aug 2021 11:32:43 -0400 Mark Johnston wrote: > On Fri, Aug 27, 2021 at 05:29:34PM +0200, T=C4=B3l Coosemans wrote: >> On Fri, 27 Aug 2021 17:24:58 +0300 Konstantin Belousov >> wrote: =20 >>> On Fri, Aug 27, 2021 at 03:41:30PM +0200, T=C4=B3l Coosemans wrote: =20 >>>> I use devel/llvm* to build base and just switched to llvm12. It seems >>>> that on i386 clang12 uses R_386_PLT32 relocations for some calls to at >>>> least memset, memcpy and __stack_chk_fail (clang11 uses R_386_PC32). >>>> These are converted to R_386_JMP_SLOT relocations by the linker which >>>> aren't supported by the kernel, e.g. loading linux.ko gives "kldload: >>>> unexpected relocation type" from sys/i386/i386/elf_machdep.c. The PLT >>>> entries also depend on a base pointer in %ebx but kernel modules aren't >>>> compiled with -fPIC, so this can't work and I suspect this is a >>>> regression in clang12. >>>>=20 >>>> The following code shows the difference between clang11 and clang12: >>>>=20 >>>> -------- >>>> #include >>>>=20 >>>> void * >>>> test_memset(void *p, int c, size_t len) { >>>> return (memset(p, c, len)); >>>> } >>>>=20 >>>> void * >>>> test_memcpy(void *dst, const void *src, size_t len) { >>>> return (memcpy(dst, src, len)); >>>> } >>>>=20 >>>> void * >>>> test_memmove(void *dst, const void *src, size_t len) { >>>> return (memmove(dst, src, len)); >>>> } >>>> -------- >>>>=20 >>>> Output of "readelf -r test.o" when compiled with "clang12 -c test.c -m= 32": >>>> r_offset r_info r_type st_value st_name >>>> 0000002c 00000504 R_386_PLT32 00000000 memset >>>> 00000067 00000304 R_386_PLT32 00000000 memcpy >>>> 000000a7 00000402 R_386_PC32 00000000 memmove >>>>=20 >>>> With clang11: >>>> r_offset r_info r_type st_value st_name >>>> 00000036 00000502 R_386_PC32 00000000 memset >>>> 00000083 00000302 R_386_PC32 00000000 memcpy >>>> 000000d2 00000402 R_386_PC32 00000000 memmove =20 >>>=20 >>> Are you asking (for somebody) to add R_386_JMP_SLOT to i386/elf_machdep= .c? >>> Like this, not even built. >>>=20 >>> diff --git a/sys/i386/i386/elf_machdep.c b/sys/i386/i386/elf_machdep.c >>> index 3754b36d9e33..a26a4189e0ee 100644 >>> --- a/sys/i386/i386/elf_machdep.c >>> +++ b/sys/i386/i386/elf_machdep.c >>> @@ -245,6 +245,7 @@ elf_reloc_internal(linker_file_t lf, Elf_Addr reloc= base, const void *data, >>> break; >>> =20 >>> case R_386_GLOB_DAT: /* S */ >>> + case R_386_JMP_SLOT: >>> error =3D lookup(lf, symidx, 1, &addr); >>> if (error !=3D 0) >>> return (-1); =20 >>=20 >> No, I've tried that. It handles the relocation but callers still don't >> setup %ebx as PIC register. I'm looking for someone to confirm it's a >> compiler bug and not a missing flag or something. I tried -fno-plt and >> that has no effect. =20 >=20 > Does disabling -zifunc-noplt fix the problem? I believe it's set by > default for i386. Removing it from sys/conf/kern.pre.mk didn't help. From nobody Fri Aug 27 16:14:08 2021 X-Original-To: freebsd-current@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id D74C5178789C for ; Fri, 27 Aug 2021 16:14:09 +0000 (UTC) (envelope-from freqlabs@FreeBSD.org) Received: from smtp.freebsd.org (smtp.freebsd.org [96.47.72.83]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "smtp.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4Gx4Xd2Htpz4f8B for ; Fri, 27 Aug 2021 16:14:09 +0000 (UTC) (envelope-from freqlabs@FreeBSD.org) Received: from Ryans-MBP.attlocal.net (unknown [IPv6:2600:1700:358a:c660:61b4:ab15:75e9:930b]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client did not present a certificate) (Authenticated sender: freqlabs/mail) by smtp.freebsd.org (Postfix) with ESMTPSA id DC0392DE1F for ; Fri, 27 Aug 2021 16:14:08 +0000 (UTC) (envelope-from freqlabs@FreeBSD.org) Subject: Re: ZFS crash with -CURRENT from Aug 23rd To: freebsd-current@freebsd.org References: From: Ryan Moeller Message-ID: <4ccaefc5-2e7e-5ba9-58e6-573656104155@FreeBSD.org> Date: Fri, 27 Aug 2021 12:14:08 -0400 User-Agent: Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:78.0) Gecko/20100101 Thunderbird/78.13.0 List-Id: Discussions about the use of FreeBSD-current List-Archive: https://lists.freebsd.org/archives/freebsd-current List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-current@freebsd.org MIME-Version: 1.0 In-Reply-To: Content-Type: text/plain; charset=utf-8; format=flowed Content-Transfer-Encoding: 8bit Content-Language: en-US X-ThisMailContainsUnwantedMimeParts: N On 8/27/21 11:35 AM, Ryan Moeller wrote: >>> zfs_deleteextattr_sa() at zfs_deleteextattr_sa+0x1e/frame >>> 0xfffffe0147380360 >>> zfs_setextattr() at zfs_setextattr+0x1e3/frame 0xfffffe01473804e0 >>> >>>    Panic String: VERIFY(zp->z_is_sa) failed > > > I see the issue, thanks! > > > -Ryan > > https://github.com/openzfs/zfs/pull/12514 From nobody Sat Aug 28 13:50:20 2021 X-Original-To: freebsd-current@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 9E8FE179D029 for ; Sat, 28 Aug 2021 13:50:40 +0000 (UTC) (envelope-from grahamperrin@gmail.com) Received: from mail-wr1-x429.google.com (mail-wr1-x429.google.com [IPv6:2a00:1450:4864:20::429]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "GTS CA 1O1" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4GxdJb6Ksvz4gBb for ; Sat, 28 Aug 2021 13:50:39 +0000 (UTC) (envelope-from grahamperrin@gmail.com) Received: by mail-wr1-x429.google.com with SMTP id b6so14932620wrh.10 for ; Sat, 28 Aug 2021 06:50:39 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=mime-version:references:in-reply-to:from:date:message-id:subject:to :content-transfer-encoding; bh=Ucr4BLViYANnAbErU89Uzrza7WhokuEeMwhT2mvJ/q4=; b=ovjXn2VlY82nFi9kiFDdv+nuqb1DpmQU2cqt+4NwdXkzDSep6pW74lUlYsF8wl+52f QHr7VY5rjtLemn+kiaaWN21yUwEjIZHK7HCNFkxGRearzjZfQ55rR3UZPaTksBbruEhV Q8EZJky6RYne9LVMGxhyoWnMeW7kfszXLalcJBXp7J89NvUyflVP068H6/cmRRF0TOWN V97EaH4lHdcfsJHJO5csxvgajkBzUUetRQgdw1FwImNEZbjio7lAoKdkt4Y514Yo6nCX lBunjgN9OytOEo+N6MmwYhP3qL72nUmbuRpndEOshPKa33mf4fN0WFZ8wykPo7y1G6EG Q0GQ== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:references:in-reply-to:from:date :message-id:subject:to:content-transfer-encoding; bh=Ucr4BLViYANnAbErU89Uzrza7WhokuEeMwhT2mvJ/q4=; b=JJ0QyQ2u+x1/BAMvAYZKcz8vKNWflV63JSpa+Bw8BAQLK/TQG8tz350DpW9Y6aJWrA uGfVab3RBQ7juAKJNt+8mnW9uJBG1n5MCTkk+vhovKGIntAK8thuf4LDhWwGjFSUUEeY Q43m3mt41j7iURJ4vKKDlFWHnLhwqEEfgbo17BV+q3pmJU2wbkiTaEOVSPr9pjNduyR1 2QWhSzC0Nx3rVNy/OLxUW2aZB73f7FsAb67f3C+0SzTxU+TZYo00+FhUP6BWcGyTQoXG wqfZoJ9HdxCZEYHMALif/LECWNx93cGz6tZtWMeWG9Mk9SqoMX/5Jmxqu3iOYMcbuuMR H9TQ== X-Gm-Message-State: AOAM532eHCgNMIsmeZJuVshoKPNqJasVJ1UgiyoFMEQVzv+CBez+3646 IG2E3ss8UmDTdR9+HIIrXQk7vmO0oz7mn3WQza4JjTvG+ld/0Q== X-Google-Smtp-Source: ABdhPJzXYRHQaJmXB7IALHP5ILSa5iizoMk2+/4Hw92npwB3Apg9uAWidT10Y3M4OdV07XMYts3/Rv7qf5buU7PcTEA= X-Received: by 2002:adf:ebcd:: with SMTP id v13mr16114002wrn.400.1630158632881; Sat, 28 Aug 2021 06:50:32 -0700 (PDT) List-Id: Discussions about the use of FreeBSD-current List-Archive: https://lists.freebsd.org/archives/freebsd-current List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-current@freebsd.org MIME-Version: 1.0 References: <149845085.13.1630055426223@localhost> In-Reply-To: From: Graham Perrin Date: Sat, 28 Aug 2021 14:50:20 +0100 Message-ID: Subject: Re: Experiments with sswap(1), srm(1), wipe(1), gdisk(8), lsblk and gpart(8) To: FreeBSD CURRENT Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Rspamd-Queue-Id: 4GxdJb6Ksvz4gBb X-Spamd-Bar: -- Authentication-Results: mx1.freebsd.org; dkim=pass header.d=gmail.com header.s=20161025 header.b=ovjXn2Vl; dmarc=pass (policy=none) header.from=gmail.com; spf=pass (mx1.freebsd.org: domain of grahamperrin@gmail.com designates 2a00:1450:4864:20::429 as permitted sender) smtp.mailfrom=grahamperrin@gmail.com X-Spamd-Result: default: False [-2.00 / 15.00]; ARC_NA(0.00)[]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; R_DKIM_ALLOW(-0.20)[gmail.com:s=20161025]; FROM_HAS_DN(0.00)[]; R_SPF_ALLOW(-0.20)[+ip6:2a00:1450:4000::/36:c]; FREEMAIL_FROM(0.00)[gmail.com]; MIME_GOOD(-0.10)[text/plain]; PREVIOUSLY_DELIVERED(0.00)[freebsd-current@freebsd.org]; NEURAL_HAM_LONG(-1.00)[-1.000]; RCPT_COUNT_ONE(0.00)[1]; MID_RHS_MATCH_FROMTLD(0.00)[]; TO_DN_ALL(0.00)[]; DKIM_TRACE(0.00)[gmail.com:+]; DMARC_POLICY_ALLOW(-0.50)[gmail.com,none]; RCVD_IN_DNSWL_NONE(0.00)[2a00:1450:4864:20::429:from]; NEURAL_SPAM_SHORT(1.00)[0.998]; TO_MATCH_ENVRCPT_ALL(0.00)[]; FROM_EQ_ENVFROM(0.00)[]; MIME_TRACE(0.00)[0:+]; FREEMAIL_ENVFROM(0.00)[gmail.com]; ASN(0.00)[asn:15169, ipnet:2a00:1450::/32, country:US]; RCVD_COUNT_TWO(0.00)[2]; RCVD_TLS_ALL(0.00)[]; DWL_DNSWL_NONE(0.00)[gmail.com:dkim] X-ThisMailContainsUnwantedMimeParts: N > =E2=80=A6 I'll report what might be an obscure bug in lsblk. Fixed but not yet in ports: =E2=80=A6 > Lines 131=E2=80=93139, gdisk should have added freebsd-swap at /dev/da0p3= , I > ignored the suggestion to remove the hard disk drive ("Warning: The > kernel may continue to use old or deleted partitions."), gpart then > showed nothing (free space) where da0p3 was expected. =E2=80=A6 > Lines 288=E2=80=93297, gdisk should have deleted /dev/da0p3, I ignored th= e > suggestion to remove the drive, lsblk showed da0p3 still present. =E2=80=A6 Today: * sysctl kern.geom.debugflags=3D16 was not required * things were as expected following each run of gdisk, ignoring the warnings about the kernel continuing to use old or deleted partitions. puts kern.geom.debugflags=3D16 in context. I'm not sure why it was required yesterday. ---- # /usr/home/grahamperrin/dev/lsblk/lsblk da4 DEVICE MAJ:MIN SIZE TYPE LABEL MOUNT da4 2:115 466G GPT - - da4p1 2:116 200M efi msdosfs/EFI= SYS - da4p2 2:117 512K freebsd-boot gpt/gptbo= ot0 - da4p3 2:118 16G freebsd-swap gpt/FreeBSD%20s= wap - da4p4 2:119 450G freebsd-zfs gpt/zfs0 -:- 4.0K - = - - # srm -lv /dev/da4p3 Using /dev/urandom for random input. Wipe mode is insecure (two passes [0xff/random]) Wiping /dev/da4p3 Warning: /dev/da4p3 is not a regular file, rename/unlink only!Warning: Couldn't rename /dev/da4p3 - Operation not supported Removed file /dev/da4p3 ... Done # sysctl sysctl kern.geom.debugflags kern.geom.debugflags: 0 # gdisk /dev/da4 GPT fdisk (gdisk) version 1.0.8 Partition table scan: MBR: protective BSD: not present APM: not present GPT: present Found valid GPT with protective MBR; using GPT. Command (? for help): d Partition number (1-4): 3 Command (? for help): w Final checks complete. About to write GPT data. THIS WILL OVERWRITE EXISTIN= G PARTITIONS!! Do you want to proceed? (Y/N): y OK; writing new GUID partition table (GPT) to /dev/da4. Warning: The kernel may continue to use old or deleted partitions. You should reboot or remove the drive. The operation has completed successfully. # /usr/home/grahamperrin/dev/lsblk/lsblk da4 DEVICE MAJ:MIN SIZE TYPE LABEL MOUNT da4 2:115 466G GPT - - da4p1 2:116 200M efi msdosfs/EFI= SYS - da4p2 2:117 512K freebsd-boot gpt/gptbo= ot0 - -:- 16G - = - - da4p4 2:118 450G freebsd-zfs gpt/zfs0 -:- 4.0K - = - - # gdisk /dev/da4 GPT fdisk (gdisk) version 1.0.8 Partition table scan: MBR: protective BSD: not present APM: not present GPT: present Found valid GPT with protective MBR; using GPT. Command (? for help): n Partition number (3-128, default 3): First sector (410664-976773127, default =3D 410664) or {+-}size{KMGTP}: Last sector (410664-33966079, default =3D 33966079) or {+-}size{KMGTP}: Current type is A503 (FreeBSD UFS) Hex code or GUID (L to show codes, Enter =3D A503): a502 Changed type of partition to 'FreeBSD swap' Command (? for help): w Final checks complete. About to write GPT data. THIS WILL OVERWRITE EXISTIN= G PARTITIONS!! Do you want to proceed? (Y/N): y OK; writing new GUID partition table (GPT) to /dev/da4. Warning: The kernel may continue to use old or deleted partitions. You should reboot or remove the drive. The operation has completed successfully. # /usr/home/grahamperrin/dev/lsblk/lsblk DEVICE MAJ:MIN SIZE TYPE LABEL MOUNT ada0 0:121 932G GPT - - ada0p1 0:123 260M efi gpt/efibo= ot0 - -:- 1.0M - = - - ada0p2 0:125 16G freebsd-swap gpt/swap0 SWAP ada0p2.eli 2:76 16G freebsd-swap - SWAP ada0p3 0:127 915G freebsd-zfs gpt/zfs0 ada0p3.eli 0:135 915G zfs = - - -:- 708K - = - - da4 2:115 466G GPT - - da4p1 2:116 200M efi msdosfs/EFI= SYS - da4p2 2:117 512K freebsd-boot gpt/gptbo= ot0 - da4p3 2:118 16G freebsd-swap gpt/FreeBSD%20s= wap - da4p4 2:119 450G freebsd-zfs gpt/zfs0 -:- 4.0K - = - - da5 0:209 466G GPT - - -:- 1.0M - = - - da5p1 0:210 466G freebsd-zfs gpt/Transcend da6 0:217 14G GPT - - -:- 1.0M - = - - da6p1 0:218 14G freebsd-zfs gpt/cache-transcend da7 0:239 29G GPT - - da7p1 0:240 29G freebsd-zfs gpt/cache-august # gpart show =3D> 40 1953525088 ada0 GPT (932G) 40 532480 1 efi (260M) 532520 2008 - free - (1.0M) 534528 33554432 2 freebsd-swap (16G) 34088960 1919434752 3 freebsd-zfs (915G) 1953523712 1416 - free - (708K) =3D> 34 976773101 da5 GPT (466G) 34 2014 - free - (1.0M) 2048 976771087 1 freebsd-zfs (466G) =3D> 34 30310333 da6 GPT (14G) 34 2014 - free - (1.0M) 2048 30308319 1 freebsd-zfs (14G) =3D> 34 60437425 da7 GPT (29G) 34 60437425 1 freebsd-zfs (29G) =3D> 40 976773088 da4 GPT (466G) 40 409600 1 efi (200M) 409640 1024 2 freebsd-boot (512K) 410664 33555416 3 freebsd-swap (16G) 33966080 942807040 4 freebsd-zfs (450G) 976773120 8 - free - (4.0K) # /usr/local/sbin/lsblk DEVICE MAJ:MIN SIZE TYPE LABEL MOUNT ada0 0:121 932G GPT - - ada0p1 0:123 260M efi gpt/efibo= ot0 - -:- 1.0M - = - - ada0p2 0:125 16G freebsd-swap gpt/swap0 SWAP ada0p2.eli 2:76 16G freebsd-swap - SWAP ada0p3 0:127 915G freebsd-zfs gpt/zfs0 ada0p3.eli 0:135 915G zfs = - - -:- 708K - = - - cd0 0:129 0B - - - da0 2:105 0B freebsd-swap - SWAP da1 2:107 0B - - - da2 2:108 0B - - - da3 2:109 0B - - - da4 2:115 466G GPT - - da4p1 2:116 200M efi msdosfs/EFI= SYS - da4p2 2:117 512K freebsd-boot gpt/gptbo= ot0 - da4p3 2:118 16G freebsd-swap gpt/FreeBSD%20s= wap - da4p4 2:119 450G freebsd-zfs gpt/zfs0 -:- 4.0K - = - - da5 0:209 466G GPT - - -:- 1.0M - = - - da5p1 0:210 466G freebsd-zfs gpt/Transcend da6 0:217 14G GPT - - -:- 1.0M - = - - da6p1 0:218 14G freebsd-zfs gpt/cache-transcend da7 0:239 29G GPT - - da7p1 0:240 29G freebsd-zfs gpt/cache-august # From nobody Sat Aug 28 14:24:53 2021 X-Original-To: freebsd-current@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 7450617902B8 for ; Sat, 28 Aug 2021 14:24:57 +0000 (UTC) (envelope-from grahamperrin@gmail.com) Received: from mail-wr1-x435.google.com (mail-wr1-x435.google.com [IPv6:2a00:1450:4864:20::435]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "GTS CA 1O1" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4Gxf482Jh1z4tqV; Sat, 28 Aug 2021 14:24:56 +0000 (UTC) (envelope-from grahamperrin@gmail.com) Received: by mail-wr1-x435.google.com with SMTP id u9so15036812wrg.8; Sat, 28 Aug 2021 07:24:56 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=subject:to:references:cc:from:message-id:date:user-agent :mime-version:in-reply-to:content-transfer-encoding:content-language; bh=Kth1OhJp70sSmfaKujSjkzpw85LZwxe2nZ+E4QEs1J4=; b=bXzqwKrPTf7mQVlywOXfez/P7Nh7tESnaCnMgy9pOC83V6tBwKY6+gwUFe05cvYXG1 YLt1mjC0e4UAA2kePD+N/dqKRLJXGzgvLRJ82AYF2Em6jXMOCNDMeiYP8IjmeuTN2mk1 oJpz/ICAX1W1J5ndBV7LKhyJirKJVR9zBhso1zZK3Rk33CaSxdfq2h15f1PnnmtlJN1r olZ+4cgbu6Poj2KYtS/LdzWTf77goGUGg2SR6Oc6bS4anYCHd2phkTOhqLWzmJAR5SXr HsuPmkHl0iPDILL3TRHjzvTwSZe89l01eN36CWO/xClfMgypFeGpWt92vJSc7cR9Muq6 NVcA== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:subject:to:references:cc:from:message-id:date :user-agent:mime-version:in-reply-to:content-transfer-encoding :content-language; bh=Kth1OhJp70sSmfaKujSjkzpw85LZwxe2nZ+E4QEs1J4=; b=dfsLiChYagXah6jAM/ShyMLpAqH9GUeKPOLg+nyTQrQifKBTGeO38SziTj5wC1UaGF K7GO6VsjPOtX4GtAFMVXokqkw6oXsP/urihtggzk2/u42WiKtSa5X93lXrrUa+uKPW9f C6x2x7b/ReMKpV5VvLM3UNtD+uYk9u3ZVnuZAD7nsK54fskVqMOuh2R0qQvP8C7vX0zf u67bNVKRoXVWxkuoWapIAZZmbjb7+62lrVcDf3CJ98C21EGbybUGGW3VeTBhG9a99Kxd wSXbcQR/i1ydflC8L1TUCHPqaPQx1DdhXolwRE+lYbGSEGhm/k0xfcUvGTLCtufspA0Q FKvA== X-Gm-Message-State: AOAM531I6JOLscgnmaey57HAjrEeqXnnT10IxBD9dIokk4TE8bIBNwW0 3Rd31c+R60AKFchDljghGSHgLllZn6o3Hw== X-Google-Smtp-Source: ABdhPJxanCht4uYDa4T8MvCarQMSAekxjgSgQpEZv732SSt5Gt3nk0BAD7k+wLdn5aSYvOO4Xhs/aA== X-Received: by 2002:a5d:464f:: with SMTP id j15mr16487117wrs.325.1630160694091; Sat, 28 Aug 2021 07:24:54 -0700 (PDT) Received: from ?IPv6:2001:470:1f1c:a0::2? (tunnel642390-pt.tunnel.tserv1.lon2.ipv6.he.net. [2001:470:1f1c:a0::2]) by smtp.gmail.com with ESMTPSA id s205sm7289717wme.4.2021.08.28.07.24.53 (version=TLS1_3 cipher=TLS_AES_128_GCM_SHA256 bits=128/128); Sat, 28 Aug 2021 07:24:53 -0700 (PDT) Subject: Re: rescue/sh check failed, installation aborted To: John Baldwin References: <0577ca44-86c2-d54c-33b7-c7174632e569@gmail.com> Cc: FreeBSD CURRENT From: Graham Perrin Message-ID: Date: Sat, 28 Aug 2021 15:24:53 +0100 User-Agent: Mozilla/5.0 (X11; FreeBSD amd64; rv:78.0) Gecko/20100101 Thunderbird/78.13.0 List-Id: Discussions about the use of FreeBSD-current List-Archive: https://lists.freebsd.org/archives/freebsd-current List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-current@freebsd.org MIME-Version: 1.0 In-Reply-To: Content-Type: text/plain; charset=utf-8; format=flowed Content-Transfer-Encoding: 8bit Content-Language: en-GB X-Rspamd-Queue-Id: 4Gxf482Jh1z4tqV X-Spamd-Bar: --- Authentication-Results: mx1.freebsd.org; dkim=pass header.d=gmail.com header.s=20161025 header.b=bXzqwKrP; dmarc=pass (policy=none) header.from=gmail.com; spf=pass (mx1.freebsd.org: domain of grahamperrin@gmail.com designates 2a00:1450:4864:20::435 as permitted sender) smtp.mailfrom=grahamperrin@gmail.com X-Spamd-Result: default: False [-4.00 / 15.00]; ARC_NA(0.00)[]; RCVD_VIA_SMTP_AUTH(0.00)[]; R_DKIM_ALLOW(-0.20)[gmail.com:s=20161025]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; FROM_HAS_DN(0.00)[]; R_SPF_ALLOW(-0.20)[+ip6:2a00:1450:4000::/36:c]; FREEMAIL_FROM(0.00)[gmail.com]; MIME_GOOD(-0.10)[text/plain]; TO_MATCH_ENVRCPT_ALL(0.00)[]; NEURAL_HAM_LONG(-1.00)[-1.000]; RCVD_COUNT_THREE(0.00)[3]; TO_DN_ALL(0.00)[]; DKIM_TRACE(0.00)[gmail.com:+]; RCPT_COUNT_TWO(0.00)[2]; DMARC_POLICY_ALLOW(-0.50)[gmail.com,none]; RCVD_IN_DNSWL_NONE(0.00)[2a00:1450:4864:20::435:from]; NEURAL_HAM_SHORT(-1.00)[-1.000]; FROM_EQ_ENVFROM(0.00)[]; MIME_TRACE(0.00)[0:+]; FREEMAIL_ENVFROM(0.00)[gmail.com]; ASN(0.00)[asn:15169, ipnet:2a00:1450::/32, country:US]; RCVD_TLS_ALL(0.00)[]; MID_RHS_MATCH_FROM(0.00)[]; DWL_DNSWL_NONE(0.00)[gmail.com:dkim] X-ThisMailContainsUnwantedMimeParts: N On 23/08/2021 22:26, John Baldwin wrote: > On 8/23/21 12:18 PM, Graham Perrin wrote: >> Encountered whilst attempting to build and install 14.0-CURRENT over >> 13.0-RELEASE-p3 (experimental, helloSystem): >> >> >> >> Background, condensed, to the best of my recollection: >> >> cd /usr/src >> make buildworld    # succeeded >> make kernel    # failed >> make clean >> LOCAL_MODULES=    # added to /etc/src.conf >> make kernel-toolchain >> make kernel >> restarted in single user mode >> mount -uw / >> service zfs start >> cd /usr/src >> make installworld – failed as pictured. >> >> I see , fixed >> in 2018. >> >> Any suggestions? > > I'm not sure what the 'make clean' would have done. I lazily assumed that it would clean things. Things :-) > Did you mean 'make cleanworld'? I didn't, but but I'll try to remember that it's an option. > If so, you will need to do a 'make buildworld' again before trying to do > 'make installworld'.  The error message implies that there is no 'make > buildworld' > output in /usr/obj (as if you had run 'make cleanworld' up above where > you list > 'make clean') Thanks. I decided to boot kernel.old then start afresh. End result at , for anyone who's interested. From nobody Sat Aug 28 14:28:29 2021 X-Original-To: current@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 22E6A1793C67; Sat, 28 Aug 2021 14:28:33 +0000 (UTC) (envelope-from avg@FreeBSD.org) Received: from smtp.freebsd.org (smtp.freebsd.org [96.47.72.83]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "smtp.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4Gxf8K0YGYz3DhD; Sat, 28 Aug 2021 14:28:33 +0000 (UTC) (envelope-from avg@FreeBSD.org) Received: from [192.168.0.88] (unknown [195.64.148.76]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client did not present a certificate) (Authenticated sender: avg/mail) by smtp.freebsd.org (Postfix) with ESMTPSA id 77E1393A4; Sat, 28 Aug 2021 14:28:32 +0000 (UTC) (envelope-from avg@FreeBSD.org) To: FreeBSD Current , doc@FreeBSD.org From: Andriy Gapon Subject: installworld with NO_ROOT produces paths with .. for man pages Message-ID: Date: Sat, 28 Aug 2021 17:28:29 +0300 User-Agent: Mozilla/5.0 (X11; FreeBSD amd64; rv:78.0) Gecko/20100101 Firefox/78.0 Thunderbird/78.13.0 List-Id: Discussions about the use of FreeBSD-current List-Archive: https://lists.freebsd.org/archives/freebsd-current List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-current@freebsd.org MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8; format=flowed Content-Language: en-US Content-Transfer-Encoding: 8bit X-ThisMailContainsUnwantedMimeParts: N This seems to be related to the recent change to install manual pages for all platforms. My method of creating a cross-platform installation image is to install with NO_ROOT and then to tar up with @METALOG argument. On the destination I simply untar the archive into a destination directory (typically a fresh ZFS BE). Today I noticed some complaints when extracting the archive, here is a few: ./usr/share/man/man4/i386/../smapi.4.gz: Path contains '..' ./usr/share/man/man4/i386/../vpd.4.gz: Path contains '..' ./usr/share/man/man4/powerpc/../adb.4.gz: Path contains '..' ./usr/share/man/man4/powerpc/../akbd.4.gz: Path contains '..' This is a not a big deal but would be nice to "straighten" the installation paths when installing such manual pages. P.S. NO_ROOT does not seem to be documented outside of the source code. -- Andriy Gapon From nobody Sun Aug 29 17:37:47 2021 X-Original-To: freebsd-current@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 90DEF17B58C5 for ; Sun, 29 Aug 2021 17:37:57 +0000 (UTC) (envelope-from grahamperrin@gmail.com) Received: from mail-wm1-x32d.google.com (mail-wm1-x32d.google.com [IPv6:2a00:1450:4864:20::32d]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "GTS CA 1O1" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4GyLJN3y0Jz4TLN for ; Sun, 29 Aug 2021 17:37:56 +0000 (UTC) (envelope-from grahamperrin@gmail.com) Received: by mail-wm1-x32d.google.com with SMTP id c129-20020a1c35870000b02902e6b6135279so7889319wma.0 for ; Sun, 29 Aug 2021 10:37:56 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=subject:from:to:references:message-id:date:user-agent:mime-version :in-reply-to:content-transfer-encoding:content-language; bh=B2w7ea5pz4bv6tUTy6rHkXAC/tbd4Y9IMMmlhba2Jhw=; b=JEuOBOm11NyE/mA9qyfcwprfOtUU5pymvvag2YHO74J8LRYwYXmxn7SaW+T6tut9Qq 93j30xFYJp5KDTSAP4e+f+R+nKjLSleSpdlDAMh/S1xu7kZQJQLSy/nIPeHL+AckL2Fd hea2rYwvhPsxfH5r6GOx+pTOw+TMBiRtXkNFy+vm6c6u86zWK48xFYGajpn8iqNAjwCk uyShPsTXpibEBeerD7aCw7SBwZNlmCfCFQnWN7AU3rkdLi36NaCN6Wr/RQ43zSfV+jKL iOQrI0d6qes841qD0Le2tc7vGdA3Zu0oXpm0q9sBq4JOKY9Zt8mK98VqiNQkU9xs90an 4AAw== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:subject:from:to:references:message-id:date :user-agent:mime-version:in-reply-to:content-transfer-encoding :content-language; bh=B2w7ea5pz4bv6tUTy6rHkXAC/tbd4Y9IMMmlhba2Jhw=; b=iEoDeZJguj0j2LKVgcq+XHHa1U+YIiVWHh6TumXfXAF8JVdXYsKIzHiLxKoRfT0IRa oEPTL1fc1y+CrGS3qhpjID5qTy3v9SiJUSBb0peg7pf4KItcT6bhN0+Q8Z0BGgqi1q3o vz8AxJRS2gu90ZalkV/MjrLYMzSB+/Ju0pB6UGlpWKHZZQm+1yhboVDv2VNmK/QuVVoN Q1SL16mfvz/x8ljC2BhvtPVpVDkPbeQVHKWtwZVJ0DjUd+GK68c+GojNPhqfTMuCfN72 n/xWfinHTqq4R/9IHCowU1bXuyICZ5W/cT8xNy22uiFWNIAah9NSvvbVHzg/mAWAIZV8 Wapw== X-Gm-Message-State: AOAM531VRHxjWJ8HIUo+dzHcgk5D+0WJUNZWqYvLCIrOYwmAD2LxLmjK mQknC6MFIM9/Sw2Ov1jjqsy9UQOCJhJbaQ== X-Google-Smtp-Source: ABdhPJxUcKcBThWLRmeg8JDMuvS++ikqlk15mcqjHwPFYHRqmglk3j8LY877jo/gxKLUCpOe9RU+GQ== X-Received: by 2002:a7b:c843:: with SMTP id c3mr16331077wml.76.1630258669053; Sun, 29 Aug 2021 10:37:49 -0700 (PDT) Received: from [192.168.1.10] (88-105-96-80.dynamic.dsl.as9105.com. [88.105.96.80]) by smtp.gmail.com with ESMTPSA id n3sm12384703wmi.0.2021.08.29.10.37.47 for (version=TLS1_3 cipher=TLS_AES_128_GCM_SHA256 bits=128/128); Sun, 29 Aug 2021 10:37:48 -0700 (PDT) Subject: gdisk(8) and geli(8) From: Graham Perrin To: FreeBSD CURRENT References: <149845085.13.1630055426223@localhost> Message-ID: <503419c6-ab7a-dad9-8bd0-7a450b3b4604@gmail.com> Date: Sun, 29 Aug 2021 18:37:47 +0100 User-Agent: Mozilla/5.0 (X11; FreeBSD amd64; rv:78.0) Gecko/20100101 Thunderbird/78.13.0 List-Id: Discussions about the use of FreeBSD-current List-Archive: https://lists.freebsd.org/archives/freebsd-current List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-current@freebsd.org MIME-Version: 1.0 In-Reply-To: Content-Type: text/plain; charset=utf-8; format=flowed Content-Transfer-Encoding: 8bit Content-Language: en-GB X-Rspamd-Queue-Id: 4GyLJN3y0Jz4TLN X-Spamd-Bar: -- Authentication-Results: mx1.freebsd.org; dkim=pass header.d=gmail.com header.s=20161025 header.b=JEuOBOm1; dmarc=pass (policy=none) header.from=gmail.com; spf=pass (mx1.freebsd.org: domain of grahamperrin@gmail.com designates 2a00:1450:4864:20::32d as permitted sender) smtp.mailfrom=grahamperrin@gmail.com X-Spamd-Result: default: False [-2.21 / 15.00]; RCVD_VIA_SMTP_AUTH(0.00)[]; FREEMAIL_FROM(0.00)[gmail.com]; R_SPF_ALLOW(-0.20)[+ip6:2a00:1450:4000::/36]; RCVD_COUNT_THREE(0.00)[3]; TO_DN_ALL(0.00)[]; DKIM_TRACE(0.00)[gmail.com:+]; DMARC_POLICY_ALLOW(-0.50)[gmail.com,none]; RECEIVED_SPAMHAUS_PBL(0.00)[88.105.96.80:received]; FROM_EQ_ENVFROM(0.00)[]; MIME_TRACE(0.00)[0:+]; FREEMAIL_ENVFROM(0.00)[gmail.com]; ASN(0.00)[asn:15169, ipnet:2a00:1450::/32, country:US]; MID_RHS_MATCH_FROM(0.00)[]; DWL_DNSWL_NONE(0.00)[gmail.com:dkim]; ARC_NA(0.00)[]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; R_DKIM_ALLOW(-0.20)[gmail.com:s=20161025]; FROM_HAS_DN(0.00)[]; TO_MATCH_ENVRCPT_ALL(0.00)[]; NEURAL_HAM_LONG(-1.00)[-1.000]; MIME_GOOD(-0.10)[text/plain]; PREVIOUSLY_DELIVERED(0.00)[freebsd-current@freebsd.org]; RCPT_COUNT_ONE(0.00)[1]; NEURAL_SPAM_SHORT(0.79)[0.793]; RCVD_IN_DNSWL_NONE(0.00)[2a00:1450:4864:20::32d:from]; RCVD_TLS_ALL(0.00)[] X-ThisMailContainsUnwantedMimeParts: N On 28/08/2021 14:50, Graham Perrin wrote: > Re: Experiments with sswap(1), srm(1), wipe(1), gdisk(8), lsblk and > gpart(8) > puts kern.geom.debugflags=16 in > context. I'm not sure why it was required yesterday. The explanation was probably GELI. From the previously attached file:   da0p4.eli      0:196 450G zfs                                               - -