From nobody Sat Oct 14 23:54:19 2023 X-Original-To: freebsd-hackers@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4S7KwY1frvz4xQ48 for ; Sat, 14 Oct 2023 23:54:21 +0000 (UTC) (envelope-from leres@freebsd.org) Received: from smtp.freebsd.org (smtp.freebsd.org [IPv6:2610:1c1:1:606c::24b:4]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "smtp.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4S7KwY16NXz3SQk for ; Sat, 14 Oct 2023 23:54:21 +0000 (UTC) (envelope-from leres@freebsd.org) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1697327661; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding; bh=1lzhJlnnhOeVyH/1plxh5oBjHSS9nebKvvuH18j0arQ=; b=ZEMMvU50G5iWrZIcveRe9MO+Bm7qBatoXTtuQWpo46K5cMmL9yjpOyyTqtSDaZ7rV+mTFl Wv/zwiUP6m/a8aDYYEvqM/AeCqiXP9OQlVuZgy7vxf6sXfnJ5S3R5sXD//w7p4tGbe/Zcd Kj6frqL6HqBSqqaHlZYEPWMB8Z5vK1zeTFVje5b4ce6nhlbwFEu1RqA5wx4NF1p746E9Wr 7J4SfP5GZYLd2T7Vyq5EqE7Hqq1Pmv/6aDlx5ieYvBqPuf72OAhPfoQfbOA4XouVznqwPE P7TjAnnVg3k7IekwQkD55/Mp3HHahLNmZPD/RjY5TFH0DzmyU4ZPIfG0IRtd5A== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1697327661; a=rsa-sha256; cv=none; b=kCmpC9xKaAV0pvWY5n9o8Je9XC71AV5fBHN7b7Po928sa86Fc1GK94u9oEONg9GS3VldYx +cymTOGEM7fniVObcjgTKMXbeuRXH8uTHLkoY4LKA4E4WRVcVc707R0EFbV15iVKLOflCM UG6UzamVLS4Pf2pjD4XDdJq7UwsNw1PVfmLAoThBc6WIPBuwJL0OjU9WoapbRNUAv9JgEg y3jwGHLuq2ha2HkFs5Viq2V3HPghS3HXpSNxhk6+jyO7CQDUcXHslH6hL9+mB9ypku35iG fU3xK/BuMw+xii8s8SFhiU047J1KauKJ/Vd5d0vvWYN2DIM7wc/ZT/TC2qIACA== ARC-Authentication-Results: i=1; mx1.freebsd.org; none ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1697327661; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding; bh=1lzhJlnnhOeVyH/1plxh5oBjHSS9nebKvvuH18j0arQ=; b=DymMBs/7HLEyfezqRYZ6h+/PXI02eP/fGuLOQBagXYiep6uVXyYirfe6tvV9XB5GE1W8X/ 8FSd1ZO7FPy7NJrJy8buzWbpRx6QUVyMnadsZux60n1gGRg5Im6laLLxq6d8W/P7jwxX5I v9+gMyPw9fR/2rtJ8LBoLaOjQB9mkdMwisaFby6gMAkmeMySInQfouc9tFVOza+P2cu0I1 jVHe5Fhx250Z3uqJ6LzU4N34AZGn8E/+vJxntRm0ta8p03efQrXLehTv3TrMKN+LyYBC1U b5Jl7iurAj2KZta8Um17y+0Nsa5Kp38jit3zxR0ncGW0rZVr1NrXf364XT9ULQ== Received: from [IPV6:fd:1965::2] (unknown [IPv6:2600:1700:ab1b:6800::48]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) (Authenticated sender: leres) by smtp.freebsd.org (Postfix) with ESMTPSA id 4S7KwX67sVzyR0 for ; Sat, 14 Oct 2023 23:54:20 +0000 (UTC) (envelope-from leres@freebsd.org) Message-ID: Date: Sat, 14 Oct 2023 16:54:19 -0700 List-Id: Technical discussions relating to FreeBSD List-Archive: https://lists.freebsd.org/archives/freebsd-hackers List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-hackers@freebsd.org MIME-Version: 1.0 User-Agent: Mozilla Thunderbird Content-Language: en-US From: Craig Leres To: freebsd-hackers@freebsd.org Subject: Trouble building cmake-core with DEFAULT_VERSIONS=ssl=openssl31 Content-Type: text/plain; charset=UTF-8; format=flowed Content-Transfer-Encoding: 7bit This is a really weird one. poudriere recently started failing to build cmake-core for me (13.2/amd64). It sorta looks like fallout from the pkgconfig /usr and /usr/local/ path reversal situation: ld: error: undefined symbol: EVP_PKEY_id >>> referenced by openssl.c >>> openssl.c.o:(Curl_ossl_certchain) in archive lib/libcmcurl.a >>> referenced by openssl.c >>> openssl.c.o:(cert_stuff) in archive lib/libcmcurl.a What's *really* strange is cmake-core builds fine in a interactive poudriere jail. I've never seen this before! And it makes this really difficult to get a handle on... To recap, this fails: poudriere bulk -j 13release -p current devel/cmake-core This also fails: poudriere bulk -i -j 13release -p current devel/cmake-core but then "cd /usr/ports/devel/cmake-core ; make" in the resulting jail works!! I tried openssl32 and it's the same. What am I missing? Craig From nobody Sun Oct 15 13:39:16 2023 X-Original-To: freebsd-hackers@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4S7hDS72FMz4wxs0 for ; Sun, 15 Oct 2023 13:39:20 +0000 (UTC) (envelope-from void@f-m.fm) Received: from out3-smtp.messagingengine.com (out3-smtp.messagingengine.com [66.111.4.27]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4S7hDS02mSz3Wrf for ; Sun, 15 Oct 2023 13:39:20 +0000 (UTC) (envelope-from void@f-m.fm) Authentication-Results: mx1.freebsd.org; dkim=pass header.d=f-m.fm header.s=fm3 header.b="N8H2x/4n"; dkim=pass header.d=messagingengine.com header.s=fm3 header.b=HcfRgssd; spf=pass (mx1.freebsd.org: domain of void@f-m.fm designates 66.111.4.27 as permitted sender) smtp.mailfrom=void@f-m.fm; dmarc=pass (policy=none) header.from=f-m.fm Received: from compute2.internal (compute2.nyi.internal [10.202.2.46]) by mailout.nyi.internal (Postfix) with ESMTP id A730A5C0252 for ; Sun, 15 Oct 2023 09:39:18 -0400 (EDT) Received: from mailfrontend2 ([10.202.2.163]) by compute2.internal (MEProxy); Sun, 15 Oct 2023 09:39:18 -0400 DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=f-m.fm; h=cc :content-type:content-type:date:date:from:from:in-reply-to :message-id:mime-version:reply-to:sender:subject:subject:to:to; s=fm3; t=1697377158; x=1697463558; bh=UfFlTBmaEsKrTx1kYdKDVc8dC VfZukNDihU5RwFlaMI=; b=N8H2x/4nSUvzsK4NWMJ/NleFzaScBxQ3O+5Pigbjg bAGJjUPiQ37hAYyHMR3lMXQkZ+eA+BDx9FBPXC+0lLxJiylGGIUrVrPftaFXoVvz +IQSsHM43JPSoC+09ULHnmEz3NKdFz4ipmfb5CJwgShAgf6PzWJ48Czcbn5wbqHB lBHdQiscPTXfkimmGAHa5Oq4KrL2mrr4mZqPwRLQS61VVxCX4uXMI1hSX2vT2818 wkCtLOUJ/df2KVLkWKjqaNpwK7ODNeaxASZIC+uB7FK6bdI6TvTOoW1WSoUHRIl4 9aMohuWP0lfd/OmdzyO6mQ+DkzvMnqwVnW2EkVFdOWl9A== DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d= messagingengine.com; h=cc:content-type:content-type:date:date :feedback-id:feedback-id:from:from:in-reply-to:message-id :mime-version:reply-to:sender:subject:subject:to:to:x-me-proxy :x-me-proxy:x-me-sender:x-me-sender:x-sasl-enc; s=fm3; t= 1697377158; x=1697463558; bh=UfFlTBmaEsKrTx1kYdKDVc8dCVfZukNDihU 5RwFlaMI=; b=HcfRgssdH+kC0Gn+r2xwALT2zzHLr7oFu+F8eAL2tFVbJ6j+Fr9 h1M5sZ2BcRLwIelpZgM1oBnt25OC/g2a4TGIc131TBEqntqXE5BGKSdQVEmdGKjx MfAdy/IrDyXTb2WW1QOpJgj4KA3en4dR02+Tav0NmyPMrvyugUyG53KMe86rvbDC 4ya8Y5TlGwDqrOpGHaXPgLMFOzi6y41MQRJULXrsxbhirIzLU/kSO13qmUEBKJm3 cGC4V6Cn/JpuIzOA9PDSni0R2oQhnQ1vG1J1p1XnWeAYBNqG6T+yalIC8N/v/Cqi NiOC2N0uXbjN8tEnPmMIQt0FJ1wSEiD/w7Q== X-ME-Sender: X-ME-Received: X-ME-Proxy-Cause: gggruggvucftvghtrhhoucdtuddrgedvkedrieekgdeivdcutefuodetggdotefrodftvf curfhrohhfihhlvgemucfhrghsthforghilhdpqfgfvfdpuffrtefokffrpgfnqfghnecu uegrihhlohhuthemuceftddtnecunecujfgurhepfffhvffukfggtggusehttdertddttd dvnecuhfhrohhmpehvohhiugcuoehvohhiugesfhdqmhdrfhhmqeenucggtffrrghtthgv rhhnpeevudffiedvffffgffhgeefjeefffdtieetheetkeefhfdvfefgtedtueehgeffue enucevlhhushhtvghrufhiiigvpedtnecurfgrrhgrmhepmhgrihhlfhhrohhmpehvohhi ugesfhdqmhdrfhhm X-ME-Proxy: Feedback-ID: i2541463c:Fastmail Received: by mail.messagingengine.com (Postfix) with ESMTPA for ; Sun, 15 Oct 2023 09:39:18 -0400 (EDT) Date: Sun, 15 Oct 2023 14:39:16 +0100 From: void To: freebsd-hackers@freebsd.org Subject: zpool geli encryption question Message-ID: Mail-Followup-To: freebsd-hackers@freebsd.org List-Id: Technical discussions relating to FreeBSD List-Archive: https://lists.freebsd.org/archives/freebsd-hackers List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-hackers@freebsd.org MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii; format=flowed Content-Disposition: inline X-Spamd-Bar: --- X-Spamd-Result: default: False [-3.05 / 15.00]; NEURAL_HAM_LONG(-1.00)[-1.000]; DWL_DNSWL_LOW(-1.00)[messagingengine.com:dkim]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; NEURAL_SPAM_SHORT(0.55)[0.546]; DMARC_POLICY_ALLOW(-0.50)[f-m.fm,none]; MID_RHS_NOT_FQDN(0.50)[]; R_SPF_ALLOW(-0.20)[+ip4:66.111.4.27]; R_DKIM_ALLOW(-0.20)[f-m.fm:s=fm3,messagingengine.com:s=fm3]; MIME_GOOD(-0.10)[text/plain]; RCVD_IN_DNSWL_LOW(-0.10)[66.111.4.27:from]; ASN(0.00)[asn:19151, ipnet:66.111.4.0/24, country:US]; PREVIOUSLY_DELIVERED(0.00)[freebsd-hackers@freebsd.org]; RCVD_COUNT_THREE(0.00)[3]; DKIM_TRACE(0.00)[f-m.fm:+,messagingengine.com:+]; TO_DN_NONE(0.00)[]; FREEMAIL_FROM(0.00)[f-m.fm]; RCPT_COUNT_ONE(0.00)[1]; FREEMAIL_ENVFROM(0.00)[f-m.fm]; TO_MATCH_ENVRCPT_ALL(0.00)[]; FROM_EQ_ENVFROM(0.00)[]; RCVD_TLS_LAST(0.00)[]; FROM_HAS_DN(0.00)[]; MLMMJ_DEST(0.00)[freebsd-hackers@freebsd.org]; MIME_TRACE(0.00)[0:+]; ARC_NA(0.00)[]; RCVD_VIA_SMTP_AUTH(0.00)[] X-Rspamd-Queue-Id: 4S7hDS02mSz3Wrf A machine periodically backs up bhyve volume-backed VMs like so: # zfs send ssdzfs/fbsd140R | gzip -c > /vol-backups/$(date '+%G.%m.%d_%H:%M').fbsd140R.gz This vm is zfs internally with geli encryption of both the fs and swap. The same backup routine applies to an openbsd vm. It has its own way of filesystem encryption. Both volumes are 64GB in size. On the host, both volumes use lz4. Surprisingly (to me at least), the freebsd backup results in a smaller size of archive. The openbsd one results in a slightly larger archive than its source. I'm expecting both archives to be slightly larger than their sources, because encrypted data is uncompressible. The freebsd archive is 19GB. The openbsd one is 65GB. Why is this? -- From nobody Sun Oct 15 14:17:57 2023 X-Original-To: freebsd-hackers@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4S7j5K4Wmgz4x14h for ; Sun, 15 Oct 2023 14:18:13 +0000 (UTC) (envelope-from asomers@gmail.com) Received: from mail-ua1-f44.google.com (mail-ua1-f44.google.com [209.85.222.44]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "GTS CA 1D4" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4S7j5H3y85z3bRG for ; Sun, 15 Oct 2023 14:18:11 +0000 (UTC) (envelope-from asomers@gmail.com) Authentication-Results: mx1.freebsd.org; dkim=none; spf=pass (mx1.freebsd.org: domain of asomers@gmail.com designates 209.85.222.44 as permitted sender) smtp.mailfrom=asomers@gmail.com; dmarc=none Received: by mail-ua1-f44.google.com with SMTP id a1e0cc1a2514c-7b5f7f4e733so1390584241.3 for ; Sun, 15 Oct 2023 07:18:11 -0700 (PDT) X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20230601; t=1697379489; x=1697984289; h=content-transfer-encoding:to:subject:message-id:date:from :in-reply-to:references:mime-version:x-gm-message-state:from:to:cc :subject:date:message-id:reply-to; bh=Mv9EzZrw0FobnkSob5ADqMUE5hUuJWW3CsxY2rTMTlE=; b=veOcfjdulLPdhPCPgJpjrf+AcxGL5PYpQol+lnSGGAlDujG7B7ptZZhvT9wKNO2w0L Nzm1u8DJYUKHJ4s6iiSrA1DddFIChqaO5tn6aeoJrkgmX0FBIubFPXGLR1+unkdTJmOW WNyQ9GTqB8iNOZZQDGNILLfmH1GnK5FcrOD4wMMQTzR8jl33HHdj2iTUJUmbjkNRXJdc 9EEJllHSdgI6ZqiM1Yxg1v3SENuZ31Lxx0SmfRojPgSAuTg0wfD1A5B3XKxFdboa+eS3 X7+Y+wwTv8QJehFBeZyzfkrTg+R/yGbBt328mhjGqAfzcXZfbOeLxUiAik7R3ATvexNo SmzA== X-Gm-Message-State: AOJu0YxKAu25+IHHZn+8ACxjvJCIUGXYb1r1fFNsirPKLF5/gfkZXd9c 56ibxhzxAEm0uGuEC388e0IbFUIyluUo+tcKjoMGU8D0 X-Google-Smtp-Source: AGHT+IE/VU5yiFwCoZCwcSQZHxTB3lkApmNAOoZn18Co6kwlAA7y0OP6Lam6Yy2sIzSPpsBX4omKdu8vJr01vanjnbQ= X-Received: by 2002:a1f:ed41:0:b0:495:dcd0:471 with SMTP id l62-20020a1fed41000000b00495dcd00471mr26572226vkh.5.1697379489534; Sun, 15 Oct 2023 07:18:09 -0700 (PDT) List-Id: Technical discussions relating to FreeBSD List-Archive: https://lists.freebsd.org/archives/freebsd-hackers List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-hackers@freebsd.org MIME-Version: 1.0 References: In-Reply-To: From: Alan Somers Date: Sun, 15 Oct 2023 07:17:57 -0700 Message-ID: Subject: Re: zpool geli encryption question To: freebsd-hackers@freebsd.org Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Spamd-Bar: - X-Spamd-Result: default: False [-1.31 / 15.00]; NEURAL_HAM_LONG(-1.00)[-1.000]; NEURAL_HAM_SHORT(-0.90)[-0.903]; NEURAL_SPAM_MEDIUM(0.60)[0.596]; FORGED_SENDER(0.30)[asomers@freebsd.org,asomers@gmail.com]; R_SPF_ALLOW(-0.20)[+ip4:209.85.128.0/17]; MIME_GOOD(-0.10)[text/plain]; RCVD_COUNT_ONE(0.00)[1]; MLMMJ_DEST(0.00)[freebsd-hackers@freebsd.org]; MIME_TRACE(0.00)[0:+]; RWL_MAILSPIKE_POSSIBLE(0.00)[209.85.222.44:from]; FREEMAIL_ENVFROM(0.00)[gmail.com]; R_DKIM_NA(0.00)[]; FROM_NEQ_ENVFROM(0.00)[asomers@freebsd.org,asomers@gmail.com]; ASN(0.00)[asn:15169, ipnet:209.85.128.0/17, country:US]; RCVD_IN_DNSWL_NONE(0.00)[209.85.222.44:from]; RCVD_TLS_LAST(0.00)[]; RCPT_COUNT_ONE(0.00)[1]; FREEFALL_USER(0.00)[asomers]; ARC_NA(0.00)[]; DMARC_NA(0.00)[freebsd.org]; FROM_HAS_DN(0.00)[]; PREVIOUSLY_DELIVERED(0.00)[freebsd-hackers@freebsd.org]; TO_MATCH_ENVRCPT_ALL(0.00)[]; TO_DN_NONE(0.00)[]; TO_DOM_EQ_FROM_DOM(0.00)[] X-Rspamd-Queue-Id: 4S7j5H3y85z3bRG On Sun, Oct 15, 2023 at 6:39=E2=80=AFAM void wrote: > > A machine periodically backs up bhyve volume-backed VMs like so: > > # zfs send ssdzfs/fbsd140R | gzip -c > /vol-backups/$(date '+%G.%m.%d_%H:= %M').fbsd140R.gz > > This vm is zfs internally with geli encryption of both the fs and swap. > > The same backup routine applies to an openbsd vm. It has its own way of > filesystem encryption. > > Both volumes are 64GB in size. On the host, both volumes use lz4. > > Surprisingly (to me at least), the freebsd backup results in a smaller > size of archive. The openbsd one results in a slightly larger archive tha= n > its source. > > I'm expecting both archives to be slightly larger than their sources, > because encrypted data is uncompressible. > > The freebsd archive is 19GB. The openbsd one is 65GB. Why is this? How much of the FreeBSD VM's disk is actually in-use? Maybe you are using TRIM with FreeBSD, which punches holes in the host's ZFS storage. That would explain why compression seems to save space, even though the data is encrypted. -Alan From nobody Sun Oct 15 16:39:22 2023 X-Original-To: freebsd-hackers@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4S7mDG3wSLz4x8V4 for ; Sun, 15 Oct 2023 16:39:26 +0000 (UTC) (envelope-from void@f-m.fm) Received: from out1-smtp.messagingengine.com (out1-smtp.messagingengine.com [66.111.4.25]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4S7mDF5bwVz4Qrg for ; Sun, 15 Oct 2023 16:39:25 +0000 (UTC) (envelope-from void@f-m.fm) Authentication-Results: mx1.freebsd.org; dkim=pass header.d=f-m.fm header.s=fm3 header.b=kw7+FRze; dkim=pass header.d=messagingengine.com header.s=fm3 header.b=v+xCsEfb; spf=pass (mx1.freebsd.org: domain of void@f-m.fm designates 66.111.4.25 as permitted sender) smtp.mailfrom=void@f-m.fm; dmarc=pass (policy=none) header.from=f-m.fm Received: from compute3.internal (compute3.nyi.internal [10.202.2.43]) by mailout.nyi.internal (Postfix) with ESMTP id 1E02B5C0293 for ; Sun, 15 Oct 2023 12:39:25 -0400 (EDT) Received: from mailfrontend2 ([10.202.2.163]) by compute3.internal (MEProxy); Sun, 15 Oct 2023 12:39:25 -0400 DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=f-m.fm; h=cc :content-type:content-type:date:date:from:from:in-reply-to :in-reply-to:message-id:mime-version:references:reply-to:sender :subject:subject:to:to; s=fm3; t=1697387965; x=1697474365; bh=85 YPfeWur7fmUktK76iOKXLgsx0uSxndMS6iNH5XFIU=; b=kw7+FRze8mJ6CKAK1a OAcHwFdYtKEBuf4QzMMrSVmaV/icb4oYmyoMpAjceJwV2qB94gZgZNhglidDeeXL W34toE83iYOkWlG1wrtPXRORzQmjwNNT4kCELe9WB+hCoeewEdxVeAPGvPgrfv6p UxP/mO3FgxAT27TgLHuiTv72Gsmn+MMvRQdUniCO0KuXBnbQg1CyEIFxsiJILkV8 xxhhNlAYxg7FvfH3wnioktz3bhpZYlkUa2hDMlg1fd2v1gM/m6LirKBbVoMaIbdV 26URNhnijIFbpxJDYaBXc5b5fIeYOXU/b3DdGV+n46b/LWjXHHuCUoIpSwpRgpSA +chA== DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d= messagingengine.com; h=cc:content-type:content-type:date:date :feedback-id:feedback-id:from:from:in-reply-to:in-reply-to :message-id:mime-version:references:reply-to:sender:subject :subject:to:to:x-me-proxy:x-me-proxy:x-me-sender:x-me-sender :x-sasl-enc; s=fm3; t=1697387965; x=1697474365; bh=85YPfeWur7fmU ktK76iOKXLgsx0uSxndMS6iNH5XFIU=; b=v+xCsEfbUFQhAjEXYRMl7g02kATpu JwuhtX5riIQov0vF3wO0UTln+3fceQQWLEqFXKLJkbPnPdYfo3+y+XOPtPPsug7i 3bWm2q+hurm83jOPO7C3YBnlT+FKDvX/lWMrCj2GMfaC/2rYsH2NWxqUF4wegEv2 zUpIzoi2mUXIOTRTmRA4FkBpdaD+eUz3ZzewY+3kmyLBsGPiJ/+L5avzHBIsdy1n pdCoaZonxeGFgoiDHRJRutAPx6oTYmAko1BYLZQOYi9y33+DbmY+ZTa/vCrEtnwz tmZjPjY6YWUzXyQyth32FGYY7k7d0xuhzjIFpvZjWkyKvcT2Icu+1v6tg== X-ME-Sender: X-ME-Received: X-ME-Proxy-Cause: gggruggvucftvghtrhhoucdtuddrgedvkedrieekgdelkecutefuodetggdotefrodftvf curfhrohhfihhlvgemucfhrghsthforghilhdpqfgfvfdpuffrtefokffrpgfnqfghnecu uegrihhlohhuthemuceftddtnecunecujfgurhepfffhvffukfhfgggtuggjsehttdertd dttddvnecuhfhrohhmpehvohhiugcuoehvohhiugesfhdqmhdrfhhmqeenucggtffrrght thgvrhhnpeekleduvdelhfeileefgffghfffkedtheellefgudfgvdegkeejjedutdehhe fgueenucevlhhushhtvghrufhiiigvpedtnecurfgrrhgrmhepmhgrihhlfhhrohhmpehv ohhiugesfhdqmhdrfhhm X-ME-Proxy: Feedback-ID: i2541463c:Fastmail Received: by mail.messagingengine.com (Postfix) with ESMTPA for ; Sun, 15 Oct 2023 12:39:24 -0400 (EDT) Date: Sun, 15 Oct 2023 17:39:22 +0100 From: void To: freebsd-hackers@freebsd.org Subject: Re: zpool geli encryption question Message-ID: Mail-Followup-To: freebsd-hackers@freebsd.org References: List-Id: Technical discussions relating to FreeBSD List-Archive: https://lists.freebsd.org/archives/freebsd-hackers List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-hackers@freebsd.org MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii; format=flowed Content-Disposition: inline In-Reply-To: X-Spamd-Bar: ---- X-Spamd-Result: default: False [-4.61 / 15.00]; DWL_DNSWL_LOW(-1.00)[messagingengine.com:dkim]; NEURAL_HAM_LONG(-1.00)[-1.000]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; NEURAL_HAM_SHORT(-0.91)[-0.913]; DMARC_POLICY_ALLOW(-0.50)[f-m.fm,none]; MID_RHS_NOT_FQDN(0.50)[]; R_SPF_ALLOW(-0.20)[+ip4:66.111.4.25]; R_DKIM_ALLOW(-0.20)[f-m.fm:s=fm3,messagingengine.com:s=fm3]; MIME_GOOD(-0.10)[text/plain]; RWL_MAILSPIKE_GOOD(-0.10)[66.111.4.25:from]; RCVD_IN_DNSWL_LOW(-0.10)[66.111.4.25:from]; PREVIOUSLY_DELIVERED(0.00)[freebsd-hackers@freebsd.org]; BLOCKLISTDE_FAIL(0.00)[66.111.4.25:server fail]; FROM_HAS_DN(0.00)[]; TO_MATCH_ENVRCPT_ALL(0.00)[]; RCPT_COUNT_ONE(0.00)[1]; RCVD_TLS_LAST(0.00)[]; MLMMJ_DEST(0.00)[freebsd-hackers@freebsd.org]; RCVD_COUNT_THREE(0.00)[3]; TO_DN_NONE(0.00)[]; FREEMAIL_FROM(0.00)[f-m.fm]; ARC_NA(0.00)[]; DKIM_TRACE(0.00)[f-m.fm:+,messagingengine.com:+]; MIME_TRACE(0.00)[0:+]; FROM_EQ_ENVFROM(0.00)[]; ASN(0.00)[asn:19151, ipnet:66.111.4.0/24, country:US]; FREEMAIL_ENVFROM(0.00)[f-m.fm]; RCVD_VIA_SMTP_AUTH(0.00)[] X-Rspamd-Queue-Id: 4S7mDF5bwVz4Qrg On Sun, Oct 15, 2023 at 07:17:57AM -0700, Alan Somers wrote: >How much of the FreeBSD VM's disk is actually in-use? (in the example below, another vm instance, same observation) from the host: NAME USED AVAIL REFER MOUNTPOINT ssdzfs/fbsd140Rv1 97.5G 309G 21.3G - within the booted vm: NAME AVAIL USED USEDSNAP USEDDS USEDREFRESERV USEDCHILD zroot 74.8G 9.97G 0B 96K 0B 9.97G zroot/ROOT 74.8G 4.61G 0B 96K 0B 4.61G zroot/ROOT/default 74.8G 4.61G 0B 4.61G 0B 0B zroot/home 74.8G 59.6M 0B 59.6M 0B 0B zroot/tmp 74.8G 120K 0B 120K 0B 0B zroot/usr 74.8G 5.28G 0B 96K 0B 5.28G zroot/usr/ports 74.8G 5.28G 0B 5.28G 0B 0B zroot/usr/src 74.8G 96K 0B 96K 0B 0B zroot/var 74.8G 1.17M 0B 96K 0B 1.08M zroot/var/audit 74.8G 96K 0B 96K 0B 0B zroot/var/crash 74.8G 96K 0B 96K 0B 0B zroot/var/log 74.8G 564K 0B 564K 0B 0B zroot/var/mail 74.8G 252K 0B 252K 0B 0B zroot/var/tmp 74.8G 96K 0B 96K 0B 0B gzipped archive: -rw-r--r-- 1 root wheel 21G 15 Oct 16:39 2023.10.15_15:57.fbsd140Rv1.gz >Maybe you are using TRIM with FreeBSD, which punches holes in the host's ZFS >storage. On the bhyve host (14.0-BETA3 #0 releng/14.0-n265111) vfs.zfs.vdev.trim_min_active: 1 vfs.zfs.vdev.trim_max_active: 2 vfs.zfs.trim.queue_limit: 10 vfs.zfs.trim.txg_batch: 32 vfs.zfs.trim.metaslab_skip: 0 vfs.zfs.trim.extent_bytes_min: 32768 vfs.zfs.trim.extent_bytes_max: 134217728 vfs.zfs.l2arc.trim_ahead: 0 vfs.ffs.dotrimcons: 1 Does this mean trim is enabled and active on the host? I didn't set it. Maybe it was automatically set because zfs knows the hardware is SSD? > That would explain why compression seems to save space, even > though the data is encrypted. That's really smart. TYVM for the explainer. -- From nobody Sun Oct 15 16:43:23 2023 X-Original-To: freebsd-hackers@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4S7mK66mrVz4x8s5 for ; Sun, 15 Oct 2023 16:43:38 +0000 (UTC) (envelope-from asomers@gmail.com) Received: from mail-vk1-f172.google.com (mail-vk1-f172.google.com [209.85.221.172]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "GTS CA 1D4" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4S7mK54Kyhz4RkB for ; Sun, 15 Oct 2023 16:43:37 +0000 (UTC) (envelope-from asomers@gmail.com) Authentication-Results: mx1.freebsd.org; dkim=none; spf=pass (mx1.freebsd.org: domain of asomers@gmail.com designates 209.85.221.172 as permitted sender) smtp.mailfrom=asomers@gmail.com; dmarc=none Received: by mail-vk1-f172.google.com with SMTP id 71dfb90a1353d-49d0f24a815so1613613e0c.2 for ; Sun, 15 Oct 2023 09:43:37 -0700 (PDT) X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20230601; t=1697388215; x=1697993015; h=content-transfer-encoding:to:subject:message-id:date:from :in-reply-to:references:mime-version:x-gm-message-state:from:to:cc :subject:date:message-id:reply-to; bh=1eMsyZx20nPHSaPWYNWZzhG1kHxfY6FLdRtvEELb69g=; b=ml4V+BjX3E6U7N5JlzIbh9zGhDACTEC7vi5zxxALYWD6aXvTHMrcXp4G+8oc24diSs XhJN0Rv3cv/+dZ+xm03k8RfD2hUe3LcYgxfb0MgoDjZr0/bV5qVNUDnbbH2bCRZaMlL9 J917tGRTHTas1d9PgIA2ZONVzV46gI9aPGbqvcKt+P3uNxBMu4HNSzmf7wgm8wXXPT/Y XsXY1h86zcJYNGoRbnfEg4sgwlnskd2u1mmYwH6maVwdzYGBSbncRYKNcFe0T2eNiHNv hZw5EAvyGLjPmFs3ra7WawSmIMGSGXlIZN0dcbfnqjBe1JmzBZoAk/kpGGEdCukBT+aI Eeww== X-Gm-Message-State: AOJu0YxXk83jYstkcJ7uMjEAm//S0jku/sWuhDj5IsQjztYy4gDd15vt KzA4hrzF+OWAiI3dKSKfbvO/sjzT4RPmhDCeOd9U2N5w X-Google-Smtp-Source: AGHT+IF7MnG8Zm2IRkGbCyLj3MSdmILq34T8c3pu6b3dyj152gf88G/OA5oCcW2drRSYYGoT7VDFnGGrNCndkbdwEUE= X-Received: by 2002:a05:6122:1d4b:b0:4a8:4218:7b90 with SMTP id gd11-20020a0561221d4b00b004a842187b90mr839875vkb.9.1697388215144; Sun, 15 Oct 2023 09:43:35 -0700 (PDT) List-Id: Technical discussions relating to FreeBSD List-Archive: https://lists.freebsd.org/archives/freebsd-hackers List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-hackers@freebsd.org MIME-Version: 1.0 References: In-Reply-To: From: Alan Somers Date: Sun, 15 Oct 2023 09:43:23 -0700 Message-ID: Subject: Re: zpool geli encryption question To: freebsd-hackers@freebsd.org Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Spamd-Bar: - X-Spamd-Result: default: False [-1.13 / 15.00]; NEURAL_HAM_LONG(-1.00)[-1.000]; NEURAL_HAM_SHORT(-0.97)[-0.968]; NEURAL_SPAM_MEDIUM(0.84)[0.839]; FORGED_SENDER(0.30)[asomers@freebsd.org,asomers@gmail.com]; R_SPF_ALLOW(-0.20)[+ip4:209.85.128.0/17]; MIME_GOOD(-0.10)[text/plain]; PREVIOUSLY_DELIVERED(0.00)[freebsd-hackers@freebsd.org]; DMARC_NA(0.00)[freebsd.org]; RCPT_COUNT_ONE(0.00)[1]; RCVD_TLS_LAST(0.00)[]; TO_MATCH_ENVRCPT_ALL(0.00)[]; RCVD_IN_DNSWL_NONE(0.00)[209.85.221.172:from]; BLOCKLISTDE_FAIL(0.00)[209.85.221.172:server fail]; FROM_HAS_DN(0.00)[]; FREEFALL_USER(0.00)[asomers]; ARC_NA(0.00)[]; MIME_TRACE(0.00)[0:+]; RCVD_COUNT_ONE(0.00)[1]; TO_DN_NONE(0.00)[]; MLMMJ_DEST(0.00)[freebsd-hackers@freebsd.org]; R_DKIM_NA(0.00)[]; ASN(0.00)[asn:15169, ipnet:209.85.128.0/17, country:US]; FREEMAIL_ENVFROM(0.00)[gmail.com]; TO_DOM_EQ_FROM_DOM(0.00)[]; FROM_NEQ_ENVFROM(0.00)[asomers@freebsd.org,asomers@gmail.com]; RWL_MAILSPIKE_POSSIBLE(0.00)[209.85.221.172:from] X-Rspamd-Queue-Id: 4S7mK54Kyhz4RkB On Sun, Oct 15, 2023 at 9:39=E2=80=AFAM void wrote: > > On Sun, Oct 15, 2023 at 07:17:57AM -0700, Alan Somers wrote: > > >How much of the FreeBSD VM's disk is actually in-use? > > (in the example below, another vm instance, same observation) > > from the host: > > NAME USED AVAIL REFER MOUNTPOINT > ssdzfs/fbsd140Rv1 97.5G 309G 21.3G - > > within the booted vm: > > NAME AVAIL USED USEDSNAP USEDDS USEDREFRESERV USEDCH= ILD > zroot 74.8G 9.97G 0B 96K 0B 9.= 97G > zroot/ROOT 74.8G 4.61G 0B 96K 0B 4.= 61G > zroot/ROOT/default 74.8G 4.61G 0B 4.61G 0B = 0B > zroot/home 74.8G 59.6M 0B 59.6M 0B = 0B > zroot/tmp 74.8G 120K 0B 120K 0B = 0B > zroot/usr 74.8G 5.28G 0B 96K 0B 5.= 28G > zroot/usr/ports 74.8G 5.28G 0B 5.28G 0B = 0B > zroot/usr/src 74.8G 96K 0B 96K 0B = 0B > zroot/var 74.8G 1.17M 0B 96K 0B 1.= 08M > zroot/var/audit 74.8G 96K 0B 96K 0B = 0B > zroot/var/crash 74.8G 96K 0B 96K 0B = 0B > zroot/var/log 74.8G 564K 0B 564K 0B = 0B > zroot/var/mail 74.8G 252K 0B 252K 0B = 0B > zroot/var/tmp 74.8G 96K 0B 96K 0B = 0B > > gzipped archive: > > -rw-r--r-- 1 root wheel 21G 15 Oct 16:39 2023.10.15_15:57.fbsd140Rv1.= gz > > >Maybe you are using TRIM with FreeBSD, which punches holes in the host's= ZFS > >storage. > > On the bhyve host (14.0-BETA3 #0 releng/14.0-n265111) > > vfs.zfs.vdev.trim_min_active: 1 > vfs.zfs.vdev.trim_max_active: 2 > vfs.zfs.trim.queue_limit: 10 > vfs.zfs.trim.txg_batch: 32 > vfs.zfs.trim.metaslab_skip: 0 > vfs.zfs.trim.extent_bytes_min: 32768 > vfs.zfs.trim.extent_bytes_max: 134217728 > vfs.zfs.l2arc.trim_ahead: 0 > vfs.ffs.dotrimcons: 1 > > Does this mean trim is enabled and active on the host? > I didn't set it. Maybe it was automatically set because zfs knows the > hardware is SSD? Within the VM, do "zpool get autotrim zroot" to see if it's set. You can also manually trim with "zpool trim zroot" if you don't want to use the autotrim setting. Note that even without trim, it's possible that there are LBAs which the VM simply has never written to. That could also explain the low space usage on the host. > > > That would explain why compression seems to save space, even > > though the data is encrypted. > > That's really smart. > > TYVM for the explainer. > -- > > From nobody Sun Oct 15 17:06:22 2023 X-Original-To: freebsd-hackers@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4S7mqm3Q1Fz4xB2n for ; Sun, 15 Oct 2023 17:06:44 +0000 (UTC) (envelope-from void@f-m.fm) Received: from out1-smtp.messagingengine.com (out1-smtp.messagingengine.com [66.111.4.25]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4S7mql5tH1z4V5v for ; Sun, 15 Oct 2023 17:06:43 +0000 (UTC) (envelope-from void@f-m.fm) Authentication-Results: mx1.freebsd.org; dkim=pass header.d=f-m.fm header.s=fm3 header.b=DsoL9NPR; dkim=pass header.d=messagingengine.com header.s=fm3 header.b="i7XGn/Qy"; spf=pass (mx1.freebsd.org: domain of void@f-m.fm designates 66.111.4.25 as permitted sender) smtp.mailfrom=void@f-m.fm; dmarc=pass (policy=none) header.from=f-m.fm Received: from compute6.internal (compute6.nyi.internal [10.202.2.47]) by mailout.nyi.internal (Postfix) with ESMTP id 88AC55C0281 for ; Sun, 15 Oct 2023 13:06:43 -0400 (EDT) Received: from imap46 ([10.202.2.96]) by compute6.internal (MEProxy); Sun, 15 Oct 2023 13:06:43 -0400 DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=f-m.fm; h=cc :content-type:content-type:date:date:from:from:in-reply-to :in-reply-to:message-id:mime-version:references:reply-to:sender :subject:subject:to:to; s=fm3; t=1697389603; x=1697476003; bh=/x DIwmX9ykNO2zG/se6k+OpFL/PFgErPdkrq0aRK8ig=; b=DsoL9NPRvOW0Wji37l Wa03LAX5rdexdYq+njOkiX+WWG8aTaoqGswQ+w4kTqIRYpAxuTLuw1l+2URAl8Z4 p+vUWR2nnfEq1kBIV5A5qdUcwXDr7sj/JwoIwffpA1BOaY8zV8SxqV1sIYtGlnYL Z9orTyF5YqBKsNuYWFt2D73s/b5jhJOgzEJ3C84tEjxm20zd9+1Nsv/bfYLx8zLY xAwoIeT5ZyaRReP3aPmjevN3G9pstJZ/rqyQPimvedd0Rvpij5GqDClG0vaQjPJe wushYcHMAHlxEayobg5QwOQmoUrEddBMZcLaS44HcV4Drwgt0eA5FNeroXLRDQ0T G/EA== DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d= messagingengine.com; h=cc:content-type:content-type:date:date :feedback-id:feedback-id:from:from:in-reply-to:in-reply-to :message-id:mime-version:references:reply-to:sender:subject :subject:to:to:x-me-proxy:x-me-proxy:x-me-sender:x-me-sender :x-sasl-enc; s=fm3; t=1697389603; x=1697476003; bh=/xDIwmX9ykNO2 zG/se6k+OpFL/PFgErPdkrq0aRK8ig=; b=i7XGn/QyepT6D/CPYVy3xKnUuE7Ko oY1redxXL0kjc0RLSuHXgpPk/Ql6aZ/bJlOOV8p4vmIJKjOgHCG871nnq0qhVi44 UwFEgQSIt78F7bgKzJfFgJCL7+Aw9qKrNPT+6NqLhMaUj57c4aUrb7WR2gii6gjM pYDcXGaErkhjwWkIrs6quLQdwCWYuWyexicw8PER4Wj9fSgm36SkPctA5e+fB121 xAj2gMCYRVCFSsJkPSl7/zu57MAYKQUVZ9rVd9HjGUOYPrQh7zTo2ny6ela6Nq98 uwP9AsRppHsBHmBxvTfMVTgY0tL034MSRJK9wAGZ/7Q7HFGRhp+zdKlzg== X-ME-Sender: X-ME-Proxy-Cause: gggruggvucftvghtrhhoucdtuddrgedvkedrieekgddutdefucetufdoteggodetrfdotf fvucfrrhhofhhilhgvmecuhfgrshhtofgrihhlpdfqfgfvpdfurfetoffkrfgpnffqhgen uceurghilhhouhhtmecufedttdenucenucfjughrpefofgggkfgjfhffhffvufgtsehttd ertderredtnecuhfhrohhmpehvohhiugcuoehvohhiugesfhdqmhdrfhhmqeenucggtffr rghtthgvrhhnpeeitedvueehtdehtddvhfeuhfevhedvieelvdeiffehveelheegfedule ejudekvdenucevlhhushhtvghrufhiiigvpedtnecurfgrrhgrmhepmhgrihhlfhhrohhm pehvohhiugesfhdqmhdrfhhm X-ME-Proxy: Feedback-ID: i2541463c:Fastmail Received: by mailuser.nyi.internal (Postfix, from userid 501) id 4EBE62A20085; Sun, 15 Oct 2023 13:06:43 -0400 (EDT) X-Mailer: MessagingEngine.com Webmail Interface User-Agent: Cyrus-JMAP/3.9.0-alpha0-1019-ged83ad8595-fm-20231002.001-ged83ad85 List-Id: Technical discussions relating to FreeBSD List-Archive: https://lists.freebsd.org/archives/freebsd-hackers List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-hackers@freebsd.org MIME-Version: 1.0 Message-Id: In-Reply-To: References: Date: Sun, 15 Oct 2023 17:06:22 +0000 From: void To: freebsd-hackers@freebsd.org Subject: Re: zpool geli encryption question Content-Type: text/plain X-Spamd-Bar: ----- X-Spamd-Result: default: False [-5.16 / 15.00]; DWL_DNSWL_LOW(-1.00)[messagingengine.com:dkim]; NEURAL_HAM_LONG(-1.00)[-1.000]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; NEURAL_HAM_SHORT(-0.97)[-0.967]; DMARC_POLICY_ALLOW(-0.50)[f-m.fm,none]; R_DKIM_ALLOW(-0.20)[f-m.fm:s=fm3,messagingengine.com:s=fm3]; R_SPF_ALLOW(-0.20)[+ip4:66.111.4.25:c]; RCVD_IN_DNSWL_LOW(-0.10)[66.111.4.25:from]; RWL_MAILSPIKE_GOOD(-0.10)[66.111.4.25:from]; MIME_GOOD(-0.10)[text/plain]; XM_UA_NO_VERSION(0.01)[]; TO_MATCH_ENVRCPT_ALL(0.00)[]; FROM_HAS_DN(0.00)[]; RCPT_COUNT_ONE(0.00)[1]; PREVIOUSLY_DELIVERED(0.00)[freebsd-hackers@freebsd.org]; ARC_NA(0.00)[]; ASN(0.00)[asn:19151, ipnet:66.111.4.0/24, country:US]; FREEMAIL_ENVFROM(0.00)[f-m.fm]; TO_DN_NONE(0.00)[]; FREEMAIL_FROM(0.00)[f-m.fm]; RCVD_TLS_LAST(0.00)[]; RCVD_COUNT_THREE(0.00)[3]; FROM_EQ_ENVFROM(0.00)[]; DKIM_TRACE(0.00)[f-m.fm:+,messagingengine.com:+]; MIME_TRACE(0.00)[0:+]; MLMMJ_DEST(0.00)[freebsd-hackers@freebsd.org] X-Rspamd-Queue-Id: 4S7mql5tH1z4V5v On Sun, 15 Oct 2023, at 16:43, Alan Somers wrote: > Within the VM, do "zpool get autotrim zroot" to see if it's set. You > can also manually trim with "zpool trim zroot" if you don't want to > use the autotrim setting. > > Note that even without trim, it's possible that there are LBAs which > the VM simply has never written to. That could also explain the low > space usage on the host. # zpool get autotrim zroot NAME PROPERTY VALUE SOURCE zroot autotrim off default I've enabled it on the VM. I was surprised this type of setting would work within the VM. I'll enable it (autotrim) on all hosts too. thanks -- From nobody Mon Oct 16 16:40:07 2023 X-Original-To: freebsd-hackers@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4S8NBd04Kcz4xYn6 for ; Mon, 16 Oct 2023 16:40:09 +0000 (UTC) (envelope-from leres@freebsd.org) Received: from smtp.freebsd.org (smtp.freebsd.org [96.47.72.83]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "smtp.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4S8NBc6lyXz3Qjt for ; Mon, 16 Oct 2023 16:40:08 +0000 (UTC) (envelope-from leres@freebsd.org) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1697474408; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=LtSKS5g5QvOsFJr6c+t8Fsw2PuLnI2W5PucQV12Hq58=; b=a2yJ+26xZ9fGi1Hj1puXUI0VD0ez5mODtmV4x0VB4aLTrDS7VS9T5PHcqbsSakKW/AStYk UItFnRuut0gsxPYo7zyi/3mhVlmg1iST159kHabaADq1dfoNAc7IbyIuWd/E3MiMgX8VWN nLE6fMeJcZBhJjRE/W9CriXmsSxP38fyjSiskZtEdVEsjX98BqyOPR6J+vqwoExRuENPIG qZ+oow+1VOjuPTTbNa9WDDDyxwfZ25Oypx/a+0HR1k/owmhKiAwVnGVGXpIKRLz/nJF7PW UPB85YYt/lB+x2KBrD8zsVR65uy2LliEgv09+biegcG0McJhaiXNfVnwV5+OSw== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1697474408; a=rsa-sha256; cv=none; b=gvO6/bC31f3679vCZvFZh4opo8cAP25uAWRHhoas/TrIb22cRdRhXu97E2aUMh6hnVlJSF QGIiexPXP2XZTcgxw1sMawn6z3kZ6OznzMMo6SH0pej+Dr8FHNmCDolvflusbJ9iGUF6Or fuFb74K0qf69nh3v9CE7NJHdKLABJCr+phldzEYgezxDMO3dr0L+SKzw8Z/bGiD0t5Sx0m sYg37zuWeE2XBM3pxmCv+j4HPNiW0YSMwEpiViwUsOSee0vWJ3+MvzpssVqsP4e8p8fqt0 RaqTLrb02mvhoYQqj5vbkCMZz9uH2AxOe3sod5KLnuikVwCNQM90Lj1wSMhLMA== ARC-Authentication-Results: i=1; mx1.freebsd.org; none ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1697474408; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=LtSKS5g5QvOsFJr6c+t8Fsw2PuLnI2W5PucQV12Hq58=; b=S4C838lK4CaFHDfqlGM8/FPS3Yg8MfprUY2024JyrSL3ReLppqeWZpHdK2/f5N8hxlm4c1 28/+Z974kUYxs4IE5LmNLmhthlLZeajslzjac0a/Nj1rMKoXttS2hYvXM8tdWW3RDu19xD 8cvbftIgVzrouk0ulZNNVDGAQOrhEwuR5BXjA8EIDHKmx9HwtVoF9EyNZORSViuY3kEcj7 ujxby1+hea+zu0skydWsjAIRNby+GYcM9Vr8wAbVjFLfp0fQeSxscByACby8PKQsRrGgvS 5g+NVJGJuOt3dHhrb/q3dLxhRtUTRvtVJ3aG/1yZKGCe8bg+PKZaE3HDmWSznA== Received: from [IPV6:fd:1965::2] (unknown [IPv6:2600:1700:ab1b:6800::48]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) (Authenticated sender: leres) by smtp.freebsd.org (Postfix) with ESMTPSA id 4S8NBc4KHCzlGc for ; Mon, 16 Oct 2023 16:40:08 +0000 (UTC) (envelope-from leres@freebsd.org) Message-ID: <58815319-5a14-4980-a0c9-afb2b44332b6@freebsd.org> Date: Mon, 16 Oct 2023 09:40:07 -0700 List-Id: Technical discussions relating to FreeBSD List-Archive: https://lists.freebsd.org/archives/freebsd-hackers List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-hackers@freebsd.org MIME-Version: 1.0 User-Agent: Mozilla Thunderbird Subject: Re: Trouble building cmake-core with DEFAULT_VERSIONS=ssl=openssl31 Content-Language: en-US From: Craig Leres To: freebsd-hackers@freebsd.org References: In-Reply-To: Content-Type: text/plain; charset=UTF-8; format=flowed Content-Transfer-Encoding: 8bit On 10/14/23 16:54, Craig Leres wrote: > This is a really weird one. > > poudriere recently started failing to build cmake-core for me > (13.2/amd64). It sorta looks like fallout from the pkgconfig /usr and > /usr/local/ path reversal situation: > > ld: error: undefined symbol: EVP_PKEY_id > >>> referenced by openssl.c > >>>               openssl.c.o:(Curl_ossl_certchain) in archive > lib/libcmcurl.a > >>> referenced by openssl.c > >>>               openssl.c.o:(cert_stuff) in archive lib/libcmcurl.a > > What's *really* strange is cmake-core builds fine in a interactive > poudriere jail. I've never seen this before! And it makes this really > difficult to get a handle on... > > To recap, this fails: > >     poudriere bulk -j 13release -p current devel/cmake-core > > This also fails: > >     poudriere bulk -i -j 13release -p current devel/cmake-core > > but then "cd /usr/ports/devel/cmake-core ; make" in the resulting jail > works!! > > I tried openssl32 and it's the same. > > What am I missing? To wrap this up, I'm pretty sure ccache was the cause of my puzzle. Ultimately, nuking the cache (ccache -C) solved this. Craig From nobody Wed Oct 18 06:09:30 2023 X-Original-To: freebsd-hackers@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4S9L686QlRz4xZDq for ; Wed, 18 Oct 2023 06:09:36 +0000 (UTC) (envelope-from azathanai@icloud.com) Received: from qs51p00im-qukt01072502.me.com (qs51p00im-qukt01072502.me.com [17.57.155.15]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4S9L6753wcz3N4Y for ; Wed, 18 Oct 2023 06:09:35 +0000 (UTC) (envelope-from azathanai@icloud.com) Authentication-Results: mx1.freebsd.org; dkim=pass header.d=icloud.com header.s=1a1hai header.b=iY6yHPDY; spf=pass (mx1.freebsd.org: domain of azathanai@icloud.com designates 17.57.155.15 as permitted sender) smtp.mailfrom=azathanai@icloud.com; dmarc=pass (policy=quarantine) header.from=icloud.com DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=icloud.com; s=1a1hai; t=1697609373; bh=Si6m31KDGnAAdWv5AeCPyQKJiqRTcxDqKCzwq3w/+0Y=; h=From:To:Subject:Date:Message-ID:Content-Type:MIME-Version; b=iY6yHPDYhYiKivwbrovLg6msemyJdR+vr5tfqI4SNeNR6q9XHr9E9FogAg3vlCuI0 9BplS9mF9aMwiyzKuIA96BGhGnihl9vE+B7Uvrybd3ry08t2PubNZdCLGN/iNZ8BIi tJCKtZSbn0RM/4Qtnbu4djR4UFBQ9uq8fFE96GcVDhMffuOnxe8gPjLgYiEJzqvQFy 77lUbzNuY3k6BolkbPOw1MPrEFit+J5fJYWAdXY1q7UGqYHDmDGqcEK05TQNYEIRS+ 54iLfebmtj5u28N4/LLxZ/5VDWworpyXshPSBSsfS7/24icwxVtUMmra6AgqVy/1xk lVRRM+CkXCPwQ== Received: from AM6PR02MB4471.eurprd02.prod.outlook.com (qs51p00im-dlb-asmtp-mailmevip.me.com [17.57.155.28]) by qs51p00im-qukt01072502.me.com (Postfix) with ESMTPSA id EA33A6EC01A0; Wed, 18 Oct 2023 06:09:32 +0000 (UTC) From: "azathanai@icloud.com" To: Warner Losh CC: "freebsd-hackers@FreeBSD.org" Subject: Re: Question of installing over SAS controller and USB flash Thread-Topic: Question of installing over SAS controller and USB flash Thread-Index: AQHZ+7gox8b2WXJ7x0SXInCUTrHiVLBDh8MAgADxNbGAAEMlAIAKXwQW X-MS-Exchange-MessageSentRepresentingType: 1 Date: Wed, 18 Oct 2023 06:09:30 +0000 Message-ID: References: In-Reply-To: Accept-Language: en-US, bg-BG Content-Language: en-US X-MS-Has-Attach: X-MS-Exchange-Organization-SCL: -1 X-MS-TNEF-Correlator: X-MS-Exchange-Organization-RecordReviewCfmType: 0 msip_labels: Content-Type: multipart/alternative; boundary="_000_AM6PR02MB4471C1516952D8DCE423C9E7A5D5AAM6PR02MB4471eurp_" List-Id: Technical discussions relating to FreeBSD List-Archive: https://lists.freebsd.org/archives/freebsd-hackers List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-hackers@freebsd.org MIME-Version: 1.0 X-Proofpoint-GUID: UMKZTwuf3J50is4WUEiThwoxtS32Nb4X X-Proofpoint-ORIG-GUID: UMKZTwuf3J50is4WUEiThwoxtS32Nb4X X-Proofpoint-Virus-Version: =?UTF-8?Q?vendor=3Dfsecure_engine=3D1.1.170-22c6f66c430a71ce266a39bfe25bc?= =?UTF-8?Q?2903e8d5c8f:6.0.138,18.0.790,17.11.62.513.0000000_definitions?= =?UTF-8?Q?=3D2022-01-12=5F02:2020-02-14=5F02,2022-01-12=5F02,2021-12-02?= =?UTF-8?Q?=5F01_signatures=3D0?= X-Proofpoint-Spam-Details: rule=notspam policy=default score=0 suspectscore=0 spamscore=0 mlxscore=0 mlxlogscore=999 adultscore=0 malwarescore=0 bulkscore=0 phishscore=0 clxscore=1015 classifier=spam adjust=0 reason=mlx scancount=1 engine=8.12.0-2308100000 definitions=main-2310180051 X-Spamd-Bar: ----- X-Spamd-Result: default: False [-6.00 / 15.00]; WHITELIST_SPF_DKIM(-3.00)[icloud.com:d:+,icloud.com:s:+]; FROM_DN_EQ_ADDR(1.00)[]; NEURAL_HAM_LONG(-1.00)[-1.000]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; NEURAL_HAM_SHORT(-1.00)[-0.998]; DMARC_POLICY_ALLOW(-0.50)[icloud.com,quarantine]; R_SPF_ALLOW(-0.20)[+ip4:17.57.155.0/24]; R_DKIM_ALLOW(-0.20)[icloud.com:s=1a1hai]; ONCE_RECEIVED(0.10)[]; RWL_MAILSPIKE_GOOD(-0.10)[17.57.155.15:from]; MIME_BASE64_TEXT(0.10)[]; MIME_GOOD(-0.10)[multipart/alternative,text/plain]; RCVD_IN_DNSWL_LOW(-0.10)[17.57.155.15:from]; DWL_DNSWL_NONE(0.00)[icloud.com:dkim]; TO_MATCH_ENVRCPT_SOME(0.00)[]; ARC_NA(0.00)[]; MLMMJ_DEST(0.00)[freebsd-hackers@freebsd.org]; TO_DN_EQ_ADDR_SOME(0.00)[]; MIME_TRACE(0.00)[0:+,1:+,2:~]; FREEMAIL_ENVFROM(0.00)[icloud.com]; FREEMAIL_FROM(0.00)[icloud.com]; TO_DN_SOME(0.00)[]; RCVD_VIA_SMTP_AUTH(0.00)[]; ASN(0.00)[asn:714, ipnet:17.57.155.0/24, country:US]; DKIM_TRACE(0.00)[icloud.com:+]; RCVD_COUNT_ONE(0.00)[1]; RCPT_COUNT_TWO(0.00)[2]; FROM_EQ_ENVFROM(0.00)[]; RCVD_TLS_ALL(0.00)[] X-Rspamd-Queue-Id: 4S9L6753wcz3N4Y --_000_AM6PR02MB4471C1516952D8DCE423C9E7A5D5AAM6PR02MB4471eurp_ Content-Type: text/plain; charset="utf-8" Content-Transfer-Encoding: base64 SGV5IFdhcm5lciwNCnRoYW5rcyBmb3IgdGhlIHRvb2wuIEkndmUgYmVlbiBhYmxlIHRvIGluc3Rh bGwgTGludXggb24gdGhlIG1hY2hpbmUgKHdoZW4gcGFydGl0aW9uaW5nIGp1c3QgcHV0IHRoZSAv Ym9vdCBvbiB0aGUgZmxhc2ggY2FyZCBhbmQgZXZlcnl0aGluZyB3aGVuIHZlcnkgZWFzeSkgYW5k IHN0YXJ0ZWQgdGhlIHRvb2wuIElmIEknbSB1bmRlcnN0YW5kaW5nIGNvcnJlY3RseSBpdCBoYXMg QklPUyBhbmQgRUZJIGZsYXNoOg0KX19fX19fX19fX19fX19fX19fXw0KU29mdHdhcmUgVmVyc2lv biBJbmZvcm1hdGlvbg0KLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLQ0KQ3VycmVudCBhY3Rp dmUgZmlybXdhcmUgdmVyc2lvbiBpcyAwYjAwMDAwMCAoMTEuMDAuMDApDQpGaXJtd2FyZSBpbWFn ZSdzIHZlcnNpb24gaXMgTVBURlctMTEuMDAuMDAuMDAtSVQNCiAgTFNJIExvZ2ljDQogIE5vdCBQ YWNrYWdlZCBZZXQNCng4NiBCSU9TIGltYWdlJ3MgdmVyc2lvbiBpcyBNUFQyQklPUy03LjExLjAw LjAwICgyMDEwLjA3LjI5KQ0KRUZJIEJJT1MgaW1hZ2UncyB2ZXJzaW9uIGlzIDcuMDAuMDAuMDEN Cl9fX19fX19fX19fX19fX19fX18NCg0KSG93ZXZlciwgdGhlICJCSU9TIiBvZiB0aGUgbWFjaGlu ZSBkb2VzIG5vdCBwcm92aWRlIHRoZSBvcHRpb24gdG8gYm9vdCBmcm9tIHRoZSBjb250cm9sbGVy IGFuZC9vciBpbmNsdWRlIGl0IGluIHRoZSBib290IG9yZGVyLiBJcyB0aGVyZSBzb21lIG9wdGlv biBpbiB0aGUgbHNpdXRpbCB0aGF0IEkgbmVlZCB0byB1c2UgdG8gImZvcmNlIiB0aGUgYm9vdCBv cHRpb24gZm9yIHRoZSBjb250cm9sbGVyPw0KDQoNCl9fX19fX19fX19fX19fX19fX19fX19fX19f X19fX19fDQpGcm9tOiBvd25lci1mcmVlYnNkLWhhY2tlcnNAZnJlZWJzZC5vcmcgPG93bmVyLWZy ZWVic2QtaGFja2Vyc0BmcmVlYnNkLm9yZz4gb24gYmVoYWxmIG9mIFdhcm5lciBMb3NoIDxpbXBA YnNkaW1wLmNvbT4NClNlbnQ6IFdlZG5lc2RheSwgT2N0b2JlciAxMSwgMjAyMyAxODo0NA0KVG86 IGF6YXRoYW5haUBpY2xvdWQuY29tIDxhemF0aGFuYWlAaWNsb3VkLmNvbT4NCkNjOiBmcmVlYnNk LWhhY2tlcnNARnJlZUJTRC5vcmcgPGZyZWVic2QtaGFja2Vyc0BmcmVlYnNkLm9yZz4NClN1Ympl Y3Q6IFJlOiBRdWVzdGlvbiBvZiBpbnN0YWxsaW5nIG92ZXIgU0FTIGNvbnRyb2xsZXIgYW5kIFVT QiBmbGFzaA0KDQpUaGVyZSdzIG5vdCBhIEZyZWVCU0QgcG9ydC9wa2cgZm9yIGxzaXV0aWwsIGJ1 dCBJJ3ZlZCB1c2VkIGl0IGF0ICRXT1JLIGZvciB0aGluZ3MuDQoNCmh0dHBzOi8vZ2l0aHViLmNv bS90aG9tYXNsb3ZlbGwvTFNJVXRpbA0KDQpoYXMgYW4gYXJjaGl2ZSBvZiBzb3VyY2VzLiBJJ3Zl IG5vdCB1c2VkIHRoaXMgYXQgYWxsLCBhbmQgaXQgaGFzbid0IGJlZW4gcG9ydGVkIHRvIEZyZWVC U0QgaW4gdGhpcyByZXBvLg0KQnV0IEkga25vdyBpdCBhbGxvd3Mgb25lIHRvIHR1cm4gb24vb2Zm IHRoZSBQT1NUIC8gQklPUyBpbiB0aGUgY2FyZCwgd2hpY2ggaXMgd2hhdCB5b3UgbmVlZC4gIEl0 IHJ1bnMNCnVuZGVyIExpbnV4IGZvciBzdXJlIChhZ2FpbiwgZG9uJ3Qga25vdyB3aGF0IHBhY2th Z2VzIGFyZSBhdmFpbGFibGUgdGhlcmUpLiBJIGRvbid0IHRoaW5rIEkgY2FuIHNoYXJlDQp3aGF0 IEkgaGF2ZSBmb3IgJFdPUksgd2l0aCB0aGUgcHVibGljIHNpbmNlIEkgdGhpbmsgd2UgZ290IGl0 IGluIGEgd2F5IHRoYXQgZG9lc24ndCBsZXQgbWUgZGlzY2xvc2UgdGhlDQpzb3VyY2VzLg0KDQpP bmUgbWlnaHQgYWxzbyBiZSBhYmxlIG1vdmUgdGhlIGNvZGUgbHNpdXRpbCB0aGF0IGVuYWJsZXMg aXQgdG8gbXBzdXRpbC4gSXQncyBnb2luZyB0byBiZSBzZW5kaW5nIGEgcmF3DQpjb21tYW5kIHRv IHRoZSBkZXZpY2UuIEl0IHNob3VsZG4ndCBiZSB0b28gaGFyZC4uLi4NCg0KV2FybmVyDQoNCk9u IFdlZCwgT2N0IDExLCAyMDIzIGF0IDY6MDLigK9BTSBhemF0aGFuYWlAaWNsb3VkLmNvbTxtYWls dG86YXphdGhhbmFpQGljbG91ZC5jb20+IDxhemF0aGFuYWlAaWNsb3VkLmNvbTxtYWlsdG86YXph dGhhbmFpQGljbG91ZC5jb20+PiB3cm90ZToNCkhleSBXYXJuZXIsDQp0aGUgYm94IGlzIHZlcnkg ZmVhdHVyZUxFU1MgKGFuIG9sZCBYeXJhdGV4IEhTLTEyMzVUIGJveCwgYXMgZmFyIGFzIEkgcmVz ZWFyY2hlZCBpdCkuDQpUMjAyOV9RUiB2MS4zLmFpIChoYWNrc3BhY2Uub3JnLnVrKTxodHRwczov L3dpa2kubG9uZG9uLmhhY2tzcGFjZS5vcmcudWsvdy9pbWFnZXMvYi9iMi9IUy0xMjM1VC1BVFhf UXVpY2tfUmVmZXJlbmNlX1NoZWV0LnBkZj4NCig1KSBYeXJhdGV4IDA5NDQwMzctMDMgTW90aGVy Ym9hcmQgTXlzdGVyeSBTT0xWRUQgOiBob21lbGFiIChyZWRkaXQuY29tKTxodHRwczovL3d3dy5y ZWRkaXQuY29tL3IvaG9tZWxhYi9jb21tZW50cy84bG9nZTYveHlyYXRleF8wOTQ0MDM3MDNfbW90 aGVyYm9hcmRfbXlzdGVyeV9zb2x2ZWQvPg0KDQpUaHJvdWdoIHRoZSBQT1NUIHByb2Nlc3MgYW5k IHRoZSBCSU9TIHRoZXJlIGlzIG5vIG9wdGlvbiB0byBnZXQgaW50byB0aGUgU0FTIGNvbnRyb2xs ZXIgYW5kIGVuYWJsZSBpdHMgQklPUy4gSSB3b3VsZCBsb3ZlIHRvIGluc3RhbGwgRnJlZUJTRCBk aXJlY3RseSBvbiB0aGUgZHJpdmVzIGFuZCBub3QgdG8gZGVhbCB3aXRoIHRoZSBmbGFzaCBjYXJk LCBidXQgSSBzdXBwb3NlIHRoZSBsYWNrIG9mIGNvbnRyb2xsZXIgQklPUyBpcyB0aGUgcmVhc29u IHRoZSBib3ggY29tZXMgd2l0aCByZWFkZXIgYW5kIGNhcmQgZGlyZWN0bHkuDQoNCkFzIEknbSBu ZXcgdG8gRnJlZUJTRCBhbmQgWkZTIEknbSBzdHJ1Z2dsaW5nIHRvIHNldCB1cCB0aGUgcGFydGl0 aW9uaW5nLiBJIHdhcyB0aGlua2luZyB0bzoNCg0KICAxLiAgUGFydGl0aW9uIHRoZSBlbnRpcmUg RkxBU0ggY2FyZCAoNGdpZ3MpIG9uIE1CUiB3aXRoIGZyZWVic2QtdWZzIGFuZCBtb3VudCAvYm9v dC4gQXMgSSd2ZSByZWFkIHRoZXJlIHNob3VsZCBub3QgYmUgRVNQIChlZmkpIHBhcnRpdGlvbiBh cyB0aGlzIGlzIGZsYXNoLCB0aHVzIE1CUiwgd2hpY2ggaXMgImxlZ2FjeSIgYW5kIHdpdGhvdXQg RVNQLg0KICAyLiAgUGFydGl0aW9uIG9uZSBvZiB0aGUgZHJpdmVzICgzdGVyYSkgd2l0aCBHUFQs IGZyZWVic2QtemZzIHN0cmlwZSBhbmQgbW91bnQgLw0KICAzLiAgV2hlbiB0aGUgc3lzdGVtIGlz IHVwIGFuZCBydW5uaW5nLCBhZGQgdGhlIHJlc3Qgb2YgdGhlIGRyaXZlcyAoMTEgbW9yZSkgdG8g dGhlIHBvb2wgYW5kIGNoYW5nZSB0aGUgcG9vbCB0byBSQUlEWjIuIEhvd2V2ZXIgSSdtIG5vdCBz dXJlIHRoaXMgaXMgcG9zc2libGUsIHRvIGNoYW5nZSB0aGUgdHlwZSBvZiB0aGUgcG9vbCB3aXRo b3V0IGVyYXNpbmcgZXZlcnl0aGluZy4gTG9naWNhbCB0aGlua2luZyBzYXlzIGl0IGlzIG5vdCBw b3NzaWJsZS4NCiAgNC4gIEFmdGVyIGFsbCBvZiB0aGVzZSBjb21lcyB0aGUgbW91bnRpbmcgb2Yg ZmlsZXN5c3RlbXMgYW5kIGNyZWF0aW5nIGZzdGFiIHRvIGNvbnRpbnVlIHRoZSBpbnN0YWxsYXRp b24sIHdoaWNoIGlzIGZ1bGwgZGFya25lc3MgYXQgdGhlIG1vbWVudCwgYXMgSSdtIHN0aWxsIHN0 cnVnZ2xpbmcgd2l0aCB0aGUgaW5pdGlhbCBzdGFydCBhbmQgbm90IGhhdmUgcmVhZCBhbnl0aGlu ZyBvbiB0aGF0Lg0KDQpBbGwgb2YgdGhlc2Ugc2hvdWxkIGJlIGRvbmUgaW4gc2hlbGwgd2l0aCB0 aGUgZ3BhcnQgdXRpbGl0eSBkdXJpbmcgaW5zdGFsbCBhbmQgSSBjYW5ub3QgZmlndXJlIG91dCwg aG93IHRvIG1ha2UgcG9pbnRzIDIgYW5kIDMgb24gb25lIGdvIGhhdmluZyBkaXJlY3RseSB0aGUg UkFJRFoyLg0KDQoNCl9fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fDQpGcm9tOiBvd25l ci1mcmVlYnNkLWhhY2tlcnNAZnJlZWJzZC5vcmc8bWFpbHRvOm93bmVyLWZyZWVic2QtaGFja2Vy c0BmcmVlYnNkLm9yZz4gPG93bmVyLWZyZWVic2QtaGFja2Vyc0BmcmVlYnNkLm9yZzxtYWlsdG86 b3duZXItZnJlZWJzZC1oYWNrZXJzQGZyZWVic2Qub3JnPj4gb24gYmVoYWxmIG9mIFdhcm5lciBM b3NoIDxpbXBAYnNkaW1wLmNvbTxtYWlsdG86aW1wQGJzZGltcC5jb20+Pg0KU2VudDogV2VkbmVz ZGF5LCBPY3RvYmVyIDExLCAyMDIzIDAwOjIwDQpUbzogYXphdGhhbmFpQGljbG91ZC5jb208bWFp bHRvOmF6YXRoYW5haUBpY2xvdWQuY29tPiA8YXphdGhhbmFpQGljbG91ZC5jb208bWFpbHRvOmF6 YXRoYW5haUBpY2xvdWQuY29tPj4NCkNjOiBmcmVlYnNkLWhhY2tlcnNARnJlZUJTRC5vcmcgPGZy ZWVic2QtaGFja2Vyc0BmcmVlYnNkLm9yZzxtYWlsdG86ZnJlZWJzZC1oYWNrZXJzQGZyZWVic2Qu b3JnPj4NClN1YmplY3Q6IFJlOiBRdWVzdGlvbiBvZiBpbnN0YWxsaW5nIG92ZXIgU0FTIGNvbnRy b2xsZXIgYW5kIFVTQiBmbGFzaA0KDQoNCg0KT24gVHVlLCBPY3QgMTAsIDIwMjMgYXQgMjozNuKA r1BNIGF6YXRoYW5haUBpY2xvdWQuY29tPG1haWx0bzphemF0aGFuYWlAaWNsb3VkLmNvbT4gPGF6 YXRoYW5haUBpY2xvdWQuY29tPG1haWx0bzphemF0aGFuYWlAaWNsb3VkLmNvbT4+IHdyb3RlOg0K SGkgYWxsLA0KYSBuZXdiaWUgaW4gRnJlZUJTRCBoZXJlIHRyeWluZyB0byBpbnN0YWxsIGEgUkFJ RFoyIG9uIGEgc2VydmVyIHdpdGggbXBzIFNBUyBjb250cm9sbGVyIHdpdGggZHJpdmVzIHdoaWNo IGFyZSBub3QgdmlzaWJsZSBpbiB0aGUgYm9vdCBvcmRlciBpbiBCSU9TLg0KU28sIEkgY2Fubm90 IGluc3RhbGwgZGlyZWN0bHkgb24gdGhlIGRyaXZlcywgZGVzcGl0ZSB0aGF0IHRoZSBpbnN0YWxs ZXIgInNlZXMiIHRoZW0sIGJlY2F1c2UgdGhlIEJJT1MgZG9lcyBub3Qgc2VlIHRoZSBjb250cm9s bGVyIGFuZCBpdHMgZHJpdmVzIGFzIG9wdGlvbi4NCg0KSGF2ZSB5b3UgZW5hYmxlZCB0aGUgQklP UyBvbiB0aGUgbXBzIGNhcmQgaXRzZWxmPyBPdGhlcndpc2UgaXQgd29uJ3QgaW5zdGFsbCBhIEJJ T1MgZnJhZ21lbnQgdG8gcnVuIGF0IGJvb3QsIGFuZCB0aGUgZHJpdmVzIHdvbid0IGJlIHNlZW4u DQoNCk9uIHRoZSBvdGhlciBoYW5kLCBJIGhhdmUgYSBjYXJkIHJlYWRlciB3aXRoIGEgZmxhc2gg Y2FyZCBvbiBpdCAoNGdpZ3MpIGZyb20gd2hpY2ggSSBjYW4gYm9vdCBhbmQgd2hlcmUgSSBjYW4g aGF2ZSBteSAvYm9vdCBwYXJ0aXRpb24gd2l0aCB0aGUga2VybmVsLg0KSSd2ZSBhIGxvdCBvZiBx dWVzdGlvbnMgYW5kIEkgc3RpbGwgY2Fubm90IGZpbmQgdGhlIGFuc3dlcnMgdG8gbW9zdCBvZiB0 aGVtLCBkZXNwaXRlIGdvaW5nIHRocm91Z2ggdGhlIGhhbmRib29rLCB0aGUgYm9vdCBwcm9jZXNz IGV4cGxhbmF0aW9uLCB0aGUgaW5zdGFsbGF0aW9uIHByb2Nlc3MgaGFuZGJvb2sgYW5kIGEgbG90 IG9mIG1vcmUgcmVhZGluZy4NCg0KDQogICogICBIb3cgc2hvdWxkIHRoZSBmbGFzaCBjYXJkIGJl IHBhcnRpdGlvbmVkIGFuZCB3aXRoIHdoYXQgbW91bnRwb2ludHM/IFRoZSBzZXJ2ZXIgaXMgQklP UyBjYXBhYmxlLg0KICAqICAgSG93IHNob3VsZCB0aGUgcmVzdCBvZiB0aGUgZHJpdmVzIGJlIHBh cnRpdGlvbmVkIHdpdGggWkZTIGFuZCB0aGUgbW91bnRwb2ludHM/IFRoZSBzdGFuZGFyZCBjb25m aWd1cmF0aW9uIGZyb20gdGhlIGluc3RhbGxlciBvbiBSQUlEWjIgaXMgZ29vZCBmb3IgbWUuDQoN CkkndmUgZXhwZXJpZW5jZSB3aXRoIExpbnV4IGJ1dCBpcyBub3QgaGVscGluZyBhIGxvdCBoZXJl LiBUaGUgc2V0dXAgbG9va3MgcXVpdGUgZGlmZmVyZW50IC4uLi4gcHJvYmFibHkgYmVjYXVzZSBv ZiB0aGUgWkZTLg0KDQpBbnkgaGVscCwgbGlua3MsIGlkZWFzIGFuZCBjb21tZW50cyB3aWxsIGJl IG11Y2ggYXBwcmVjaWF0ZWQhDQoNClRoYXQncyBhIHdvcmthcm91bmQsIGJ1dCB5b3Ugc2hvdWxk IGJlIGFibGUgdG8gZW5hYmxlIHRoZSBCSU9TIHBhcnQgb2YgdGhlIG1wcy9tcHIgY2FyZHMgYW5k IGJvb3Qgb2ZmIHRoZW0uIEkndmUgZG9uZSB0aGF0IGJlZm9yZS4NCg0KV2FybmVyDQoNCg0KQ3li ZXJseSB5b3VycywNCmRlcmFnb3RoDQoNCg0K --_000_AM6PR02MB4471C1516952D8DCE423C9E7A5D5AAM6PR02MB4471eurp_ Content-Type: text/html; charset="utf-8" Content-Transfer-Encoding: base64 PGh0bWw+DQo8aGVhZD4NCjxtZXRhIGh0dHAtZXF1aXY9IkNvbnRlbnQtVHlwZSIgY29udGVudD0i dGV4dC9odG1sOyBjaGFyc2V0PXV0Zi04Ij4NCjxzdHlsZSB0eXBlPSJ0ZXh0L2NzcyIgc3R5bGU9 ImRpc3BsYXk6bm9uZTsiPiBQIHttYXJnaW4tdG9wOjA7bWFyZ2luLWJvdHRvbTowO30gPC9zdHls ZT4NCjwvaGVhZD4NCjxib2R5IGRpcj0ibHRyIj4NCjxkaXYgY2xhc3M9ImVsZW1lbnRUb1Byb29m IiBzdHlsZT0iZm9udC1mYW1pbHk6IEFwdG9zLCBBcHRvc19FbWJlZGRlZEZvbnQsIEFwdG9zX01T Rm9udFNlcnZpY2UsIENhbGlicmksIEhlbHZldGljYSwgc2Fucy1zZXJpZjsgZm9udC1zaXplOiAx MnB0OyBjb2xvcjogcmdiKDAsIDAsIDApOyI+DQpIZXkgV2FybmVyLDwvZGl2Pg0KPGRpdiBjbGFz cz0iZWxlbWVudFRvUHJvb2YiIHN0eWxlPSJmb250LWZhbWlseTogQXB0b3MsIEFwdG9zX0VtYmVk ZGVkRm9udCwgQXB0b3NfTVNGb250U2VydmljZSwgQ2FsaWJyaSwgSGVsdmV0aWNhLCBzYW5zLXNl cmlmOyBmb250LXNpemU6IDEycHQ7IGNvbG9yOiByZ2IoMCwgMCwgMCk7Ij4NCnRoYW5rcyBmb3Ig dGhlIHRvb2wuIEkndmUgYmVlbiBhYmxlIHRvIGluc3RhbGwgTGludXggb24gdGhlIG1hY2hpbmUg KHdoZW4gcGFydGl0aW9uaW5nIGp1c3QgcHV0IHRoZSAvYm9vdCBvbiB0aGUgZmxhc2ggY2FyZCBh bmQgZXZlcnl0aGluZyB3aGVuIHZlcnkgZWFzeSkgYW5kIHN0YXJ0ZWQgdGhlIHRvb2wuIElmIEkn bSB1bmRlcnN0YW5kaW5nJm5ic3A7Y29ycmVjdGx5IGl0IGhhcyBCSU9TIGFuZCBFRkkgZmxhc2g6 PC9kaXY+DQo8ZGl2IGNsYXNzPSJlbGVtZW50VG9Qcm9vZiI+PHNwYW4gc3R5bGU9ImZvbnQtZmFt aWx5OiBBcHRvcywgQXB0b3NfRW1iZWRkZWRGb250LCBBcHRvc19NU0ZvbnRTZXJ2aWNlLCBDYWxp YnJpLCBIZWx2ZXRpY2EsIHNhbnMtc2VyaWY7IGZvbnQtc2l6ZTogMTJwdDsgY29sb3I6IHJnYigw LCAwLCAwKTsiPl9fX19fX19fX19fX19fX19fX188L3NwYW4+PC9kaXY+DQo8ZGl2IGNsYXNzPSJl bGVtZW50VG9Qcm9vZiI+PHNwYW4gc3R5bGU9ImZvbnQtZmFtaWx5OiBBcHRvcywgQXB0b3NfRW1i ZWRkZWRGb250LCBBcHRvc19NU0ZvbnRTZXJ2aWNlLCBDYWxpYnJpLCBIZWx2ZXRpY2EsIHNhbnMt c2VyaWY7IGZvbnQtc2l6ZTogMTJwdDsgY29sb3I6IHJnYigwLCAwLCAwKTsiPlNvZnR3YXJlIFZl cnNpb24gSW5mb3JtYXRpb248L3NwYW4+PC9kaXY+DQo8ZGl2IGNsYXNzPSJlbGVtZW50VG9Qcm9v ZiI+PHNwYW4gc3R5bGU9ImZvbnQtZmFtaWx5OiBBcHRvcywgQXB0b3NfRW1iZWRkZWRGb250LCBB cHRvc19NU0ZvbnRTZXJ2aWNlLCBDYWxpYnJpLCBIZWx2ZXRpY2EsIHNhbnMtc2VyaWY7IGZvbnQt c2l6ZTogMTJwdDsgY29sb3I6IHJnYigwLCAwLCAwKTsiPi0tLS0tLS0tLS0tLS0tLS0tLS0tLS0t LS0tLS08L3NwYW4+PC9kaXY+DQo8ZGl2PjxzcGFuIHN0eWxlPSJmb250LWZhbWlseTogQXB0b3Ms IEFwdG9zX0VtYmVkZGVkRm9udCwgQXB0b3NfTVNGb250U2VydmljZSwgQ2FsaWJyaSwgSGVsdmV0 aWNhLCBzYW5zLXNlcmlmOyBmb250LXNpemU6IDEycHQ7IGNvbG9yOiByZ2IoMCwgMCwgMCk7Ij5D dXJyZW50IGFjdGl2ZSBmaXJtd2FyZSB2ZXJzaW9uIGlzIDBiMDAwMDAwICgxMS4wMC4wMCk8L3Nw YW4+PC9kaXY+DQo8ZGl2PjxzcGFuIHN0eWxlPSJmb250LWZhbWlseTogQXB0b3MsIEFwdG9zX0Vt YmVkZGVkRm9udCwgQXB0b3NfTVNGb250U2VydmljZSwgQ2FsaWJyaSwgSGVsdmV0aWNhLCBzYW5z LXNlcmlmOyBmb250LXNpemU6IDEycHQ7IGNvbG9yOiByZ2IoMCwgMCwgMCk7Ij5GaXJtd2FyZSBp bWFnZSdzIHZlcnNpb24gaXMgTVBURlctMTEuMDAuMDAuMDAtSVQ8L3NwYW4+PC9kaXY+DQo8ZGl2 PjxzcGFuIHN0eWxlPSJmb250LWZhbWlseTogQXB0b3MsIEFwdG9zX0VtYmVkZGVkRm9udCwgQXB0 b3NfTVNGb250U2VydmljZSwgQ2FsaWJyaSwgSGVsdmV0aWNhLCBzYW5zLXNlcmlmOyBmb250LXNp emU6IDEycHQ7IGNvbG9yOiByZ2IoMCwgMCwgMCk7Ij4mbmJzcDsgTFNJIExvZ2ljPC9zcGFuPjwv ZGl2Pg0KPGRpdj48c3BhbiBzdHlsZT0iZm9udC1mYW1pbHk6IEFwdG9zLCBBcHRvc19FbWJlZGRl ZEZvbnQsIEFwdG9zX01TRm9udFNlcnZpY2UsIENhbGlicmksIEhlbHZldGljYSwgc2Fucy1zZXJp ZjsgZm9udC1zaXplOiAxMnB0OyBjb2xvcjogcmdiKDAsIDAsIDApOyI+Jm5ic3A7IE5vdCBQYWNr YWdlZCBZZXQ8L3NwYW4+PC9kaXY+DQo8ZGl2IGNsYXNzPSJlbGVtZW50VG9Qcm9vZiI+PHNwYW4g c3R5bGU9ImZvbnQtZmFtaWx5OiBBcHRvcywgQXB0b3NfRW1iZWRkZWRGb250LCBBcHRvc19NU0Zv bnRTZXJ2aWNlLCBDYWxpYnJpLCBIZWx2ZXRpY2EsIHNhbnMtc2VyaWY7IGZvbnQtc2l6ZTogMTJw dDsgY29sb3I6IHJnYigwLCAwLCAwKTsiPng4NiBCSU9TIGltYWdlJ3MgdmVyc2lvbiBpcyBNUFQy QklPUy03LjExLjAwLjAwICgyMDEwLjA3LjI5KTwvc3Bhbj48L2Rpdj4NCjxkaXYgY2xhc3M9ImVs ZW1lbnRUb1Byb29mIj48c3BhbiBzdHlsZT0iZm9udC1mYW1pbHk6IEFwdG9zLCBBcHRvc19FbWJl ZGRlZEZvbnQsIEFwdG9zX01TRm9udFNlcnZpY2UsIENhbGlicmksIEhlbHZldGljYSwgc2Fucy1z ZXJpZjsgZm9udC1zaXplOiAxMnB0OyBjb2xvcjogcmdiKDAsIDAsIDApOyI+RUZJIEJJT1MgaW1h Z2UncyB2ZXJzaW9uIGlzIDcuMDAuMDAuMDE8L3NwYW4+PC9kaXY+DQo8ZGl2IGNsYXNzPSJlbGVt ZW50VG9Qcm9vZiI+PHNwYW4gc3R5bGU9ImxldHRlci1zcGFjaW5nOiBub3JtYWw7IGZvbnQtZmFt aWx5OiBBcHRvcywgQXB0b3NfRW1iZWRkZWRGb250LCBBcHRvc19NU0ZvbnRTZXJ2aWNlLCBDYWxp YnJpLCBIZWx2ZXRpY2EsIHNhbnMtc2VyaWY7IGZvbnQtc2l6ZTogMTZweDsgZm9udC13ZWlnaHQ6 IDQwMDsgY29sb3I6IHJnYigwLCAwLCAwKTsgYmFja2dyb3VuZC1jb2xvcjogcmdiKDI1NSwgMjU1 LCAyNTUpOyI+X19fX19fX19fX19fX19fX19fXzwvc3Bhbj48L2Rpdj4NCjxkaXYgY2xhc3M9ImVs ZW1lbnRUb1Byb29mIj48c3BhbiBzdHlsZT0ibGV0dGVyLXNwYWNpbmc6IG5vcm1hbDsgZm9udC1m YW1pbHk6IEFwdG9zLCBBcHRvc19FbWJlZGRlZEZvbnQsIEFwdG9zX01TRm9udFNlcnZpY2UsIENh bGlicmksIEhlbHZldGljYSwgc2Fucy1zZXJpZjsgZm9udC1zaXplOiAxNnB4OyBmb250LXdlaWdo dDogNDAwOyBjb2xvcjogcmdiKDAsIDAsIDApOyBiYWNrZ3JvdW5kLWNvbG9yOiByZ2IoMjU1LCAy NTUsIDI1NSk7Ij48YnI+DQo8L3NwYW4+PC9kaXY+DQo8ZGl2IGNsYXNzPSJlbGVtZW50VG9Qcm9v ZiI+PHNwYW4gc3R5bGU9ImxldHRlci1zcGFjaW5nOiBub3JtYWw7IGZvbnQtZmFtaWx5OiBBcHRv cywgQXB0b3NfRW1iZWRkZWRGb250LCBBcHRvc19NU0ZvbnRTZXJ2aWNlLCBDYWxpYnJpLCBIZWx2 ZXRpY2EsIHNhbnMtc2VyaWY7IGZvbnQtc2l6ZTogMTZweDsgZm9udC13ZWlnaHQ6IDQwMDsgY29s b3I6IHJnYigwLCAwLCAwKTsgYmFja2dyb3VuZC1jb2xvcjogcmdiKDI1NSwgMjU1LCAyNTUpOyI+ SG93ZXZlciwNCiB0aGUgJnF1b3Q7QklPUyZxdW90OyBvZiB0aGUgbWFjaGluZSBkb2VzIG5vdCBw cm92aWRlIHRoZSBvcHRpb24gdG8gYm9vdCBmcm9tIHRoZSBjb250cm9sbGVyIGFuZC9vciBpbmNs dWRlIGl0IGluIHRoZSBib290IG9yZGVyLiBJcyB0aGVyZSBzb21lIG9wdGlvbiBpbiB0aGUgbHNp dXRpbCB0aGF0IEkgbmVlZCB0byB1c2UgdG8gJnF1b3Q7Zm9yY2UmcXVvdDsgdGhlIGJvb3Qgb3B0 aW9uIGZvciB0aGUgY29udHJvbGxlcj88L3NwYW4+PC9kaXY+DQo8ZGl2IGNsYXNzPSJlbGVtZW50 VG9Qcm9vZiI+PHNwYW4gc3R5bGU9ImxldHRlci1zcGFjaW5nOiBub3JtYWw7IGZvbnQtZmFtaWx5 OiBBcHRvcywgQXB0b3NfRW1iZWRkZWRGb250LCBBcHRvc19NU0ZvbnRTZXJ2aWNlLCBDYWxpYnJp LCBIZWx2ZXRpY2EsIHNhbnMtc2VyaWY7IGZvbnQtc2l6ZTogMTZweDsgZm9udC13ZWlnaHQ6IDQw MDsgY29sb3I6IHJnYigwLCAwLCAwKTsgYmFja2dyb3VuZC1jb2xvcjogcmdiKDI1NSwgMjU1LCAy NTUpOyI+PGJyPg0KPC9zcGFuPjwvZGl2Pg0KPGRpdiBjbGFzcz0iZWxlbWVudFRvUHJvb2YiPjxz cGFuIHN0eWxlPSJsZXR0ZXItc3BhY2luZzogbm9ybWFsOyBmb250LWZhbWlseTogQXB0b3MsIEFw dG9zX0VtYmVkZGVkRm9udCwgQXB0b3NfTVNGb250U2VydmljZSwgQ2FsaWJyaSwgSGVsdmV0aWNh LCBzYW5zLXNlcmlmOyBmb250LXNpemU6IDE2cHg7IGZvbnQtd2VpZ2h0OiA0MDA7IGNvbG9yOiBy Z2IoMCwgMCwgMCk7IGJhY2tncm91bmQtY29sb3I6IHJnYigyNTUsIDI1NSwgMjU1KTsiPiZuYnNw Ozwvc3Bhbj48L2Rpdj4NCjxkaXYgaWQ9ImFwcGVuZG9uc2VuZCI+PC9kaXY+DQo8aHIgc3R5bGU9 ImRpc3BsYXk6aW5saW5lLWJsb2NrO3dpZHRoOjk4JSIgdGFiaW5kZXg9Ii0xIj4NCjxkaXYgaWQ9 ImRpdlJwbHlGd2RNc2ciIGRpcj0ibHRyIj48Zm9udCBmYWNlPSJDYWxpYnJpLCBzYW5zLXNlcmlm IiBzdHlsZT0iZm9udC1zaXplOjExcHQiIGNvbG9yPSIjMDAwMDAwIj48Yj5Gcm9tOjwvYj4gb3du ZXItZnJlZWJzZC1oYWNrZXJzQGZyZWVic2Qub3JnICZsdDtvd25lci1mcmVlYnNkLWhhY2tlcnNA ZnJlZWJzZC5vcmcmZ3Q7IG9uIGJlaGFsZiBvZiBXYXJuZXIgTG9zaCAmbHQ7aW1wQGJzZGltcC5j b20mZ3Q7PGJyPg0KPGI+U2VudDo8L2I+IFdlZG5lc2RheSwgT2N0b2JlciAxMSwgMjAyMyAxODo0 NDxicj4NCjxiPlRvOjwvYj4gYXphdGhhbmFpQGljbG91ZC5jb20gJmx0O2F6YXRoYW5haUBpY2xv dWQuY29tJmd0Ozxicj4NCjxiPkNjOjwvYj4gZnJlZWJzZC1oYWNrZXJzQEZyZWVCU0Qub3JnICZs dDtmcmVlYnNkLWhhY2tlcnNAZnJlZWJzZC5vcmcmZ3Q7PGJyPg0KPGI+U3ViamVjdDo8L2I+IFJl OiBRdWVzdGlvbiBvZiBpbnN0YWxsaW5nIG92ZXIgU0FTIGNvbnRyb2xsZXIgYW5kIFVTQiBmbGFz aDwvZm9udD4NCjxkaXY+Jm5ic3A7PC9kaXY+DQo8L2Rpdj4NCjxkaXY+DQo8ZGl2IGRpcj0ibHRy Ij5UaGVyZSdzIG5vdCBhIEZyZWVCU0QgcG9ydC9wa2cgZm9yIGxzaXV0aWwsIGJ1dCBJJ3ZlZCB1 c2VkIGl0IGF0ICRXT1JLIGZvciB0aGluZ3MuDQo8ZGl2Pjxicj4NCjwvZGl2Pg0KPGRpdj48YSBo cmVmPSJodHRwczovL2dpdGh1Yi5jb20vdGhvbWFzbG92ZWxsL0xTSVV0aWwiPmh0dHBzOi8vZ2l0 aHViLmNvbS90aG9tYXNsb3ZlbGwvTFNJVXRpbDwvYT48YnI+DQo8L2Rpdj4NCjxkaXY+PGJyPg0K PC9kaXY+DQo8ZGl2PmhhcyBhbiBhcmNoaXZlIG9mIHNvdXJjZXMuIEkndmUgbm90IHVzZWQgdGhp cyBhdCBhbGwsIGFuZCBpdCBoYXNuJ3QgYmVlbiBwb3J0ZWQgdG8gRnJlZUJTRCBpbiB0aGlzIHJl cG8uPC9kaXY+DQo8ZGl2PkJ1dCBJIGtub3cgaXQgYWxsb3dzIG9uZSB0byB0dXJuIG9uL29mZiB0 aGUgUE9TVCAvIEJJT1MgaW4gdGhlIGNhcmQsIHdoaWNoIGlzIHdoYXQgeW91IG5lZWQuJm5ic3A7 IEl0IHJ1bnM8L2Rpdj4NCjxkaXY+dW5kZXIgTGludXggZm9yIHN1cmUgKGFnYWluLCBkb24ndCBr bm93IHdoYXQgcGFja2FnZXMgYXJlIGF2YWlsYWJsZSB0aGVyZSkuIEkgZG9uJ3QgdGhpbmsgSSBj YW4gc2hhcmU8L2Rpdj4NCjxkaXY+d2hhdCBJIGhhdmUgZm9yICRXT1JLIHdpdGggdGhlIHB1Ymxp YyBzaW5jZSBJIHRoaW5rIHdlIGdvdCBpdCBpbiBhIHdheSB0aGF0IGRvZXNuJ3QgbGV0IG1lIGRp c2Nsb3NlIHRoZTwvZGl2Pg0KPGRpdj5zb3VyY2VzLjwvZGl2Pg0KPGRpdj48YnI+DQo8L2Rpdj4N CjxkaXY+T25lIG1pZ2h0IGFsc28gYmUgYWJsZSBtb3ZlIHRoZSBjb2RlIGxzaXV0aWwgdGhhdCBl bmFibGVzIGl0IHRvIG1wc3V0aWwuIEl0J3MgZ29pbmcgdG8gYmUgc2VuZGluZyBhIHJhdzwvZGl2 Pg0KPGRpdj5jb21tYW5kIHRvIHRoZSBkZXZpY2UuIEl0IHNob3VsZG4ndCBiZSB0b28gaGFyZC4u Li48L2Rpdj4NCjxkaXY+PGJyPg0KPC9kaXY+DQo8ZGl2Pldhcm5lcjwvZGl2Pg0KPC9kaXY+DQo8 YnI+DQo8ZGl2IGNsYXNzPSJ4X2dtYWlsX3F1b3RlIj4NCjxkaXYgZGlyPSJsdHIiIGNsYXNzPSJ4 X2dtYWlsX2F0dHIiPk9uIFdlZCwgT2N0IDExLCAyMDIzIGF0IDY6MDLigK9BTSA8YSBocmVmPSJt YWlsdG86YXphdGhhbmFpQGljbG91ZC5jb20iPg0KYXphdGhhbmFpQGljbG91ZC5jb208L2E+ICZs dDs8YSBocmVmPSJtYWlsdG86YXphdGhhbmFpQGljbG91ZC5jb20iPmF6YXRoYW5haUBpY2xvdWQu Y29tPC9hPiZndDsgd3JvdGU6PGJyPg0KPC9kaXY+DQo8YmxvY2txdW90ZSBjbGFzcz0ieF9nbWFp bF9xdW90ZSIgc3R5bGU9Im1hcmdpbjowcHggMHB4IDBweCAwLjhleDsgYm9yZGVyLWxlZnQ6MXB4 IHNvbGlkIHJnYigyMDQsMjA0LDIwNCk7IHBhZGRpbmctbGVmdDoxZXgiPg0KPGRpdiBjbGFzcz0i eF9tc2c2NDkwMjI0Nzg0NjY3MDU2NTQwIj4NCjxkaXYgZGlyPSJsdHIiPg0KPGRpdiBzdHlsZT0i Zm9udC1mYW1pbHk6QXB0b3MsQXB0b3NfRW1iZWRkZWRGb250LEFwdG9zX01TRm9udFNlcnZpY2Us Q2FsaWJyaSxIZWx2ZXRpY2Esc2Fucy1zZXJpZjsgZm9udC1zaXplOjEycHQ7IGNvbG9yOnJnYigw LDAsMCkiPg0KSGV5IFdhcm5lciw8L2Rpdj4NCjxkaXYgc3R5bGU9ImZvbnQtZmFtaWx5OkFwdG9z LEFwdG9zX0VtYmVkZGVkRm9udCxBcHRvc19NU0ZvbnRTZXJ2aWNlLENhbGlicmksSGVsdmV0aWNh LHNhbnMtc2VyaWY7IGZvbnQtc2l6ZToxMnB0OyBjb2xvcjpyZ2IoMCwwLDApIj4NCnRoZSBib3gg aXMgdmVyeSBmZWF0dXJlTEVTUyAoYW4gb2xkIFh5cmF0ZXggSFMtMTIzNVQgYm94LCBhcyBmYXIg YXMgSSByZXNlYXJjaGVkIGl0KS4mbmJzcDs8L2Rpdj4NCjxkaXYgc3R5bGU9ImZvbnQtZmFtaWx5 OkFwdG9zLEFwdG9zX0VtYmVkZGVkRm9udCxBcHRvc19NU0ZvbnRTZXJ2aWNlLENhbGlicmksSGVs dmV0aWNhLHNhbnMtc2VyaWY7IGZvbnQtc2l6ZToxMnB0OyBjb2xvcjpyZ2IoMCwwLDApIj4NCjxh IGhyZWY9Imh0dHBzOi8vd2lraS5sb25kb24uaGFja3NwYWNlLm9yZy51ay93L2ltYWdlcy9iL2Iy L0hTLTEyMzVULUFUWF9RdWlja19SZWZlcmVuY2VfU2hlZXQucGRmIiBpZD0ieF9tXzY0OTAyMjQ3 ODQ2NjcwNTY1NDBPV0FkNGRjMTViOC1iYmE1LTU2YzQtYzVkNC1iNDI4YzNjZDQ5ZWQiIHRhcmdl dD0iX2JsYW5rIj5UMjAyOV9RUiB2MS4zLmFpIChoYWNrc3BhY2Uub3JnLnVrKTwvYT48YnI+DQo8 L2Rpdj4NCjxkaXYgc3R5bGU9ImZvbnQtZmFtaWx5OkFwdG9zLEFwdG9zX0VtYmVkZGVkRm9udCxB cHRvc19NU0ZvbnRTZXJ2aWNlLENhbGlicmksSGVsdmV0aWNhLHNhbnMtc2VyaWY7IGZvbnQtc2l6 ZToxMnB0OyBjb2xvcjpyZ2IoMCwwLDApIj4NCjxhIGhyZWY9Imh0dHBzOi8vd3d3LnJlZGRpdC5j b20vci9ob21lbGFiL2NvbW1lbnRzLzhsb2dlNi94eXJhdGV4XzA5NDQwMzcwM19tb3RoZXJib2Fy ZF9teXN0ZXJ5X3NvbHZlZC8iIGlkPSJ4X21fNjQ5MDIyNDc4NDY2NzA1NjU0MExQbG5rT1dBMzY0 MTRlZmMtMzc0My1lNTE4LTA5OTEtMTM1NjYyOTExNGM1IiB0YXJnZXQ9Il9ibGFuayI+KDUpIFh5 cmF0ZXggMDk0NDAzNy0wMyBNb3RoZXJib2FyZCBNeXN0ZXJ5IFNPTFZFRCA6IGhvbWVsYWIgKHJl ZGRpdC5jb20pPC9hPjxicj4NCjwvZGl2Pg0KPGRpdiBzdHlsZT0iZm9udC1mYW1pbHk6QXB0b3Ms QXB0b3NfRW1iZWRkZWRGb250LEFwdG9zX01TRm9udFNlcnZpY2UsQ2FsaWJyaSxIZWx2ZXRpY2Es c2Fucy1zZXJpZjsgZm9udC1zaXplOjEycHQ7IGNvbG9yOnJnYigwLDAsMCkiPg0KPGJyPg0KPC9k aXY+DQo8ZGl2IHN0eWxlPSJmb250LWZhbWlseTpBcHRvcyxBcHRvc19FbWJlZGRlZEZvbnQsQXB0 b3NfTVNGb250U2VydmljZSxDYWxpYnJpLEhlbHZldGljYSxzYW5zLXNlcmlmOyBmb250LXNpemU6 MTJwdDsgY29sb3I6cmdiKDAsMCwwKSI+DQpUaHJvdWdoIHRoZSBQT1NUIHByb2Nlc3MgYW5kIHRo ZSBCSU9TIHRoZXJlIGlzIG5vIG9wdGlvbiB0byBnZXQgaW50byB0aGUgU0FTIGNvbnRyb2xsZXIg YW5kIGVuYWJsZSBpdHMgQklPUy4gSSB3b3VsZCBsb3ZlIHRvIGluc3RhbGwgRnJlZUJTRCBkaXJl Y3RseSBvbiB0aGUgZHJpdmVzIGFuZCBub3QgdG8gZGVhbCB3aXRoIHRoZSBmbGFzaCBjYXJkLCBi dXQgSSBzdXBwb3NlIHRoZSBsYWNrIG9mIGNvbnRyb2xsZXIgQklPUyBpcyB0aGUgcmVhc29uDQog dGhlIGJveCBjb21lcyB3aXRoIHJlYWRlciBhbmQgY2FyZCBkaXJlY3RseS48L2Rpdj4NCjxkaXYg c3R5bGU9ImZvbnQtZmFtaWx5OkFwdG9zLEFwdG9zX0VtYmVkZGVkRm9udCxBcHRvc19NU0ZvbnRT ZXJ2aWNlLENhbGlicmksSGVsdmV0aWNhLHNhbnMtc2VyaWY7IGZvbnQtc2l6ZToxMnB0OyBjb2xv cjpyZ2IoMCwwLDApIj4NCjxicj4NCjwvZGl2Pg0KPGRpdiBzdHlsZT0iZm9udC1mYW1pbHk6QXB0 b3MsQXB0b3NfRW1iZWRkZWRGb250LEFwdG9zX01TRm9udFNlcnZpY2UsQ2FsaWJyaSxIZWx2ZXRp Y2Esc2Fucy1zZXJpZjsgZm9udC1zaXplOjEycHQ7IGNvbG9yOnJnYigwLDAsMCkiPg0KQXMgSSdt IG5ldyB0byBGcmVlQlNEIGFuZCBaRlMgSSdtIHN0cnVnZ2xpbmcgdG8gc2V0IHVwIHRoZSBwYXJ0 aXRpb25pbmcuIEkgd2FzIHRoaW5raW5nIHRvOjwvZGl2Pg0KPGRpdiBzdHlsZT0iZm9udC1mYW1p bHk6QXB0b3MsQXB0b3NfRW1iZWRkZWRGb250LEFwdG9zX01TRm9udFNlcnZpY2UsQ2FsaWJyaSxI ZWx2ZXRpY2Esc2Fucy1zZXJpZjsgZm9udC1zaXplOjEycHQ7IGNvbG9yOnJnYigwLDAsMCkiPg0K PG9sPg0KPGxpIHN0eWxlPSJsaXN0LXN0eWxlLXR5cGU6JnF1b3Q7MS4gJnF1b3Q7Ij48c3Bhbj5Q YXJ0aXRpb24gdGhlIGVudGlyZSBGTEFTSCBjYXJkICg0Z2lncykgb24gTUJSIHdpdGggZnJlZWJz ZC11ZnMgYW5kIG1vdW50IC9ib290LiBBcyBJJ3ZlIHJlYWQgdGhlcmUgc2hvdWxkIG5vdCBiZSBF U1AgKGVmaSkgcGFydGl0aW9uIGFzIHRoaXMgaXMgZmxhc2gsIHRodXMgTUJSLCB3aGljaCBpcyAm cXVvdDtsZWdhY3kmcXVvdDsgYW5kIHdpdGhvdXQgRVNQLjwvc3Bhbj48L2xpPjxsaSBzdHlsZT0i bGlzdC1zdHlsZS10eXBlOiZxdW90OzIuICZxdW90OyI+PHNwYW4+UGFydGl0aW9uIG9uZSBvZiB0 aGUgZHJpdmVzICgzdGVyYSkgd2l0aCBHUFQsIGZyZWVic2QtemZzIHN0cmlwZSBhbmQgbW91bnQg Lzwvc3Bhbj48L2xpPjxsaSBzdHlsZT0ibGlzdC1zdHlsZS10eXBlOiZxdW90OzMuICZxdW90OyI+ PHNwYW4+V2hlbiB0aGUgc3lzdGVtIGlzIHVwIGFuZCZuYnNwO3J1bm5pbmcsIGFkZCB0aGUgcmVz dCBvZiB0aGUgZHJpdmVzICgxMSBtb3JlKSB0byB0aGUgcG9vbCBhbmQgY2hhbmdlIHRoZSBwb29s IHRvIFJBSURaMi4gSG93ZXZlciBJJ20gbm90IHN1cmUgdGhpcyBpcyBwb3NzaWJsZSwgdG8gY2hh bmdlIHRoZSB0eXBlIG9mIHRoZSBwb29sIHdpdGhvdXQgZXJhc2luZyBldmVyeXRoaW5nLiBMb2dp Y2FsDQogdGhpbmtpbmcgc2F5cyBpdCBpcyBub3QgcG9zc2libGUuPC9zcGFuPjwvbGk+PGxpIHN0 eWxlPSJsaXN0LXN0eWxlLXR5cGU6JnF1b3Q7NC4gJnF1b3Q7Ij5BZnRlciBhbGwgb2YgdGhlc2Ug Y29tZXMgdGhlIG1vdW50aW5nIG9mIGZpbGVzeXN0ZW1zIGFuZCBjcmVhdGluZyBmc3RhYiB0byBj b250aW51ZSB0aGUgaW5zdGFsbGF0aW9uLCB3aGljaCBpcyBmdWxsIGRhcmtuZXNzIGF0IHRoZSBt b21lbnQsIGFzIEknbSBzdGlsbCBzdHJ1Z2dsaW5nIHdpdGggdGhlIGluaXRpYWwgc3RhcnQgYW5k IG5vdCBoYXZlIHJlYWQgYW55dGhpbmcgb24gdGhhdC48L2xpPjwvb2w+DQo8ZGl2Pjxicj4NCjwv ZGl2Pg0KPGRpdj48c3Bhbj5BbGwgb2YgdGhlc2Ugc2hvdWxkIGJlIGRvbmUgaW4gc2hlbGwgd2l0 aCB0aGUgZ3BhcnQgdXRpbGl0eSBkdXJpbmcgaW5zdGFsbCBhbmQgSSBjYW5ub3QgZmlndXJlIG91 dCwgaG93IHRvIG1ha2UgcG9pbnRzIDIgYW5kIDMgb24gb25lIGdvIGhhdmluZyBkaXJlY3RseSB0 aGUgUkFJRFoyLjwvc3Bhbj48L2Rpdj4NCjxkaXY+PHNwYW4+PGJyPg0KPC9zcGFuPjwvZGl2Pg0K PGRpdj48c3Bhbj48YnI+DQo8L3NwYW4+PC9kaXY+DQo8L2Rpdj4NCjxkaXYgaWQ9InhfbV82NDkw MjI0Nzg0NjY3MDU2NTQwYXBwZW5kb25zZW5kIj48L2Rpdj4NCjxociBzdHlsZT0iZGlzcGxheTpp bmxpbmUtYmxvY2s7IHdpZHRoOjk4JSI+DQo8ZGl2IGlkPSJ4X21fNjQ5MDIyNDc4NDY2NzA1NjU0 MGRpdlJwbHlGd2RNc2ciIGRpcj0ibHRyIj48Zm9udCBmYWNlPSJDYWxpYnJpLCBzYW5zLXNlcmlm IiBjb2xvcj0iIzAwMDAwMCIgc3R5bGU9ImZvbnQtc2l6ZToxMXB0Ij48Yj5Gcm9tOjwvYj4NCjxh IGhyZWY9Im1haWx0bzpvd25lci1mcmVlYnNkLWhhY2tlcnNAZnJlZWJzZC5vcmciIHRhcmdldD0i X2JsYW5rIj5vd25lci1mcmVlYnNkLWhhY2tlcnNAZnJlZWJzZC5vcmc8L2E+ICZsdDs8YSBocmVm PSJtYWlsdG86b3duZXItZnJlZWJzZC1oYWNrZXJzQGZyZWVic2Qub3JnIiB0YXJnZXQ9Il9ibGFu ayI+b3duZXItZnJlZWJzZC1oYWNrZXJzQGZyZWVic2Qub3JnPC9hPiZndDsgb24gYmVoYWxmIG9m IFdhcm5lciBMb3NoICZsdDs8YSBocmVmPSJtYWlsdG86aW1wQGJzZGltcC5jb20iIHRhcmdldD0i X2JsYW5rIj5pbXBAYnNkaW1wLmNvbTwvYT4mZ3Q7PGJyPg0KPGI+U2VudDo8L2I+IFdlZG5lc2Rh eSwgT2N0b2JlciAxMSwgMjAyMyAwMDoyMDxicj4NCjxiPlRvOjwvYj4gPGEgaHJlZj0ibWFpbHRv OmF6YXRoYW5haUBpY2xvdWQuY29tIiB0YXJnZXQ9Il9ibGFuayI+YXphdGhhbmFpQGljbG91ZC5j b208L2E+ICZsdDs8YSBocmVmPSJtYWlsdG86YXphdGhhbmFpQGljbG91ZC5jb20iIHRhcmdldD0i X2JsYW5rIj5hemF0aGFuYWlAaWNsb3VkLmNvbTwvYT4mZ3Q7PGJyPg0KPGI+Q2M6PC9iPiBmcmVl YnNkLWhhY2tlcnNARnJlZUJTRC5vcmcgJmx0OzxhIGhyZWY9Im1haWx0bzpmcmVlYnNkLWhhY2tl cnNAZnJlZWJzZC5vcmciIHRhcmdldD0iX2JsYW5rIj5mcmVlYnNkLWhhY2tlcnNAZnJlZWJzZC5v cmc8L2E+Jmd0Ozxicj4NCjxiPlN1YmplY3Q6PC9iPiBSZTogUXVlc3Rpb24gb2YgaW5zdGFsbGlu ZyBvdmVyIFNBUyBjb250cm9sbGVyIGFuZCBVU0IgZmxhc2g8L2ZvbnQ+DQo8ZGl2PiZuYnNwOzwv ZGl2Pg0KPC9kaXY+DQo8ZGl2Pg0KPGRpdiBkaXI9Imx0ciI+DQo8ZGl2IGRpcj0ibHRyIj48YnI+ DQo8L2Rpdj4NCjxicj4NCjxkaXY+DQo8ZGl2IGRpcj0ibHRyIj5PbiBUdWUsIE9jdCAxMCwgMjAy MyBhdCAyOjM24oCvUE0gPGEgaHJlZj0ibWFpbHRvOmF6YXRoYW5haUBpY2xvdWQuY29tIiB0YXJn ZXQ9Il9ibGFuayI+DQphemF0aGFuYWlAaWNsb3VkLmNvbTwvYT4gJmx0OzxhIGhyZWY9Im1haWx0 bzphemF0aGFuYWlAaWNsb3VkLmNvbSIgdGFyZ2V0PSJfYmxhbmsiPmF6YXRoYW5haUBpY2xvdWQu Y29tPC9hPiZndDsgd3JvdGU6PGJyPg0KPC9kaXY+DQo8YmxvY2txdW90ZSBzdHlsZT0ibWFyZ2lu OjBweCAwcHggMHB4IDAuOGV4OyBib3JkZXItbGVmdDoxcHggc29saWQgcmdiKDIwNCwyMDQsMjA0 KTsgcGFkZGluZy1sZWZ0OjFleCI+DQo8ZGl2Pg0KPGRpdiBkaXI9Imx0ciI+DQo8ZGl2IHN0eWxl PSJmb250LWZhbWlseTpBcHRvcyxBcHRvc19FbWJlZGRlZEZvbnQsQXB0b3NfTVNGb250U2Vydmlj ZSxDYWxpYnJpLEhlbHZldGljYSxzYW5zLXNlcmlmOyBmb250LXNpemU6MTJwdDsgY29sb3I6cmdi KDAsMCwwKSI+DQpIaSBhbGwsPC9kaXY+DQo8ZGl2IHN0eWxlPSJmb250LWZhbWlseTpBcHRvcyxB cHRvc19FbWJlZGRlZEZvbnQsQXB0b3NfTVNGb250U2VydmljZSxDYWxpYnJpLEhlbHZldGljYSxz YW5zLXNlcmlmOyBmb250LXNpemU6MTJwdDsgY29sb3I6cmdiKDAsMCwwKSI+DQphIG5ld2JpZSBp biBGcmVlQlNEIGhlcmUgdHJ5aW5nIHRvIGluc3RhbGwgYSBSQUlEWjIgb24gYSBzZXJ2ZXIgd2l0 aCBtcHMgU0FTIGNvbnRyb2xsZXIgd2l0aCBkcml2ZXMgd2hpY2ggYXJlIG5vdCB2aXNpYmxlIGlu IHRoZSBib290IG9yZGVyIGluIEJJT1MuPC9kaXY+DQo8ZGl2IHN0eWxlPSJmb250LWZhbWlseTpB cHRvcyxBcHRvc19FbWJlZGRlZEZvbnQsQXB0b3NfTVNGb250U2VydmljZSxDYWxpYnJpLEhlbHZl dGljYSxzYW5zLXNlcmlmOyBmb250LXNpemU6MTJwdDsgY29sb3I6cmdiKDAsMCwwKSI+DQpTbywg SSBjYW5ub3QgaW5zdGFsbCBkaXJlY3RseSBvbiB0aGUgZHJpdmVzLCBkZXNwaXRlIHRoYXQgdGhl IGluc3RhbGxlciAmcXVvdDtzZWVzJnF1b3Q7IHRoZW0sIGJlY2F1c2UgdGhlIEJJT1MgZG9lcyBu b3Qgc2VlIHRoZSBjb250cm9sbGVyIGFuZCBpdHMgZHJpdmVzIGFzIG9wdGlvbi48L2Rpdj4NCjwv ZGl2Pg0KPC9kaXY+DQo8L2Jsb2NrcXVvdGU+DQo8ZGl2Pjxicj4NCjwvZGl2Pg0KPGRpdj5IYXZl IHlvdSBlbmFibGVkIHRoZSBCSU9TIG9uIHRoZSBtcHMgY2FyZCBpdHNlbGY/IE90aGVyd2lzZSBp dCB3b24ndCBpbnN0YWxsIGEgQklPUyBmcmFnbWVudCB0byBydW4gYXQgYm9vdCwgYW5kIHRoZSBk cml2ZXMgd29uJ3QgYmUgc2Vlbi48L2Rpdj4NCjxkaXY+PGJyPg0KPC9kaXY+DQo8YmxvY2txdW90 ZSBzdHlsZT0ibWFyZ2luOjBweCAwcHggMHB4IDAuOGV4OyBib3JkZXItbGVmdDoxcHggc29saWQg cmdiKDIwNCwyMDQsMjA0KTsgcGFkZGluZy1sZWZ0OjFleCI+DQo8ZGl2Pg0KPGRpdiBkaXI9Imx0 ciI+DQo8ZGl2IHN0eWxlPSJmb250LWZhbWlseTpBcHRvcyxBcHRvc19FbWJlZGRlZEZvbnQsQXB0 b3NfTVNGb250U2VydmljZSxDYWxpYnJpLEhlbHZldGljYSxzYW5zLXNlcmlmOyBmb250LXNpemU6 MTJwdDsgY29sb3I6cmdiKDAsMCwwKSI+DQpPbiB0aGUgb3RoZXIgaGFuZCwgSSBoYXZlIGEgY2Fy ZCByZWFkZXIgd2l0aCBhIGZsYXNoIGNhcmQgb24gaXQgKDRnaWdzKSBmcm9tIHdoaWNoIEkgY2Fu IGJvb3QgYW5kIHdoZXJlIEkgY2FuIGhhdmUgbXkgL2Jvb3QgcGFydGl0aW9uIHdpdGggdGhlIGtl cm5lbC4mbmJzcDs8L2Rpdj4NCjxkaXYgc3R5bGU9ImZvbnQtZmFtaWx5OkFwdG9zLEFwdG9zX0Vt YmVkZGVkRm9udCxBcHRvc19NU0ZvbnRTZXJ2aWNlLENhbGlicmksSGVsdmV0aWNhLHNhbnMtc2Vy aWY7IGZvbnQtc2l6ZToxMnB0OyBjb2xvcjpyZ2IoMCwwLDApIj4NCkkndmUgYSBsb3Qgb2YgcXVl c3Rpb25zIGFuZCBJIHN0aWxsIGNhbm5vdCBmaW5kIHRoZSBhbnN3ZXJzIHRvIG1vc3Qgb2YgdGhl bSwgZGVzcGl0ZSBnb2luZyB0aHJvdWdoIHRoZSBoYW5kYm9vaywgdGhlIGJvb3QgcHJvY2VzcyBl eHBsYW5hdGlvbiwgdGhlIGluc3RhbGxhdGlvbiBwcm9jZXNzIGhhbmRib29rIGFuZCBhIGxvdCBv ZiBtb3JlIHJlYWRpbmcuPC9kaXY+DQo8ZGl2IHN0eWxlPSJmb250LWZhbWlseTpBcHRvcyxBcHRv c19FbWJlZGRlZEZvbnQsQXB0b3NfTVNGb250U2VydmljZSxDYWxpYnJpLEhlbHZldGljYSxzYW5z LXNlcmlmOyBmb250LXNpemU6MTJwdDsgY29sb3I6cmdiKDAsMCwwKSI+DQo8YnI+DQo8L2Rpdj4N CjxkaXYgc3R5bGU9ImZvbnQtZmFtaWx5OkFwdG9zLEFwdG9zX0VtYmVkZGVkRm9udCxBcHRvc19N U0ZvbnRTZXJ2aWNlLENhbGlicmksSGVsdmV0aWNhLHNhbnMtc2VyaWY7IGZvbnQtc2l6ZToxMnB0 OyBjb2xvcjpyZ2IoMCwwLDApIj4NCjx1bD4NCjxsaSBzdHlsZT0ibGlzdC1zdHlsZS10eXBlOiZx dW90Oy0gJnF1b3Q7Ij48c3Bhbj5Ib3cgc2hvdWxkIHRoZSBmbGFzaCBjYXJkIGJlIHBhcnRpdGlv bmVkIGFuZCB3aXRoIHdoYXQgbW91bnRwb2ludHM/IFRoZSBzZXJ2ZXIgaXMgQklPUyBjYXBhYmxl Ljxicj4NCjwvc3Bhbj48L2xpPjxsaSBzdHlsZT0ibGlzdC1zdHlsZS10eXBlOiZxdW90Oy0gJnF1 b3Q7Ij48c3Bhbj5Ib3cgc2hvdWxkIHRoZSByZXN0IG9mIHRoZSBkcml2ZXMgYmUgcGFydGl0aW9u ZWQgd2l0aCBaRlMgYW5kIHRoZSBtb3VudHBvaW50cz8gVGhlIHN0YW5kYXJkIGNvbmZpZ3VyYXRp b24gZnJvbSB0aGUgaW5zdGFsbGVyIG9uIFJBSURaMiBpcyBnb29kIGZvciBtZS48L3NwYW4+PC9s aT48L3VsPg0KPGRpdj48c3Bhbj5JJ3ZlIGV4cGVyaWVuY2Ugd2l0aCBMaW51eCBidXQgaXMgbm90 IGhlbHBpbmcgYSBsb3QgaGVyZS4gVGhlIHNldHVwIGxvb2tzIHF1aXRlIGRpZmZlcmVudCAuLi4u IHByb2JhYmx5IGJlY2F1c2Ugb2YgdGhlIFpGUy48L3NwYW4+PC9kaXY+DQo8ZGl2PjxzcGFuPjxi cj4NCjwvc3Bhbj48L2Rpdj4NCjxkaXY+PHNwYW4+QW55IGhlbHAsIGxpbmtzLCBpZGVhcyBhbmQg Y29tbWVudHMgd2lsbCBiZSBtdWNoIGFwcHJlY2lhdGVkITwvc3Bhbj48L2Rpdj4NCjwvZGl2Pg0K PC9kaXY+DQo8L2Rpdj4NCjwvYmxvY2txdW90ZT4NCjxkaXY+PGJyPg0KPC9kaXY+DQo8ZGl2PlRo YXQncyBhIHdvcmthcm91bmQsIGJ1dCB5b3Ugc2hvdWxkIGJlIGFibGUgdG8gZW5hYmxlIHRoZSBC SU9TIHBhcnQgb2YgdGhlIG1wcy9tcHIgY2FyZHMgYW5kIGJvb3Qgb2ZmIHRoZW0uIEkndmUgZG9u ZSB0aGF0IGJlZm9yZS48L2Rpdj4NCjxkaXY+PGJyPg0KPC9kaXY+DQo8ZGl2Pldhcm5lcjwvZGl2 Pg0KPGRpdj4mbmJzcDs8L2Rpdj4NCjxibG9ja3F1b3RlIHN0eWxlPSJtYXJnaW46MHB4IDBweCAw cHggMC44ZXg7IGJvcmRlci1sZWZ0OjFweCBzb2xpZCByZ2IoMjA0LDIwNCwyMDQpOyBwYWRkaW5n LWxlZnQ6MWV4Ij4NCjxkaXY+DQo8ZGl2IGRpcj0ibHRyIj4NCjxkaXYgc3R5bGU9ImZvbnQtZmFt aWx5OkFwdG9zLEFwdG9zX0VtYmVkZGVkRm9udCxBcHRvc19NU0ZvbnRTZXJ2aWNlLENhbGlicmks SGVsdmV0aWNhLHNhbnMtc2VyaWY7IGZvbnQtc2l6ZToxMnB0OyBjb2xvcjpyZ2IoMCwwLDApIj4N CjxkaXY+PHNwYW4+PGJyPg0KPC9zcGFuPjwvZGl2Pg0KPGRpdj48c3Bhbj5DeWJlcmx5IHlvdXJz LDwvc3Bhbj48L2Rpdj4NCjxkaXY+PHNwYW4+ZGVyYWdvdGg8L3NwYW4+PC9kaXY+DQo8ZGl2Pjxz cGFuPjxicj4NCjwvc3Bhbj48L2Rpdj4NCjxkaXY+PHNwYW4+PGJyPg0KPC9zcGFuPjwvZGl2Pg0K PC9kaXY+DQo8L2Rpdj4NCjwvZGl2Pg0KPC9ibG9ja3F1b3RlPg0KPC9kaXY+DQo8L2Rpdj4NCjwv ZGl2Pg0KPC9kaXY+DQo8L2Rpdj4NCjwvYmxvY2txdW90ZT4NCjwvZGl2Pg0KPC9kaXY+DQo8L2Jv ZHk+DQo8L2h0bWw+DQo= --_000_AM6PR02MB4471C1516952D8DCE423C9E7A5D5AAM6PR02MB4471eurp_-- From nobody Wed Oct 18 06:14:33 2023 X-Original-To: freebsd-hackers@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4S9LCz09k9z4xZk6 for ; Wed, 18 Oct 2023 06:14:39 +0000 (UTC) (envelope-from azathanai@icloud.com) Received: from qs51p00im-qukt01072102.me.com (qs51p00im-qukt01072102.me.com [17.57.155.11]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4S9LCy19RQz3Nqy for ; Wed, 18 Oct 2023 06:14:38 +0000 (UTC) (envelope-from azathanai@icloud.com) Authentication-Results: mx1.freebsd.org; dkim=pass header.d=icloud.com header.s=1a1hai header.b=GqePUpc5; spf=pass (mx1.freebsd.org: domain of azathanai@icloud.com designates 17.57.155.11 as permitted sender) smtp.mailfrom=azathanai@icloud.com; dmarc=pass (policy=quarantine) header.from=icloud.com DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=icloud.com; s=1a1hai; t=1697609677; bh=KYbPrd2Eu31THnrSH9xg4kBDdZorWcjXnwo0RHrm0Uo=; h=From:To:Subject:Date:Message-ID:Content-Type:MIME-Version; b=GqePUpc5L7fOhBSyMvA2qeLNsRkEsBUiJqVzIEkkXPS13W7dd7V2k54calZKg5Yan YQKb7wiRVw2pQx2vXPLc3umxI+HFJIw3rMhqhg1RTwQwu/IcrdNzzEmtOuBRjrKUG5 B3ZFADc+voDDqcumIMTWRHgzYbgGM7L1FflWjhGaBrGeDkxIAbDd720RTxxT42l0LU 2Li0kX9UxyohuqeE66qMA6m2PVdGj+B+00zB6ZA/lXinIdIISoDSeQnd7ZTRN0rXg1 LzpprTPPVXsRuW8M7O869r5PBW3ySCGJUv6LLZESAlMFWdNpGs5jEtgjRKMLSF5NvT /oWdn0BgQhfsw== Received: from AM6PR02MB4471.eurprd02.prod.outlook.com (qs51p00im-dlb-asmtp-mailmevip.me.com [17.57.155.28]) by qs51p00im-qukt01072102.me.com (Postfix) with ESMTPSA id 0B38C3401BF; Wed, 18 Oct 2023 06:14:35 +0000 (UTC) From: "azathanai@icloud.com" To: Miroslav Lachman <000.fbsd@quip.cz> CC: "freebsd-hackers@FreeBSD.org" Subject: Re: Question of installing over SAS controller and USB flash Thread-Topic: Question of installing over SAS controller and USB flash Thread-Index: AQHZ+7gox8b2WXJ7x0SXInCUTrHiVLBDh8MAgADxNbGAACMPAIAEK6+c X-MS-Exchange-MessageSentRepresentingType: 1 Date: Wed, 18 Oct 2023 06:14:33 +0000 Message-ID: References: <84c06802-a6d9-fa5d-8dab-9ebe18074321@quip.cz> In-Reply-To: <84c06802-a6d9-fa5d-8dab-9ebe18074321@quip.cz> Accept-Language: en-US, bg-BG Content-Language: en-US X-MS-Has-Attach: X-MS-Exchange-Organization-SCL: -1 X-MS-TNEF-Correlator: X-MS-Exchange-Organization-RecordReviewCfmType: 0 msip_labels: Content-Type: multipart/alternative; boundary="_000_AM6PR02MB4471AD796A475A88421738B9A5D1AAM6PR02MB4471eurp_" List-Id: Technical discussions relating to FreeBSD List-Archive: https://lists.freebsd.org/archives/freebsd-hackers List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-hackers@freebsd.org MIME-Version: 1.0 X-Proofpoint-ORIG-GUID: -7GD-ZdXoAreS9RZbuCB0t_ctcyWcfvD X-Proofpoint-GUID: -7GD-ZdXoAreS9RZbuCB0t_ctcyWcfvD X-Proofpoint-Virus-Version: =?UTF-8?Q?vendor=3Dfsecure_engine=3D1.1.170-22c6f66c430a71ce266a39bfe25bc?= =?UTF-8?Q?2903e8d5c8f:6.0.138,18.0.790,17.11.62.513.0000000_definitions?= =?UTF-8?Q?=3D2022-01-12=5F02:2020-02-14=5F02,2022-01-12=5F02,2021-12-02?= =?UTF-8?Q?=5F01_signatures=3D0?= X-Proofpoint-Spam-Details: rule=notspam policy=default score=0 spamscore=0 suspectscore=0 mlxlogscore=999 adultscore=0 phishscore=0 mlxscore=0 malwarescore=0 bulkscore=0 clxscore=1011 classifier=spam adjust=0 reason=mlx scancount=1 engine=8.12.0-2212070000 definitions=main-2310180052 X-Spamd-Bar: ------ X-Spamd-Result: default: False [-6.20 / 15.00]; WHITELIST_SPF_DKIM(-3.00)[icloud.com:d:+,icloud.com:s:+]; FROM_DN_EQ_ADDR(1.00)[]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; NEURAL_HAM_LONG(-1.00)[-1.000]; NEURAL_HAM_SHORT(-1.00)[-1.000]; DMARC_POLICY_ALLOW(-0.50)[icloud.com,quarantine]; R_SPF_ALLOW(-0.20)[+ip4:17.57.155.0/24:c]; R_DKIM_ALLOW(-0.20)[icloud.com:s=1a1hai]; RWL_MAILSPIKE_VERYGOOD(-0.20)[17.57.155.11:from]; ONCE_RECEIVED(0.10)[]; RCVD_IN_DNSWL_LOW(-0.10)[17.57.155.11:from]; MIME_GOOD(-0.10)[multipart/alternative,text/plain]; TO_DN_EQ_ADDR_SOME(0.00)[]; MLMMJ_DEST(0.00)[freebsd-hackers@freebsd.org]; TO_MATCH_ENVRCPT_SOME(0.00)[]; ARC_NA(0.00)[]; ASN(0.00)[asn:714, ipnet:17.57.155.0/24, country:US]; MIME_TRACE(0.00)[0:+,1:+,2:~]; FREEMAIL_FROM(0.00)[icloud.com]; TO_DN_SOME(0.00)[]; RCVD_VIA_SMTP_AUTH(0.00)[]; DWL_DNSWL_NONE(0.00)[icloud.com:dkim]; DKIM_TRACE(0.00)[icloud.com:+]; RCVD_COUNT_ONE(0.00)[1]; RCPT_COUNT_TWO(0.00)[2]; FREEMAIL_ENVFROM(0.00)[icloud.com]; FROM_EQ_ENVFROM(0.00)[]; RCVD_TLS_ALL(0.00)[] X-Rspamd-Queue-Id: 4S9LCy19RQz3Nqy --_000_AM6PR02MB4471AD796A475A88421738B9A5D1AAM6PR02MB4471eurp_ Content-Type: text/plain; charset="iso-8859-1" Content-Transfer-Encoding: quoted-printable Hey Miroslav, thank you for the help. I've tried with the first part of your suggestion - gpart bootcode, but tha= t was not enough. I suppose I do need the /boot on the flash card, as I've = installed Linux and put the /boot "folder" on the flash and everything was = working flawlessly. I'll try your suggestion with the memstick. Just a question there. Do I need to make the "gpart bootcode" part if I'm creating the memstick, o= r the memstick has everything needed to boot from it, i.e. it has the bootc= odes? Thanks again for your help and willingness to waste your time on a noob que= stions! Cyberly yours, Nikolay Balov ________________________________ From: owner-freebsd-hackers@freebsd.org = on behalf of Miroslav Lachman <000.fbsd@quip.cz> Sent: Wednesday, October 11, 2023 16:49 To: azathanai@icloud.com ; Warner Losh Cc: freebsd-hackers@FreeBSD.org Subject: Re: Question of installing over SAS controller and USB flash On 11/10/2023 14:02, azathanai@icloud.com wrote: > Hey Warner, > the box is very featureLESS (an old Xyratex HS-1235T box, as far as I > researched it). > T2029_QR v1.3.ai (hackspace.org.uk) > > (5) Xyratex 0944037-03 Motherboard Mystery SOLVED : homelab (reddit.com) > > > Through the POST process and the BIOS there is no option to get into the > SAS controller and enable its BIOS. I would love to install FreeBSD > directly on the drives and not to deal with the flash card, but I > suppose the lack of controller BIOS is the reason the box comes with > reader and card directly. [..] This depends on at what stage the computer starts to see the disk behind the SAS controller. I had an old HP server that only saw one disk out of four in the BIOS, so it couldn't boot from RAIDZ, but it was enough to make a 10GB partition on each disk as a 4 way ZFS mirror, boot from that and use the rest of each disk for the main RAIDZ storage (4x 8TB). Maybe it would have been enough to use a USB flash drive for the freebsd-boot partition in GPT scheme and then continue boot from the disks on the SAS controller. gpart create -s GPT da0 gpart bootcode -b /boot/pmbr da0 gpart add -b 40 -s 512 -t freebsd-boot da0 gpart bootcode -p /boot/zfsgptboot -i 1 da0 As long as the computer boots from the installer CD, FreeBSD with RAIDZ can be installed on the disks behind the SAS controller without any modification, only the USB flash drive must provide the boot. If the USB flash drive must also contain a UFS /boot partition, then copy an image that can be downloaded from the web as a "mini-memstick" to the USB flash drive https://www.freebsd.org/releases/13.2R/announce/ (use dd according to the instructions) Or again, create a complete installation from the FreeBSD installer on the USB flash drive. But the installation to big drives with RAIDZ should be done normally from the FreeBSD installer. No modifications needed. Kind regards Miroslav Lachman --_000_AM6PR02MB4471AD796A475A88421738B9A5D1AAM6PR02MB4471eurp_ Content-Type: text/html; charset="iso-8859-1" Content-Transfer-Encoding: quoted-printable
Hey Miroslav,
thank you for the help.
I've tried with the first part of your suggestion - gpart bootcode, but tha= t was not enough. I suppose I do need the /boot on the flash card, as I've = installed Linux and put the /boot "folder" on the flash and every= thing was working flawlessly.
I'll try your suggestion with the memstick. Just a question there.
Do I need to make the "gpart bootcode" part if I'm creating the m= emstick, or the memstick has everything needed to boot from it, i.e. it has= the bootcodes?

Thanks again for your help and willingness to waste your tim= e on a noob questions!

Cyberly yours,
Nikolay Balov


From: owner-= freebsd-hackers@freebsd.org <owner-freebsd-hackers@freebsd.org> on be= half of Miroslav Lachman <000.fbsd@quip.cz>
Sent: Wednesday, October 11, 2023 16:49
To: azathanai@icloud.com <azathanai@icloud.com>; Warner L= osh <imp@bsdimp.com>
Cc: freebsd-hackers@FreeBSD.org <freebsd-hackers@FreeBSD.org= >
Subject: Re: Question of installing over SAS controller and USB= flash
 
On 11/10/2023 14:02, azathanai@icloud= .com wrote:
> Hey Warner,
> the box is very featureLESS (an old Xyratex HS-1235T box, as far as I<= br> > researched it).
> T2029_QR v1.3.ai (hackspace.org.uk)
> <https://wiki.lond= on.hackspace.org.uk/w/images/b/b2/HS-1235T-ATX_Quick_Reference_Sheet.pdf>
> (5) Xyratex 0944037-03 Motherboard Mystery SOLVED : homelab (reddit.co= m)
> <https://www.= reddit.com/r/homelab/comments/8loge6/xyratex_094403703_motherboard_mystery_= solved/>
>
> Through the POST process and the BIOS there is no option to get into t= he
> SAS controller and enable its BIOS. I would love to install FreeBSD > directly on the drives and not to deal with the flash card, but I
> suppose the lack of controller BIOS is the reason the box comes with > reader and card directly.

[..]

This depends on at what stage the computer starts to see the disk behind the SAS controller. I had an old HP server that only saw one disk out of four in the BIOS, so it couldn't boot from RAIDZ, but it was enough to
make a 10GB partition on each disk as a 4 way ZFS mirror, boot from that and use the rest of each disk for the main RAIDZ storage (4x 8TB).

Maybe it would have been enough to use a USB flash drive for the
freebsd-boot partition in GPT scheme and then continue boot from the
disks on the SAS controller.

gpart create -s GPT da0
gpart bootcode -b /boot/pmbr da0
gpart add -b 40 -s 512 -t freebsd-boot da0
gpart bootcode -p /boot/zfsgptboot -i 1 da0

As long as the computer boots from the installer CD, FreeBSD with RAIDZ
can be installed on the disks behind the SAS controller without any
modification, only the USB flash drive must provide the boot.

If the USB flash drive must also contain a UFS /boot partition, then
copy an image that can be downloaded from the web as a "mini-memstick&= quot;
to the USB flash drive
https://www.freebsd.org/releases/13.2R/announce/ (use dd a= ccording to
the instructions)
Or again, create a complete installation from the FreeBSD installer on
the USB flash drive.

But the installation to big drives with RAIDZ should be done normally
from the FreeBSD installer. No modifications needed.

Kind regards
Miroslav Lachman


--_000_AM6PR02MB4471AD796A475A88421738B9A5D1AAM6PR02MB4471eurp_-- From nobody Wed Oct 18 11:43:42 2023 X-Original-To: freebsd-hackers@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4S9TWm23tWz4xtq3 for ; Wed, 18 Oct 2023 11:43:48 +0000 (UTC) (envelope-from paulf2718@gmail.com) Received: from mail-lj1-x234.google.com (mail-lj1-x234.google.com [IPv6:2a00:1450:4864:20::234]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "GTS CA 1D4" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4S9TWl39fZz4QdF for ; Wed, 18 Oct 2023 11:43:47 +0000 (UTC) (envelope-from paulf2718@gmail.com) Authentication-Results: mx1.freebsd.org; dkim=pass header.d=gmail.com header.s=20230601 header.b=RtATeH2f; spf=pass (mx1.freebsd.org: domain of paulf2718@gmail.com designates 2a00:1450:4864:20::234 as permitted sender) smtp.mailfrom=paulf2718@gmail.com; dmarc=pass (policy=none) header.from=gmail.com Received: by mail-lj1-x234.google.com with SMTP id 38308e7fff4ca-2c504a5e1deso80710871fa.2 for ; Wed, 18 Oct 2023 04:43:47 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20230601; t=1697629425; x=1698234225; darn=freebsd.org; h=subject:from:content-language:to:user-agent:mime-version:date :message-id:from:to:cc:subject:date:message-id:reply-to; bh=Rx8ztXnnB5XHoAW7Z8CjlNCmVXQdo4vpz/aAK/eDR7k=; b=RtATeH2fR1CX8hK4S/gNr27acbyR4ehdd7iABTE7MpMyQnMc40XcdAziAWukvKmc2j SDBws+n+/+E+4fqg/vZD6OnhkrwnCE8zP7mCMI/+OLcsdWcLuTaCG0uU7Hu896O75EqP io3pidTkN2KXCBrvxSJvFeiQvLaSvtyPIY4Tq+LU+J7jcB0qTlcXioWoHB9buxN0FfG4 ZNvb8yRGol5mmHkUUKHMFk9T0Eab+t1jL5zJelkI2I68NYAMJbmP6BM2NZ5fK/bdYjpx +p2ysQh+J4y1uOVdBzslUzQVNfyC0jOKAt5kCIhuTg6DVibl529CCPCH+W4woyRUTo1T arwQ== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20230601; t=1697629425; x=1698234225; h=subject:from:content-language:to:user-agent:mime-version:date :message-id:x-gm-message-state:from:to:cc:subject:date:message-id :reply-to; bh=Rx8ztXnnB5XHoAW7Z8CjlNCmVXQdo4vpz/aAK/eDR7k=; b=NJ4yEzI58At3x2Di6d9yriY6SFIBfSJ74/fY0fDe5v+HGoQV3g6IMFG59NblK9AX88 n3casZywE2+6z8f+uTLqp5pXGNp/Yd82P32StQgexQi0r8u+v3nxKGHeayiWKJs9yZyj REXSevFGfi8mr8S1v8Ur/5idMnsdmKN80UbSeuMN4stFo+6/CcmyJBnZIcoacdNWvedO rsT1qW5Kpvhkt3lxnTlfIcQzCLBbNP+OPuZnk1aUMl16UxSG15pjbnsETJb2ZRffK7w5 H5DVIUaCDv14pj5dDFicNJK9vcqmMN/W3KNOLsITYgfrg5vQwXAXzkXhKd+C10YQouAt yllg== X-Gm-Message-State: AOJu0Yyk/P81X9hPVfjVk6m7MNYYGINzOLjsE3GBqVTunj/xmgvYsYeJ lKAFNn/aqR0y3iKSf/EwRYMs6Cpyq1JFJA== X-Google-Smtp-Source: AGHT+IGklsaxJ47PhktpYkEGts4MqS2oK3y2ZUOTywYV74E09CXlwFgxMzhg3H87kvR0jKsnAZKppA== X-Received: by 2002:a05:651c:1198:b0:2c4:fef7:c41e with SMTP id w24-20020a05651c119800b002c4fef7c41emr3280131ljo.0.1697629425163; Wed, 18 Oct 2023 04:43:45 -0700 (PDT) Received: from [137.202.253.23] (nat-ies.mentorg.com. [192.94.31.2]) by smtp.gmail.com with ESMTPSA id b12-20020a05600c150c00b0040586360a36sm1434281wmg.17.2023.10.18.04.43.43 for (version=TLS1_3 cipher=TLS_AES_128_GCM_SHA256 bits=128/128); Wed, 18 Oct 2023 04:43:44 -0700 (PDT) Content-Type: multipart/alternative; boundary="------------FkSLwtkHSHIX51iMCOBIbiB1" Message-ID: <01a7debc-bdc4-4aba-9f8d-1b78a00aac3c@gmail.com> Date: Wed, 18 Oct 2023 13:43:42 +0200 List-Id: Technical discussions relating to FreeBSD List-Archive: https://lists.freebsd.org/archives/freebsd-hackers List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-hackers@freebsd.org MIME-Version: 1.0 User-Agent: Mozilla Thunderbird To: "freebsd-hackers@FreeBSD.org" Content-Language: en-GB From: Paul Floyd Subject: Valgrind 3.22 RC1 announced X-Spamd-Bar: -- X-Spamd-Result: default: False [-2.73 / 15.00]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; URI_COUNT_ODD(1.00)[15]; NEURAL_HAM_LONG(-1.00)[-1.000]; NEURAL_HAM_SHORT(-0.74)[-0.744]; DMARC_POLICY_ALLOW(-0.50)[gmail.com,none]; R_DKIM_ALLOW(-0.20)[gmail.com:s=20230601]; R_SPF_ALLOW(-0.20)[+ip6:2a00:1450:4000::/36:c]; MIME_GOOD(-0.10)[multipart/alternative,text/plain]; XM_UA_NO_VERSION(0.01)[]; FROM_HAS_DN(0.00)[]; TO_MATCH_ENVRCPT_ALL(0.00)[]; TO_DN_EQ_ADDR_ALL(0.00)[]; PREVIOUSLY_DELIVERED(0.00)[freebsd-hackers@freebsd.org]; RCVD_IN_DNSWL_NONE(0.00)[2a00:1450:4864:20::234:from]; RCPT_COUNT_ONE(0.00)[1]; RCVD_VIA_SMTP_AUTH(0.00)[]; MID_RHS_MATCH_FROM(0.00)[]; DWL_DNSWL_NONE(0.00)[gmail.com:dkim]; FROM_EQ_ENVFROM(0.00)[]; DKIM_TRACE(0.00)[gmail.com:+]; FREEMAIL_FROM(0.00)[gmail.com]; ARC_NA(0.00)[]; RCVD_TLS_LAST(0.00)[]; FREEMAIL_ENVFROM(0.00)[gmail.com]; MIME_TRACE(0.00)[0:+,1:+,2:~]; MLMMJ_DEST(0.00)[freebsd-hackers@freebsd.org]; ASN(0.00)[asn:15169, ipnet:2a00:1450::/32, country:US]; RCVD_COUNT_TWO(0.00)[2] X-Rspamd-Queue-Id: 4S9TWl39fZz4QdF This is a multi-part message in MIME format. --------------FkSLwtkHSHIX51iMCOBIbiB1 Content-Type: text/plain; charset=UTF-8; format=flowed Content-Transfer-Encoding: 7bit Hi Below is the announcement for Valgrind 3.22 RC1 I'd really appreciate it if anyone can download build, and check it. Specific to FreeBSD, there ren't many new things compared to the current devel/freebsd-devel port/package (on the other hand the devel/valgrind devel is still on Valgrind 3.21 release plus a couple of patches). The main thing is that if Valgrind itself crashes it should now print a human readable callstack. Useful for bug reports! The main thing that I've worked on for this release is a major overhaul of aligned allocation/deallocation and sized deallocation 1. Previously the behaviour was mostly "like GNU libc" no matter the platform. Now Valgrind tries to behave like the build platform. 2. Previously there was no checking that alignment values were valid, now there is. 3. Previously there was no checking that deallocation alignment or size matchees the allocation alignment and size, now there is. For the C++ allocation operators, unless you are writing a compiler or allocator library it is unlikely that you will ever encounter these issues since it's the compiler that translates new and delete expressions into calls to operator new and operator delete. Users of Cachegrind can now use annotation to start and stop instrumentation. That allows you to focus on the code you want to analyse and reduces the runtime burden. The mailing list referenced in the announcement is valgrind-developers@lists.sourceforge.net Announcement ===> An RC1 tarball for 3.22.0 is now available at https://sourceware.org/pub/valgrind/valgrind-3.22.0.RC1.tar.bz2 (md5sum = 786715e301f9b1d3e10faf2a5b360598) (sha1sum = ea0e9ca5b5c45168bfcb795e1d19d9d3f5d58223) https://sourceware.org/pub/valgrind/valgrind-3.22.0.RC1.tar.bz2.asc Please give it a try in configurations that are important for you and report any problems you have, either on this mailing list, or (preferably) via our bug tracker at https://bugs.kde.org/enter_bug.cgi?product=valgrind RC2 will appear in one week, Tuesday 24 October. And if nothing critical emerges after that, a final release will happen a week after that on Tuesday 31 October. A+ Paul --------------FkSLwtkHSHIX51iMCOBIbiB1 Content-Type: text/html; charset=UTF-8 Content-Transfer-Encoding: 7bit

Hi

Below is the announcement for Valgrind 3.22 RC1

I'd really appreciate it if anyone can download build, and check it.

Specific to FreeBSD, there ren't many new things compared to the current devel/freebsd-devel port/package (on the other hand the devel/valgrind devel is still on Valgrind 3.21 release plus a couple of patches). The main thing is that if Valgrind itself crashes it should now print a human readable callstack. Useful for bug reports!

The main thing that I've worked on for this release is a major overhaul of aligned allocation/deallocation and sized deallocation

  1. Previously the behaviour was mostly "like GNU libc" no matter the platform. Now Valgrind tries to behave like the build platform.

  2. Previously there was no checking that alignment values were valid, now there is.

  3. Previously there was no checking that deallocation alignment or size matchees the allocation alignment and size, now there is.

For the C++ allocation operators, unless you are writing a compiler or allocator library it is unlikely that you will ever encounter these issues since it's the compiler that translates new and delete expressions into calls to operator new and operator delete.

Users of Cachegrind can now use annotation to start and stop instrumentation. That allows you to focus on the code you want to analyse and reduces the runtime burden.


The mailing list referenced in the announcement is

valgrind-developers@lists.sourceforge.net

Announcement ===>

An RC1 tarball for 3.22.0 is now available at
https://sourceware.org/pub/valgrind/valgrind-3.22.0.RC1.tar.bz2
(md5sum = 786715e301f9b1d3e10faf2a5b360598)
(sha1sum = ea0e9ca5b5c45168bfcb795e1d19d9d3f5d58223)
https://sourceware.org/pub/valgrind/valgrind-3.22.0.RC1.tar.bz2.asc
Please give it a try in configurations that are important for you and
report any problems you have, either on this mailing list, or
(preferably) via our bug tracker at
https://bugs.kde.org/enter_bug.cgi?product=valgrind
RC2 will appear in one week, Tuesday 24 October. And if nothing
critical emerges after that, a final release will happen a week after
that on Tuesday 31 October.



A+

Paul


--------------FkSLwtkHSHIX51iMCOBIbiB1-- From nobody Wed Oct 18 14:30:09 2023 X-Original-To: freebsd-hackers@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4S9YCp5tV9z4x5wy for ; Wed, 18 Oct 2023 14:30:14 +0000 (UTC) (envelope-from azathanai@icloud.com) Received: from qs51p00im-qukt01072702.me.com (qs51p00im-qukt01072702.me.com [17.57.155.17]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4S9YCp0BZTz3LWC for ; Wed, 18 Oct 2023 14:30:14 +0000 (UTC) (envelope-from azathanai@icloud.com) Authentication-Results: mx1.freebsd.org; dkim=pass header.d=icloud.com header.s=1a1hai header.b=UuyWFw0F; spf=pass (mx1.freebsd.org: domain of azathanai@icloud.com designates 17.57.155.17 as permitted sender) smtp.mailfrom=azathanai@icloud.com; dmarc=pass (policy=quarantine) header.from=icloud.com DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=icloud.com; s=1a1hai; t=1697639412; bh=1wXGT2JMokfH6AeNStK/56gEQ9U6iSP8MBorwHdO+Gw=; h=From:To:Subject:Date:Message-ID:Content-Type:MIME-Version; b=UuyWFw0F/2bGEg1N1zFoKTjSLd4855Y72dZ4jSbmbm4NXaFSsOuenHZ1BTTeZPt8h reuMcuXSTVJkp2hc/KmeagW6nXS5LIHWRU/tvVD06HcAfJG2vK+CNsanGBIeW7ISNY v7XdGRMdiPSf/6Aw2FJi/ozjwS/xbE3fRGn5th7ezg63TnHJvdQcd60aMckWaUmbJg ikwGNKOKah9v8INcPWrE8Ilt/aPNT5cIzGAU/ZCgiL2S1vYUDBs/6cdCP8N0pZAV7f UaoPKSMv0g/FgFShjWyMe1UJBPcCLyZqCMLrOnmQHKSGdS+DSdrmoMuRe7lB762xiH PrJS4C4HON0EQ== Received: from AM6PR02MB4471.eurprd02.prod.outlook.com (qs51p00im-dlb-asmtp-mailmevip.me.com [17.57.155.28]) by qs51p00im-qukt01072702.me.com (Postfix) with ESMTPSA id 552641680488; Wed, 18 Oct 2023 14:30:11 +0000 (UTC) From: "azathanai@icloud.com" To: Miroslav Lachman <000.fbsd@quip.cz> CC: "freebsd-hackers@FreeBSD.org" Subject: Re: Question of installing over SAS controller and USB flash Thread-Topic: Question of installing over SAS controller and USB flash Thread-Index: AQHZ+7gox8b2WXJ7x0SXInCUTrHiVLBDh8MAgADxNbGAACMPAIAEK6+cgAbeJC4= X-MS-Exchange-MessageSentRepresentingType: 1 Date: Wed, 18 Oct 2023 14:30:09 +0000 Message-ID: References: <84c06802-a6d9-fa5d-8dab-9ebe18074321@quip.cz> In-Reply-To: Accept-Language: en-US, bg-BG Content-Language: en-US X-MS-Has-Attach: X-MS-Exchange-Organization-SCL: -1 X-MS-TNEF-Correlator: X-MS-Exchange-Organization-RecordReviewCfmType: 0 msip_labels: Content-Type: multipart/alternative; boundary="_000_AM6PR02MB44715B177C56DDBB0CC4CD4AA5D5AAM6PR02MB4471eurp_" List-Id: Technical discussions relating to FreeBSD List-Archive: https://lists.freebsd.org/archives/freebsd-hackers List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-hackers@freebsd.org MIME-Version: 1.0 X-Proofpoint-GUID: xNs8NxVarmvGvqZDbkleLNexQxAqGuYV X-Proofpoint-ORIG-GUID: xNs8NxVarmvGvqZDbkleLNexQxAqGuYV X-Proofpoint-Virus-Version: =?UTF-8?Q?vendor=3Dfsecure_engine=3D1.1.170-22c6f66c430a71ce266a39bfe25bc?= =?UTF-8?Q?2903e8d5c8f:6.0.138,18.0.790,17.0.605.474.0000000_definitions?= =?UTF-8?Q?=3D2022-01-12=5F02:2020-02-14=5F02,2022-01-12=5F02,2020-01-23?= =?UTF-8?Q?=5F02_signatures=3D0?= X-Proofpoint-Spam-Details: rule=notspam policy=default score=0 clxscore=1015 spamscore=0 mlxscore=0 bulkscore=0 malwarescore=0 adultscore=0 phishscore=0 suspectscore=0 mlxlogscore=999 classifier=spam adjust=0 reason=mlx scancount=1 engine=8.12.0-2212070000 definitions=main-2310180119 X-Spamd-Bar: ------ X-Spamd-Result: default: False [-6.11 / 15.00]; WHITELIST_SPF_DKIM(-3.00)[icloud.com:d:+,icloud.com:s:+]; FROM_DN_EQ_ADDR(1.00)[]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; NEURAL_HAM_LONG(-1.00)[-1.000]; NEURAL_HAM_SHORT(-0.91)[-0.910]; DMARC_POLICY_ALLOW(-0.50)[icloud.com,quarantine]; RWL_MAILSPIKE_VERYGOOD(-0.20)[17.57.155.17:from]; R_DKIM_ALLOW(-0.20)[icloud.com:s=1a1hai]; R_SPF_ALLOW(-0.20)[+ip4:17.57.155.0/24]; RCVD_IN_DNSWL_LOW(-0.10)[17.57.155.17:from]; ONCE_RECEIVED(0.10)[]; MIME_GOOD(-0.10)[multipart/alternative,text/plain]; ARC_NA(0.00)[]; MLMMJ_DEST(0.00)[freebsd-hackers@freebsd.org]; TO_MATCH_ENVRCPT_SOME(0.00)[]; TO_DN_EQ_ADDR_SOME(0.00)[]; FREEMAIL_ENVFROM(0.00)[icloud.com]; ASN(0.00)[asn:714, ipnet:17.57.155.0/24, country:US]; FREEMAIL_FROM(0.00)[icloud.com]; TO_DN_SOME(0.00)[]; RCVD_VIA_SMTP_AUTH(0.00)[]; DWL_DNSWL_NONE(0.00)[icloud.com:dkim]; DKIM_TRACE(0.00)[icloud.com:+]; RCVD_COUNT_ONE(0.00)[1]; RCPT_COUNT_TWO(0.00)[2]; MIME_TRACE(0.00)[0:+,1:+,2:~]; FROM_EQ_ENVFROM(0.00)[]; RCVD_TLS_ALL(0.00)[] X-Rspamd-Queue-Id: 4S9YCp0BZTz3LWC --_000_AM6PR02MB44715B177C56DDBB0CC4CD4AA5D5AAM6PR02MB4471eurp_ Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: quoted-printable OK. I've flashed the card with the mini-memstick and now it boots and starts th= e installation for FreeBSD, which is fine. However when it goes on partitio= ning of the drives, I'm not sure what to do. 1. I can mark all drives on the sas controller for auto-zfs, but if the = flash card is not "included" then the machine will reboot to the installati= on again. 2. I can include the flash card in the installation of auto-zfs, but tha= t means to have the card as root space and will not be able to use the big = drives. 3. I need to manually setup the partitions, having the efi and /boot on = the flash card and eventually mirrored on all other drives and have the / o= n the SAS drives, but doesn't have a clue how to do that. Is 3 the correct way to proceed and is any help on that possible? Cyberly yours, Nikolay Balov ________________________________ From: owner-freebsd-hackers@freebsd.org = on behalf of azathanai@icloud.com Sent: Wednesday, October 18, 2023 09:14 To: Miroslav Lachman <000.fbsd@quip.cz> Cc: freebsd-hackers@FreeBSD.org Subject: Re: Question of installing over SAS controller and USB flash Hey Miroslav, thank you for the help. I've tried with the first part of your suggestion - gpart bootcode, but tha= t was not enough. I suppose I do need the /boot on the flash card, as I've = installed Linux and put the /boot "folder" on the flash and everything was = working flawlessly. I'll try your suggestion with the memstick. Just a question there. Do I need to make the "gpart bootcode" part if I'm creating the memstick, o= r the memstick has everything needed to boot from it, i.e. it has the bootc= odes? Thanks again for your help and willingness to waste your time on a noob que= stions! Cyberly yours, Nikolay Balov ________________________________ From: owner-freebsd-hackers@freebsd.org = on behalf of Miroslav Lachman <000.fbsd@quip.cz> Sent: Wednesday, October 11, 2023 16:49 To: azathanai@icloud.com ; Warner Losh Cc: freebsd-hackers@FreeBSD.org Subject: Re: Question of installing over SAS controller and USB flash On 11/10/2023 14:02, azathanai@icloud.com wrote: > Hey Warner, > the box is very featureLESS (an old Xyratex HS-1235T box, as far as I > researched it). > T2029_QR v1.3.ai (hackspace.org.uk) > > (5) Xyratex 0944037-03 Motherboard Mystery SOLVED : homelab (reddit.com) > > > Through the POST process and the BIOS there is no option to get into the > SAS controller and enable its BIOS. I would love to install FreeBSD > directly on the drives and not to deal with the flash card, but I > suppose the lack of controller BIOS is the reason the box comes with > reader and card directly. [..] This depends on at what stage the computer starts to see the disk behind the SAS controller. I had an old HP server that only saw one disk out of four in the BIOS, so it couldn't boot from RAIDZ, but it was enough to make a 10GB partition on each disk as a 4 way ZFS mirror, boot from that and use the rest of each disk for the main RAIDZ storage (4x 8TB). Maybe it would have been enough to use a USB flash drive for the freebsd-boot partition in GPT scheme and then continue boot from the disks on the SAS controller. gpart create -s GPT da0 gpart bootcode -b /boot/pmbr da0 gpart add -b 40 -s 512 -t freebsd-boot da0 gpart bootcode -p /boot/zfsgptboot -i 1 da0 As long as the computer boots from the installer CD, FreeBSD with RAIDZ can be installed on the disks behind the SAS controller without any modification, only the USB flash drive must provide the boot. If the USB flash drive must also contain a UFS /boot partition, then copy an image that can be downloaded from the web as a "mini-memstick" to the USB flash drive https://www.freebsd.org/releases/13.2R/announce/ (use dd according to the instructions) Or again, create a complete installation from the FreeBSD installer on the USB flash drive. But the installation to big drives with RAIDZ should be done normally from the FreeBSD installer. No modifications needed. Kind regards Miroslav Lachman --_000_AM6PR02MB44715B177C56DDBB0CC4CD4AA5D5AAM6PR02MB4471eurp_ Content-Type: text/html; charset="us-ascii" Content-Transfer-Encoding: quoted-printable
OK.
I've flashed the card with the mini-memstick and now it boots and starts th= e installation for FreeBSD, which is fine. However when it goes on par= titioning of the drives, I'm not sure what to do.
  1. I c= an mark all drives on the sas controller for auto-zfs, but if the flash car= d is not "included" then the machine will reboot to the installation again. 
  2. I c= an include the flash card in the installation of auto-zfs, but that means t= o have the card as root space and will not be able to use the big drives.
  3. I n= eed to manually setup the partitions, having the efi and /boot on the flash= card and eventually mirrored on all other drives and have the / on the SAS drives, but doesn't have a clue how= to do that.
Is 3 the correct way to proceed and is any help = on that possible?


Cyberly yours,
Nikolay Balov
From: owner-freebsd-hackers= @freebsd.org <owner-freebsd-hackers@freebsd.org> on behalf of azathan= ai@icloud.com <azathanai@icloud.com>
Sent: Wednesday, October 18, 2023 09:14
To: Miroslav Lachman <000.fbsd@quip.cz>
Cc: freebsd-hackers@FreeBSD.org <freebsd-hackers@FreeBSD.org><= br> Subject: Re: Question of installing over SAS controller and USB flas= h
 
Hey Miroslav,
thank you for the help.
I've tried with the first part of your suggestion - gpart bootcode, but tha= t was not enough. I suppose I do need the /boot on the flash card, as I've = installed Linux and put the /boot "folder" on the flash and every= thing was working flawlessly.
I'll try your suggestion with the memstick. Just a question there.
Do I need to make the "gpart bootcode" part if I'm creating the m= emstick, or the memstick has everything needed to boot from it, i.e. it has= the bootcodes?

Thanks again for your help and willingness to waste your tim= e on a noob questions!

Cyberly yours,
Nikolay Balov


From: owner-freeb= sd-hackers@freebsd.org <owner-freebsd-hackers@freebsd.org> on behalf = of Miroslav Lachman <000.fbsd@quip.cz>
Sent: Wednesday, October 11, 2023 16:49
To: azathanai@icloud.com <azathanai@icloud.com>; Warner L= osh <imp@bsdimp.com>
Cc: freebsd-hackers@FreeBSD.org <freebsd-hackers@FreeBSD.org= >
Subject: Re: Question of installing over SAS controller and USB= flash
 
On 11/10/2023 14:02, azathanai@icloud.c= om wrote:
> Hey Warner,
> the box is very featureLESS (an old Xyratex HS-1235T box, as far as I<= br> > researched it).
> T2029_QR v1.3.ai (hackspace.org.uk)
> <https://wiki.lo= ndon.hackspace.org.uk/w/images/b/b2/HS-1235T-ATX_Quick_Reference_Sheet.pdf<= /a>>
> (5) Xyratex 0944037-03 Motherboard Mystery SOLVED : homelab (reddit.co= m)
> <https://ww= w.reddit.com/r/homelab/comments/8loge6/xyratex_094403703_motherboard_myster= y_solved/>
>
> Through the POST process and the BIOS there is no option to get into t= he
> SAS controller and enable its BIOS. I would love to install FreeBSD > directly on the drives and not to deal with the flash card, but I
> suppose the lack of controller BIOS is the reason the box comes with > reader and card directly.

[..]

This depends on at what stage the computer starts to see the disk behind the SAS controller. I had an old HP server that only saw one disk out of four in the BIOS, so it couldn't boot from RAIDZ, but it was enough to
make a 10GB partition on each disk as a 4 way ZFS mirror, boot from that and use the rest of each disk for the main RAIDZ storage (4x 8TB).

Maybe it would have been enough to use a USB flash drive for the
freebsd-boot partition in GPT scheme and then continue boot from the
disks on the SAS controller.

gpart create -s GPT da0
gpart bootcode -b /boot/pmbr da0
gpart add -b 40 -s 512 -t freebsd-boot da0
gpart bootcode -p /boot/zfsgptboot -i 1 da0

As long as the computer boots from the installer CD, FreeBSD with RAIDZ
can be installed on the disks behind the SAS controller without any
modification, only the USB flash drive must provide the boot.

If the USB flash drive must also contain a UFS /boot partition, then
copy an image that can be downloaded from the web as a "mini-memstick&= quot;
to the USB flash drive
https://www.freebsd.org/releases/13.2R/announce/ (use dd= according to
the instructions)
Or again, create a complete installation from the FreeBSD installer on
the USB flash drive.

But the installation to big drives with RAIDZ should be done normally
from the FreeBSD installer. No modifications needed.

Kind regards
Miroslav Lachman


--_000_AM6PR02MB44715B177C56DDBB0CC4CD4AA5D5AAM6PR02MB4471eurp_-- From nobody Wed Oct 18 17:56:42 2023 X-Original-To: freebsd-hackers@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4S9dpB36Ntz4xKNM for ; Wed, 18 Oct 2023 17:56:50 +0000 (UTC) (envelope-from sgk@troutmask.apl.washington.edu) Received: from troutmask.apl.washington.edu (troutmask.apl.washington.edu [128.95.76.21]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4S9dp95KcFz4Twp for ; Wed, 18 Oct 2023 17:56:49 +0000 (UTC) (envelope-from sgk@troutmask.apl.washington.edu) Authentication-Results: mx1.freebsd.org; none Received: from troutmask.apl.washington.edu (localhost [127.0.0.1]) by troutmask.apl.washington.edu (8.17.1/8.17.1) with ESMTP id 39IHugkh037958; Wed, 18 Oct 2023 10:56:42 -0700 (PDT) (envelope-from sgk@troutmask.apl.washington.edu) Received: (from sgk@localhost) by troutmask.apl.washington.edu (8.17.1/8.17.1/Submit) id 39IHugl9037957; Wed, 18 Oct 2023 10:56:42 -0700 (PDT) (envelope-from sgk) Date: Wed, 18 Oct 2023 10:56:42 -0700 From: Steve Kargl To: Paul Floyd Cc: "freebsd-hackers@FreeBSD.org" Subject: Re: Valgrind 3.22 RC1 announced Message-ID: Reply-To: sgk@troutmask.apl.washington.edu References: <01a7debc-bdc4-4aba-9f8d-1b78a00aac3c@gmail.com> List-Id: Technical discussions relating to FreeBSD List-Archive: https://lists.freebsd.org/archives/freebsd-hackers List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-hackers@freebsd.org MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: <01a7debc-bdc4-4aba-9f8d-1b78a00aac3c@gmail.com> X-Spamd-Bar: ---- X-Rspamd-Pre-Result: action=no action; module=replies; Message is reply to one we originated X-Spamd-Result: default: False [-4.00 / 15.00]; REPLY(-4.00)[]; ASN(0.00)[asn:73, ipnet:128.95.0.0/16, country:US] X-Rspamd-Queue-Id: 4S9dp95KcFz4Twp On Wed, Oct 18, 2023 at 01:43:42PM +0200, Paul Floyd wrote: > > Below is the announcement for Valgrind 3.22 RC1 > > I'd really appreciate it if anyone can download build, and check it. > Is https://bugs.kde.org/show_bug.cgi?id=381819 fixed? If not, are there plans to include the patch attached to the bug report in the FreeBSD port? -- Steve From nobody Wed Oct 18 19:34:36 2023 X-Original-To: freebsd-hackers@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4S9gzJ0nPRz4xRT3 for ; Wed, 18 Oct 2023 19:34:52 +0000 (UTC) (envelope-from paulf2718@gmail.com) Received: from mail-wm1-x332.google.com (mail-wm1-x332.google.com [IPv6:2a00:1450:4864:20::332]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "GTS CA 1D4" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4S9gzG6zw1z4rQ5 for ; Wed, 18 Oct 2023 19:34:50 +0000 (UTC) (envelope-from paulf2718@gmail.com) Authentication-Results: mx1.freebsd.org; dkim=pass header.d=gmail.com header.s=20230601 header.b=Dk9O5YdO; spf=pass (mx1.freebsd.org: domain of paulf2718@gmail.com designates 2a00:1450:4864:20::332 as permitted sender) smtp.mailfrom=paulf2718@gmail.com; dmarc=pass (policy=none) header.from=gmail.com Received: by mail-wm1-x332.google.com with SMTP id 5b1f17b1804b1-4083dbc43cfso7362645e9.3 for ; Wed, 18 Oct 2023 12:34:50 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20230601; t=1697657688; x=1698262488; darn=freebsd.org; h=message-id:in-reply-to:to:references:date:subject:mime-version :content-transfer-encoding:from:from:to:cc:subject:date:message-id :reply-to; bh=5stROyWLXVumQB5rOGC+zvwh8UEsu5eaDKEKIEqmt4M=; b=Dk9O5YdO3COAapxulbINfrWsyDCHyVmfWra+wc0zbmsfnWd+93zBnoxuNeYMszrRi+ qWmJKKEgXgYO/3JrwOlYgz9Crp7R4mlsRvuB3xMV3xUnmClptGv16StO8KNK6le15ubg OLmZpilDIgiKk3wO45RjQkQgTqcFKGWPg2OQoRBoGJZykWHPFSLGJs0To4K7QSuqhwjV qHkw2nx1VeLE0DYkWQBd+61DDbf9kQTD5U+Pi1D4nPCwRsriPvjHryNl4DpxWjDgD4AL 8KFt4husbc5WH/CTVzR9rpSuaFDmJ9lVu867n9KODte7W4IUaPORLA8L39pZViee7i/d 40fQ== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20230601; t=1697657688; x=1698262488; h=message-id:in-reply-to:to:references:date:subject:mime-version :content-transfer-encoding:from:x-gm-message-state:from:to:cc :subject:date:message-id:reply-to; bh=5stROyWLXVumQB5rOGC+zvwh8UEsu5eaDKEKIEqmt4M=; b=K8w5MMsVq2fx37zMusHkcddzQhZ6sC2cko4n0iSINKxKBoE1LGteprLz4vdQ2dC+ur JUVM52NidtnpBvQOt553D1CqGUDMMPEypBEaE/Vm0QOmDBVD0vKmo4y/GWfgMhuSWL3A OsGJQNj+VaURwx+IsA4Mv8iPJPDDx22YIdfBQbtFlTNHKgneX1YLmMPQNq8vEm2YpUYj a0yWX2e/v+nfpy6wZWlsM0IeRANygj/EVQbfVUlrAlgVT+kp1wtaNIYo0P09U/BwQy08 THbxqY32bM7qD1Zx28PQRBEMqPCOXEmFpgi97BYPuqw7DUuaDzehlA3fWWovSqM7Wtw4 J93w== X-Gm-Message-State: AOJu0Yz/Cm+bZogpVzuvpIcNvkutEeGFQK3zj1TnkawvTOnzo0ZU/DG4 m1ccjMjSW1XRFIm9TRKCVjgyyO3vRac= X-Google-Smtp-Source: AGHT+IHBvp3cFDUW7oqnmuD87R/mEFhNpDKg1WP0Rp1ViMINw3zr6OVB7Z0OzTeKRJsAjbrhkKRBBg== X-Received: by 2002:a05:600c:3b19:b0:401:73b2:f043 with SMTP id m25-20020a05600c3b1900b0040173b2f043mr246435wms.1.1697657687815; Wed, 18 Oct 2023 12:34:47 -0700 (PDT) Received: from smtpclient.apple ([2a01:cb15:8010:2f00:57:67be:23ff:942a]) by smtp.gmail.com with ESMTPSA id l13-20020a5d480d000000b0032d9523de65sm2741683wrq.48.2023.10.18.12.34.46 for (version=TLS1_2 cipher=ECDHE-ECDSA-AES128-GCM-SHA256 bits=128/128); Wed, 18 Oct 2023 12:34:47 -0700 (PDT) From: Paul Floyd Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: quoted-printable List-Id: Technical discussions relating to FreeBSD List-Archive: https://lists.freebsd.org/archives/freebsd-hackers List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-hackers@freebsd.org Mime-Version: 1.0 (Mac OS X Mail 16.0 \(3731.700.6\)) Subject: Re: Valgrind 3.22 RC1 announced Date: Wed, 18 Oct 2023 21:34:36 +0200 References: <01a7debc-bdc4-4aba-9f8d-1b78a00aac3c@gmail.com> To: "freebsd-hackers@FreeBSD.org" In-Reply-To: Message-Id: <6509AC79-3080-42A8-8E34-87974C15491C@gmail.com> X-Mailer: Apple Mail (2.3731.700.6) X-Spamd-Bar: --- X-Spamd-Result: default: False [-3.50 / 15.00]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; NEURAL_HAM_LONG(-1.00)[-1.000]; NEURAL_HAM_SHORT(-1.00)[-0.998]; DMARC_POLICY_ALLOW(-0.50)[gmail.com,none]; MV_CASE(0.50)[]; R_DKIM_ALLOW(-0.20)[gmail.com:s=20230601]; R_SPF_ALLOW(-0.20)[+ip6:2a00:1450:4000::/36]; MIME_GOOD(-0.10)[text/plain]; FROM_HAS_DN(0.00)[]; TO_MATCH_ENVRCPT_ALL(0.00)[]; RCPT_COUNT_ONE(0.00)[1]; RCVD_IN_DNSWL_NONE(0.00)[2a00:1450:4864:20::332:from]; PREVIOUSLY_DELIVERED(0.00)[freebsd-hackers@freebsd.org]; TO_DN_EQ_ADDR_ALL(0.00)[]; RCVD_VIA_SMTP_AUTH(0.00)[]; DWL_DNSWL_NONE(0.00)[gmail.com:dkim]; MLMMJ_DEST(0.00)[freebsd-hackers@freebsd.org]; FROM_EQ_ENVFROM(0.00)[]; DKIM_TRACE(0.00)[gmail.com:+]; FREEMAIL_FROM(0.00)[gmail.com]; ARC_NA(0.00)[]; RCVD_TLS_LAST(0.00)[]; FREEMAIL_ENVFROM(0.00)[gmail.com]; MIME_TRACE(0.00)[0:+]; MID_RHS_MATCH_FROM(0.00)[]; ASN(0.00)[asn:15169, ipnet:2a00:1450::/32, country:US]; RCVD_COUNT_TWO(0.00)[2] X-Rspamd-Queue-Id: 4S9gzG6zw1z4rQ5 > On 18 Oct 2023, at 19:56, Steve Kargl = wrote: >=20 >>=20 >>=20 >=20 > Is https://bugs.kde.org/show_bug.cgi?id=3D381819 fixed? > If not, are there plans to include the patch attached > to the bug report in the FreeBSD port? >=20 Hi No, that didn=E2=80=99t make it. I ran out of time to write a test case, = plus I don=E2=80=99t have anything to test it on. It=E2=80=99s likely to be one of the next things that I try to resolve. Regards Paul From nobody Wed Oct 18 20:04:19 2023 X-Original-To: freebsd-hackers@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4S9hdL6fvlz4xSnc for ; Wed, 18 Oct 2023 20:04:22 +0000 (UTC) (envelope-from sgk@troutmask.apl.washington.edu) Received: from troutmask.apl.washington.edu (troutmask.apl.washington.edu [128.95.76.21]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4S9hdL3vXdz4tgl for ; Wed, 18 Oct 2023 20:04:22 +0000 (UTC) (envelope-from sgk@troutmask.apl.washington.edu) Authentication-Results: mx1.freebsd.org; none Received: from troutmask.apl.washington.edu (localhost [127.0.0.1]) by troutmask.apl.washington.edu (8.17.1/8.17.1) with ESMTP id 39IK4Jle089428; Wed, 18 Oct 2023 13:04:19 -0700 (PDT) (envelope-from sgk@troutmask.apl.washington.edu) Received: (from sgk@localhost) by troutmask.apl.washington.edu (8.17.1/8.17.1/Submit) id 39IK4JcA089427; Wed, 18 Oct 2023 13:04:19 -0700 (PDT) (envelope-from sgk) Date: Wed, 18 Oct 2023 13:04:19 -0700 From: Steve Kargl To: Paul Floyd Cc: "freebsd-hackers@FreeBSD.org" Subject: Re: Valgrind 3.22 RC1 announced Message-ID: Reply-To: sgk@troutmask.apl.washington.edu References: <01a7debc-bdc4-4aba-9f8d-1b78a00aac3c@gmail.com> <6509AC79-3080-42A8-8E34-87974C15491C@gmail.com> List-Id: Technical discussions relating to FreeBSD List-Archive: https://lists.freebsd.org/archives/freebsd-hackers List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-hackers@freebsd.org MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Disposition: inline Content-Transfer-Encoding: 8bit In-Reply-To: <6509AC79-3080-42A8-8E34-87974C15491C@gmail.com> X-Spamd-Bar: ---- X-Rspamd-Pre-Result: action=no action; module=replies; Message is reply to one we originated X-Spamd-Result: default: False [-4.00 / 15.00]; REPLY(-4.00)[]; ASN(0.00)[asn:73, ipnet:128.95.0.0/16, country:US] X-Rspamd-Queue-Id: 4S9hdL3vXdz4tgl On Wed, Oct 18, 2023 at 09:34:36PM +0200, Paul Floyd wrote: > > > > On 18 Oct 2023, at 19:56, Steve Kargl wrote: > > > > > > Is https://bugs.kde.org/show_bug.cgi?id=381819 fixed? > > If not, are there plans to include the patch attached > > to the bug report in the FreeBSD port? > > > No, that didn’t make it. I ran out of time to write a test > case, plus I don’t have anything to test it on. > > It’s likely to be one of the next things that I try to resolve. > Thanks for the info. That issues has been a thorn in my side while working on gcci/gfortran patches for a long time. I typically use the -mno-tbm option, but how to insure that is in effect everywhere is pain. -- Steve